CN111770373B - Content synchronization method, device and equipment based on live broadcast and storage medium - Google Patents

Content synchronization method, device and equipment based on live broadcast and storage medium Download PDF

Info

Publication number
CN111770373B
CN111770373B CN202010658703.9A CN202010658703A CN111770373B CN 111770373 B CN111770373 B CN 111770373B CN 202010658703 A CN202010658703 A CN 202010658703A CN 111770373 B CN111770373 B CN 111770373B
Authority
CN
China
Prior art keywords
content
target
live broadcast
video stream
terminal
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202010658703.9A
Other languages
Chinese (zh)
Other versions
CN111770373A (en
Inventor
王智博
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Dajia Internet Information Technology Co Ltd
Original Assignee
Beijing Dajia Internet Information Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Dajia Internet Information Technology Co Ltd filed Critical Beijing Dajia Internet Information Technology Co Ltd
Priority to CN202010658703.9A priority Critical patent/CN111770373B/en
Publication of CN111770373A publication Critical patent/CN111770373A/en
Application granted granted Critical
Publication of CN111770373B publication Critical patent/CN111770373B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/4302—Content synchronisation processes, e.g. decoder synchronisation
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/21—Server components or server architectures
    • H04N21/218—Source of audio or video content, e.g. local disk arrays
    • H04N21/2187—Live feed
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/236—Assembling of a multiplex stream, e.g. transport stream, by combining a video stream with other content or additional data, e.g. inserting a URL [Uniform Resource Locator] into a video stream, multiplexing software data into a video stream; Remultiplexing of multiplex streams; Insertion of stuffing bits into the multiplex stream, e.g. to obtain a constant bit-rate; Assembling of a packetised elementary stream
    • H04N21/23602—Multiplexing isochronously with the video sync, e.g. according to bit-parallel or bit-serial interface formats, as SDI
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/242—Synchronization processes, e.g. processing of PCR [Program Clock References]
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/4302—Content synchronisation processes, e.g. decoder synchronisation
    • H04N21/4305—Synchronising client clock from received content stream, e.g. locking decoder clock with encoder clock, extraction of the PCR packets
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/478—Supplemental services, e.g. displaying phone caller identification, shopping application

Abstract

The disclosure provides a content synchronization method, device, equipment and storage medium based on live broadcast, and belongs to the technical field of internet. The method comprises the following steps: receiving a content publishing request, wherein the content publishing request is used for indicating that target content is published when a target live video stream is played to a target time; in response to the content distribution request, transmitting the target content to at least one viewer terminal of the target live video stream; and acquiring the target live broadcast video stream added with a content display signaling at the target time, wherein the content display signaling is used for indicating the at least one audience terminal to display the target content when the content display signaling is analyzed in the process of playing the target live broadcast video stream. By the technical scheme, the content of the live video stream and the time for displaying the target content can be kept consistent, content synchronization is realized, and user experience is improved.

Description

Content synchronization method, device and equipment based on live broadcast and storage medium
Technical Field
The present disclosure relates to the field of internet technologies, and in particular, to a method, an apparatus, a device, and a storage medium for content synchronization based on live broadcast.
Background
Currently, live question answering activities are favored by more and more users, so more and more live service providers open live question answering activities. When a live broadcast service provider starts a live broadcast answering activity, after a live broadcast user proposes a question, the live broadcast user can indicate a terminal of an audience user to pop up the question and an option through triggering a question publishing operation, so that the audience user can see the popped up question and option after hearing the question proposed by the live broadcast user, and answering is carried out.
The technical scheme has the problems that as the live broadcast content watched by audience users usually has certain delay, the pop-up time of questions and answers and the question-providing time of the live broadcast users have errors, and the answer thinking of the audience users can be interrupted, so that the user experience is influenced.
Disclosure of Invention
The present disclosure provides a content synchronization method, device, equipment and storage medium based on live broadcast, which are used for solving the problem that the live broadcast content watched by audience users usually has a certain delay, so that the timing of the popup of questions and answers and the timing of the questions proposed by the live broadcast users have errors, which may interrupt the answer thinking of the audience users, thereby affecting the user experience. The technical scheme of the disclosure is as follows:
according to a first aspect of the embodiments of the present disclosure, there is provided a live broadcast-based content synchronization method, applied to a live broadcast server, including:
receiving a content publishing request, wherein the content publishing request is used for indicating that target content is published when a target live video stream is played to a target time;
in response to the content publishing request, transmitting the target content to at least one viewer terminal of the target live video stream;
and acquiring the target live broadcast video stream added with a content display signaling at the target time, wherein the content display signaling is used for indicating the at least one audience terminal to display the target content when the content display signaling is analyzed in the process of playing the target live broadcast video stream.
In an optional implementation manner, the obtaining the target live video stream added with the content presentation signaling at the target time includes:
acquiring a terminal identifier carried by the content publishing request, the target time and a content identifier of the target content;
generating a content display signaling carrying the content identification of the target content;
sending a signaling adding request carrying the target time and the content display signaling to a live broadcast terminal indicated by the terminal identification, wherein the signaling adding request is used for indicating the live broadcast terminal to add the content display signaling at the target time of the target live broadcast video stream;
and receiving the target live broadcast video stream which is sent by the live broadcast terminal and added with the content display signaling.
In an optional implementation manner, the obtaining the target live video stream added with the content presentation signaling at the target time includes:
acquiring the target time carried by the content publishing request and the content identifier of the target content;
receiving the target live broadcast video stream acquired by the live broadcast terminal in the live broadcast process;
and adding the content display signaling at the target time of the target live broadcast video stream, wherein the content display signaling carries a content identifier of the target content.
In an optional implementation manner, the target time is a first target duration, and adding the content presentation signaling at the target time of the target live video stream includes:
and continuously adding the content display signaling in the target live video stream within the first target duration.
In an optional embodiment, the target time is a first target time point, and after the content presentation signaling is added to the target time of the target live video stream, the method further includes:
and continuously adding the content display signaling in the target live video stream within a first target time length after the first target time point.
In an optional embodiment, after the target content is transmitted to at least one viewer terminal of the target live video stream, the method further comprises:
and sending a second target time point corresponding to the target content to the at least one audience terminal, wherein the second target time point is used for indicating the at least one audience terminal to display the target content at the second target time point when the content display signaling is not analyzed.
In an optional implementation manner, before the receiving the content publishing request, the method further includes:
and in response to receiving a video stream acquisition request for acquiring the target live video stream sent by at least one viewer terminal, sending the target live video stream to the at least one viewer terminal.
According to a second aspect of the embodiments of the present disclosure, a live broadcast-based content synchronization method is provided, which is applied to a live broadcast terminal, and the method includes:
sending a target live broadcast video stream acquired in a live broadcast process to a live broadcast server;
sending a content publishing request carrying a terminal identifier of the live broadcast terminal, target time and a content identifier of target content to a live broadcast server, wherein the content publishing request is used for indicating that the target content is published when the target live broadcast video stream is played to the target time;
receiving a signaling adding request which is returned by the live broadcast server and carries the target time and a content display signaling, wherein the content display signaling is generated by the live broadcast server according to the content publishing request;
and adding the content display signaling at the target time of the target live broadcast video stream according to the signaling addition request, wherein the content display signaling carries a content identifier of the target content.
In an optional implementation manner, the target time is a second target duration, and adding the content presentation signaling at the target time of the target live video stream includes:
and continuously adding the content display signaling in the target live video stream within the second target duration.
In an optional embodiment, the target time is a third target time point, and after the content presentation signaling is added to the target time of the target live video stream, the method further includes:
and continuously adding the content display signaling in the target live video stream within a second target time length after the third target time point.
According to a third aspect of the embodiments of the present disclosure, there is provided a live broadcast-based content synchronization method applied to a viewer terminal, the method including:
sending a video stream acquisition request for acquiring a target live broadcast video stream to a live broadcast server, and playing the received target live broadcast video stream;
caching target content sent by the live broadcast server;
responding to a content display signaling analyzed in the process of playing the target live broadcast video stream, and displaying the target content according to the content display signaling, wherein the content display signaling carries a content identifier of the target content.
In an optional implementation manner, the presenting the target content according to the content presentation signaling includes:
acquiring a content identifier of the target content carried by the content display signaling;
acquiring the target content from the plurality of cached contents according to the content identification;
and displaying the target content.
According to a fourth aspect of the embodiments of the present disclosure, there is provided a live broadcast-based content synchronization method applied to a live broadcast system, where the live broadcast system includes a live broadcast terminal, a live broadcast server, and at least one viewer terminal, the method including:
the live broadcast terminal sends a target live broadcast video stream acquired in a live broadcast process to the live broadcast server;
the live broadcast server responds to a content publishing request sent by the live broadcast terminal, and sends target content to at least one audience terminal of the target live broadcast video stream, wherein the content publishing request is used for indicating that the target content is published when the target live broadcast video stream is played to a target time;
the live broadcast server acquires the target live broadcast video stream added with the content display signaling at the target time;
and the at least one audience terminal caches the target content, analyzes the content display signaling in the process of responding to the target live broadcast video stream acquired from the live broadcast server, and displays the target content.
In an optional implementation manner, the acquiring, by the live server, the target live video stream added with the content presentation signaling at the target time includes:
the live broadcast server acquires a terminal identifier carried by a content release request sent by the live broadcast terminal, the target time and a content identifier of the target content;
the live broadcast server generates a content display signaling carrying a content identifier of the target content;
the live broadcast server sends a signaling adding request carrying the target time and the content display signaling to the live broadcast terminal indicated by the terminal identification, wherein the signaling adding request is used for indicating the live broadcast terminal to add the content display signaling at the target time of the target live broadcast video stream;
and the live broadcast server receives the target live broadcast video stream which is sent by the live broadcast terminal and added with the content display signaling.
In an optional implementation manner, after the live broadcast server sends a signaling addition request carrying the target time and the content display signaling to the live broadcast terminal indicated by the terminal identifier, the method further includes:
the live broadcast terminal receives a signaling adding request which is returned by the live broadcast server and carries the target time and the content display signaling;
the live broadcast terminal adds the content display signaling at the target time of the target live broadcast video stream according to the signaling addition request;
and the live broadcast terminal sends the target live broadcast video stream added with the content display signaling to the live broadcast server.
In an optional implementation manner, the target time is a second target duration, and the adding, by the live broadcast terminal, the content display signaling at the target time of the target live broadcast video stream according to the signaling addition request includes:
and the live broadcast terminal continuously adds the content display signaling in the target live broadcast video stream within the second target time length according to the signaling adding request.
In an optional implementation manner, the target time is a third target time point, and after the live broadcast terminal adds the content display signaling at the target time of the target live broadcast video stream according to the signaling addition request, the method further includes:
and the live broadcast terminal continuously adds the content display signaling in the target live broadcast video stream within a second target time length after the third target time point according to the signaling addition request.
In an optional implementation manner, the acquiring, by the live server, the target live video stream added with the content presentation signaling at the target time includes:
the live broadcast server acquires the target time carried by the content publishing request and the content identifier of the target content;
the live broadcast server receives the target live broadcast video stream acquired by the live broadcast terminal in the live broadcast process;
and the live broadcast server adds the content display signaling at the target time of the target live broadcast video stream, wherein the content display signaling carries the content identification of the target content.
In an optional implementation manner, the target time is a first target duration, and the adding, by the live broadcast server, the content presentation signaling at the target time of the target live broadcast video stream includes:
and the live broadcast server continuously adds the content display signaling in the target live broadcast video stream within the first target time length.
In an optional implementation manner, the target time is a first target time point, and after the live server adds the content presentation signaling to the target time of the target live video stream, the method further includes:
and the live broadcast server continuously adds the content display signaling in the target live broadcast video stream within a first target time length after the first target time point.
In an optional implementation manner, after the live broadcast server sends the target content to at least one viewer terminal of the target live broadcast video stream in response to the content publishing request sent by the live broadcast terminal, the method further includes:
and the live broadcast server sends a second target time point corresponding to the target content to the at least one audience terminal, wherein the second target time point is used for indicating the at least one audience terminal to display the target content at the second target time point when the content display signaling is not analyzed.
According to a fifth aspect of the embodiments of the present disclosure, there is provided a live broadcast-based content synchronization apparatus, applied to a live broadcast server, including:
a first request receiving unit configured to perform receiving a content distribution request indicating that a target content is distributed when a target live video stream is played to a target time;
a content transmitting unit configured to perform transmitting the target content to at least one viewer terminal of the target live video stream;
a video stream obtaining unit configured to perform obtaining of the target live video stream to which a content presentation signaling is added at the target time, where the content presentation signaling is used to instruct the at least one viewer terminal to present the target content when the content presentation signaling is analyzed in a process of playing the target live video stream.
In an optional implementation manner, the video stream obtaining unit is configured to perform obtaining of a terminal identifier carried by the content publishing request, the target time, and a content identifier of the target content; generating a content display signaling carrying the content identification of the target content; sending a signaling adding request carrying the target time and the content display signaling to a live broadcast terminal indicated by the terminal identification, wherein the signaling adding request is used for indicating the live broadcast terminal to add the content display signaling at the target time of the target live broadcast video stream; and receiving the target live broadcast video stream which is sent by the live broadcast terminal and added with the content display signaling.
In an optional implementation manner, the video stream acquiring unit includes:
the obtaining subunit is configured to perform obtaining of the target time carried by the content publishing request and the content identifier of the target content;
a video stream receiving subunit configured to execute receiving of the target live video stream acquired by the live terminal in a live broadcasting process;
a signaling adding subunit, configured to add the content display signaling at the target time of the target live broadcast video stream, where the content display signaling carries a content identifier of the target content.
In an optional embodiment, the target time is a first target duration, and the signaling adding subunit is configured to continue adding the content presentation signaling in the target live video stream for the first target duration.
In an optional implementation manner, the target time is a first target time point, and the signaling adding subunit is configured to perform, for a first target duration after the first target time point, continuously adding the content presentation signaling to the target live video stream.
In an optional implementation manner, the content sending unit is further configured to perform sending, to the at least one viewer terminal, a second target time point corresponding to the target content, where the second target time point is used to instruct the at least one viewer terminal to present the target content at the second target time point when the content presentation signaling is not parsed out.
In an alternative embodiment, the apparatus further comprises:
the first video stream transmitting unit is configured to execute the transmission of the target live video stream to at least one viewer terminal in response to the reception of a video stream acquisition request transmitted by the at least one viewer terminal for acquiring the target live video stream.
According to a sixth aspect of the embodiments of the present disclosure, there is provided a live broadcast-based content synchronization apparatus, applied to a live broadcast terminal, the apparatus including:
a second video stream sending unit configured to execute sending of a target live video stream acquired in a live broadcast process to a live broadcast server;
a first request sending unit, configured to execute sending, to a live broadcast server, a content publishing request carrying a terminal identifier of the live broadcast terminal, a target time, and a content identifier of a target content, where the content publishing request is used to instruct to publish the target content when the target live broadcast video stream is played to the target time;
a second request receiving unit, configured to execute receiving a signaling addition request carrying the target time and a content display signaling returned by the live broadcast server, where the content display signaling is generated by the live broadcast server according to the content release request;
and the signaling adding unit is configured to add the content display signaling in the target time of the target live broadcast video stream according to the signaling adding request, wherein the content display signaling carries a content identifier of the target content.
In an optional implementation manner, the target time is a second target duration, and the signaling adding unit is configured to perform adding the content presentation signaling in the target live video stream continuously within the second target duration.
In an optional implementation manner, the target time is a third target time point, and the signaling adding unit is configured to perform adding the content presentation signaling in the target live video stream continuously for a second target time duration after the third target time point.
According to a seventh aspect of the embodiments of the present disclosure, there is provided a live broadcast-based content synchronization apparatus, applied to a viewer terminal, the apparatus including:
a second request sending unit configured to execute sending a video stream acquisition request for acquiring a target live video stream to a live server, and play the received target live video stream;
a content caching unit configured to perform caching of target content sent by the live broadcast server;
and the content display unit is configured to execute a content display signaling analyzed in the process of playing the target live video stream, and display the target content according to the content display signaling, wherein the content display signaling carries the content identifier of the target content.
In an optional implementation manner, the content presentation unit is configured to perform obtaining of a content identifier of the target content carried by the content presentation signaling; acquiring the target content from the plurality of cached contents according to the content identification; and displaying the target content.
According to an eighth aspect of embodiments of the present disclosure, there is provided a computer device, which may be configured as a server, the server comprising:
one or more processors;
a memory for storing the processor executable program code;
wherein the processor is configured to execute the program code to implement the live based content synchronization method provided in the first aspect.
According to a ninth aspect of embodiments of the present disclosure, there is provided a storage medium having program code that, when executed by a processor of a server, enables the server to perform the live broadcast-based content synchronization method provided by the first aspect described above.
According to a tenth aspect of embodiments of the present disclosure, there is provided a computer device, which may be configured as a terminal, the terminal comprising:
one or more processors;
a memory for storing the processor executable program code;
wherein the processor is configured to execute the program code to implement the live-based content synchronization method provided by the second aspect; or, the content synchronization method based on live broadcast provided by the third aspect is implemented.
According to an eleventh aspect of embodiments of the present disclosure, there is provided a storage medium having program code that, when executed by a processor of a terminal, enables the terminal to perform the live broadcast-based content synchronization method provided by the second aspect described above; or, implementing the live broadcast-based content synchronization method provided by the third aspect.
According to a twelfth aspect of embodiments of the present disclosure, there is provided an application program product storing one or more program codes executable by a processor of a server or a terminal to perform the live based content synchronization method provided by the above aspects or alternative implementations of the aspects.
The technical scheme provided by the embodiment of the disclosure at least brings the following beneficial effects:
the target content is sent to at least one audience terminal of the target live broadcast video stream by responding to a content publishing request for indicating to publish the target content when the target live broadcast video stream is played to the target time, and the target live broadcast video stream added with the content display signaling at the target time is obtained, so that the target content is displayed if the content display signaling is analyzed in the process of playing the target live broadcast video stream by the at least one audience terminal, the video content of the live broadcast video stream and the opportunity of displaying the target content are kept consistent, content synchronization is realized, and user experience is improved.
It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the disclosure.
Drawings
The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present disclosure and, together with the description, serve to explain the principles of the disclosure and are not to be construed as limiting the disclosure.
Fig. 1 is a diagram illustrating an implementation environment of a live-based content synchronization method according to an exemplary embodiment.
Fig. 2 is a flow diagram illustrating a method for live based content synchronization in accordance with an exemplary embodiment.
Fig. 3 is a flow diagram illustrating another live based content synchronization method in accordance with an example embodiment.
Fig. 4 is a flow diagram illustrating another live based content synchronization method in accordance with an example embodiment.
Fig. 5 is an interaction flow diagram illustrating a method for live-based content synchronization in accordance with an exemplary embodiment.
Fig. 6 is an interaction flow diagram illustrating another live-based content synchronization method in accordance with an exemplary embodiment.
Fig. 7 is a diagram illustrating a display answer popup control in accordance with an exemplary embodiment.
FIG. 8 is a diagram illustrating another display of an answer popup control, according to an exemplary embodiment.
Fig. 9 is a flow diagram illustrating another live based content synchronization method in accordance with an example embodiment.
Fig. 10 is a flow diagram illustrating another live based content synchronization method in accordance with an example embodiment.
Fig. 11 is a diagram illustrating interaction between a anchor terminal, a director terminal, a source station server, a live companion server, a content distribution server, and at least one viewer terminal according to an illustrative embodiment.
Fig. 12 is a block diagram illustrating a live based content synchronization apparatus according to an example embodiment.
Fig. 13 is a block diagram illustrating another live based content synchronization apparatus according to an example embodiment.
Fig. 14 is a block diagram illustrating another live-based content synchronization apparatus in accordance with an example embodiment.
Fig. 15 is a block diagram of a terminal shown in accordance with an example embodiment.
Fig. 16 is a block diagram illustrating a live server in accordance with an example embodiment.
Detailed Description
In order to make the technical solutions of the present disclosure better understood by those of ordinary skill in the art, the technical solutions in the embodiments of the present disclosure will be clearly and completely described below with reference to the accompanying drawings.
It should be noted that the terms "first," "second," and the like in the description and claims of the present disclosure and in the above-described drawings are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used is interchangeable under appropriate circumstances such that the embodiments of the disclosure described herein are capable of operation in sequences other than those illustrated or otherwise described herein. The implementations described in the exemplary embodiments below are not intended to represent all implementations consistent with the present disclosure. Rather, they are merely examples of apparatus and methods consistent with certain aspects of the present disclosure, as detailed in the following claims
The user information to which the present disclosure relates may be information authorized by the user or sufficiently authorized by each party.
Some techniques to which the present disclosure relates are described below:
the AVC (Audio Video Coding ) technology means that Audio and Video data is coded into a piece of data through a specific algorithm and format so as to be transmitted over the internet, or a piece of data is decoded into Audio and Video data so as to be played at a terminal.
The AACS (Advanced Audio Coding Service) technology is to insert AAC (Advanced Audio Coding) coded data in a specific format (e.g., flv) when the AVC technology is used to code Audio and video data, and the terminal can decode the AAC coded data in the specific format when the AVC is used to decode the Audio and video data, and then achieve the effect of aligning the AAC signaling with the Audio and video data. It is possible to determine whether or not the av is played to a specified time (i.e., a time at which the AAC data is inserted) by this technique.
The LCS (Long Connection Service) technique is used for the back-end to issue the instruction to the terminal for execution. The LCS system establishes a Socket channel between the terminal and the remote server, the transmitted command is processed by a Protocol Buffer and transmitted to the terminal in a binary form, and the terminal parses the command by the Protocol Buffer and executes the command operation.
Fig. 1 is a diagram illustrating an implementation environment of a live-based content synchronization method according to an exemplary embodiment. Referring to fig. 1, the implementation environment specifically includes: a terminal 101 and a live server 102.
The terminal 101 may be at least one of a smartphone, a smartwatch, a desktop computer, a laptop computer, an MP3 player, an MP4 player, a laptop portable computer, and the like. The terminal 101 may be connected to the live server 102 through a wireless network or a wired network. A client may be installed and operated on the terminal 101, where the client may be used to log in an account of a live user or an account of an audience user, and if the client logs in the account of the live user, the terminal 101 may be used to encode a live video stream acquired in real time in a live broadcast process, and then upload the encoded live video stream to the live broadcast server 102; if the client logs in an account of the viewer user, the terminal 101 may be configured to acquire a live video stream from the live server 102, and then decode the acquired live video stream and render and play the live video stream. Or, a client for live broadcasting or a client for watching live broadcasting may be installed and operated on the terminal 101, and a live broadcasting user may encode a live broadcasting video stream acquired in real time in a live broadcasting process through the client for live broadcasting and then upload the encoded live broadcasting video stream to the live broadcasting server 102; the viewer user may obtain a live video stream from the live server 102 through a client for viewing live, and then decode the obtained live video stream and render and play the video stream.
The terminal 101 may be generally referred to as one of a plurality of terminals, and the embodiment is only illustrated by the terminal 101. Those skilled in the art will appreciate that the number of terminals described above may be greater or fewer. For example, the number of the terminals 101 may be only a few, or the number of the terminals 101 may be tens or hundreds, or more, and the number of the terminals 101 and the type of the device are not limited in the embodiment of the present disclosure.
The live server 102 may be at least one of a server, a plurality of servers, a cloud computing platform, and a virtualization center. The live broadcast server 102 may be connected to the terminal 101 and other terminals through a wireless network or a wired network, and the live broadcast server 102 may receive a live broadcast video stream sent by the live broadcast terminal 103 and may also send a signaling addition request to the live broadcast terminal 103. The live server 102 may also transmit targeted content and live video streams to the viewer terminals 101. Optionally, the number of the live servers 102 may be more or less, and the embodiment of the disclosure does not limit this. Of course, the live server 102 may also include other functional servers to provide more comprehensive and diverse services.
In an optional implementation manner, the live broadcast-based content synchronization method can be applied to a live broadcast answering activity scene, and is implemented based on interaction among audience terminals, a live broadcast terminal and a live broadcast server. The live broadcast answer activity means that a live broadcast user can continuously ask questions in the live broadcast process, audience users watching the live broadcast can answer the questions according to the questions and options popped up by the terminal, and a live broadcast service provider can provide rewards for the audience users according to the answer conditions of the audience users. Through the live broadcast answer activity, the frequency of using the live broadcast application program by the user can be increased, and the marketing activity can be carried out in the live broadcast answer process.
Fig. 2 is a flowchart illustrating a live broadcast-based content synchronization method according to an exemplary embodiment, and referring to fig. 2, the method is applied to a live broadcast server, and includes the specific steps of:
in step S201, the live server receives a content distribution request indicating that the target content is distributed when the target live video stream is played to the target time.
In response to the content distribution request, the live server transmits the target content to at least one viewer terminal of the target live video stream in step S202.
In step S203, the live broadcast server obtains the target live broadcast video stream with a content presentation signaling added at the target time, where the content presentation signaling is used to instruct the at least one viewer terminal to present the target content when the content presentation signaling is analyzed in the process of playing the target live broadcast video stream.
According to the scheme provided by the embodiment of the disclosure, a content publishing request for indicating that the target content is published when the target live video stream is played to the target time is responded, the target content is sent to at least one audience terminal of the target live video stream, and the target live video stream added with the content display signaling at the target time is obtained, so that the target content is displayed if the content display signaling is analyzed in the process of playing the target live video stream by the at least one audience terminal, and therefore, the video content of the live video stream and the opportunity of displaying the target content can be kept consistent, content synchronization is realized, and user experience is improved.
In an optional embodiment, the obtaining the target live video stream with the content presentation signaling added at the target time includes:
acquiring a terminal identifier carried by the content publishing request, the target time and a content identifier of the target content;
generating a content display signaling carrying the content identification of the target content;
sending a signaling adding request carrying the target time and the content display signaling to a live broadcast terminal indicated by the terminal identifier, wherein the signaling adding request is used for indicating the live broadcast terminal to add the content display signaling at the target time of the target live broadcast video stream;
and receiving the target live broadcast video stream which is sent by the live broadcast terminal and added with the content display signaling.
In an optional embodiment, the obtaining the target live video stream with the content presentation signaling added at the target time includes:
acquiring the target time carried by the content publishing request and the content identifier of the target content;
receiving the target live broadcast video stream acquired by the live broadcast terminal in the live broadcast process;
and adding the content display signaling at the target time of the target live video stream, wherein the content display signaling carries the content identifier of the target content.
In an optional embodiment, the target time is a first target duration, and the adding the content presentation signaling at the target time of the target live video stream includes:
and continuously adding the content display signaling in the target live video stream within the first target duration.
In an optional embodiment, the target time is a first target time point, and after the content presentation signaling is added to the target time of the target live video stream, the method further includes:
and continuously adding the content display signaling in the target live video stream within a first target time length after the first target time point.
In an optional embodiment, after the target content is transmitted to the at least one viewer terminal of the target live video stream, the method further comprises:
and sending a second target time point corresponding to the target content to the at least one viewer terminal, wherein the second target time point is used for indicating the at least one viewer terminal to display the target content at the second target time point when the content display signaling is not analyzed.
In an optional implementation manner, before the receiving the content publishing request, the method further includes:
and in response to receiving a video stream acquisition request for acquiring the target live video stream sent by at least one viewer terminal, sending the target live video stream to the at least one viewer terminal.
Fig. 3 is a flowchart illustrating another live-based content synchronization method according to an exemplary embodiment, and referring to fig. 3, the method is applied to a live terminal, and includes the following specific steps:
in step S301, the live broadcast terminal sends a target live broadcast video stream acquired in the live broadcast process to the live broadcast server.
In step S302, the live broadcast terminal sends a content publishing request carrying a terminal identifier of the live broadcast terminal, a target time, and a content identifier of a target content to the live broadcast server, where the content publishing request is used to instruct to publish the target content when the target live broadcast video stream is played to the target time.
In step S303, the live broadcast terminal receives a signaling addition request carrying the target time and the content display signaling returned by the live broadcast server, where the content display signaling is generated by the live broadcast server according to the content release request.
In step S304, the live broadcast terminal adds the content display signaling at the target time of the target live broadcast video stream according to the signaling addition request, where the content display signaling carries the content identifier of the target content.
The scheme provided by the embodiment of the disclosure enables at least one audience terminal to obtain a live broadcast video stream through the live broadcast server by sending the target live broadcast video stream collected in the live broadcast process to the live broadcast server, then sends a content release request carrying a terminal identifier of the live broadcast terminal, a target time and a content identifier of target content to the live broadcast server, then receives a signaling addition request carrying the target time and a content display signaling generated by the live broadcast server according to the content release request, adds the target time of the target live broadcast video stream based on the signaling addition request, adds the content display signaling carrying the content identifier of the target content, enables the at least one audience terminal to display the target content if analyzing the content display signaling in the process of playing the target live broadcast video stream, thereby ensuring that the video content of the live broadcast video stream and the opportunity of displaying the target content are kept consistent, content synchronization is realized, and user experience is improved.
In an optional embodiment, the target time is a second target duration, and the adding the content presentation signaling at the target time of the target live video stream includes:
and continuously adding the content display signaling in the target live video stream within the second target time length.
In an optional embodiment, the target time is a third target time point, and after the content presentation signaling is added to the target time of the target live video stream, the method further includes:
and continuously adding the content display signaling in the target live video stream within a second target time length after the third target time point.
Fig. 4 is a flowchart illustrating another live-based content synchronization method according to an exemplary embodiment, referring to fig. 4, applied to a viewer terminal, the method includes the following specific steps:
in step S401, the viewer terminal sends a video stream acquisition request for acquiring a target live video stream to the live server, and plays the received target live video stream.
In step S402, the viewer terminal caches the target content transmitted by the live server.
In step S403, in response to parsing out a content display signaling in the process of playing the target live video stream, the audience terminal displays the target content according to the content display signaling, where the content display signaling carries a content identifier of the target content.
According to the scheme provided by the embodiment of the disclosure, the target content sent by the live broadcast server is cached, and the target live broadcast video stream obtained from the live broadcast server is played, so that the target content is displayed if the content display signaling is analyzed in the process of playing the target live broadcast video stream by the audience terminal, the video content of the live broadcast video stream and the opportunity of displaying the target content are kept consistent, the content synchronization is realized, and the user experience is improved.
In an optional embodiment, the presenting the target content according to the content presentation signaling includes:
acquiring the content identifier of the target content carried by the content display signaling;
acquiring the target content from the plurality of cached contents according to the content identification;
and displaying the target content.
Fig. 5 is an interaction flowchart of a live-based content synchronization method according to an exemplary embodiment, and referring to fig. 5, the method is applied to a live system, the live system includes a live terminal, a live server and at least one viewer terminal, and the method includes the following specific steps:
in step S501, the live broadcast terminal sends a target live broadcast video stream acquired in a live broadcast process to the live broadcast server;
in step S502, the live broadcast server sends a target content to at least one viewer terminal of the target live broadcast video stream in response to a content publishing request sent by the live broadcast terminal, where the content publishing request is used to instruct to publish the target content when the target live broadcast video stream is played to a target time;
in step S503, the live broadcast server acquires the target live broadcast video stream with the content display signaling added at the target time;
in step S504, the at least one viewer terminal caches the target content, and analyzes the content display signaling in response to playing the target live video stream acquired from the live server, so as to display the target content.
According to the scheme provided by the embodiment of the disclosure, a target live broadcast video stream acquired in a live broadcast process is sent to a live broadcast server through a live broadcast terminal, the live broadcast server responds to a content release request for indicating that a target content is released when the target live broadcast video stream is played to a target time, the target content is sent to at least one audience terminal of the target live broadcast video stream, and the target live broadcast video stream which is sent by the live broadcast terminal and is added with a content display signaling at the target time is obtained, so that the target content is displayed if the content display signaling is analyzed in the process of playing the target live broadcast video stream by the at least one audience terminal, the video content of the live broadcast video stream and the opportunity of displaying the target content can be kept consistent, content synchronization is realized, and user experience is improved.
In an optional embodiment, the live server obtains the target live video stream with added content presentation signaling at the target time, including:
the live broadcast server acquires a terminal identifier carried by a content release request sent by the live broadcast terminal, the target time and a content identifier of the target content;
the live broadcast server generates a content display signaling carrying a content identifier of the target content;
the live broadcast server sends a signaling adding request carrying the target time and the content display signaling to the live broadcast terminal indicated by the terminal identifier, wherein the signaling adding request is used for indicating the live broadcast terminal to add the content display signaling at the target time of the target live broadcast video stream;
and the live broadcast server receives the target live broadcast video stream which is sent by the live broadcast terminal and added with the content display signaling.
In an optional implementation manner, after the live broadcast server sends, to the live broadcast terminal indicated by the terminal identifier, a signaling addition request carrying the target time and the content display signaling, the method further includes:
the live broadcast terminal receives a signaling adding request which is returned by the live broadcast server and carries the target time and the content display signaling;
the live broadcast terminal adds the content display signaling in the target time of the target live broadcast video stream according to the signaling addition request;
and the live broadcast terminal sends the target live broadcast video stream added with the content display signaling to the live broadcast server.
In an optional implementation manner, the target time is a second target duration, and the adding, by the live broadcast terminal, the content display signaling at the target time of the target live broadcast video stream according to the signaling addition request includes:
and the live broadcast terminal continuously adds the content display signaling in the target live broadcast video stream within the second target time length according to the signaling adding request.
In an optional implementation manner, the target time is a third target time point, and after the live terminal adds the content presentation signaling at the target time of the target live video stream according to the signaling addition request, the method further includes:
and the live broadcast terminal continuously adds the content display signaling into the target live broadcast video stream within a second target time length after the third target time point according to the signaling addition request.
In an optional embodiment, the live server obtains the target live video stream with added content presentation signaling at the target time, including:
the live broadcast server acquires the target time carried by the content publishing request and the content identifier of the target content;
the live broadcast server receives the target live broadcast video stream acquired by the live broadcast terminal in the live broadcast process;
and the live broadcast server adds the content display signaling at the target time of the target live broadcast video stream, wherein the content display signaling carries the content identification of the target content.
In an optional implementation manner, the target time is a first target duration, and the adding, by the live server, the content presentation signaling at the target time of the target live video stream includes:
and the live broadcast server continuously adds the content display signaling in the target live broadcast video stream within the first target time length.
In an optional embodiment, the target time is a first target time point, and after the live server adds the content presentation signaling to the target time of the target live video stream, the method further includes:
and the live broadcast server continuously adds the content display signaling in the target live broadcast video stream within a first target time length after the first target time point.
In an optional implementation manner, after the live server sends the target content to at least one viewer terminal of the target live video stream in response to the content publishing request sent by the live terminal, the method further includes:
the live broadcast server sends a second target time point corresponding to the target content to the at least one audience terminal, and the second target time point is used for indicating the at least one audience terminal to display the target content at the second target time point when the content display signaling is not analyzed.
Fig. 2 to fig. 5 are only basic flows of the present disclosure, and the scheme provided by the present disclosure is further explained below based on a specific implementation, and fig. 6 is an interaction flow diagram of another live-based content synchronization method according to an exemplary embodiment. Taking the application to a live system as an example, the live system includes a live terminal, a live server, and at least one viewer terminal, referring to fig. 6, the method includes:
in step S601, the live broadcast terminal sends a target live broadcast video stream acquired in a live broadcast process to the live broadcast server.
In the embodiment of the disclosure, a live user can acquire audio and video data in a live process through audio and video acquisition equipment, and then encode the acquired data through a live terminal to send the data to a live server in a live video stream mode.
For example, taking a live broadcast answering scene as an example, a live broadcast user, namely a main broadcast, records a live broadcast site through a camera during live broadcast, and the live broadcast terminal performs AVC encoding on a recorded live broadcast video and then uploads the encoded live broadcast video to a live broadcast server.
It should be noted that, for any live terminal, the live terminal may send a live request to the live server, and the live server provides resources required for live broadcast for the live terminal according to the live request. And the live broadcast terminal sends the target live broadcast video stream acquired in the live broadcast process to the live broadcast server through a video stream transmission channel established by the live broadcast server. The live broadcast server can simultaneously receive live broadcast video streams uploaded by a plurality of live broadcast terminals, and can distinguish the received live broadcast video streams according to the terminal identifications of the live broadcast terminals sending the live broadcast video streams.
In step S602, any viewer terminal sends a video stream acquisition request for acquiring a target live video stream to the live server, and plays the received target live video stream.
In the embodiment of the present disclosure, the viewer terminal that requests the target live video stream from the live server, that is, the terminal used by the viewer user who is watching the live video stream, may be referred to as the viewer terminal of the target live video stream, and the viewer terminal of the target live video stream may be at least one. The live broadcast server can establish the corresponding relation between the live broadcast video stream and the audience terminal when the audience terminal requests the live broadcast video stream.
In step S603, the live broadcast terminal sends, to the live broadcast server, a content publishing request carrying a terminal identifier of the live broadcast terminal, a target time, and a content identifier of the target content, where the content publishing request is used to instruct to publish the target content when the target live broadcast video stream is played to the target time.
It should be noted that, in the live broadcast process, if the live broadcast terminal detects a content distribution operation, the live broadcast terminal may generate a content distribution request, where the content distribution request may carry a terminal identifier of the live broadcast terminal, a content identifier of a target content, and a target time for distributing the target content. In the live broadcast process, the live broadcast terminal can send at least one content publishing request carrying different content identifications and different target times to the live broadcast server so as to indicate that different contents are published when the target live broadcast video stream is played to different times.
For example, continuing with the above live question answering scenario as an example, after a live user recites a question in the live broadcasting process, a terminal of a viewer user watching the live broadcasting will play a live video stream of the topic recited by the live user about 4 to 6 seconds later, and at this time, the topic content and the option content need to be published at the terminal. A live broadcast user can trigger generation of a title publishing request through a title publishing operation, and then trigger a time of live broadcast video stream recording during the title publishing operation, for example, a time when the live broadcast user says "please listen to the title", namely, target time for displaying title content and option content during playing of the live broadcast video stream, or within a time period of 1 second to 2 seconds after the live broadcast user says "please listen to the title", namely, target time for displaying the title content and the option content during playing of the live broadcast video stream. The live broadcast terminal can send a content publishing request carrying the terminal identifier of the live broadcast terminal, the target time for triggering the topic publishing operation and the topic identifier to the server.
In step S604, the live server receives the content distribution request.
In the embodiment of the present disclosure, the live server may execute step S604 to send the target content to at least one viewer terminal of the target live video stream in response to the received content publishing request.
In step S605, the live server transmits the target content to at least one viewer terminal of the target live video stream.
In the embodiment of the present disclosure, after receiving a content publishing request sent by a live terminal, a live server may determine a target live video stream sent by the live terminal according to a terminal identifier carried in the content publishing request. And then, based on the corresponding relation between the live video stream and the audience terminals, target content is sent to at least one audience terminal of the target live video stream. The target content can be the title, option, answer, ranking information and the like to be published.
For example, continuing to take the above live question answering scenario as an example, if 100 users watch live broadcast of anchor a, that is, live broadcast question answering activity, the corresponding relationship between the terminal identifier of the audience terminal used by the 100 users and the video stream identifier of the live broadcast video stream of the anchor a is stored in the live broadcast server, and the live broadcast server may send the title, the option, and the like to the audience terminals of the 100 users according to the terminal identifier of the audience terminal.
It should be noted that, before the live broadcast server sends the target content to the at least one viewer terminal, the live broadcast server may encode the received target live broadcast video stream, such as compressing or changing a video format, and then, in response to receiving video stream acquisition requests respectively sent by the at least one viewer terminal to acquire the target live broadcast video stream, the live broadcast server may send the target live broadcast video stream to the at least one viewer terminal.
In step S606, the live broadcast server acquires a target live broadcast video stream to which a content presentation signaling is added at a target time.
In the embodiment of the present disclosure, the content display signaling may be added to the target live video stream by the live server, or may be added to the target live video stream by the live terminal.
In an optional implementation manner, when the content display signaling is added to the target live broadcast video stream by the live broadcast terminal, the step of the live broadcast server acquiring the target live broadcast video stream to which the content display signaling is added at the target time is as follows: the live broadcast server can acquire the terminal identifier, the target time and the content identifier of the target content carried by the content publishing request, and then generate a content display signaling carrying the content identifier of the target content. The live broadcast server can send a signaling adding request carrying the target time and the content display signaling to the live broadcast terminal indicated by the terminal identification, wherein the signaling adding request is used for indicating the live broadcast terminal to add the content display signaling at the target time of the target live broadcast video stream. The live broadcast server can receive a target live broadcast video stream which is sent by the live broadcast terminal and added with the content display signaling. The content display signaling is generated by the live broadcast server, and then the live broadcast terminal adds the content display signaling, so that the live broadcast terminal can complete the addition of the content display signaling when encoding the acquired target live broadcast video stream, and the adding efficiency is high.
For example, continuing to take the live broadcast question answering scenario as an example, after receiving a question issuing request sent by a live broadcast terminal at a time point of "please listen to the question", the live broadcast server may generate an AAC signaling carrying a question number, add the AAC signaling and the time point of "please listen to the question" to the signaling addition request, and send the signaling addition request to the live broadcast terminal according to the terminal identifier.
In an optional implementation manner, when the content display signaling is added to the target live broadcast video stream by the live broadcast server, the step of the live broadcast server acquiring the target live broadcast video stream to which the content display signaling is added at the target time is as follows: the server can obtain target time carried by the content publishing request and a content identifier of the target content, and then receives a target live broadcast video stream acquired by the live broadcast terminal in the live broadcast process. The server can add a content display signaling at the target time of the target live broadcast video stream, wherein the content display signaling carries a content identifier of the target content. The content display signaling is added to the target time of the target live broadcast video stream by the live broadcast server, so that the step of sending a signaling addition request to the live broadcast terminal is reduced, the whole process is simplified, and the addition efficiency is improved.
The target time may be a time point or a time period. When the target time is a time period, the target time is a first target time period, and the first target time period may be 100 milliseconds, 200 milliseconds, or the like. The live broadcast server can continuously add a content display signaling in the target live broadcast video stream within the first target duration. When the target time is a time point, and the target time is a first target time point, the live broadcast server can continuously add the content display signaling in the target live broadcast video stream within a first target time length after the first target time point after adding the content display signaling in the first target time point of the target live broadcast video stream. By continuously adding the content display signaling, the problem that the content display signaling is lost due to the loss of the audio and video frames corresponding to the first target time point caused by the reasons of network blockage and the like can be avoided, the content display signaling can play a role, and the robustness of the content display signaling is improved.
Similarly, when the live broadcast terminal adds the content display signaling at the target time of the target live broadcast video stream, the target time can be a time point or a time period. When the target time is a time period, the target time is a second target time period, and the second target time period may be 100 milliseconds, 200 milliseconds, or the like. The live broadcast terminal can continuously add the content display signaling in the target live broadcast video stream within the second target duration. When the target time is a time point and the target time is a third target time point, the live broadcast server can continuously add the content display signaling in the target live broadcast video stream within a second target time duration after the third target time point after adding the content display signaling in the third target time point of the target live broadcast video stream. By continuously adding the content display signaling, the problem that the content display signaling is lost due to the loss of the audio and video frames corresponding to the third target time point caused by the reasons of network blockage and the like can be avoided, the content display signaling can play a role, and the robustness of the content display signaling is increased.
It should be noted that the live broadcast server is further capable of sending a second target time point corresponding to the target content to the at least one viewer terminal, where the second target time point is used to instruct the at least one viewer terminal to display the target content at the second target time point when the content display signaling is not parsed out. Due to the fact that the second target time point is set, when the target live broadcast video stream cannot be obtained due to poor network of the audience terminal, the questions and options can be displayed based on the second target time point, so that the audience user can also participate in answering under the condition of poor network, and better experience is brought to the audience user.
In step S607, at least one viewer terminal caches the target content, parses a content presentation signaling in response to playing the target live video stream acquired from the live server, and presents the target content according to the content presentation signaling.
In this embodiment, for any of the at least one viewer terminal, after receiving the target content sent by the live broadcast terminal, the viewer terminal may cache the target content in a storage space of the viewer terminal. The audience terminal can also continuously acquire a target live broadcast video stream from the live broadcast server, decode the acquired live broadcast video stream and render and play audio and video obtained by decoding.
It should be noted that, when the audience terminal decodes the target live video stream, if the content display signaling is added to the target live video stream, the audience terminal may also obtain the content display signaling by parsing from the target live video stream. The audience terminal can obtain the cached target content according to the content identification carried in the content display signaling based on the analyzed content display signaling, and display the target content.
For example, continuing to take the above live broadcast answer scenario as an example, the viewer terminal acquires a live broadcast video stream from the live broadcast server, decodes the acquired live broadcast video stream through the AVC technique, and renders the decoded live broadcast video stream and plays the rendered live broadcast video stream. If the audience terminal analyzes the AAC signaling added by the live broadcast terminal when decoding the live broadcast video stream, the audience terminal can acquire the cached titles and options according to the AAC signaling.
It should be noted that the audience terminal may add the target content to the display control for display, the display control may be set with display time, and when the display time ends, the terminal may cancel displaying the display control and delete the cached target content. Wherein, the demonstration time can be 5 seconds, 10 seconds, 15 seconds, etc., which is not limited by the present disclosure.
For example, continuing to take the above-mentioned live question answering scenario as an example, when the viewer terminal plays a live video stream, and when the live video stream at the time point of "please listen to the question" is played, the terminal analyzes the live video stream to obtain an AAC signaling for displaying the question and the option during decoding, and at this time, the viewer terminal fills the cached display question and the option into the answer box control. And then the audience terminal controls the answer box control to pop up when rendering and playing the 'please listen to the question'. Referring to fig. 7, fig. 7 is a diagram illustrating a display answer popup control according to an exemplary embodiment. In fig. 7, a question answering popup window control is displayed on the audio/video playing interface in a floating manner, and the question answering popup window control displays a question X, an option 1, an option 2, and an option 3. The answer popup window control also displays the display time, and the answer popup window control cancels the display when the display time is 0.
It should be noted that, if the viewer terminal further receives a second target time point corresponding to the target content sent by the live broadcast server, the viewer terminal may display the target content at the second target time point when the content display signaling is not parsed.
For example, continuing to use the above live question answering scenario as an example, when the audience terminal plays the live video stream, if the current time has reached the second target time point but no AAC signaling for displaying the questions and options is obtained, the audience terminal fills the cached display questions and options into the answer box control at the second target time point, and controls the answer box control to pop up. Referring to fig. 8, fig. 8 is a diagram illustrating another display answer popup control in accordance with an exemplary embodiment. In fig. 8, the current network of the viewer terminal is not good, which results in missing of the obtained live video stream, the live broadcast is paused, and the zebra crossing is displayed on the screen. At this time, when the current time reaches the second target time point, the audience terminal displays a question Y, an option 1, an option 2 and an option 3 in a suspension manner on the playing interface.
In order to make the flow of the live broadcast-based content synchronization method described in the above steps S601 to S607 clearer, reference may be made to fig. 9, where fig. 9 is a flowchart illustrating another live broadcast-based content synchronization method according to an exemplary embodiment. In fig. 9, firstly, a live user may collect a live video stream through a live terminal, and send an encoded target live video stream to a live server. The live server then transmits the received live video stream to at least one viewer terminal. Then, at least one viewer terminal decodes the received target live video stream, and renders and plays the decoded target live video stream. In the live broadcast process, a live broadcast user sends a content release request to a live broadcast server through a live broadcast terminal, the live broadcast server sends a signaling addition request to the live broadcast terminal, and simultaneously sends target content to at least one audience terminal. And after receiving the signaling adding request, the live broadcast terminal adds a content display signaling in the target live broadcast video stream.
It should be noted that, the foregoing steps S601 to S607 are optional implementations of the live broadcast-based content synchronization method provided in the embodiment of the present disclosure, and accordingly, the live broadcast-based content synchronization method may also be implemented in other ways. For example, when the live server transmits the target content to at least one viewer terminal, all the required content can be transmitted to the at least one viewer terminal at one time. And then the audience terminal acquires corresponding target content from the cached content according to the content identification, and then displays the target content.
According to the scheme provided by the embodiment of the disclosure, the target content is sent to at least one audience terminal of the target live broadcast video stream by responding to the content publishing request for indicating to publish the target content when the target live broadcast video stream is played to the target time, and the target live broadcast video stream added with the content display signaling at the target time is obtained, so that the target content is displayed if the content display signaling is analyzed in the process of playing the target live broadcast video stream by the at least one audience terminal, the video content of the live broadcast video stream and the opportunity for displaying the target content can be kept consistent, content synchronization is realized, and the user experience is improved
All the above optional technical solutions may be combined arbitrarily to form the optional embodiments of the present disclosure, and are not described herein again.
Fig. 6 is an example of the application environment shown in fig. 1, and optionally, in the live broadcasting process, the function executed by the live broadcasting terminal may also be implemented by a anchor terminal and a director terminal associated with the anchor terminal. The anchor terminal logs in an account of a live user and is used for collecting live video streams, and the director terminal logs in an account of a director user related to the account of the live user and is used for sending a content publishing request. The live broadcast server can comprise a source station server, a live broadcast companion server and a content publishing server, wherein the source station server is used for receiving and sending live broadcast video streams, the live broadcast companion server is used for providing background services related to live broadcast for live broadcast users, and the content publishing server is used for sending target content to at least one audience terminal. The following description is based on the interaction among the anchor terminal, the director terminal, the source station server, the live partner server, the content distribution server, and at least one viewer terminal. Fig. 10 is a flow diagram illustrating another live based content synchronization method in accordance with an example embodiment. Referring to fig. 10, the method includes:
in step S1001, the anchor terminal sends a target live video stream acquired in a live process to the source station server.
It should be noted that the source station server may be a source station server of a content distribution network, and is configured to receive a target live video stream uploaded by a host terminal, then send the target live video stream to each node of the content distribution network, and obtain the live video stream from the node of the content distribution network by at least one viewer terminal of the target live video stream. This step can be referred to as step S301, and is not described herein again.
In step S1002, the director terminal transmits a content distribution request for instructing distribution of the target content when the target live video stream is played to the target time, to the content distribution server.
It should be noted that, in the live broadcasting process, the director user may trigger the content publishing operation when the director user speaks a content publishing password, such as "please listen to the title", and send the content publishing request to the content publishing server through the director terminal. This step can be referred to as step S303, which is not described herein again.
In step S1003, the content distribution server transmits a signaling addition instruction to the live buddy server in response to the content distribution request transmitted by the director terminal.
The signaling adding indication carries a terminal identifier of the anchor terminal and is used for indicating the live broadcasting partner server to send a signaling adding request to the live broadcasting terminal.
In step S1004, the live buddy server transmits a signaling addition request to the anchor terminal in response to the signaling addition indication.
The live mate server can generate a content display signaling, and then sends a signaling addition request carrying the content display signaling to the anchor terminal. This step can be referred to as step S306, which is not described herein again.
In step S1005, the anchor terminal responds to the signaling addition request, and adds a content display signaling carrying a content identifier of the target content at the target time of the target live broadcast video stream.
This step may refer to step S306, which is not described herein again.
In step S1006, the content distribution server transmits the target content to at least one viewer terminal of the target live video stream in response to the content distribution request transmitted by the director terminal.
This step can be referred to as step S305, and is not described herein again.
In step S1007, at least one of the viewer terminals caches the target content, and analyzes a content display signaling in response to playing the target live video stream acquired from the source station server, so as to display the target content.
This step can refer to step S307, which is not described herein again.
It should be noted that fig. 11 is a diagram illustrating an interaction structure among a main broadcasting terminal, a director terminal, a source station server, a live mate server, a content distribution server and at least one audience terminal according to an exemplary embodiment. As shown in fig. 11.
According to the scheme provided by the embodiment of the disclosure, the content display signaling carrying the content identification of the target content is added to the target of the target live video stream by indicating the anchor terminal, so that when the audience terminal plays the live video stream acquired from the source station server, the target content can be displayed according to the content display signaling when the target time is reached, the content of the live video stream and the opportunity for displaying the target content can be kept consistent, the content synchronization is realized, and the user experience is improved.
Fig. 12 is a block diagram illustrating a live based content synchronization apparatus according to an example embodiment. Referring to fig. 12, applied to a live server, the apparatus includes: a first request receiving unit 1201, a content transmitting unit 1202, and a video stream acquiring unit 1203.
A first request receiving unit 1201 configured to perform receiving a content distribution request indicating that a target content is distributed when a target live video stream is played to a target time;
a content transmitting unit 1202 configured to perform transmitting the target content to at least one viewer terminal of the target live video stream;
a video stream obtaining unit 1203 configured to perform obtaining the target live video stream with a content exhibition signaling added at the target time, where the content exhibition signaling is used to instruct the at least one viewer terminal to exhibit the target content when the content exhibition signaling is parsed out in the process of playing the target live video stream.
In the embodiment of the disclosure, by responding to a content publishing request for instructing to publish a target content when a target live video stream is played to a target time, the target content is sent to at least one audience terminal of the target live video stream, and the target live video stream added with a content display signaling at the target time is acquired, so that the target content is displayed if the content display signaling is analyzed in the process of playing the target live video stream by the at least one audience terminal, thereby ensuring that the video content of the live video stream and the opportunity of displaying the target content are kept consistent, realizing content synchronization, and improving user experience.
In an optional implementation manner, the video stream obtaining unit 1203 is configured to perform obtaining of the terminal identifier carried by the content publishing request, the target time, and the content identifier of the target content; generating a content display signaling carrying the content identification of the target content; sending a signaling adding request carrying the target time and the content display signaling to a live broadcast terminal indicated by the terminal identifier, wherein the signaling adding request is used for indicating the live broadcast terminal to add the content display signaling at the target time of the target live broadcast video stream; and receiving the target live broadcast video stream which is sent by the live broadcast terminal and added with the content display signaling.
In an optional implementation, the video stream acquiring unit 1203 includes:
an obtaining subunit 12031, configured to perform obtaining the target time carried by the content publishing request and the content identifier of the target content;
a video stream receiving subunit 12032, configured to perform receiving the target live video stream captured by the live terminal during a live process;
a signaling adding subunit 12033, configured to perform adding the content presentation signaling at the target time of the target live video stream, where the content presentation signaling carries a content identifier of the target content.
In an alternative embodiment, the target time is a first target duration, and the signaling adding subunit 12033 is configured to perform the adding of the content presentation signaling in the target live video stream continuously for the first target duration.
In an alternative embodiment, the target time is a first target time point, and the signaling adding subunit 12033 is configured to continue to add the content presentation signaling to the target live video stream for a first target duration after the first target time point.
In an optional implementation, the content sending unit 1202 is further configured to perform sending, to the at least one viewer terminal, a second target time point corresponding to the target content, where the second target time point is used to instruct the at least one viewer terminal to present the target content at the second target time point when the content presentation signaling is not parsed out.
In an alternative embodiment, the apparatus further comprises:
a first video stream transmitting unit 1204 configured to perform transmitting the target live video stream to at least one viewer terminal in response to receiving a video stream acquisition request transmitted by the at least one viewer terminal to acquire the target live video stream.
Fig. 13 is a block diagram illustrating another live based content synchronization apparatus according to an example embodiment. Referring to fig. 13, the apparatus applied to a live terminal includes: a second video stream transmitting unit 1301, a first request transmitting unit 1302, a second request receiving unit 1303, and a signaling addition unit 1304.
A second video stream sending unit 1301 configured to execute sending of a target live video stream acquired in a live broadcast process to a live broadcast server;
a first request sending unit 1302, configured to execute sending, to a live broadcast server, a content publishing request carrying a terminal identifier of the live broadcast terminal, a target time, and a content identifier of a target content, where the content publishing request is used to indicate that the target content is published when the target live broadcast video stream is played to the target time;
a second request receiving unit 1303, configured to execute receiving a signaling addition request carrying the target time and a content display signaling returned by the live broadcast server, where the content display signaling is generated by the live broadcast server according to the content publishing request;
a signaling adding unit 1304 configured to add the content display signaling at the target time of the target live video stream according to the signaling adding request, where the content display signaling carries a content identifier of the target content.
In the disclosed embodiment, by sending a target live broadcast video stream collected in the live broadcast process to a live broadcast server, at least one audience terminal can obtain the live broadcast video stream through the live broadcast server, then sending a content publishing request carrying a terminal identifier of the live broadcast terminal, a target time and a content identifier of target content to the live broadcast server, then receiving a signaling adding request carrying the target time and a content display signaling generated by the live broadcast server according to the content publishing request, and adding the content display signaling carrying the content identifier of the target content based on the signaling adding request for the target time of the target live broadcast video stream, so that the at least one audience terminal can display the target content if analyzing the content display signaling in the process of playing the target live broadcast video stream, thereby ensuring that the video content of the live broadcast video stream and the opportunity of displaying the target content are kept consistent, content synchronization is realized, and user experience is improved.
In an alternative embodiment, the target time is a second target duration, and the signaling adding unit 1304 is configured to continue to add the content presentation signaling to the target live video stream for the second target duration.
In an alternative embodiment, the target time is a third target time point, and the signaling adding unit 1304 is configured to continue to add the content presentation signaling to the target live video stream for a second target duration after the third target time point.
Fig. 14 is a block diagram illustrating another live based content synchronization apparatus according to an example embodiment. Referring to fig. 14, the apparatus is applied to a viewer terminal, and includes: a second request transmission unit 1401, a content caching unit 1402, and a content presentation unit 1403.
A second request sending unit 1401 configured to execute sending a video stream acquisition request for acquiring a target live video stream to a live server, and play the received target live video stream;
a content caching unit 1402 configured to perform caching of target content sent by the live server;
a content presentation unit 1403 configured to perform, in response to parsing out a content presentation signaling in the process of playing the target live video stream, presenting the target content according to the content presentation signaling, where the content presentation signaling carries a content identifier of the target content.
In the embodiment of the disclosure, the target content sent by the live broadcast server is cached, and the target live broadcast video stream acquired from the live broadcast server is played, so that the target content is displayed if the content display signaling is analyzed in the process of playing the target live broadcast video stream by the audience terminal, thereby ensuring that the video content of the live broadcast video stream and the opportunity for displaying the target content are kept consistent, realizing content synchronization, and improving user experience.
In an optional implementation manner, the content presenting unit 1403 is configured to perform obtaining the content identifier of the target content carried by the content presentation signaling; acquiring the target content from the plurality of cached contents according to the content identification; and displaying the target content.
It should be noted that, when the live content synchronization apparatus provided in the foregoing embodiment performs synchronization between live content and target content, only the division of the functional units is illustrated, and in practical applications, the above function distribution may be completed by different functional units as needed, that is, the internal structure of the terminal or the server may be divided into different functional units to complete all or part of the above described functions. In addition, the content synchronization device based on live broadcast provided by the above embodiment and the content synchronization method based on live broadcast belong to the same concept, and the specific implementation process thereof is described in detail in the method embodiment and is not described herein again.
With regard to the apparatus in the above-described embodiment, the specific manner in which each module performs the operation has been described in detail in the embodiment related to the method, and will not be elaborated here.
Fig. 15 is a block diagram of a terminal shown in accordance with an example embodiment. The terminal 1500 may be a viewer terminal used by a viewer user or a live terminal used by a live user. The terminal 1500 may be: a smart phone, a tablet computer, an MP3 player (Moving Picture Experts Group Audio Layer III, motion video Experts compression standard Audio Layer 3), an MP4 player (Moving Picture Experts compression standard Audio Layer IV, motion video Experts compression standard Audio Layer 4), a notebook computer, or a desktop computer. Terminal 1500 may also be referred to as user equipment, a portable terminal, a laptop terminal, a desktop terminal, or other names.
In general, terminal 1500 includes: a processor 1501 and memory 1502.
Processor 1501 may include one or more processing cores, such as a 4-core processor, an 8-core processor, or the like. The processor 1501 may be implemented in at least one hardware form of a DSP (Digital Signal Processing), an FPGA (Field-Programmable Gate Array), and a PLA (Programmable Logic Array). Processor 1501 may also include a main processor and a coprocessor, where the main processor is a processor for Processing data in an awake state, and is also referred to as a Central Processing Unit (CPU); a coprocessor is a low power processor for processing data in a standby state. In some embodiments, the processor 1501 may be integrated with a GPU (Graphics Processing Unit), which is responsible for rendering and drawing the content required to be displayed on the display screen. In some embodiments, processor 1501 may further include an AI (Artificial Intelligence) processor for processing computing operations related to machine learning.
The memory 1502 may include one or more computer-readable storage media, which may be non-transitory. The memory 1502 may also include high-speed random access memory, as well as non-volatile memory, such as one or more magnetic disk storage devices, flash memory storage devices.
In some embodiments, the terminal 1500 may further include: a peripheral interface 1503 and at least one peripheral. The processor 1501, memory 1502, and peripheral interface 1503 may be connected by buses or signal lines. Various peripheral devices may be connected to peripheral interface 1503 via buses, signal lines, or circuit boards. Specifically, the peripheral device includes: at least one of a radio frequency circuit 1504, a display 1505, a camera assembly 1506, an audio circuit 1507, a positioning assembly 1508, and a power supply 1509.
The peripheral interface 1503 may be used to connect at least one peripheral related to I/O (Input/Output) to the processor 1501 and the memory 1502. In some embodiments, the processor 1501, memory 1502, and peripheral interface 1503 are integrated on the same chip or circuit board; in some other embodiments, any one or two of the processor 1501, the memory 1502, and the peripheral interface 1503 may be implemented on separate chips or circuit boards, which is not limited in this embodiment.
The Radio Frequency circuit 1504 is used to receive and transmit RF (Radio Frequency) signals, also known as electromagnetic signals. The radio frequency circuitry 1504 communicates with communication networks and other communication devices via electromagnetic signals. The radio frequency circuit 1504 converts an electrical signal into an electromagnetic signal to transmit, or converts a received electromagnetic signal into an electrical signal. Optionally, the radio frequency circuit 1504 includes: an antenna system, an RF transceiver, one or more amplifiers, a tuner, an oscillator, a digital signal processor, a codec chipset, a subscriber identity module card, and so forth. The radio frequency circuit 1504 can communicate with other terminals via at least one wireless communication protocol. The wireless communication protocols include, but are not limited to: metropolitan area networks, various generation mobile communication networks (2G, 3G, 4G, and 5G), Wireless local area networks, and/or WiFi (Wireless Fidelity) networks. In some embodiments, the radio frequency circuitry 1504 may also include NFC (Near Field Communication) related circuitry, which is not limited by the present disclosure.
The display screen 1505 is used to display a UI (User Interface). The UI may include graphics, text, icons, video, and any combination thereof. When the display screen 1505 is a touch display screen, the display screen 1505 also has the ability to capture touch signals on or over the surface of the display screen 1505. The touch signal may be input to the processor 1501 as a control signal for processing. In this case, the display screen 1505 may also be used to provide virtual buttons and/or a virtual keyboard, also referred to as soft buttons and/or a soft keyboard. In some embodiments, display 1505 may be one, providing the front panel of terminal 1500; in other embodiments, the display 1505 may be at least two, each disposed on a different surface of the terminal 1500 or in a folded design; in still other embodiments, the display 1505 may be a flexible display disposed on a curved surface or a folded surface of the terminal 1500. Even more, the display 1505 may be configured in a non-rectangular irregular pattern, i.e., a shaped screen. The Display 1505 can be made of LCD (Liquid Crystal Display), OLED (Organic Light-Emitting Diode), and other materials.
The camera assembly 1506 is used to capture images or video. Optionally, the camera assembly 1506 includes a front camera and a rear camera. Generally, a front camera is disposed at a front panel of the terminal, and a rear camera is disposed at a rear surface of the terminal. In some embodiments, the number of the rear cameras is at least two, and each rear camera is any one of a main camera, a depth-of-field camera, a wide-angle camera and a telephoto camera, so that the main camera and the depth-of-field camera are fused to realize a background blurring function, and the main camera and the wide-angle camera are fused to realize panoramic shooting and VR (Virtual Reality) shooting functions or other fusion shooting functions. In some embodiments, camera head assembly 1506 may also include a flash. The flash lamp can be a single-color temperature flash lamp or a double-color temperature flash lamp. The double-color-temperature flash lamp is a combination of a warm-light flash lamp and a cold-light flash lamp, and can be used for light compensation at different color temperatures.
The audio circuitry 1507 may include a microphone and speaker. The microphone is used for collecting sound waves of a user and the environment, converting the sound waves into electric signals, and inputting the electric signals to the processor 1501 for processing or inputting the electric signals to the radio frequency circuit 1504 to realize voice communication. The microphones may be provided in a plurality, respectively, at different portions of the terminal 1500 for the purpose of stereo sound collection or noise reduction. The microphone may also be an array microphone or an omni-directional pick-up microphone. The speaker is then used to convert electrical signals from the processor 1501 or the radio frequency circuitry 1504 into sound waves. The loudspeaker can be a traditional film loudspeaker or a piezoelectric ceramic loudspeaker. When the speaker is a piezoelectric ceramic speaker, the speaker can be used for purposes such as converting an electric signal into a sound wave audible to a human being, or converting an electric signal into a sound wave inaudible to a human being to measure a distance. In some embodiments, the audio circuitry 1507 may also include a headphone jack.
The positioning component 1508 is used for locating the current geographic position of the terminal 1500 for navigation or LBS (Location Based Service). The Positioning component 1508 may be a Positioning component based on the united states GPS (Global Positioning System), the chinese beidou System, the russian graves System, or the european union's galileo System.
A power supply 1509 is used to supply power to the various components in terminal 1500. The power supply 1509 may be alternating current, direct current, disposable batteries, or rechargeable batteries. When the power supply 1509 includes a rechargeable battery, the rechargeable battery may support wired charging or wireless charging. The rechargeable battery may also be used to support fast charge technology.
In some embodiments, the terminal 1500 also includes one or more sensors 1510. The one or more sensors 1510 include, but are not limited to: acceleration sensor 1511, gyro sensor 1512, pressure sensor 1513, fingerprint sensor 1514, optical sensor 1515, and proximity sensor 1516.
The acceleration sensor 1511 may detect the magnitude of acceleration on three coordinate axes of the coordinate system established with the terminal 1500. For example, the acceleration sensor 1511 may be used to detect components of the gravitational acceleration in three coordinate axes. The processor 1501 may control the display screen 1505 to display the user interface in a landscape view or a portrait view based on the gravitational acceleration signal collected by the acceleration sensor 1511. The acceleration sensor 1511 may also be used for acquisition of motion data of a game or a user.
The gyroscope sensor 1512 can detect the body direction and the rotation angle of the terminal 1500, and the gyroscope sensor 1512 and the acceleration sensor 1511 cooperate to collect the 3D motion of the user on the terminal 1500. The processor 1501 may implement the following functions according to the data collected by the gyro sensor 1512: motion sensing (such as changing the UI according to a user's tilting operation), image stabilization while shooting, game control, and inertial navigation.
Pressure sensor 1513 may be disposed on a side frame of terminal 1500 and/or underneath display 1505. When the pressure sensor 1513 is disposed on the side frame of the terminal 1500, the holding signal of the user to the terminal 1500 may be detected, and the processor 1501 performs left-right hand recognition or shortcut operation according to the holding signal collected by the pressure sensor 1513. When the pressure sensor 1513 is disposed at a lower layer of the display screen 1505, the processor 1501 controls the operability control on the UI interface in accordance with the pressure operation of the user on the display screen 1505. The operability control comprises at least one of a button control, a scroll bar control, an icon control and a menu control.
The fingerprint sensor 1514 is configured to collect a fingerprint of the user, and the processor 1501 identifies the user based on the fingerprint collected by the fingerprint sensor 1514, or the fingerprint sensor 1514 identifies the user based on the collected fingerprint. Upon recognizing that the user's identity is a trusted identity, the processor 1501 authorizes the user to perform relevant sensitive operations including unlocking the screen, viewing encrypted information, downloading software, paying, and changing settings, etc. The fingerprint sensor 1514 may be disposed on the front, back, or side of the terminal 1500. When a physical key or vendor Logo is provided on the terminal 1500, the fingerprint sensor 1514 may be integrated with the physical key or vendor Logo.
The optical sensor 1515 is used to collect ambient light intensity. In one embodiment, processor 1501 may control the brightness of display screen 1505 based on the intensity of ambient light collected by optical sensor 1515. Specifically, when the ambient light intensity is high, the display brightness of the display screen 1505 is increased; when the ambient light intensity is low, the display brightness of the display screen 1505 is adjusted down. In another embodiment, the processor 1501 may also dynamically adjust the shooting parameters of the camera assembly 1506 based on the ambient light intensity collected by the optical sensor 1515.
A proximity sensor 1516, also known as a distance sensor, is typically provided on the front panel of the terminal 1500. The proximity sensor 1516 is used to collect the distance between the user and the front surface of the terminal 1500. In one embodiment, when the proximity sensor 1516 detects that the distance between the user and the front surface of the terminal 1500 gradually decreases, the processor 1501 controls the display 1505 to switch from the bright screen state to the dark screen state; when the proximity sensor 1516 detects that the distance between the user and the front surface of the terminal 1500 gradually becomes larger, the processor 1501 controls the display 1505 to switch from the message screen state to the bright screen state.
Those skilled in the art will appreciate that the configuration shown in fig. 15 does not constitute a limitation of terminal 1500, and may include more or fewer components than shown, or some components may be combined, or a different arrangement of components may be employed.
Fig. 16 is a block diagram illustrating a live server 1600 according to an example embodiment, where the server 1600 may have a relatively large difference due to different configurations or performances, and may include one or more processors (CPUs) 1601 and one or more memories 1602, where the storage media contained in the memories 1602 may be a ROM1603 and a Random Access Memory (RAM) 1604. The memory 1602 has at least one program code stored therein, and the at least one program code is loaded and executed by the processor 1601 to implement the method for synchronizing content based on live broadcast provided by the above-mentioned method embodiments. Of course, the server may also have components such as a wired or wireless network interface 1605 and an input/output interface 1606 to facilitate input and output, the server 1600 may also include a mass storage device 1607, and the server 1600 may also include other components for implementing device functions, which are not described herein again.
In an exemplary embodiment, a storage medium comprising program code, such as a memory 1102 comprising program code, executable by a processor 1101 of the server 1100 to perform the above-described method is also provided. Alternatively, the storage medium may be a non-transitory computer readable storage medium, which may be, for example, a ROM, a Random Access Memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, and the like.
Other embodiments of the disclosure will be apparent to those skilled in the art from consideration of the specification and practice of the disclosure disclosed herein. This disclosure is intended to cover any variations, uses, or adaptations of the disclosure following, in general, the principles of the disclosure and including such departures from the present disclosure as come within known or customary practice within the art to which the disclosure pertains. It is intended that the specification and examples be considered as exemplary only, with a true scope and spirit of the disclosure being indicated by the following claims.
It will be understood that the present disclosure is not limited to the precise arrangements described above and shown in the drawings and that various modifications and changes may be made without departing from the scope thereof. The scope of the present disclosure is limited only by the appended claims.

Claims (17)

1. A live broadcast-based content synchronization method is applied to a live broadcast server, and comprises the following steps:
receiving a content publishing request sent by a live broadcast terminal, wherein the content publishing request is used for indicating that target content is published when a target live broadcast video stream is played to a target time;
in response to the content publishing request, transmitting the target content to at least one viewer terminal of the target live video stream to enable the at least one viewer terminal to cache the target content;
acquiring a terminal identifier carried by the content publishing request, the target time and a content identifier of the target content;
generating a content display signaling carrying a content identifier of the target content, where the content display signaling is used to instruct the at least one viewer terminal to respond to the analyzed content display signaling in the process of playing the target live video stream, obtain the target content from the cached multiple contents based on the content identifier of the target content, and display the target content;
sending a signaling adding request carrying the target time and the content display signaling to a live broadcast terminal indicated by the terminal identification, wherein the signaling adding request is used for indicating the live broadcast terminal to add the content display signaling at the target time of the target live broadcast video stream;
receiving a target live broadcast video stream which is sent by the live broadcast terminal and to which the content display signaling is added, wherein the content display signaling is continuously added in the target live broadcast video stream by the live broadcast terminal within a second target time length under the condition that the target time is the second target time length;
and responding to a video stream acquisition request of the at least one audience terminal, and pushing the target live video stream added with the content display signaling to the at least one audience terminal.
2. The method of claim 1, wherein after the pushing the target live video stream to which the content presentation signaling has been added to the at least one viewer terminal in response to a video stream acquisition request of the at least one viewer terminal, the method further comprises:
and sending a second target time point corresponding to the target content to the at least one audience terminal, wherein the second target time point is used for indicating the at least one audience terminal to display the target content at the second target time point when the content display signaling is not analyzed.
3. The method of claim 1, wherein before receiving the content publication request, the method further comprises:
and in response to receiving a video stream acquisition request for acquiring the target live video stream sent by at least one viewer terminal, sending the target live video stream to the at least one viewer terminal.
4. A content synchronization method based on live broadcast is characterized in that the method is applied to a live broadcast terminal, and the method comprises the following steps:
sending a target live broadcast video stream acquired in a live broadcast process to a live broadcast server;
sending a content publishing request carrying a terminal identifier of the live broadcast terminal, a target time and a content identifier of a target content to the live broadcast server, wherein the content publishing request is used for indicating that the target content is published when the target live broadcast video stream is played to the target time, and the content publishing request is also used for requesting the live broadcast server to send the target content to at least one audience terminal of the target live broadcast video stream so as to enable the at least one audience terminal to cache the target content;
receiving a signaling adding request which is returned by the live broadcast server and carries the target time and the content display signaling, wherein the content display signaling is generated by the live broadcast server according to the content publishing request;
adding the content display signaling at the target time of the target live video stream according to the signaling addition request, wherein the content display signaling carries a content identifier of the target content, and is used for indicating the at least one audience terminal to respond to the analyzed content display signaling in the process of playing the target live video stream, obtain the target content from the plurality of cached contents based on the content identifier of the target content, and display the target content;
sending the target live video stream added with the content display signaling to the live broadcast server so that the live broadcast server pushes the target live video stream added with the content display signaling to the at least one audience terminal;
wherein, in a case that the target time is a second target duration, the adding the content presentation signaling at the target time of the target live broadcast video stream includes:
and continuously adding the content display signaling in the target live broadcast video stream within the second target time length, wherein the content display signaling carries a content identifier of the target content.
5. The live-based content synchronization method according to claim 4, wherein in a case that the target time is a third target time point, after adding the content presentation signaling at the target time of the target live video stream, the method further comprises:
and continuously adding the content display signaling in the target live video stream within a second target time length after the third target time point.
6. A content synchronization method based on live broadcast is characterized in that the method is applied to audience terminals and comprises the following steps:
sending a video stream acquisition request for acquiring a target live video stream to a live broadcast server, and playing the received target live video stream, wherein the target live video stream is sent to the live broadcast server by a live broadcast terminal, and the target live video stream is a live video stream acquired by the live broadcast terminal in a live broadcast process;
caching target content sent by the live broadcast server, wherein the target content is sent by the live broadcast server in response to a content publishing request sent by the live broadcast terminal, the content publishing request is used for indicating that the target content is published when the target live broadcast video stream is played to a target time, and the content publishing request carries a terminal identifier, the target time and a content identifier of the target content;
in the process of playing the target live broadcast video stream, responding to the analyzed content display signaling, and acquiring the content identification of the target content carried by the content display signaling;
acquiring the target content from the plurality of cached contents according to the content identification;
displaying the target content;
the content display signaling is generated by the live broadcast server according to the content release request, and the content display signaling is added to the target live broadcast video stream at the target time by the live broadcast terminal;
and under the condition that the target time is a second target duration, the content display signaling is continuously added in the target live broadcast video stream by the live broadcast terminal within the second target duration.
7. A content synchronization method based on live broadcast is characterized in that the method is applied to a live broadcast system, the live broadcast system comprises a live broadcast terminal, a live broadcast server and at least one audience terminal, and the method comprises the following steps:
the live broadcast terminal sends a target live broadcast video stream acquired in a live broadcast process to the live broadcast server;
the live broadcast server responds to a content publishing request sent by the live broadcast terminal, and sends target content to at least one audience terminal of the target live broadcast video stream, wherein the content publishing request is used for indicating that the target content is published when the target live broadcast video stream is played to a target time;
the at least one viewer terminal caches the target content;
the live broadcast server acquires a terminal identifier carried by the content publishing request, the target time and a content identifier of the target content;
the live broadcast server generates a content display signaling carrying a content identifier of the target content, wherein the content display signaling is used for indicating the at least one audience terminal to respond to the analyzed content display signaling in the process of playing the target live broadcast video stream, acquire the target content from the plurality of cached contents based on the content identifier of the target content, and display the target content;
the live broadcast server sends a signaling adding request carrying the target time and the content display signaling to the live broadcast terminal indicated by the terminal identification, wherein the signaling adding request is used for indicating the live broadcast terminal to add the content display signaling at the target time of the target live broadcast video stream;
the live broadcast terminal receives the signaling adding request returned by the live broadcast server;
the live broadcast terminal adds the content display signaling at the target time of the target live broadcast video stream according to the signaling addition request; wherein, in a case that the target time is a second target duration, the adding the content presentation signaling at the target time of the target live broadcast video stream includes: the live broadcast terminal continuously adds the content display signaling in the target live broadcast video stream within the second target duration, wherein the content display signaling carries a content identifier of the target content;
the live broadcast terminal sends the target live broadcast video stream added with the content display signaling to the live broadcast server;
the live broadcast server receives the target live broadcast video stream added with the content display signaling;
responding to a video stream acquisition request of the at least one audience terminal, and pushing the target live video stream added with the content display signaling to the at least one audience terminal by the live broadcast server;
the at least one audience terminal receives the target live video stream added with the content display signaling;
responding to a content display signaling analyzed by the at least one audience terminal in the process of playing the target live broadcast video stream, and acquiring a content identifier of the target content carried by the content display signaling;
the at least one audience terminal device obtains the target content from the plurality of cached contents according to the content identification;
the at least one viewer terminal presents the targeted content.
8. The live-broadcast-based content synchronization method according to claim 7, wherein in a case that the target time is a third target time point, the live broadcast terminal adds the content presentation signaling at the target time of the target live broadcast video stream according to the signaling addition request, and the method further comprises:
and the live broadcast terminal continuously adds the content display signaling in the target live broadcast video stream within a second target time length after the third target time point according to the signaling addition request.
9. The live-based content synchronization method of claim 8, wherein after the live server transmits the target content to at least one viewer terminal of the target live video stream in response to the content distribution request transmitted by the live terminal, the method further comprises:
and the live broadcast server sends a second target time point corresponding to the target content to the at least one audience terminal, wherein the second target time point is used for indicating the at least one audience terminal to display the target content at the second target time point when the content display signaling is not analyzed.
10. A live broadcast-based content synchronization apparatus applied to a live broadcast server, the apparatus comprising:
the device comprises a first request receiving unit, a first processing unit and a second processing unit, wherein the first request receiving unit is used for executing and receiving a content publishing request sent by a live broadcast terminal, and the content publishing request is used for indicating that target content is published when a target live broadcast video stream is played to a target time;
a content transmitting unit configured to perform transmitting the target content to at least one viewer terminal of the target live video stream to cause the at least one viewer terminal to cache the target content;
a video stream obtaining unit configured to perform obtaining of a terminal identifier carried by the content publishing request, the target time, and a content identifier of the target content; generating a content display signaling carrying a content identifier of the target content, wherein the content display signaling is used for indicating the at least one audience terminal to respond to the analyzed content display signaling in the process of playing the target live video stream, obtain the target content from the plurality of cached contents based on the content identifier of the target content, and display the target content; sending a signaling adding request carrying the target time and the content display signaling to a live broadcast terminal indicated by the terminal identification, wherein the signaling adding request is used for indicating the live broadcast terminal to add the content display signaling at the target time of the target live broadcast video stream; receiving a target live broadcast video stream which is sent by the live broadcast terminal and to which the content display signaling is added, wherein the content display signaling is continuously added in the target live broadcast video stream by the live broadcast terminal within a second target time length under the condition that the target time is the second target time length; and responding to a video stream acquisition request of the at least one audience terminal, and pushing the target live video stream added with the content display signaling to the at least one audience terminal.
11. The live-based content synchronization apparatus according to claim 10, wherein the content transmission unit is further configured to perform transmission of a second target time point corresponding to the target content to the at least one viewer terminal, and the second target time point is used to instruct the at least one viewer terminal to present the target content at the second target time point when the content presentation signaling is not parsed out.
12. The live-based content synchronization apparatus of claim 10, wherein the apparatus further comprises:
the first video stream transmitting unit is configured to execute the transmission of the target live video stream to at least one viewer terminal in response to the reception of a video stream acquisition request transmitted by the at least one viewer terminal for acquiring the target live video stream.
13. A content synchronization device based on live broadcast is characterized in that the device is applied to a live broadcast terminal, and the device comprises:
a second video stream sending unit configured to execute sending of a target live video stream acquired in a live broadcast process to a live broadcast server;
a first request sending unit, configured to execute sending, to the live broadcast server, a content publishing request carrying a terminal identifier of the live broadcast terminal, a target time, and a content identifier of a target content, where the content publishing request is used to indicate that the target content is published when the target live broadcast video stream is played to the target time, and the content publishing request is further used to request the live broadcast server to send the target content to at least one viewer terminal of the target live broadcast video stream, so that the at least one viewer terminal caches the target content;
a second request receiving unit, configured to execute receiving a signaling addition request carrying the target time and a content display signaling returned by the live broadcast server, where the content display signaling is generated by the live broadcast server according to the content publishing request;
a signaling adding unit, configured to add the content display signaling at the target time of the target live video stream according to the signaling adding request, where the content display signaling carries a content identifier of the target content, and the content display signaling is used to indicate that the at least one viewer terminal obtains the target content from the plurality of cached contents and displays the target content in response to parsing out the content display signaling in a process of playing the target live video stream based on the content identifier of the target content; sending the target live video stream added with the content display signaling to the live broadcast server so that the live broadcast server pushes the target live video stream added with the content display signaling to the at least one audience terminal; wherein, in a case that the target time is a second target duration, the adding the content presentation signaling at the target time of the target live broadcast video stream includes: and continuously adding the content display signaling in the target live broadcast video stream within the second target time length, wherein the content display signaling carries a content identifier of the target content.
14. The live-based content synchronization device of claim 13, wherein in case that the target time is a third target time point, the signaling adding unit is configured to continue to add the content showing signaling in the target live video stream for a second target time duration after the third target time point.
15. A live broadcast-based content synchronization apparatus, for use in a viewer terminal, the apparatus comprising:
a second request sending unit, configured to execute sending a video stream acquisition request for acquiring a target live video stream to a live broadcast server, and play a received target live video stream, where the target live video stream is sent to the live broadcast server by a live broadcast terminal, and the target live video stream is a live video stream acquired by the live broadcast terminal in a live broadcast process;
the content caching unit is configured to perform caching of target content sent by the live broadcast server, wherein the target content is sent by the live broadcast server in response to a content publishing request sent by the live broadcast terminal, the content publishing request is used for indicating that the target content is published when the target live broadcast video stream is played to a target time, and the content publishing request carries a terminal identifier, the target time and a content identifier of the target content;
the content display unit is configured to respond to the analyzed content display signaling in the process of playing the target live broadcast video stream and acquire a content identifier of the target content carried by the content display signaling; acquiring the target content from the plurality of cached contents according to the content identification; displaying the target content; the content display signaling is generated by the live broadcast server according to the content release request, and the content display signaling is added to the target live broadcast video stream at the target time by the live broadcast terminal; and under the condition that the target time is a second target duration, the content display signaling is continuously added in the target live broadcast video stream by the live broadcast terminal within the second target duration.
16. A computer device, characterized in that the computer device comprises:
one or more processors;
a memory for storing the processor executable program code;
wherein the processor is configured to execute the program code to implement the live based content synchronization method of any of claims 1-6.
17. A storage medium, wherein program code in the storage medium, when executed by a processor of a server, enables the server to perform the live based content synchronization method of any one of claims 1 to 6.
CN202010658703.9A 2020-07-09 2020-07-09 Content synchronization method, device and equipment based on live broadcast and storage medium Active CN111770373B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202010658703.9A CN111770373B (en) 2020-07-09 2020-07-09 Content synchronization method, device and equipment based on live broadcast and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202010658703.9A CN111770373B (en) 2020-07-09 2020-07-09 Content synchronization method, device and equipment based on live broadcast and storage medium

Publications (2)

Publication Number Publication Date
CN111770373A CN111770373A (en) 2020-10-13
CN111770373B true CN111770373B (en) 2022-09-02

Family

ID=72726209

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202010658703.9A Active CN111770373B (en) 2020-07-09 2020-07-09 Content synchronization method, device and equipment based on live broadcast and storage medium

Country Status (1)

Country Link
CN (1) CN111770373B (en)

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106488291A (en) * 2016-11-17 2017-03-08 百度在线网络技术（北京）有限公司 The method and apparatus of simultaneous display file in net cast
CN108366278A (en) * 2018-02-01 2018-08-03 北京奇艺世纪科技有限公司 A kind of user in video playing interacts implementation method and device
CN108495152A (en) * 2018-03-30 2018-09-04 武汉斗鱼网络科技有限公司 A kind of net cast method, apparatus, electronic equipment and medium
CN108881956A (en) * 2018-06-07 2018-11-23 腾讯科技（深圳）有限公司 A kind of live stream transmission method, device and relevant device
CN110545452A (en) * 2018-05-28 2019-12-06 阿里巴巴集团控股有限公司 Network live broadcast method, device, terminal and server
CN111147878A (en) * 2019-12-30 2020-05-12 广州酷狗计算机科技有限公司 Stream pushing method and device in live broadcast and computer storage medium

Family Cites Families (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105828123A (en) * 2016-03-30 2016-08-03 乐视控股（北京）有限公司 Method and apparatus for interaction in live broadcast
US20180063556A1 (en) * 2016-08-29 2018-03-01 YouNow, Inc. Systems and methods for providing guest broadcasting on a live stream video platform
CN106804008A (en) * 2017-03-22 2017-06-06 深圳市路通网络技术有限公司 A kind of information displaying method and device
US11412313B2 (en) * 2018-05-02 2022-08-09 Twitter, Inc. Sharing timestamps for video content in a messaging platform
CN108924661B (en) * 2018-07-12 2020-02-18 北京微播视界科技有限公司 Data interaction method, device, terminal and storage medium based on live broadcast room
CN110222142B (en) * 2019-05-09 2021-08-27 网宿科技股份有限公司 Topic distribution method and device

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106488291A (en) * 2016-11-17 2017-03-08 百度在线网络技术（北京）有限公司 The method and apparatus of simultaneous display file in net cast
CN108366278A (en) * 2018-02-01 2018-08-03 北京奇艺世纪科技有限公司 A kind of user in video playing interacts implementation method and device
CN108495152A (en) * 2018-03-30 2018-09-04 武汉斗鱼网络科技有限公司 A kind of net cast method, apparatus, electronic equipment and medium
CN110545452A (en) * 2018-05-28 2019-12-06 阿里巴巴集团控股有限公司 Network live broadcast method, device, terminal and server
CN108881956A (en) * 2018-06-07 2018-11-23 腾讯科技（深圳）有限公司 A kind of live stream transmission method, device and relevant device
CN111147878A (en) * 2019-12-30 2020-05-12 广州酷狗计算机科技有限公司 Stream pushing method and device in live broadcast and computer storage medium

Also Published As

Publication number Publication date
CN111770373A (en) 2020-10-13

Similar Documents

Publication Publication Date Title
CN109600678B (en) Information display method, device and system, server, terminal and storage medium
CN108966008B (en) Live video playback method and device
CN108419113B (en) Subtitle display method and device
CN109660817B (en) Video live broadcast method, device and system
CN113965807B (en) Message pushing method, device, terminal, server and storage medium
CN108833963B (en) Method, computer device, readable storage medium and system for displaying interface picture
CN109874043B (en) Video stream sending method, video stream playing method and video stream playing device
CN110971925B (en) Display method, device and system of live broadcast interface
CN111107389B (en) Method, device and system for determining live broadcast watching time length
CN109194972B (en) Live stream acquisition method and device, computer equipment and storage medium
CN112995759A (en) Interactive service processing method, system, device, equipment and storage medium
CN107896337B (en) Information popularization method and device and storage medium
CN108600778B (en) Media stream transmitting method, device, system, server, terminal and storage medium
CN110418152B (en) Method and device for carrying out live broadcast prompt
CN110533585B (en) Image face changing method, device, system, equipment and storage medium
CN113490010B (en) Interaction method, device and equipment based on live video and storage medium
CN112118477A (en) Virtual gift display method, device, equipment and storage medium
CN112104648A (en) Data processing method, device, terminal, server and storage medium
CN111246236A (en) Interactive data playing method, device, terminal, server and storage medium
CN110958464A (en) Live broadcast data processing method and device, server, terminal and storage medium
CN112969093A (en) Interactive service processing method, device, equipment and storage medium
CN113204671A (en) Resource display method, device, terminal, server, medium and product
CN111294607B (en) Live broadcast interaction method and device, server and terminal
CN113271470A (en) Live broadcast wheat connecting method, device, terminal, server and storage medium
CN108833970B (en) Live broadcast recording method and device, computer equipment and storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant