CN111447458A - Live broadcast system, method and device based on content explanation and live broadcast server - Google Patents
Live broadcast system, method and device based on content explanation and live broadcast server Download PDFInfo
- Publication number
- CN111447458A CN111447458A CN202010250990.XA CN202010250990A CN111447458A CN 111447458 A CN111447458 A CN 111447458A CN 202010250990 A CN202010250990 A CN 202010250990A CN 111447458 A CN111447458 A CN 111447458A
- Authority
- CN
- China
- Prior art keywords
- content
- data
- explained
- server
- live broadcast
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 47
- 230000001360 synchronised effect Effects 0.000 claims abstract description 19
- 238000004590 computer program Methods 0.000 claims description 5
- 238000009877 rendering Methods 0.000 claims description 2
- 238000010586 diagram Methods 0.000 description 9
- 230000008569 process Effects 0.000 description 8
- 230000006870 function Effects 0.000 description 4
- 238000004891 communication Methods 0.000 description 3
- 230000009286 beneficial effect Effects 0.000 description 2
- 239000008280 blood Substances 0.000 description 2
- 210000004369 blood Anatomy 0.000 description 2
- 230000008859 change Effects 0.000 description 2
- 238000001816 cooling Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 238000013500 data storage Methods 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 238000010295 mobile communication Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 239000007787 solid Substances 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/21—Server components or server architectures
- H04N21/218—Source of audio or video content, e.g. local disk arrays
- H04N21/2187—Live feed
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/4302—Content synchronisation processes, e.g. decoder synchronisation
- H04N21/4305—Synchronising client clock from received content stream, e.g. locking decoder clock with encoder clock, extraction of the PCR packets
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/439—Processing of audio elementary streams
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
- H04N21/44012—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving rendering scenes according to scene graphs, e.g. MPEG-4 scene graphs
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/478—Supplemental services, e.g. displaying phone caller identification, shopping application
- H04N21/4781—Games
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
- H04N21/85—Assembly of content; Generation of multimedia applications
- H04N21/854—Content authoring
- H04N21/8547—Content authoring involving timestamps for synchronizing content
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Computer Security & Cryptography (AREA)
- Databases & Information Systems (AREA)
- Information Transfer Between Computers (AREA)
Abstract
The embodiment of the invention discloses a live broadcast system, a method and a device based on content explanation and a live broadcast server. The system comprises: the system comprises a content server, a live broadcast server, a main broadcast server and a spectator, wherein the content server stores content running data of content to be explained; the live broadcast server acquires content operation data on the content server and content comment data acquired by the anchor terminal for the content to be explained, and forwards the content operation data and the content comment data to the audience terminal after synchronous matching; and the audience terminal restores the content to be explained by adopting the content operation data and synchronously plays the matched content explanation data. The system greatly reduces the data volume transmitted between the live broadcast server and the content server and between the live broadcast server and the audience, thereby reducing the bandwidth cost of the live broadcast server.
Description
Technical Field
The embodiment of the invention relates to the field of video processing, in particular to a live broadcast system, a live broadcast method, a live broadcast device and a live broadcast server based on content explanation.
Background
With the coming of the internet era, the life and entertainment contents and habits of people are also changed greatly. Among them, the live broadcast industry is attracting more and more users as a new entertainment mode.
Taking live game as an example, the traditional live game display mode is that a spectator can watch the real-time explanation of the game anchor on the game match in a live broadcast room, and the specific implementation process of the live broadcast mode can be as follows: the method comprises the steps that a main broadcasting end intercepts a game picture displayed at present, obtains an explanation picture collected by a camera and explanation content input by a microphone, codes the game picture, the explanation picture and the explanation content into a live broadcast code stream, forwards the live broadcast code stream to a spectator end through a live broadcast server, and decodes the live broadcast code stream and plays the live broadcast picture and the explanation content by the spectator end, so that the aim of watching a game match is fulfilled.
However, the traditional method has a high requirement on the bandwidth of the live server, and the bandwidth cost of the live server is increased.
Disclosure of Invention
The embodiment of the invention provides a live broadcast system, a live broadcast method and a live broadcast server based on content explanation, and the bandwidth cost of the live broadcast server is reduced.
In a first aspect, an embodiment of the present invention provides a live broadcast system based on content commentary, including: the system comprises a content server, a live broadcast server, a main broadcast server and a spectator, wherein the content server stores content running data of content to be explained; wherein,
the live broadcast server acquires content operation data on the content server and content comment data acquired by the anchor terminal for the content to be explained, and forwards the content operation data and the content comment data to the audience terminal after synchronous matching; and the audience terminal restores the content to be explained by adopting the content operation data and synchronously plays the matched content explanation data.
In a second aspect, an embodiment of the present invention provides a live broadcast method based on a content commentary, including:
respectively acquiring content operation data and content explanation data of content to be explained at a specified source end;
and synchronously matching the content operation data and the content comment data, and then forwarding the content operation data and the content comment data to a spectator end in a comment live broadcast room, so that the spectator end restores the content to be explained by adopting the content operation data and synchronously plays the matched content comment data.
In a third aspect, an embodiment of the present invention provides a live broadcast apparatus based on content commentary, including:
the content data acquisition module is used for respectively acquiring content operation data and content explanation data of the content to be explained at a specified source end;
and the synchronous forwarding module is used for synchronously matching the content operation data and the content comment data and then forwarding the content operation data and the content comment data to a spectator end in a comment live broadcast room so that the spectator end restores the content to be explained by adopting the content operation data and synchronously plays the matched content comment data.
In a fourth aspect, an embodiment of the present invention provides a live broadcast server, where the live broadcast server includes:
one or more processors;
storage means for storing one or more programs;
when the one or more programs are executed by the one or more processors, the one or more processors implement the content commentary-based live broadcasting method according to any embodiment of the present invention.
In a fifth aspect, an embodiment of the present invention provides a computer-readable storage medium, on which a computer program is stored, where the computer program, when executed by a processor, implements a live broadcast method based on content commentary according to any embodiment of the present invention.
According to the live broadcast system, the live broadcast method, the live broadcast device and the live broadcast server, the live broadcast server acquires content operation data on the content server and content description data acquired by the anchor terminal for the content to be explained, synchronously matches the content operation data and the content description data and forwards the content operation data and the content description data to the audience terminal, and the audience terminal restores the content to be explained by adopting the content operation data and synchronously plays the matched content description data. For the content to be explained, the live broadcast server only needs to obtain the content operation data in the content to be explained from the content server, does not need to obtain the whole content picture of the content to be explained from the content server, and the live broadcast server only forwards the content operation data in the content to be explained to the audience, and does not need to forward the whole content picture to the audience.
Drawings
Other features, objects and advantages of the invention will become more apparent upon reading of the detailed description of non-limiting embodiments made with reference to the following drawings:
fig. 1 is a schematic structural diagram of a content-description-based live broadcast system according to an embodiment of the present application;
fig. 2 is a schematic block diagram of a live broadcast system based on content explanation according to an embodiment of the present application;
fig. 3 is a schematic flowchart of a live broadcasting method based on content explanation according to a second embodiment of the present application;
fig. 4 is a schematic flowchart of a live broadcasting method based on content explanation according to a third embodiment of the present application;
fig. 5 is an interaction diagram of a live broadcast method based on content explanation according to a third embodiment of the present invention;
fig. 6 is a schematic structural diagram of a live broadcast apparatus based on content explanation according to a fourth embodiment of the present invention;
fig. 7 is a schematic structural diagram of a live broadcast server according to a fifth embodiment of the present invention.
Detailed Description
The present invention will be described in further detail with reference to the accompanying drawings and examples. It is to be understood that the specific embodiments described herein are merely illustrative of the invention and are not limiting of the invention. It should be further noted that, for the convenience of description, only some of the structures related to the present invention are shown in the drawings, not all of the structures. In addition, the embodiments and features of the embodiments in the present invention may be combined with each other without conflict.
Example one
Fig. 1 is a schematic structural diagram of a live broadcast system based on content explanation according to an embodiment of the present application, and fig. 2 is a schematic block diagram of a live broadcast system based on content explanation according to an embodiment of the present application. Referring to fig. 1 and 2, the system may include: the content server 10, the live broadcast server 11, the anchor server 12 and the audience 13, wherein the content server 10 stores content operation data of content to be explained. The live broadcast server 11 obtains content operation data on the content server 10 and content comment data acquired by the anchor 12 for the content to be explained, and forwards the content operation data and the content comment data to the audience 13 after performing synchronous matching; the spectator end 13 restores the content to be explained by using the content operation data, and synchronously plays the matched content explanation data.
Specifically, the content to be explained is the content explained by the anchor terminal 12 in the explanation live broadcasting room. Optionally, when the anchor terminal 12 plays the game commentary live broadcast in the commentary live broadcast room, the content to be commentary may be a game match to be commentary. Because the content executing party (such as a game participant) can operate the content to be explained in real time to change in the live broadcasting process, so as to generate corresponding content running data, and send the content running data to the content server 10, and the content server 10 forwards the content running data to other content executing parties (such as other game participants), so as to realize complete running of the content, the content running data of the content to be explained in the live broadcasting process can be stored on the content server 10 in real time. When the anchor terminal 12 enters the live commentary room to start live commentary, the anchor terminal 12 collects a content commentary picture of the anchor content to be commentary through the camera device, and collects a content commentary audio of the anchor content to be commentary through the audio input device, wherein the content commentary picture and the content commentary audio form the content commentary data. The anchor terminal 12 sends the collected content description data to the live broadcast server terminal 11, so that the live broadcast server terminal 11 stores the content description data of the content to be described, which is stored in the anchor terminal 12.
Meanwhile, in order for the viewer side 13 to be able to view the content to be explained by the anchor side 12, the live broadcast service side 11 needs to acquire the content running data of the content to be explained stored on the content service side 10. The content operation data comprises content operation data and content state data. Taking the game match to be explained as the content to be explained as an example, the content running data includes the game operation data and the game state data of the game player. For example, the game operation data may be game player moving chess pieces, obtaining new chess pieces, etc., and the game state data may be information (race, attribute, etc.) of the chess pieces, position (position on battlefield) of the chess pieces, orientation (direction the chess pieces face on the board), state (existing skill, skill cooling, blood volume, etc.) of the chess pieces. When a game player performs a game operation, the content server 10 stores game operation data and game state data of the game player in synchronization so that the live broadcast server 11 can acquire the game operation data when a game comment is live broadcast. Meanwhile, as the spectator end is provided with the internal spectator system for content explanation in advance, and various scene parameters under the operation of the content are configured in the internal spectator system, for example, for the game spectator system, the spectator end can enter the initial state picture of the game by selecting the game explained this time after logging in the game spectator system, and the spectator end can directly execute the corresponding game operation under the initial state picture after acquiring the game operation data and the game state data of the game player at the moment, and only sends the game operation data and the game state data without sending the specific picture of the game to the spectator end, the data volume transmitted between the live broadcast server and the content server end as well as the spectator end is greatly reduced, and the bandwidth cost of the live broadcast server is reduced.
In practical applications, when the anchor terminal 12 performs the content to be explained and broadcast directly, the anchor terminal 12 may view the content to be explained on site, and may also access the content server 10 to view the content to be explained, for example, the anchor terminal 12 logs in the front-end application corresponding to the content server 10, and then displays a content operation screen of a content executor that operates in real time on an interface of the anchor terminal 12. Optionally, when the anchor terminal 12 accesses the content server terminal 10 to view the content to be explained, the content server terminal 10 may forward the content operation data of the content to be explained to the anchor terminal 12. In this way, the live server 11 can obtain the content operation data from the content server 10 or the anchor 12. Therefore, optionally, a source obtaining rule of the content running data is further set on the live broadcast server 11, so that when the live broadcast server 11 obtains the content running data of the content to be explained, the live broadcast server 11 can obtain the content running data of the content to be explained from the content server 10 or the anchor server 12 based on the source obtaining rule, so that the obtaining mode of the content running data is diversified, double backup of the content running data is realized, and the condition that the audience 13 cannot watch the content explanation live broadcast after the data of a certain data storage party is lost is avoided.
After the live broadcast server 11 obtains the content operation data of the content to be explained and the content explanation data of the content to be explained by the anchor, the live broadcast server 11 needs to perform synchronous matching processing on the content operation data and the content explanation data and then forwards the content operation data and the content explanation data to the audience 13.
In practical applications, the content operation data and the content comment data may respectively include corresponding timestamps, and the timestamps may be relative time or absolute time. The relative time of the content operation data is the time difference relative to the live broadcast starting time of the content to be explained, and the relative time of the content explanation data is the time difference relative to the live broadcast starting time of the explanation. Taking the time stamps included in the content operation data and the content description data as absolute time as an example, the live broadcast server 11 may select the content operation data and the content description data with the same time stamp as matching data, and forward the matching data to the viewer 13.
After the viewer 13 obtains the matched content operation data and content comment data sent by the live broadcast server 11, the viewer 13 recovers the content to be explained by using the content operation data, and synchronously displays the content comment picture of the anchor and synchronously plays the content comment audio of the anchor. The content description screen can be displayed on the content to be described in an overlapping manner.
With continued reference to fig. 2, in order to enable the viewer 13 to normally view the live content commentary, optionally, corresponding content applications are configured on both the anchor 12 and the viewer 13. Correspondingly, the anchor terminal 12 plays the content to be explained through the content application on the host computer, and then can explain the played content to be explained to form content explanation data. The process of the viewer side 13 using the content operation data to restore the content to be explained may be: the viewer end 13 calculates the content running data of the content to be explained by calling the content configuration parameters of the content application on the local machine so as to restore the content to be explained. After the spectator end 13 restores the content to be explained, the spectator end 13 synchronously decodes the content explanation picture in the matched content explanation data, and renders the restored content to be explained and the content explanation picture off the screen for display.
Specifically, the live application in the viewer 13 calls the content configuration parameters in the content application on the local device, restores the picture to be explained through the content state data in the content running data, and sequentially changes the content state data by using the dynamic operation data in the content running data, thereby restoring the content to be explained. In one embodiment, when the live content commentary watched by the audience 13 is the live game commentary, the content application is a game client, i.e. the game client needs to be installed on both the anchor end 12 and the audience 13. Meanwhile, the content comment data may also be data encoded by an encoding algorithm, so that the viewer 13 also decodes the content comment data through a local decoding module to obtain a content comment picture and a content comment audio in the content comment data. Then, the viewer 13 performs off-screen rendering on the restored content to be explained and the content explanation picture, displays the rendered picture, and synchronously plays the content explanation audio.
In the live broadcasting system based on content explanation provided by the embodiment of the invention, the live broadcasting service end acquires the content operation data on the content service end and the content explanation data acquired by the host end for the content to be explained, synchronously matches the content operation data and the content explanation data and forwards the content explanation data to the audience end, and the audience end restores the content to be explained by using the content operation data and synchronously plays the matched content explanation data. For the content to be explained, the live broadcast server only needs to obtain the content operation data in the content to be explained from the content server, does not need to obtain the whole content picture of the content to be explained from the content server, and the live broadcast server only forwards the content operation data in the content to be explained to the audience, and does not need to forward the whole content picture to the audience.
Example two
Fig. 3 is a flowchart illustrating a live broadcasting method based on content description according to a second embodiment of the present application. It should be noted that the live broadcasting method based on content commentary provided in this embodiment may be executed by a live broadcasting device based on content commentary provided in this embodiment, where the device may be implemented in a software and/or hardware manner and integrated in a live broadcasting server executing the method. The embodiment of the present application relates to how a live broadcast server implements a live broadcast process of content commentary on content to be commentary, and specifically, as shown in fig. 3, the method may include:
s101, respectively obtaining content operation data and content description data of content to be described at a specified source end.
Specifically, the content to be explained is the content explained by the anchor in the explanation live broadcasting room. Alternatively, the content to be explained may be a game match to be explained. The content operation data may include content operation data and content state data, and the content commentary data includes a content commentary screen and content commentary audio for the anchor to commentary. Taking the content to be explained as the game match to be explained as an example, the content running data may be game operation data and game state data of a game player. For example, the game operation data may be game player moving chess pieces, obtaining new chess pieces, etc., and the game state data may be information (race, attribute, etc.) of the chess pieces, position (position on battlefield) of the chess pieces, orientation (direction the chess pieces face on the board), state (existing skill, skill cooling, blood volume, etc.) of the chess pieces. The content commentary data may include an event commentary screen and generated event commentary audio, which are played by the anchor when the game commentary is played.
When the audience needs to watch the content description live broadcast, the live broadcast server may obtain the content operation data and the content description data from the specified source respectively. Optionally, the process of acquiring the content operation data and the content description data may be: acquiring content running data of the content to be explained from a content server or a main broadcasting end in the explanation live broadcasting room according to a preset source end acquisition rule; and acquiring the content comment data of the content to be explained from a main broadcasting end in the comment live broadcasting room.
In practical application, the anchor end performs content explanation on the content to be explained while viewing the content to be explained, and at this time, the anchor end stores the content explanation data, so that the live broadcast server can obtain the content explanation data of the content to be explained from the anchor end in the explanation live broadcast room. Of course, the anchor terminal may view the content to be explained on site (that is, the anchor terminal does not access to the content server terminal to view the content to be explained), or may view the content to be explained through the viewing system (that is, the anchor terminal accesses to the content server terminal to view the content to be explained), for example, the anchor terminal logs in the front-end application corresponding to the content server terminal, and then the content server terminal sends the content running data of the content to be explained to the anchor terminal, so as to display the content operation picture of the real-time operation of the content executor on the interface of the anchor terminal according to the content running data. That is, when the anchor terminal accesses the content server terminal to view the content to be explained, the anchor terminal also stores the content operation data of the content to be explained. Certainly, since the content executing party (such as a game participant) operates the content to be explained in real time to change in the live broadcasting process, the corresponding content running data is generated and sent to the content server, and the content server forwards the content running data to other content executing parties (such as other game participants), so that the complete running of the content is realized, the content running data of the content to be explained in the live broadcasting process can be stored on the content server in real time. That is, no matter whether the anchor terminal is connected to the content server terminal to watch the content to be explained, the content server terminal stores the content operation data of the content to be explained. For such a situation, when the live broadcast server obtains the content operation data, the live broadcast server may obtain the content operation data from a content server or an anchor terminal in the live broadcast commentary room according to a source terminal obtaining rule set by the live broadcast server.
Optionally, the source end obtaining rule may be that if the anchor end is accessed to the content server end to view the content to be explained, the content operation data of the content to be explained is obtained from the anchor end, and if the anchor end is not accessed to the content server end to view the content to be explained, the content operation data of the content to be explained is obtained from the content server end.
And S102, synchronously matching the content operation data and the content comment data, and then forwarding the content operation data and the content comment data to a spectator end in a comment live broadcast room, so that the spectator end restores the content to be explained by adopting the content operation data, and synchronously plays the matched content comment data.
After the live broadcast server acquires the content operation data and the content comment data, in order to ensure that the played content is synchronous at the audience, the live broadcast server also needs to perform synchronous matching processing on the acquired content operation data and the content comment data, and forward the matched content operation data and content comment data to the audience. Therefore, after the audience terminal receives the matched content operation data and the content explanation data, the audience terminal can call the content configuration parameters of the content application on the local machine to calculate the content operation data, so as to restore the content to be explained, decode a content explanation picture and content explanation audio in the content explanation data by using a corresponding decoding algorithm, render the restored content to be explained and the content explanation picture for display in an off-screen mode, and play the content explanation audio synchronously. The content comment picture can be displayed on the content to be commented in an overlapped manner, or the content comment picture can be positioned around the content to be commented.
Optionally, when the anchor terminal and the audience terminal access the anchor server, the anchor server may further perform identity authentication on the anchor terminal and the audience terminal, respectively, and after the identity authentication is passed, allow the anchor terminal and the audience terminal to access the anchor server.
In the live broadcasting method based on content explanation provided by the embodiment of the invention, the live broadcasting server respectively obtains the content operation data and the content explanation data of the content to be explained at the specified source end, and forwards the content operation data and the content explanation data to the audience end in the explanation live broadcasting room after synchronous matching, so that the audience end adopts the content operation data to restore the content to be explained and synchronously plays the matched content explanation data. The live broadcast server only needs to obtain the content operation data in the content picture from the content server, does not need to obtain the whole content picture from the content server, and only forwards the content operation data in the content picture to the audience without forwarding the whole content picture to the audience.
EXAMPLE III
Fig. 4 is a schematic flow chart of a live broadcasting method based on content description according to a third embodiment of the present application. The embodiment is optimized on the basis of the technical scheme provided by the embodiment. Referring to fig. 4, the method may include:
s201, content operation data and content description data of the content to be described are obtained at a specified source end respectively.
S202, obtaining the synchronous time difference of the content operation data and the content comment data.
In order to ensure that the content to be explained live broadcast by the audience end matches with the explanation content of the anchor, the anchor acquires the content operation data and the content explanation data and simultaneously acquires the synchronization time difference between the content operation data and the content explanation data. Optionally, the live broadcast server may obtain the synchronization time difference between the content operation data and the content comment data according to a comparison result between the live broadcast start time of the content to be explained and the comment start time of the content to be explained by the anchor terminal.
And S203, synchronizing and matching the content operation data and the content comment data by adopting the synchronization time difference, and then forwarding the content operation data and the content comment data to a spectator end in a comment live broadcast room so that the spectator end restores the content to be explained by adopting the content operation data and synchronously plays the matched content comment data.
The live broadcast server can select the matched content operation data and content explanation data to forward to the audience terminal in the explanation live broadcast room based on the synchronization time difference, the time stamp of the content operation data and the time stamp of the content explanation data. For example, it is assumed that the content commentary data to be processed at this time is data corresponding to a first time that is 3 minutes apart from the commentary start time, that is, the timestamp of the content commentary data is 3 minutes, and it is assumed that the acquisition time of the content commentary data is 1 minute later than the acquisition time of the content operation data, that is, the synchronization time difference between the content commentary data and the content operation data is 1 minute, at this time, the live broadcast server selects the content operation data corresponding to a second time as data matched with the content commentary data according to the timestamp and the synchronization time difference of the content commentary data, where the interval between the second time and the live broadcast start time of the content to be commentary is 4 minutes.
In this embodiment, the live broadcast server needs to acquire the synchronization time difference between the content operation data and the content comment data while acquiring the content operation data and the content comment data, and performs synchronization matching processing on the content operation data and the content comment data based on the synchronization time difference, so that the data forwarded to the audience terminal is matched, and thus the content to be explained restored and displayed by the audience terminal based on the content operation data is synchronized with the played content comment data, thereby preventing loss of the user due to the fact that the displayed content to be explained is not synchronized with the played content comment data.
In order to facilitate understanding of those skilled in the art, the following takes content to be explained as a game match as an example, and is described in conjunction with the above live broadcast system based on content explanation, where reference is made to fig. 5, a live broadcast method based on content explanation provided in an embodiment of the present application may include:
s201, the live broadcast server obtains game running data from a game server or a main broadcast end.
Wherein, the anchor end and the audience end need to be provided with game client ends in advance. The game play data includes game operation data and game state data.
S202, the anchor terminal collects a game comment picture of the anchor and a game comment audio of the anchor for a game match, and codes the game comment picture and the game comment audio to obtain a live broadcast code stream.
The anchor terminal can collect the game comment picture by controlling the camera device and collect the game comment audio by controlling the audio input device (such as a microphone). The anchor terminal encodes the game comment picture into h264 code stream and mixes the h264 code stream into the game comment audio to form live broadcast code stream, wherein the live broadcast code stream is game comment data.
And S203, the anchor side sends the live broadcast code stream to a live broadcast server.
And S204, the live broadcast server performs synchronous matching processing on the game running data and the live broadcast code stream by adopting the synchronous time difference.
S205, the live broadcast server forwards the matched game running data and live broadcast code stream to the audience.
S206, the spectator end calculates the game running data by adopting the game client end to restore the game competition picture, decodes the live broadcast code stream by adopting the decoding module to obtain the game comment picture and the game comment audio frequency, renders the game competition picture and the game comment picture off the screen for display, and synchronously plays the game comment audio frequency.
Example four
Fig. 6 is a schematic structural diagram of a live broadcast device based on content explanation according to a fourth embodiment of the present application. As shown in fig. 6, the apparatus may include: a content data acquisition module 20 and a synchronous forwarding module 21.
Specifically, the content data obtaining module 20 is configured to obtain content operation data and content description data of the content to be described at a specified source end respectively;
the synchronous forwarding module 21 is configured to forward the content operation data and the content comment data to a viewer in a comment live broadcast room after performing synchronous matching, so that the viewer restores the content to be explained by using the content operation data, and synchronously plays the matched content comment data.
In the live broadcasting device based on content explanation provided by the embodiment of the invention, the live broadcasting server respectively obtains the content operation data and the content explanation data of the content to be explained at the specified source end, and forwards the content operation data and the content explanation data to the audience end in the explanation live broadcasting room after synchronously matching the content operation data and the content explanation data, so that the audience end adopts the content operation data to restore the content to be explained and synchronously plays the matched content explanation data. The live broadcast server only needs to obtain the content operation data in the content picture from the content server, does not need to obtain the whole content picture from the content server, and only forwards the content operation data in the content picture to the audience without forwarding the whole content picture to the audience.
The live broadcasting device based on the content explanation provided by the embodiment can be applied to the live broadcasting method based on the content explanation provided by any embodiment, and has corresponding functions and beneficial effects.
EXAMPLE five
Fig. 7 is a schematic structural diagram of a live server according to a fifth embodiment of the present invention, as shown in fig. 7, the live server includes a processor 50, a storage device 51, and a communication device 52; the number of processors 50 in the live server may be one or more, and one processor 50 is taken as an example in fig. 6; the processor 50, the storage means 51 and the communication means 52 in the live server may be connected by a bus or other means, as exemplified by the connection via a bus in fig. 6.
The storage device 51 is a computer-readable storage medium, and can be used to store software programs, computer-executable programs, and modules, such as program instructions/modules corresponding to the live broadcasting method based on content commentary according to any embodiment of the present invention. The processor 50 executes various functional applications and data processing of the live broadcast server by running software programs, instructions and modules stored in the storage device 51, that is, the live broadcast method based on the content commentary is realized.
The storage device 51 may mainly include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application program required for at least one function; the storage data area may store data created according to the use of the terminal, and the like. Further, the storage 51 may include high speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other non-volatile solid state storage device. In some examples, the storage 51 may further include memory located remotely from the processor 50, which may be connected to a live server over a network. Examples of such networks include, but are not limited to, the internet, intranets, local area networks, mobile communication networks, and combinations thereof.
The communication means 52 may be used to enable a network connection or a mobile data connection between the devices.
The live broadcast server provided by the embodiment can be used for executing the live broadcast method based on the content explanation provided by any embodiment, and has corresponding functions and beneficial effects.
EXAMPLE six
An embodiment of the present application further provides a computer-readable storage medium, on which a computer program is stored, where the computer program, when executed by a processor, can implement the live broadcast method based on content commentary in any of the above embodiments. The method specifically comprises the following steps:
respectively acquiring content operation data and content explanation data of content to be explained at a specified source end;
and synchronously matching the content operation data and the content comment data, and then forwarding the content operation data and the content comment data to a spectator end in a comment live broadcast room, so that the spectator end restores the content to be explained by adopting the content operation data and synchronously plays the matched content comment data.
Of course, the storage medium provided in the embodiments of the present application contains computer-executable instructions, and the computer-executable instructions are not limited to the method operations described above, and may also perform related operations in the live broadcast method based on content commentary provided in any embodiment of the present application.
Based on the understanding that the technical solutions of the present application can be embodied in the form of software products, which can be stored in a computer-readable storage medium, such as a floppy disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a flash Memory (F L ASH), a hard disk or an optical disk of a computer, and the like, and include instructions for enabling a computer device (which may be a personal computer, a server, or a network device) to execute the methods described in the embodiments of the present application.
It should be noted that, in the embodiment of the processing apparatus for media resources, the included units and modules are only divided according to functional logic, but are not limited to the above division as long as the corresponding functions can be implemented; in addition, specific names of the functional units are only used for distinguishing one functional unit from another, and are not used for limiting the protection scope of the application.
The above description is only a preferred embodiment of the present application and is not intended to limit the present application, and various modifications and changes may be made by those skilled in the art. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present application shall be included in the protection scope of the present application.
Claims (13)
1. A live broadcast system based on content commentary, comprising: the system comprises a content server, a live broadcast server, a main broadcast server and a spectator, wherein the content server stores content running data of content to be explained; wherein,
the live broadcast server acquires content operation data on the content server and content comment data acquired by the anchor terminal for the content to be explained, and forwards the content operation data and the content comment data to the audience terminal after synchronous matching; and the audience terminal restores the content to be explained by adopting the content operation data and synchronously plays the matched content explanation data.
2. The live broadcasting system of claim 1, wherein when the anchor terminal accesses the content server terminal to view the content to be explained, the content server terminal forwards content operation data of the content to be explained to the anchor terminal.
3. The live broadcasting system according to claim 2, wherein a source acquisition rule of the content running data is set on the live broadcasting server to instruct to acquire the content running data to be explained from the content server or the anchor.
4. A live system according to claim 1, wherein the anchor end and the viewer end are each provided with a corresponding content application; wherein,
the anchor end plays the content to be explained through a content application on the local machine;
and the audience terminal calculates the content running data of the content to be explained by calling the content configuration parameters of the content application on the local machine so as to restore the content to be explained.
5. A live broadcasting system according to any one of claims 1 to 4, wherein the viewer side decodes the content commentary picture in the matched content commentary data synchronously after restoring the content to be commentary, and renders the restored content to be commentary and the content commentary picture off screen to display the corresponding rendering result.
6. A live broadcast method based on content explanation is characterized by comprising the following steps:
respectively acquiring content operation data and content explanation data of content to be explained at a specified source end;
and synchronously matching the content operation data and the content comment data, and then forwarding the content operation data and the content comment data to a spectator end in a comment live broadcast room, so that the spectator end restores the content to be explained by adopting the content operation data and synchronously plays the matched content comment data.
7. A live broadcasting method according to claim 6, wherein the obtaining of the content operation data and the content description data of the content to be described at the specified source end respectively comprises:
acquiring content running data of the content to be explained from a content server or a main broadcasting end in the explanation live broadcasting room according to a preset source end acquisition rule;
and acquiring the content comment data of the content to be explained from a main broadcasting end in the comment live broadcasting room.
8. The live broadcasting method according to claim 7, wherein the source end obtaining rule is that if the anchor end is accessed to the content server end to view the content to be explained, the source end obtains content running data of the content to be explained from the anchor end, and if the anchor end is not accessed to the content server end to view the content to be explained, the source end obtains content running data of the content to be explained from the content server end.
9. The live broadcasting method according to claim 6, wherein when the content run data and the content commentary data of the content to be commentary are obtained at a specified source end respectively, the method further comprises:
acquiring the synchronous time difference of the content running data and the content comment data;
the synchronously matching the content operation data and the content comment data comprises:
and adopting the synchronization time difference to perform synchronization matching on the content operation data and the content comment data.
10. A live method according to any one of claims 6-9, further comprising:
and respectively carrying out identity authentication on the anchor terminal and the audience terminal in the commentary live broadcasting room.
11. A live broadcast apparatus based on content explanation, comprising:
the content data acquisition module is used for respectively acquiring content operation data and content explanation data of the content to be explained at a specified source end;
and the synchronous forwarding module is used for synchronously matching the content operation data and the content comment data and then forwarding the content operation data and the content comment data to a spectator end in a comment live broadcast room so that the spectator end restores the content to be explained by adopting the content operation data and synchronously plays the matched content comment data.
12. A live server, comprising:
one or more processors;
storage means for storing one or more programs;
when executed by the one or more processors, cause the one or more processors to implement a content commentary-based live method as claimed in any one of claims 6 to 10.
13. A computer-readable storage medium, on which a computer program is stored, which, when being executed by a processor, implements a content commentary-based live broadcasting method according to any one of claims 6 to 10.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010250990.XA CN111447458A (en) | 2020-04-01 | 2020-04-01 | Live broadcast system, method and device based on content explanation and live broadcast server |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010250990.XA CN111447458A (en) | 2020-04-01 | 2020-04-01 | Live broadcast system, method and device based on content explanation and live broadcast server |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN111447458A true CN111447458A (en) | 2020-07-24 |
Family
ID=71652703
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010250990.XA Pending CN111447458A (en) | 2020-04-01 | 2020-04-01 | Live broadcast system, method and device based on content explanation and live broadcast server |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111447458A (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114007091A (en) * | 2021-10-27 | 2022-02-01 | 北京市商汤科技开发有限公司 | Video processing method and device, electronic equipment and storage medium |
| WO2024099335A1 (en) * | 2022-11-10 | 2024-05-16 | 北京字跳网络技术有限公司 | Livestream method and apparatus, device and storage medium |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101018237A (en) * | 2007-01-16 | 2007-08-15 | 成都金山互动娱乐科技有限公司 | A method for playing the online synchronization explication of the network game |
| CN105791958A (en) * | 2016-04-22 | 2016-07-20 | 北京小米移动软件有限公司 | Method and device for live broadcasting game |
| CN106162043A (en) * | 2015-04-14 | 2016-11-23 | 杭州施强网络科技有限公司 | Multimedia file demenstration method in a kind of video conferencing system |
| US20180139257A1 (en) * | 2016-11-15 | 2018-05-17 | Genvid Technologies, Inc. | Systems and methods for video game streaming utilizing feedback and aggregation of viewer interests and interactions |
| CN109195020A (en) * | 2018-10-11 | 2019-01-11 | 三星电子（中国）研发中心 | A kind of the game live broadcasting method and system of AR enhancing |
-
2020
- 2020-04-01 CN CN202010250990.XA patent/CN111447458A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101018237A (en) * | 2007-01-16 | 2007-08-15 | 成都金山互动娱乐科技有限公司 | A method for playing the online synchronization explication of the network game |
| CN106162043A (en) * | 2015-04-14 | 2016-11-23 | 杭州施强网络科技有限公司 | Multimedia file demenstration method in a kind of video conferencing system |
| CN105791958A (en) * | 2016-04-22 | 2016-07-20 | 北京小米移动软件有限公司 | Method and device for live broadcasting game |
| US20180139257A1 (en) * | 2016-11-15 | 2018-05-17 | Genvid Technologies, Inc. | Systems and methods for video game streaming utilizing feedback and aggregation of viewer interests and interactions |
| CN109195020A (en) * | 2018-10-11 | 2019-01-11 | 三星电子（中国）研发中心 | A kind of the game live broadcasting method and system of AR enhancing |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114007091A (en) * | 2021-10-27 | 2022-02-01 | 北京市商汤科技开发有限公司 | Video processing method and device, electronic equipment and storage medium |
| WO2024099335A1 (en) * | 2022-11-10 | 2024-05-16 | 北京字跳网络技术有限公司 | Livestream method and apparatus, device and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10039979B2 (en) | Capturing asynchronous commentary to pre-recorded gameplay | |
| CN111818004B (en) | Cloud game live broadcast method and system and computer readable storage medium | |
| EP2940940B1 (en) | Methods for sending and receiving video short message, apparatus and handheld electronic device thereof | |
| WO2016150317A1 (en) | Method, apparatus and system for synthesizing live video | |
| CN108495152B (en) | Video live broadcast method and device, electronic equipment and medium | |
| CN111836074B (en) | Live wheat-connecting method and device, electronic equipment and storage medium | |
| US20220167036A1 (en) | Live broadcast method and apparatus, and computer device and storage medium | |
| CN109391851B (en) | Video live broadcast method and device, computer equipment and storage medium | |
| JP5916244B2 (en) | Video playback system | |
| CN112073543B (en) | Cloud video recording method and system and readable storage medium | |
| CN112019877A (en) | Screen projection method, device and equipment based on VR equipment and storage medium | |
| CN112752114B (en) | Method and device for generating live broadcast playback interactive message, server and storage medium | |
| CN103368932A (en) | Multi-screen video playback system and related multi-screen control device | |
| CN111432284B (en) | Bullet screen interaction method of multimedia terminal and multimedia terminal | |
| CN112291498B (en) | Audio and video data transmission method and device and storage medium | |
| CN111447458A (en) | Live broadcast system, method and device based on content explanation and live broadcast server | |
| JP7290260B1 (en) | Servers, terminals and computer programs | |
| CN114546308A (en) | Application interface screen projection method, device, equipment and storage medium | |
| CN109756744B (en) | Data processing method, electronic device and computer storage medium | |
| CN115529498A (en) | Live broadcast interaction method and related equipment | |
| WO2024082561A1 (en) | Video processing method and apparatus, computer, readable storage medium, and program product | |
| CN116801006A (en) | Live-broadcast continuous-wheat confluence method, equipment and storage medium | |
| JP2009171294A (en) | Video distribution system, video relay apparatus, and video relay method | |
| CN111918092B (en) | Video stream processing method, device, server and storage medium | |
| CN112995692B (en) | Interactive data processing method, device, equipment and medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20200724 |