CN109618178A - A kind of live broadcasting method, apparatus and system - Google Patents
A kind of live broadcasting method, apparatus and system Download PDFInfo
- Publication number
- CN109618178A CN109618178A CN201910054096.2A CN201910054096A CN109618178A CN 109618178 A CN109618178 A CN 109618178A CN 201910054096 A CN201910054096 A CN 201910054096A CN 109618178 A CN109618178 A CN 109618178A
- Authority
- CN
- China
- Prior art keywords
- media stream
- mixed
- live
- demand
- stream
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/21—Server components or server architectures
- H04N21/218—Source of audio or video content, e.g. local disk arrays
- H04N21/2187—Live feed
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/234—Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs
- H04N21/23424—Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs involving splicing one content stream with another content stream, e.g. for inserting or substituting an advertisement
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/234—Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs
- H04N21/2343—Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements
- H04N21/234309—Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements by transcoding between formats or standards, e.g. from MPEG-2 to MPEG-4 or from Quicktime to Realvideo
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/235—Processing of additional data, e.g. scrambling of additional data or processing content descriptors
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/435—Processing of additional data, e.g. decrypting of additional data, reconstructing software from modules extracted from the transport stream
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs
- H04N21/44016—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving splicing one content stream with another content stream, e.g. for substituting a video clip
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs
- H04N21/4402—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
- H04N21/440218—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display by transcoding between formats or standards, e.g. from MPEG-2 to MPEG-4
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/475—End-user interface for inputting end-user data, e.g. personal identification number [PIN], preference data
- H04N21/4756—End-user interface for inputting end-user data, e.g. personal identification number [PIN], preference data for rating content, e.g. scoring a recommended movie
Abstract
The embodiment of the invention provides a kind of live broadcasting method, apparatus and system, method includes: to receive the mark for the on-demand media stream that live streaming client is sent, and the live media stream for on-demand media stream；According to the mark of on-demand media stream, on-demand media stream is obtained from Resource Server；On-demand media stream and live media stream are subjected to synchronized mixes, obtain mixed video stream；Mixed video stream is sent to user client.As it can be seen that the commentary live streaming that the embodiment of the present invention can be realized visual form more vividly, intuitively improves user experience.In addition, on-demand media stream and live media stream are mixed in server sync, the resource of main broadcaster's client will not be occupied, will not during live streaming the incoherent content of typing.
Description
Technical field
The present invention relates to multi-media processing technical fields, more particularly to a kind of live broadcasting method, apparatus and system.
Background technique
Net cast industry develops rapidly in recent years, wherein it is a kind of emerging direct-seeding that video display, which comment live streaming,.Video display are commented
During stating live streaming, spectators can with main broadcaster synchronize see films and television programs, meanwhile, spectators can also watch main broadcaster to the films and television programs
Commentary.
Existing video display are commented in live streaming, and main broadcaster obtains order video and synchronous sight from program request streaming server respectively with spectators
It sees, the commentary of main broadcaster is pushed to General Visitors in the form of text, thus, spectators are when watching order video, it can be seen that main
The text broadcast for order video is commented.
However, text is commented not enough vividly, intuitively, user experience is bad.
Summary of the invention
The embodiment of the present invention is designed to provide a kind of live broadcasting method, apparatus and system, to realize commenting for visual form
Live streaming is stated, more vividly, intuitively, improves user experience.
Specific technical solution is as follows:
To achieve the goals above, the embodiment of the invention provides a kind of live broadcast system, the system comprises: resource service
Device, mixed flow server, the distribution server, main broadcaster's client and user client；
Main broadcaster's client obtains main broadcaster and is directed to the point for obtaining on-demand media stream from the Resource Server
The mark of the on-demand media stream and the live media stream are sent to the mixed flow and taken by the live media stream for broadcasting Media Stream
Business device；
The mixed flow server, for obtaining the point from the Resource Server according to the mark of the on-demand media stream
Media Stream is broadcast, and the on-demand media stream and the live media stream are subjected to synchronized mixes, obtains mixed-media stream, it will be described
Mixed-media stream is sent to the distribution server；
The distribution server, for the mixed-media stream to be sent to the user client.
Optionally, the on-demand media stream that will acquire and the live media stream carry out synchronized mixes, obtain mixing matchmaker
The step of body stream, comprising:
The on-demand media stream and the live media stream are decoded respectively, obtain target medium decoding data and
Media decoding data is commented in real time；
According to preset configuration, to the target medium decoding data and comments media decoding data in real time and compiled again
Code, obtains mixed-media stream.
Optionally, the preset configuration includes: the resolution ratio of mixed-media stream, code rate and the on-demand media stream and institute
State relative position and size of the live media stream in the display image of the mixed-media stream.
To achieve the goals above, the embodiment of the invention also provides a kind of live broadcasting methods, are applied to mixed flow server, institute
The method of stating includes:
The synchronizing information that main broadcaster's client is sent is received, the synchronizing information includes the mark of on-demand media stream, Yi Jizhen
To the live media stream of the on-demand media stream；
According to the mark of the on-demand media stream, on-demand media stream is obtained from Resource Server；
The on-demand media stream and the live media stream are subjected to synchronized mixes, obtain mixed-media stream；
The mixed-media stream is sent to the distribution server, so that the distribution server sends out the mixed-media stream
It send to user client.
Optionally, described that acquired on-demand media stream and the live media stream are subjected to synchronized mixes, it is mixed
The step of Media Stream, comprising:
Acquired on-demand media stream and the live media stream are decoded respectively, obtain target medium decoding data
And media decoding data is commented in real time；
According to preset configuration, to the target medium decoding data and comments media decoding data in real time and compiled again
Code, obtains mixed-media stream.
Optionally, the preset configuration, comprising: the resolution ratio of mixed-media stream, code rate and the on-demand media stream with
Relative position and size of the live media stream in the display image of the mixed-media stream.
To achieve the goals above, the embodiment of the invention also provides a kind of live broadcast devices, are applied to mixed flow server, institute
Stating device includes:
Receiving module sends synchronizing information for receiving main broadcaster's client, and the synchronizing information includes on-demand media stream
Mark, and for the live media stream of the on-demand media stream；
Module is obtained, for the mark according to the on-demand media stream, obtains on-demand media stream from Resource Server；
Mixing module obtains mixing matchmaker for the on-demand media stream and the live media stream to be carried out synchronized mixes
Body stream；
Sending module, for the mixed-media stream to be sent to the distribution server, so that the distribution server is by institute
It states mixed-media stream and is sent to user client.
Optionally, the mixing module, is specifically used for:
Acquired on-demand media stream and the live media stream are decoded respectively, obtain target medium decoding data
And media decoding data is commented in real time；
According to preset configuration, to the target medium decoding data and comments media decoding data in real time and compiled again
Code, obtains mixed-media stream.
Optionally, the preset configuration, comprising: the resolution ratio of mixed-media stream, code rate and the on-demand media stream with
Relative position and size of the live media stream in the display image of the mixed-media stream.
To achieve the goals above, the embodiment of the invention also provides a kind of electronic equipment, including processor, communication to connect
Mouth, memory and communication bus, wherein processor, communication interface, memory complete mutual communication by communication bus；
Memory, for storing computer program；
Processor when for executing the program stored on memory, realizes any of the above-described method and step.
To achieve the goals above, the embodiment of the invention also provides a kind of computer readable storage medium, the calculating
Computer program is stored in machine readable storage medium storing program for executing, the computer program realizes any of the above-described method when being executed by processor
Step.
Live broadcasting method provided in an embodiment of the present invention, apparatus and system receive the on-demand media stream that live streaming client is sent
Mark, and the live media stream for on-demand media stream；According to the mark of on-demand media stream, point is obtained from Resource Server
Broadcast Media Stream；On-demand media stream and live media stream are subjected to synchronized mixes, obtain mixed video stream；Mixed video stream is sent
To user client.As it can be seen that the commentary live streaming that the embodiment of the present invention can be realized visual form more vividly, is intuitively improved and is used
Family experience.In addition, on-demand media stream and live media stream are mixed in server sync, the money of main broadcaster's client will not be occupied
Source, will not during live streaming the incoherent content of typing.
Certainly, implement any of the products of the present invention or method it is not absolutely required at the same reach all the above excellent
Point.
Detailed description of the invention
In order to more clearly explain the embodiment of the invention or the technical proposal in the existing technology, to embodiment or will show below
There is attached drawing needed in technical description to be briefly described, it should be apparent that, the accompanying drawings in the following description is only this
Some embodiments of invention for those of ordinary skill in the art without creative efforts, can be with
It obtains other drawings based on these drawings.
Fig. 1 is a kind of structural schematic diagram of live broadcast system provided in an embodiment of the present invention；
Fig. 2 is a kind of flow chart of live broadcasting method provided in an embodiment of the present invention；
Fig. 3 is a kind of structural schematic diagram of live broadcast device provided in an embodiment of the present invention；
Fig. 4 is a kind of structural schematic diagram of electronic equipment provided in an embodiment of the present invention.
Specific embodiment
Following will be combined with the drawings in the embodiments of the present invention, and technical solution in the embodiment of the present invention carries out clear, complete
Site preparation description, it is clear that described embodiments are only a part of the embodiments of the present invention, instead of all the embodiments.It is based on
Embodiment in the present invention, it is obtained by those of ordinary skill in the art without making creative efforts every other
Embodiment shall fall within the protection scope of the present invention.
Referring to Fig. 1, Fig. 1 is a kind of structural schematic diagram of live broadcast system provided in an embodiment of the present invention, as shown in Figure 1, should
Live broadcast system includes main broadcaster's client 101, Resource Server 102, mixed flow server 103, the distribution server 104 and user visitor
Family end 105.
Wherein, main broadcaster's client 101 obtains on-demand media stream from Resource Server 102, and obtains main broadcaster for program request matchmaker
The mark of on-demand media stream and live media stream are sent to mixed flow server 103 by the live media stream of body stream.
Wherein, on-demand media stream is the video display class Media Stream of main broadcaster's viewing synchronous with user, such as " thinkling sound Ya list ".Matchmaker is broadcast live
Body stream is the commentary Media Stream that main broadcaster is directed to on-demand media stream, such as main broadcaster is directed to the commentary Media Stream that " thinkling sound Ya list " is done.
In the embodiment of the present invention, Media Stream indicates the mixing of video flowing and audio stream.
Mixed flow server 103 obtains on-demand media stream from Resource Server 102 according to the mark of on-demand media stream, and by point
It broadcasts Media Stream and live media stream carries out synchronized mixes, obtain mixed-media stream, mixed-media stream is sent to the distribution server
104。
Mixed-media stream is sent to user client 105 by the distribution server 104.
Live broadcast system provided by the invention is described in detail below:
In the embodiment of the present invention, when carrying out video display commentary live streaming, main broadcaster can be chosen main broadcaster by main broadcaster's client 101
On-demand media stream, then main broadcaster's client 101 can obtain on-demand media stream from Resource Server 102.Main broadcaster's client 101 simultaneously
The connection with mixed flow server 103 is established, the mark of program request Media Stream is sent to mixed flow server 103.
Mixed flow server 103 obtains on-demand media stream from Resource Server 102 according to the mark of on-demand media stream, wherein
The on-demand media stream of acquisition can be different quality version, for example, super clear version, high definition version, SD version etc..It can root
Corresponding version is obtained according to actual demand.
In an embodiment of the present invention, mixed flow server 103 is according to the identifier lookup of on-demand media stream to difference
It after the on-demand media stream of quality version, can be connected, be selected by the Intranet between mixed flow server 103 and Resource Server 102
The on-demand media stream of highest-quality version is taken to be downloaded.So as to meet different quality version mixed-media stream mixing
Process.
In the embodiment of the present invention, when main broadcaster's client 101 starts play-on-demand Media Stream, main broadcaster also starts to program request matchmaker
Body stream is commented, and main broadcaster's client 101 records the Media Stream that main broadcaster is commented, and as live media stream, and will be recorded in real time
The live media stream of system is sent to mixed flow server 103.
The live media stream received and the on-demand media stream of downloading are carried out synchronized mixes by mixed flow server 103, are obtained
Mixed-media stream.Wherein, mixed flow server 103 can according to the demand of user, generate the mixed-media stream of a variety of quality versions,
For example, super clear version, high definition version, SD version etc..
In a kind of embodiment of the invention, the on-demand media stream and live media stream that mixed flow server 103 will acquire are carried out
Synchronized mixes, the step of obtaining mixed-media stream, may include following refinement step:
Step 11: on-demand media stream and live media stream are decoded respectively, obtain target medium decoding data and
Media decoding data is commented in real time.
In an embodiment of the present invention, mixed flow server 103 can be decoded on-demand media stream, obtain target medium decoding
Data；And decode live media stream, it obtains commenting decoding data in real time.
Step 12: according to preset configuration, to target medium decoding data and commenting media decoding data in real time and carry out weight
It is newly encoded, obtain mixed-media stream.
In an embodiment of the present invention, mixed flow server 103 can comment media by target medium decoding data and in real time
Decoding data recompiles, and obtains mixed-media stream.User can configure the process recompiled, for example, matching confidence
Breath may include the display of the resolution ratio of mixed-media stream, code rate and on-demand media stream and live media stream in mixed-media stream
Relative position and size in image.
In an embodiment of the present invention, mixed-media stream comments one that video occupies screen in playing process in real time
Subregion is shown, for example, commenting the lower left corner or the lower right corner that video is shown in screen in real time.Above-mentioned on-demand media stream with
Relative position of the live media stream in the display image of mixed-media stream, that is, indicate the display area for commenting video in real time.
In an embodiment of the present invention, on-demand media stream and live media stream can be obtained from main broadcaster's client 101 mixed
Close the relative position in the display image of Media Stream and size.Specifically, mixed flow server 103 can be from main broadcaster's client 101
It obtains and comments display area and size of the video in main broadcaster's client 101 in real time, and carry out mixed-media according to identical configuration
The synthesis of stream, so that the mixed-media stream after synthesis when playing, comments video in the display area of user client 105 in real time
And size is synchronous with main broadcaster's client 101.
In the embodiment of the present invention, the mixed-media stream generated in real time is sent to the distribution server by mixed flow server 103
104, the distribution server 104 notifies each user client 105, and mixed-media stream is ready for, then user client 105 can be with
The mixed-media stream of different quality is downloaded from the distribution server 104 according to self-demand.
It can be seen that can be realized the commentary live streaming of visual form, more using live broadcasting method provided in an embodiment of the present invention
Add lively, intuitive, raising user experience.In addition, on-demand media stream and live media stream are mixed in server sync, it will not
Occupy main broadcaster's client resource, will not during live streaming the incoherent content of typing.
In an embodiment of the present invention, during progress is broadcast live, mixed flow server 103 can detecte the point of downloading
It is whether synchronous with from the received live media stream of main broadcaster's client 101 to broadcast Media Stream, if asynchronous, adjusts on-demand media stream
Playing time, so that on-demand media stream is synchronised with live media stream.
For example, current commentary live streaming is broadcast live for the commentary of certain film, and current mixed flow server 103 is from main broadcaster
The received live media stream of client 101 is the 20th minute for the film, and the media of the film currently obtained
Stream is the 19th minute, and the two is not synchronized.Then when the broadcasting of the Media Stream of the adjustable film of mixed flow server 103
It carves, specifically, mixed flow server 103 directly can obtain the currently playing moment from Resource Server 102 as the 20th minute
The Media Stream of the film, or navigated to the 20th minute from buffered good media resource, to obtain currently playing
The Media Stream for the film that moment is the 20th minute, so that the Media Stream of live media stream and film is synchronised.
In another kind embodiment of the invention, be broadcast live carry out during, main broadcaster may the point commented of adjust automatically
The playing time of Media Stream is broadcast, then main broadcaster can notify mixed flow service by main broadcaster's client 101 after adjusting playing time
Device 103 guarantees on-demand media stream and live media so that mixed flow server 103 also adjusts the playing time of on-demand media stream
Stream is synchronised.
For example, current commentary live streaming is the commentary live streaming for certain film, and during live streaming, main broadcaster is to the film
Playing time adjusted, be adjusted to from the 20th minute the 30th minute, then main broadcaster's client 101 can notify to mix
Streaming server 103, mixed flow server 103 also adjust the playing time of the film.Specifically, mixed flow server 103 can be direct
The Media Stream that the currently playing moment is the halfhour film is obtained from Resource Server 102, or from buffered good
Media resource in navigate to the 30th minute, thus obtain the currently playing moment be the halfhour film media
Stream, so that the Media Stream of live media stream and film is synchronised.
The embodiment of the invention also provides a kind of live broadcasting methods, are applied to mixed flow server, comprising the following steps:
S201: receiving main broadcaster's client and send synchronizing information, and the synchronizing information includes the mark of on-demand media stream, and
For the live media stream of the on-demand media stream.
S202: according to the mark of on-demand media stream, on-demand media stream is obtained from Resource Server.
S203: on-demand media stream and live media stream are subjected to synchronized mixes, obtain mixed-media stream.
In an embodiment of the present invention, above-mentioned steps S203 may include following refinement step:
S203a: acquired on-demand media stream and live media stream are decoded respectively, obtain target medium solution yardage
Media decoding data is commented accordingly and in real time；
S203b: it according to preset configuration, to target medium decoding data and comments media decoding data in real time and carries out again
Coding, obtains mixed-media stream.
Wherein, preset configuration may include: the resolution ratio of mixed-media stream, code rate and on-demand media stream and live streaming matchmaker
Relative position and size of the body stream in the display image of mixed-media stream.
S204: mixed-media stream is sent to the distribution server, so that mixed-media stream is sent to use by the distribution server
Family client.
The specific implementation process of above-mentioned steps is described in detail in system embodiment, and this will not be repeated here.
Using live broadcasting method provided in an embodiment of the present invention, the mark for the target video that live streaming client is sent can receive
Know, and for the real-time comments video flowing of target video；According to the mark of target video, target view is obtained from Resource Server
Frequency flows；Target video stream is synchronized with real-time commentary video flowing and is mixed, mixed video stream is obtained；Mixed video stream is sent
To user client.As it can be seen that the commentary live streaming that the embodiment of the present invention can be realized visual form more vividly, is intuitively improved and is used
Family experience.In addition, on-demand media stream and live media stream are mixed in server sync, the money of main broadcaster's client will not be occupied
Source, will not during live streaming the incoherent content of typing.
The embodiment of the invention also provides a kind of live broadcast devices, are applied to mixed flow server, comprise the following modules:
Receiving module 301 sends synchronizing information for receiving main broadcaster's client, and synchronizing information includes the mark of on-demand media stream
Know, and for the live media stream of on-demand media stream；
Module 302 is obtained, for the mark according to on-demand media stream, obtains on-demand media stream from Resource Server；
Mixing module 303 obtains mixed-media stream for on-demand media stream and live media stream to be carried out synchronized mixes；
Sending module 304, for mixed-media stream to be sent to the distribution server, so that the distribution server is by mixed-media
Stream is sent to user client,
In an embodiment of the present invention, mixing module 303 specifically can be used for:
Acquired on-demand media stream and live media stream are decoded respectively, obtain target medium decoding data and
Media decoding data is commented in real time；
According to preset configuration, to target medium decoding data and comments media decoding data in real time and recompiles,
Obtain mixed-media stream.
In an embodiment of the present invention, preset configuration may include: the resolution ratio of mixed-media stream, code rate and program request matchmaker
The relative position and size of body stream and live media stream in the display image of mixed-media stream.
In an embodiment of the present invention, obtain module 302, can be also used for: from main broadcaster's client obtain relative position and
Size.
Using live broadcast device provided in an embodiment of the present invention, the mark for the target video that live streaming client is sent is received, with
And the real-time comments video flowing for target video；According to the mark of target video, target video stream is obtained from Resource Server；
Target video stream is synchronized with real-time commentary video flowing and is mixed, mixed video stream is obtained；Mixed video stream is sent to use
Family client.As it can be seen that the commentary live streaming that the embodiment of the present invention can be realized visual form more vividly, intuitively improves user's body
It tests.In addition, on-demand media stream and live media stream are mixed in server sync, the resource of main broadcaster's client will not be occupied,
Will not during live streaming the incoherent content of typing.
The embodiment of the invention also provides a kind of electronic equipment, as shown in figure 4, include processor 401, communication interface 402,
Memory 403 and communication bus 404, wherein processor 401, communication interface 402, memory 403 are complete by communication bus 404
At mutual communication,
Memory 403, for storing computer program；
Processor 401 when for executing the program stored on memory 403, realizes following steps:
The synchronizing information that main broadcaster's client is sent is received, the synchronizing information includes the mark of on-demand media stream, Yi Jizhen
To the live media stream of on-demand media stream；
According to the mark of on-demand media stream, on-demand media stream is obtained from Resource Server；
On-demand media stream and live media stream are subjected to synchronized mixes, obtain mixed-media stream；
Mixed-media stream is sent to the distribution server, so that mixed-media stream is sent to user client by the distribution server
End.
As it can be seen that receiving the mark for the target video that live streaming client is sent using electronic equipment provided in an embodiment of the present invention
Know, and for the real-time comments video flowing of target video；According to the mark of target video, target view is obtained from Resource Server
Frequency flows；Target video stream is synchronized with real-time commentary video flowing and is mixed, mixed video stream is obtained；Mixed video stream is sent
To user client.As it can be seen that the commentary live streaming that the embodiment of the present invention can be realized visual form more vividly, is intuitively improved and is used
Family experience.In addition, on-demand media stream and live media stream are mixed in server sync, the money of main broadcaster's client will not be occupied
Source, will not during live streaming the incoherent content of typing.
The communication bus 404 that above-mentioned electronic equipment is mentioned can be Peripheral Component Interconnect standard (Peripheral
Component Interconnect, PCI) bus or expanding the industrial standard structure (Extended Industry Standard
Architecture, EISA) bus etc..The communication bus 404 can be divided into address bus, data/address bus, control bus etc..For
Convenient for indicating, only indicated with a thick line in figure, it is not intended that an only bus or a type of bus.
Communication interface is for the communication between above-mentioned electronic equipment and other equipment.
Memory 403 may include random access memory (Random Access Memory, RAM), also may include
Nonvolatile memory (Non-Volatile Memory, NVM), for example, at least a magnetic disk storage.Optionally, memory
403 can also be that at least one is located remotely from the storage device of aforementioned processor.
Above-mentioned processor 401 can be general processor, including central processing unit (Central Processing
Unit, CPU), network processing unit (Network Processor, NP) etc.；It can also be digital signal processor (Digital
Signal Processing, DSP), specific integrated circuit (Application Specific Integrated Circuit,
ASIC), field programmable gate array (Field-Programmable Gate Array, FPGA) or other programmable logic
Device, discrete gate or transistor logic, discrete hardware components.
The embodiment of the invention also provides a kind of computer readable storage medium, it is stored in computer readable storage medium
Computer program realizes any of the above-described method and step when computer program is executed by processor.
It should be noted that, in this document, relational terms such as first and second and the like are used merely to a reality
Body or operation are distinguished with another entity or operation, are deposited without necessarily requiring or implying between these entities or operation
In any actual relationship or order or sequence.Moreover, the terms "include", "comprise" or its any other variant are intended to
Non-exclusive inclusion, so that the process, method, article or equipment including a series of elements is not only wanted including those
Element, but also including other elements that are not explicitly listed, or further include for this process, method, article or equipment
Intrinsic element.In the absence of more restrictions, the element limited by sentence "including a ...", it is not excluded that
There is also other identical elements in process, method, article or equipment including element.
Each embodiment in this specification is all made of relevant mode and describes, same and similar portion between each embodiment
Dividing may refer to each other, and each embodiment focuses on the differences from other embodiments.Especially for method,
For device, electronic equipment and computer readable storage medium embodiment, since it is substantially similar to system embodiment, so
It is described relatively simple, the relevent part can refer to the partial explaination of embodiments of method.
The above is merely preferred embodiments of the present invention, it is not intended to limit the scope of the present invention.It is all in this hair
Any modification, equivalent replacement, improvement and so within bright spirit and principle, are included within the scope of protection of the present invention.
Claims (11)
1. a kind of live broadcast system, which is characterized in that the system comprises: Resource Server, mixed flow server, the distribution server,
Main broadcaster's client and user client；
Main broadcaster's client obtains main broadcaster and is directed to the program request matchmaker for obtaining on-demand media stream from the Resource Server
The mark of the on-demand media stream and the live media stream are sent to described mixed by the live media stream of body stream commented in real time
Streaming server；
The mixed flow server, for obtaining the program request matchmaker from the Resource Server according to the mark of the on-demand media stream
Body stream, and the on-demand media stream and the live media stream are subjected to synchronized mixes, mixed-media stream is obtained, by the mixing
Media stream is to the distribution server；
The distribution server, for the mixed-media stream to be sent to the user client.
2. system according to claim 1, which is characterized in that the on-demand media stream that will acquire and the live media
The step of stream carries out synchronized mixes, obtains mixed-media stream, comprising:
The on-demand media stream and the live media stream are decoded respectively, obtain target medium decoding data and in real time
Comment media decoding data；
According to preset configuration, to the target medium decoding data and comments media decoding data in real time and recompiles,
Obtain mixed-media stream.
3. system according to claim 2, which is characterized in that the preset configuration includes: the resolution ratio of mixed-media stream,
The relative position of code rate and the on-demand media stream and the live media stream in the display image of the mixed-media stream
And size.
4. a kind of live broadcasting method, which is characterized in that be applied to mixed flow server, which comprises
The synchronizing information that main broadcaster's client is sent is received, the synchronizing information includes the mark of on-demand media stream, and is directed to institute
State the live media stream of on-demand media stream；
According to the mark of the on-demand media stream, on-demand media stream is obtained from Resource Server；
The on-demand media stream and the live media stream are subjected to synchronized mixes, obtain mixed-media stream；
The mixed-media stream is sent to the distribution server, so that the mixed-media stream is sent to by the distribution server
User client.
5. according to the method described in claim 4, it is characterized in that, described by acquired on-demand media stream and the live streaming matchmaker
The step of body stream carries out synchronized mixes, obtains mixed-media stream, comprising:
Acquired on-demand media stream and the live media stream are decoded respectively, obtain target medium decoding data and
Media decoding data is commented in real time；
According to preset configuration, to the target medium decoding data and comments media decoding data in real time and recompiles,
Obtain mixed-media stream.
6. according to the method described in claim 5, it is characterized in that, the preset configuration, comprising: the resolution of mixed-media stream
The opposite position of rate, code rate and the on-demand media stream and the live media stream in the display image of the mixed-media stream
It sets and size.
7. a kind of live broadcast device, which is characterized in that be applied to mixed flow server, described device includes:
Receiving module sends synchronizing information for receiving main broadcaster's client, and the synchronizing information includes the mark of on-demand media stream,
And the live media stream for the on-demand media stream；
Module is obtained, for the mark according to the on-demand media stream, obtains on-demand media stream from Resource Server；
Mixing module obtains mixed-media stream for the on-demand media stream and the live media stream to be carried out synchronized mixes；
Sending module, for the mixed-media stream to be sent to the distribution server, so that the distribution server will be described mixed
Media stream is closed to user client.
8. device according to claim 7, which is characterized in that the mixing module is specifically used for:
Acquired on-demand media stream and the live media stream are decoded respectively, obtain target medium decoding data and
Media decoding data is commented in real time；
According to preset configuration, to the target medium decoding data and comments media decoding data in real time and recompiles,
Obtain mixed-media stream.
9. device according to claim 8, which is characterized in that the preset configuration, comprising: the resolution of mixed-media stream
The opposite position of rate, code rate and the on-demand media stream and the live media stream in the display image of the mixed-media stream
It sets and size.
10. a kind of electronic equipment, which is characterized in that including processor, communication interface, memory and communication bus, wherein processing
Device, communication interface, memory complete mutual communication by communication bus；
Memory, for storing computer program；
Processor when for executing the program stored on memory, realizes any method and step of claim 4-6.
11. a kind of computer readable storage medium, which is characterized in that be stored with computer in the computer readable storage medium
Program realizes claim 4-6 any method and step when the computer program is executed by processor.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910054096.2A CN109618178A (en) | 2019-01-21 | 2019-01-21 | A kind of live broadcasting method, apparatus and system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910054096.2A CN109618178A (en) | 2019-01-21 | 2019-01-21 | A kind of live broadcasting method, apparatus and system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN109618178A true CN109618178A (en) | 2019-04-12 |
Family
ID=66018839
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910054096.2A Pending CN109618178A (en) | 2019-01-21 | 2019-01-21 | A kind of live broadcasting method, apparatus and system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109618178A (en) |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111246253A (en) * | 2020-01-21 | 2020-06-05 | 北京三体云联科技有限公司 | Video streaming method and device |
| CN114071168A (en) * | 2021-11-16 | 2022-02-18 | 上海哔哩哔哩科技有限公司 | Mixed-flow direct-broadcast stream scheduling method and device |
| CN114666614A (en) * | 2019-04-23 | 2022-06-24 | 华为技术有限公司 | Media stream sending method, device and equipment |
| CN114765695A (en) * | 2021-01-15 | 2022-07-19 | 北京字节跳动网络技术有限公司 | Live broadcast data processing method, device, equipment and medium |
| CN115460431A (en) * | 2022-09-23 | 2022-12-09 | 北京爱奇艺科技有限公司 | Media stream live broadcasting method, system, computer equipment and storage medium |
Citations (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104135667A (en) * | 2014-06-10 | 2014-11-05 | 腾讯科技（深圳）有限公司 | Video remote explanation synchronization method, terminal equipment and system |
| CN105025314A (en) * | 2015-07-15 | 2015-11-04 | 腾讯科技（深圳）有限公司 | Multimedia live broadcast method and device |
| CN105120305A (en) * | 2015-08-10 | 2015-12-02 | 合一网络技术(北京)有限公司 | Method of playing picture in picture video on mobile terminal and system thereof |
| CN105721954A (en) * | 2016-01-29 | 2016-06-29 | 北京奇艺世纪科技有限公司 | System and method for playing videos in turns |
| CN105791958A (en) * | 2016-04-22 | 2016-07-20 | 北京小米移动软件有限公司 | Method and device for live broadcasting game |
| CN106162221A (en) * | 2015-03-23 | 2016-11-23 | 阿里巴巴集团控股有限公司 | The synthetic method of live video, Apparatus and system |
| CN106412663A (en) * | 2016-09-30 | 2017-02-15 | 乐视控股（北京）有限公司 | Live broadcast method, live broadcast apparatus and terminal |
| CN106559696A (en) * | 2016-12-01 | 2017-04-05 | 北京小米移动软件有限公司 | Method for sending information and device |
| CN106686424A (en) * | 2017-01-06 | 2017-05-17 | 广州四三九九信息科技有限公司 | Screen recording and live streaming method based on mobile terminal |
| CN106792244A (en) * | 2016-12-30 | 2017-05-31 | 广州华多网络科技有限公司 | Net cast method and device |
| CN108259989A (en) * | 2018-01-19 | 2018-07-06 | 广州华多网络科技有限公司 | Method, computer readable storage medium and the terminal device of net cast |
-
2019
- 2019-01-21 CN CN201910054096.2A patent/CN109618178A/en active Pending
Patent Citations (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104135667A (en) * | 2014-06-10 | 2014-11-05 | 腾讯科技（深圳）有限公司 | Video remote explanation synchronization method, terminal equipment and system |
| CN106162221A (en) * | 2015-03-23 | 2016-11-23 | 阿里巴巴集团控股有限公司 | The synthetic method of live video, Apparatus and system |
| CN105025314A (en) * | 2015-07-15 | 2015-11-04 | 腾讯科技（深圳）有限公司 | Multimedia live broadcast method and device |
| CN105120305A (en) * | 2015-08-10 | 2015-12-02 | 合一网络技术(北京)有限公司 | Method of playing picture in picture video on mobile terminal and system thereof |
| CN105721954A (en) * | 2016-01-29 | 2016-06-29 | 北京奇艺世纪科技有限公司 | System and method for playing videos in turns |
| CN105791958A (en) * | 2016-04-22 | 2016-07-20 | 北京小米移动软件有限公司 | Method and device for live broadcasting game |
| CN106412663A (en) * | 2016-09-30 | 2017-02-15 | 乐视控股（北京）有限公司 | Live broadcast method, live broadcast apparatus and terminal |
| CN106559696A (en) * | 2016-12-01 | 2017-04-05 | 北京小米移动软件有限公司 | Method for sending information and device |
| CN106792244A (en) * | 2016-12-30 | 2017-05-31 | 广州华多网络科技有限公司 | Net cast method and device |
| CN106686424A (en) * | 2017-01-06 | 2017-05-17 | 广州四三九九信息科技有限公司 | Screen recording and live streaming method based on mobile terminal |
| CN108259989A (en) * | 2018-01-19 | 2018-07-06 | 广州华多网络科技有限公司 | Method, computer readable storage medium and the terminal device of net cast |
Cited By (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114666614A (en) * | 2019-04-23 | 2022-06-24 | 华为技术有限公司 | Media stream sending method, device and equipment |
| CN111246253A (en) * | 2020-01-21 | 2020-06-05 | 北京三体云联科技有限公司 | Video streaming method and device |
| CN114765695A (en) * | 2021-01-15 | 2022-07-19 | 北京字节跳动网络技术有限公司 | Live broadcast data processing method, device, equipment and medium |
| CN114071168A (en) * | 2021-11-16 | 2022-02-18 | 上海哔哩哔哩科技有限公司 | Mixed-flow direct-broadcast stream scheduling method and device |
| CN114071168B (en) * | 2021-11-16 | 2023-09-12 | 上海哔哩哔哩科技有限公司 | Mixed-flow live stream scheduling method and device |
| CN115460431A (en) * | 2022-09-23 | 2022-12-09 | 北京爱奇艺科技有限公司 | Media stream live broadcasting method, system, computer equipment and storage medium |
| CN115460431B (en) * | 2022-09-23 | 2023-10-10 | 北京爱奇艺科技有限公司 | Media stream live broadcast method, system, computer device and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109618178A (en) | A kind of live broadcasting method, apparatus and system | |
| CN105357542B (en) | Live broadcasting method, apparatus and system | |
| EP3334175A1 (en) | Streaming media and caption instant synchronization displaying and matching processing method, device and system | |
| CN105812943B (en) | A kind of video editing method and system | |
| CN103763626B (en) | A kind of information-pushing method, equipment and system | |
| JP2006005897A (en) | Terminal device, content distribution system, information output method, information output program | |
| CN103096128B (en) | A kind of realize the method for video interactive, server, terminal and system | |
| US20150007218A1 (en) | Method and apparatus for frame accurate advertisement insertion | |
| CN101998116A (en) | Method, system and equipment for realizing multi-view video service | |
| US10575050B2 (en) | Providing a plurality of points of view of digital environments | |
| CN109803151B (en) | Multimedia data stream switching method and device, storage medium and electronic device | |
| CN104202652B (en) | The control method for playing back and set top box of a kind of television set top box | |
| CN103024491B (en) | The video broadcasting method of mobile terminal and system | |
| TW201412099A (en) | Method of playing internet video and related electronic device | |
| WO2014190655A1 (en) | Application synchronization method, application server and terminal | |
| CN105704399A (en) | Playing method and system for multi-picture television program | |
| CN113630614A (en) | Game live broadcast method, device, system, electronic equipment and readable storage medium | |
| KR20130138213A (en) | Methods for processing multimedia flows and corresponding devices | |
| CN106060573B (en) | Live broadcasting method and device based on terminal screen content | |
| CN108810567A (en) | A kind of matched method in audio & video visual angle, client and server | |
| US9479738B2 (en) | Method and apparatus for transmitting and receiving broadcasting information using reserved channels | |
| CN109218274A (en) | A kind of processing method and processing device of media information | |
| KR20150073573A (en) | Method and apparatus for displaying contents related in mirroring picture | |
| CN103813200B (en) | The method and electronic equipment of information processing | |
| CN103281585A (en) | Set top box (STB) device of Internet protocol television (IPTV) |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20190412 |