CN113225577A - Live stream processing method, device and system, electronic equipment and storage medium - Google Patents
Live stream processing method, device and system, electronic equipment and storage medium Download PDFInfo
- Publication number
- CN113225577A CN113225577A CN202110498263.XA CN202110498263A CN113225577A CN 113225577 A CN113225577 A CN 113225577A CN 202110498263 A CN202110498263 A CN 202110498263A CN 113225577 A CN113225577 A CN 113225577A
- Authority
- CN
- China
- Prior art keywords
- live
- stream
- merged
- live stream
- live broadcast
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000003672 processing method Methods 0.000 title claims abstract description 34
- 238000005034 decoration Methods 0.000 claims abstract description 101
- 238000004806 packaging method and process Methods 0.000 claims abstract description 56
- 238000012545 processing Methods 0.000 claims abstract description 47
- 238000004891 communication Methods 0.000 claims description 36
- 238000000034 method Methods 0.000 claims description 24
- 230000005540 biological transmission Effects 0.000 claims description 6
- 239000000126 substance Substances 0.000 claims description 2
- 230000000694 effects Effects 0.000 abstract description 30
- 238000010586 diagram Methods 0.000 description 23
- 238000004590 computer program Methods 0.000 description 9
- 238000005516 engineering process Methods 0.000 description 8
- 230000003993 interaction Effects 0.000 description 6
- 230000006870 function Effects 0.000 description 4
- 238000011161 development Methods 0.000 description 3
- 230000002452 interceptive effect Effects 0.000 description 3
- 230000004048 modification Effects 0.000 description 3
- 238000012986 modification Methods 0.000 description 3
- 230000003287 optical effect Effects 0.000 description 3
- 230000008569 process Effects 0.000 description 3
- 230000001360 synchronised effect Effects 0.000 description 3
- 238000004364 calculation method Methods 0.000 description 2
- 230000006872 improvement Effects 0.000 description 2
- 230000000007 visual effect Effects 0.000 description 2
- 238000003491 array Methods 0.000 description 1
- 238000013473 artificial intelligence Methods 0.000 description 1
- 230000001413 cellular effect Effects 0.000 description 1
- 238000010276 construction Methods 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 230000001747 exhibiting effect Effects 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 238000010801 machine learning Methods 0.000 description 1
- 239000013307 optical fiber Substances 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- 230000001953 sensory effect Effects 0.000 description 1
- 230000008054 signal transmission Effects 0.000 description 1
- 230000005236 sound signal Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/21—Server components or server architectures
- H04N21/218—Source of audio or video content, e.g. local disk arrays
- H04N21/2187—Live feed
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/234—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
- H04N21/23424—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving splicing one content stream with another content stream, e.g. for inserting or substituting an advertisement
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/236—Assembling of a multiplex stream, e.g. transport stream, by combining a video stream with other content or additional data, e.g. inserting a URL [Uniform Resource Locator] into a video stream, multiplexing software data into a video stream; Remultiplexing of multiplex streams; Insertion of stuffing bits into the multiplex stream, e.g. to obtain a constant bit-rate; Assembling of a packetised elementary stream
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Business, Economics & Management (AREA)
- Marketing (AREA)
- Databases & Information Systems (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
The disclosure provides a live stream processing method, a live stream processing device, a live stream processing system, electronic equipment and a storage medium, and relates to the technical field of computers, in particular to the technical field of computer vision and information flow. The specific implementation scheme is as follows: receiving a first live stream pushed by a first live end and a second live stream pushed by a second live end; merging the first live broadcast stream and the second live broadcast stream to obtain a merged live broadcast stream; and sending the merged live broadcast stream to a packaging machine, so that the packaging machine can add decoration information of a first live broadcast end to the merged live broadcast stream. The embodiment of the disclosure can optimize and combine the decoration effect of the live stream.
Description
Technical Field
The present disclosure relates to the field of computer technology, and more particularly, to the field of computer vision and information flow technology.
Background
With the development of computer technology, users can perform network interaction in various ways, new network vocabularies are generated along with the diversification of interaction ways, and network live broadcast is one of the ways.
During the live network broadcast process, independent audio and/or video signal acquisition equipment is erected on a live broadcast site and led into a broadcast directing terminal (broadcast directing equipment or platform), and then the audio and/or video signal acquisition equipment is uploaded to a server through a network and is released to a website for audiences to watch.
Live webcasting can realize remote signal transmission of a live webcasting end and a spectator webcasting end, and when people are inconvenient to go out, live webcasting becomes an important social contact mode and an entertainment mode which are more and more commonly used. With the rapid development of computer technology, live broadcasting is also developed from a single live broadcasting end to audience end display, and multiple live broadcasting ends can play and display audio-visual signals for the audience end together. In most cases, a user may select a mobile terminal to watch live broadcasting, so that more requirements are made on live broadcasting technology and live broadcasting effect, such as requirements on picture effect and the like. Further improvements in live broadcast technology are needed to meet the higher demands of users on new forms of live broadcast.
Disclosure of Invention
The disclosure provides a live stream processing method, a live stream processing device, a live stream processing system, electronic equipment and a storage medium.
According to an aspect of the present disclosure, there is provided a live stream processing method, including:
receiving a first live stream pushed by a first live end and a second live stream pushed by a second live end;
merging the first live stream and the second live stream to obtain a merged live stream;
and sending the combined live broadcast stream to a packaging machine, so that the packaging machine can add the decoration information of the first live broadcast end to the combined live broadcast stream.
According to another aspect of the present disclosure, there is provided a live stream processing method, including:
pulling a merged live stream generated by a real-time communication server side; the merged live stream is a live stream obtained by merging a first live stream of the first live end and a second live stream of the second live end;
adding decoration information of a first live broadcast end to the merged live broadcast stream;
and sending the combined live stream added with the decoration information to a live audience.
According to another aspect of the present disclosure, there is provided a live stream processing apparatus including:
the live broadcast stream receiving module is used for receiving a first live broadcast stream pushed by a first live broadcast end and a second live broadcast stream pushed by a second live broadcast end;
the merging module is used for merging the first live stream and the second live stream to obtain a merged live stream;
and the sending module is used for sending the combined live stream to a packaging machine, so that the packaging machine can add the decoration information of the first live end to the combined live stream.
According to another aspect of the present disclosure, there is provided a live stream processing apparatus including:
the merging and pulling module is used for pulling the merged live stream generated by the real-time communication server side; the merged live stream is a live stream obtained by merging a first live stream of the first live end and a second live stream of the second live end;
the adding module is used for adding decoration information of the first live broadcast end to the merged live broadcast stream;
and the adding and sending module is used for sending the combined live stream added with the decoration information to a live audience.
According to another aspect of the present disclosure, there is provided a live stream processing system including:
the first live stream processing device is applied to a live stream processing device of a real-time communication server side provided by any one embodiment of the disclosure;
the second live stream processing device is the live stream processing device applied to the packaging machine end provided by any one embodiment of the disclosure;
the third live broadcast stream processing device is used for receiving a combined live broadcast stream sent by the real-time communication server, wherein the combined live broadcast stream is obtained by combining a first live broadcast stream of the first live broadcast end and a second live broadcast stream of the second live broadcast end by the real-time communication server; and the direct broadcasting server is used for providing the combined live broadcasting stream to the packaging machine under the condition that the packaging machine draws the combined live broadcasting stream, so that the packaging machine can add decoration information of the first direct broadcasting end to the combined live broadcasting stream;
the fourth live stream processing device is used for receiving the combined live stream which is pushed by the packaging machine and added with the decoration information; and forwarding the combined live stream added with the decoration information to a distribution network server.
According to another aspect of the present disclosure, there is provided an electronic device including:
at least one processor; and
a memory communicatively coupled to the at least one processor; wherein the content of the first and second substances,
the memory stores instructions executable by the at least one processor to enable the at least one processor to perform a method according to any one of the embodiments of the present disclosure.
According to another aspect of the present disclosure, there is provided a non-transitory computer readable storage medium having stored thereon computer instructions for causing a computer to perform a method in any of the embodiments of the present disclosure.
According to another aspect of the present disclosure, a computer program product is provided, comprising a computer program which, when executed by a processor, implements the method in any of the embodiments of the present disclosure.
According to the technology disclosed by the invention, the decoration information can be added to the combined live stream of the first live broadcast end and the second live broadcast end, so that the whole picture of the combined live broadcast stream can present the decoration information, the decoration effect can be more clearly watched under the condition that a user uses a terminal with a smaller display screen such as a mobile terminal to live broadcast and watch, and the quality of the live broadcast picture is improved.
It should be understood that the statements in this section do not necessarily identify key or critical features of the embodiments of the present disclosure, nor do they limit the scope of the present disclosure. Other features of the present disclosure will become apparent from the following description.
Drawings
The drawings are included to provide a better understanding of the present solution and are not to be construed as limiting the present disclosure. Wherein:
fig. 1 is a schematic diagram of a live stream processing method according to an embodiment of the present disclosure;
fig. 2A is a pictorial diagram of a merged live stream prior to adding decoration information, according to an example of the present disclosure;
fig. 2B is a pictorial diagram of a merged live stream with added decoration information according to an example of the present disclosure;
fig. 3 is a schematic diagram of a live stream processing method according to another embodiment of the present disclosure;
fig. 4A is a schematic view of a screen viewed by a viewer of a first live end according to an example of the present disclosure;
fig. 4B is a schematic view of a second live end viewer viewing a screen according to an example of the present disclosure;
fig. 5 is a schematic diagram of a live stream processing method according to yet another embodiment of the present disclosure;
fig. 6 is a schematic diagram of a live stream processing method according to yet another embodiment of the present disclosure;
fig. 7 is a schematic diagram of a live stream processing method according to an example of the present disclosure;
fig. 8A, B is a schematic diagram of a live stream processing method according to another example of the present disclosure;
fig. 9 is a schematic diagram of a live stream processing method according to yet another example of the present disclosure;
fig. 10 is a schematic diagram of a live stream processing method according to yet another example of the present disclosure;
fig. 11 is a schematic diagram of a live stream processing apparatus according to an embodiment of the present disclosure;
fig. 12 is a schematic diagram of a live stream processing apparatus according to another embodiment of the present disclosure;
fig. 13 is a schematic diagram of a live stream processing apparatus according to yet another embodiment of the present disclosure;
fig. 14 is a schematic diagram of a live stream processing apparatus according to yet another embodiment of the present disclosure;
fig. 15 is a schematic diagram of a live stream processing apparatus according to yet another embodiment of the present disclosure;
fig. 16 is a schematic diagram of a live stream processing apparatus according to yet another embodiment of the present disclosure;
fig. 17 is a schematic diagram of a live stream processing apparatus according to yet another embodiment of the present disclosure;
fig. 18 is a schematic diagram of a live stream processing apparatus according to yet another embodiment of the present disclosure;
fig. 19 is a schematic diagram of a live stream processing apparatus according to yet another embodiment of the present disclosure;
fig. 20 is a schematic diagram of a live stream processing system according to an embodiment of the present disclosure;
fig. 21 is a block diagram of an electronic device used to implement a live stream processing method of an embodiment of the present disclosure.
Detailed Description
Exemplary embodiments of the present disclosure are described below with reference to the accompanying drawings, in which various details of the embodiments of the disclosure are included to assist understanding, and which are to be considered as merely exemplary. Accordingly, those of ordinary skill in the art will recognize that various changes and modifications of the embodiments described herein can be made without departing from the scope and spirit of the present disclosure. Also, descriptions of well-known functions and constructions are omitted in the following description for clarity and conciseness.
The embodiment of the present disclosure first provides a live stream processing method, as shown in fig. 1, in an implementation manner, the live stream processing method includes:
step S11: receiving a first live stream pushed by a first live end and a second live stream pushed by a second live end;
step S12: merging the first live stream and the second live stream to obtain a merged live stream;
step S13: and sending the combined live broadcast stream to a packaging machine, so that the packaging machine can add the decoration information of the first live broadcast end to the combined live broadcast stream.
In a possible implementation manner, the first live broadcast end and the second live broadcast end may be the same live broadcast end.
In a possible implementation manner, the first live broadcast end and the second live broadcast end may be different live broadcast ends. The first live broadcast end can be a host live broadcast end of a multi-user live broadcast room.
Under the condition that the first live broadcast end and the second live broadcast end are different live broadcast ends, the first live broadcast end can comprise at least one different live broadcast end, and the second live broadcast end can also comprise at least one different live broadcast end.
The first live end may be a live stream signal acquiring end, such as a terminal of a live party, and may be configured to acquire at least one of an audio signal and a video signal of the live party. The second live end may be another live end different from the first live end and may be configured to obtain at least one of an audio and a video signal of another live party.
The first live stream pushed by the first live end may be a live stream pushed by the first live end according to a push address used for merging. Similarly, the second live stream pushed by the second live broadcast end may be a live stream pushed by the second live broadcast end according to the push address for merging.
Under the condition that the first live broadcast end and the second live broadcast end are the same live broadcast end, the combined live broadcast stream can be the first live broadcast stream.
In a case where the first live broadcast terminal and the second live broadcast terminal are different live broadcast terminals, the merged live broadcast stream may include a merged live broadcast stream for viewers of the first live broadcast terminal and a merged live broadcast stream for viewers of the second live broadcast terminal. Therefore, in the picture of the combined live stream watched by the audience at the first live broadcast end, the live broadcast picture at the first live broadcast end can be used as a master picture; in the picture of the combined live stream viewed by the viewer at the second live broadcast end, the live broadcast picture at the second live broadcast end can be used as a main picture.
In a possible implementation manner, the first live stream and the second live stream are merged to obtain a merged live stream, where, under the condition that both the first live stream and the second live stream include audio and video, the video in the first live stream and the video in the second live stream may be merged to obtain a merged video stream, the audio in the first live stream and the audio in the second live stream are merged to obtain a merged audio stream, and finally the merged video stream and the merged audio stream are merged to obtain a merged live stream.
The packaging machine may be a module or a machine for performing packaging operations. The packaging machine is mainly used for performing packaging operation, namely adding the decoration information of the first live end into the combined live stream.
In a possible implementation manner, the decoration information of the first live end may be virtual decoration information for interspersing live pictures of the first live end, such as special effects (e.g., a tv show effect, a news simulcast effect, a festival effect, etc.) appearing on the pictures of the first live end, virtual decorations appearing at fixed positions in the pictures of the first live end, and the like.
In another possible implementation manner, the decoration information of the first direct broadcasting end can also be audio decoration information.
In this embodiment, after the decoration information of the first live broadcast end is added to the merged live broadcast stream, one end viewing the merged live broadcast stream can view the visual and/or auditory decoration effect of the decoration information.
In a possible implementation manner, the merged live stream watched by the audience at the first live end and the merged live stream watched by the audience at the second live end have a certain difference, and the decoration information of the first live end can be added only for the merged live stream watched by the audience at the first live end, so that the audience at the first live end can perform more sufficient and better experience interaction with the anchor of the first live end.
In a possible implementation manner, when the live stream processing method provided by the embodiment of the present disclosure is applied to a multi-user interactive live room, the first live broadcast end may be a main live broadcast end. Before receiving a second live stream pushed by a second live end, the method may include: and the first live broadcast end receives the joining request of the second live broadcast end and sends a joining request passing message to the second live broadcast end, so that the second live broadcast end joins the multi-user interactive live broadcast room.
In a possible implementation manner, the merged live stream may further include live streams of more live ends.
In one implementation, steps S11-S13 may be performed at a real time Communication server (RTC). The real-time communication server side can be one of the RTCs.
In general, for a live broadcast room of a real-time multi-person interactive video live broadcast, a server can be used for merging live broadcast streams of multiple live broadcast ends, a spectator end only needs to pull one merged live broadcast stream, the spectator end plays one synthesized video stream, only a single window stream picture before confluence can be seen, the decoration effect is achieved, and the decoration effect of the whole room of the current live broadcast room cannot be obtained.
The embodiment of the disclosure can add decoration information to the combined live stream of the first live broadcast end and the second live broadcast end, so that the whole picture of the combined live broadcast stream can present decoration information, and under the condition that a user uses a terminal with a smaller display screen such as a mobile terminal to live broadcast and watch, a decoration effect can be watched more clearly, and the quality of the live broadcast picture is improved.
As shown in fig. 2A, the picture before decoration and the picture after decoration shown in fig. 2B are added with decoration information in the merged live stream, and the decoration effect 22 of the picture 21 in the first live broadcast room can be viewed over the entire picture of the merged live stream, thereby sufficiently exhibiting the decoration effect.
The decoration information, after being added to the entire merged picture of the merged live stream, may be scaled up in a certain ratio than when only displayed in the area of a single live room of the merged picture.
With the development of live broadcast technology, new live broadcast decoration effects are continuously developed. For new decorative effects, the audience needs to develop new containers to bear the decorative effects. In the live broadcast process, the whole decoration effect and the state of the current live broadcast room are required to be obtained through a server interface, and the audience end obtains the decoration effect of the live broadcast room and the decoration effect presenting state cannot be guaranteed to be completely synchronous with the live broadcast audio and video stream. Moreover, the decorative effect that can be achieved is limited, cannot be expanded, and is difficult to support new decorative effects, thereby causing more play to be impossible.
The live stream processing method provided by the embodiment of the disclosure adds the decoration effect uniformly, so that the combined live stream with the decoration effect added can be converted into a picture which can be played by a viewer, and a new decoration effect is easy to expand. And under the condition that the decoration effect is kept synchronous with the merged live stream when being added to the merged live stream, the live stream and the decoration effect in the picture received by the audience can also be kept synchronous.
In an embodiment, as shown in fig. 3, merging the first live stream and the second live stream to obtain a merged live stream, further may include:
step S31: determining a merged picture according to the picture of the first live stream and the picture of the second live stream;
step S32: generating a Real Time Messaging Protocol (RTMP) data packet according to the merged picture, the first live stream and the second live stream;
step S33: and taking the real-time message transmission protocol data packet as a merged live stream.
In an implementation manner, determining a merged picture according to a picture of a first live stream and a picture of a second live stream may specifically include: calculating respective positions of the two pictures in the combined picture according to the picture of the first live stream and the picture of the second live stream; and determining a merged picture according to the picture of the first live stream, the picture of the second live stream and the corresponding positions of the two pictures.
In a possible implementation manner, determining a merged picture according to a picture of the first live stream and a picture of the second live stream may specifically include: calculating respective positions of the two pictures in the combined picture according to the picture of the first live stream, the picture of the second live stream and a preset template; and determining a merged picture according to the picture of the first live stream, the picture of the second live stream and the corresponding positions of the two pictures.
In a possible implementation manner, determining a merged picture according to a picture of the first live stream and a picture of the second live stream may specifically include: and determining the merged picture seen by the audience of the first live end and the merged picture seen by the audience of the second live end.
For example, as shown in fig. 4A and 4B, the picture of the first live broadcast end is a picture a, the picture of the second live broadcast end is a picture B, and if the first picture on the upper left side of the display screen is a master picture, the picture seen by the viewer end of the first live broadcast end may be the picture shown in fig. 4A, that is, the picture a of the first live broadcast end is located in the master merged picture; the view seen by the viewer of the second live broadcast end may be the view shown in fig. 4B, i.e. the combined view with the view B of the second live broadcast end located at the main position.
In one implementation, the first live stream may include a video stream and/or an audio stream of the first live broadcast, and a pull stream address of the first live stream; a push stream address for the first live stream may also be included. The pull address of the first live stream can be used for providing the viewer side, and the viewer side can obtain the video stream and/or the audio stream in the first live stream according to the pull address of the first live stream. Similarly, the second live stream may also include a pull address of the second live stream, and may also include a push address of the second live stream.
In this embodiment, the merged frame includes a display window of each live broadcast room and a blank area or a background area outside the display window.
In a possible implementation manner, the real-time messaging protocol data packet may include a pull address of the first live stream and a pull address of the second live stream.
In this embodiment, a merged picture can be obtained according to the first live stream and the second live stream, so that a viewer can view a picture of the first live end and a picture of the second live end.
In an embodiment, as shown in fig. 5, the live stream processing method may further include:
step S51: under the condition that a second live broadcast end carries out stream pulling through a stream pulling address of a direct connection channel, a first live broadcast stream is provided for the second live broadcast end;
step S52: and under the condition that the first live end pulls the stream through the stream pulling address of the direct connection channel, providing a second live stream for the first live end.
In this embodiment, when the first live broadcast end and the second live broadcast end transmit the first live broadcast stream and the second live broadcast stream used for generating the merged live broadcast stream, the first live broadcast stream and the second live broadcast stream can be transmitted through a real-time communication direct connection channel specially set. Meanwhile, the first live broadcast end can pull the live broadcast stream of the second live broadcast end through the stream pulling address of the direct connection channel, so that the picture of the second live broadcast end can be watched. Conversely, the second live broadcast end can watch the picture of the first live broadcast end in the same way.
In this embodiment, the steps S51 and S52 may be executed in any order, or may not be executed in sequence.
Under the condition that other live broadcast ends exist, each live broadcast end can watch the pictures of other live broadcast ends except the live broadcast end through a direct connection channel of real-time communication. For example, when a third live broadcast end exists, the live broadcast stream of the second live broadcast end and the live broadcast stream of the third live broadcast end can be pulled under the condition that the first live broadcast end pulls the live broadcast stream through a direct connection channel of real-time communication. After the live broadcast is played, the picture of the second live broadcast end and the picture of the third live broadcast end can be displayed on the screen according to the divided areas; or the merged live broadcast stream of the second live broadcast end and the third live broadcast end can be pulled, and the merged picture of the second live broadcast stream and the picture of the third live broadcast stream is displayed on the first live broadcast end.
Similarly, the second live broadcast end can also pull the live broadcast streams of the third live broadcast end and the first live broadcast end. The third live broadcast end can pull the live broadcast streams of the first live broadcast end and the second live broadcast end.
In this embodiment, the first live broadcast terminal and the second live broadcast terminal can directly acquire the pictures of other live broadcast terminals except the first live broadcast terminal and the second live broadcast terminal through the direct connection channel of real-time communication, so that the pictures of the branch parts between the anchor broadcasts can be shared and watched in real time quickly.
In one embodiment, sending the merged live stream to a packaging machine includes:
the merged live stream is sent to a Delivery Network server (CDN), so that the Delivery Network server provides the merged live stream to the packaging machine.
In a possible implementation manner, sending the merged live stream to the distribution network server may include sending the merged live stream to the distribution network server according to a push address of the merged live stream, so that the packaging machine can obtain the merged live stream from the distribution network server when pulling the merged live stream according to a pull address of the merged live stream.
In another implementation, the distribution network server may be further configured to distribute the combined live stream with the decoration information added thereto to each of the viewers.
In this embodiment, the merged live stream can be forwarded to the packaging machine through the distribution network server, so that the packaging machine can perform packaging operation of adding decoration information to the merged live stream.
An embodiment of the present disclosure further provides a live stream processing method, as shown in fig. 6, including:
step S61: pulling a merged live stream generated by a real-time communication server side; the merged live stream is a live stream obtained by merging a first live stream of the first live end and a second live stream of the second live end;
step S62: adding decoration information of a first live broadcast end to the merged live broadcast stream;
step S63: and sending the combined live stream added with the decoration information to a live audience.
In a possible implementation, the decoration information may be obtained from the first direct broadcasting end, or the decoration information is separately sent to the packaging machine by the first direct broadcasting end, and the adding operation of the decoration information is executed on the packaging machine.
In another possible implementation, the decoration information may also be obtained from other terminals, or sent to the packaging machine separately by other non-live terminals, where the adding operation of the decoration information is performed.
In a possible implementation manner, the merged live stream added with the decoration information is sent to a live viewer end, which may be sending the merged live stream corresponding to the viewer of the first live viewer end to the viewer end of the first live viewer end; and sending the combined live broadcast stream corresponding to the audience of the second live broadcast end to the audience end of the second live broadcast end.
In this embodiment, the steps S61-S63 may be performed at the end of a packaging machine, which may be a functional module or a physical machine.
In case the packaging machine is a functional module, it may be arranged on a physical machine.
Packaging information can be added to the merged live stream in the embodiment, so that the audience can watch the decoration on the whole merged live picture, and the watching comfort is improved.
In one embodiment, the pulling of the merged live stream generated by the real-time communication server side includes:
and pulling the merged live stream sent by the real-time communication server from the distribution network server.
In one embodiment, the method for sending the merged live stream with the decoration information added thereto to the live audience comprises the following steps:
the combined live stream added with the decoration information is forwarded to a distribution network server through a multimedia server, so that the distribution network server can provide the combined live stream added with the decoration information to a live audience.
In one implementation, the distribution network server can provide the merged live stream with the decoration information added thereto to the live audience under the condition that the live audience pulls the merged live stream.
The embodiment of the present disclosure further provides a live stream processing method, which may be applied to a distribution network server, and as shown in fig. 7, the live stream processing method includes:
step S71: receiving a combined live stream sent by a real-time communication server side, wherein the combined live stream is a combined live stream obtained by combining a first live stream of a first live end and a second live stream of a second live end by the real-time communication server side;
step S72: and under the condition that the packaging machine draws the combined live stream, providing the combined live stream to the packaging machine, so that the packaging machine can add the decoration information of the first live end to the combined live stream.
In this embodiment, the packaging machine can send the merged live stream from the real-time communication server to the packaging machine, so that the packaging machine can obtain the merged live stream, and add the decoration information to the merged live stream, so that the decoration effect can be distributed on the whole merged picture of the merged live stream received by the audience, and the watching experience of the user is improved.
In one embodiment, steps S71 and S72 may be performed at the distribution network server side.
In one embodiment, the live stream processing method further includes:
receiving a combined live stream which is sent by a packaging machine and added with decoration information;
and under the condition that the audience pulls the merged live stream added with the decoration information, providing the merged live stream added with the decoration information to the audience.
The steps described above may be performed at the distribution network server side.
In this embodiment, the merged live stream to which the decoration information is added can be sent from the packaging machine to the viewer side, so that the viewer side can obtain the merged live stream.
In an example of the present disclosure, the first live end is a host end, that is, the first live end can accept requests of other live ends, so that the other live ends can join the live end in the live room of multiple people. In this example, the live stream processing method includes the method shown in fig. 8A, specifically as follows.
Step S81: and entering a live broadcast room. And the anchor (comprising a live host, an anchor A and an anchor B) enters a video live broadcasting room, requests a server and acquires a special streaming address and an original streaming address.
Step S82: and pushing the live stream. The host side pushes the live stream to the RTC server through the special streaming address, and other anchor A, anchor B and the like except the host use the original streaming address to push the stream to the RTC streaming server.
Step S83: and forwarding the live stream. The RTC streaming media server receives audio and video streams of a host, an anchor A and an anchor B respectively, and is responsible for pushing live streaming streams of other live broadcasting ends except a target live broadcasting end to the target live broadcasting end. And in addition, the audio and video streams of each live broadcast end are forwarded to the RTC confluence service of the RTC streaming media server.
The anchor, the anchor A and the anchor B are respectively contacted with an RTC streaming media server, the RTC collects the stream pushing addresses of the anchor A and the anchor B and the stream pushing address of the anchor, and the anchor A, the anchor B and the anchor respectively establish a real-time broadcast channel with the RTC, so that the pipeline data receiving is realized when the live stream receiving is carried out among the anchor A, the anchor B and the anchor. The RTC streaming media server can send the live streams of other live broadcast ends except the target live broadcast end to the target live broadcast end through the addresses of all live broadcast ends connected by the pipelines.
Step S84: and merging the live streams. After receiving live streams of a host, a anchor A and an anchor B, the RTC confluence service firstly calculates video stream pictures of the host, the anchor A and the anchor B according to a merging template to obtain a placement window position, synthesizes the host, the anchor A and the anchor B into an audio and video stream according to a calculation result, and finally packages the video and the audio into an RTMP protocol data packet and pushes the RTMP protocol data packet to a CDN server. Different merging templates can be used for different numbers and different types of multi-user live broadcast terminals.
Step S85: and adding decorative information. The method comprises the steps that audio and video streams of a host are pulled from a CDN (content delivery network) at a packaging machine end through a special pull stream address for merging live streams, then decoration information such as bullet screens, backgrounds and activity atmosphere addition and audio changing is carried out to present decoration effects in the merged live streams, the packaging machine pushes the merged live streams subjected to the decoration information to a multimedia server through an original push stream address, and finally the multimedia server forwards the merged live streams to the CDN server.
Step S86: and (4) viewing. Audience of a host, a anchor A and an anchor B enter respective anchor live broadcasting rooms, and then the combined live broadcasting stream added with the decoration information is pulled from the CDN through original stream pulling addresses of the host, the anchor A and the anchor B to watch the live broadcasting room live broadcasting interaction among multiple persons.
As shown in fig. 8B, in one example of the present disclosure, the live stream processing method includes the following steps performed at the live end or the RTC end.
Step S87: and acquiring two paths of live streams pushed by the stream pushing addresses. Including the push stream address of the moderator end and the push stream address of the anchor end.
Step S88: and respectively judging whether the two received live streams are live streams of the host side.
Step S89: if so, a dedicated push stream address (corresponding to the push stream address of the first live end in the foregoing embodiment) is added to the live stream to form a first direct stream.
Step S810: if not, adding the original push stream address (equivalent to the push stream address of the second live end in the foregoing embodiment) to the live stream to form a second live stream.
Step S811: and merging the first live stream and the second live stream into a merged live stream of an RMTP protocol.
Step S812: the merged live stream is forwarded to the CDN.
As shown in fig. 9, in an example of the present disclosure, the live stream processing method includes the following steps performed at the wrapper end.
Step S91: the merged live stream is pulled from the CDN by pulling the stream pull address of the merged live stream.
Step S92: the decoration information is added to the merged live stream.
Step S93: and sending the combined live stream added with the decoration information to a multimedia server, so that the multimedia server sends the combined live stream added with the decoration information to the CDN after processing.
In one example of the present disclosure, as shown in fig. 10, the live stream processing method includes the following steps performed at the viewer side.
Step S101: and acquiring a live broadcast pull stream address.
Step S102: and judging whether the live broadcast end corresponding to the live broadcast stream pulling address is a host live broadcast end or not.
Step S103: in the case of the host live end, the merged live stream with the added decoration information is presented to the audience end.
Step S104: and in the case of not the live end of the host, showing the combined live stream without the decoration information to the audience end.
An embodiment of the present disclosure provides a live stream processing apparatus, as shown in fig. 11, including:
a live stream receiving module 111, configured to receive a first live stream pushed by a first live end and a second live stream pushed by a second live end;
a merging module 112, configured to merge the first live stream and the second live stream to obtain a merged live stream;
the sending module 113 is configured to send the merged live stream to a packaging machine, so that the packaging machine can add decoration information of the first live end to the merged live stream.
In one embodiment, as shown in fig. 12, the merging module includes:
a picture unit 121, configured to determine a merged picture according to a picture of the first live stream and a picture of the second live stream;
a data packet unit 122, configured to generate a real-time messaging protocol data packet according to the merged picture, the first live stream, and the second live stream;
and a data packet processing unit 123, configured to take the real-time messaging protocol data packet as a merged live stream.
In one embodiment, as shown in fig. 13, the live stream processing apparatus further includes:
a first providing module 131, configured to provide a first live broadcast stream to a second live broadcast end when the second live broadcast end performs a stream pull through a stream pull address of a direct connection channel;
the second providing module 132 is configured to provide the second live stream to the first live end when the first live end performs a pull stream through a pull stream address of the direct connection channel.
In one embodiment, as shown in fig. 14, the transmitting module includes:
a distribution unit 141 for sending the merged live stream to a distribution network server, so that the distribution network server provides the merged live stream to the packaging machine.
An embodiment of the present disclosure further provides a live stream processing apparatus, as shown in fig. 15, including:
a merging pull module 151, configured to pull a merged live stream generated by the real-time communication server; the merged live stream is a live stream obtained by merging a first live stream of the first live end and a second live stream of the second live end;
an adding module 152, configured to add decoration information of the first live end to the merged live stream;
and an adding and sending module 153, configured to send the merged live stream with the decoration information added thereto to a live viewer.
In one embodiment, as shown in fig. 16, the merge pull module includes:
the distribution pulling unit 161 is configured to pull the merged live stream sent by the real-time communication server from the distribution network server.
In one embodiment, as shown in fig. 17, adding a sending module includes:
the distribution sending unit 171 is configured to forward the merged live stream to which the decoration information is added to the distribution network server through the multimedia server, so that the distribution network server can provide the merged live stream to which the decoration information is added to the live viewer.
An embodiment of the present disclosure further provides a live stream processing apparatus, which can be applied to a distribution network server, as shown in fig. 18, including:
the merging receiving module 181 is configured to receive a merged live stream sent by a real-time communication server, where the merged live stream is a merged live stream obtained by a real-time communication server merging a first live stream of a first live end and a second live stream of a second live end;
a merge providing module 182, configured to provide the merged live stream to the packaging machine in a case where the packaging machine pulls the merged live stream, so that the packaging machine can add the decoration information of the first live end to the merged live stream.
In an embodiment, as shown in fig. 19, the apparatus may be applied to a distribution network server, and further includes:
the decoration merging receiving module 191 is used for receiving the merged live stream which is sent by the packaging machine and added with the decoration information;
and the decoration merging transmission module 192 is configured to provide the combined live stream to which the decoration information is added to the viewer side in a case where the viewer side pulls the combined live stream to which the decoration information is added.
The embodiment of the disclosure also provides a live stream processing system. As shown in fig. 20, the application architecture may include: a moderator live end 2001, a anchor live end 2002, an RTC end 2003, a packager 2004, a multimedia server 2005, a CDN end 2006, a moderator audience end 2007, and an anchor audience end 2008. The host live broadcast end 2001 and the anchor live broadcast end 2002 respectively generate two paths of live broadcast streams (respectively including a push-pull stream address corresponding to the host live broadcast end and a push-pull stream address corresponding to the anchor live broadcast end), the two paths of live broadcast streams are combined through the RTC end and the combined live broadcast stream is sent to the CDN end 2006, meanwhile, the RTC end sends the live broadcast stream of the host live broadcast end 2001 to the anchor live broadcast end 2002, and sends the live broadcast stream of the anchor live broadcast end 2002 to the host live broadcast end 2001.
The merged live stream is pulled by packager 2004 at CDN end 2006 and decorated with information added. And then sent to the multimedia server 2005 for media information stream processing, and a play stream that can be pulled by and played at the viewer side is generated. The host viewer 2007 and the anchor viewer 2008 pull the play stream according to the pull stream addresses of the host live end 2001 and the anchor live end 2003 respectively for live viewing.
The information of the moderator live broadcast end 2001, the anchor live broadcast end 2002 and the RTC end 2003 can be transmitted through a low-latency network.
The embodiment of the disclosure can be applied to the technical field of computers, and particularly can be applied to the technical field of computer vision and information flow.
The functions of each unit, module or sub-module in each apparatus in the embodiments of the present disclosure may refer to the corresponding description in the above method embodiments, and are not described herein again.
The present disclosure also provides an electronic device, a readable storage medium, and a computer program product according to embodiments of the present disclosure.
Fig. 21 shows a schematic block diagram of an example electronic device 2100 that can be used to implement embodiments of the present disclosure. Electronic devices are intended to represent various forms of digital computers, such as laptops, desktops, workstations, personal digital assistants, servers, blade servers, mainframes, and other appropriate computers. The electronic device may also represent various forms of mobile devices, such as personal digital processing, cellular phones, smart phones, wearable devices, and other similar computing devices. The components shown herein, their connections and relationships, and their functions, are meant to be examples only, and are not meant to limit implementations of the disclosure described and/or claimed herein.
As shown in fig. 21, the electronic device 2100 includes a computing unit 2101, which may perform various appropriate actions and processes according to a computer program stored in a Read Only Memory (ROM)2102 or a computer program loaded from a storage unit 2108 into a Random Access Memory (RAM) 2103. In the RAM 2103, various programs and data necessary for the operation of the electronic device 2100 can also be stored. The computing unit 2101, ROM 2102 and RAM 2103 are connected to each other via a bus 2104. An input/output (I/O) interface 2105 is also connected to bus 2104.
A number of components in the electronic device 2100 are connected to the I/O interface 2105, including: an input unit 2106 such as a keyboard, a mouse, or the like; an output unit 2107 such as various types of displays, speakers, and the like; a storage unit 2108 such as a magnetic disk, an optical disk, or the like; and a communication unit 2109 such as a network card, modem, wireless communication transceiver, etc. The communication unit 2109 allows the electronic device 2100 to exchange information/data with other devices via a computer network, such as the internet, and/or various telecommunication networks.
The computing unit 2101 may be a variety of general-purpose and/or special-purpose processing components with processing and computing capabilities. Some examples of the computational units 2101 include, but are not limited to, Central Processing Units (CPUs), Graphics Processing Units (GPUs), various specialized Artificial Intelligence (AI) computational chips, various computational units running machine learning model algorithms, Digital Signal Processors (DSPs), and any suitable processors, controllers, microcontrollers, and the like. The calculation unit 2101 executes the respective methods and processes described above, such as the live stream processing method. For example, in some embodiments, the live stream processing method may be implemented as a computer software program tangibly embodied in a machine-readable medium, such as the storage unit 2108. In some embodiments, part or all of the computer program may be loaded and/or installed onto the electronic device 2100 via the ROM 2102 and/or the communication unit 2109. When the computer program is loaded into the RAM 2103 and executed by the computing unit 2101, one or more steps of the live stream processing method described above may be performed. Alternatively, in other embodiments, the computing unit 2101 may be configured by any other suitable means (e.g., by way of firmware) to perform the live stream processing method.
Various implementations of the systems and techniques described here above may be implemented in digital electronic circuitry, integrated circuitry, Field Programmable Gate Arrays (FPGAs), Application Specific Integrated Circuits (ASICs), Application Specific Standard Products (ASSPs), system on a chip (SOCs), load programmable logic devices (CPLDs), computer hardware, firmware, software, and/or combinations thereof. These various embodiments may include: implemented in one or more computer programs that are executable and/or interpretable on a programmable system including at least one programmable processor, which may be special or general purpose, receiving data and instructions from, and transmitting data and instructions to, a storage system, at least one input device, and at least one output device.
Program code for implementing the methods of the present disclosure may be written in any combination of one or more programming languages. These program codes may be provided to a processor or controller of a general purpose computer, special purpose computer, or other programmable data processing apparatus, such that the program codes, when executed by the processor or controller, cause the functions/operations specified in the flowchart and/or block diagram to be performed. The program code may execute entirely on the machine, partly on the machine, as a stand-alone software package partly on the machine and partly on a remote machine or entirely on the remote machine or server.
In the context of this disclosure, a machine-readable medium may be a tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. The machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any suitable combination of the foregoing. More specific examples of a machine-readable storage medium would include an electrical connection based on one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.
To provide for interaction with a user, the systems and techniques described here can be implemented on a computer having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to a user; and a keyboard and a pointing device (e.g., a mouse or a trackball) by which a user can provide input to the computer. Other kinds of devices may also be used to provide for interaction with a user; for example, feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user may be received in any form, including acoustic input, speech input, or tactile input.
The systems and techniques described here can be implemented in a computing system that includes a back-end component (e.g., as a data server), or that includes a middleware component (e.g., an application server), or that includes a front-end component (e.g., a user computer having a graphical user interface or a web browser through which a user can interact with an implementation of the systems and techniques described here), or any combination of such back-end, middleware, or front-end components. The components of the system can be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include: local Area Networks (LANs), Wide Area Networks (WANs), and the Internet.
The computer system may include clients and servers. A client and server are generally remote from each other and typically interact through a communication network. The relationship of client and server arises by virtue of computer programs running on the respective computers and having a client-server relationship to each other.
It should be understood that various forms of the flows shown above may be used, with steps reordered, added, or deleted. For example, the steps described in the present disclosure may be executed in parallel or sequentially or in different orders, and are not limited herein as long as the desired results of the technical solutions disclosed in the present disclosure can be achieved.
The above detailed description should not be construed as limiting the scope of the disclosure. It should be understood by those skilled in the art that various modifications, combinations, sub-combinations and substitutions may be made in accordance with design requirements and other factors. Any modification, equivalent replacement, and improvement made within the spirit and principle of the present disclosure should be included in the scope of protection of the present disclosure.
Claims (17)
1. A live stream processing method includes:
receiving a first live stream pushed by a first live end and a second live stream pushed by a second live end;
merging the first live broadcast stream and the second live broadcast stream to obtain a merged live broadcast stream;
and sending the merged live broadcast stream to a packaging machine, so that the packaging machine can add decoration information of a first live broadcast end to the merged live broadcast stream.
2. The method of claim 1, wherein the merging the first live stream and the second live stream to obtain a merged live stream comprises:
determining a merged picture according to the picture of the first live stream and the picture of the second live stream;
generating a real-time message transmission protocol data packet according to the combined picture, the first live stream and the second live stream;
and taking the real-time message transmission protocol data packet as the merged live stream.
3. The method of claim 1, further comprising:
under the condition that the second live broadcast end carries out stream pulling through a stream pulling address of a direct connection channel, the first live broadcast stream is provided for the second live broadcast end;
and under the condition that the first live end carries out stream pulling through a stream pulling address of a direct connection channel, providing the second live stream for the first live end.
4. The method of claim 1, wherein the sending the merged live stream to a packager comprises:
sending the merged live stream to a distribution network server such that the distribution network server provides the merged live stream to the packaging machine.
5. A live stream processing method includes:
pulling a merged live stream generated by a real-time communication server side; the merged live stream is a live stream obtained by merging a first live stream of a first live end and a second live stream of a second live end;
adding decoration information of the first live broadcast end to the merged live broadcast stream;
and sending the combined live stream added with the decoration information to a live audience.
6. The method of claim 5, wherein the pulling the merged live stream generated by the real-time communication server comprises:
and pulling the merged live stream sent by the real-time communication server from a distribution network server.
7. The method of claim 5, wherein the sending the combined live stream with the decoration information added thereto to a live audience comprises:
and forwarding the combined live stream added with the decoration information to a distribution network server through a multimedia server, so that the distribution network server can provide the combined live stream added with the decoration information to the live audience.
8. A live stream processing apparatus comprising:
the live broadcast stream receiving module is used for receiving a first live broadcast stream pushed by a first live broadcast end and a second live broadcast stream pushed by a second live broadcast end;
a merging module, configured to merge the first live stream and the second live stream to obtain a merged live stream;
and the sending module is used for sending the combined live broadcast stream to a packaging machine, so that the packaging machine can add the decoration information of the first live broadcast end to the combined live broadcast stream.
9. The apparatus of claim 8, wherein the means for merging comprises:
the picture unit is used for determining a combined picture according to the picture of the first live stream and the picture of the second live stream;
the data packet unit is used for generating a real-time message transmission protocol data packet according to the combined picture, the first live stream and the second live stream;
and the data packet processing unit is used for taking the real-time message transmission protocol data packet as the merged live stream.
10. The apparatus of claim 8, wherein the apparatus further comprises:
a first providing module, configured to provide the first live broadcast stream to the second live broadcast end when the second live broadcast end performs a stream pull through a stream pull address of a direct connection channel;
and the second providing module is used for providing the second live stream to the first live end under the condition that the first live end performs stream pulling through a stream pulling address of a direct connection channel.
11. The apparatus of claim 8, wherein the means for transmitting comprises:
a distribution unit, configured to send the merged live stream to a distribution network server, so that the distribution network server provides the merged live stream to the packaging machine.
12. A live stream processing apparatus comprising:
the merging and pulling module is used for pulling the merged live stream generated by the real-time communication server side; the merged live stream is a live stream obtained by merging a first live stream of a first live end and a second live stream of a second live end;
the adding module is used for adding the decoration information of the first live broadcast end to the merged live broadcast stream;
and the adding and sending module is used for sending the combined live stream added with the decoration information to a live audience.
13. The apparatus of claim 12, wherein the merge pull module comprises:
and the distribution pulling unit is used for pulling the combined live stream sent by the real-time communication server from a distribution network server.
14. The apparatus of claim 12, wherein the add-and-send module comprises:
and the distribution sending unit is used for forwarding the combined live stream added with the decoration information to a distribution network server through a multimedia server so that the distribution network server provides the combined live stream added with the decoration information to the live audience.
15. A live stream processing system, comprising:
a first live stream processing apparatus, being a live stream processing apparatus according to any one of claims 8 to 11;
a second live stream processing apparatus, being a live stream processing apparatus according to any one of claims 12 to 14;
the third live broadcast stream processing device is used for receiving a combined live broadcast stream sent by the real-time communication server, wherein the combined live broadcast stream is obtained by combining a first live broadcast stream of the first live broadcast end and a second live broadcast stream of the second live broadcast end by the real-time communication server; and the direct broadcasting server is used for providing the combined live broadcasting stream to the packaging machine under the condition that the packaging machine draws the combined live broadcasting stream, so that the packaging machine can add decoration information of the first direct broadcasting end to the combined live broadcasting stream;
the fourth live stream processing device is used for receiving the combined live stream which is pushed by the packaging machine and added with the decoration information; and forwarding the merged live stream added with the decoration information to a distribution network server.
16. An electronic device, comprising:
at least one processor; and
a memory communicatively coupled to the at least one processor; wherein the content of the first and second substances,
the memory stores instructions executable by the at least one processor to enable the at least one processor to perform the method of any one of claims 1-7.
17. A non-transitory computer readable storage medium having stored thereon computer instructions for causing a computer to perform the method of any one of claims 1-7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110498263.XA CN113225577B (en) | 2021-05-07 | 2021-05-07 | Live stream processing method, device and system, electronic equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110498263.XA CN113225577B (en) | 2021-05-07 | 2021-05-07 | Live stream processing method, device and system, electronic equipment and storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN113225577A true CN113225577A (en) | 2021-08-06 |
| CN113225577B CN113225577B (en) | 2022-10-11 |
Family
ID=77091769
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110498263.XA Active CN113225577B (en) | 2021-05-07 | 2021-05-07 | Live stream processing method, device and system, electronic equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113225577B (en) |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114268823A (en) * | 2021-12-01 | 2022-04-01 | 北京达佳互联信息技术有限公司 | Video playing method and device, electronic equipment and storage medium |
| CN114390310A (en) * | 2022-01-13 | 2022-04-22 | 广州繁星互娱信息科技有限公司 | Data pushing method and device, storage medium and electronic equipment |
| CN114745595A (en) * | 2022-05-10 | 2022-07-12 | 上海哔哩哔哩科技有限公司 | Bullet screen display method and device |
| CN114866822A (en) * | 2022-05-10 | 2022-08-05 | 上海哔哩哔哩科技有限公司 | Live broadcast stream pushing method and device and live broadcast stream pulling method and device |
| WO2023045651A1 (en) * | 2021-09-26 | 2023-03-30 | 北京字跳网络技术有限公司 | Livestreaming voice chat method and apparatus, electronic device, medium, and program product |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20140160223A1 (en) * | 2012-12-12 | 2014-06-12 | Jan-Christoph Bieselt | Call-in Participation for a Live Video Broadcast |
| CN106254899A (en) * | 2016-08-16 | 2016-12-21 | 网宿科技股份有限公司 | The control method of a kind of live even wheat and system |
| CN106658205A (en) * | 2016-11-22 | 2017-05-10 | 广州华多网络科技有限公司 | Studio video streaming synthesis control method, device and terminal equipment |
| CN110035321A (en) * | 2019-04-11 | 2019-07-19 | 北京大生在线科技有限公司 | A kind of trailing and system of online real-time video |
| CN112291579A (en) * | 2020-10-26 | 2021-01-29 | 北京字节跳动网络技术有限公司 | Data processing method, device, equipment and storage medium |
| CN112312144A (en) * | 2019-07-31 | 2021-02-02 | 腾讯科技（深圳）有限公司 | Live broadcast method, device, equipment and storage medium |
-
2021
- 2021-05-07 CN CN202110498263.XA patent/CN113225577B/en active Active
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20140160223A1 (en) * | 2012-12-12 | 2014-06-12 | Jan-Christoph Bieselt | Call-in Participation for a Live Video Broadcast |
| CN106254899A (en) * | 2016-08-16 | 2016-12-21 | 网宿科技股份有限公司 | The control method of a kind of live even wheat and system |
| CN106658205A (en) * | 2016-11-22 | 2017-05-10 | 广州华多网络科技有限公司 | Studio video streaming synthesis control method, device and terminal equipment |
| CN110035321A (en) * | 2019-04-11 | 2019-07-19 | 北京大生在线科技有限公司 | A kind of trailing and system of online real-time video |
| CN112312144A (en) * | 2019-07-31 | 2021-02-02 | 腾讯科技（深圳）有限公司 | Live broadcast method, device, equipment and storage medium |
| CN112291579A (en) * | 2020-10-26 | 2021-01-29 | 北京字节跳动网络技术有限公司 | Data processing method, device, equipment and storage medium |
Cited By (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2023045651A1 (en) * | 2021-09-26 | 2023-03-30 | 北京字跳网络技术有限公司 | Livestreaming voice chat method and apparatus, electronic device, medium, and program product |
| CN114268823A (en) * | 2021-12-01 | 2022-04-01 | 北京达佳互联信息技术有限公司 | Video playing method and device, electronic equipment and storage medium |
| CN114390310A (en) * | 2022-01-13 | 2022-04-22 | 广州繁星互娱信息科技有限公司 | Data pushing method and device, storage medium and electronic equipment |
| CN114745595A (en) * | 2022-05-10 | 2022-07-12 | 上海哔哩哔哩科技有限公司 | Bullet screen display method and device |
| CN114866822A (en) * | 2022-05-10 | 2022-08-05 | 上海哔哩哔哩科技有限公司 | Live broadcast stream pushing method and device and live broadcast stream pulling method and device |
| CN114745595B (en) * | 2022-05-10 | 2024-02-27 | 上海哔哩哔哩科技有限公司 | Bullet screen display method and device |
| CN114866822B (en) * | 2022-05-10 | 2024-04-09 | 上海哔哩哔哩科技有限公司 | Live broadcast push stream method and device, and live broadcast pull stream method and device |
Also Published As
| Publication number | Publication date |
|---|---|
| CN113225577B (en) | 2022-10-11 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN113225577B (en) | Live stream processing method, device and system, electronic equipment and storage medium | |
| US20180316939A1 (en) | Systems and methods for video processing, combination and display of heterogeneous sources | |
| US20180316948A1 (en) | Video processing systems, methods and a user profile for describing the combination and display of heterogeneous sources | |
| US20180316947A1 (en) | Video processing systems and methods for the combination, blending and display of heterogeneous sources | |
| CN110798697B (en) | Video display method, device and system and electronic equipment | |
| US20180316942A1 (en) | Systems and methods and interfaces for video processing, combination and display of heterogeneous sources | |
| CN108076349B (en) | Network interactive live broadcast method, system and electronic equipment | |
| US20160366464A1 (en) | Method, device, and system for interactive television | |
| US11284137B2 (en) | Video processing systems and methods for display, selection and navigation of a combination of heterogeneous sources | |
| US20180316944A1 (en) | Systems and methods for video processing, combination and display of heterogeneous sources | |
| US20180316943A1 (en) | Fpga systems and methods for video processing, combination and display of heterogeneous sources | |
| US20180316946A1 (en) | Video processing systems and methods for display, selection and navigation of a combination of heterogeneous sources | |
| US9432316B2 (en) | Representation of online discussion in conjunction with primary visual content | |
| US20130110900A1 (en) | System and method for controlling and consuming content | |
| WO2018107875A1 (en) | Method and system for microphone-connection live broadcast of a live-broadcast platform | |
| US20130076980A1 (en) | Systems and methods for synchronizing the presentation of a combined video program | |
| US11451858B2 (en) | Method and system of processing information flow and method of displaying comment information | |
| WO2018071781A2 (en) | Systems and methods for video processing and display | |
| CN112291502B (en) | Information interaction method, device and system and electronic equipment | |
| KR101915786B1 (en) | Service System and Method for Connect to Inserting Broadcasting Program Using an Avata | |
| CN112135155B (en) | Audio and video connecting and converging method and device, electronic equipment and storage medium | |
| US20180316940A1 (en) | Systems and methods for video processing and display with synchronization and blending of heterogeneous sources | |
| US20180316941A1 (en) | Systems and methods for video processing and display of a combination of heterogeneous sources and advertising content | |
| CN104053062A (en) | Electronic displays having paired canvases | |
| CN114125480A (en) | Live broadcasting chorus interaction method, system and device and computer equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |