CN113473158A

CN113473158A - Live broadcast data processing method, device, electronic equipment, medium and program product

Info

Publication number: CN113473158A
Application number: CN202110748390.0A
Authority: CN
Inventors: 李明路; 舒志强
Original assignee: Beijing Baidu Netcom Science and Technology Co Ltd
Current assignee: Beijing Baidu Netcom Science and Technology Co Ltd
Priority date: 2021-06-30
Filing date: 2021-06-30
Publication date: 2021-10-01
Anticipated expiration: 2041-06-30
Also published as: CN113473158B

Abstract

The disclosure provides a live data processing method, a live data processing device, electronic equipment, media and program products, and relates to the field of artificial intelligence, in particular to the technical fields of cloud computing, internet of things and the like. The specific implementation scheme is as follows: acquiring first direct-broadcast stream data; adding a live streaming distribution command in the first live streaming data according to a live streaming instruction; and sending the first direct-broadcast stream data after the direct-broadcast stream distribution command is added to a cloud terminal system, so that the cloud terminal system can distribute the first direct-broadcast stream to at least one appointed receiver according to the direct-broadcast stream distribution command. The embodiment of the disclosure can improve the distribution efficiency of the live stream and reduce the system burden.

Description

Live broadcast data processing method, device, electronic equipment, medium and program product

Technical Field

The utility model relates to an artificial intelligence technical field especially relates to technical fields such as cloud computing, thing networking.

Background

With the development of computer technology, live broadcast is gradually emerging as a new interactive mode and new technology. The live broadcast mode can comprise various categories such as show live broadcast, E-commerce live broadcast, knowledge live broadcast and the like, and the universal live broadcast field with various forms has penetrated into various industries. To date, the vast majority of global network traffic comes from video traffic, and how much video traffic is owned can directly or indirectly determine how much resources are acquired. And under the condition that the live broadcast can bring a large amount of video traffic, the improvement of the live broadcast technology can promote the live broadcast party and the watching party to use the live broadcast technology and can bring more resources for the live broadcast platform. Therefore, how to provide a live broadcast technology which is more convenient and easier to operate for a live broadcast technology user is an important problem in the development of the live broadcast technology.

Disclosure of Invention

The disclosure provides a live data processing method, a live data processing device, an electronic device, a medium and a program product.

According to an aspect of the present disclosure, there is provided a live data processing method, including:

acquiring first direct-broadcast stream data;

adding a live streaming distribution command in the first live streaming data according to the live streaming command;

and sending the first direct-broadcast stream data added with the direct-broadcast stream distribution command to a cloud terminal system, so that the cloud terminal system can distribute the first direct-broadcast stream to at least one appointed receiver according to the direct-broadcast stream distribution command.

According to another aspect of the present disclosure, there is provided a live data processing method, including:

receiving first direct-current streaming data sent by a terminal;

under the condition that the first live streaming data is detected to carry a live streaming distribution command, generating third live streaming data distributed to at least one appointed receiver according to the live streaming distribution command and the first live streaming data;

the third live streaming data is sent to the content distribution network server such that the content distribution network server is capable of sending the third live streaming data to at least one designated recipient.

According to another aspect of the present disclosure, there is provided a live data processing apparatus including:

the first direct-current data acquisition module is used for acquiring first direct-current data;

the adding module is used for adding a live streaming distribution command in the first live streaming data according to the live streaming command;

the first sending module is used for sending the first direct-broadcast stream data added with the direct-broadcast stream distribution command to the cloud terminal system, so that the cloud terminal system can distribute the first direct-broadcast stream to at least one designated receiver according to the direct-broadcast stream distribution command.

the first direct-current data receiving module is used for receiving first direct-current data sent by a terminal;

the third live streaming data generation module is used for generating third live streaming data distributed to at least one appointed receiver according to the live streaming distribution command and the first live streaming data under the condition that the first live streaming data is detected to carry a live streaming distribution command;

and the third live streaming sending module is used for distributing the third live streaming data to at least one appointed receiver.

According to another aspect of the present disclosure, there is provided an electronic device including:

at least one processor; and

a memory communicatively coupled to the at least one processor; wherein the content of the first and second substances,

the memory stores instructions executable by the at least one processor to enable the at least one processor to perform a method according to any one of the embodiments of the present disclosure.

According to another aspect of the present disclosure, there is provided a non-transitory computer readable storage medium having stored thereon computer instructions for causing a computer to perform a method in any of the embodiments of the present disclosure.

According to another aspect of the present disclosure, a computer program product is provided, comprising a computer program which, when executed by a processor, implements the method in any of the embodiments of the present disclosure.

According to the technology disclosed by the invention, the first live streaming data can be sent to the cloud terminal system of the cloud end, and the first live streaming data is distributed through the system of the cloud end, so that the strong data processing capacity of the cloud end is utilized, and the distribution efficiency of the live streaming is improved; meanwhile, the first live streaming data is distributed through the terminal system running at the cloud end, so that information such as distribution parameters and the like is easily customized according to the requirements of users, and the customizability of live streaming distribution and the usability of a cloud end distribution module are improved.

It should be understood that the statements in this section do not necessarily identify key or critical features of the embodiments of the present disclosure, nor do they limit the scope of the present disclosure. Other features of the present disclosure will become apparent from the following description.

Drawings

The drawings are included to provide a better understanding of the present solution and are not to be construed as limiting the present disclosure. Wherein:

fig. 1 is a schematic diagram of a live data processing method according to an embodiment of the present disclosure;

fig. 2 is a schematic diagram of a live data processing method according to another embodiment of the present disclosure;

fig. 3 is a schematic diagram of a live data processing method according to yet another embodiment of the present disclosure;

fig. 4 is a schematic diagram of a live data processing method according to yet another embodiment of the present disclosure;

fig. 5 is a system architecture diagram of a live data processing method implementation according to an example of the present disclosure;

6A-C are schematic diagrams of a live stream distribution command data format according to an example of the present disclosure;

fig. 7A is a schematic structural diagram of a live stream distribution command implemented by a live data processing method according to an example of the present disclosure;

fig. 7B is a live stream distribution command transition diagram implemented by a live data processing method according to an example of the present disclosure;

fig. 8 is a screen recording framework diagram implemented by a live data processing method according to an example of the present disclosure;

fig. 9 is a schematic diagram of a live data processing apparatus according to an embodiment of the present disclosure;

fig. 10 is a schematic diagram of a live data processing apparatus according to another embodiment of the present disclosure;

fig. 11 is a schematic diagram of a live data processing apparatus according to yet another embodiment of the present disclosure;

fig. 12 is a schematic diagram of a live data processing apparatus according to yet another embodiment of the present disclosure;

fig. 13 is a schematic diagram of a live data processing apparatus according to yet another embodiment of the present disclosure;

fig. 14 is a schematic diagram of a live data processing apparatus according to yet another embodiment of the present disclosure;

fig. 15 is a schematic diagram of a live data processing apparatus according to yet another embodiment of the present disclosure;

fig. 16 is a schematic diagram of a live data processing apparatus according to yet another embodiment of the present disclosure;

fig. 17 is a schematic diagram of a live data processing apparatus according to yet another embodiment of the present disclosure;

fig. 18 is a schematic diagram of a live data processing apparatus according to yet another embodiment of the present disclosure;

fig. 19 is a schematic diagram of a live data processing apparatus according to yet another embodiment of the present disclosure;

fig. 20 is a schematic diagram of a live data processing apparatus according to yet another embodiment of the present disclosure;

fig. 21 is a block diagram of an electronic device used to implement a live data processing method of an embodiment of the present disclosure.

Detailed Description

Exemplary embodiments of the present disclosure are described below with reference to the accompanying drawings, in which various details of the embodiments of the disclosure are included to assist understanding, and which are to be considered as merely exemplary. Accordingly, those of ordinary skill in the art will recognize that various changes and modifications of the embodiments described herein can be made without departing from the scope and spirit of the present disclosure. Also, descriptions of well-known functions and constructions are omitted in the following description for clarity and conciseness.

The embodiment of the present disclosure first provides a live data processing method, as shown in fig. 1, including:

step S11: acquiring first direct-broadcast stream data;

step S12: adding a live streaming distribution command in the first live streaming data according to the live streaming command;

step S13: and sending the first direct-broadcast stream data added with the direct-broadcast stream distribution command to a cloud terminal system, so that the cloud terminal system can distribute the first direct-broadcast stream data to at least one appointed receiver according to the direct-broadcast stream distribution command.

In this embodiment, the live data processing method shown in fig. 1 may be applied to various types of terminals, such as any input/output device connected to a computer system or a communication system. Specifically, for example, the mobile phone, the desktop computer, the notebook computer, the tablet computer, the wearable smart device, and the like may be used.

The first live streaming data may be live streaming data recorded by a live end, that is, live streaming data for push streaming. Which may specifically include at least one of video data and audio data. The first live streaming data may be original recorded data acquired by a live end, or may be data that can be directly pushed after being processed by operations such as encoding.

The live broadcasting instruction may be an instruction issued by a user at a live broadcasting end, and may be used to instruct the live broadcasting end to issue first live broadcasting stream data for stream pushing. In an implementation manner, if the terminal does not receive the live broadcast instruction, the stream pushing operation of the first live broadcast stream data may not be executed by default.

The live stream distribution command is used for indicating a set receiver receiving the live stream distribution command and sending the first live stream data to a specified receiver. In a specific implementation manner, a user of the live broadcast end can write and set a receiver of the first live broadcast stream data, authentication information and the like in a live broadcast stream distribution command.

The adding of the live streaming distribution command to the first live streaming data may be to use the live streaming distribution command and the first live streaming data as transmittable data, and the live streaming distribution command and the first live streaming data may be data independent of each other in the transmittable data.

The method includes adding a live stream distribution command to the first live stream data, and inserting the live stream distribution command into the first live stream data, so that the live stream distribution command can be sent simultaneously when the first live stream data is sent.

In a specific implementation mode, a user can issue a live broadcast instruction by operating an input device such as a terminal keyboard, a touch screen and a mouse, and after receiving the live broadcast instruction, the terminal adds a live broadcast stream distribution command to first live broadcast stream data.

When the terminal is a specific type of terminal device, the cloud terminal system may be a corresponding type of terminal system operating in the cloud. The cloud system may also be a terminal component that can operate in the terminal environment in the cloud simulation, for example, a terminal component a and a terminal component B that can operate in the cloud, and a component A, B that can operate in the cloud can achieve similar effects and the same functions as those in the terminal operation.

The cloud terminal system can also be a module, an environment and the like which run at the cloud end and have partial functions of the terminal system, and the functions of the same part as those of the terminal system are reused.

In one implementation, in the case that a portion of the terminal system common to the cloud terminal system is changed, the cloud terminal system may be changed together therewith. Alternatively, when the cloud terminal system is changed, a part common to the terminal system and the cloud terminal system is also changed.

For example, if the terminal is a mobile phone, the cloud terminal system may be a mobile phone system running in the cloud, that is, a cloud mobile phone system. If the terminal is a computer, the cloud terminal system may be a computer system operating in the cloud.

In one implementation, after the live broadcast side starts the terminal system of the live broadcast side, the cloud terminal system can be started at the same time. Or when the live broadcast side starts the part of the live broadcast side, which is common to the cloud terminal system, the cloud terminal system is started at the same time.

In this embodiment, the first live stream data to which the live stream distribution command is added is sent to the cloud terminal system, and the first live stream data to which the live stream distribution command is added may be sent to the cloud terminal system through some intermediate transmission systems, or directly sent to the cloud terminal system through a set protocol. Therefore, the cloud terminal system can obtain the distribution content according to the live stream distribution command under the condition that the received data is analyzed and the live stream distribution command is detected to exist in the received data, and sends the first live stream data corresponding to the distribution content to the specified receiver.

In another implementation manner, the cloud terminal system sends the first direct-broadcast stream data received together with the direct-broadcast stream distribution command to a specified receiver when detecting that the direct-broadcast stream distribution command exists in the received data.

In another implementation manner, the cloud terminal system may send, to a specified recipient, the first live stream data received at the same time as the live stream distribution command is received, when detecting that the live stream distribution command exists in the received data.

In the embodiment of the disclosure, the first live streaming data can be sent to the cloud terminal system of the cloud end, and the first live streaming data is distributed through the system of the cloud end, so that the strong data processing capability of the cloud end is utilized, and the distribution efficiency of the live streaming is improved; meanwhile, the first live streaming data is distributed through the terminal system running at the cloud end, so that information such as distribution parameters and the like is easily customized according to the requirements of users, and the customizability of live streaming distribution and the usability of a cloud end distribution module are improved.

In an embodiment, after acquiring the first live streaming data, as shown in fig. 2, the method further includes:

step S21: sending the first direct-current streaming data to a cloud terminal system;

step S22: receiving screen recording data returned by the cloud terminal system according to the first live streaming data;

step S23: and playing the screen recording data, and receiving a live broadcast instruction sent by a user according to the playing effect of the screen recording data.

In this embodiment, the first live streaming data is sent to the cloud terminal system, and may be the first live streaming data that does not carry the live streaming distribution command and is sent to the cloud terminal system.

In this embodiment, the screen recording data may be audio and/or video data which is directly generated by the cloud terminal system according to the first live streaming data and has the same content as the first live streaming data and can be played; or the audio and/or video data recorded when the cloud terminal system pre-plays the first direct-current streaming data.

In this embodiment, the screen recording data returned by the cloud terminal system according to the first live streaming data may be received by the cloud terminal system according to the screen recording data returned by the first live streaming data when the first live streaming data does not carry a live streaming distribution command.

The playing of the screen recording data may be playing the screen recording data on a display device connected to the live broadcast terminal after receiving the screen recording data, presenting a playing effect (including a head portrait effect, information of the live broadcast party, and the like) presented by the screen recording data at the audience terminal, or presenting a video picture (a simple video picture) effect presented by the screen recording data at the audience terminal.

In this embodiment, the screen recording data is played at the live broadcast end, so that a user at the live broadcast end can watch the playing effect of the screen recording data through a display device connected with the live broadcast end, and determine and adjust information such as a shooting mode, an acquisition mode, parameters and the like of the first live broadcast stream according to the playing effect, so as to change the watching effect of the audience end; or determining to push the first live stream according to the current playing effect according to the playing effect, and sending a live broadcasting instruction through the input equipment of the live broadcasting end.

In this embodiment, the user of the live broadcast end can watch the playing effect of the screen recording data through the display device of the live broadcast end, so that preview can be performed before deciding stream pushing, and when the playing effect cannot reach an expected value, the obtaining mode or parameter of the first live broadcast data is adjusted, so that the live broadcast effect can be close to or meet the requirement of the live broadcast party.

In one embodiment, adding a live stream distribution command to a first live stream data according to a live instruction includes:

according to the live broadcasting instruction, inserting a live broadcasting stream distribution command at the adjacent position of the key frame of the first live broadcasting stream data, or inserting a live broadcasting stream distribution command at the adjacent position of all frames of the first live broadcasting stream data.

In this embodiment, the position adjacent to the key frame of the first live streaming data may be before the key frame or after the key frame. The adjacent positions of all frames of the first live stream data may be before or after each frame.

The key frame of the first direct current data can be determined according to the definition or the label.

In this embodiment, a live stream distribution command can be added to the first live stream data according to the live command, so that after the cloud terminal system receives the first live stream data, whether to execute distribution of the first live stream data can be determined according to whether the first live stream data carries the live stream distribution command.

In one embodiment, the live data processing method further includes:

receiving a user configuration command;

and setting the authentication information and the distribution address in the live stream distribution command according to the user configuration command.

In this embodiment, the receiving of the user configuration command may be receiving the user configuration command through a terminal input device of the live broadcast terminal.

By setting the authentication information and the distribution address, a receiver of live streaming data can be configured, for example, a shopping platform A can be configured to receive live streaming data, a shopping platform B can be configured not to receive live streaming data, and authentication modes, authentication instructions and the like of all platforms can be configured.

In this embodiment, the user of the live broadcast end can configure the authentication information and the distribution address in the live broadcast stream distribution command as needed, thereby realizing customizability of live broadcast stream distribution. Meanwhile, the user can carry out configuration operation at the live broadcast end, so that the conditions for user configuration are simplified, and the satisfaction degree of the personalized requirements of the user is improved.

In one embodiment, the live stream distribution command is a command in a supplemental enhancement information format, and the live data processing method further includes:

generating object numbered musical notation format information of a live stream distribution command according to authentication information and a distribution address set by a user configuration command;

and converting the information of the object numbered musical notation format into a command of a supplementary enhancement information format, and distributing the command as a live stream.

In this embodiment, the object profile format Information is Json format Information, which is easy to write, and a command of Supplemental Enhancement Information format (SEI) is a signal channel in H264 coding, which is used to add Information to a live stream, and implement transparent transmission and parsing of data from push stream to play.

In the embodiment, the information in the object numbered musical notation format is converted into the live stream distribution command in the supplemental enhancement information format, so that the user at the live end can easily operate when configuring the live stream distribution command.

In one embodiment, the live data processing method further includes:

receiving second live streaming data of at least one appointed receiver forwarded by the cloud terminal system;

and locally playing the second live streaming data.

In the case where the receiving side is provided in plurality, the second live streaming data may be live streaming data of all receiving sides or live streaming data transmitted by a part of the receiving sides.

In this embodiment, the cloud terminal system can forward the live broadcast stream data of the live broadcast party, so that the live broadcast end can simultaneously implement the live broadcast operation through the cloud terminal system.

An embodiment of the present disclosure further provides a live data processing method, as shown in fig. 3, including:

step S31: receiving first direct-current streaming data sent by a terminal;

step S32: under the condition that the first live streaming data is detected to carry a live streaming distribution command, generating third live streaming data distributed to at least one appointed receiver according to the live streaming distribution command and the first live streaming data;

step S33: the third live streaming data is distributed to at least one designated recipient.

In this embodiment, the third live streaming data may be data generated by processing the first live streaming data in a manner such as encoding, or may be the first live channel data itself.

In this embodiment, the S31-S33 may be applied to a cloud, and the cloud may have a terminal system running thereon or may have a part of components of the terminal system running thereon, so as to implement a part of functions of the terminal system.

In this embodiment, different third live streaming data may be generated for different designated recipients.

In this embodiment, the cloud can generate the first live streaming data into third live streaming data for sending to the designated receiver according to the received live streaming distribution command, so as to improve the live streaming distribution efficiency.

In one embodiment, a receiving terminal sends first direct current streaming data, which includes:

receiving first direct-current data through a plug-flow cluster of a Platform Service system at a cloud end, and sending the first direct-current data to a central control Platform cluster of the Platform Service system (PaaS) at the cloud end; the central control platform cluster is used for generating third live streaming data distributed to at least one appointed receiver according to the first live streaming data and the live streaming distribution command under the condition that the obtained first live streaming data is detected to carry the live streaming distribution command.

In one embodiment, after receiving the first direct current streaming data sent by the terminal, as shown in fig. 4, the method further includes:

step S41: under the condition that the first direct-broadcast stream data carrying a direct-broadcast stream distribution command is not detected, generating a virtual screen according to the first direct-broadcast stream data;

step S42: rendering a playing picture of the first direct-current streaming data in the virtual screen;

step S43: recording a screen of a playing picture of the first direct-playing streaming data to obtain screen recording data;

step S44: and sending the screen recording data to a cloud platform, namely a stream pushing cluster of the service system, so that the stream pushing cluster can send the screen recording data to the terminal through the cloud terminal system.

In this embodiment, the push stream cluster of the PaaS system may also be referred to as a play cluster.

In one embodiment, generating third live streaming data for distribution to at least one designated recipient based on a live streaming distribution command and the first live streaming data comprises:

and generating third live broadcast stream data aiming at the corresponding appointed receiver according to the authentication information and the appointed receiver address in the live broadcast stream distribution command.

In this embodiment, the authentication information may be sent or not sent according to the configuration.

In one embodiment, the live data processing method further includes:

and running a live broadcast software development kit of the terminal at the cloud end to generate a cloud terminal system.

In one embodiment, the live data processing method further includes:

receiving fourth live streaming data of at least one designated receiver forwarded by the content distribution network server;

and sending the fourth live streaming data to the cloud terminal system, so that the cloud terminal system can send the fourth live streaming data to the terminal.

The fourth live streaming data may be live streaming data transmitted by all or a part of the at least one receiver.

In an example of the present disclosure, a live system architecture may be illustrated with reference to fig. 5: in the terminal system, there is provided a Live SDK51 including components such as a Player (Player)52 and a push streaming module (Pusher) 53. At the cloud end, a cloud terminal system 54 is operated, and in the case where the terminal is a mobile phone, the cloud terminal system may be a BAC (cloud mobile phone system).

In an embodiment of the present disclosure, the cloud mobile phone system may be a virtualization technology based on an ARM (Advanced Reduced Instruction Set computer) server, and may operate the mobile phone system in a cloud. For example, in the case that the mobile phone system is an Android system, the cloud mobile phone can operate the native terminal Android mobile phone system in the cloud end, so that the push streaming and pull streaming functions of mobile phone live broadcast are realized in the cloud end.

The cloud terminal system 54 contains the same components as the Live SDK in the terminal system, i.e., a player 55, a plug flow module 56, etc. A plurality of terminal instances may be deployed on the cloud terminal system 54, and the terminal instance deployed on the cloud terminal system 54 may be, for example, an executable application on a desktop system. The cloud end further comprises a live-broadcast PaaS system 57, the live-broadcast PaaS system 57 further comprises a stream receiving cluster 58, a central control Platform (Platform) cluster 59 and a playing cluster 510, the stream receiving cluster 58, the central control Platform cluster 59 and the playing cluster 510 can perform information transmission through an intranet, and compared with the internet public network, each cluster in the PaaS system 57 can be directly connected through an appointed IP address, so that the effects of higher bandwidth and lower delay compared with the public network are achieved, and the reliability of the information transmission is guaranteed. The function of the cloud end system 54 is equivalent to part of the function of the central control platform cluster 59, that is, part of the function of the central control platform cluster 59 is migrated to the cloud end system 54. The playback cluster 510 further includes one or more stream routes. The cloud end of the live broadcast system further includes a Content Distribution Network (CDN) server 511, which plays a role of distributing live broadcast streams, and the CDN server 511 may include multiple levels of nodes, such as a level 1 node, a level 2 node, a level 3 node, and the like, and can forward a live broadcast stream to the live broadcast PaaS system 57 after authentication and achieve an effect of accelerating data transmission.

In a specific implementation manner, the user may select a transmission Protocol between the terminal and the cloud or the CDN, for example, may select a RMPT (Real Time Messaging Protocol) Protocol, an RTP (Real-Time Transport Protocol) Protocol, an SRT (Secure Reliable Transport, which is a low latency Transport Protocol) Protocol, an FLV (Flash Video, Streaming media format) Protocol, or an HLS (HTTP Live Streaming, which is an adaptive code rate Streaming media Transport Protocol) Protocol.

In the disclosed example, information can be recalled between the cloud terminal system and the terminal system, and the running state of the party to be recalled can be confirmed.

In the disclosed example, live streaming is distributed through the cloud terminal system, and compared with the multi-leave distribution of live streaming through the terminal system, the latter needs to push the stream to the cloud live system through terminal live broadcast software, and distributes the stream to other destination addresses through the live broadcast central control platform, and in the process, risks are added except for introduction of the central control platform development. According to the embodiment of the method and the system, the live streaming is distributed to all receivers through the cloud terminal system, the original terminal live broadcasting capacity is realized, the mobile phone cloudization is realized by means of the cloud architecture, the logic coupled in the live broadcasting PaaS system is separated, the independence of the live broadcasting PaaS system is kept, the system stability is improved, and the independent system is easier to expand and maintain.

Under the condition that the terminal is a mobile phone, the cloud live broadcast system is in butt joint with the mobile phone system, and the cloud live broadcast stream distribution effect is achieved on the basis of maintaining the existing cloud live broadcast system.

Under the condition that the terminal adopts a mobile phone and the cloud terminal system adopts a cloud mobile phone system, the cloud mobile phone system deploys a live broadcast APK (Android application package) which can independently run, namely a mobile phone SDK. When a user starts live broadcast stream pushing by using a live broadcast SDK of a terminal mobile phone, a live broadcast system can inform a cloud mobile phone system in an asynchronous mode when detecting that live broadcast streams are active, and at the moment, the cloud mobile phone system can awaken a live broadcast service which is already built in a system layer and trigger stream pulling behaviors in the live broadcast service, so that the user who starts the live broadcast of the terminal can watch live broadcast pictures by means of a virtual screen of the cloud mobile phone system.

When a terminal mobile phone user initiates a live stream distribution request, a terminal mobile phone live SDK adds an identifier of a distribution command into a video stream, wherein the distribution command is realized by adding SEI (Supplemental Enhancement Information) Information into a standard H264 coding format. The SEI information is a signal channel in H264 coding, and can be used for adding information in a live stream to realize transparent transmission and analysis of data from push stream to play. The SEI-added live stream is sent to a cloud live system through a live SDK of the terminal mobile phone. When receiving a live stream added with SEI, the cloud live system already awakens the live service in the cloud mobile phone system, and at the moment, the live service in the cloud mobile phone system starts to analyze live stream information by using the stream pulling capability, and when the live stream with the SEI is analyzed, the SEI information is completely analyzed and sent to the live service built in the cloud mobile phone system.

In a specific implementation manner of the present disclosure, the format of the live stream data may be H264 or H265 format, and the bare stream data structures of the live streams in the two formats may be as shown in fig. 6A, including NAL Header (Network Abstract Layer Header) and RBSP (Raw Byte Sequence Payload).

When the SEI information is added, the SEI information may be inserted before a key frame of live stream data, as shown in fig. 6B; it is also possible to insert each frame of live stream data before, as shown in fig. 6C. In fig. 6B, the RBSP may include an SPS (Sequence Parameter Set), a PPS (Picture Parameter Set), an IDR (Instantaneous Decoding Refresh) frame, a P frame, and a B frame, and SEI information may precede the first key frame P frame, and in fig. 6C, SEI information may be inserted before all IDR, P, and B frames.

As shown in fig. 7A, the basic information of the SEI information in H264 or H265 constitutes NALU (Network abstraction Layer Unit) including: the header | F | NRI | SEI unit type |, where F (forbidden) denotes a disable bit, NRI denotes NAL ref idc (Network Abstract Layer reference idc), and SEI unit type denotes an SEI unit type. The SEI NALU further includes: SEI payload type (SEI payload type), SEI payload size (SEI payload size), SEI payload UUID (SEI payload universal unique identifier), SEI payload content (SEI payload content), RBSP trailing bits (PBSP tail bits). Wherein, the length of the | F | NRI | SEI unit type |, the SEI payload type, and the PBSP tail bit may be 1 byte, and the length of the rest information may be multi-byte or unlimited byte.

In a specific implementation manner of the present disclosure, a data structure of the SEI information may be a data structure that can be flexibly customized by a service provider, and since the terminal live broadcast SDK and the live broadcast service and live broadcast bottom layer push-pull stream capability that are built in the cloud mobile phone system may actually be a live broadcast SDK of the same SDK product, the data structure has a cross-platform capability, and can be deployed at a mobile terminal or in the cloud mobile phone system. Therefore, the live broadcast service in the cloud mobile phone can be completely understood by aiming at the SEI information customized by the business party, the user can configure the SEI information, a Json format live broadcast instruction is generated according to the configuration information of the user, the Json format live broadcast instruction information is converted into a SEI format live broadcast instruction (SEI information), the system can analyze the SEI format instruction through a preset corresponding relation, and end-to-end full-link live broadcast stream communication is achieved by means of the method.

In one example of the present disclosure, the generation of the live command may be as shown in fig. 7B. Through a Json-format live broadcast instruction, a user configures load (Payload) content of the live broadcast instruction to be content between "{ }" in fig. 7B, that is, "UseType": 1, "User Name": "shajiefeng". The Json string is packed into SEI frames (SEI information) which the recipient can parse character by character. For example, 06 in the SEI information in fig. 7B can be interpreted as Nalu type SEI; 05 can be interpreted as SEI type; 36 can be interpreted as Payload bytes; 08-b8 can be interpreted as a UUID (Universal Unique Identifier); 7b-00 can be resolved into payload (payload) content, i.e., "UseType": 1, "User Name": "shajiefeng"; 80 may resolve into a tail.

In the disclosed example, under the condition that the terminal is a mobile phone and the cloud terminal is a cloud mobile phone, after a stream pulling module of a live broadcast service built in the cloud mobile phone analyzes corresponding SEI information, if a distribution command is initiated by the SEI, a screen recording module in the live broadcast service is triggered at this time. The screen recording module plays a role in distributing live broadcast streams of the cloud mobile phone system. Because the live broadcast service pull module in the cloud mobile phone is rendered on the virtual screen and is not a terminal physical screen, the rendering of a plurality of virtual screens can be realized by means of the cloud mobile phone, and the cloud mobile phone can realize the technical effect of efficient multi-path distribution.

In the embodiment of the present disclosure, the physical screen rendering is performed according to the screen recording data of the virtual screen. The physical screen rendering can be jointly completed based on the SurfaceFliger (embossment) and the Hardware Composer HAL (Hardware editor Hardware abstraction layer) of the Android system, and the data screen rendering is completed by executing the steps of receiving the buffer area, determining the most effective method for synthesizing the buffer area, sending the buffer area to the display equipment and the like. Wherein the screen sends a VSYNC (Vertical Sync) signal to the surface flag to realize periodic refreshing. In some terminal systems, the processing mechanism of the virtual screen is substantially consistent with the rendering of the physical screen, and provides data and adds buffer queue (buffer queue), but the difference is that the Hardware Composer HAL is not completed by the original manufacturer of the display device Hardware, but is generated by Android Surface consumer components, such as UI (User Interface) components like Surface View, texurreview, and glsurface View (Graphics Library Surface View). Compared with a physical screen, the Surface consumption component of the Android system can create a plurality of instances according to actual scenes.

The generation of screen recording data of the virtual screen depends on the screen recording module, and in one implementation, the framework of the screen recording module is as shown in fig. 8, and includes: AV Core (Audio & Video Core) 81, AR Capture (augmented Reality Capture) 82, RTMP Socket (RTMP protocol port) 83, SRT Socket (SRT protocol port) 84, RTC (Real Time Clock )85, Audio Record (Video recording) 86, Media Codec (Media encoder) 87, OpenGL (open graphics library) 88, Virtual Display (Virtual screen) 89, Media Projection (Media Projection) module 810, Surface 811, and NetWork I/O (NetWork input output interface) 812. The real-time clock 85 may include an External video recording module (External Audio Record), among others.

A voice signal (MIC) is input into an Audio Record Device 813 of an AVcore81, a pcm (Pulse Code Modulation) stream is generated, and the pcm stream passes through an Audio Filter module 814 and an Audio Media Encoder module 815 to an FLV multiplexer (FLV multiplexing terminal) 816, and is sent to an RTMP port through an FLV format in combination with information sent by a Video Media Encoder module 817. Video recording signals are played on a created Virtual screen 89 and a created media projection module 810 through an Audio Record module by operations of coding, opening a graphic library, and the like, a Virtual Display89 is opened through the media projection module 810, and a Video Filter internal interface module is transmitted to the Virtual Display89, a picture generated by the Video Display89 enters a Buffer Queue held by the Video Filter through the interface module, the picture is consumed by the Video Filter, and after the Video Filter monitors texture updating, the texture is cut and transformed, and finally the picture is drawn to an input Surface (input interface) of the Audio media coding module 85 to perform Video coding, so that screen data is generated. The screen recording data can be sent to each port after operations such as audio media coding and the like, so that the screen recording data can be acquired by a receiver.

According to the embodiment of the present disclosure, a cloud terminal system is used for distributing live streaming data, and distribution of live streaming becomes simpler and more efficient after a terminal (e.g., a mobile phone) system is clouded; meanwhile, the performance of the terminal after cloud processing is released, and compared with the performance problem caused by the fact that the terminal distributes multi-path streams, the terminal after cloud processing obtains more computing capacity, and the performance can be guaranteed fundamentally. The terminal after the cloudization has more management and control, and the terminal after the cloudization itself is still the terminal, means to terminal developer or user, can use the terminal after current terminal technology drive cloudization, and then can realize more business logic, relies on live well accuse platform relatively, and decoupling zero with the high in the clouds is realized to this kind of mode, and live stream distribution becomes independently controllable.

An embodiment of the present disclosure further provides a live data processing apparatus, as shown in fig. 9, including:

a first direct current data obtaining module 91, configured to obtain first direct current data;

the adding module 92 is configured to add a live streaming distribution command to the first live streaming data according to the live streaming instruction;

the first sending module 93 is configured to send the first direct broadcast stream data to which the direct broadcast stream distribution command is added to the cloud terminal system, so that the cloud terminal system can distribute the first direct broadcast stream to at least one designated recipient according to the direct broadcast stream distribution command.

In one embodiment, as shown in fig. 10, the live stream data processing apparatus further includes:

the second sending module 101 is configured to send the first direct current data to the cloud terminal system;

the screen recording data receiving module 102 is configured to receive screen recording data returned by the cloud terminal system according to the first live streaming data;

and the screen recording data playing module 103 is used for playing the screen recording data and receiving a live broadcast instruction sent by a user according to the playing effect of the screen recording data.

In one embodiment, as shown in fig. 11, the adding module includes:

a first inserting unit 111 configured to insert a live stream distribution command at an adjacent position of a key frame of the first live stream data according to a live instruction;

and/or a second inserting unit 112 for inserting the live stream distribution command at adjacent positions of all frames of the first live stream data according to the live instruction.

In one embodiment, as shown in fig. 12, the live stream data processing apparatus further includes:

a configuration receiving module 121, configured to receive a user configuration command;

and the configuration module 122 is configured to set the authentication information and the distribution address in the live stream distribution command according to the configuration command.

In an embodiment, the live stream distribution command is a command in a supplemental enhancement information format, and as shown in fig. 13, the live data processing apparatus further includes:

the object numbered musical notation module 131 is used for generating object numbered musical notation format information of a live stream distribution command according to the authentication information and the distribution address set by the user configuration command;

and the conversion module 132 is configured to convert the object numbered musical notation format information into a command in a supplemental enhancement information format, and serve as a live stream distribution command.

In one embodiment, as shown in fig. 14, the live stream data processing apparatus further includes:

a second live streaming receiving module 141, configured to receive second live streaming data of at least one specified recipient forwarded by the cloud terminal system;

and a second live streaming playing module 142, configured to play the second live streaming data locally.

An embodiment of the present disclosure further provides a live data processing apparatus, as shown in fig. 15, including:

a first direct current data receiving module 151, configured to receive first direct current data sent by a terminal;

a third live streaming data generating module 152, configured to generate, according to the live streaming distribution command and the first live streaming data, third live streaming data distributed to at least one specified receiver when it is detected that the first live streaming data carries a live streaming distribution command;

and a third live streaming sending module 153, configured to distribute the third live streaming data to at least one designated recipient.

In one embodiment, as shown in fig. 16, the first streaming data receiving module includes:

the receiving and sending unit 161 is configured to receive the first direct current data through the push stream cluster of the cloud platform, i.e., the service system, and send the first direct current data to the central control platform cluster of the cloud platform, i.e., the service system; the central control platform cluster is used for generating third live streaming data distributed to at least one appointed receiver according to the first live streaming data and the live streaming distribution command under the condition that the obtained first live streaming data is detected to carry the live streaming distribution command.

In one embodiment, as shown in fig. 17, the live data processing apparatus further includes:

the virtual screen generating module 171 is configured to generate a virtual screen according to the first live streaming data when it is not detected that the first live streaming data carries a live streaming distribution command;

a rendering module 172, configured to render a playing screen of the first direct current streaming data in the virtual screen;

a screen recording module 173, configured to record a screen of a playing picture of the first live streaming data to obtain screen recording data;

and the screen recording sending module 174 is configured to send the screen recording data to a cloud platform, that is, a stream pushing cluster of the service system, so that the stream pushing cluster can send the screen recording data to the terminal through the cloud terminal system.

In one embodiment, as shown in fig. 18, the third live stream data generation module includes:

and the analysis generating unit 181 is configured to generate third live streaming data for a corresponding designated recipient according to the authentication information and the address of the designated recipient in the live streaming distribution command.

In one embodiment, as shown in fig. 19, the live data processing apparatus further includes:

and the cloud terminal system module 191 is used for operating the live broadcast software development kit of the terminal at the cloud end to generate a cloud terminal system.

In one embodiment, as shown in fig. 20, the live data processing apparatus further includes:

a fourth live streaming receiving module 201, configured to receive fourth live streaming data of at least one specified recipient forwarded by the content distribution network server;

the fourth live streaming forwarding module 202 is configured to send the fourth live streaming data to the cloud terminal system, so that the cloud terminal system can send the fourth live streaming data to the terminal.

The functions of each unit, module or sub-module in each apparatus in the embodiments of the present disclosure may refer to the corresponding description in the above method embodiments, and are not described herein again.

The present disclosure also provides an electronic device, a readable storage medium, and a computer program product according to embodiments of the present disclosure.

FIG. 21 shows a schematic block diagram of an example electronic device 210 that may be used to implement embodiments of the present disclosure. Electronic devices are intended to represent various forms of digital computers, such as laptops, desktops, workstations, personal digital assistants, servers, blade servers, mainframes, and other appropriate computers. The electronic device may also represent various forms of mobile devices, such as personal digital processing, cellular phones, smart phones, wearable devices, and other similar computing devices. The components shown herein, their connections and relationships, and their functions, are meant to be examples only, and are not meant to limit implementations of the disclosure described and/or claimed herein.

As shown in fig. 21, the electronic device 2100 includes a computing unit 2111 that can perform various appropriate actions and processes in accordance with a computer program stored in a Read Only Memory (ROM)2112 or a computer program loaded from a storage unit 2118 into a Random Access Memory (RAM) 2113. In the RAM 2113, various programs and data necessary for the operation of the electronic device 2100 can also be stored. The calculation unit 2111, the ROM 2112, and the RAM 2113 are connected to each other via a bus 2114. An input/output (I/O) interface 2115 is also connected to bus 2114.

A plurality of components in the electronic device 2100 are connected to the I/O interface 2115, including: an input unit 2116 such as a keyboard, a mouse, or the like; an output unit 2117 such as various types of displays, speakers, and the like; a storage unit 2118 such as a magnetic disk, an optical disk, or the like; and a communication unit 2119 such as a network card, modem, wireless communication transceiver, or the like. The communication unit 2119 allows the electronic apparatus 2100 to exchange information/data with other apparatuses via a computer network such as the internet and/or various telecommunication networks.

The computing unit 2111 may be a variety of general and/or special purpose processing components having processing and computing capabilities. Some examples of the computing unit 2111 include, but are not limited to, a Central Processing Unit (CPU), a Graphics Processing Unit (GPU), various specialized Artificial Intelligence (AI) computing chips, various computing units running machine learning model algorithms, a Digital Signal Processor (DSP), and any suitable processor, controller, microcontroller, and so forth. The calculation unit 2111 performs the respective methods and processes described above, such as the live data processing method. For example, in some embodiments, the live data processing method may be implemented as a computer software program tangibly embodied in a machine-readable medium, such as storage unit 2118. In some embodiments, part or all of the computer program may be loaded and/or installed onto the electronic device 2100 via the ROM 2112 and/or the communication unit 2119. When the computer program is loaded into the RAM 2113 and executed by the computing unit 2111, one or more steps of the live data processing method described above may be performed. Alternatively, in other embodiments, the computing unit 2111 may be configured to perform the live data processing method by any other suitable means (e.g., by means of firmware).

Various implementations of the systems and techniques described here above may be implemented in digital electronic circuitry, integrated circuitry, Field Programmable Gate Arrays (FPGAs), Application Specific Integrated Circuits (ASICs), Application Specific Standard Products (ASSPs), system on a chip (SOCs), load programmable logic devices (CPLDs), computer hardware, firmware, software, and/or combinations thereof. These various embodiments may include: implemented in one or more computer programs that are executable and/or interpretable on a programmable system including at least one programmable processor, which may be special or general purpose, receiving data and instructions from, and transmitting data and instructions to, a storage system, at least one input device, and at least one output device.

Program code for implementing the methods of the present disclosure may be written in any combination of one or more programming languages. These program codes may be provided to a processor or controller of a general purpose computer, special purpose computer, or other programmable data processing apparatus, such that the program codes, when executed by the processor or controller, cause the functions/operations specified in the flowchart and/or block diagram to be performed. The program code may execute entirely on the machine, partly on the machine, as a stand-alone software package partly on the machine and partly on a remote machine or entirely on the remote machine or server.

In the context of this disclosure, a machine-readable medium may be a tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. The machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any suitable combination of the foregoing. More specific examples of a machine-readable storage medium would include an electrical connection based on one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

To provide for interaction with a user, the systems and techniques described here can be implemented on a computer having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to a user; and a keyboard and a pointing device (e.g., a mouse or a trackball) by which a user can provide input to the computer. Other kinds of devices may also be used to provide for interaction with a user; for example, feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user may be received in any form, including acoustic input, speech input, or tactile input.

The systems and techniques described here can be implemented in a computing system that includes a back-end component (e.g., as a data server), or that includes a middleware component (e.g., an application server), or that includes a front-end component (e.g., a user computer having a graphical user interface or a web browser through which a user can interact with an implementation of the systems and techniques described here), or any combination of such back-end, middleware, or front-end components. The components of the system can be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include: local Area Networks (LANs), Wide Area Networks (WANs), and the Internet.

The computer system may include clients and servers. A client and server are generally remote from each other and typically interact through a communication network. The relationship of client and server arises by virtue of computer programs running on the respective computers and having a client-server relationship to each other.

It should be understood that various forms of the flows shown above may be used, with steps reordered, added, or deleted. For example, the steps described in the present disclosure may be executed in parallel or sequentially or in different orders, and are not limited herein as long as the desired results of the technical solutions disclosed in the present disclosure can be achieved.

The above detailed description should not be construed as limiting the scope of the disclosure. It should be understood by those skilled in the art that various modifications, combinations, sub-combinations and substitutions may be made in accordance with design requirements and other factors. Any modification, equivalent replacement, and improvement made within the spirit and principle of the present disclosure should be included in the scope of protection of the present disclosure.

Claims

1. A live data processing method includes:

acquiring first direct-broadcast stream data;

adding a live streaming distribution command in the first live streaming data according to a live streaming instruction;

and sending the first direct-broadcast stream data after the direct-broadcast stream distribution command is added to a cloud terminal system, so that the cloud terminal system can distribute the first direct-broadcast stream data to at least one appointed receiver according to the direct-broadcast stream distribution command.

2. The method of claim 1, wherein after the obtaining the first direct current data, further comprising:

sending the first direct-current streaming data to a cloud terminal system;

receiving screen recording data returned by the cloud terminal system according to the first direct broadcast stream data;

and playing the screen recording data, and receiving a live broadcast instruction sent by a user according to the playing effect of the screen recording data.

3. The method according to claim 1 or 2, wherein the adding a live stream distribution command in the first live stream data according to a live instruction comprises:

according to a live broadcasting instruction, inserting a live broadcasting stream distribution command at the adjacent position of a key frame of the first live broadcasting stream data, or inserting a live broadcasting stream distribution command at the adjacent position of all frames of the first live broadcasting stream data.

4. The method of any of claims 1-3, further comprising:

receiving a user configuration command;

5. The method of any of claims 1-4, wherein the live stream distribution command is a command in a supplemental enhancement information format, the method further comprising:

and converting the object numbered musical notation format information into a command in a supplementary enhancement information format, and taking the command as the live stream distribution command.

6. The method of any of claims 1-5, further comprising:

receiving second live streaming data of the at least one designated receiver forwarded by the cloud terminal system;

and locally playing the second live streaming data.

7. A live data processing method includes:

receiving first direct-current streaming data sent by a terminal;

sending the third live streaming data to a content distribution network server such that the content distribution network server can send the third live streaming data to the at least one designated recipient.

8. The method of claim 7, wherein the receiving of the first direct current streaming data sent by the terminal comprises:

receiving the first direct current data through a stream pushing cluster of a platform serving as a service system of the cloud, and sending the first direct current data to a central control platform cluster of the platform serving as the service system of the cloud; the central control platform cluster is used for generating third live streaming data distributed to at least one appointed receiver according to the first live streaming data and a live streaming distribution command under the condition that the obtained first live streaming data is detected to carry the live streaming distribution command.

9. The method according to claim 7 or 8, wherein after receiving the first direct current data transmitted by the terminal, the method further comprises:

under the condition that the first direct-broadcast stream data carrying a direct-broadcast stream distribution command is not detected, generating a virtual screen according to the first direct-broadcast stream data;

rendering a playing picture of the first direct-current streaming data in the virtual screen;

recording a screen of a playing picture of the first direct-playing streaming data to obtain screen recording data;

and sending the screen recording data to a cloud platform, namely a stream pushing cluster of a service system, so that the stream pushing cluster can send the screen recording data to a terminal through a cloud terminal system.

10. The method of any of claims 7-9, wherein generating third live stream data for distribution to at least one designated recipient based on the live stream distribution command and the first live stream data comprises:

11. The method of any of claims 7-10, further comprising:

and running a live broadcast software development kit of the terminal at the cloud end to generate the cloud terminal system.

12. The method of any of claims 7-11, further comprising:

and sending the fourth live streaming data to a cloud terminal system, so that the cloud terminal system can send the fourth live streaming data to a terminal.

13. A live data processing apparatus comprising:

the adding module is used for adding a live streaming distribution command in the first live streaming data according to a live streaming instruction;

the first sending module is used for sending the first direct-broadcast stream data after the direct-broadcast stream distribution command is added to the cloud terminal system, so that the cloud terminal system can distribute the first direct-broadcast stream data to at least one appointed receiver according to the direct-broadcast stream distribution command.

14. The apparatus of claim 13, wherein the apparatus further comprises:

the second sending module is used for sending the first direct-current streaming data to a cloud terminal system;

the screen recording data receiving module is used for receiving screen recording data returned by the cloud terminal system according to the first direct broadcast stream data;

and the screen recording data playing module is used for playing the screen recording data and receiving a live broadcast instruction sent by a user according to the playing effect of the screen recording data.

15. The apparatus of claim 13 or 14, wherein the adding means comprises:

a first inserting unit, configured to insert a live stream distribution command at an adjacent position of a key frame of the first live stream data according to a live instruction;

or, the second inserting unit is used for inserting the live stream distribution command at the adjacent position of all the frames of the first live stream data according to the live stream instruction.

16. The apparatus of any of claims 13-15, further comprising:

the configuration receiving module is used for receiving a user configuration command;

and the configuration module is used for setting the authentication information and the distribution address in the live stream distribution command according to the user configuration command.

17. The apparatus of any of claims 13-16, wherein the live stream distribution command is a command in a supplemental enhancement information format, the apparatus further comprising:

the object numbered musical notation module is used for generating object numbered musical notation format information of a direct stream distribution command according to the authentication information and the distribution address set by the user configuration command;

and the conversion module is used for converting the object numbered musical notation format information into a command in a supplementary enhancement information format, and the command is used as the live stream distribution command.

18. The apparatus of any of claims 13-17, further comprising:

the second live streaming receiving module is used for receiving second live streaming data of the at least one designated receiver forwarded by the cloud terminal system;

and the second live streaming playing module is used for locally playing the second live streaming data.

19. A live data processing apparatus comprising:

a third live streaming data generation module, configured to generate, when it is detected that the first live streaming data carries a live streaming distribution command, third live streaming data distributed to at least one specified receiver according to the live streaming distribution command and the first live streaming data;

and the third live streaming sending module is used for distributing the third live streaming data to the at least one appointed receiver.

20. The apparatus of claim 19, wherein the first streaming data receiving module comprises:

the receiving and sending unit is used for receiving the first direct-current data through a stream pushing cluster of a platform serving as a service system at the cloud end and sending the first direct-current data to a central control platform cluster of the platform serving as the service system at the cloud end; the central control platform cluster is used for generating third live streaming data distributed to at least one appointed receiver according to the first live streaming data and a live streaming distribution command under the condition that the obtained first live streaming data is detected to carry the live streaming distribution command.

21. The apparatus of claim 19 or 20, wherein the apparatus further comprises:

the virtual screen generating module is used for generating a virtual screen according to the first direct-broadcast stream data under the condition that the first direct-broadcast stream data is not detected to carry a direct-broadcast stream distribution command;

the rendering module is used for rendering a playing picture of the first direct-current streaming data in the virtual screen;

the screen recording module is used for recording a screen of a playing picture of the first direct-playing streaming data to obtain screen recording data;

and the screen recording sending module is used for sending the screen recording data to a flow pushing cluster of a cloud platform, namely a service system, so that the flow pushing cluster can send the screen recording data to a terminal through a cloud terminal system.

22. The apparatus of any of claims 19-21, wherein the third live streaming data generation module comprises:

and the analysis generating unit is used for generating third live broadcast stream data aiming at the corresponding appointed receiver according to the authentication information and the appointed receiver address in the live broadcast stream distribution command.

23. The apparatus of any of claims 19-22, further comprising:

and the cloud terminal system module is used for operating a live broadcast software development kit of the terminal at the cloud end to generate the cloud terminal system.

24. The apparatus of any of claims 19-23, further comprising:

a fourth live streaming receiving module, configured to receive fourth live streaming data of at least one specified recipient forwarded by the content distribution network server;

and the fourth live streaming forwarding module is used for sending the fourth live streaming data to the cloud terminal system, so that the cloud terminal system can send the fourth live streaming data to the terminal.

25. An electronic device, comprising:

at least one processor; and

the memory stores instructions executable by the at least one processor to enable the at least one processor to perform the method of any one of claims 1-12.

26. A non-transitory computer readable storage medium having stored thereon computer instructions for causing a computer to perform the method of any one of claims 1-12.

27. A computer program product comprising a computer program which, when executed by a processor, implements the method according to any one of claims 1-12.