CN109788303B

CN109788303B - Live video stream pushing method and device, electronic equipment and storage medium

Info

Publication number: CN109788303B
Application number: CN201910080509.4A
Authority: CN
Inventors: 何思远
Original assignee: Guangzhou Kugou Computer Technology Co Ltd
Current assignee: Guangzhou Kugou Computer Technology Co Ltd
Priority date: 2019-01-28
Filing date: 2019-01-28
Publication date: 2020-12-04
Anticipated expiration: 2039-01-28
Also published as: CN109788303A

Abstract

The application discloses a live video stream pushing method and device and a storage medium, and belongs to the technical field of multimedia. The method comprises the following steps: in the process of pushing a live video stream, counting continuous stuck-down level values, wherein the continuous stuck-down level values are used for representing the number of times or degradation rate of continuous double-screen stream pushing to single-screen stream pushing; when the continuous pause degradation level value reaches a reference degradation threshold value within the reference live broadcast times or the reference live broadcast duration, starting a continuous single-screen stream mode, wherein the continuous single-screen stream mode is a mode only allowing to push a single-screen stream; and when the push state of the live video stream is monitored to meet the double-screen stream push condition, switching from the continuous single-screen stream mode to the double-screen stream mode. The problem that the pushing termination is caused by the fact that the blocking phenomenon occurs when two paths of live video streams are pushed simultaneously can be avoided, the pushing success rate of the live video streams is improved, and therefore the live broadcast success rate is also improved.

Description

Live video stream pushing method and device, electronic equipment and storage medium

Technical Field

The present application relates to the field of multimedia technologies, and in particular, to a live video stream push method and apparatus, an electronic device, and a storage medium.

Background

In the network live broadcast platform, a fan user can watch live broadcast of the anchor terminal through a mobile phone, or the fan user can also watch live broadcast of the anchor terminal through a Personal Computer (PC) device. In order to adapt to different devices for playing live video streams, the anchor terminal can carry out double-screen stream pushing in the live process.

The double-screen stream pushing means that the anchor terminal simultaneously sends two paths of live video streams to a background server in a live broadcasting process, the two paths of live video streams comprise a cross screen stream and a vertical screen stream, the cross screen stream can be used for being played on PC equipment, and the vertical screen stream can be used for being played on a mobile phone. Therefore, the background server can push the corresponding live video stream for the device according to the device type of the device requesting to pull the live video stream, for example, when the device pulling the live video stream is a mobile phone, the background server sends the vertical screen stream to the mobile phone.

However, when the network performance is poor or the hardware configuration is low, a pause phenomenon is easily generated when the anchor terminal simultaneously pushes two paths of live video streams, and at this time, the anchor terminal can only terminate the push operation, so that the push success rate of the live video streams is reduced.

Disclosure of Invention

The embodiment of the application provides a live video stream pushing method and device, electronic equipment and a storage medium, and can solve the problem that the pushing success rate of a live video stream is reduced because the pushing operation can only be stopped in a poor pushing environment in the related art. The technical scheme is as follows:

in a first aspect, a method for pushing a live video stream is provided, where the method includes:

in the process of pushing a live video stream, counting continuous stuck-down level values, wherein the continuous stuck-down level values are used for representing the number of times or degradation rate of continuous double-screen stream pushing to single-screen stream pushing;

when the continuous pause degradation level value reaches a reference degradation threshold value within the reference live broadcast times or the reference live broadcast duration, starting a continuous single-screen stream mode, wherein the continuous single-screen stream mode is a mode only allowing to push a single-screen stream;

and when the push state of the live video stream is monitored to meet the double-screen stream push condition, switching from the continuous single-screen stream mode to the double-screen stream mode.

Optionally, the statistical continuous stuck-down number value includes:

when the pushed live video stream is a double-screen stream, monitoring the transmission performance index of the live video stream;

and when the transmission performance index is smaller than a reference index threshold value, reducing the double-screen flow pushing to the single-screen flow pushing, and increasing the continuous stuck reduction number value by a first numerical value.

Optionally, the transmission performance indicator includes a video coding rate and/or a video frame loss rate.

Optionally, after the starting of the continuous single-screen streaming mode, the method further includes:

counting the duration of the single-screen stream, wherein the duration of the single-screen stream refers to the duration of the continuous single-screen stream mode, and when the duration of the single-screen stream reaches a first duration threshold, determining that the push state of the live video stream meets the double-screen stream push condition;

or,

counting the number of times of single-screen stable pushing and/or the number of times of single-screen temporary pushing, wherein the number of times of single-screen stable pushing refers to the number of times that the pushing duration of a single-screen stream exceeds a second duration threshold value and no pause or stop broadcasting occurs during the pushing duration, and the number of times of single-screen stream pushing does not reach the second duration threshold value and no pause or stop broadcasting occurs during the pushing duration; and when the single-screen stable pushing times and/or the single-screen temporary pushing times reach a first time threshold value, determining that the pushing state of the live video stream meets the double-screen stream pushing condition.

Optionally, when the number of times of stable pushing on the single screen and/or the number of times of temporary pushing on the single screen reaches a first time threshold, before determining that the pushing state of the live video stream meets the pushing condition of the dual-screen stream, the method further includes:

starting double-screen stream pushing, and counting the stable pushing times of the double screens in the process of the double-screen stream pushing, wherein the stable pushing times of the double screens refer to the times that the pushing time of the double screens exceeds a third time threshold value and jamming and degradation do not occur in the pushing period;

when the number of times of the double-screen stable pushing reaches a second time threshold value, determining that the pushing state of the live video stream meets the double-screen stream pushing condition;

and when the stable pushing times of the double screens does not reach the second time threshold value, restarting the continuous single-screen streaming mode.

Optionally, before counting the continuous katton reduction level number values in the pushing process of the live video stream, the method further includes:

displaying a push stream adjusting function option, wherein the push stream adjusting function option is used for starting or closing a push stream mode adjusting function, and the push stream mode adjusting function is used for adjusting a push stream mode according to a push state of the live video stream;

and when detecting that the push stream adjusting function option is in an open state, executing the operation of counting continuous pause down-grade values in the push process of the live video stream.

In a second aspect, a push device for live video streaming is provided, the device including:

the device comprises a counting module, a display module and a display module, wherein the counting module is used for counting continuous stuck reduction level values in the pushing process of a live video stream, and the continuous stuck reduction level values are used for representing the number of times or the degradation rate of continuous double-screen stream pushing to single-screen stream pushing;

the starting module is used for starting a continuous single-screen streaming mode when the continuous pause degradation level number value reaches a reference degradation threshold value within a reference live broadcast frequency or a reference live broadcast duration, wherein the continuous single-screen streaming mode is a mode only allowing single-screen streaming to be pushed;

and the switching module is used for switching from the continuous single-screen stream mode to the double-screen stream mode when the push state of the live video stream is monitored to meet the double-screen stream push condition.

Optionally, the statistics module is configured to:

Optionally, the statistics module is further configured to:

or,

Optionally, the statistics module is further configured to:

when the single-screen stable pushing times and/or the single-screen temporary pushing times reach a first time threshold, starting double-screen stream pushing, and counting the double-screen stable pushing times in the double-screen stream pushing process, wherein the double-screen stable pushing times refer to the times that the double-screen stream pushing duration exceeds a third duration threshold and jamming degradation does not occur in the pushing duration;

Optionally, the statistics module is further configured to:

In a third aspect, an electronic device is provided, including:

a processor;

a memory for storing processor-executable instructions;

wherein the processor is configured to implement the push method of the live video stream according to the first aspect.

In a fourth aspect, a computer-readable storage medium is provided, where instructions are stored on the computer-readable storage medium, and when executed by a processor, the instructions implement the live video stream push method according to the first aspect.

In a fifth aspect, a computer program product containing instructions is provided, which when run on a computer, causes the computer to execute the push method for live video stream according to the first aspect.

The technical scheme provided by the embodiment of the application has the following beneficial effects:

in the process of pushing the live video stream, counting continuous pause level reduction values, and determining the number of times or the degradation rate of continuously reducing the double-screen stream from the single-screen stream according to the continuous pause level reduction values. If the continuous pause degradation level value reaches the reference degradation threshold value within the reference live broadcast times or the reference live broadcast duration, the push environment of the live broadcast video stream is unstable, and at the moment, only the push of the single-screen stream can be allowed, namely, the push of the double-screen stream is forbidden. In the mode of only allowing single-screen stream pushing, when the pushing state of the live video stream is monitored to meet the double-screen stream pushing condition, the pushing environment is stable, and therefore the mode can be restored to the double-screen stream mode again. Therefore, the problem that the pushing is stopped due to the fact that the blocking phenomenon occurs when two paths of live video streams are pushed simultaneously can be avoided, the pushing success rate of the live video streams is improved, and the live broadcast success rate is also improved.

Drawings

In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings needed to be used in the description of the embodiments are briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present application, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without creative efforts.

FIG. 1 is a schematic diagram of an implementation environment shown in accordance with an exemplary embodiment;

FIG. 2 is a flow diagram illustrating a push method of a live video stream in accordance with an exemplary embodiment;

FIG. 3 is a flow diagram illustrating a push method of a live video stream in accordance with another exemplary embodiment;

fig. 4 is a schematic structural diagram illustrating a push apparatus for live video streaming according to an exemplary embodiment;

fig. 5 is a schematic diagram illustrating a structure of a terminal according to another exemplary embodiment.

Detailed Description

To make the objects, technical solutions and advantages of the present application more clear, embodiments of the present application will be described in further detail below with reference to the accompanying drawings.

Before describing the push method of the live video stream provided by the embodiment of the present application in detail, first, a brief description is given to an application scenario and an implementation environment related to the embodiment of the present application.

First, a brief description is given of an application scenario related to an embodiment of the present application.

In order to adapt to different types of fan terminals to play a live video stream in a network live platform, an anchor terminal can encode and push a cross screen stream and a vertical screen stream simultaneously, so that the requirement on a push environment of the live video stream is high, such as the network performance for transmitting the live video stream. However, networks such as internet bandwidth that can be used to transport dual-screen streams have fluctuating characteristics such that the push requirements for dual-screen streams may not be met when the push environment is poor for a period of time. Therefore, the anchor terminal may have a long-time pause phenomenon in the process of pushing the two-screen stream, and cannot automatically recover by adjusting the encoding rate and the like. For the problems, currently, the push of the live video stream can only be terminated, so that the push success rate of the live video stream is reduced, and the live video stream fails to be live. Therefore, the method for pushing the live video stream can solve the problem of live termination caused by blockage during the pushing of the double-screen stream, and can improve the pushing success rate of the live video stream, namely the live success rate. For specific implementation, refer to the following embodiments.

Next, a brief description will be given of an implementation environment related to the embodiments of the present application.

Referring to fig. 1, fig. 1 is a schematic diagram illustrating an implementation environment in accordance with an example embodiment. The implementation environment may include a host terminal 110, a backend server 120, and a fan terminal 130. The anchor terminal 110 and the fan-shaped terminal 130 can establish communication connection with the background server 120 through a wired network or a wireless network, respectively.

The anchor terminal 110 is a terminal used by an anchor user, that is, the anchor user can log in to a live webcast platform to perform live webcast by using the anchor terminal 110. In the live broadcasting process, the anchor terminal 110 may push the live video stream to the background server 130 for management, and further, the anchor terminal 110 may push two paths of live video streams simultaneously. In some embodiments, the anchor terminal 110 may be a mobile phone, a tablet computer, a notebook computer, a desktop computer, and the like, which is not limited in this embodiment.

The background server 120 is mainly used for managing live related data, for example, receiving a live video stream pushed by the anchor terminal 110, and pushing the live video stream to a fan terminal 130 requesting to pull the live video stream. In implementation, the background server 120 may be one server, or the background server 120 may also be a server cluster composed of multiple servers, which is not limited in this embodiment of the present application.

The fan terminal 130 is a terminal used by a fan user, that is, the fan user can log in to a live webcast platform to watch live webcast by using the fan terminal 130. In implementation, the fan terminal 130 may pull the live video stream from the background server 120 to play, so that the fan user may view the live broadcast of the anchor user. In some embodiments, the fan terminal 130 may be a device such as a cell phone, or the fan terminal 130 may be a PC device such as a tablet, laptop, desktop, laptop, or the like.

After the application scenarios and the implementation environments related to the embodiments of the present application are described, a detailed description will be given below of a push method of a live video stream provided by the embodiments of the present application with reference to the accompanying drawings.

Referring to fig. 2, fig. 2 is a flowchart illustrating a method for pushing a live video stream according to an exemplary embodiment, where the embodiment of the present application is described by taking as an example that the method for pushing a live video stream is applied to the implementation environment shown in fig. 1, the method may include the following steps:

step 201: in the process of pushing the live video stream, counting continuous pause reduction level values, wherein the continuous pause reduction level values are used for representing the number of times or the degradation rate of continuously reducing from double-screen stream pushing to single-screen stream pushing.

Step 202: and when the continuous pause degradation level value reaches a reference degradation threshold value within the reference live broadcast times or the reference live broadcast duration, starting a continuous single-screen stream mode, wherein the continuous single-screen stream mode is a mode only allowing to push a single-screen stream.

Step 203: and when the push state of the live video stream is monitored to meet the double-screen stream push condition, switching from the continuous single-screen stream mode to the double-screen stream mode.

In the embodiment of the application, in the network live broadcast platform, in order to adapt to different types of fan terminals to play the live broadcast video stream, the anchor terminal may encode and push the cross-screen stream and the vertical-screen stream at the same time, so that the requirement on a push environment of the live broadcast video stream is high, including network performance for transmitting the live broadcast video stream, for example. However, networks such as internet bandwidth that can be used to transport dual-screen streams have fluctuating characteristics such that the push requirements for dual-screen streams may not be met when the push environment is poor for a period of time. Therefore, the anchor terminal may have a long-time pause phenomenon in the process of pushing the two-screen stream, and cannot automatically recover by adjusting the encoding rate and the like. For the problems, currently, the push of the live video stream can only be terminated, so that the push success rate of the live video stream is reduced, and the live video stream fails to be live. Therefore, the method for pushing the live video stream can solve the problem of live termination caused by blockage during the pushing of the double-screen stream, and can improve the pushing success rate of the live video stream, namely the live success rate. For specific implementation, refer to the following embodiments.

Optionally, the statistical continuous stuck-down number value includes:

or,

All the above optional technical solutions can be combined arbitrarily to form an optional embodiment of the present application, and the present application embodiment is not described in detail again.

Fig. 3 is a flowchart illustrating a method for pushing a live video stream according to another exemplary embodiment, where this embodiment is illustrated by applying the method for pushing a live video stream to the implementation environment shown in fig. 1, and the method may include the following implementation steps:

step 301: in the process of pushing the live video stream, when the pushed live video stream is a double-screen stream, monitoring the transmission performance index of the live video stream.

As described above, the anchor terminal may encode two live video streams respectively, and then push the two live video streams after encoding to the background server at the same time, where the two live video streams include a cross-screen stream and a vertical-screen stream, which may be referred to as a push dual-screen stream. In the process of pushing the double-screen stream, in order to facilitate automatic adjustment of the pushing mode under the conditions of unstable network and the like, the anchor terminal monitors the transmission performance index of the live video stream.

In one possible implementation, the transmission performance indicator may include a video encoding rate and/or a video frame packet loss rate. That is, the anchor terminal may monitor the video encoding rate, or may monitor the video frame packet loss rate, or may monitor the video encoding rate and the video frame packet loss rate at the same time.

Further, before executing the method provided by the embodiment of the present application, a push stream adjustment function option may be displayed, where the push stream adjustment function option is used to turn on or turn off a push stream mode adjustment function, where the push stream mode adjustment function is to adjust a push stream mode according to a push state of the live video stream, and when detecting that the push stream adjustment function option is in an on state, the push method of the live video stream provided by the embodiment of the present application is executed.

For example, the anchor terminal may display a push stream adjustment function option on the live interface, and when the anchor user wants that the anchor terminal can automatically adjust the push stream mode according to the push condition of the live video stream, the anchor terminal may be controlled to be in an open state to open the push stream mode adjustment function, so that the anchor terminal may automatically monitor the transmission performance index of the live video stream during the live broadcast.

Further, the push stream adjustment function option defaults to an on state, or may be manually turned on by the anchor user. In addition, when the anchor user does not need the anchor terminal to automatically adjust the push stream mode, the push stream adjustment function option can be controlled to be in a closed state, and at the moment, the push stream mode adjustment function is also closed accordingly. Further, after the push stream mode adjustment function is turned off, the anchor terminal clears the historical statistical data, wherein the historical statistical data includes, but is not limited to, historical reference live broadcast times, reference live broadcast time length and continuous pause step-down values.

Step 302: and when the transmission performance index is smaller than the reference index threshold value, reducing the double-screen flow pushing to the single-screen flow pushing, and increasing the continuous stuck reduction number value by a first numerical value.

The continuous Kanton reduction number value is used for representing the number of times of continuously reducing from double-screen stream pushing to single-screen stream pushing or the degradation rate.

In implementation, when a pause phenomenon occurs in the push of a live video stream due to the conditions of poor network transmission performance and the like, the push of the live video stream can be automatically adjusted generally by adjusting the encoding rate and the like, however, when the transmission performance index of the live video stream is still smaller than the reference index threshold value, it indicates that the push pause problem of the live video stream still cannot be solved by adjusting the encoding rate and the like, at this time, the push of the double-screen stream can be reduced to the push of the single-screen stream, and the anchor terminal increases the continuous pause level reduction value by a first numerical value.

The reference index threshold may be set by a user according to actual needs in a self-defined manner, or may be set by the anchor terminal in a default manner, which is not limited in the embodiment of the present application.

In addition, the first numerical value can be set by a user according to actual requirements in a self-defined mode, and can also be set by the anchor terminal in a default mode. For example, the first value may be set to 1, where each count increases the successive stuck step number by 1.

In one possible implementation, the implementation of reducing the dual-screen streaming push to the single-screen streaming push may include: and sending the horizontal screen stream to a background server, and forbidding pushing of the vertical screen stream. That is to say, when the dual-screen stream pushing is reduced to the single-screen stream pushing, the vertical screen stream can be stopped, and only the horizontal screen stream is pushed to the background server.

Of course, the foregoing is only described by taking an example of stopping pushing the vertical screen stream when the dual-screen stream pushing is reduced to the single-screen stream pushing, and in another embodiment, the horizontal screen stream may also be stopped from being pushed, which is not limited in this application embodiment.

It should be noted that, after the anchor terminal reduces the dual-screen streaming push to the single-screen streaming push, in some embodiments, when a situation such as an increase of a new service is detected, for example, an increase of a continuous service, the anchor terminal may restart the dual-screen streaming push. And then, the anchor terminal continuously monitors the transmission performance index of the live video stream in the double-screen stream pushing process so as to count the continuous stuck reduction level value.

In addition, it should be noted that, the above step 301 and step 302 are used to implement an operation of counting continuous katton reduction values in the pushing process of the live video stream.

Step 303: and when the continuous pause degradation level value reaches a reference degradation threshold value within the reference live broadcast times or the reference live broadcast duration, starting a continuous single-screen stream mode, wherein the continuous single-screen stream mode is a mode only allowing to push a single-screen stream.

The reference live broadcast times and the reference live broadcast duration can be set by a user according to actual requirements in a user-defined mode, and can also be set by the anchor terminal in a default mode.

The reference degradation threshold may be set by a user according to actual needs in a self-defined manner, or may be set by the anchor terminal in a default manner, which is not limited in the embodiment of the present application.

When the continuous pause degradation level value reaches a reference degradation threshold value within the reference anchor playing times or the reference live playing duration, it is indicated that a pause degradation event is detected continuously for multiple times, namely, the continuous anchor playing terminal reduces the double-screen stream push to single-screen stream push due to the pause condition, at this moment, a continuous single-screen stream mode is started, two live video streams are not allowed to be pushed simultaneously in the mode, and only one live video stream is allowed to be pushed.

For example, assuming that the continuous stuck reduction level value is used to indicate the number of times of continuously reducing from the two-screen streaming pushing to the single-screen streaming pushing, the reference live broadcasting number is 10 times, and when the reference degradation threshold is set to 5, if it is detected that the continuous stuck reduction level value reaches 5 times within 10 live broadcasting, the continuous single-screen streaming mode is started, that is, only the single-screen streaming pushing is allowed. As another example, assuming that the continuous stuck degradation value is used to represent the degradation rate of continuous dropping from the dual-screen streaming push to the single-screen streaming push, the reference live broadcast time period is 300 minutes, and when the reference degradation threshold is set to 20%, if the continuous stuck degradation rate is detected to reach 20% in the 300-minute live broadcast time period, the continuous single-screen streaming mode is started, that is, only the single-screen streaming push is allowed.

It should be noted that, in the process of counting the continuous stuck falling level number, if the continuous stuck falling level number does not reach the reference degradation threshold value within the reference live broadcast times or the reference live broadcast duration, the continuous stuck falling level number is cleared and counted again.

Step 304: and monitoring whether the push state of the live video stream meets the push condition of the double-screen stream.

In the process that the anchor terminal executes the single-screen stream pushing, in order to determine when and under what conditions the double-screen stream pushing can be recovered, whether the pushing state of the live video stream meets the double-screen stream pushing condition or not can be monitored. In a possible implementation manner, the specific implementation of monitoring whether the push state of the live video stream satisfies the push condition of the dual-screen stream may include the following two possible cases:

in the first case: and counting the duration of the single-screen stream, wherein the duration of the single-screen stream refers to the duration of the continuous single-screen stream mode, and when the duration of the single-screen stream reaches a first duration threshold, determining that the push state of the live video stream meets the double-screen stream push condition.

The first time threshold may be set by a user according to actual needs in a self-defined manner, or may be set by the anchor terminal in a default manner, which is not limited in the embodiment of the present application.

That is, the anchor terminal counts the duration of the continuous single-screen streaming mode, and if the duration reaches the first duration threshold, it may be considered that the push environment of the live video stream is restored to a stable state, and at this time, it may be determined that the push state of the live video stream satisfies the dual-screen streaming push condition. The stable state described in the embodiment of the present application refers to a state in which the push environment can satisfy the dual-screen stream push.

For example, assuming that the first duration threshold is 12 hours, the anchor terminal starts to count the duration of the continuous single-screen streaming mode after entering the continuous single-screen streaming mode, and once it is detected that the duration reaches 12 hours, it may be determined that the push status of the live video stream satisfies the dual-screen streaming push condition.

In the second case: counting the single-screen stable pushing times and/or the single-screen temporary pushing times, wherein the single-screen stable pushing times refer to the times that the pushing time of the single-screen stream exceeds a second time threshold and the jamming and stopping do not occur in the pushing period, and the single-screen temporary pushing times refer to the times that the pushing time of the single-screen stream does not reach the second time threshold and the jamming and stopping do not occur in the pushing period; and when the single-screen stable pushing times and/or the single-screen temporary pushing times reach a first time threshold value, determining that the pushing state of the live video stream meets the double-screen stream pushing condition.

The second duration threshold may be set by a user according to actual needs in a self-defined manner, or may be set by the anchor terminal in a default manner, which is not limited in the embodiment of the present application.

In addition, the first time threshold may be set by a user according to actual requirements in a self-defined manner, or may be set by the anchor terminal in a default manner, which is not limited in the embodiment of the present application.

In one possible implementation, the anchor terminal counts the number of times a single screen is stably pushed. Specifically, if the duration of the single-screen stream push exceeds a second duration threshold and no stuck degradation event occurs within the duration, the anchor terminal increases the number of times of single-screen stable push by a second value. When the single-screen stable pushing frequency reaches the first time threshold value, the pushing environment of the live video stream is considered to be basically stable, and at the moment, the pushing state of the live video stream can be determined to meet the double-screen stream pushing condition.

In another possible implementation manner, the number of single-screen temporary pushing times can be counted. If the duration of the single-screen stream pushing does not exceed the second duration threshold and the stuck degradation event does not occur within the duration, the fact that the duration of the anchor user who probably broadcasts the live broadcast is short and the stuck degradation event does not occur within the short-time live broadcast indicates that the single-screen stream pushing times are increased by a second value. When the temporary pushing frequency of the single screen reaches the first time threshold value, the pushing environment of the live video stream is considered to be basically stable, and at the moment, the pushing state of the live video stream can be determined to meet the double-screen stream pushing condition.

Further, under the condition of simultaneously counting the single-screen stable pushing times and the single-screen temporary pushing times, as long as at least one of the single-screen stable pushing times and the single-screen temporary pushing times reaches a first time threshold value, the pushing environment of the live video stream can be considered to be basically stable, and at this time, it can be determined that the pushing state of the live video stream meets the double-screen stream pushing condition.

The second value may be set by a user according to actual requirements in a user-defined manner, or may be set by the anchor terminal in a default manner, which is not limited in the embodiment of the present application.

Further, in the second case, when the number of times of stable pushing on the single screen and/or the number of times of temporary pushing on the single screen reaches the threshold of the first number, before determining that the pushing state of the live video stream meets the pushing condition of the dual-screen stream, the following implementation process may be further included: starting double-screen stream pushing, and counting the stable pushing times of the double screens in the process of the double-screen stream pushing, wherein the stable pushing times of the double screens refer to the times that the pushing time of the double screens exceeds a third time threshold value and jamming and degradation do not occur in the pushing period; when the double-screen stable pushing frequency reaches a second frequency threshold value, determining that the pushing state of the live video stream meets the double-screen stream pushing condition; and restarting the continuous single-screen streaming mode when the stable pushing times of the double screens do not reach the second time threshold value.

That is, in the case when the number of times of single-screen stable pushing and/or the number of times of single-screen temporary pushing reaches the first threshold, in order to further determine whether the pushing environment of the live video stream really reaches the stable state, a "release-maintaining mode" may be entered, where the release-maintaining mode actually makes a further observation on the pushing environment of the live video stream with a stricter standard. In implementation, the dual-screen stream pushing is started, and the number of times of the dual-screen stable pushing is counted in the dual-screen stream pushing process, that is, the number of times that the duration of the dual-screen stream pushing exceeds a third duration threshold and the jam degradation does not occur during the stream pushing period is counted. If the number of times of the double-screen stable pushing reaches the second threshold, it is indicated that a stuck degradation event does not occur in the double-screen stream pushing process, at this time, it can be considered that the pushing environment of the live video stream is determined to be restored to a stable state, and therefore it can be determined that the pushing state of the live video stream meets the double-screen stream pushing condition. On the contrary, if the number of times of blocking in the period reaches the set value, the pushing environment of the live video stream is not really recovered to the stable state, at the moment, the operation of starting the continuous single-screen stream mode needs to be returned again, and the anchor terminal clears the historical data and restarts the calculation.

The third duration threshold may be set by a user according to actual requirements in a self-defined manner, or may be set by the anchor terminal in a default manner. In some embodiments, the third duration threshold may be the same as the second duration threshold, and of course, the third duration threshold may also be different from the second duration threshold, which is not limited in this application.

The second-time threshold may be set by a user according to actual requirements in a user-defined manner, or may be set by the anchor terminal in a default manner, which is not limited in the embodiment of the present application.

Step 305: and when the push state of the live video stream is monitored to meet the double-screen stream push condition, switching from the continuous single-screen stream mode to the double-screen stream mode.

When it is monitored that the push state of the live video stream meets the push condition of the double-screen stream, it is indicated that the push environment of the live video stream is restored to the stable state, so that the anchor terminal is restored to the double-screen stream mode, that is, the cross-screen stream and the vertical-screen stream are simultaneously pushed to the background server, and in the process of pushing, the anchor terminal continues to monitor the transmission performance index of the live video stream, so as to re-count the continuous stuck down-level value according to the transmission performance index.

In the embodiment of the application, in the process of pushing the live video stream, the continuous stuck down value is counted, and the number of times or the degradation rate of continuously reducing the double-screen stream from the single-screen stream can be determined according to the continuous stuck down value. If the continuous pause degradation level value reaches the reference degradation threshold value within the reference live broadcast times or the reference live broadcast duration, the push environment of the live broadcast video stream is unstable, and at the moment, only the push of the single-screen stream can be allowed, namely, the push of the double-screen stream is forbidden. In the mode of only allowing single-screen stream pushing, when the pushing state of the live video stream is monitored to meet the double-screen stream pushing condition, the pushing environment is stable, and therefore the mode can be restored to the double-screen stream mode again. Therefore, the problem that the pushing termination is caused by frequent blocking phenomenon when two paths of live video streams are pushed simultaneously can be avoided, the problem that the image quality is unstable due to large fluctuation of the code rate is avoided, the pushing success rate and the stability of the live video streams are improved, and the live broadcast success rate is also improved.

Fig. 4 is a schematic structural diagram illustrating a push apparatus for live video stream, which may be implemented by software, hardware or a combination of the two, according to an exemplary embodiment. The push device of the live video stream can comprise:

the counting module 410 is configured to count a continuous stuck reduction number value in a live video stream pushing process, where the continuous stuck reduction number value is used to indicate the number of times or a degradation rate of continuously reducing from dual-screen stream pushing to single-screen stream pushing;

a starting module 420, configured to start a continuous single-screen streaming mode when the continuous stuck degradation number value reaches a reference degradation threshold within a reference live broadcast time or a reference live broadcast duration, where the continuous single-screen streaming mode is a mode in which only a single-screen stream is allowed to be pushed;

and a switching module 430, configured to switch from the continuous single-screen streaming mode to a dual-screen streaming mode when it is monitored that the push state of the live video stream meets a dual-screen streaming push condition.

Optionally, the statistics module 410 is configured to:

Optionally, the statistics module 410 is further configured to:

or,

Optionally, the statistics module 410 is further configured to:

In the embodiment of the application, in the process of pushing the live video stream, the continuous stuck down value is counted, and the number of times or the degradation rate of continuously reducing the double-screen stream from the single-screen stream can be determined according to the continuous stuck down value. If the continuous pause degradation level value reaches the reference degradation threshold value within the reference live broadcast times or the reference live broadcast duration, the push environment of the live broadcast video stream is unstable, and at the moment, only the push of the single-screen stream can be allowed, namely, the push of the double-screen stream is forbidden. In the mode of only allowing single-screen stream pushing, when the pushing state of the live video stream is monitored to meet the double-screen stream pushing condition, the pushing environment is stable, and therefore the mode can be restored to the double-screen stream mode again. Therefore, the problem that the pushing is stopped due to the fact that the blocking phenomenon occurs when two paths of live video streams are pushed simultaneously can be avoided, the pushing success rate of the live video streams is improved, and the live broadcast success rate is also improved.

It should be noted that: when the push device for live video streaming provided in the foregoing embodiment implements the push method for live video streaming, only the division of the functional modules is used for illustration, and in practical applications, the function distribution may be completed by different functional modules as needed, that is, the internal structure of the device is divided into different functional modules, so as to complete all or part of the functions described above. In addition, the push device of the live video stream and the push method embodiment of the live video stream provided by the above embodiments belong to the same concept, and specific implementation processes thereof are detailed in the method embodiments and are not described herein again.

Fig. 5 shows a block diagram of a terminal 500 according to an exemplary embodiment of the present application. The terminal 500 may be: a smart phone, a tablet computer, an MP3 player (Moving Picture Experts Group Audio Layer III, motion video Experts compression standard Audio Layer 3), an MP4 player (Moving Picture Experts Group Audio Layer IV, motion video Experts compression standard Audio Layer 4), a notebook computer, or a desktop computer. Terminal 500 may also be referred to by other names such as user equipment, portable terminal, laptop terminal, desktop terminal, and the like.

In general, the terminal 500 includes: a processor 501 and a memory 502.

The processor 501 may include one or more processing cores, such as a 4-core processor, an 8-core processor, and so on. The processor 501 may be implemented in at least one hardware form of a DSP (Digital Signal Processing), an FPGA (Field-Programmable Gate Array), and a PLA (Programmable Logic Array). The processor 501 may also include a main processor and a coprocessor, where the main processor is a processor for Processing data in an awake state, and is also called a Central Processing Unit (CPU); a coprocessor is a low power processor for processing data in a standby state. In some embodiments, the processor 501 may be integrated with a GPU (Graphics Processing Unit), which is responsible for rendering and drawing the content required to be displayed on the display screen. In some embodiments, processor 501 may also include an AI (Artificial Intelligence) processor for processing computational operations related to machine learning.

Memory 502 may include one or more computer-readable storage media, which may be non-transitory. Memory 502 may also include high-speed random access memory, as well as non-volatile memory, such as one or more magnetic disk storage devices, flash memory storage devices. In some embodiments, a non-transitory computer readable storage medium in memory 502 is used to store at least one instruction for execution by processor 501 to implement a push method of a live video stream as provided by method embodiments herein.

In some embodiments, the terminal 500 may further optionally include: a peripheral interface 503 and at least one peripheral. The processor 501, memory 502 and peripheral interface 503 may be connected by a bus or signal lines. Each peripheral may be connected to the peripheral interface 503 by a bus, signal line, or circuit board. Specifically, the peripheral device includes: at least one of radio frequency circuitry 504, touch screen display 505, camera 506, audio circuitry 507, positioning components 508, and power supply 509.

The peripheral interface 503 may be used to connect at least one peripheral related to I/O (Input/Output) to the processor 501 and the memory 502. In some embodiments, the processor 501, memory 502, and peripheral interface 503 are integrated on the same chip or circuit board; in some other embodiments, any one or two of the processor 501, the memory 502, and the peripheral interface 503 may be implemented on a separate chip or circuit board, which is not limited in this embodiment.

The Radio Frequency circuit 504 is used for receiving and transmitting RF (Radio Frequency) signals, also called electromagnetic signals. The radio frequency circuitry 504 communicates with communication networks and other communication devices via electromagnetic signals. The rf circuit 504 converts an electrical signal into an electromagnetic signal to transmit, or converts a received electromagnetic signal into an electrical signal. Optionally, the radio frequency circuit 504 includes: an antenna system, an RF transceiver, one or more amplifiers, a tuner, an oscillator, a digital signal processor, a codec chipset, a subscriber identity module card, and so forth. The radio frequency circuitry 504 may communicate with other terminals via at least one wireless communication protocol. The wireless communication protocols include, but are not limited to: the world wide web, metropolitan area networks, intranets, generations of mobile communication networks (2G, 3G, 4G, and 5G), Wireless local area networks, and/or WiFi (Wireless Fidelity) networks. In some embodiments, the rf circuit 504 may further include NFC (Near Field Communication) related circuits, which are not limited in this application.

The display screen 505 is used to display a UI (User Interface). The UI may include graphics, text, icons, video, and any combination thereof. When the display screen 505 is a touch display screen, the display screen 505 also has the ability to capture touch signals on or over the surface of the display screen 505. The touch signal may be input to the processor 501 as a control signal for processing. At this point, the display screen 505 may also be used to provide virtual buttons and/or a virtual keyboard, also referred to as soft buttons and/or a soft keyboard. In some embodiments, the display screen 505 may be one, providing the front panel of the terminal 500; in other embodiments, the display screens 505 may be at least two, respectively disposed on different surfaces of the terminal 500 or in a folded design; in still other embodiments, the display 505 may be a flexible display disposed on a curved surface or on a folded surface of the terminal 500. Even more, the display screen 505 can be arranged in a non-rectangular irregular figure, i.e. a shaped screen. The Display screen 505 may be made of LCD (Liquid Crystal Display), OLED (Organic Light-Emitting Diode), and other materials.

The camera assembly 506 is used to capture images or video. Optionally, camera assembly 506 includes a front camera and a rear camera. Generally, a front camera is disposed at a front panel of the terminal, and a rear camera is disposed at a rear surface of the terminal. In some embodiments, the number of the rear cameras is at least two, and each rear camera is any one of a main camera, a depth-of-field camera, a wide-angle camera and a telephoto camera, so that the main camera and the depth-of-field camera are fused to realize a background blurring function, and the main camera and the wide-angle camera are fused to realize panoramic shooting and VR (Virtual Reality) shooting functions or other fusion shooting functions. In some embodiments, camera assembly 506 may also include a flash. The flash lamp can be a monochrome temperature flash lamp or a bicolor temperature flash lamp. The double-color-temperature flash lamp is a combination of a warm-light flash lamp and a cold-light flash lamp, and can be used for light compensation at different color temperatures.

Audio circuitry 507 may include a microphone and a speaker. The microphone is used for collecting sound waves of a user and the environment, converting the sound waves into electric signals, and inputting the electric signals to the processor 501 for processing, or inputting the electric signals to the radio frequency circuit 504 to realize voice communication. For the purpose of stereo sound collection or noise reduction, a plurality of microphones may be provided at different portions of the terminal 500. The microphone may also be an array microphone or an omni-directional pick-up microphone. The speaker is used to convert electrical signals from the processor 501 or the radio frequency circuit 504 into sound waves. The loudspeaker can be a traditional film loudspeaker or a piezoelectric ceramic loudspeaker. When the speaker is a piezoelectric ceramic speaker, the speaker can be used for purposes such as converting an electric signal into a sound wave audible to a human being, or converting an electric signal into a sound wave inaudible to a human being to measure a distance. In some embodiments, audio circuitry 507 may also include a headphone jack.

The positioning component 508 is used for positioning the current geographic Location of the terminal 500 for navigation or LBS (Location Based Service). The Positioning component 508 may be a Positioning component based on the Global Positioning System (GPS) in the united states, the beidou System in china, or the galileo System in russia.

Power supply 509 is used to power the various components in terminal 500. The power source 509 may be alternating current, direct current, disposable or rechargeable. When power supply 509 includes a rechargeable battery, the rechargeable battery may be a wired rechargeable battery or a wireless rechargeable battery. The wired rechargeable battery is a battery charged through a wired line, and the wireless rechargeable battery is a battery charged through a wireless coil. The rechargeable battery may also be used to support fast charge technology.

In some embodiments, terminal 500 also includes one or more sensors 510. The one or more sensors 510 include, but are not limited to: acceleration sensor 511, gyro sensor 512, pressure sensor 513, fingerprint sensor 514, optical sensor 515, and proximity sensor 516.

The acceleration sensor 511 may detect the magnitude of acceleration on three coordinate axes of the coordinate system established with the terminal 500. For example, the acceleration sensor 511 may be used to detect components of the gravitational acceleration in three coordinate axes. The processor 501 may control the touch screen 505 to display the user interface in a landscape view or a portrait view according to the gravitational acceleration signal collected by the acceleration sensor 511. The acceleration sensor 511 may also be used for acquisition of motion data of a game or a user.

The gyro sensor 512 may detect a body direction and a rotation angle of the terminal 500, and the gyro sensor 512 may cooperate with the acceleration sensor 511 to acquire a 3D motion of the user on the terminal 500. The processor 501 may implement the following functions according to the data collected by the gyro sensor 512: motion sensing (such as changing the UI according to a user's tilting operation), image stabilization at the time of photographing, game control, and inertial navigation.

The pressure sensor 513 may be disposed on a side bezel of the terminal 500 and/or an underlying layer of the touch display screen 505. When the pressure sensor 513 is disposed on the side frame of the terminal 500, a user's holding signal of the terminal 500 may be detected, and the processor 501 performs left-right hand recognition or shortcut operation according to the holding signal collected by the pressure sensor 513. When the pressure sensor 513 is disposed at the lower layer of the touch display screen 505, the processor 501 controls the operability control on the UI interface according to the pressure operation of the user on the touch display screen 505. The operability control comprises at least one of a button control, a scroll bar control, an icon control and a menu control.

The fingerprint sensor 514 is used for collecting a fingerprint of the user, and the processor 501 identifies the identity of the user according to the fingerprint collected by the fingerprint sensor 514, or the fingerprint sensor 514 identifies the identity of the user according to the collected fingerprint. Upon recognizing that the user's identity is a trusted identity, the processor 501 authorizes the user to perform relevant sensitive operations including unlocking the screen, viewing encrypted information, downloading software, paying, and changing settings, etc. The fingerprint sensor 514 may be provided on the front, back, or side of the terminal 500. When a physical button or a vendor Logo is provided on the terminal 500, the fingerprint sensor 514 may be integrated with the physical button or the vendor Logo.

The optical sensor 515 is used to collect the ambient light intensity. In one embodiment, the processor 501 may control the display brightness of the touch display screen 505 based on the ambient light intensity collected by the optical sensor 515. Specifically, when the ambient light intensity is high, the display brightness of the touch display screen 505 is increased; when the ambient light intensity is low, the display brightness of the touch display screen 505 is turned down. In another embodiment, processor 501 may also dynamically adjust the shooting parameters of camera head assembly 506 based on the ambient light intensity collected by optical sensor 515.

A proximity sensor 516, also referred to as a distance sensor, is typically disposed on the front panel of the terminal 500. The proximity sensor 516 is used to collect the distance between the user and the front surface of the terminal 500. In one embodiment, when the proximity sensor 516 detects that the distance between the user and the front surface of the terminal 500 gradually decreases, the processor 501 controls the touch display screen 505 to switch from the bright screen state to the dark screen state; when the proximity sensor 516 detects that the distance between the user and the front surface of the terminal 500 becomes gradually larger, the processor 501 controls the touch display screen 505 to switch from the screen-rest state to the screen-on state.

Those skilled in the art will appreciate that the configuration shown in fig. 5 is not intended to be limiting of terminal 500 and may include more or fewer components than those shown, or some components may be combined, or a different arrangement of components may be used.

The embodiment of the present application further provides a non-transitory computer-readable storage medium, and when an instruction in the storage medium is executed by a processor of a mobile terminal, the mobile terminal is enabled to execute the live video stream push method provided in the foregoing embodiment.

The embodiment of the present application further provides a computer program product containing instructions, which when run on a computer, causes the computer to execute the push method for live video stream provided by the above illustrated embodiment.

It will be understood by those skilled in the art that all or part of the steps for implementing the above embodiments may be implemented by hardware, or may be implemented by a program instructing relevant hardware, where the program may be stored in a computer-readable storage medium, and the above-mentioned storage medium may be a read-only memory, a magnetic disk or an optical disk, etc.

The above description is only exemplary of the present application and should not be taken as limiting the present application, as any modification, equivalent replacement, or improvement made within the spirit and principle of the present application should be included in the protection scope of the present application.

Claims

1. A method for pushing a live video stream, the method comprising:

2. The method of claim 1, wherein said counting successive stuck reduction number values comprises:

3. The method of claim 2, wherein the transmission performance indicator comprises a video encoding rate and/or a video frame loss rate.

4. The method of claim 1, wherein after initiating the continuous single-screen streaming mode, further comprising:

or,

5. The method as claimed in claim 4, wherein before determining that the push status of the live video stream satisfies the push condition of the two-screen stream when the number of times of the single-screen steady push and/or the number of times of the single-screen temporary push reaches a first time threshold, the method further includes:

6. The method as claimed in claim 1, wherein before counting the continuous katton reduction level values during the push of the live video stream, the method further comprises:

7. A push device for live video streaming, the device comprising:

8. The apparatus of claim 7, wherein the statistics module is to:

9. The apparatus of claim 8, wherein the transmission performance indicator comprises a video encoding rate and/or a video frame loss rate.

10. The apparatus of claim 7, wherein the statistics module is further to:

or,

11. The apparatus of claim 10, wherein the statistics module is further to:

12. The apparatus of claim 7, wherein the statistics module is further to:

13. An electronic device, comprising:

a processor;

a memory for storing processor-executable instructions;

wherein the processor is configured to implement the steps of any of the methods of claims 1-6.

14. A computer-readable storage medium having instructions stored thereon, wherein the instructions, when executed by a processor, implement the steps of any of the methods of claims 1-6.