WO2015058590A1

WO2015058590A1 - Control method, device and system for live broadcast of video, and storage medium

Info

Publication number: WO2015058590A1
Application number: PCT/CN2014/086055
Authority: WO
Inventors: 胡兴华
Original assignee: 腾讯科技（深圳）有限公司
Priority date: 2013-10-21
Filing date: 2014-09-05
Publication date: 2015-04-30
Also published as: CN103533387A; CN103533387B

Abstract

Disclosed are a control method, device and system of the live broadcast of a video, and a storage medium. The method comprises: a video server forwarding a video frame from a main broadcast device to a user equipment; the video server monitoring whether a key frame loss occurs in the video frame; and if it is monitored that a key frame loss occurs, the video server sending notification information to the main broadcast device, so that the main broadcast device sends a new key frame. The video server detects whether a key frame loss occurs, then the video server notifies the main broadcast device of the lost key frame, and the main broadcast device sends a new key frame, so that the main broadcast device can upload the new key frame in time, thereby eliminating the phenomena that pictures cannot be displayed and a screen is blurred due to the fact that a key frame is lost. Since it is not necessary to increase the frequency of the occurrence of the key frame, the data transmission amount can be reduced, so that bandwidth requirements are reduced and a network is made to be more smooth.

Description

The invention relates to a video live broadcast control method, device and system and storage medium. The patent application is filed on October 21, 2013, and the application number is 201310495767.1, the applicant is Tencent Technology (Shenzhen) Co., Ltd., and the invention name is "a video." The priority of the Chinese patent application of the method, the device and the system of the present disclosure is incorporated herein by reference.

The present invention relates to the field of computer technologies, and in particular, to a video live broadcast control method, device, system, and storage medium. Background technique

A frame is a single image of the smallest unit in a video or animation, equivalent to each shot on a film.

The key frame is a complete reservation of one frame. When decoding, only the frame data is needed to complete the display of one picture, which can generally refer to I frame. The frame between two key frames is a non-key frame, which may be generally referred to as a transition frame or an intermediate frame. The frame in which the prediction frame records the prediction information is also called a prediction frame, and the prediction information recorded according to the prediction frame may be in the decoding process. The image is obtained by combining key frame decoding, and the transition frame generally refers to a P frame, a B frame, and the like.

A key frame generally refers to an I frame, which records information of an entire image. Therefore, a frame I picture takes a much larger space than a predicted frame P frame and a bidirectionally predicted frame B frame, especially when the video dynamic is not large. Next, the volume of an I picture will be more than 10 times the volume of a P picture or a B picture. In all video frames, the number of normal P frames is the most, and the number is much larger than the other two frames. However, the overall space occupied by the P frame is not the most, so excessive use of the I frame will reduce the compression efficiency, and the file will become larger or the resolution will decrease. The key frame is used in the video position of the scene switching to maximize its value. If it is used in the video position of non-scene switching, it not only wastes space, but also affects the overall quality of the video. When using the specified bit rate, excessive use of I Frames can cause the overall quality of the video to drop.

The current live broadcast service provides video coding from the anchor device to the video server, and the video server distributes the video code to each user device. The video encoding typically has a keyframe around 10 seconds. During the video encoding propagation from the anchor device to the video server, once the key frame data is lost, the intermediate transition frame cannot be displayed, so it is necessary to wait until 10 seconds later to receive a complete key frame before the normal decoding occurs. Picture. In order to solve the problem that the picture cannot be displayed due to the loss of key frames, or the phenomenon of displaying the screen, the current solution to this problem is to increase the frequency of occurrence of key frames, for example: Adjusting to a key frame occurs in 2-3 seconds. Thus, when the key frame data is lost, the time of its impact is reduced from 10 seconds to 2-3 seconds.

Based on the foregoing, due to the large amount of key frame data, the above scheme improves the frequency of occurrence of key frames (ie, shortening the spacing of key frames), which greatly increases the bit rate of the video, which imposes extremely high requirements on the bandwidth, even Causing network congestion. Summary of the invention

The embodiment of the invention provides a video live broadcast control method, device, system and storage medium, which are used for eliminating the phenomenon that the picture cannot be displayed and the screen is caused by the loss of the key frame, and the data transmission amount is reduced, the bandwidth requirement is reduced, and the network is made. More fluid.

In a first aspect, an embodiment of the present invention provides a video live broadcast control method, including:

The video server forwards the video frame of the autonomous device to the user equipment, where the video frame includes key frames and non-key frames;

The video server monitors whether a key frame loss occurs in the video frame;

If the video server detects that a key frame is lost, the notification message is sent to the anchor device, so that the anchor device sends a new key frame.

In a second aspect, the embodiment of the present invention further provides a video live broadcast control method, including: receiving, by a user equipment, a video frame from an anchor device that is forwarded by a video server, where the video frame packet includes a key frame and a non-key frame;

If the user equipment receives a new key frame from the anchor device forwarded by the video server when decoding the current video frame is unsuccessful, discarding the unsuccessfully decoded video frame, and receiving the new Non-keyframes of keyframes;

The user equipment decodes the received new key frame and its non-key frame, and displays the decoded video picture. In a third aspect, the embodiment of the present invention further provides a video live broadcast control method, including: the anchor device collects video data that needs to be broadcasted in real time into a video frame, and sends a video frame to the user equipment through the video server, where the video frame Contains keyframes and non-keyframes;

And if the anchor device receives the notification information, the anchor device sends a new key frame to the user equipment by using the video server.

In a fourth aspect, the embodiment of the present invention further provides a video server, including:

a forwarding control unit, configured to control a video frame of the future autonomous device to be forwarded to the user equipment, where the video frame includes a key frame and a non-key frame;

a frame loss monitoring unit, configured to monitor whether a key frame is lost in the video frame;

The information sending unit is configured to: if the frame loss monitoring unit detects that a key frame is lost, send the notification information to the anchor device, so that the anchor device sends a new key frame.

In a fifth aspect, the embodiment of the present invention further provides a user equipment, including:

a video receiving unit, configured to receive a video frame from the anchor device forwarded by the video server, where the video frame includes a key frame and a non-key frame; receive a video frame after the re-encoded key frame; and a frame determining unit, configured to determine Whether a new key frame from the anchor device forwarded by the video server is received when the current video frame decoding is unsuccessful;

a frame loss control unit, configured to discard the unsuccessfully decoded video frame if a new key frame from the anchor device forwarded by the video server is received when the current video frame is unsuccessfully decoded; the video a receiving unit, configured to receive a non-key frame of the new key frame;

a decoding unit, configured to decode the received new key frame and its non-key frame;

a display unit, configured to display a video picture decoded by the decoding unit.

In a sixth aspect, the embodiment of the present invention further provides an anchor device, including:

a data collection unit, configured to collect video data that needs to be broadcasted at present;

a coding unit, configured to encode video data collected by the data collection unit into a video frame, where the video frame includes a key frame and a non-key frame;

a sending unit, configured to send, by using a video server, a video frame obtained by encoding the coding unit to a user equipment;

An information receiving unit, configured to receive notification information of a lost key frame; The sending unit is further configured to: if the information receiving unit receives the notification information, send a new key frame to the user equipment by using the video server.

In a seventh aspect, the embodiment of the present invention further provides a video live broadcast system, including: an anchor device, a user device, and a video server;

The anchor device is the anchor device of any one of the embodiments of the present invention, and the video server is any one of the video servers provided by the embodiment of the present invention. User equipment.

In a seventh aspect, the embodiment of the present invention further provides a storage medium including computer executable instructions, where the computer executable instructions are executed by a computer processor to execute a video live broadcast control method, the method comprising:

The video server monitors whether a key frame loss occurs in the video frame;

In an eighth aspect, the embodiment of the present invention further provides a storage medium including computer executable instructions, where the computer executable instructions are executed by a computer processor to execute a video live broadcast control method, the method comprising:

The user equipment receives a video frame from the anchor device forwarded by the video server, the video frame packet containing key frames and non-key frames;

The user equipment decodes the received new key frame and its non-key frame, and displays the decoded video picture.

In a ninth aspect, the embodiment of the present invention further provides a storage medium including computer executable instructions, where the computer executable instructions are executed by a computer processor to perform a video live broadcast control method, the method comprising: The anchor device collects the video data that needs to be broadcasted as a video frame, and sends a video frame to the user equipment through the video server, where the video frame includes a key frame and a non-key frame;

If the anchor device receives the notification information, the anchor device transmits a new key frame to the video server.

As can be seen from the above technical solutions, the embodiment of the present invention has the following advantages: The video server detects whether a key frame is lost, and then the video server notifies the anchor device that the key frame is lost, and the new key frame is sent by the anchor device, so that The anchor device uploads new key frames in time to eliminate the inability to display and bloom the screen caused by the loss of key frames. Since it is not necessary to increase the frequency of occurrence of key frames, the amount of data transmission can be reduced, thereby reducing bandwidth requirements and making the network more fluid. DRAWINGS

In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the following drawings will be briefly described in the description of the embodiments, and it is obvious that the drawings in the following description are only some embodiments of the present invention, Those skilled in the art can also obtain other drawings based on these drawings without paying creative labor.

1 is a schematic flowchart of a method according to an embodiment of the present invention;

2 is a schematic flowchart of a method according to an embodiment of the present invention;

3 is a schematic flowchart of a method according to an embodiment of the present invention;

4 is a schematic structural diagram of a video server according to an embodiment of the present invention;

FIG. 5 is a schematic structural diagram of a video server according to an embodiment of the present invention;

6 is a schematic structural diagram of a user equipment according to an embodiment of the present invention;

7 is a schematic structural diagram of an anchor device according to an embodiment of the present invention;

8 is a schematic structural diagram of an anchor device according to an embodiment of the present invention;

9 is a schematic structural diagram of a video server according to an embodiment of the present invention;

FIG. 10 is a schematic structural diagram of a user equipment according to an embodiment of the present invention;

11 is a schematic structural diagram of an anchor device according to an embodiment of the present invention;

12 is a schematic structural diagram of a system according to an embodiment of the present invention;

FIG. 13 is a schematic flowchart of a method according to an embodiment of the present invention; FIG. 14 is a schematic structural diagram of a terminal according to an embodiment of the present invention.

detailed description

The present invention will be further described in detail with reference to the accompanying drawings, in which FIG. . All other embodiments obtained by a person of ordinary skill in the art based on the embodiments of the present invention without creative efforts are within the scope of the present invention.

The video live broadcast control method provided by the embodiment of the present invention can be applied to a live video broadcast system. The architecture of the system can be as shown in FIG. 12, including an anchor device, a video server, and a user equipment. The anchor device is configured to provide a live video encoding to the video server, and the video server distributes the video encoding to one or more user equipments for live video broadcast. The number of the anchor devices may be one or more, and multiple anchor devices may perform live video broadcast to the user equipment through the video server.

The embodiment of the present invention provides a video live broadcast control method, which is specifically implemented by a video server of a live video system. As shown in FIG. 1, the method includes:

101: The video server forwards the video frame of the autonomous device to the user equipment, where the video frame packet includes a key frame and a non-key frame;

102: The video server monitors whether a key frame loss occurs in the above video frame;

Further, since the non-key frame associated with the key frame records the prediction information with reference to the key frame, if a key frame loss occurs, the non-key frame associated with it loses meaning, in order to reduce The necessary data transmission, and the video display error that may be caused by the embodiment of the present invention provide the following solutions: The foregoing method further includes: if the video server receives the non-key frame associated with the lost key frame, discarding the above and losing Keyframes associated with non-keyframes.

Assume that the received frame is as shown in Table 1:

Table 1

Frame number frame type

1 I

11 P

12 P 13 P

14 P

2 I

21 P

22 P The I frame with sequence numbers 1 and 2 above is the key frame, and the P frames with the sequence numbers 11-14 and 21-22 are non-key frames. If the I frame with sequence number 2 is lost, then the sequence number is 21 -22 P frames are discarded.

103: If the video server detects that a key frame is lost, sending a notification message to the anchor device to notify the anchor device of the missing key frame, so that the anchor device sends the re-encoded key frame.

The re-encoded key frame may be a key frame encoded by the anchor device according to the current live data when the notification information is received, and the lost key frame is not re-encoded.

In actual operation, if the video server detects that a key frame is lost, the notification information is sent to the anchor device, so that the anchor device sends a new key frame.

The new key frame may be re-encoded, or may be a new key frame that has been encoded but not sent, and can indicate that the anchor device starts the next new key frame and its non-key frame when it learns that the lost key frame is lost. Send it. For key frames that have been lost, there is no need to send their associated unsent non-critical frames.

The video server may send the notification information to the anchor device, so that the operation of the anchor device to send a new key frame may be implemented in multiple manners. In addition to the implementation manner of step 103 in the foregoing embodiment, the following manner may be adopted. :

The operation mode may be: if the video server detects that a key frame is lost, sending a notification message to the anchor device, so that the anchor device recodes the current video data into a key frame and a non-key frame, to the video. The server sends.

In this mode of operation, the video server only needs to inform the anchor device that a key frame is lost, and it is not necessary to specifically inform which key frame is lost. After the anchor device receives this information, it is from the current live broadcast. The video data begins to be re-encoded and sent.

The operation mode of the other party may be: if the video server detects that a key frame is lost, sending a notification message to the anchor device to notify the anchor device of the missing key frame, so that the anchor device selects the loss from the cache. The next key frame and non-key frame of the key frame are sent to the video server.

In the operation mode, the active video may be encoded in multiple frames, including multiple key frames and non-key frames in the sequence, and then encoded in the anchor device and then sequentially sent. At this time, the video server specifically informs the anchor device which key frame is lost, and the anchor device searches the cache for the next key frame that has been encoded after the lost key frame, and if so, starts transmitting from the next key frame. Instead of sending non-key frames that are missing keyframes.

In the above embodiment, the video server detects whether a key frame is lost, and then the video server notifies the anchor device of the lost key frame, and the anchor device sends a new key frame, so that the anchor device can upload a new key frame in time, and eliminate the key frame. The picture caused by the loss cannot be displayed and the screen is displayed. Since the frequency of key frames does not have to be increased, the amount of data transmission can be reduced, thereby reducing the bandwidth requirements and making the network more fluid.

The embodiment of the present invention further provides another video live broadcast control method, which is performed by a user equipment in a live video system, and includes the following:

In this embodiment, the user equipment generally receives video frames including key frames and non-key frames in sequence, and decodes the key frames and their associated non-key frames, and performs video image display after decoding. When a key frame is lost, it is obvious that the user equipment cannot successfully decode even if it receives the non-key frame of the key frame. If a new key frame is received when the current video frame decoding is unsuccessful, it can be considered that there is a key frame loss. Phenomenon. For the discarding operation of the unsuccessfully decoded video frame, and the operation of accepting the non-keyframe of the new key frame, the two operations are not limited in sequence, preferably the receiving operation is performed first, and then the new key frame and its non-key After the frame can be successfully decoded, the unsuccessfully decoded video frame is further discarded, which ensures that the newly received video frame can be successfully decoded.

The operation performed after receiving the new key frame is preferably used in the following manner. As shown in FIG. 2, the method may include:

201: The user equipment receives a video frame from the anchor device forwarded by the video server, where the video frame includes a key frame and a non-key frame;

202: If the user equipment receives the re-encoded key frame from the anchor device forwarded by the video server, the user equipment determines the position of the re-encoded key frame in the video frame, and after the location Video frame data is discarded, and the video frame after the above-mentioned re-encoded key frame is received;

In the above operation, the re-encoded key frame, that is, the new key frame re-transmitted by the anchor device after the occurrence of the key frame loss. When the user equipment receives this new key frame, the new key frame is found in the video frame instead of the position corresponding to the lost key frame, which is actually the position of the lost key frame. Due to the loss of the original key frame, the non-key frame of the lost key frame can no longer be successfully decoded, so the video frame data after the above position can be discarded.

203: Decode the received video frame and display the decoded video picture.

In the above embodiment, the video server forwards a new key frame to compensate for the lost key frame, and eliminates the phenomenon that the picture cannot be displayed and the screen is lost due to the loss of the key frame during the live broadcast of the video. Since there is no need to increase the frequency of occurrence of key frames, the amount of data transmission can be reduced, thereby reducing the bandwidth requirements and making the network more fluid.

In the above embodiment, if no new key frame is received, only two steps 201 and 203 are performed. If a new key frame is received, it may be determined that there is a key frame loss, since the Missing keyframe-related non-keyframes, and non-keyframes record prediction information that is referenced to keyframes, so keyframe loss can cause non-keyframes associated with it to lose meaning, in order to reduce unnecessary decoding operations. And the video display error that may be caused, the embodiment of the present invention provides the following solution: Further, if the user equipment receives the forwarding by the video server Recoded keyframes from the anchor device, including:

The user equipment described above stops the decoding operation of all of the video frames after the re-encoded key frame is in the video frame.

Typically, the user equipment stores the received video frames, for example, in memory. Then, the required video frame is extracted from the memory for decoding operation. Therefore, received video frames and decoded video frames may be stored in different locations in the memory. After discarding a portion of the video frames based on the foregoing scheme, these video frames may still have been called for decoding, so it is preferable to further stop the current decoding operation on the video frames, and re-decode from the re-encoded key frames and their non-key frames.

The embodiment of the present invention further provides another video live broadcast control method, which is performed by an anchor device in a live video system, and the method includes the following:

The anchor device collects video data that needs to be broadcasted in real time into a video frame, and sends a video frame to the user equipment through the video server, where the video frame includes a key frame and a non-key frame;

As mentioned earlier, there are many ways in which an anchor device can receive notification information and send new key frames. Wherein, as shown in FIG. 3, the method includes:

301: The anchor device collects video data that needs to be broadcasted as a video frame, and sends a video frame to the user equipment by using a video server, where the video frame includes a key frame and a non-key frame.

302: If the anchor device receives the notification information, the notification information indicates the lost key frame; then, the anchor device re-encodes the key frame, and sends the re-encoded key frame to the user equipment by using the video server.

Of course, if the anchor device receives the notification information, the anchor device may send another new key frame to the user equipment by using the video server.

Another mode of operation is: if the anchor device receives the notification information, the anchor device re-encodes the current video data into a key frame and a non-key frame, and sends the message to the user equipment through the video server.

In this operation mode, when the anchor device learns that a key frame is lost, the current live video is re-encoded and then sent. A further mode of operation is: if the anchor device receives the notification information indicating the lost key frame, the anchor device selects the next key frame and the non-key frame of the lost key frame from the cache, and Sended to the user equipment by the video server.

In this mode of operation, the anchor device learns that a key frame is lost, and knows which key frame is lost. In the cache, it searches for the next key frame that has been encoded and not transmitted, and starts transmitting from the next key frame.

In the above embodiment, the video server detects whether a key frame is lost, and then the video server notifies the anchor device of the lost key frame, and the anchor device re-encodes the key frame, so that the anchor device can upload a new key frame in time to eliminate the key frame loss. The resulting picture cannot be displayed and the screen is displayed. Since the frequency of key frames does not have to be increased, the amount of data transmission can be reduced, thereby reducing the bandwidth requirements and making the network more fluid.

In the above embodiment, if the notification information is not received, only 301 is needed. If the notification information is received, it may be determined that there is a key frame loss, because the lost key frame may have been completed. Non-keyframe encoding, and non-keyframe recording is based on keyframe prediction information, so keyframe loss will cause the non-keyframe associated with it to lose meaning, in order to reduce the user equipment side (decoding end) The present invention provides the following solutions: The foregoing method further includes: the foregoing anchor device discards the already associated with the lost key frame, and the foregoing decoding method is provided. Non-keyframes that are encoded and not sent to the video server above.

The embodiment of the present invention further provides a video server, as shown in FIG. 4, including:

a forwarding control unit 401, configured to control a video frame of the future autonomous device to be forwarded to the user equipment, where the video frame includes a key frame and a non-key frame;

The frame loss monitoring unit 402 is configured to monitor whether a key frame is lost in the video frame.

The information sending unit 403 is configured to: if the frame loss monitoring unit 402 detects that a key frame is lost, send the notification information to the anchor device, so that the anchor device sends a new key frame.

The information sending unit 403 is specifically configured to: if the frame loss monitoring unit detects that a key frame is lost, send the notification information to the anchor device, and notify the anchor device of the lost key frame, so that the anchor device sends the re-encoded Keyframe. The re-encoded key frame may be a key frame encoded by the anchor device according to the current live data when the notification information is received, and the lost key frame is not re-encoded.

Or the information sending unit 403 is specifically configured to: if the frame loss monitoring unit detects that a key frame is lost, send the notification information to the anchor device, so that the anchor device recodes the current video data into a key frame. And non-key frames, sent to the video server.

Or the information sending unit 403 is specifically configured to: if the frame loss monitoring unit detects that a key frame is lost, send the notification information to the anchor device to notify the anchor device of the lost key frame, so that the The anchor device selects the next key frame and the non-key frame of the lost key frame from the cache and transmits to the video server.

Further, since the non-key frame associated with the key frame records the prediction information with reference to the key frame, if a key frame loss occurs, the non-key frame associated with it loses meaning, in order to reduce The video server of the present invention provides the following solution. The video server further includes: a control frame dropping unit 501, if received, as shown in FIG. The non-keyframe associated with the lost keyframe discards the non-keyframe associated with the missing keyframe as described above.

An embodiment of the present invention further provides a user equipment, as shown in FIG. 6, including:

a video receiving unit 601, configured to receive a video frame from an anchor device that is forwarded by a video server, where the video frame includes a key frame and a non-key frame;

a frame determining unit 602, configured to determine whether a new key frame from the anchor device forwarded by the video server is received when the current video frame is unsuccessfully decoded;

a frame loss control unit 603, configured to discard the unsuccessfully decoded video frame if a new key frame from the anchor device forwarded by the video server is received when the current video frame is unsuccessfully decoded; The video receiving unit 601 is further configured to receive the non-key frame of the new key frame, and the decoding unit 604 is configured to decode the received new key frame and its non-key frame;

The display unit 605 is configured to display the video picture decoded by the decoding unit 604.

Specifically, the video receiving unit 601 is specifically configured to receive a video frame after the re-encoded key frame;

The frame determining unit 602 is specifically configured to determine whether the video receiving unit 601 receives the re-encoded key frame from the anchor device forwarded by the video server;

The frame dropping control unit 603 is specifically configured to: if the frame determining unit 602 determines that the video receiving unit receives the re-encoded key frame from the anchor device forwarded by the video server, the user equipment determines the re-encoded key frame. Position in the video frame, and discard the video frame data after the above position;

In the above embodiment, the key frame of the re-encoded code is forwarded by the video server to compensate the lost key frame, and the picture cannot be displayed and the screen is lost due to the loss of the key frame during the live broadcast of the video. Since it is not necessary to increase the frequency of occurrence of key frames, the amount of data transmission can be reduced, thereby reducing the bandwidth requirements and making the network more fluid.

In the above embodiment, if the re-encoded key frame is received, it may be determined that there is a key frame loss condition, since the non-key frame associated with the lost key frame may have been received, and the non-key frame record is the key The frame is the referenced prediction information, so the key frame loss may cause the non-key frame associated with it to be meaningless. In order to reduce the unnecessary decoding operation and the video display error that may be caused, the embodiment of the present invention provides the following solutions: Further, the decoding unit 604 is further configured to: if the user equipment receives the re-encoded key frame from the anchor device forwarded by the video server, stop all the re-encoded key frames in the video frame The decoding operation of the video frame.

An embodiment of the present invention further provides an anchor device, as shown in FIG. 7, including:

a data collection unit 701, configured to collect video data that needs to be broadcasted at present;

The encoding unit 702 is configured to encode the video data collected by the data collection unit into a video frame, where the video frame includes a key frame and a non-key frame;

a sending unit 703, configured to send, by using a video server, the coding unit to send to the user equipment Video frame to;

The information receiving unit 704 is configured to receive notification information of a key frame loss.

The sending unit 703 is further configured to: if the information receiving unit 704 receives the notification information, send a new key frame to the user equipment by using the video server.

There are several specific implementations of each unit:

An implementation manner is: the coding unit 702 may be specifically configured to: if the foregoing anchor device receives the notification information, re-encode the key frame;

The sending unit 703 is specifically configured to send, by using the video server, the video frame encoded by the coding unit to the user equipment, and send the re-encoded key frame to the user equipment by using the video server;

The information receiving unit 704 is specifically configured to receive the notification information, where the notification information indicates the lost key frame.

Another implementation manner is: the coding unit 702 is specifically configured to re-encode the current video data into a key frame and a non-key frame if the notification information is received;

The sending unit 703 is specifically configured to send the key frame and the non-key frame re-encoded by the coding unit to the user equipment by using the video server.

A further implementation manner is: the sending unit 703 is specifically configured to: if receiving the notification information indicating the lost key frame, select the next key frame and the non-key frame of the lost key frame from the cache, And sending to the user equipment through the video server.

In the above embodiment, if the notification information is received, it may be determined that there is a case where the key frame is lost, since the encoding of the non-key frame related to the lost key frame may have been completed, and the non-key frame is recorded with the key frame. For the reference information, the loss of key frames will cause the non-key frames associated with them to lose meaning, in order to reduce unnecessary decoding operations, unnecessary data transmission, and possible video on the user equipment side (decoding side). The display of the error is provided by the embodiment of the present invention. Solution: Further, as shown in FIG. 8, the foregoing anchor device further includes:

A frame loss unit 801 is configured to discard non-key frames that have been encoded and are not sent to the video server associated with the lost key frame.

The embodiment of the present invention further provides another video server, as shown in FIG. 9, comprising: a receiver 901, a transmitter 902, a processor 903, and a memory 904;

The processor 903 is configured to control the video server to forward the video frame of the autonomous device to the user equipment, where the video frame includes a key frame and a non-key frame; monitoring whether the key frame is lost in the video frame; If the frame is lost, the control sends a notification message to the anchor device to enable the anchor device to send a new key frame.

Specifically, if the key frame loss is detected, the notification information is sent to the anchor device, and the key frame lost by the anchor device is notified, so that the anchor device sends the re-encoded key frame.

Or, specifically, if a key frame loss is detected, the notification information is sent to the anchor device, so that the anchor device re-encodes the current video data into a key frame and a non-key frame, and sends the message to the video server.

Or, if a key frame loss is detected, sending a notification message to the anchor device to notify the anchor device of the missing key frame, so that the anchor device selects the next one of the lost key frames from the cache. Key frames and non-key frames are sent to the video server.

Further, since the non-key frame associated with the key frame records the prediction information with reference to the key frame, if a key frame loss occurs, the non-key frame associated with it loses meaning, in order to reduce The necessary data transmission, and the video display error that may be caused, the embodiment of the present invention provides the following solution: Further, the processor 903 is further configured to receive and lose key frames if The associated non-keyframes discard the non-keyframes associated with the missing keyframes described above. An embodiment of the present invention further provides another user equipment, as shown in FIG. 10, including: a receiver 1001, a transmitter 1002, a processor 1003, and a memory 1004.

The processor 1003 is configured to control, by the user equipment, the video frame from the anchor device that is forwarded by the video server, where the video frame includes a key frame and a non-key frame; if the video frame is unsuccessfully decoded, the a new key frame forwarded by the video server from the anchor device, discarding the unsuccessfully decoded video frame, and receiving the non-key frame of the new key frame; decoding the received new key frame and Non-keyframe, and display the decoded video picture.

Specifically, if the user equipment receives the re-encoded key frame from the anchor device forwarded by the video server, determining a position of the re-encoded key frame in the video frame, and setting the video frame data after the location Discarding, and receiving the video frame after the above-mentioned re-encoded key frame; decoding the received video frame, and controlling display of the decoded video picture.

In the above embodiment, if the re-encoded key frame is received, it may be determined that there is a key frame loss condition, since the non-key frame associated with the lost key frame may have been received, and the non-key frame record is the key The frame is the referenced prediction information, so the key frame loss may cause the non-key frame associated with it to be meaningless. In order to reduce the unnecessary decoding operation and the video display error that may be caused, the embodiment of the present invention provides the following solutions: Further, the processor 1003 is further configured to: if the user equipment receives the re-encoded key frame from the anchor device forwarded by the video server, stop all the re-encoded key frames in the video frame The decoding operation of the video frame.

The embodiment of the present invention further provides another anchor device, as shown in FIG. 11, comprising: a receiver 1101, a transmitter 1102, a processor 1103, and a memory 1104;

The processor 1103 is configured to control, to collect, video data that is currently required to be broadcasted into a video frame, and send a video frame to the user equipment by using the video server, where the video frame includes a key frame and a non-key a frame; if the anchor device receives the notification information, the anchor device sends a new key frame to the user equipment through the video server.

Specifically, if the anchor device receives the notification information, the notification information indicates the lost key frame; then, the anchor device re-encodes the key frame, and sends the re-encoded key frame to the user equipment through the video server.

Alternatively, if the anchor device receives the notification information, the anchor device re-encodes the current video data into a key frame and a non-key frame, and sends the message to the user equipment by using the video server.

Or, if the anchor device receives the notification information indicating the lost key frame, the anchor device selects the next key frame and the non-key frame of the lost key frame from the cache, and passes the The video server sends to the user equipment.

In the above embodiment, if the notification information is received, it may be determined that there is a case where the key frame is lost, since the encoding of the non-key frame related to the lost key frame may have been completed, and the non-key frame is recorded with the key frame. For the reference information, the loss of key frames will cause the non-key frames associated with them to lose meaning, in order to reduce unnecessary decoding operations, unnecessary data transmission, and possible video on the user equipment side (decoding side). In the embodiment of the present invention, the following solutions are provided: Further, the processor 1103 is further configured to discard a non-key frame that has been encoded and is not sent to the video server that is associated with the lost key frame.

The embodiment of the present invention further provides a video live broadcast system, as shown in FIG. 12, including: an anchor device 1201, a user device 1202, and a video server 1203;

The anchor device 1201 is an anchor device according to any one of the embodiments of the present invention. The video server 1203 is a video server according to any one of the embodiments of the present invention. User equipment.

The embodiment of the invention is a compensation scheme based on uplink key frame data in the live broadcast process of the anchor device. When the video server finds that the uplink key frame data is lost during the live broadcast of the anchor device, the information is fed back to the client of the anchor device, and the anchor device notifies the client encoding module to stop encoding the non-key frame, and restarts encoding a key frame or the next one. After the key frame is sent, the client of the user equipment can decode and display the normal video picture after receiving the complete key frame. Referring to FIG. 13 , the specific process of a preferred example is as follows:

1 301: The anchor device collects live data, encodes the video frame and sends it to the video server, and the video server forwards the video frame to the user equipment. In this step, the video frame contains key frames as well as non-critical frames.

1 302: The video server finds that the broadcast device's live uplink key frame data is lost, and the information is sent back to the client of the anchor device to indicate which key frame the lost key frame is.

1 303: The client of the anchor device notifies the client encoding module to stop the encoding of the non-keyframe and restarts encoding a key frame.

1 304: The client of the anchor device discards all non-keyframe data associated with the lost keyframe that has not been uploaded.

1 305: The client of the anchor device uploads the instant recoded key frame data to the video server, and sends the re-encoded key frame data to the user equipment through the video server.

1 306: The client of the user equipment stops decoding and discards all video frames (since the previously correctly decoded data has been displayed, the subsequent data should start with the re-encoded key frame, so all video frames can be discarded) until the steps are received. The key frame of 1 305 is then re-decoded to display the normal video picture.

In the above embodiment, when the anchor device loses packets in the uplink, it can restore the normal video frame in a short time, and there is no long-term pause. Since only the key frame data is lost, the key frame is encoded immediately, and the code rate does not rise and the network is congested.

The embodiment of the present invention further provides a storage medium including computer executable instructions for executing a video live broadcast control method when executed by a computer processor, the method comprising:

The video server monitors whether a key frame loss occurs in the video frame; If the video server detects that a key frame is lost, the notification message is sent to the anchor device, so that the anchor device sends a new key frame.

The video live broadcast control method performed by the storage medium of each computer executable instruction can further perform the video live broadcast control method provided by the embodiment of the present invention.

The embodiment of the present invention further provides a terminal device. As shown in FIG. 14 , for the convenience of description, only parts related to the embodiment of the present invention are shown. For details that are not disclosed, refer to the method part of the embodiment of the present invention. . The terminal may be any mobile device, a tablet computer, a PDA (Personal Data Center), a POS (Point of Sa les, a sales terminal), an in-vehicle computer, or the like, and the terminal is a mobile phone. example:

FIG. 14 is a block diagram showing a partial structure of a mobile phone related to a terminal provided by an embodiment of the present invention. Referring to FIG. 14, the mobile phone includes: a radio frequency (RF) circuit 1410, a memory 1420, The input unit 1430, the display unit 1440, the sensor 1450, the audio circuit 1460, the wireless fidelity (WiFi) module 1470, the processor 1480, and the power supply 1490 and the like. It will be understood by those skilled in the art that the structure of the handset shown in FIG. 14 does not constitute a limitation to the handset, and may include more or less components than those illustrated, or some components may be combined, or different components may be arranged.

The following describes the components of the mobile phone in detail with reference to FIG. 14:

The RF circuit 1410 can be used for receiving and transmitting signals during and after receiving or transmitting information, and in particular, after receiving the downlink information of the base station, it is processed by the processor 1480; in addition, the uplink data is designed to be sent to the base station. Generally, RF circuits include, but are not limited to, an antenna, at least one amplifier, a transceiver, a coupler, a Low Noise Amplifier (LNA), a duplexer, and the like. In addition, RF circuitry 140 can also communicate with the network and other devices via wireless communication. The above wireless communication may use any communication standard or protocol, including but not limited to Global System of Mobile communication (GSM), General Packet Radio Service (GPRS), and code division multiple access ( Code Division Multiple Access (CDMA), Wideband Code Division Multiple Access (WCDMA) > Long Term Evolution (LTE), e-mail, Short Messaging Service (SMS), etc.

The memory 1420 can be used to store software programs and modules, and the processor 1480 executes various functional applications and data processing of the mobile phone by running software programs and modules stored in the memory 1420. The memory 1420 may mainly include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application required for at least one function (such as a sound playing function, an image playing function, etc.), and the like; the storage data area may be stored according to Data created by the use of the mobile phone (such as audio data, phone book, etc.). In addition, memory 1420 can include high speed random access memory, and can also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid state memory device.

The input unit 1430 can be configured to receive input numeric or character information and to generate key signal inputs related to user settings and function controls of the handset 1400. Specifically, the input unit 1430 may include a touch panel 1431 and other input devices 1432. The touch panel 1431, also referred to as a touch screen, can collect touch operations on or near the user (such as a user using a finger, a stylus, etc. or any suitable object or The attachment is operated on the touch panel 1431 or in the vicinity of the touch panel 1431, and the corresponding connecting device is driven according to a preset program. Optionally, the touch panel 1431 may include two parts: a touch detection device and a touch controller. Wherein, the touch detection device detects the touch orientation of the user, and detects a signal brought by the touch operation, and transmits the signal to the touch controller; the touch controller receives the touch information from the touch detection device, converts the touch information into contact coordinates, and sends the touch information The processor 1480 is provided and can receive commands from the processor 1480 and execute them. In addition, the touch panel 1431 can be implemented in various types such as resistive, capacitive, infrared, and surface acoustic waves. In addition to the touch panel 1431, the input unit 1430 may also include other input devices 1432. Specifically, the other input device 1432 may include, but is not limited to, one or more of a physical keyboard, function keys (such as a volume control button, a switch button, etc.), a trackball, a mouse, a joystick, and the like.

The display unit 1440 can be used to display information input by the user or information provided to the user as well as various menus of the mobile phone. The display unit 1440 may include a display panel 1441. Alternatively, the display panel 1441 may be configured in the form of a liquid crystal display (LCD), an organic light-emitting diode (OLED), or the like. . Further, the touch panel 1431 may cover the display panel 1441. When the touch panel 1431 detects a touch operation thereon or nearby, the touch panel 1431 transmits to the processor 1480 to determine the type of the touch event, and then the processor 1480 according to the touch event. The type provides a corresponding visual output on display panel 1441. Although the touch panel 1431 and the display panel 1441 are used as two independent components to implement the input and input functions of the mobile phone in FIG. 14, in some embodiments, the touch panel 1431 and the display panel 1441 may be integrated. Realize the input and output of the phone

•6匕

3匕.

The handset 1400 can also include at least one type of sensor 1450, such as a light sensor, motion sensor, and other sensors. Specifically, the light sensor may include an ambient light sensor and a proximity sensor, wherein the ambient light sensor may adjust the brightness of the display panel 1441 according to the brightness of the ambient light, and the proximity sensor may close the display panel 1441 and/or when the mobile phone moves to the ear. Or backlight. As a kind of motion sensor, the accelerometer sensor can detect the magnitude of acceleration in all directions (usually three axes). When it is stationary, it can detect the magnitude and direction of gravity. It can be used to identify the gesture of the mobile phone (such as horizontal and vertical screen switching, related Games, magnetometer attitude calibration), vibration recognition related functions (such as pedometer, tapping), etc.; as well as other sensors such as gyroscopes, barometers, hygrometers, thermometers, infrared sensors, etc. An audio circuit 1460, a speaker 1461, and a microphone 1462 can provide an audio interface between the user and the handset. The audio circuit 1460 can transmit the converted electrical data of the received audio data to the speaker 1461 and convert it into a sound signal output by the speaker 1461. On the other hand, the microphone 1462 converts the collected sound signal into an electrical signal, and the audio circuit 1460 After receiving, it is converted into audio data, and then processed by the audio data output processor 1480, transmitted to the other mobile phone via the RF circuit 1410, or outputted to the memory 1420 for further processing.

WiFi is a short-range wireless transmission technology. The mobile phone can help users to send and receive emails, browse web pages and access streaming media through the WiFi module 1470. It provides users with wireless broadband Internet access. Although FIG. 14 shows the WiFi module 1470, it can be understood that it does not belong to the essential configuration of the mobile phone 1400, and may be omitted as needed within the scope of not changing the essence of the invention.

The processor 1480 is the control center of the handset, which connects various portions of the entire handset using various interfaces and lines, by executing or executing software programs and/or modules stored in the memory 1420, and by invoking data stored in the memory 1420, The phone's various functions and processing data, so that the overall monitoring of the phone. Optionally, the processor 1480 may include one or more processing units. Preferably, the processor 1480 may integrate an application processor and a modem processor, where the application processor mainly processes an operating system, a user interface, an application, and the like. The modem processor primarily handles wireless communications. It will be appreciated that the above described modem processor may also not be integrated into the processor 1480.

The handset 1400 also includes a power source 1490 (such as a battery) for powering various components. Preferably, the power source can be logically coupled to the processor 1480 through a power management system to perform functions such as managing charging, discharging, and power management through the power management system.

Although not shown, the mobile phone 1400 may further include a camera, a Bluetooth module, and the like, and details are not described herein. In the embodiment of the present invention, the processor 1480 included in the terminal further has the following functions: if used as a user equipment, the processor 1480 is configured to control the user equipment to receive a video frame from the anchor device forwarded by the video server, where The video frame includes a key frame and a non-key frame; if the user equipment receives a new key frame forwarded by the video server from the anchor device when the current video frame is unsuccessfully decoded, the unsuccessfully decoded Video frame is discarded, and the non-key frame of the new key frame is received; the user equipment decodes the received new key frame and its non-key Frame, and display the decoded video picture.

Specifically, for example, if the user equipment receives the re-encoded key frame from the anchor device forwarded by the video server, determining the position of the re-encoded key frame in the video frame, and setting the video frame after the location The data is discarded, and the video frame after the above-mentioned re-encoded key frame is received; the received video frame is decoded, and the decoded video picture is displayed.

In the above embodiment, if a new key frame is received, it may be determined that there is a loss of the key frame, since the non-key frame related to the lost key frame may have been received, and the non-key frame records the key frame. For the referenced prediction information, therefore, the loss of the key frame may cause the non-key frame associated with it to be meaningless. In order to reduce the unnecessary decoding operation and the video display error that may be caused, the embodiment of the present invention provides the following solution: The processor 1480 is further configured to: if the user equipment receives the re-encoded key frame from the anchor device forwarded by the video server, stop all videos after the re-encoded key frame is located in the video frame. The decoding operation of the frame.

The master device, if used as an anchor device, the processor 1480 is configured to control the video data currently required to be broadcasted into a video frame, and send a video frame to the user equipment through the video server, where the video frame includes a key frame and a non- a key frame; if the anchor device receives the notification information, the anchor device sends a new key frame to the user equipment through the video server.

For example, if the anchor device receives the notification information, the notification information indicates the lost key frame; then, the anchor device re-encodes the key frame, and sends the re-encoded key frame to the user equipment through the video server.

In the above embodiment, the video server detects whether a key frame is lost, and then the video server notifies the anchor device of the lost key frame, and the anchor device sends a new key frame, so that the anchor device can upload a new key frame in time, and eliminate the key frame. The picture caused by the loss cannot be displayed and the screen is displayed. Since it is not necessary to increase the frequency of occurrence of key frames, the amount of data transmission can be reduced, thereby reducing the bandwidth requirement and making the network more smooth. In the above embodiment, if the notification information is received, it may be determined that there is a case where the key frame is lost, since the encoding of the non-key frame related to the lost key frame may have been completed, and the non-key frame is recorded with the key frame. For the reference information, the loss of key frames will cause the non-key frames associated with them to lose meaning, in order to reduce unnecessary decoding operations, unnecessary data transmission, and possible video on the user equipment side (decoding side). In the embodiment of the present invention, the following solutions are provided: Further, the processor 1480 is further configured to discard non-key frames that have been encoded and are not sent to the video server that are associated with the lost key frame.

It can be understood that the terminal device can function as both the anchor device and the user device, and thus the terminal device can also have all the functions of the above processor.

It should be noted that, in the foregoing embodiment of the user equipment, the anchor device, and the video server, each unit included is only divided according to functional logic, but is not limited to the foregoing division, as long as the corresponding function can be implemented; The specific names of the functional units are also only for the purpose of distinguishing between the two, and are not intended to limit the scope of the present invention.

In addition, those skilled in the art may understand that all or part of the steps in implementing the above method embodiments may be performed by a program to instruct related hardware, and the corresponding program may be stored in a computer readable storage medium, as mentioned above. The storage medium may be a read only memory, a magnetic disk or an optical disk or the like.

The above is only a preferred embodiment of the present invention, but the scope of the present invention is not limited thereto, and any person skilled in the art can easily think of changes or replacements within the technical scope disclosed by the embodiments of the present invention. All should be covered by the scope of the present invention. Therefore, the scope of protection of the present invention should be determined by the scope of the claims.

Claims

claims

1. A video live broadcast control method, characterized by including:

The video server forwards video frames from the host device to the user device, where the video frames include key frames and non-key frames;

The video server monitors whether key frames are lost in the video frames;

If the video server detects that key frames are lost, it sends notification information to the host device so that the host device sends new key frames.

2. The method according to claim 1, characterized in that, if the video server detects that a key frame is lost, it sends notification information to the anchor device, so that the anchor device sends a new key frame, including:

If the video server detects that key frames are lost, it sends notification information to the host device to inform the host device of the lost key frames, so that the host device sends re-encoded key frames.

3. The method according to claim 1, characterized in that, if the video server detects that a key frame is lost, the video server sends notification information to the anchor device, so that the anchor device sends a new key frame, including:

If the video server detects that key frames are lost, it will send notification information to the host device, so that the host device will re-encode the current video data into key frames and non-key frames and send them to the video server.

4. The method according to claim 1, characterized in that, if the video server detects that a key frame is lost, it sends notification information to the anchor device, so that the anchor device sends a new key frame, including:

If the video server detects that a key frame is lost, it sends notification information to the host device to inform the host device of the lost key frame, so that the host device selects the next key of the lost key frame from the cache. frames and non-key frames, sent to the video server.

5. The method according to any one of claims 1-4, characterized in that, further comprising:

If the video server receives non-key frames associated with the lost key frames, then discards the non-key frames associated with the lost key frames.

6. A video live broadcast control method, characterized by including:

The user equipment receives video frames from the host equipment forwarded by the video server, and the video frame packets Contains key frames and non-key frames;

If the user equipment receives a new key frame from the host device forwarded by the video server when the current video frame is unsuccessfully decoded, the unsuccessfully decoded video frame is discarded and the new key frame is received. non-keyframes of keyframes;

7. The method according to claim 6, characterized in that if the user equipment receives a new key frame from the host device forwarded by the video server when decoding the current video frame fails, then, The user equipment discards the unsuccessfully decoded video frames and receives the new non-key frames of the key frames including:

If the user equipment receives the re-encoded key frame from the host device forwarded by the video server, the user equipment determines the position of the re-encoded key frame in the video frame, and sets the position to The video frame data after the key frame is discarded, and the video frame after the re-encoded key frame is received.

8. The method according to claim 7, characterized in that, if the user equipment receives the re-encoded key frame from the host device forwarded by the video server, it further includes:

The user equipment stops the decoding operation of all video frames after the position of the re-encoded key frame in the video frame.

9. A video live broadcast control method, characterized by including:

The anchor device collects and encodes the video data that currently needs to be broadcast into video frames, and sends the video frames to the user device through the video server. The video frames include key frames and non-key frames;

If the host device receives the notification information, the host device sends a new key frame to the user device through the video server.

10. The method according to claim 9, characterized in that, if the anchor device receives the notification information, sending the new key frame to the user device through the video server includes: if the anchor device After receiving the notification information indicating the lost key frame, the host device re-encodes the key frame and sends the re-encoded key frame to the user device through the video server.

11. The method according to claim 9, characterized in that, if the anchor device receives the notification information, sending the new key frame to the user device through the video server includes: if the anchor device After receiving the notification information, the host device re-encodes the current video data into key frames and non-key frames, and sends them to the user device through the video server.

12. The method according to claim 9, characterized in that, if the anchor device receives the notification information, sending the new key frame to the user device through the video server includes: if the anchor device Upon receiving notification information indicating a lost key frame, the host device selects the next key frame and non-key frame of the lost key frame from the cache, and sends them to the user device through the video server.

13. The method according to any one of claims 9-12, further comprising:

The host device discards non-key frames associated with the missing key frames that have been encoded and not sent to the video server.

14. A video server, characterized by including:

A forwarding control unit, used to control the forwarding of video frames from the host device to the user device, where the video frames include key frames and non-key frames;

A frame loss monitoring unit, used to monitor whether key frames are lost in the video frames;

The information sending unit is configured to send notification information to the host device if the frame loss monitoring unit detects that a key frame is lost, so that the host device sends a new key frame.

15. The video server according to claim 14, characterized in that:

The information sending unit is specifically configured to send notification information to the anchor device if the frame loss monitoring unit detects that a key frame is lost, informing the anchor device of the lost key frame, and causing the anchor device to send a re-encoding keyframes.

16. The video server according to claim 14, characterized in that:

The information sending unit is specifically configured to send notification information to the host device if the frame loss monitoring unit detects that a key frame is lost, so that the host device re-encodes the current video data into key frames and non-key frames. Frames are sent to the video server.

17. The video server according to claim 14, characterized in that:

The information sending unit is specifically configured to: if the frame loss monitoring unit detects that a key frame is lost, Then send notification information to the host device to inform the host device of the lost key frame, so that the host device selects the next key frame and non-key frame of the lost key frame from the cache, and sends the video to the video Sent by the server.

18. The video server according to any one of claims 14 to 17, further comprising: a frame dropping control unit configured to discard the non-key frame associated with the lost key frame if a non-key frame associated with the lost key frame is received. The missing keyframe is associated with a non-keyframe.

19. A user equipment, characterized by: including:

A video receiving unit, configured to receive video frames from the host device forwarded by the video server, where the video frames include key frames and non-key frames;

A frame determination unit, used to determine whether a new key frame from the host device forwarded by the video server is received when decoding the current video frame is unsuccessful;

A frame loss control unit, configured to discard the unsuccessfully decoded video frame if a new key frame from the host device forwarded by the video server is received when the current video frame is unsuccessfully decoded; the video The receiving unit is also configured to receive non-key frames of the new key frame;

A display unit is used to display the video picture decoded by the decoding unit.

20. The user equipment according to claim 19, characterized in that:

The video receiving unit is specifically configured to receive the video frame after the re-encoded key frame; the frame determining unit is specifically configured to determine whether the video receiving unit has received the re-coded key frame from the host device forwarded by the video server. encoded keyframes;

The frame loss control unit is specifically configured to: if the frame determination unit determines that the video receiving unit receives the re-encoded key frame from the host device forwarded by the video server, then, the user equipment determines that the The position of the re-encoded key frame in the video frame is determined, and the video frame data after the position is discarded.

21. The user equipment according to claim 20, characterized in that,

The decoding unit is also configured to, if the user equipment receives the re-encoded key frame from the host device forwarded by the video server, stop all the re-encoded key frames after the position in the video frame. Decoding operation of video frames.

22. An anchor device, characterized by including:

The data collection unit is used to collect the video data that currently needs to be broadcast live;

An encoding unit, used to encode the video data collected by the data collection unit into video frames, where the video frames include key frames and non-key frames;

A sending unit, configured to send the video frame encoded by the encoding unit to the user equipment through the video server;

Information receiving unit, used to receive notification information of key frame loss;

The sending unit is also configured to send a new key frame to the user equipment through the video server if the information receiving unit receives the notification information.

23. The anchor device according to claim 22, characterized in that:

The encoding unit is specifically used to re-encode the key frame if the anchor device receives the notification information;

The sending unit is specifically configured to send the video frames encoded by the encoding unit to the user equipment through the video server, and send the re-encoded key frames to the user equipment through the video server; the information receiving unit is specifically used to receive Notification information indicating the lost key frame.

24. The anchor device according to claim 22, characterized in that:

The encoding unit is specifically used to re-encode the current video data into key frames and non-key frames if notification information is received;

The sending unit is specifically configured to send the key frames and non-key frames re-encoded by the encoding unit to the user equipment through the video server.

25. The anchor device according to claim 22, characterized in that:

The sending unit is specifically configured to, if notification information indicating a lost key frame is received, select the next key frame and non-key frame of the lost key frame from the cache, and send the message to the user through the video server device sends.

26. The anchor device according to any one of claims 22 to 25, further comprising: a frame dropping unit, configured to discard non-key frames associated with the lost key frames that have been encoded and not sent to the video server. frame.

27. A video live broadcast system, including: anchor equipment, user equipment and video server, characterized by:

The anchor device is the anchor device described in any one of claims 22-26, the video server is the video server described in any one of claims 14-18, and the user equipment is the video server described in any one of claims 19-21. user equipment.

28. A storage medium containing computer-executable instructions, which when executed by a computer processor are used to execute a video live broadcast control method, characterized in that the method includes:

The video server monitors whether key frames are lost in the video frames;

29. A storage medium containing computer-executable instructions. The computer-executable instructions, when executed by a computer processor, are used to perform a video live broadcast control method. The method is characterized in that the method includes: The user equipment receives a video message sent by a video server. Forwarded video frames from the host device, the video frames include key frames and non-key frames;

30. A storage medium containing computer-executable instructions. The computer-executable instructions, when executed by a computer processor, are used to execute a video live broadcast control method, characterized in that the method includes: The host device collects current needs The live video data is encoded into video frames, and the video frames are sent to the user device through the video server, where the video frames include key frames and non-key frames;

If the host device receives the notification information, the host device sends a new key frame to the video server.