CN115484505A

CN115484505A - Video transmission method, device, equipment, system and computer storage medium

Info

Publication number: CN115484505A
Application number: CN202110604743.XA
Authority: CN
Inventors: 汪伊明; 罗勇
Original assignee: Huawei Technologies Co Ltd
Current assignee: Huawei Technologies Co Ltd
Priority date: 2021-05-31
Filing date: 2021-05-31
Publication date: 2022-12-16
Also published as: WO2022252953A1

Abstract

The application discloses a video transmission method, a device, equipment, a system and a computer storage medium, and belongs to the technical field of communication. The problem of relatively poor video playing quality is solved. The method comprises the following steps: the method comprises the steps that the gateway equipment obtains the network quality of a network between the gateway equipment and user equipment; the gateway device acquires a video fragment set based on the network quality, wherein the acquired video fragment set comprises a plurality of target video fragments; the gateway device sends the video clip set to the user device. The method and the device can improve the playing quality of the user equipment, and are used for transmitting videos between the gateway equipment and the user equipment.

Description

Video transmission method, device, equipment, system and computer storage medium

Technical Field

The present application relates to the field of communications technologies, and in particular, to a video transmission method, apparatus, device, system, and computer storage medium.

Background

The gateway equipment acquires the video fragments, then sends the video fragments to the user equipment, and the user equipment plays the video fragments, so that the video playing method is widely applied.

At present, in a video transmission method, a user device determines a current download speed, and then sends a video fragment set acquisition request to a gateway device based on the download speed, where the request is used to request to acquire a video fragment that needs to be played in a future period of time. The gateway device sends the set of video slices requested by the request to the user device. The subsequent user equipment can play the multiple video slices in turn.

Due to fluctuation of network quality, video clips requested by a video clip set acquisition request may be difficult to be effectively transmitted to user equipment, so that the user equipment has problems of jamming and the like when playing videos, and playing quality is affected.

Disclosure of Invention

The embodiment of the application provides a video transmission method, a video transmission device, video transmission equipment, a video transmission system and a computer storage medium. The problem of poor video playing quality is solved, and the technical scheme is as follows:

in a first aspect, a video transmission method is provided, and the method includes:

the method comprises the steps that the gateway equipment obtains the network quality of a network between the gateway equipment and user equipment; the gateway equipment acquires a video fragment set based on network quality, wherein the acquired video fragment set comprises a plurality of target video fragments; the gateway device sends the video clip set to the user device.

In the embodiment of the application, the gateway device obtains the video fragment set comprising the plurality of target video fragments based on the network quality, so that the gateway device can flexibly determine the video fragment set based on the network quality, the problem of playing blockage caused by network fluctuation can be avoided, and the playing quality of the user equipment can be improved.

Optionally, the gateway device obtains the video slicing set based on the network quality, including:

the gateway equipment determines at least two target code rates based on the network quality and the reference code rate, wherein the at least two target code rates comprise a first target code rate determined based on the reference code rate and a second target code rate determined based on the reference code rate and the network quality; the gateway equipment acquires a plurality of target video fragments with at least two target code rates based on the at least two target code rates and the identifiers of the plurality of target video fragments.

Wherein the target video slice may be provided by a video source device. The identity of the target video segment may be used to determine the content of the target video segment.

The gateway equipment obtains at least two video fragments with target code rates based on the network quality and the reference code rate, and then the code rates of the video fragments played by the user equipment can be flexibly determined. The reference code rate may be a code rate pre-stored in the gateway device, or may be a code rate obtained by the gateway device in a predetermined manner. The reference code rate may facilitate control of the code rate of video slices in a subsequent set of video slices to be transmitted.

In practical implementation, there may be multiple reference code rate obtaining manners, and according to different reference code rate obtaining manners, the following two optional implementation manners are taken as examples in the embodiment of the present application for description.

In a first implementation manner, the gateway device receives a code rate sent by the user equipment, and determines a reference code rate based on the code rate sent by the user equipment.

The code rate transmitted by the user equipment may be a code rate determined by the user equipment based on the network quality of the user equipment. The gateway device determines the code rate as a reference code rate, so that at least two target code rates determined according to the reference code rate and the network quality of the gateway device can be related to both the network quality of the user equipment and the network quality of the gateway device.

In an alternative example, when the code rate transmitted by the user equipment is one code rate, the gateway device may determine the one code rate as the reference code rate.

In another alternative example, the code rates transmitted by the user equipment include at least two code rates. The gateway device may determine the reference code rate based on the at least two code rates. For example, the gateway device may determine one code rate of the at least two code rates as the reference code rate, or may determine both of the at least two code rates as the reference code rate.

In the method of determining one of the at least two code rates as the reference code rate, the step of determining the reference code rate based on the code rate sent by the ue may include the following two cases according to different network qualities:

in the first case: and when the network quality is lower than the quality threshold value, the gateway equipment determines the minimum code rate in the code rates sent by the user equipment as the reference code rate. When the network quality is lower than the quality threshold value, the current network state is poor. The gateway device may determine a minimum code rate of the code rates sent by the user equipment as a reference code rate to reduce the code rates of at least part of the video slices in the subsequently determined video slice set, thereby facilitating the gateway device to effectively transmit the target video slice to the user equipment when the network quality is poor.

In the second case: and when the network quality is higher than the quality threshold, the gateway equipment determines the maximum code rate in the code rates sent by the user equipment as the reference code rate. And when the network quality is higher than the quality threshold value, the current network state is better. The gateway device may determine a maximum code rate among the code rates sent by the user device as a reference code rate, so as to improve the code rate of at least part of the video slices in the subsequently determined video slice set. The code rate of the target video fragments obtained subsequently is higher, the transmission efficiency of the target video fragments is further improved when the network state is good, and the effective utilization of communication resources is realized.

In a second implementation manner, the gateway device determines the target bitrate of the last video slice sent to the user equipment last time as the reference bitrate. The last video fragment sent to the user equipment last time may refer to the last video fragment in the video fragment set sent to the user equipment by the gateway equipment before the video fragment set sent to the user equipment this time. The last video fragment is the video fragment closest to the video fragment set to be sent at this time, so that the network state at the current moment can be reflected more accurately.

The number of the reference code rates determined by the gateway device is different, and finally, the modes for acquiring at least two target code rates are also different. The examples of the present application are described by way of example in two ways:

in the first way, the gateway device determines one or more code rates as the reference code rate. In this case, the gateway device may use the reference code rate as the first target code rate; and when the network quality is lower than the quality threshold, enabling the second target code rate to be smaller than the reference code rate (namely the second target code rate is smaller than the first target code rate). Therefore, the code rate of at least part of the target video fragments can be ensured to be smaller, and the target video fragments can be effectively transmitted to the user equipment when the network state is poor. And when the network quality is higher than the quality threshold, the second target code rate is larger than the reference code rate (namely the second target code rate is larger than the first target code rate). Therefore, the code rate of at least part of the target video fragments can be ensured to be larger, the effective utilization of communication resources is convenient to realize when the network state is better, and the definition of the target video fragments with the target code rate in playing is improved.

The first method is described by taking the second target bitrate as an example, which is determined based on the reference bitrate and the network quality. In this embodiment, the second target bitrate may also be determined based on the first target bitrate and the network quality. For example, when the network quality is lower than the quality threshold, the second target code rate is smaller than the first target code rate; and when the network quality is higher than the quality threshold value, the second target code rate is larger than the first target code rate.

In the second way, the gateway device determines at least two code rates as the reference code rate. In this case, when the network quality is lower than the quality threshold, the first target code rate and the second target code rate are both smaller than the reference code rate; and when the network quality is higher than the quality threshold, the first target code rate and the second target code rate are both larger than the reference code rate.

Wherein, when the network quality is lower than the quality threshold, the network state is poor. At this time, the first target code rate and the second target code rate may both be smaller than the reference code rate (in addition, if the at least two target code rates further include other target code rates, the other target code rates may also both be smaller than the reference code rate), so that the target video fragment with a smaller code rate is obtained subsequently, and thus, the gateway device may be convenient to effectively transmit the target video fragment to the user equipment when the network quality is poor.

When the network quality is higher than the quality threshold value, the network state is better. At this time, the target code rates may all be greater than the reference code rate (in addition, if the at least two target code rates further include other target code rates, the other target code rates may also all be greater than the reference code rate), so that the code rate of the subsequently obtained target video slice is higher, and further, when the network state is good, the transmission efficiency of the target video slice is further improved, and effective utilization of communication resources is achieved.

The quality threshold may be a preset value, and may be obtained according to a test performed in advance. For example, when the network quality is lower than a certain threshold, the video playing of the user equipment is more serious, and the threshold may be determined as the quality threshold.

Optionally, the acquiring, by the gateway device, the multiple target video fragments based on at least two target bit rates and the identifiers of the multiple target video fragments includes:

for the identifier of each target video fragment, the gateway device obtains a plurality of alternative video fragments based on the identifier, the identifiers of the alternative video fragments are the same, and the code rates are different.

The video source device may send a video fragment with one code rate in a multicast or broadcast manner, where an identifier of the video fragment is an identifier of one target video fragment, and the gateway device may process the video fragment to obtain alternative video fragments with multiple code rates.

Then, acquiring the target video slice may include two optional implementations, in one optional implementation:

and the gateway equipment acquires the alternative video fragments with the code rates corresponding to the target code rates of the identifiers from the multiple alternative video fragments as the target video fragments.

In another optional mode, when the network quality is lower than the quality threshold, the gateway device obtains a target alternative video fragment with a code rate larger than a target code rate corresponding to the identifier from the multiple alternative video fragments, removes a target frame in the target alternative video fragment to obtain a target video fragment with the code rate of the target code rate, wherein the target frame includes a B frame or a non-key P frame. After the B frame and the non-key P frame are removed, the influence on the video fragment is small, the code rate of the video fragment can be reduced, and the video fragment is conveniently transmitted when the network quality is low.

Optionally, the obtaining of the network quality of the network with the user equipment includes: determining a network quality based on network parameters, the network parameters including one or more of:

packet loss rate or packet loss number of a network between the gateway device and the user device; a transmission delay of a network between the gateway device and the user device; a transmission rate of a network between the gateway device and the user device; an interference index of a network between the gateway device and the user device; a packet loss rate or a packet loss number of a network between the gateway device and the video source device.

Optionally, the acquiring, by the gateway device, the network quality of the network with the user equipment includes:

the gateway equipment acquires the network quality of the network between the gateway equipment and the user equipment within the target time length before the current time. In this way, the variation trend of the network quality in the historical time period can be obtained, so that the target code rate can be determined based on the variation trend.

Or the gateway device acquires the network quality of the network between the gateway device and the user equipment in real time. The network quality obtained in the way can better reflect the network state at the current moment.

Optionally, the network between the gateway device and the user equipment is a wireless local area network. For example, a Wireless Fidelity (WiFi) network.

In a second aspect, the present application provides a video transmission method, including:

the method comprises the steps that user equipment receives a video fragment set sent by gateway equipment, wherein the video fragment set is obtained by the gateway equipment based on the network quality of a network between the gateway equipment and the user equipment, and the received video fragment set comprises a plurality of target video fragments; and the user equipment plays the video fragment set.

The video fragment set played by the user comprises a plurality of video fragments, and the video fragments are obtained by the gateway device based on the network quality, so that the video fragments played by the user device can be flexibly determined, the problem of playing blockage caused by network fluctuation can be avoided, and the playing quality of the user device can be improved.

Optionally, before the user equipment receives the video respectively-collected, the user equipment sends at least two code rates to the gateway equipment, where the at least two code rates are used for the gateway equipment to obtain the video slice collection. That is, the user equipment may also control the bitrate of the video slice by sending the bitrate to the gateway device.

In a third aspect, the present application provides a video transmission apparatus, which may include at least one module, and the at least one module may be configured to implement the first aspect or the video transmission method provided in the various possible implementations of the first aspect.

In a fourth aspect, the present application provides a video transmission apparatus, which may include at least one module, and the at least one module may be configured to implement the second aspect or the video transmission method provided by the various possible implementations of the second aspect.

In a fifth aspect, the present application provides a computer storage medium having stored therein computer instructions that instruct a computer device to execute the method provided by the first aspect or the various possible implementations of the first aspect, or to execute the method provided by the second aspect or the various possible implementations of the second aspect.

In a sixth aspect, a video transmission system is provided, comprising: a gateway device comprising the video transmission apparatus of the third aspect, and a user equipment comprising the video transmission apparatus of the fourth aspect.

In a seventh aspect, the present application provides a computer program product comprising computer instructions stored in a computer storage medium. The processor of the computer device may read the computer instructions from the computer storage medium, and the processor executes the computer instructions to cause the computer device to perform the method provided by the first aspect or the various possible implementations of the first aspect, or to cause the computer device to perform the method provided by the second aspect or the various possible implementations of the second aspect.

In an eighth aspect, the present application provides a chip, which may include programmable logic circuits and/or program instructions, and which when run is configured to implement the video transmission method according to any one of the first or second aspects.

In a ninth aspect, the present application provides a gateway device, comprising: a processor and a memory;

the memory stores computer instructions; the processor executes the computer instructions stored by the memory to cause the gateway device to perform the video transmission method provided by the first aspect or various possible implementations of the first aspect.

In a tenth aspect, the present application provides a user equipment, comprising: a processor and a memory; the memory stores computer instructions; the processor executes the computer instructions stored by the memory to cause the user equipment to perform the second aspect or various possible implementations of the second aspect to provide a method of video transmission.

In the embodiment of the application, the gateway device obtains the video fragment set based on the network quality, and then the gateway device can flexibly determine the video fragment set played by the user equipment, so that the problem of playing blockage caused by network fluctuation can be avoided, and the playing quality of the user equipment can be improved.

Drawings

Fig. 1 is a schematic application environment diagram related to a video transmission method according to an embodiment of the present application;

fig. 2 is a schematic flowchart of a video transmission method according to an embodiment of the present application;

fig. 3 is a schematic diagram of network quality within a target duration according to an embodiment of the present application;

fig. 4 is a schematic flowchart of acquiring a video slice set according to an embodiment of the present application;

fig. 5 is a schematic diagram illustrating a video slice and a reference bitrate in a video slice set according to this embodiment of the present application;

fig. 6 is a flowchart of acquiring multiple target video slices according to this embodiment of the present application;

fig. 7 is a video clip set transmitted by a gateway device to a user device according to the related art;

fig. 8 is a schematic diagram of a video slice set provided in an embodiment of the present application;

fig. 9 is a schematic structural diagram of a video transmission apparatus according to an embodiment of the present application;

fig. 10 is a schematic structural diagram of a video obtaining module according to an embodiment of the present application;

fig. 11 is a schematic structural diagram of another video acquisition module provided in an embodiment of the present application;

fig. 12 is a schematic structural diagram of a video transmission apparatus according to an embodiment of the present application;

fig. 13 is a schematic structural diagram of another video transmission apparatus according to an embodiment of the present application;

fig. 14 is a schematic structural diagram of a video transmission device according to an embodiment of the present application.

Detailed Description

To make the objects, technical solutions and advantages of the present application more clear, embodiments of the present application will be described in further detail below with reference to the accompanying drawings.

Fig. 1 is a schematic application environment diagram related to a video transmission method according to an embodiment of the present application. The application environment includes a user device 10, a gateway device 20, and a video source device 30.

The connection between the user device 10 and the gateway device 20 may be via a wired network or a wireless network. For example, the network between the user equipment and the gateway device is a local area network. Such as a wireless local area network or a wired local area network. The Wireless local area network may be a Wireless Fidelity (WiFi) network. The gateway device 20 and the video source device 30 may be connected via a wired network or a wireless network.

By way of example, the user device 10 may comprise a cell phone, a tablet computer, a television, a laptop computer, or a desktop computer. Gateway device 20 may include a router (e.g., an Optical Network Terminal (ONT)), a Digital Subscriber Line (DSL), a Customer-Premises Equipment (CPE), an Access Point (AP) device, a Cable modem (Cable modem), or the like. Video source device 30 is used to provide video assets to gateway apparatus 20. Alternatively, the video source device 30 may provide video resources to the gateway device 20 by way of broadcast or multicast. Video source device 30 may be a server or a cluster of servers.

In this application environment, the process of video transmission between the user equipment 10 and the gateway device 20 is as follows: the user equipment 10 may first determine the video to be played (e.g., a short video, a movie or a series of television shows). Then, at regular intervals (e.g. 10 seconds), the user equipment 10 may determine, based on the network state between the user equipment 10 and the gateway device 20, a bitrate and an identifier of a video segment (video segment file) in the video to be played, and send a video segment set acquisition request to the gateway device 20, where the video segment set acquisition request carries a file list, and the file list may include identifiers of a plurality of video segments and bitrates corresponding to the video segments. After acquiring the video slice set acquisition request, the gateway device 20 may acquire a video slice set based on the network quality with the user device 10 and send the video slice set to the user device 10, where the video slice set includes a plurality of target video slices with at least two target bit rates.

The file list may be an m3u8 (m 3u8 is an m3u file in UTF-8 encoding format) list, and the format of the video slice may be a Transport Stream (TS) format. The video slice in the embodiment of the present application may include image data and audio data, or may only include image data, which is not limited in the embodiment of the present application.

Fig. 2 is a schematic flowchart of a video transmission method according to an embodiment of the present application. The method can be applied to the application environment shown in fig. 1. As shown in fig. 2, the method includes:

s201, the user equipment sends a video fragment set acquisition request to the gateway equipment.

For example, when the network between the user equipment and the gateway device is a WiFi network, the user equipment may send a video shard set acquisition request to the gateway device through the WiFi network.

The video slice set obtaining request may include an identifier of a plurality of video slices in a video slice set to be played by the user equipment (the video slice set may be determined by the user equipment operating the user equipment, or may be determined by the user equipment based on a preset recommendation manner), and a bitrate of the plurality of video slices. The code rates of the multiple video slices may be the same or different. That is, the video slice set acquisition request may include one code rate, or at least two code rates. In addition, the identifiers of the multiple video slices in the video slice set acquisition request are arranged according to the playing order of the corresponding video slices, or the video slice set acquisition request may record the playing order of the video slices corresponding to the identifiers of the multiple video slices.

When a Bitrate is included in the video slice set acquisition request, the Bitrate may be a Bitrate determined by the ue based on its network quality (for example, the Bitrate determined by the ue based on an Adaptive Bitrate Streaming (ABR) technique or a multicast Adaptive Bitrate Streaming (mABR) technique).

Optionally, the video fragment set acquisition request carries a file list, and the identifiers of the multiple video fragments to be played by the user equipment in a future period of time and the bit rates of the multiple video fragments may be recorded in the file list. For example, when the file list in the video slice set acquisition request includes a bitrate, it can be as shown in table 1 below.

TABLE 1

Identification	Code rate
		0	256kbps
1	256kbps
		2	256kbps
3	256kbps

In table 1, 0, 1, 2, 3, and 4 are identifiers of video slices, the identifiers correspond to video slices with different contents, and the bitrate of the video slice corresponding to each identifier is 256kbps, so the file list includes a bitrate of 256kbps.

When the file list in the video slice set acquisition request includes at least two code rates, the following table 2 may be used.

TABLE 2

In table 2, the bitrate of the video slice corresponding to the identifiers 0 and 3 is 256kbps, the bitrate of the video slice corresponding to the identifier 1 is 64kbps, and the bitrate of the video slice corresponding to the identifier 2 is 128kbps, so that the file list includes 3 bitrates of 256kbps, 64kbps, and 128kbps.

Optionally, the user equipment may periodically send a video fragment set acquisition request to the gateway device, where the length of the period may be equal to the playing time of multiple video fragments in the video fragment set.

S202, the gateway equipment acquires the network quality of the network between the gateway equipment and the user equipment.

Wherein, the network quality is an index for reflecting the network state between the gateway device and the user equipment. The network quality may be represented by a numerical value (or score) or may be represented by a gear. For example, these two gears may be high or low.

Optionally, the gateway device may determine the network quality based on at least one network parameter. In one example, when the network quality is represented by a numerical value, the gateway device may take a weighted sum of parameter values of at least one network parameter as the numerical value reflecting the network quality; or, the gateway device may normalize the parameter value of the at least one network parameter to obtain a parameter value of the same dimension, and then use the weighted sum of the at least one processed network parameter as a numerical value reflecting the network quality. Optionally, the network quality may also be represented by an Adaptive Streaming Score (Adaptive Streaming Score), which may range from 0 to 100, with larger values indicating better network quality.

In another example, when the network quality is represented by a gear, a threshold value may be set for each network parameter, a parameter value of each network parameter is compared with the corresponding threshold value, and a target gear is determined based on the comparison result. For example, the number of parameter values lower than the corresponding threshold value (or parameter values higher than the corresponding threshold value) is acquired, the number is compared with a plurality of shift ranges set in advance, and the shift position corresponding to the shift range in which the number is located is determined as the target shift position. For example, the preset plurality of shift ranges include a low shift range and a high shift range, and if the number of parameter values lower than the corresponding threshold value is within the low shift range, the low shift corresponding to the low shift range is determined as the target shift.

Assuming that the network between the gateway device and the user device is a first network and the network between the gateway device and the video source device is a second network, the network parameters may include one or more of the following:

the first network parameter: packet loss rate or number of packets lost in the first network. Wherein, the packet loss rate or the packet loss quantity of the first network is inversely related to the network quality.

The second network parameter: a transmission delay of the first network. The transmission delay of the first network is inversely related to the network quality.

The third network parameter: the transmission rate of the first network. The transmission rate of the first network is positively correlated with the network quality.

Fourth network parameters: an interference index of the first network. The interference index may be used to reflect the strength of the external interference experienced by the first network, which is inversely related to the network quality.

Fifth network parameters: packet loss rate or number of packets lost for the second network. The network state of the second network also affects the network quality of the first network, and the packet loss rate or the packet loss quantity of the second network is a parameter that relatively reflects the network state of the second network, and the packet loss rate or the packet loss quantity of the second network is inversely related to the network quality. When the gateway device is an Optical Network terminal, the packet loss rate or the packet loss amount of the second Network may be obtained through a Passive Optical Network (PON) interface of the Optical Network terminal.

In addition, the network parameters may also include one or more of other parameters, such as network traffic, transmission Control Protocol (TCP) connection statistics, TCP synchronization Sequence number (SYN)/Acknowledgement Character (ACK) Time statistics, round Trip Time (RTT) statistics, TCP retransmission Timeout statistics, TCP Time statistics of the first data packet received, estimated server response Time statistics, TCP Checksum error (TCP Checksum error), error header length (Bad header length), error data length (Bad data length), retransmission (Duplicate) statistics, out of Sequence (Out of Sequence) statistics, and Out of Time (Out) statistics. The embodiment of the present application does not limit the type of the network parameter.

When the first network is a WiFi network, the gateway device may obtain the first to fourth network parameters by sensing a state of a WiFi air interface (the WiFi air interface may be regarded as a virtual logical port between the gateway device and the user equipment) (e.g., sensing whether a Block acknowledgement character (Block ACK) is lost).

In the above examples, a and B are "in positive correlation" and mean that a and B change in the same direction, that is, B increases with an increase in a and B decreases with a decrease in a. A is "negatively correlated" with B, meaning that A and B vary in opposite directions, i.e., B decreases as A increases and B increases as A decreases. Wherein A and B are the terms referred to herein.

In S202, there may be multiple occasions when the gateway device acquires the network quality, and the following two optional implementation manners are exemplified in the embodiment of the present application:

a first alternative implementation: the gateway equipment acquires the network quality of the network between the gateway equipment and the user equipment within the target time length before the current time.

The network quality in the target time period (i.e. the historical time period) before the current time may reflect the variation trend of the network quality. Fig. 3 is a schematic diagram of network quality within a target duration according to an embodiment of the present application. As shown in fig. 3, in the diagram, the abscissa is time t, and the ordinate is network quality, and the network quality in the target time period can be represented by a network quality curve. It can be seen that the network quality within the target duration becomes higher first and then lower as time goes by.

For example, the current time may be a time when the gateway device receives a video shard set acquisition request (the request may include the file list) sent by the user device, and the gateway device may acquire the network quality of the network between the gateway device and the user device in a target time length before the video shard set acquisition request is received after the gateway device receives the video shard set acquisition request sent by the user device. The target time length may be less than or equal to the same time length of a period in which the user equipment sends the video fragment set acquisition request to the gateway device.

The network quality determined by the implementation mode can reflect the variation trend of the network quality in the historical time period, and the subsequent gateway equipment can conveniently determine the code rate of the video fragment based on the variation trend.

A second alternative implementation: the gateway device acquires the network quality of the network between the gateway device and the user device in real time. That is, the gateway device may also obtain the network quality of the network between the current time and the user equipment. For example, the current time may be a time when the gateway device receives a video shard set acquisition request sent by the user equipment, and the gateway device may acquire the network quality of the network between the gateway device and the user equipment when receiving the video shard set acquisition request sent by the user equipment. The network quality obtained by the implementation mode can better reflect the network state at the current moment, and the subsequent gateway equipment can conveniently determine the code rate of the video fragment based on the real-time network state.

S203, the gateway device obtains a video fragment set based on the network quality, wherein the obtained video fragment set comprises a plurality of target video fragments.

Optionally, the gateway device may obtain a video fragment set with a higher code rate when the network quality is higher, so as to improve the definition of a video played by the user equipment; when the network quality is low, the video fragment set with low code rate is obtained, so that the risk of blocking when the user equipment plays the video is reduced. Fig. 4 is a schematic flowchart of acquiring a video slice set according to an embodiment of the present application. As shown in fig. 4, the process may include:

s2031, the gateway equipment determines the reference code rate.

The reference code rate is a code rate referred to by the gateway device when acquiring the code rate of the video slice set. There are various ways to obtain the reference code rate, and the following three optional implementation ways are used as examples in the embodiment of the present application for description.

The gateway equipment determines the code rate as a reference code rate, so that at least two target code rates determined according to the reference code rate and the network quality of the gateway equipment can be adaptively matched with both the network quality of the user equipment and the network quality of the gateway equipment, the possibility of blocking of the user equipment during video playing can be reduced, and the playing quality is improved.

The code rate transmitted by the user equipment may include one kind, or may include at least two kinds. When the code rate transmitted by the user equipment includes one code rate, the gateway equipment may directly determine the one code rate as the reference code rate. When the code rate transmitted by the user equipment includes at least two code rates, the gateway device may determine the reference code rate based on the at least two code rates. For example, the gateway device may determine one code rate of the at least two code rates as the reference code rate, or may determine both of the at least two code rates as the reference code rate.

In an alternative example, if the gateway device determines one of the at least two code rates as the reference code rate, the step of determining the reference code rate based on the code rate sent by the user equipment according to the difference of the network quality may include the following two cases:

in the first case: and when the network quality is lower than the quality threshold value, the gateway equipment determines the minimum code rate in the code rates sent by the user equipment as the reference code rate. And when the network quality is lower than the quality threshold value, the current network state is poor. The gateway device can determine the minimum code rate in the code rates sent by the user device as the reference code rate, so that the subsequent gateway device refers to the code rate when acquiring the code rate of the video fragment set, thereby ensuring that the code rate of at least part of target video fragments is smaller, and reducing the possibility of blocking when the user device plays the video. For example: the code rates transmitted by the user equipment include 64 kilobits per second (kbps), 128kbps, and 256kbps, and the gateway device may determine the reference code rate as 64kbps when the network quality is below the quality threshold.

In this embodiment, when the network quality is represented by a numerical value, the quality threshold may be a preset numerical value, which may be obtained according to a network communication test performed in advance. For example, when the network quality is lower than a certain threshold, the video playing by the user equipment is more serious, and the threshold can be determined as the quality threshold.

Alternatively, the quality threshold may be represented by a threshold gear of a plurality of gears when the network quality is represented by a gear, the network quality being determined to be greater than the quality threshold when the acquired gear of the network quality is above the threshold gear, and the network quality being determined to be less than the quality threshold when the acquired gear of the network quality is below the threshold gear. For example, the network quality may include three steps of high, medium, and low, and the quality threshold is the step of medium between high and low. And when the network quality is in a high grade, determining that the network quality is greater than a quality threshold, and when the network quality is in a low grade, determining that the network quality is less than the quality threshold.

In the second case: and when the network quality is higher than the quality threshold, the gateway equipment determines the maximum code rate in the code rates sent by the user equipment as the reference code rate. And when the network quality is higher than the quality threshold value, indicating that the current network state is better. The gateway equipment can determine the maximum code rate in the code rates sent by the user equipment as the reference code rate, so that the subsequent gateway equipment can obtain the code rate referred by the code rate of the video fragment set, thereby ensuring that the code rate of at least part of target video fragments is larger, being convenient for realizing effective utilization of communication resources when the network state is better, improving the definition of videos played by the user equipment and improving the user experience. For example: the code rates transmitted by the user equipment include 64kbps, 128kbps and 256kbps, and the gateway device may determine the reference code rate as 256kbps when the network quality is higher than the quality threshold.

In addition, the network quality may also be equal to the quality threshold, in which case, the gateway device may determine, as the reference code rate, a code rate of a median or an average code rate among the code rates transmitted by the user equipment.

It should be noted that, in the embodiment of the present application, the code rates are illustrated as 64kbps, 128kbps, and 256kbps, but the code rates may be other, such as 1 megabit per second (Mbps), 1.5Mbps, 15Mbps, and 18 Mbps.

In another alternative example, if the gateway device determines the at least two code rates as the reference code rate. The gateway device may correspond the at least two code rates to different video slices in the set of video slices to be transmitted by the gateway device. For example, different one or more video slices in the video slice set respectively correspond to different code rates sent by the user equipment, so in the subsequent process, the gateway device may determine the target code rate of each video slice based on the network quality and the reference code rate corresponding to each video slice.

Fig. 5 is a schematic diagram illustrating a video slice in a video slice set and a reference bitrate in accordance with an embodiment of the present application. As shown in fig. 5, there are a plurality of

video slices

1, 2, 3, 4, 5, 6, 7, 8 and 9 arranged in the playing order in the video slice set, and the identifications of the video slices are different. The reference code rate corresponding to

video slices

1 and 2 is 64kbps, the reference code rate corresponding to

video slices

3, 4 and 5 is 128kbps, the reference code rate corresponding to video slice 6 is 64kbps, and the reference code rate corresponding to

video slices

3, 4 and 5 is 256kbps.

In a second implementation manner, the gateway device determines the target bitrate of the last video slice sent to the user equipment last time as the reference bitrate. The last video fragment sent to the user equipment last time may refer to the last video fragment in the video fragment set sent to the user equipment by the gateway equipment before the video fragment set sent to the user equipment this time. The last video fragment is the video fragment which is closest to the sending time of the video fragment set to be sent at this time, and the code rate of the last video fragment is determined as the reference code rate, so that the subsequent gateway equipment refers to the code rate when acquiring the code rate of the video fragment set, thereby improving the relevance and the continuity of the code rates of two continuous video fragment sets and improving the playing quality.

In a third implementation manner, the gateway device determines a preset code rate as a reference code rate. The preset code rate may be configured in advance in the gateway device by the user, or may be a code rate predetermined by the gateway device according to the network environment. The network environment includes a communication environment and/or a natural environment.

S2032, the gateway device determines at least two target code rates based on the network quality and the reference code rate.

For example, the at least two target code rates include a first target code rate determined based on the reference code rate and a second target code rate determined based on the reference code rate and the network quality. The first target code rate is the code rate of at least one target video fragment in the video fragment set, and the second target code rate is the code rate of at least one other target video fragment in the video fragment set. Wherein, the first target code rate and the second target code rate may be different. In addition, the at least two target code rates may further include other target code rates determined based on the reference code rate, and/or other target code rates determined based on the reference code rate and the network quality.

As mentioned above, the reference code rate may be used as a reference for the code rate of the video slice in the video slice set to be currently transmitted, so as to control the code rate of the video slice in the video slice set to be currently transmitted.

In a first optional example, when the gateway device determines one or more code rates as the reference code rate, the determining at least two target code rates according to the difference in network quality may include:

when determining at least two target code rates based on the network quality and the reference code rate, the gateway device may use the reference code rate as a first target code rate, and when the network quality is lower than the quality threshold, make the second target code rate smaller than the reference code rate (that is, smaller than the first target code rate). For example: the reference code rate is determined to be 128kbps, and when the network quality is lower than the quality threshold, the gateway device may determine a second target code rate of the at least two code rates to be 64kbps. In addition, if the at least two target code rates further include other target code rates, the other target code rates may also be smaller than the reference code rate. On this basis, in the target video fragment in the video fragment set acquired by the subsequent gateway device, the code rate of one part of the video fragments is the reference code rate, and the code rate of the other part of the video fragments is smaller than the reference code rate. Therefore, the code rate of at least part of the target video fragments can be ensured to be smaller, and the target video fragments can be effectively transmitted to the user equipment when the network state is poor.

When determining at least two target code rates based on the network quality and the reference code rate, the gateway device may use the reference code rate as a first target code rate, and when the network quality is higher than the quality threshold, make the second target code rate larger than the reference code rate (i.e., larger than the first target code rate). For example: the reference code rate is determined to be 128kbps and the gateway device may determine the second target code rate to be 256kbps when the network quality is below the quality threshold. In addition, if the at least two target code rates further include other target code rates, the other target code rates may also be greater than the reference code rate. On this basis, in the target video fragment in the video fragment set acquired by the subsequent gateway device, the code rate of one part of the video fragments is the reference code rate, and the code rate of the other part of the video fragments is greater than the reference code rate. Therefore, the code rate of at least part of the target video fragments can be ensured to be larger, the effective utilization of communication resources is convenient to realize when the network state is better, and the definition of the target video fragments with the target code rate in playing is improved.

In the first optional example, the first target code rate is the same as the reference code rate, and in actual implementation, the first target code rate may be different from the reference code rate, which is determined based on the network quality and the reference code rate. For example, when the network quality is lower than the quality threshold, the first target code rate is smaller than the reference code rate; when the network quality is higher than the quality threshold, the first target code rate is greater than the reference code rate.

In a second optional example, when the gateway device determines at least two code rates as the reference code rate, when the network quality is lower than the quality threshold, both the first target code rate determined based on the reference code rate and the second target code rate determined based on the reference code rate and the network quality are smaller than the reference code rate. Therefore, the overall target code rates of at least two kinds of target codes are low, and the video fragments obtained subsequently can be effectively transmitted when the network quality is low. For example, the reference bitrate corresponding to the first two video slices of the video slice set is 64kbps, and the reference bitrate corresponding to the second and third video slices is 128kbps, when the network quality is lower than the quality threshold, it can be determined that the first target bitrate corresponding to the first two video slices is 32kbps, and the second target bitrate corresponding to the second and third video slices is 64kbps. In addition, if the at least two target code rates further include other target code rates, the other target code rates may also be smaller than the reference code rate.

And when the network quality is higher than the quality threshold, the first target code rate and the second target code rate are both larger than the reference code rate. For example, the reference bitrate corresponding to the first two video slices of the video slice set is 64kbps, and the reference bitrate corresponding to the second and third video slices is 128kbps, when the network quality is lower than the quality threshold, it can be determined that the first target bitrate corresponding to the first two video slices is 128kbps, and the second target bitrate corresponding to the second and third video slices is 256kbps. In addition, if the at least two target code rates further include other target code rates, the target code rates may be greater than the reference code rate.

It should be noted that, when the network quality obtained by the gateway device is the network quality in the target duration before the current time, the method for the gateway device to compare the network quality with the quality threshold may include the following steps:

first, if the number of the quality thresholds is one, the gateway device may first determine an average value of the network quality within the target duration, compare the average value with the quality thresholds, determine that the network quality is greater than the quality thresholds when the average value is greater than the quality thresholds, and determine that the network quality is less than the quality thresholds when the average value is less than the quality thresholds; or, the minimum value of the network quality in the target duration may be compared with a quality threshold, when the minimum value is greater than the quality threshold, it is determined that the network quality is greater than the quality threshold, and when the minimum value is less than the quality threshold, it is determined that the network quality is less than the quality threshold.

Second, the quality threshold comprises a set of quality thresholds within the target duration. The set of quality thresholds may also be represented as a quality threshold curve, and when the network quality curve represented by the network quality is entirely located above the quality threshold curve, it may be determined that the network quality is greater than the quality threshold, and when the network quality curve is entirely located below the quality threshold curve, or the network quality curve intersects the quality threshold curve, it may be determined that the network quality is less than the quality threshold. The foregoing steps S2022 to S2023 provide a way to determine at least two target code rates based on the network quality and the reference code rate. In practical implementation of the present application, the gateway device may further determine at least two target code rates based on the network quality only. Alternatively, the gateway device may preset a corresponding list of code rates and network qualities. For example, the correspondence list may be as shown in table 3:

TABLE 3

A plurality of corresponding relations (table 1 shows 3 corresponding relations) are stored in the list, each corresponding relation records at least two target code rates (in each corresponding relation shown in table 3, the code rate corresponding to each network quality may include a first target code rate and a second target code rate) and the network qualities corresponding to the at least two target code rates, and at least two target code rates in any two corresponding relations are not completely the same. At least two target code rates may thus be determined based on the network quality.

The at least two target code rates determined by the gateway device are code rates of a plurality of target video fragments subsequently sent to the user equipment. When the network quality acquired by the gateway device is the network quality of the historical time period, if the length of the historical time period is the same as the length of the period of requesting the video fragment from the gateway device by the user device, the variation trend of the at least two target bit rates may be the same as or similar to the variation trend of the network quality in the historical time period. And then the change trend of the code rate of a plurality of target video fragments subsequently sent to the user equipment is the same as or similar to the change trend of the network quality in the historical time period, so that the video fragments can be transmitted based on the change trend of the network quality, and the transmission flexibility of the video fragments is improved.

In the foregoing S2032, the second target bitrate is determined based on the reference bitrate and the network quality as an example. In this embodiment, the second target bitrate may also be determined based on the first target bitrate and the network quality. For example, when the network quality is lower than the quality threshold, the second target code rate is smaller than the first target code rate; and when the network quality is higher than the quality threshold value, the second target code rate is larger than the first target code rate.

S2033, the gateway device obtains the multiple target video fragments based on the at least two target code rates and the identifiers of the multiple target video fragments.

The identifier of the target video segment may be provided by the user equipment, and the identifier of the target video segment may be used to determine the content of the target video segment, and the content of the video segments with the same identifier is the same.

Optionally, fig. 6 is a flowchart of acquiring multiple target video fragments according to an embodiment of the present application, and as shown in fig. 6, a process of acquiring multiple target video fragments by a gateway device in S2033 includes:

s20331, for the identifier of each target video fragment, the gateway device obtains a plurality of alternative video fragments based on the identifier, and the identifiers of the plurality of alternative video fragments are the same and the code rates are different.

The video source device may send the video fragments in a Multicast (Multicast) or Broadcast (Broadcast) manner, and the gateway device may establish a plurality of alternative fragment sets based on the video fragments provided by the video source device, where each alternative fragment set corresponds to one identifier, and each alternative fragment set includes a plurality of video fragments with the same identifier but different bit rates. For the identifier of each target video fragment, the gateway device obtains a corresponding alternative fragment set based on the identifier, and takes the video fragment in the alternative fragment set as a plurality of alternative video fragments corresponding to the identifier.

Illustratively, the gateway device has a video codec function, e.g., a video dynamic codec function, which is capable of decoding, encoding, and encapsulating video slices at various bit rates. Assuming that the first video fragment is any video fragment sent by the video source device and received by the gateway device, the process of establishing a plurality of candidate fragment sets based on the video fragments provided by the video source device includes: the gateway device obtains a first alternative fragment set corresponding to the first video fragment by encoding and decoding the first video fragment, where the identifiers of the multiple video fragments are the same as the identifier of the first video fragment, and the multiple video fragments in the first alternative fragment set may include the first video fragment. Optionally, the code rate of the video slice provided by the video source device may be the maximum code rate supported by the video source device, so that it may be ensured that the gateway device efficiently encodes and decodes, thereby implementing establishment of multiple alternative slice sets.

S20332, the gateway device determines a target video fragment based on the obtained multiple alternative video fragments.

In an optional mode, the gateway device obtains, from the multiple candidate video slices, a candidate video slice with a target bitrate corresponding to the identifier as a target video slice.

For example, the target bitrate of the target video slice identified as x1 is 128kbps. The alternative video fragments marked as x1 acquired by the gateway device include three alternative video fragments with the code rates of 64kbps, 128kbps and 256kbps, and then the gateway device can determine the alternative video fragments with the code rate of 128kbps as the target video fragments.

In another alternative, when the network quality is lower than the quality threshold, the gateway device may obtain the target video slice by re-encoding and decoding. For example, a target alternative video segment with a code rate larger than the target code rate corresponding to the identifier is obtained from the multiple alternative video segments, a target frame in the target alternative video segment is removed, and a target video segment with a code rate of the target code rate is obtained, wherein the target frame includes a B frame or a non-key P frame.

Wherein, the I frame, the P frame and the B frame are three video frames involved in video coding. I-frames are key frames that describe the image background and the moving subject. I-frames can be generated without reference to other pictures and are references to P-frames and B-frames (the quality of an I-frame directly affects the quality of adjacent frames). The P frame is a forward predictive coded frame, and is a frame generated based on a predetermined algorithm with an I frame or a P frame preceding the P frame as a reference frame. B frames are frames predicted from previous I or P frames and later P frames. The P frames comprise key P frames and non-key P frames, the association between the key P frames and the subsequent frames is large, the association between the non-key P frames and the subsequent frames is small, and further, the influence of deleting the non-key P frames on the subsequent video pictures is small and can be difficult to perceive by naked eyes. Optionally, the association degree of the key P frame with the subsequently associated frame is greater than a preset threshold, and the association degree of the non-key P frame with the subsequently associated frame is less than the preset threshold. The degree of association may be positively correlated with the number of association frames.

It can be seen that after the B frame and the non-key P frame are removed, the influence on the video fragment is small, so that when the network quality is poor, part or all of the B frame and the non-key P frame in the target alternative video fragment can be removed to reduce the bit rate of the video fragment. The method is convenient for transmitting the video fragments when the network quality is low, reduces the transmission delay, and avoids the problems of jamming and the like when the user equipment plays the video.

Optionally, the removing, by the gateway device, the target frame in the target alternative video segment to obtain the target video segment with the target bitrate may include:

a1, decoding the target alternative video fragments to obtain target alternative video data.

And A2, recoding the target alternative video data to remove the target frame.

And A3, repackaging the target alternative video data without the target frame to obtain the target video fragment with the target code rate.

Optionally, the gateway device may remove the target frame in the target alternative video slice based on an agreed target video encoding scheme with the user equipment. The target video coding mode can support various preset code rates, and the gateway equipment can remove the target frames in the target alternative video fragments so as to enable the target code rate of the obtained target video fragments to be one of the various preset code rates. In this way, the transmission of the target video slice and the playing on the user equipment side are facilitated. For example, the preset code rates that can be supported by the target video coding method include 64kbps, 128kbps, and 256kbps, and the code rate of the target alternative video fragment is 128kbps, and then the target code rate of the target video fragment obtained after the gateway device removes the target frame is 64kbps.

Optionally, when the network quality is lower than the quality threshold and the code rates of the multiple candidate video fragments obtained by the gateway device are all greater than the target code rate, the gateway device may obtain the target candidate video fragment whose code rate is greater than the target code rate corresponding to the identifier, and execute the above A2, remove the target frame of the target candidate video fragment, and perform frame dropping processing. However, if the target alternative video segment with the code rate greater than the target code rate corresponding to the identifier is the retransmitted video segment, the gateway device may not remove the target frame of the target alternative video segment, so as to ensure the stability of data transmission.

It should be noted that, in the foregoing S2032 and S2033, the gateway device determines at least two target bitrate based on the network quality and the reference bitrate as an example, so that the flexibility of using the bitrate in the video slice set is high. In practical implementation, the gateway device may also determine a target code rate based on the network quality and the reference code rate. For example, assuming that the gateway device determines a code rate as a reference code rate, when the network quality is lower than the quality threshold, the gateway device determines a code rate smaller than the reference code rate as a target code rate; when the network quality is higher than the quality threshold, the gateway equipment determines the code rate larger than the reference code rate as a target code rate. Assuming that the gateway device determines at least two code rates as reference code rates, when the network quality is lower than a quality threshold, the gateway device determines the code rate smaller than or equal to the minimum code rate in the reference code rates as a target code rate; when the network quality is higher than the quality threshold, the gateway equipment determines the code rate which is larger than or equal to the maximum code rate in the reference code rates as a target code rate. Correspondingly, reference is made to the foregoing S20331 to S20332 for a process of acquiring multiple target video fragments by the gateway device, which is not described herein again in this embodiment of the present application.

S204, the gateway equipment sends the video fragment set to the user equipment.

The gateway device may send the video segment set to the user device by Unicast (Unicast).

The gateway device may send the video segment set to the user device by periodically performing S201 to S204, where the period may be a playing time of the video segment set. For example, if the playing duration of each video slice set is 10 seconds, the gateway device may send the video slice set to the user device once by performing S201 to S204 once every 10 seconds.

One situation where the user equipment is stuck is: when the gateway device sends the video fragment set to the user device n-th time, the video fragment set being played by the user device may be the video fragment set sent to the user device n-1-th time by the gateway device. However, if the gateway device fails to complete sending the video clip set sent to the user device n times due to the network, and the user device has already played the video clip set sent to the user device n-1 times, the user device may be stuck. Wherein n is an integer greater than 1. In the related art, it is difficult to adjust the bitrate of a video slice in a video slice set sent in one period, and the bitrate of a video slice in a video slice set sent in one period is a fixed value. As shown in fig. 7, fig. 7 is a video segment set sent by a gateway device to a user device according to a related art, where the video segment set has 9 video segments arranged in a playing order f, which are

video segments

1, 2, 3, 4, 5, 6, 7, 8, and 9 respectively, and the identifiers of the video segments are different. The code rates of the 9 video fragments are all 128kbps, and cannot be changed based on the change of the network quality, so that the flexibility is poor. And the code rate of the video fragments can be adjusted according to the code rate sent by the user equipment after the video fragment set sent in one period is sent.

However, according to the method provided by the embodiment of the present invention, the code rates of the video slices in the video slice set sent in one period may include multiple different code rates, and the code rates may change with the change of the network quality, so that the flexibility is higher.

S205, the user equipment plays the video fragment set.

After receiving the video fragment set sent by the gateway device, the user device may play a plurality of video fragments in the video fragment set in sequence. The user equipment supports decoding and playing of video fragments with different code rates. For example, the user equipment may support decoding and playing of files in TS format with different code rates.

Because the video slices in the video slice set have at least two code rates, the code rate of the video played by the user equipment also changes in the playing process. For example, a video slice set sent by a gateway device and received by a user device may be as shown in fig. 8, where fig. 8 is a schematic diagram of a video slice set provided in an embodiment of the present application, where the video slice set includes video slices 1, 2, 3, 4, 5, 6, 7, 8, and 9 arranged according to a playing order f, and identifiers of the video slices are different. The code rate of

video slices

1 and 2 is 64kbps, the code rate of

video slices

3, 4 and 5 is 256kbps, the code rate of video slice 6 is 128kbps, and the code rate of

video slices

7, 8 and 9 is 64kbps. It can be seen that, in the video slice set, the code rate variation trend of the video slices is similar to the variation trend of the network quality shown in fig. 3, so that the risk of stuttering when the user equipment plays the video slice set can be reduced.

In the traditional video transmission method, the video fragment acquisition request sent by the user equipment to the gateway equipment each time only carries one code rate, the code rate of each request is single, and the use flexibility of the code rate is low.

Referring to the foregoing S201, in this embodiment of the present application, the video fragment acquisition request that is sent by the user equipment to the gateway device each time may include at least two code rates, where the code rate types of the requests each time are different, and the flexibility of using the code rates is high. The method for determining at least two code rates by the user equipment may refer to the method for determining at least two target code rates by the gateway equipment. For example, the user equipment obtains the network quality of the network between the user equipment and the gateway equipment, and determines at least two code rates based on the network quality. Optionally, the user equipment determines at least two code rates based on the network quality and the reference code rate. The foregoing determination manner of the network quality may refer to S202, and unlike S202, the network parameter reflecting the network quality is a network parameter that can be obtained by the user equipment, such as a transmission rate. The aforementioned manner of determining at least two code rates based on the network quality and the reference code rate may refer to S2032. In addition, the method for determining the reference code rate by the user equipment is different from the method for determining the reference code rate by the gateway equipment. For example, the user equipment determines the code rate of the identifier of the last video segment that was sent to the gateway device last time as the reference code rate, or determines the preset code rate as the reference code rate.

In summary, according to the video transmission method provided by the embodiment of the present application, the gateway device obtains the plurality of video segments based on the network quality, and then can flexibly determine the video segments played by the user equipment, so that the problem of playing jam caused by network fluctuation can be avoided, and the playing quality of the user equipment is improved.

In a conventional video transmission method, a gateway device directly obtains a plurality of video fragments of a code rate carried by a request according to the request of a user device, and sends the video fragments to the user device, without considering the network quality between the gateway device and the user device, which may make it difficult for the gateway device to effectively send the video fragments to the user device, and further cause the user device to play video chunkingly. In addition, in the conventional video transmission method, since the video fragment acquisition request sent by the user equipment to the gateway equipment each time only carries one code rate, correspondingly, the video fragment set sent by the gateway equipment to the user equipment also only includes a plurality of video fragments with one code rate. The code rate of the video fragment set is single, and the use flexibility of the code rate is low.

In the embodiment of the application, the gateway device can acquire the video fragment set sent to the user equipment based on the influence of the network quality on the video transmission, so that the probability that the video fragment set is effectively transmitted to the user equipment is improved. In this case, the code rate in the video fragment acquisition request sent by the user equipment to the gateway device may also be a code rate determined by the user equipment based on the network quality, so that the code rate in the video fragment set may be determined by both ends of the user equipment and the gateway device based on the network quality, and the probability of effective transmission and playing of the video fragment set is further improved.

In addition, the video slice set sent to the user equipment also includes a plurality of target video slices of at least two target bitrate. The video fragment sets have different code rate types and high use flexibility of the code rates.

In addition, in the foregoing embodiment, when the network quality is lower than the quality threshold, the target code rate determined by the gateway device is at least partially smaller than the reference code rate (for example, the second target code rate is smaller than the reference code rate). Therefore, at least part of target video fragments with smaller code rate are obtained subsequently, and the gateway equipment can conveniently and effectively transmit the target video fragments to the user equipment when the network quality is poor.

When the network quality is higher than the quality threshold, the gateway device determines that at least part of the target code rate is greater than the reference code rate (for example, the second target code rate is greater than the reference code rate). When the network quality is higher than the quality threshold value, the network state is better. At this time, at least part of the target video fragments with higher code rate can be obtained subsequently, and further, the transmission efficiency of the target video fragments is further improved when the network state is good, so that the effective utilization of communication resources is realized.

Therefore, the video transmission method provided by the embodiment of the application can flexibly determine the reference code rate based on the network quality, and flexibly determine the target code rate based on the reference code rate, thereby realizing the flexible and effective transmission of the video fragments.

It should be noted that, the order of the steps of the video transmission method provided in the embodiment of the present application may be appropriately adjusted, and the steps may also be increased or decreased according to the situation, and any method that can be easily conceived by a person skilled in the art within the technical scope disclosed in the present application shall be included in the protection scope of the present application, and therefore, the details are not described again.

Fig. 9 is a schematic structural diagram of a video transmission apparatus according to an embodiment of the present application, where the apparatus 90 includes: a quality obtaining module 901, configured to obtain, by the gateway device, a network quality of a network with the user equipment; a video obtaining module 902, configured to obtain, by a gateway device, a video fragment set based on network quality, where the obtained video fragment set includes multiple target video fragments; a sending module 903, configured to send the video segment set to a user equipment.

To sum up, the video transmission device provided in the embodiment of the present application obtains the video fragment set including a plurality of video fragments based on the network quality, and further can flexibly determine the video fragments played by the user equipment, and can avoid the occurrence of the problem of playing jamming caused by network fluctuation, thereby improving the playing quality of the user equipment.

Optionally, as shown in fig. 10, fig. 10 is a schematic structural diagram of a video obtaining module provided in this embodiment of the present application, and the video obtaining module 902 includes: a target code rate determining unit 9021, configured to determine at least two target code rates based on the network quality and the reference code rate, where the at least two target code rates include a first target code rate determined based on the reference code rate and a second target code rate determined based on the reference code rate and the network quality; the fragment obtaining unit 9022 is configured to obtain multiple target video fragments with at least two target code rates based on at least two target code rates and the identifiers of the multiple target video fragments.

As shown in fig. 11, fig. 11 is a schematic structural diagram of another video acquiring module according to an embodiment of the present disclosure. Optionally, the video obtaining module 902 further includes: a first reference determining unit 9023, configured to receive a code rate sent by the user equipment, and determine a reference code rate based on the code rate sent by the user equipment; a second reference determining unit 9024, configured to determine a target bitrate of a last video slice sent to the user equipment last time as the reference bitrate.

Optionally, the code rate sent by the user equipment includes at least two code rates, and the first reference determining unit 9023 is configured to: when the network quality is lower than the quality threshold, the gateway equipment determines the minimum code rate in the code rates sent by the user equipment as a reference code rate; and when the network quality is higher than the quality threshold, the gateway equipment determines the maximum code rate in the code rates sent by the user equipment as the reference code rate.

Optionally, the first target code rate is the same as the reference code rate; in an optional manner, when the network quality is lower than the quality threshold, the second target code rate is smaller than the reference code rate; in another alternative, when the network quality is higher than the quality threshold, the second target code rate is greater than the reference code rate.

Optionally, the target code rate determining unit 9021 is configured to: taking at least two code rates as reference code rates; when the network quality is lower than the quality threshold, the first target code rate and the second target code rate are both smaller than the reference code rate; and when the network quality is higher than the quality threshold, the first target code rate and the second target code rate are both larger than the reference code rate.

Optionally, the fragment obtaining unit 9022 is configured to: for the identification of each target video fragment, acquiring a plurality of alternative video fragments based on the identification, wherein the identifications of the alternative video fragments are the same, and the code rates are different; and obtaining the alternative video fragments with the code rate corresponding to the target code rate of the identification from the alternative video fragments as target video fragments, or obtaining the target alternative video fragments with the code rate larger than the target code rate corresponding to the identification from the alternative video fragments when the network quality is lower than a quality threshold, removing target frames in the target alternative video fragments to obtain the target video fragments with the code rate corresponding to the target code rate, wherein the target frames comprise B frames or non-key P frames.

Optionally, the quality obtaining module 901 is configured to: determining a network quality based on network parameters, the network parameters including one or more of: a packet loss rate or a packet loss number of a network between the gateway device and the user equipment; a transmission delay of a network between the gateway device and the user device; a transmission rate of a network between the gateway device and the user device; an interference index of a network between the gateway device and the user device; a packet loss rate or a packet loss number of a network between the gateway device and the video source device.

Optionally, the quality obtaining module 901 is configured to: acquiring the network quality of a network between gateway equipment and user equipment within a target time length before the current time; or, the network quality of the network between the gateway device and the user equipment is acquired in real time.

Optionally, the network between the gateway device and the user equipment is a wireless local area network.

Fig. 12 is a schematic structural diagram of a video transmission apparatus 120 according to an embodiment of the present application, where the apparatus 120 includes: a receiving module 121, configured to receive a video fragment set sent by a gateway device, where the video fragment set is obtained by the gateway device based on the network quality of a network between the gateway device and the video transmission apparatus 120, and the received video fragment set includes a plurality of target video fragments; and a playing module 122, configured to play the video segment set.

To sum up, according to the video transmission apparatus provided in the embodiment of the present application, the gateway device obtains the video fragment set including the plurality of video fragments based on the network quality, and then can flexibly determine the video fragments played by the user equipment, so that the occurrence of a stuck problem when the video fragment set is played due to network fluctuation can be avoided, and the playing quality of the user equipment can be improved.

Optionally, as shown in fig. 13, fig. 13 is a schematic structural diagram of another video transmission apparatus provided in this embodiment of the present application, where the video transmission apparatus 120 further includes: the code rate sending module 123 is configured to send at least two code rates to the gateway device, where the at least two code rates are used for the gateway device to obtain the video segment set.

Fig. 14 is a schematic structural diagram of a video transmission device according to an embodiment of the present application, where the video transmission device may be a gateway device or a user equipment according to the foregoing embodiment, and the video transmission device 140 includes: processor 141, memory 142, communication interface 143, and bus 144.

In the video transmission apparatus 140, the number of the processors 141 may be one or more, and fig. 10 only illustrates one of the processors 141. Alternatively, the processor 141 may be a Central Processing Unit (CPU). If the gateway device has multiple processors 141, the types of the multiple processors 141 may be different, or may be the same. Alternatively, multiple processors 141 of the gateway device may also be integrated into a multi-core processor.

Memory 142 stores computer instructions and data; memory 142 may store computer instructions and data necessary to implement the video transmission methods provided herein, e.g., memory 142 stores instructions for implementing the steps of the video transmission methods. Memory 142 may be any one or any combination of the following storage media: nonvolatile memory (e.g., read Only Memory (ROM), solid State Disk (SSD), hard disk (HDD), optical disk), volatile memory.

Communication interface 143 may be any one or any combination of the following devices: a network interface (such as an ethernet interface), a wireless network card, and the like.

Communication interface 143 provides for data communication by the gateway device to other computer devices or terminals.

Bus 144 may connect processor 141 with memory 142 and communication interface 143. Thus, processor 141 may access memory 142 via bus 144 and may also interact with other computer devices or terminals via communication interface 143.

Optionally, when the video transmission device is a gateway device, the processor 141 further has a function of including video processing, and can decode, encode, and encapsulate video slices. When the video transmission device is a user device, the processor 141 further supports decoding and playing video slices with various bit rates.

In the present application, the video transmission device executes computer instructions in memory 142 to cause video transmission device 140 to implement the video transmission methods provided herein.

The embodiment of the application further provides a video transmission system, and the video transmission system comprises the gateway device and the user equipment provided by the embodiment of the application. The video transmission system may also include a video source device. The structure of the video transmission system may refer to the structure of the application environment in fig. 1, which is not described in detail in this embodiment of the present application.

In an exemplary embodiment, a non-transitory computer storage medium, such as a memory, including instructions executable by a processor of a video source device to perform a video transmission method as shown in various embodiments of the present application is also provided. For example, the non-transitory computer storage medium may be read-only memory (ROM), random-access memory (RAM), CD-ROMs, magnetic tape, floppy disk, optical data storage devices, and the like.

It should be noted that: in the video transmission apparatus provided in the foregoing embodiment, when the video transmission method is implemented, only the division of the above functional modules is used for illustration, and in practical applications, the above functions may be distributed by different functional modules according to needs, that is, the internal structure of the device is divided into different functional modules, so as to complete all or part of the above described functions. In addition, the video transmission apparatus and the video transmission method provided by the above embodiments belong to the same concept, and specific implementation processes thereof are described in the method embodiments in detail and are not described herein again.

The term "and/or" in this application is only one kind of association relationship describing the associated object, and means that there may be three kinds of relationships, for example, a and/or B, which may mean: a exists alone, A and B exist simultaneously, and B exists alone.

It will be understood by those skilled in the art that all or part of the steps for implementing the above embodiments may be implemented by hardware, or may be implemented by a program instructing relevant hardware, where the program may be stored in a computer storage medium, and the above storage medium may be a read-only memory, a magnetic disk, an optical disk, or the like.

The above description is intended only to illustrate the alternative embodiments of the present application, and should not be construed as limiting the present application, and any modifications, equivalents, improvements and the like made within the spirit and principle of the present application should be included in the protection scope of the present application.

Claims

1. A method of video transmission, the method comprising:

the method comprises the steps that the gateway equipment obtains the network quality of a network between the gateway equipment and user equipment;

the gateway device acquires a video fragment set based on the network quality, wherein the acquired video fragment set comprises a plurality of target video fragments;

the gateway device sends the video clip set to the user device.

2. The method of claim 1, wherein the gateway device obtains the set of video slices based on the network quality, comprising:

the gateway device determines at least two target code rates based on the network quality and a reference code rate, wherein the at least two target code rates comprise a first target code rate determined based on the reference code rate and a second target code rate determined based on the reference code rate and the network quality;

the gateway device obtains the target video fragments with the at least two target bit rates based on the at least two target bit rates and the identifiers of the target video fragments.

3. The method of claim 2, further comprising:

the gateway equipment receives the code rate sent by the user equipment, and determines the reference code rate based on the code rate sent by the user equipment;

or, the gateway device determines the target code rate of the last video segment sent to the user device last time as the reference code rate.

4. The method of claim 3, wherein the code rate transmitted by the UE comprises at least two code rates, and wherein the determining the reference code rate based on the code rate transmitted by the UE comprises:

when the network quality is lower than a quality threshold, the gateway device determines the minimum code rate in the code rates sent by the user equipment as the reference code rate;

and when the network quality is higher than the quality threshold, the gateway equipment determines the maximum code rate in the code rates sent by the user equipment as the reference code rate.

5. The method of any of claims 2 to 4, wherein the first target code rate is the same as the reference code rate;

when the network quality is lower than a quality threshold, the second target code rate is smaller than the reference code rate;

when the network quality is higher than the quality threshold, the second target code rate is greater than the reference code rate.

6. The method of claim 4, wherein the gateway device determines at least two target code rates based on the network quality and a reference code rate, comprising:

the gateway equipment takes the at least two code rates as reference code rates;

when the network quality is lower than a quality threshold, the first target code rate and the second target code rate are both smaller than the reference code rate;

when the network quality is higher than the quality threshold, the first target code rate and the second target code rate are both greater than the reference code rate.

7. The method of any of claims 2 to 6, wherein the obtaining, by the gateway device, the target video slices with the at least two target bitrate based on the at least two target bitrate and the identifiers of the target video slices, comprises:

for the identifier of each target video fragment, the gateway device obtains a plurality of alternative video fragments based on the identifier, wherein the identifiers of the alternative video fragments are the same, and the code rates are different;

the gateway device obtains the alternative video fragments with the code rates being the target code rates corresponding to the identifiers from the multiple alternative video fragments as the target video fragments,

or, when the network quality is lower than a quality threshold, the gateway device obtains a target alternative video fragment with a code rate larger than a target code rate corresponding to the identifier from the multiple alternative video fragments, removes a target frame in the target alternative video fragment to obtain a target video fragment with the code rate of the target code rate, wherein the target frame includes a B frame or a non-key P frame.

8. The method according to any one of claims 1 to 7, wherein the gateway device obtaining the network quality of the network with the user equipment comprises:

the gateway equipment acquires the network quality of a network between the gateway equipment and user equipment within a target time length before the current time;

or, the gateway device obtains the network quality of the network between the gateway device and the user equipment in real time.

9. A method of video transmission, the method comprising:

the method comprises the steps that user equipment receives a video fragment set sent by gateway equipment, wherein the video fragment set is obtained by the gateway equipment based on the network quality of a network between the gateway equipment and the user equipment;

and the user equipment plays the video fragment set.

10. The method of claim 9, wherein prior to the user device receiving the respective sets of videos, the method further comprises:

and the user equipment sends at least two code rates to the gateway equipment, wherein the at least two code rates are used for the gateway equipment to obtain the video fragment set.

11. A video transmission apparatus, characterized in that the video transmission apparatus comprises:

the quality acquisition module is used for acquiring the network quality of a network between the user equipment and the user equipment;

a video acquisition module, configured to acquire a video slicing set based on the network quality, where the acquired video slicing set includes a plurality of target video slices;

a sending module, configured to send the video slicing set to the user equipment.

12. The video transmission apparatus according to claim 11, wherein the video acquisition module comprises:

a target code rate determining unit, configured to determine at least two target code rates based on the network quality and a reference code rate, where the at least two target code rates include a first target code rate determined based on the reference code rate and a second target code rate determined based on the reference code rate and the network quality;

and the fragment obtaining unit is used for obtaining the target video fragments with the at least two target code rates based on the at least two target code rates and the identifiers of the target video fragments.

13. The video transmission apparatus according to claim 12, wherein the video acquisition module further comprises:

a first reference determining unit, configured to receive a code rate sent by the user equipment, and determine the reference code rate based on the code rate sent by the user equipment;

and the second reference determining unit is used for determining the target code rate of the last video fragment sent to the user equipment last time as the reference code rate.

14. The video transmission apparatus according to claim 13, wherein the code rates transmitted by the ue include at least two code rates, and the first reference determining unit is configured to:

when the network quality is lower than a quality threshold, determining the minimum code rate in the code rates sent by the user equipment as the reference code rate;

and when the network quality is higher than the quality threshold, determining the maximum code rate in the code rates sent by the user equipment as the reference code rate.

15. The video transmission apparatus according to any of claims 12 to 14, wherein the first target bitrate is the same as the reference bitrate;

16. The video transmission apparatus according to claim 14, wherein the target bitrate determination unit is configured to:

taking the at least two code rates as reference code rates;

17. The video transmission apparatus according to any of claims 12 to 16, wherein the slice acquiring unit is configured to:

for the identifier of each target video fragment, acquiring a plurality of alternative video fragments based on the identifier, wherein the identifiers of the alternative video fragments are the same, and the code rates are different;

obtaining the alternative video slices with the target code rates corresponding to the marks from the multiple alternative video slices as the target video slices,

or when the network quality is lower than a quality threshold, obtaining a target alternative video fragment with a code rate larger than a target code rate corresponding to the identifier from the multiple alternative video fragments, removing a target frame in the target alternative video fragment to obtain the target video fragment with the code rate of the target code rate, wherein the target frame comprises a B frame or a non-key P frame.

18. The video transmission apparatus according to any of claims 11 to 17, wherein the quality acquisition module is configured to:

acquiring the network quality of a network between the user equipment and the target time length before the current time;

or acquiring the network quality of the network between the user equipment and the user equipment in real time.

19. A video transmission apparatus, characterized in that the video transmission apparatus comprises:

a receiving module, configured to receive a video segment set sent by a gateway device, where the video segment set is obtained by the gateway device based on network quality of a network between the gateway device and the video transmission apparatus, and the received video segment set includes a plurality of target video segments;

and the playing module is used for playing the video fragment set.

20. The video transmission apparatus according to claim 19, wherein the video transmission apparatus further comprises:

a code rate sending module, configured to send at least two code rates to the gateway device, where the at least two code rates are used for the gateway device to obtain the video segment set.

21. A video transmission system, comprising: a gateway device comprising the video transmission apparatus of any one of claims 11 to 18 and a user device comprising the video transmission apparatus of claim 19 or 20.

22. A gateway device, comprising:

a processor and a memory;

the memory stores computer instructions; the processor executes computer instructions stored by the memory to cause the gateway device to perform the video transmission method of any of claims 1 to 8.

23. A user device, comprising:

a processor and a memory;

the memory stores computer instructions; the processor executes the computer instructions stored by the memory to cause the user equipment to perform the video transmission method of claim 9 or 10.

24. A computer storage medium, characterized in that at least one program code is stored in the computer storage medium, which is loaded and executed by a processor to implement the video transmission method according to any one of claims 1 to 8, or to implement the video transmission method according to claim 9 or 10.