WO2022252953A1 - Procédé et appareil de transmission vidéo, dispositif, système et support de stockage informatique - Google Patents

Procédé et appareil de transmission vidéo, dispositif, système et support de stockage informatique Download PDF

Info

Publication number
WO2022252953A1
WO2022252953A1 PCT/CN2022/092470 CN2022092470W WO2022252953A1 WO 2022252953 A1 WO2022252953 A1 WO 2022252953A1 CN 2022092470 W CN2022092470 W CN 2022092470W WO 2022252953 A1 WO2022252953 A1 WO 2022252953A1
Authority
WO
WIPO (PCT)
Prior art keywords
video
code rate
target
gateway device
user equipment
Prior art date
Application number
PCT/CN2022/092470
Other languages
English (en)
Chinese (zh)
Inventor
汪伊明
罗勇
Original Assignee
华为技术有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 华为技术有限公司 filed Critical 华为技术有限公司
Publication of WO2022252953A1 publication Critical patent/WO2022252953A1/fr

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/63—Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
    • H04N21/647—Control signaling between network components and server or clients; Network processes for video distribution between server and clients, e.g. controlling the quality of the video stream, by dropping packets, protecting content from unauthorised alteration within the network, monitoring of network load, bridging between two different networks, e.g. between IP and wireless
    • H04N21/64723—Monitoring of network processes or resources, e.g. monitoring of network load
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L12/00—Data switching networks
    • H04L12/66—Arrangements for connecting between networks having differing types of switching systems, e.g. gateways
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
    • H04N21/4402—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/63—Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
    • H04N21/647—Control signaling between network components and server or clients; Network processes for video distribution between server and clients, e.g. controlling the quality of the video stream, by dropping packets, protecting content from unauthorised alteration within the network, monitoring of network load, bridging between two different networks, e.g. between IP and wireless
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/63—Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
    • H04N21/647—Control signaling between network components and server or clients; Network processes for video distribution between server and clients, e.g. controlling the quality of the video stream, by dropping packets, protecting content from unauthorised alteration within the network, monitoring of network load, bridging between two different networks, e.g. between IP and wireless
    • H04N21/64784—Data processing by the network

Definitions

  • the present application relates to the technical field of communication, and in particular to a video transmission method, device, equipment, system and computer storage medium.
  • the gateway device obtains the video fragments, and then sends the video fragments to the user equipment, which is played by the user equipment, which is a widely used video playback method.
  • the user equipment determines the current download speed, and then sends a video fragment set acquisition request to the gateway device based on the download speed, and the request is used to request to obtain video fragments that need to be played in the future .
  • the gateway device sends the video segment set requested by the request to the user equipment. Subsequent user equipment may play the multiple video segments in sequence.
  • Embodiments of the present application provide a video transmission method, device, device, system, and computer storage medium.
  • the problem of poor video playback quality is solved, and the technical solution is as follows:
  • a video transmission method comprising:
  • the gateway device obtains the network quality of the network between the user equipment; the gateway device obtains a video fragment set based on the network quality, and the obtained video fragment set includes multiple target video fragments; the gateway device sends the video fragment set to the user equipment .
  • the gateway device obtains a video fragment set including multiple target video fragments based on the network quality, so that the gateway device can flexibly determine the video fragment set based on the network quality, which can avoid playing stuck due to network fluctuations Occurrence of the frame problem can improve the playback quality of the user equipment.
  • the gateway device obtains a set of video fragments based on network quality, including:
  • the gateway device determines at least two target code rates based on the network quality and the reference code rate, the at least two target code rates include a first target code rate determined based on the reference code rate, and a second target code rate determined based on the reference code rate and network quality Code rate: the gateway device acquires multiple target video fragments with at least two target code rates based on the at least two target code rates and the identifiers of the multiple target video fragments.
  • the target video segment may be provided by a video source device.
  • the identification of the target video segment can be used to determine the content of the target video segment.
  • the gateway device obtains video fragments of at least two target coderates based on the network quality and the reference coderate, and then can flexibly determine the coderate of the video fragments played by the user equipment.
  • the reference code rate may be a code rate pre-stored in the gateway device, or a code rate acquired by the gateway device in a predetermined manner.
  • the reference bit rate can facilitate the control of the bit rate of the video slices in the set of video slices to be sent subsequently.
  • the gateway device receives the code rate sent by the user equipment, and determines the reference code rate based on the code rate sent by the user equipment.
  • the code rate sent by the user equipment may be a code rate determined by the user equipment based on its own network quality.
  • the gateway device determines the code rate as a reference code rate, so that at least two target code rates determined according to the reference code rate and the network quality of the gateway device can be related to both the network quality of the user equipment and the network quality of the gateway device.
  • the gateway device may determine this code rate as the reference code rate.
  • the code rate sent by the user equipment includes at least two code rates.
  • the gateway device may determine the reference code rate based on the at least two code rates. For example, the gateway device may determine one of the at least two code rates as the reference code rate, or may determine both of the at least two code rates as the reference code rate.
  • the step of determining the reference code rate based on the code rate sent by the user equipment may include the following two situations:
  • the first case when the network quality is lower than the quality threshold, the gateway device determines the minimum code rate among the code rates sent by the user equipment as the reference code rate. When the network quality is lower than the quality threshold, it indicates that the current network status is poor. The gateway device can determine the minimum code rate among the code rates sent by the user equipment as the reference code rate, so as to reduce the code rate of at least some video fragments in the subsequently determined video fragment set, so that the gateway device can facilitate When there is a difference, the target video segment is effectively transmitted to the user equipment.
  • the second case when the network quality is higher than the quality threshold, the gateway device determines the largest code rate among the code rates sent by the user equipment as the reference code rate. When the network quality is higher than the quality threshold, it indicates that the current network status is good. The gateway device may determine the largest code rate among the code rates sent by the user equipment as the reference code rate, so as to increase the code rates of at least some of the video fragments in the subsequently determined video fragment set. In order to make the code rate of the subsequently obtained target video fragments higher, further improve the transmission efficiency of the target video fragments when the network status is good, and realize the effective utilization of communication resources.
  • the gateway device determines the target code rate of the last video segment sent to the user equipment last time as the reference code rate.
  • the last video segment sent to the user equipment last time may refer to the last video segment in the video segment set sent to the user equipment by the gateway device before the video segment set sent to the user equipment this time.
  • the last video fragment is the closest video fragment to the set of video fragments to be sent this time, and thus can more accurately reflect the current network status.
  • the number of reference code rates determined by the aforementioned gateway device is different, and the manner of finally obtaining at least two target code rates is also different.
  • the embodiment of this application uses the following two methods as examples for illustration:
  • the gateway device determines one or more code rates as the reference code rate.
  • the gateway device can use the reference code rate as the first target code rate; when the network quality is lower than the quality threshold, make the second target code rate less than the reference code rate (that is, the second target code rate is less than the first target bit rate). In this way, it can be ensured that the code rate of at least some target video fragments is small, so that the target video fragments can be effectively transmitted to the user equipment when the network status is poor.
  • the second target code rate greater than the reference code rate that is, the second target code rate is greater than the first target code rate. In this way, it can be ensured that at least part of the target video fragments have a higher bit rate, which is convenient for realizing effective utilization of communication resources when the network status is good, and improving the clarity of the target video fragments with the target bit rate when playing.
  • the second target code rate may also be determined based on the first target code rate and network quality. For example, when the network quality is lower than the quality threshold, make the second target code rate smaller than the first target code rate; when the network quality is higher than the quality threshold, make the second target code rate greater than the first target code rate.
  • the gateway device determines at least two code rates as reference code rates.
  • the first target code rate and the second target code rate are both lower than the reference code rate; when the network quality is higher than the quality threshold, the first target code rate and the second target code rate Rates are greater than the benchmark code rate.
  • the first target code rate and the second target code rate can be made to be less than the reference code rate (in addition, if the at least two target code rates also include other target code rates, these other target code rates can also be all less than the reference code rate rate), so that the subsequent acquisition of target video fragments with a lower bit rate can facilitate the gateway device to effectively transmit the target video fragments to the user equipment when the network quality is poor.
  • the target code rates can be greater than the reference code rate (in addition, if the at least two target code rates also include other target code rates, the other target code rates can also be greater than the reference code rate), so that the subsequent obtained
  • the code rate of the target video fragment is relatively high, and then the transmission efficiency of the target video fragment is further improved when the network status is good, so as to realize the effective utilization of communication resources.
  • the quality threshold may be a preset value, which may be obtained according to a pre-conducted test. For example, when the network quality is lower than a certain threshold, and the video playback of the user equipment is severely stuck, the threshold may be determined as the quality threshold.
  • the gateway device acquires multiple target video fragments based on at least two target code rates and identifications of multiple target video fragments, including:
  • the gateway device For the identifier of each target video fragment, the gateway device obtains multiple candidate video fragments based on the identifier, and the multiple candidate video fragments have the same identifier and different code rates.
  • the video source device can send video fragments of a code rate through multicast or broadcast, and the identifier of the video fragment is the identifier of a target video fragment, and the gateway device can process the video fragment to obtain Get alternative video fragments with multiple bitrates.
  • obtaining the target video segment may include two optional implementation manners, in one optional manner:
  • the gateway device acquires a candidate video segment whose code rate identifies a corresponding target code rate from the multiple candidate video segments as the target video segment.
  • the gateway device acquires target candidate video segments whose code rate is greater than the corresponding target code rate from multiple candidate video segments, and removes the target
  • the target frame in the candidate video segment obtains the target video segment with the target bit rate, and the target frame includes a B frame or a non-key P frame. After removing B frames and non-key P frames, the impact on video fragmentation is small, and the bit rate of video fragmentation can be reduced, which is convenient for video fragmentation transmission when the network quality is low.
  • acquiring the network quality of the network with the user equipment includes: determining the network quality based on network parameters, where the network parameters include one or more of the following:
  • the packet loss rate or the number of packet loss of the network between the gateway device and the user equipment; the transmission delay of the network between the gateway device and the user equipment; the transmission rate of the network between the gateway device and the user equipment; the gateway device and the user equipment The interference index of the network between the gateway device and the video source device; the packet loss rate or the number of lost packets of the network between the gateway device and the video source device.
  • the gateway device obtains the network quality of the network with the user equipment, including:
  • the gateway device acquires the network quality of the network between the gateway device and the user equipment within the target time period before the current moment. In this way, the change trend of the network quality in the historical time period can be obtained, so that the target code rate can be determined based on the change trend.
  • the gateway device acquires the network quality of the network between the gateway device and the user equipment in real time.
  • the network quality obtained in this way can better reflect the current network status.
  • the network between the gateway device and the user equipment is a wireless local area network.
  • it may be a wireless fidelity (Wireless Fidelity, WiFi) network.
  • the present application provides a video transmission method, the method comprising:
  • the user equipment receives the video fragment set sent by the gateway device, the video fragment set is obtained by the gateway device based on the network quality of the network between the gateway device and the user equipment, and the received video fragment set includes a plurality of target video fragments;
  • the user equipment plays the set of video fragments.
  • the video fragment set played by the user includes multiple video fragments, and these video fragments are obtained by the gateway device based on the network quality, so that the video fragments played by the user equipment can be flexibly determined, which can avoid network fluctuations.
  • the occurrence of playback freeze can improve the playback quality of the user equipment.
  • the user equipment before the user equipment receives the respective sets of videos, the user equipment sends at least two code rates to the gateway device, and the at least two code rates are used for the gateway device to obtain the video fragment sets. That is, the user equipment can also control the bit rate of the video segment by sending the bit rate to the gateway device.
  • the present application provides a video transmission device.
  • the video transmission device may include at least one module, and the at least one module may be used to implement the video transmission method provided in the first aspect or various possible implementations of the first aspect.
  • the present application provides a video transmission device.
  • the video transmission device may include at least one module, and the at least one module may be used to implement the video transmission method provided in the second aspect or various possible implementations of the second aspect.
  • the present application provides a computer storage medium, in which computer instructions are stored, and the computer instructions instruct the computer device to execute the method provided by the above-mentioned first aspect or various possible implementations of the first aspect, or, Execute the above second aspect or the method provided by various possible implementations of the second aspect.
  • a sixth aspect provides a video transmission system, including: a gateway device and a user equipment, the gateway device includes the video transmission device in the third aspect, and the user equipment includes the video transmission device in the fourth aspect.
  • the present application provides a computer program product, where the computer program product includes computer instructions, and the computer instructions are stored in a computer storage medium.
  • the processor of the computer device can read the computer instructions from the computer storage medium, and the processor executes the computer instructions, so that the computer device executes the method provided by the above-mentioned first aspect or various possible implementations of the first aspect, or makes the computer
  • the device executes the above second aspect or the method provided by various possible implementations of the second aspect.
  • the present application provides a chip, which may include a programmable logic circuit and/or program instructions, used to implement the video transmission method as described in any one of the first aspect or the second aspect when the chip is running.
  • the present application provides a gateway device, including: a processor and a memory;
  • the memory stores computer instructions; the processor executes the computer instructions stored in the memory, so that the gateway device executes the first aspect or the video transmission method provided by various possible implementations of the first aspect.
  • the present application provides a user equipment, including: a processor and a memory; the memory stores computer instructions; the processor executes the computer instructions stored in the memory, so that the user equipment executes the second aspect or the first aspect.
  • a user equipment including: a processor and a memory; the memory stores computer instructions; the processor executes the computer instructions stored in the memory, so that the user equipment executes the second aspect or the first aspect.
  • Various possible implementations of the two aspects provide video transmission methods.
  • the gateway device obtains the video fragment set based on the network quality, and then the gateway device can also flexibly determine the video fragment set played by the user equipment, which can avoid the occurrence of the problem of playing stuck due to network fluctuations , which can improve the playback quality of the user equipment.
  • FIG. 1 is a schematic diagram of an application environment involved in a video transmission method provided by an embodiment of the present application
  • FIG. 2 is a schematic flowchart of a video transmission method provided by an embodiment of the present application.
  • FIG. 3 is a schematic diagram of network quality within a target duration provided by an embodiment of the present application.
  • FIG. 4 is a schematic flow diagram of obtaining a video slice set provided by an embodiment of the present application.
  • FIG. 5 is a corresponding schematic diagram of a video slice and a reference code rate in a video slice set provided in this embodiment of the present application;
  • Fig. 6 is a kind of flow chart that obtains a plurality of target video slices provided by this embodiment of the present application.
  • FIG. 7 is a set of video fragments sent by a gateway device to a user equipment provided in the related art
  • FIG. 8 is a schematic diagram of a set of video slices provided by an embodiment of the present application.
  • FIG. 9 is a schematic structural diagram of a video transmission device provided by an embodiment of the present application.
  • FIG. 10 is a schematic structural diagram of a video acquisition module provided by an embodiment of the present application.
  • Fig. 11 is a schematic structural diagram of another video acquisition module provided by the embodiment of the present application.
  • FIG. 12 is a schematic structural diagram of a video transmission device provided by an embodiment of the present application.
  • FIG. 13 is a schematic structural diagram of another video transmission device provided by an embodiment of the present application.
  • Fig. 14 is a schematic structural diagram of a video transmission device provided by an embodiment of the present application.
  • FIG. 1 is a schematic diagram of an application environment involved in a video transmission method provided by an embodiment of the present application.
  • the application environment includes user equipment 10 , gateway equipment 20 and video source equipment 30 .
  • the user equipment 10 and the gateway device 20 may be connected through a wired network or a wireless network.
  • the network between the user equipment and the gateway device is a local area network.
  • a wireless LAN or, a wired LAN.
  • the wireless local area network may be a wireless fidelity (Wireless Fidelity, WiFi) network.
  • the gateway device 20 and the video source device 30 may be connected through a wired network or a wireless network.
  • the user equipment 10 may include a mobile phone, a tablet computer, a television, a notebook computer or a desktop computer.
  • the gateway device 20 may include a router (such as an optical network terminal (Optical Network Terminal, ONT)), a digital subscriber line (Digital Subscriber Line, DSL) customer premise equipment (Customer-Premises Equipment, CPE), an access point (Access Point, AP ) equipment or cable modem (Cable modem), etc.
  • ONT optical Network Terminal
  • DSL Digital Subscriber Line
  • CPE Customer-Premises Equipment
  • AP access point
  • Cable modem cable modem
  • the video source device 30 is used to provide video resources to the gateway device 20 .
  • the video source device 30 may provide video resources to the gateway device 20 in a broadcast or multicast manner.
  • the video source device 30 may be a server or a server cluster.
  • the process of video transmission between the user equipment 10 and the gateway device 20 is as follows: the user equipment 10 can first determine the video to be played (such as a short video, a movie or an episode of a TV series). Afterwards, the user equipment 10 can determine a code rate and the identifier of the video segment (video segment file) in the video to be played based on the network state between the user equipment 10 and the gateway device 20 at regular time intervals (such as 10 seconds), And send a video segment set acquisition request to the gateway device 20, the video segment set acquisition request carries a file list, and the file list may include identifiers of multiple video segments and bit rates corresponding to the video segments.
  • the video segment set acquisition request carries a file list, and the file list may include identifiers of multiple video segments and bit rates corresponding to the video segments.
  • the gateway device 20 After the gateway device 20 obtains the request for obtaining the video fragment set, it may obtain the video fragment set based on the network quality with the user equipment 10, and send the video fragment set to the user equipment 10.
  • the video fragment set includes Multiple target video slices of at least two target bitrates.
  • the file list can be an m3u8 (m3u8 is an m3u file in UTF-8 encoding format) list
  • the format of the video segment can be a transport stream (Transport Stream, TS) format.
  • the video fragments involved in the embodiment of the present application may include image data and audio data, or may include only image data, which is not limited in the embodiment of the present application.
  • Fig. 2 is a schematic flowchart of a video transmission method provided by an embodiment of the present application. This method can be applied to the application environment shown in FIG. 1 . As shown in Figure 2, the method includes:
  • the user equipment sends a video segment set acquisition request to the gateway device.
  • the user equipment may send a video segment set acquisition request to the gateway device through the WiFi network.
  • the video fragment set acquisition request may include multiple video fragment sets to be played by the user equipment (the video fragment set may be determined by the user operating the user equipment, or determined by the user equipment based on a preset recommendation method).
  • the code rates of the multiple video slices may be the same or different. That is, the request for obtaining the video slice set may include one code rate, or at least two code rates.
  • the identifiers of multiple video fragments in the request for obtaining the video fragment set are arranged according to the playing order of the corresponding video fragments, or the request for obtaining the video fragment set may record the identifiers of the multiple video fragments The playback order of the corresponding video fragments.
  • the code rate may be a code rate determined by the user equipment based on its own network quality (for example, it may be a code rate determined by the user equipment based on Adaptive Bitrate Streaming (Adaptive Bitrate Streaming) , ABR) technology or the code rate determined by multicast Adaptive Bitrate Streaming (mABR) technology).
  • ABR Adaptive Bitrate Streaming
  • mABR multicast Adaptive Bitrate Streaming
  • the video fragment set acquisition request carries a file list, and the IDs of multiple video fragments to be played by the user equipment in the future and the code rates of the multiple video fragments may be recorded in the file list.
  • the file list in the video fragment set acquisition request includes a code rate, it may be as shown in Table 1 below.
  • 0, 1, 2, 3, and 4 are the identifications of video fragments, and these identifications correspond to video fragments of different contents, and the code rate of the video fragments corresponding to each identification is 256kbps, so, the file The list includes a bit rate of 256kbps.
  • the code rate of the video slice corresponding to 0 and 3 is 256kbps
  • the code rate of the video slice corresponding to 1 is 64kbps
  • the code rate of the video slice corresponding to 2 is 128kbps
  • the file list includes 3 bit rates of 256kbps, 64kbps and 128kbps.
  • the user equipment may periodically send a video fragment set acquisition request to the gateway device, and the length of the period may be equal to the playing duration of multiple video fragments in the video fragment set.
  • the gateway device acquires the network quality of the network between the gateway device and the user equipment.
  • the network quality is an index used to reflect the network status between the gateway device acquisition and the user equipment.
  • the network quality may be represented by a numerical value (or a score), or may be represented by a gear. For example, it could be high or low.
  • the gateway device may determine the network quality based on at least one network parameter.
  • the gateway device may use the weighted sum of the parameter values of at least one network parameter as a value reflecting the network quality; or, the gateway device may use the parameter value of at least one network parameter Normalization processing to obtain parameter values of the same dimension, and then use the weighted sum of at least one network parameter after processing as a value reflecting network quality.
  • the network quality can also be represented by an adaptive streaming score (Adaptive Streaming Score), which can range from 0 to 100, and a larger value indicates better network quality.
  • Adaptive Streaming Score Adaptive Streaming Score
  • a threshold may be set for each network parameter, the parameter value of each network parameter is compared with the corresponding threshold, and the target gear is determined based on the comparison result .
  • the number of parameter values lower than the corresponding threshold value (or higher than the corresponding threshold value) is obtained, the number is compared with a plurality of preset gear ranges, and the gear range where the number is located corresponds to The gear of is determined as the target gear.
  • the preset multiple gear ranges include a low gear range and a high gear range, if the number of parameter values lower than the corresponding threshold is within the low gear range, then the low gear corresponding to the low gear range is determined as the target gear bit.
  • the network parameters may include one or more of the following:
  • the first type of network parameter the packet loss rate or the number of packet loss of the first network. Wherein, the packet loss rate or the number of packet loss of the first network is negatively correlated with the network quality.
  • the second type of network parameter the transmission delay of the first network.
  • the transmission delay of the first network is negatively correlated with the network quality.
  • the third network parameter the transmission rate of the first network.
  • the transmission rate of the first network is positively correlated with the network quality.
  • the fourth type of network parameter the interference index of the first network.
  • the interference index can be used to reflect the intensity of external interference received by the first network, and it is negatively correlated with network quality.
  • the fifth network parameter the packet loss rate or the number of packet loss of the second network.
  • the network state of the second network will also have an impact on the network quality of the first network, and the packet loss rate or the number of packet loss of the second network is a parameter that reflects the network state of the second network.
  • the packet loss rate of the second network Or the number of dropped packets is negatively correlated with network quality.
  • the gateway device is an optical network terminal
  • the packet loss rate or the number of lost packets of the second network can be obtained through a passive optical network (Passive Optical Network, PON) interface of the optical network terminal.
  • PON Passive Optical Network
  • the network parameters can also include other parameters, such as network traffic, Transmission Control Protocol (Transmission Control Protocol, TCP) connection statistics, TCP synchronization sequence number (Synchronize Sequence Numbers, SYN)/confirmation character (Acknowledge character, ACK) time statistics, Round trip delay (Round Trip Time, RTT) statistics, TCP retransmission timeout statistics, TCP received the first data packet time statistics, estimated server response time statistics, TCP checksum error (Checksum fail), error header length ( One or more of parameters such as Bad header length, Bad data length, Duplicate statistics, Out of sequence statistics, and Timeout statistics.
  • TCP Transmission Control Protocol
  • TCP Transmission Control Protocol
  • TCP synchronization sequence number Synchrom Sequence Numbers
  • SYN Send Sequence Numbers
  • ACK Acknowledge character
  • RTT Round Trip Time
  • TCP retransmission timeout statistics TCP received the first data packet time statistics
  • estimated server response time statistics estimated server response time statistics
  • the gateway device can perceive the state of the WiFi air interface (the WiFi air interface can be considered as a virtual logical port between the gateway device and the user equipment) (such as sensing whether there is a loss of a block acknowledgment character (Block ACK) ) to obtain the aforementioned first to fourth network parameters.
  • the WiFi air interface can be considered as a virtual logical port between the gateway device and the user equipment
  • Block ACK block acknowledgment character
  • a first optional implementation manner the gateway device obtains the network quality of the network between the gateway device and the user equipment within a target time period before the current moment.
  • FIG. 3 is a schematic diagram of network quality within a target duration provided by an embodiment of the present application.
  • the abscissa is time t
  • the ordinate is network quality
  • the network quality within the target duration can be represented by a network quality curve. It can be seen that as time changes, the network quality within the target duration first becomes higher and then becomes lower.
  • the aforementioned current moment may be the moment when the gateway device receives the video fragment set acquisition request (the request may include the above-mentioned file list) sent by the user equipment, then the gateway device may receive the video fragment set sent by the user equipment After obtaining the request, obtain the network quality of the network between the gateway device and the user equipment within the target time period before receiving the request for obtaining the video segment set.
  • the target duration may be less than or equal to the duration of a period in which the user equipment sends the video segment set acquisition request to the gateway device.
  • the network quality determined in this implementation manner can reflect the change trend of the network quality in the historical time period, and it is convenient for the subsequent gateway device to determine the code rate of the video segment based on the change trend.
  • the gateway device acquires the network quality of the network between the gateway device and the user equipment in real time. That is, the gateway device can also acquire the network quality of the network between the user equipment and the current moment.
  • the current moment may be the moment when the gateway device receives the video fragment set acquisition request sent by the user equipment, then the gateway device may obtain the video fragment set acquisition request sent by the user equipment, The network quality of the network between.
  • the network quality acquired by this implementation method can better reflect the current network status, which is convenient for subsequent gateway devices to determine the code rate of video fragments based on the real-time network status.
  • the gateway device acquires a video fragment set based on network quality, and the acquired video fragment set includes multiple target video fragments.
  • Fig. 4 is a schematic flow chart of obtaining a video slice set provided by an embodiment of the present application. As shown in Figure 4, the process can include:
  • the gateway device determines a reference code rate.
  • the reference bit rate is the bit rate that the gateway device refers to when acquiring the bit rate of the video fragment set.
  • the gateway device receives the code rate sent by the user equipment, and determines the reference code rate based on the code rate sent by the user equipment.
  • the gateway device determines the code rate as a reference code rate, so that at least two target code rates determined according to the reference code rate and the network quality of the gateway device can be adaptively matched with the network quality of the user equipment and the network quality of the gateway device, In turn, it can reduce the possibility of the user equipment getting stuck when playing the video, and improve the playback quality.
  • the code rate sent by the user equipment may include one type, or may include at least two types.
  • the gateway device may directly determine the code rate as the reference code rate.
  • the gateway device may determine the reference code rate based on the at least two code rates. For example, the gateway device may determine one of the at least two code rates as the reference code rate, or may determine both of the at least two code rates as the reference code rate.
  • the gateway device determines one of the at least two code rates as the reference code rate, then according to the difference in network quality, the step of determining the reference code rate based on the code rate sent by the user equipment Can include the following two situations:
  • the first case when the network quality is lower than the quality threshold, the gateway device determines the minimum code rate among the code rates sent by the user equipment as the reference code rate. When the network quality is lower than the quality threshold, it indicates that the current network status is poor. The gateway device can determine the minimum code rate among the code rates sent by the user equipment as the reference code rate, so that the subsequent gateway device can refer to the code rate when obtaining the code rate of the video fragment set, so that at least part of the target video fragments can be guaranteed The bit rate is small, which reduces the possibility of the user device getting stuck when playing the video.
  • the code rates sent by the user equipment include 64 kilobits per second (kbps), 128 kbps and 256 kbps, and when the network quality is lower than the quality threshold, the gateway device may determine the reference code rate as 64 kbps.
  • the quality threshold when the network quality is represented by a numerical value, the quality threshold may be a preset numerical value, which may be obtained according to a pre-conducted network communication test. For example, when the network quality is lower than a certain threshold, and the video playback of the user equipment is severely stuck, the threshold may be determined as the quality threshold.
  • the quality threshold may be represented by a threshold gear among multiple gears, and when the obtained network quality gear is higher than the threshold gear, it is determined that the network quality is greater than the quality threshold, When the acquired network quality level is lower than the threshold level, it is determined that the network quality is less than the quality threshold.
  • the network quality may include three grades of high, medium and low, and the quality threshold is the grade between high and low. When the network quality is at a high level, it is determined that the network quality is greater than the quality threshold, and when the network quality is at a low level, it is determined that the network quality is less than the quality threshold.
  • the second case when the network quality is higher than the quality threshold, the gateway device determines the largest code rate among the code rates sent by the user equipment as the reference code rate. When the network quality is higher than the quality threshold, it indicates that the current network status is good. The gateway device can determine the maximum code rate among the code rates sent by the user equipment as the reference code rate, so that the subsequent gateway device can refer to the code rate when obtaining the code rate of the video fragment set, thereby ensuring the accuracy of at least some target video fragments.
  • the bit rate is relatively large, which facilitates the effective use of communication resources when the network status is good, so as to improve the clarity of the video played by the user equipment and improve the user experience.
  • the code rates sent by the user equipment include 64kbps, 128kbps and 256kbps, and when the network quality is higher than the quality threshold, the gateway device may determine the reference code rate as 256kbps.
  • the network quality may also be equal to the quality threshold.
  • the gateway device may determine the median code rate or the average code rate among the code rates sent by the user equipment as the reference code rate.
  • the code rates involved are illustrated by taking 64kbps, 128kbps and 256kbps as examples, but the code rates can also be other, such as 1 megabit per second (Mbps), 1.5Mbps, 15Mbps and 18Mbps etc.
  • the gateway device determines both the at least two code rates as the reference code rates. Then the gateway device can associate the at least two code rates with different video fragments in the video fragment set to be sent by the gateway device. For example, different one or more video fragments in the video fragmentation set correspond to different code rates sent by the user equipment, so in the subsequent process, the gateway device can base on the network quality and the reference code rate corresponding to each video fragment to determine the target bit rate for each video segment.
  • FIG. 5 is a schematic diagram of correspondence between video slices and a reference code rate in a video slice set provided by an embodiment of the present application.
  • the video fragment set there are multiple video fragments 1, 2, 3, 4, 5, 6, 7, 8 and 9 arranged in the order of playback, and the identifiers of these multiple video fragments are different .
  • the benchmark bit rate corresponding to video slices 1 and 2 is 64kbps
  • the benchmark bit rate corresponding to video slices 3, 4 and 5 is 128kbps
  • the benchmark bit rate corresponding to video slice 6 is 64kbps
  • the benchmark code rate corresponding to 5 is 256kbps.
  • the gateway device determines the target code rate of the last video segment sent to the user equipment last time as the reference code rate.
  • the last video segment sent to the user equipment last time may refer to the last video segment in the video segment set sent to the user equipment by the gateway device before the video segment set sent to the user equipment this time.
  • the last video fragment is the video fragment with the closest sending time to the set of video fragments to be sent this time, and the code rate of the last video fragment is determined as the reference code rate, so that subsequent gateway devices can obtain video fragments Refer to the bit rate when setting the bit rate of the set, so as to improve the relevance and coherence of the bit rates of two consecutive video fragment sets, and improve the playback quality.
  • the gateway device determines a preset code rate as a reference code rate.
  • the preset code rate may be pre-configured by the user in the gateway device, or may be a code rate predetermined by the gateway device according to the network environment.
  • the network environment includes a communication environment and/or a natural environment.
  • the gateway device determines at least two target code rates based on the network quality and the reference code rate.
  • the at least two target code rates include a first target code rate determined based on a reference code rate, and a second target code rate determined based on the reference code rate and network quality.
  • the first target code rate is the code rate of at least one target video slice in the video slice set
  • the second target code rate is also the code rate of at least one other target video slice in the video slice set.
  • the first target code rate and the second target code rate may be different.
  • the at least two target code rates may also include other target code rates determined based on the reference code rate, and/or, other target code rates determined based on the reference code rate and network quality.
  • the reference code rate can be used as a reference for the code rate of the video slices in the video slice set to be sent currently, so as to control the code rate of the video slices in the video slice set to be sent currently.
  • the process of determining at least two target code rates may include:
  • the reference code rate can be used as the first target code rate, and when the network quality is lower than the quality threshold, the second target code rate is lower than the reference code rate. rate (that is, less than the first target code rate).
  • the reference code rate is determined to be 128kbps, and when the network quality is lower than the quality threshold, the gateway device may determine the second target code rate among the at least two code rates as 64kbps.
  • the at least two target code rates also include other target code rates, the other target code rates may also be lower than the reference code rate.
  • some of the video fragments have a code rate of the reference code rate, and the other part of the video fragments have a code rate lower than the reference code rate. In this way, it can be ensured that the code rate of at least some target video fragments is small, so that the target video fragments can be effectively transmitted to the user equipment when the network status is poor.
  • the reference code rate can be used as the first target code rate, and when the network quality is higher than the quality threshold, the second target code rate is greater than the reference code rate (that is, greater than the first target code rate).
  • the reference code rate is determined to be 128kbps, and when the network quality is lower than the quality threshold, the gateway device may determine the second target code rate to be 256kbps.
  • the at least two target code rates also include other target code rates, the other target code rates may also be greater than the reference code rate.
  • some of the video segments have a code rate of the reference code rate, and the other part of the video segments have a code rate higher than the reference code rate. This can ensure that at least some of the target video segments have a relatively high bit rate, which facilitates the effective use of communication resources when the network status is good, and improves the clarity of the target video segments at the target bit rate when they are played.
  • the first target code rate is the same as the reference code rate as an example.
  • the first target code rate can also be different from the reference code rate, which is based on network quality and reference code rate. The rate is determined. For example, when the network quality is lower than the quality threshold, the first target code rate is less than the reference code rate; when the network quality is higher than the quality threshold, the first target code rate is greater than the reference code rate.
  • the gateway device determines at least two code rates as reference code rates
  • the second target code rate determined by the network quality is smaller than the reference code rate.
  • the first two video fragments in the video fragmentation set correspond to a benchmark bit rate of 64kbps
  • the second and third video fragments correspond to a benchmark bitrate of 128kbps
  • the network quality is lower than the quality threshold
  • the first target bitrate corresponding to the first two video fragments is 32kbps
  • the second target bitrate corresponding to the second and third video fragments is 64kbps.
  • the at least two target code rates also include other target code rates
  • the other target code rates may also be lower than the reference code rate.
  • both the first target code rate and the second target code rate are greater than the reference code rate.
  • the first two video fragments in the video fragmentation set correspond to a benchmark bit rate of 64kbps
  • the second and third video fragments correspond to a benchmark bitrate of 128kbps
  • the network quality is lower than the quality threshold
  • the first target bitrate corresponding to the first two video fragments is 128kbps
  • the second target bitrate corresponding to the second and third video fragments is 256kbps.
  • the at least two target code rates include other target code rates, they may also be greater than the reference code rate.
  • the gateway device may compare the network quality with the quality threshold in the following ways:
  • the gateway device can first determine the average value of the network quality within the target duration, and compare the average value with the quality threshold, and when the average value is greater than the quality threshold, determine The network quality is greater than the quality threshold, and when the average value is less than the quality threshold, it is determined that the network quality is less than the quality threshold; or, the minimum value of the network quality within the target duration can be compared with the quality threshold, and when the minimum value is greater than the quality threshold When the minimum value is less than the quality threshold, it is determined that the network quality is greater than the quality threshold, and when the minimum value is less than the quality threshold, it is determined that the network quality is less than the quality threshold.
  • quality thresholds include a set of quality thresholds within the target duration.
  • the set of quality thresholds can also be expressed as a quality threshold curve, and it can be determined that the network quality is greater than the quality threshold when the overall network quality curve represented by the network quality is above the quality threshold curve, and when the overall network quality curve is below the quality threshold curve, or When the network quality curve intersects with the quality threshold curve, it is determined that the network quality is less than the quality threshold.
  • the aforementioned steps S2022 to S2023 provide a way of determining at least two target code rates based on the network quality and the reference code rate.
  • the gateway device may also determine at least two target code rates based only on network quality.
  • the gateway device may be preset with a corresponding list of code rate and network quality. For example, the corresponding list may be as shown in Table 3:
  • each correspondence records at least two target code rates (in each correspondence shown in Table 3, each network quality corresponds to The code rate may include a first target code rate and a second target code rate) and the network quality corresponding to the at least two target code rates, and at least two target code rates in any two corresponding relationships are not completely the same. In this way, at least two target bit rates can be determined based on network quality.
  • the at least two target code rates determined by the gateway device are the code rates of multiple target video fragments subsequently sent to the user equipment.
  • the network quality obtained by the gateway device is the network quality of the historical time period
  • the length of the historical time period is the same as the length of the period in which the user equipment requests video fragmentation from the gateway device
  • the at least two target bit rate changes The trend may be the same as or similar to the change trend of the network quality in the historical time period.
  • the change trend of the code rate of the multiple target video fragments sent to the user equipment is also the same or similar to the change trend of the network quality in the historical time period, so that the video fragments can be transmitted based on the change trend of the network quality, Improve the transmission flexibility of video fragmentation.
  • the determination of the second target code rate based on the reference code rate and network quality is taken as an example for illustration.
  • the second target code rate may also be determined based on the first target code rate and network quality. For example, when the network quality is lower than the quality threshold, make the second target code rate smaller than the first target code rate; when the network quality is higher than the quality threshold, make the second target code rate greater than the first target code rate.
  • the gateway device acquires multiple target video segments based on the at least two target code rates and the identifiers of the multiple target video segments.
  • the identification of the target video segment may be provided by the user equipment, and the identification of the target video segment may be used to determine the content of the target video segment, and the content of the same video segment is the same.
  • FIG. 6 is a flow chart for obtaining multiple target video fragments provided in the embodiment of the present application.
  • the process for the gateway device to obtain multiple target video fragments in S2033 includes:
  • the gateway device acquires multiple candidate video segments based on the identification, and the multiple candidate video segments have the same identification and different code rates.
  • the video source device can send video fragments through multicast (Multicast) or broadcast (Broadcast), and the gateway device can establish multiple candidate fragment sets based on the video fragments provided by the video source device.
  • Each candidate fragment set Corresponding to an identifier, each set of candidate fragments includes multiple video fragments with the same identifier but different code rates.
  • the gateway device obtains a corresponding candidate segment set based on the identification, and uses the video segments in the candidate segment set as multiple candidate video segments corresponding to the identification.
  • the gateway device has a video codec function, for example, a video dynamic codec function, which is capable of decoding, encoding and encapsulating video fragments of various code rates.
  • the process of establishing multiple candidate fragment sets based on the video fragments provided by the video source device includes: A video segment is encoded and decoded to obtain a first candidate segment set corresponding to the first video segment, the identifiers of the plurality of video segments are the same as the identifier of the first video segment, and the first candidate segment A plurality of video slices in the set may include the first video slice.
  • the code rate of the video fragments provided by the video source device may be the maximum code rate supported by the video source device, so as to ensure the efficient encoding and decoding of the gateway device, thereby realizing the establishment of multiple candidate fragment sets.
  • the gateway device determines a target video segment based on the acquired multiple candidate video segments.
  • the gateway device acquires a candidate video segment whose code rate indicates a corresponding target code rate from multiple candidate video segments as the target video segment.
  • the target bit rate of the target video segment identified as x1 is 128 kbps.
  • the candidate video fragments identified as x1 obtained by the gateway device include three candidate video fragments with a code rate of 64kbps, 128kbps and 256kbps, and the gateway device can determine the candidate video fragment of 128kbps as the target video fragment .
  • the gateway device may obtain the target video segment by re-encoding and decoding. For example, obtain target candidate video segments whose code rate is greater than the corresponding target code rate from multiple candidate video segments, and remove the target frames in the target candidate video segments to obtain the target video with the target code rate Fragmentation, the target frame includes a B frame or a non-key P frame.
  • I frame, P frame and B frame are three kinds of video frames involved in video encoding.
  • I-frames are key frames that describe the image background and moving subjects.
  • the I frame can be generated without referring to other pictures, and the I frame is the reference frame of the P frame and the B frame (the quality of the I frame directly affects the quality of adjacent frames).
  • the P frame is a forward predictive coded frame, and the P frame is a frame generated based on a predetermined algorithm with the preceding I frame or P frame as a reference frame.
  • a B frame is a frame obtained by predicting the preceding I or P frame and the following P frame.
  • P frames include key P frames and non-key P frames.
  • Key P frames have a large correlation with subsequent frames, and non-key P frames have a small correlation with subsequent frames. Deleting non-key P frames will also have a relatively small impact on subsequent video images. Small and may be imperceptible to the naked eye.
  • the degree of association between the key P frame and the subsequently associated frame is greater than a preset threshold, and the degree of association between the non-key P frame and the subsequently associated frame is smaller than the preset threshold. The degree of association may be positively correlated with the number of associated frames.
  • the gateway device removes the target frame in the target candidate video fragment, and the process of obtaining the target video fragment with the target code rate may include:
  • A1. Decoding target candidate video fragments to obtain target candidate video data.
  • A3. Repackaging the target candidate video data with the target frame removed to obtain the target video fragments with the target bit rate.
  • the gateway device may remove the target frame in the target candidate video segment based on the agreed target video coding mode with the user equipment.
  • the target video coding method can support multiple preset bit rates, and the gateway device can remove the target frame in the target candidate video fragment, so that the target bit rate of the obtained target video fragment is one of the various preset bit rates. A sort of. In this way, the transmission of the target video segment and the playback on the user equipment side are facilitated.
  • the preset bit rate supported by the target video coding method includes 64kbps, 128kbps and 256kbps, and the bit rate of the target candidate video fragment is 128kbps, then the gateway device removes the target frame and obtains the target video fragment target The code rate is 64kbps.
  • the gateway device may obtain the target video fragments whose code rate is greater than the target code rate corresponding to the identifier. Select a video segment, and perform the above A2, remove the target frame of the target candidate video segment, and perform frame reduction processing. However, if the target candidate video segment whose code rate is greater than the corresponding target code rate is a retransmitted video segment, the gateway device may not remove the target frame of the target candidate video segment to ensure data transmission stability.
  • the gateway device may also determine a target code rate based on the network quality and the reference code rate. For example, assuming that the gateway device determines a code rate as the reference code rate, when the network quality is lower than the quality threshold, the gateway device determines a code rate that is less than the reference code rate as a target code rate; when the network quality is higher than When the quality threshold is reached, the gateway device determines a code rate greater than the reference code rate as a target code rate.
  • the gateway device determines at least two code rates as the reference code rate, then when the network quality is lower than the quality threshold, the gateway device determines the code rate that is less than or equal to the minimum code rate in the reference code rate as a target code rate; when When the network quality is higher than the quality threshold, the gateway device determines a code rate that is greater than or equal to the maximum code rate in the reference code rates as a target code rate.
  • the process for the gateway device to acquire multiple target video segments refer to the aforementioned S20331 to S20332, which will not be described in detail in this embodiment of the present application.
  • the gateway device sends the video fragment set to the user equipment.
  • the gateway device may send the video fragment set to the user equipment in a unicast (Unicast) manner.
  • Unicast unicast
  • the gateway device may periodically execute S201 to S204 to send the video fragment set to the user equipment, and the period may be the playing duration of the video fragment set. For example, if the playing duration of each video fragment set is 10 seconds, the gateway device may send the video fragment set to the user equipment once by executing S201 to S204 every 10 seconds.
  • a situation where the user equipment freezes is: when the gateway device sends the video fragment set to the user equipment for the nth time, the video fragment set being played by the user equipment may be the one sent by the gateway device to the user equipment for the n-1 time A collection of video fragments. However, if due to network reasons, the gateway device has not yet completed sending the video fragment set sent to the user equipment for the nth time, and the user equipment has finished playing the video fragment set sent to the user equipment for the n-1 time, then Problems such as freezing may occur on the user device. Wherein, n is an integer greater than 1.
  • Figure 7 is a set of video fragments sent by a gateway device to the user equipment provided in the related art.
  • the video fragment set has 9 video fragments arranged according to the playback order f, respectively 1, 2, 3, 4, 5, 6, 7, 8 and 9, these multiple video fragments have different identifiers.
  • the code rate of these 9 video fragments is 128kbps, which cannot be changed based on the change of network quality, and the flexibility is poor.
  • the code rate of the video fragments in the set of video fragments sent in a period may include a variety of different code rates, and the code rate may change with the change of the network quality, which is more flexible. high.
  • the user equipment plays the set of video fragments.
  • the user equipment may play multiple video fragments in the video fragment set in sequence.
  • the user equipment supports decoding and playing video fragments with different bit rates.
  • the user equipment may support decoding and playing files in TS format with different bit rates.
  • FIG. 8 is a schematic diagram of a video fragment set provided in the embodiment of the present application.
  • the video fragments 1, 2, 3, 4, 5, 6, 7, 8 and 9 arranged in f have different identifications.
  • the code rate of video slices 1 and 2 is 64kbps
  • the code rate of video slices 3, 4 and 5 is 256kbps
  • the code rate of video slice 6 is 128kbps
  • the code rate of video slices 7, 8 and 9 is 64kbps. It can be seen that in this video fragment set, the change trend of the code rate of the video fragments is similar to the change trend of the network quality shown in FIG. 3 , which can reduce the risk of freezing when the user equipment plays the video fragment set.
  • each video segment acquisition request sent by the user equipment to the gateway device may include at least two code rates, and the types of code rates requested each time are different, and the use of code rates is highly flexible.
  • the manner in which the user equipment determines at least two code rates may refer to the foregoing manner in which the gateway device determines at least two target code rates.
  • the user equipment acquires the network quality of the network between the user equipment and the gateway device, and determines at least two code rates based on the network quality.
  • the user equipment determines at least two code rates based on the network quality and the reference code rate. For the determination method of the foregoing network quality, reference may be made to S202.
  • the network parameter reflecting the network quality is a network parameter that can be obtained by the user equipment, such as a transmission rate.
  • the manner of determining at least two code rates based on the network quality and the reference code rate reference may be made to S2032.
  • the manner in which the user equipment determines the reference code rate is different from the manner in which the gateway device determines the reference code rate. For example, the user equipment determines the identified code rate of the last video segment sent to the gateway device last time as the reference code rate, or determines the preset code rate as the reference code rate.
  • the gateway device obtains multiple video fragments based on the network quality, and then can flexibly determine the video fragments played by the user equipment, which can avoid the playback caused by network fluctuations. The problem of stuttering occurs, thereby improving the playback quality of the user equipment.
  • the gateway device directly obtains multiple video fragments of the code rate carried by the request according to the request of the user equipment, and sends the multiple video fragments to the user equipment, regardless of the gateway device and the user equipment. This may make it difficult for the gateway device to effectively send multiple video fragments to the user equipment, which may cause the user equipment to freeze when playing the video.
  • the video segment acquisition request sent by the user equipment to the gateway device since the video segment acquisition request sent by the user equipment to the gateway device only carries one code rate each time, correspondingly, the video segment set sent by the gateway device to the user equipment only includes one Multiple video slices of different bitrates. The code rate of the video slice set is single, and the flexibility of using the code rate is low.
  • the gateway device may acquire a set of video fragments sent to the user equipment based on the impact of network quality on video transmission, thereby increasing the probability that the set of video fragments is effectively transmitted to the user equipment.
  • the code rate in the video segment acquisition request sent by the user equipment to the gateway device can also be the code rate determined by the user equipment based on the network quality, so that both ends of the user equipment and the gateway device can jointly base on the network
  • the quality is used to determine the bit rate in the video fragment set, and further improve the probability of effective transmission and playback of the video fragment set.
  • the set of video fragments sent to the user equipment also includes multiple target video fragments of at least two target code rates.
  • code rates There are different types of code rates for the video slice sets, and the use of code rates is highly flexible.
  • the target code rate determined by the gateway device is at least partly lower than the reference code rate (eg, the second target code rate is smaller than the reference code rate).
  • the target code rate determined by the gateway device is at least partially greater than the reference code rate (eg, the second target code rate is greater than the reference code rate).
  • the network quality is higher than the quality threshold, it indicates that the network status is good.
  • at least part of the target video segments with a higher bit rate can be subsequently obtained, and then the transmission efficiency of the target video segments can be further improved when the network status is good, so as to realize effective utilization of communication resources.
  • the video transmission method provided by the embodiment of the present application can flexibly determine a reference code rate based on network quality, and flexibly determine a target code rate based on the reference code rate, thereby realizing flexible and effective transmission of video fragments.
  • the device 90 includes: a quality acquisition module 901, used for the gateway device to acquire the network quality of the network between the user equipment; a video acquisition module 902, used for The gateway device acquires a video fragment set based on the network quality, and the acquired video fragment set includes multiple target video fragments; the sending module 903 is configured to send the video fragment set to the user equipment.
  • the video transmission device obtained by the embodiment of the present application obtains a video fragment set including multiple video fragments based on the network quality, and then can flexibly determine the video fragments played by the user equipment, which can avoid network The problem of playback freeze caused by fluctuations occurs, thereby improving the playback quality of user equipment.
  • FIG. 10 is a schematic structural diagram of a video acquisition module provided in an embodiment of the present application.
  • the video acquisition module 902 includes: a target code rate determination unit 9021, configured to Rate determines at least two target code rates, at least two target code rates include a first target code rate determined based on the reference code rate, and a second target code rate determined based on the reference code rate and network quality; the slice acquisition unit 9022, The method is used for obtaining multiple target video slices with at least two target code rates based on at least two target code rates and identifications of the multiple target video slices.
  • FIG. 11 is a schematic structural diagram of another video acquisition module provided by an embodiment of the present application.
  • the video acquisition module 902 further includes: a first reference determination unit 9023, configured to receive the code rate sent by the user equipment, and determine the reference code rate based on the code rate sent by the user equipment; a second reference determination unit 9024, configured to set the The target code rate of the last video fragment sent to the user equipment last time is determined as the reference code rate.
  • the code rate sent by the user equipment includes at least two code rates
  • the first reference determination unit 9023 is configured to: when the network quality is lower than the quality threshold, the gateway device uses the smallest code rate among the code rates sent by the user equipment rate is determined as the reference code rate; when the network quality is higher than the quality threshold, the gateway device determines the maximum code rate among the code rates sent by the user equipment as the reference code rate.
  • the first target code rate is the same as the reference code rate; in an optional manner, when the network quality is lower than the quality threshold, the second target code rate is less than the reference code rate; in another optional In the manner, when the network quality is higher than the quality threshold, the second target code rate is greater than the reference code rate.
  • the target code rate determination unit 9021 is configured to: use at least two code rates as reference code rates; when the network quality is lower than the quality threshold, both the first target code rate and the second target code rate are less than the reference code rate ; When the network quality is higher than the quality threshold, both the first target code rate and the second target code rate are greater than the reference code rate.
  • the slice obtaining unit 9022 is configured to: for the identification of each target video slice, obtain multiple candidate video slices based on the mark, the multiple candidate video slices have the same mark and different code rates; from Obtain the candidate video fragment whose code rate corresponds to the target code rate from the multiple candidate video fragments as the target video fragment, or, when the network quality is lower than the quality threshold, select the candidate video fragment from the multiple candidate video fragments Obtain the target candidate video segment whose code rate is greater than the target code rate corresponding to the identification, remove the target frame in the target candidate video segment to obtain the target video segment with the target code rate, and the target frame includes B frame or non-key P frame.
  • the quality acquisition module 901 is configured to: determine the network quality based on network parameters, the network parameters include one or more of the following: the packet loss rate or the number of packet loss of the network between the gateway device and the user equipment; The transmission delay of the network between the device and the user device; the transmission rate of the network between the gateway device and the user device; the interference index of the network between the gateway device and the user device; the network between the gateway device and the video source device The packet loss rate or number of dropped packets.
  • the quality acquisition module 901 is configured to: acquire the network quality of the network between the gateway device and the user equipment within the target time period before the current moment; or acquire the network quality of the network between the gateway device and the user equipment in real time .
  • the network between the gateway device and the user equipment is a wireless local area network.
  • Fig. 12 is a schematic structural diagram of a video transmission device 120 provided by an embodiment of the present application.
  • the device 120 includes: a receiving module 121, configured to receive a video fragment set sent by a gateway device.
  • the video fragment set is a gateway device based on the gateway device.
  • the network quality of the network between the video transmission device 120 is obtained, and the received video fragment set includes multiple target video fragments; the playing module 122 is configured to play the video fragment set.
  • the gateway device obtains a video fragment set including multiple video fragments based on the network quality, and then can flexibly determine the video fragments played by the user equipment, which can avoid Due to network fluctuations, the problem of stuttering occurs when playing a collection of video fragments, thereby improving the playback quality of user equipment.
  • FIG. 13 is a schematic structural diagram of another video transmission device provided by an embodiment of the present application.
  • the video transmission device 120 further includes: a code rate sending module 123, configured to send at least Two code rates, at least two code rates are used for the gateway device to obtain the video fragment set.
  • FIG. 14 is a schematic structural diagram of a video transmission device provided by an embodiment of the present application.
  • the video transmission device may be the gateway device or user equipment involved in the above embodiments.
  • the video transmission device 140 includes: a processor 141, a memory 142, Communication interface 143 and bus 144.
  • processors 141 there may be one or more processors 141, and FIG. 10 only shows one of the processors 141.
  • the processor 141 may be a central processing unit (Central Processing Unit, CPU). If the gateway device has multiple processors 141, the types of the multiple processors 141 may be different, or may be the same. Optionally, multiple processors 141 of the gateway device may also be integrated into a multi-core processor.
  • CPU Central Processing Unit
  • the memory 142 stores computer instructions and data; the memory 142 may store computer instructions and data required to implement the video transmission method provided in this application, for example, the memory 142 stores instructions for implementing the steps of the video transmission method.
  • the memory 142 may be any one or any combination of the following storage media: non-volatile memory (such as read only memory (ROM), solid state disk (SSD), hard disk (HDD), optical disk), volatile memory.
  • the communication interface 143 may be any one or any combination of the following devices: a network interface (such as an Ethernet interface), a wireless network card and other devices with network access functions.
  • the communication interface 143 is used for data communication between the gateway device and other computer devices or terminals.
  • the bus 144 can connect the processor 141 with the memory 142 and the communication interface 143 . In this way, through the bus 144, the processor 141 can access the memory 142, and can also use the communication interface 143 to perform data interaction with other computer devices or terminals.
  • the processor 141 when the video transmission device is a gateway device, the processor 141 also has a video processing function, which can decode, encode and encapsulate video fragments.
  • the processor 141 When the video transmission device is a user device, the processor 141 also supports decoding and playing video fragments of various bit rates.
  • the video transmission device executes computer instructions in the memory 142, so that the video transmission device 140 implements the video transmission method provided in this application.
  • the embodiment of the present application further provides a video transmission system, and the video transmission system includes the gateway device and the user equipment provided in the embodiment of the present application.
  • the video transmission system may also include a video source device.
  • non-transitory computer storage medium including instructions, such as a memory including instructions, the above instructions can be executed by a processor of a video source device to complete the video transmission shown in various embodiments of the present application method.
  • the non-transitory computer storage medium may be read only memory (ROM), random access memory (RAM), CD-ROM, magnetic tape, floppy disk, and optical data storage device, among others.
  • the video transmission device provided in the above embodiment implements the video transmission method
  • the division of the above-mentioned functional modules is used as an example for illustration.
  • the above-mentioned function allocation can be completed by different functional modules according to needs. , which divides the internal structure of the device into different functional modules to complete all or part of the functions described above.
  • the video transmission device and the video transmission method embodiments provided in the above embodiments belong to the same concept, and the specific implementation process thereof is detailed in the method embodiments, and will not be repeated here.

Landscapes

  • Engineering & Computer Science (AREA)
  • Signal Processing (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Multimedia (AREA)
  • Computer Security & Cryptography (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Abstract

La présente demande se rapporte au domaine technique des communications, et concerne un procédé et un appareil de transmission vidéo, un dispositif, un système, et un support de stockage informatique. Le problème de mauvaise qualité de lecture vidéo est résolu. Le procédé comprend les étapes suivantes : un dispositif de passerelle acquiert la qualité de réseau d'un réseau entre le dispositif de passerelle et un équipement utilisateur ; le dispositif de passerelle acquiert un ensemble de fragments vidéo sur la base de la qualité de réseau, l'ensemble de fragments vidéo acquis comprenant une pluralité de fragments vidéo cibles ; le dispositif de passerelle envoie l'ensemble de fragments vidéo à l'équipement utilisateur. La présente demande peut améliorer la qualité de lecture de l'équipement utilisateur, et la présente demande est utilisée pour une transmission vidéo entre le dispositif de passerelle et l'équipement utilisateur.
PCT/CN2022/092470 2021-05-31 2022-05-12 Procédé et appareil de transmission vidéo, dispositif, système et support de stockage informatique WO2022252953A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202110604743.XA CN115484505A (zh) 2021-05-31 2021-05-31 视频传输方法、装置、设备、系统以及计算机存储介质
CN202110604743.X 2021-05-31

Publications (1)

Publication Number Publication Date
WO2022252953A1 true WO2022252953A1 (fr) 2022-12-08

Family

ID=84322776

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2022/092470 WO2022252953A1 (fr) 2021-05-31 2022-05-12 Procédé et appareil de transmission vidéo, dispositif, système et support de stockage informatique

Country Status (2)

Country Link
CN (1) CN115484505A (fr)
WO (1) WO2022252953A1 (fr)

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101795264A (zh) * 2009-12-30 2010-08-04 北京新岸线网络技术有限公司 一种视频数据传送方法及系统
CN102118357A (zh) * 2009-12-31 2011-07-06 华为技术有限公司 一种流媒体处理方法、设备和系统
CN103581701A (zh) * 2012-08-07 2014-02-12 株式会社Ntt都科摩 向多个客户端传送多媒体数据的方法、系统和网络
US20160044342A1 (en) * 2013-04-05 2016-02-11 Sony Coproration Controller, control method, computer program, and video transmission system
CN105898408A (zh) * 2016-04-28 2016-08-24 乐视控股（北京）有限公司 视频播放方法及装置
CN107800665A (zh) * 2016-08-31 2018-03-13 华为技术有限公司 多媒体传输方法、接入网设备及终端
CN109729396A (zh) * 2017-10-31 2019-05-07 华为技术有限公司 视频分片数据传输方法和装置
CN110677727A (zh) * 2019-09-10 2020-01-10 北京奇艺世纪科技有限公司 音视频播放方法、装置、电子设备及存储介质

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101795264A (zh) * 2009-12-30 2010-08-04 北京新岸线网络技术有限公司 一种视频数据传送方法及系统
CN102118357A (zh) * 2009-12-31 2011-07-06 华为技术有限公司 一种流媒体处理方法、设备和系统
CN103581701A (zh) * 2012-08-07 2014-02-12 株式会社Ntt都科摩 向多个客户端传送多媒体数据的方法、系统和网络
US20160044342A1 (en) * 2013-04-05 2016-02-11 Sony Coproration Controller, control method, computer program, and video transmission system
CN105898408A (zh) * 2016-04-28 2016-08-24 乐视控股（北京）有限公司 视频播放方法及装置
CN107800665A (zh) * 2016-08-31 2018-03-13 华为技术有限公司 多媒体传输方法、接入网设备及终端
CN109729396A (zh) * 2017-10-31 2019-05-07 华为技术有限公司 视频分片数据传输方法和装置
CN110677727A (zh) * 2019-09-10 2020-01-10 北京奇艺世纪科技有限公司 音视频播放方法、装置、电子设备及存储介质

Also Published As

Publication number Publication date
CN115484505A (zh) 2022-12-16

Similar Documents

Publication Publication Date Title
CN110536179B (zh) 一种内容分发系统和方法
US10911506B2 (en) Methods for quality-aware adaptive streaming over hypertext transfer protocol and reporting quality of experience
CN107210993B (zh) 无线网络中的多媒体内容流的动态速率调整的方法与系统
US7680047B2 (en) Maximum transmission unit tuning mechanism for a real-time transport protocol stream
CN109600610B (zh) 一种数据编码方法、终端及计算机可读存储介质
US20120063462A1 (en) Method, apparatus and system for forwarding video data
WO2008125029A1 (fr) Procédé, système et dispositif permettant de contrôler le débit de codage du flux multimédia
KR20060115216A (ko) 멀티미디어 스트리밍 송신 장치 및 방법
WO2020199929A1 (fr) Procédé de distribution de données et dispositif de réseau
CA2846013A1 (fr) Generation d'une pluralite de flux
US20220272397A1 (en) Methods and systems for providing video at multiple bit rates
WO2022252953A1 (fr) Procédé et appareil de transmission vidéo, dispositif, système et support de stockage informatique
WO2015044104A1 (fr) Gestion de trafic vidéo
WO2021164405A1 (fr) Procédés de codage et de décodage de données, ainsi que dispositif et système associés
CN101645903A (zh) 一种多媒体数据的传输方法及装置
KR100631516B1 (ko) 스트리밍 시스템 및 적응적 대역 할당 방법
CN113207011A (zh) 一种短视频处理用预加载方法
CN113438519B (zh) 一种视频传输方法、装置、电子设备及存储介质
Chhangte et al. Index coding at the WiFi edge: An implementation study for video delivery
WO2019120532A1 (fr) Procédé et appareil de commande de débit binaire adaptatif dans un réseau de communication sans fil
WO2024051426A1 (fr) Procédé et appareil d'ajustement de rendement de codage de flux vidéo, dispositif informatique et support de stockage
Liu et al. An intelligent video streaming delivery of SVC based on rateless UEP convolutional code
CN116980713A (zh) 一种带宽检测方法、装置、电子设备及存储介质

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 22815000

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 22815000

Country of ref document: EP

Kind code of ref document: A1