WO2014100973A1

WO2014100973A1 - Video processing method, device and system

Info

Publication number: WO2014100973A1
Application number: PCT/CN2012/087420
Authority: WO
Inventors: 吴俊峰; 王瑜
Original assignee: 华为技术有限公司
Priority date: 2012-12-25
Filing date: 2012-12-25
Publication date: 2014-07-03
Also published as: CN104012054A

Abstract

Provided in an embodiment of the present invention are a video processing method, device and system, the method comprising: a proxy device receives at least one video data packet transmitted by a video server, determines that the at least one video data packet is transmitted based on HTTP/TCP, parses the at least one video data packet, conducts video frame recombination on the parsed video fragments to form at least one video frame, and identifies the priority level of each video frame; the proxy device discards the at least one video frame according to the status parameter of an air interface between a base station and a UE and the priority level of each video frame, and transmits to the base station the video frames remaining after the discard treatment. The technical solution of the present invention solves the problem of reduced video quality at a client terminal when a video data packet is falsified to solve transmission congestion.

Description

The present invention relates to video technologies, and in particular, to a video processing method, device, and system. Background technique

As a widely popular business on the Internet, video services occupy most of the traffic in the network and are receiving more and more attention. At the same time, video technologies related to video services are also evolving. For example, video coding technology is continually evolving toward higher compression and higher quality. Video transmission technology is also continuing to innovate, enabling video to adapt to the special channel of wireless channels. Environment, to meet the needs of users watching videos in a mobile environment.

The existing video transmission technologies are divided into two categories: Hypertext transfer protocol (HTTP)/Transmission Control Protocol (TCP) transmission technology and implementation-based transport protocol (Real-time) Transport Protocol (referred to as RTP) / User Datagram Protocol (UDP) transmission technology. Among them, the HTTP/TCP transmission technology is difficult to be shielded by operators because it uses the same features as web browsing, and therefore gradually becomes the mainstream of video transmission technology.

In the HTTP/TCP-based video transmission technology, the video server sends a video data packet to the base station; the base station (eNB) can discard part of the video data according to the air interface status between the base station and the user equipment (User Equipment, UE for short). The package performs congestion control. However, since the HTTP/TCP transmission technology uses the end-to-end retransmission technology to ensure reliable transmission of video data, any video data packets discarded by the base station are detected and retransmitted by the video server. Therefore, the base station is in the process of congestion control. When discarding video packets, an associated mechanism is needed to trick the video server to circumvent retransmissions. Currently, the commonly used spoofing mechanism is that a base station falsifies a video data packet to replace a discarded video data packet, but falsifying a video data packet often causes the UE to be unable to parse subsequent video frames, resulting in a significant degradation in video quality. Summary of the invention

Embodiments of the present invention provide a video processing method, device, and system, which are used to solve a problem by using a pseudo The video data packet is created to solve the problem of transmission congestion and the video quality of the client is degraded. The first aspect provides a video processing method, including:

The proxy device receives at least one video data packet sent by the video server;

Determining, by the proxy device, that the at least one video data packet is based on HTTP/TCP transmission, parsing the at least one video data packet, and performing video frame on the video segment parsed from the at least one video data packet Recombining, forming at least one video frame, and identifying a priority of each of the video frames;

And the proxy device performs discarding processing on the at least one video frame according to a state parameter of an air interface between the base station and the user equipment UE and a priority of each of the video frames;

And transmitting, by the proxy device, the remaining video frames in the at least one video frame to the base station after performing the discarding process.

With reference to the first aspect, in a first possible implementation manner of the first aspect, the proxy device, according to a state parameter of an air interface between a base station and a user equipment UE, and a priority of each of the video frames, Before at least one video frame is discarded, the method includes:

The proxy device receives a status parameter of the air interface sent by the base station.

With reference to the first possible implementation manner of the first aspect, in a second possible implementation manner of the first aspect, the receiving, by the proxy device, the status parameter of the air interface sent by the base station includes: receiving, by the proxy device a status parameter of the air interface periodically sent by the base station.

With reference to the first possible implementation manner of the first aspect, in a third possible implementation manner of the first aspect, the receiving, by the proxy device, the status parameter of the air interface sent by the base station includes: The base station sends a parameter acquisition request;

The proxy device receives a status parameter of the air interface returned by the base station according to the parameter acquisition request.

In combination with the first aspect or the first possible implementation of the first aspect or the second possible implementation of the first aspect or the third possible implementation of the first aspect, the fourth possibility in the first aspect In an implementation manner, the air interface status parameter includes at least one of a size of the current buffer data of the air interface, an average delay of the air interface, and a packet loss rate of the air interface.

Combining the first aspect or the first possible implementation of the first aspect or the second possible implementation of the first aspect or the third possible implementation of the first aspect or the fourth possible implementation of the first aspect In a fifth possible implementation manner of the first aspect, the proxy device determines The at least one video data packet is based on HTTP/TCP transmission and includes:

Determining, by the proxy device, that the at least one video data packet is based on HTTP/TCP transmission according to a content type field in an HTTP response header in the at least one video data packet; or

The proxy device determines that the at least one video data packet is based on HTTP/TCP transmission according to a format of the at least one video data packet.

The second aspect provides a video processing method, including:

The base station sends a state parameter of the air interface between the base station and the user equipment UE to the proxy device; the base station receives the video frame sent by the proxy device, and the video frame sent by the proxy device to the base station is the proxy device And at least one video formed by recombining the video frames of the video fragments in the at least one HTTP/TCP transmission-based video data packet sent by the video server to the proxy device according to the state parameter of the air interface and the priority of the video frame The remaining video frames after the frame is discarded;

The base station sends the received video frame to the UE.

With reference to the second aspect, in a first possible implementation manner of the second aspect, the sending, by the base station, the status parameter of the air interface between the base station and the user equipment UE to the proxy device includes:

The base station periodically sends the state parameter of the air interface to the proxy device.

With reference to the second aspect, in a second possible implementation manner of the second aspect, the sending, by the base station, the status parameter of the air interface between the base station and the user equipment UE to the proxy device includes:

Receiving, by the base station, a parameter acquisition request sent by the proxy device;

Sending the status of the air interface to the proxy device

With reference to the second aspect or the first possible implementation manner of the second aspect, or the second possible implementation manner of the second aspect, in a third possible implementation manner of the second aspect, the air interface status parameter includes At least one of a size of the current buffer data of the air interface, an average delay of the air interface, and a packet loss rate of the air interface.

The third aspect provides a proxy device, including:

a first receiving module, configured to receive at least one video data packet sent by the video server, and an analysis processing module, configured to determine that the at least one video data packet is based on HTTP/TCP transmission, and parse the at least one video data packet And performing video frame recombination on the video fragments parsed from the at least one video data packet to form at least one video frame, and identifying each The priority of the video frame;

And a discarding processing module, configured to discard the at least one video frame according to a state parameter of an air interface between the base station and the user equipment UE and a priority of each of the video frames;

And a first sending module, configured to send the remaining video frames in the at least one video frame to the base station after the discarding processing module performs the discarding process.

With reference to the third aspect, in a first possible implementation manner of the third aspect, the proxy device further includes: a second receiving module, configured to discard the at least one video frame in the discarding processing module Before processing, receiving a status parameter of the air interface sent by the base station.

With reference to the first possible implementation manner of the third aspect, in a second possible implementation manner of the third aspect, the second receiving module is configured to receive a status parameter of the air interface periodically sent by the base station .

In conjunction with the first possible implementation of the third aspect, in a third possible implementation of the third aspect, the proxy device further includes: a second sending module, configured to receive, at the second receiving module Before the state parameter of the air interface is described, sending a parameter acquisition request to the base station;

The second receiving module is specifically configured to receive a state parameter of the air interface that is returned by the base station according to the parameter obtaining request.

In combination with the third aspect or the first possible implementation of the third aspect or the second possible implementation of the third aspect or the third possible implementation of the third aspect, the fourth possibility in the third aspect In an implementation manner, the air interface status parameter includes at least one of a size of the current buffer data of the air interface, an average delay of the air interface, and a packet loss rate of the air interface.

Combining the third aspect or the first possible implementation of the third aspect or the second possible implementation of the third aspect or the third possible implementation of the third aspect or the fourth possible implementation of the third aspect In a fifth possible implementation manner of the third aspect, the parsing processing module is configured to determine the at least one video data according to a content type field in an HTTP response header in the at least one video data packet. The packet is based on HTTP/TCP transmission, parsing the at least one video data packet, performing video frame recombination on the video segment parsed from the at least one video data packet, forming at least one video frame, and identifying a priority of each of the video frames; or the parsing processing module is specifically configured to determine, according to a format of the at least one video data packet, that the at least one video data packet is based on HTTP/TCP transmission, to the at least Parsing a video packet, and performing video on the video segment parsed from the at least one video packet The frame is recombined to form at least one video frame and the priority of each of the video frames is identified.

A fourth aspect provides a base station, including:

a first sending module, configured to send, to the proxy device, a status parameter of an air interface between the base station and the user equipment UE;

a first receiving module, configured to receive a video frame sent by the proxy device, where the video frame sent by the proxy device to the base station is based on a status parameter of the air interface and a priority of a video frame, And at least one video frame in the video data packet sent by the video server to the proxy device for performing video frame recombination, at least one video frame formed by video frame recombination, and remaining video frames after discarding processing;

And a second sending module, configured to send the video frame received by the first receiving module to the UE.

With reference to the fourth aspect, in a first possible implementation manner of the fourth aspect, the first sending module is configured to periodically send the state parameter of the air interface to the proxy device.

With reference to the fourth aspect, in a second possible implementation manner of the fourth aspect, the base station further includes: a second receiving module, configured to: before the first sending module sends the state parameter of the air interface, Determining a parameter acquisition request sent by the proxy device;

The first sending module is specifically configured to send, according to the parameter obtaining request, a status parameter of the air interface to the proxy device.

With reference to the fourth aspect, or the first possible implementation manner of the fourth aspect, or the second possible implementation manner of the fourth aspect, in a third possible implementation manner of the fourth aspect, the air interface status parameter includes At least one of a size of the current buffer data of the air interface, an average delay of the air interface, and a packet loss rate of the air interface.

The fifth aspect provides a proxy device, including:

a receiver, configured to receive at least one video data packet sent by the video server;

a processor, configured to determine that the at least one video data packet is based on HTTP/TCP transmission, parse the at least one video data packet, and perform video on video fragments parsed from the at least one video data packet Frame recombination, forming at least one video frame, and identifying a priority of each of the video frames, according to a state parameter of an air interface between the base station and the user equipment UE, and a priority of each of the video frames, to the at least A video frame is discarded;

a transmitter, configured to discard the processor, after remaining in the at least one video frame The video frame is sent to the base station.

A sixth aspect provides a proxy device, including:

a transmitter, configured to send, to the proxy device, a status parameter of the air interface between the base station and the user equipment UE, and send a video frame received by the receiver to the UE;

The receiver is configured to receive a video frame sent by the proxy device, where the video frame sent by the proxy device to the base station is based on a status parameter of the air interface and a priority of a video frame, The video fragment sent by the video server to the proxy device for at least one video packet based on the HTTP/TCP transmission performs at least one video frame formed by recombining the video frame to perform a video frame remaining after the discarding process.

A seventh aspect provides a video processing system comprising any of the proxy devices provided by the third aspect and any of the base stations provided by the fourth aspect.

The video processing method, device and system provided by the embodiment of the present invention, by adding a proxy device between the video server and the base station, the video server first sends the video data packet to the proxy device, and the proxy device determines that the video data packet sent by the video server is based on After the HTTP/TCP transmission, the video data packet is parsed and the video frame is reassembled, and then the formed video frame is discarded, and the remaining video frames are sent to the base station to forward the base station to the base station. The UE can discard the video frame according to the state parameter of the air interface between the base station and the UE, implements congestion control, solves the problem of wireless transmission congestion between the base station and the UE, and, for the base station, The proxy device is equivalent to the sender, and the discarding process is performed on the proxy device, which is equivalent to the discarding process, and does not trigger the TCP retransmission mechanism. Therefore, the related spoofing mechanism is not needed to avoid retransmission. It can be seen that the embodiment of the present invention can implement congestion control without forgery. The video data packet solves the problem that the video quality of the UE side is degraded due to the forged video data packet, which is beneficial to improving the video quality of the UE side. BRIEF DESCRIPTION OF THE DRAWINGS In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, a brief description of the drawings used in the embodiments or the prior art description will be briefly described below. The drawings are some embodiments of the present invention, and those skilled in the art can obtain other drawings based on these drawings without any inventive labor.

FIG. 1 is a flowchart of a video processing method according to an embodiment of the present invention; 2 is a flowchart of another video processing method according to an embodiment of the present invention; FIG. 3 is a schematic structural diagram of a proxy device according to an embodiment of the present invention;

4 is a schematic structural diagram of another proxy device according to an embodiment of the present invention;

FIG. 5 is a schematic structural diagram of still another proxy device according to an embodiment of the present disclosure;

FIG. 6 is a schematic structural diagram of a base station according to an embodiment of the present disclosure;

FIG. 7 is a schematic structural diagram of another base station according to an embodiment of the present disclosure;

FIG. 8 is a schematic structural diagram of still another base station according to an embodiment of the present invention. The technical solutions in the embodiments of the present invention are clearly and completely described in the following with reference to the accompanying drawings in the embodiments of the present invention. The embodiments are a part of the embodiments of the invention, and not all of the embodiments. All other embodiments obtained by those skilled in the art based on the embodiments of the present invention without creative efforts are within the scope of the present invention.

FIG. 1 is a flowchart of a video processing method according to an embodiment of the present invention. As shown in FIG. 1, the method in this embodiment includes:

Step 101: The proxy device receives at least one video data packet sent by the video server.

Step 102: The proxy device determines that the at least one video data packet is based on HTTP/TCP transmission, parses the at least one video data packet, and performs video on the video fragment parsed from the at least one video data packet. The frame is recombined to form at least one video frame and the priority of each of the video frames is identified.

Step 103: The proxy device performs discarding processing on the at least one video frame according to a state parameter of an air interface between the base station and the UE and a priority of each of the video frames.

Step 104: The proxy device sends the remaining video frames in the at least one video frame to the base station after performing the discarding process.

In this embodiment, the proxy device is disposed between the video server and the base station, and is configured to transit the video data packet between the video server and the base station, and process the video data packet during the transit process to form a video frame, The video frame is discarded.

The UE establishes a TCP connection with the video server through the proxy device. Specifically, the UE sends a TCP connection establishment request to the video server through the proxy device, and the video server returns to the UE through the proxy device. Back to the TCP connection to establish a response. In the process, the proxy device can establish a request according to the TCP connection, and learn that a TCP connection is established between the UE and the video server. For example, the proxy device may determine that the UE requests to establish a TCP connection with the video server according to the Content-Type field in the HTTP response header in the TCP connection establishment request. When the video server needs to send a video data packet to the UE, at least one video data packet to be sent is first sent to the proxy device. The proxy device receives at least one video data packet sent by the video server; then, the proxy device determines that the received video data packet is based on HTTP/TCP transmission, and the data packet type is a video packet. For example, the proxy device may determine that the received video data packet is transmitted by HTTP/TCP according to the content type field in the HTTP response header in each video data packet received. The content type field is an HTTP protocol packet header, and the domain carries a packet type, such as a video packet. Preferably, since the proxy device has obtained a TCP connection establishment request sent by the UE to the video server for requesting to establish a TCP connection, it is known that the TCP connection is established between the UE and the video server, so that it can directly determine that the data packet sent by the video server is based on HTTP/TCP transmission; After that, it can be determined according to the content type field that the type of the received data packet is a video package. For another example, the proxy device can determine whether the received video data packet is based on HTTP/TCP transmission according to the format of the received video data packet. Specifically, the video data packet based on the HTTP/TCP transmission may be pre-agreed and transmitted in a specific message format, so after receiving the video data packet sent by the video server, the proxy device may determine whether the received video data packet meets the specificity. The message format, if it is met, determines that the received video packet is based on HTTP/TCP transmission, and conversely, determines that the received video packet is not based on HTTP/TCP transmission.

The video data packet is formed by the video server encapsulating the video frame. Specifically, the video server fragments the video frames to form video segments, and then encapsulates the video segments into video data packets. In this process, video segments of the same video frame may be encapsulated into different video data packets. This causes the video frame to be segmented. Based on this, if the proxy device discards the video frame, the proxy device needs to discard the complete video frame, otherwise the UE will receive the incomplete video frame, and the UE cannot parse the incomplete video. Framed. In order to ensure that the complete video frame can be discarded during the discarding process of the video frame, the proxy device of the embodiment determines the received video data packet after receiving the video data packet based on the HTTP/TCP transmission. Performing parsing, obtaining video clips included in the video data packet, and then performing video frame recombination on the video fragments parsed from the video data packet to form at least one video frame. Optionally, the process of parsing the received video data packet by the proxy device and reassembling the video frame may be: the proxy device parses the video data packet every time a video data packet is received, and obtains the video data packet. Video sharding; if the video shards parsed from the video data packet can form a complete video frame, a video frame can be directly formed; if the video shards parsed from the video data packet cannot form a complete The video frame can be combined with the video fragments parsed from other video data packets before or after the video data packet to form a complete video frame. Alternatively, the process of parsing the received video data packet by the proxy device and reassembling the video frame may also be: the proxy device may receive the multiple data packets after receiving the multiple video data packets according to the specified number. Perform processing such as parsing and video frame recombination.

After the video frame is formed, the proxy device can perform deep detection on the video frame to identify the priority of the video frame. For the process of the DPI processing of the video frame by the proxy device, refer to the prior art, and details are not described herein again.

Afterwards, the proxy device discards the video frame according to the state parameters of the air interface between the base station and the UE and the priority of the video frame. Specifically, before the discarding process of the video frame, the proxy device knows the state parameter of the air interface between the base station and the UE in advance, and identifies the air interface transmission status between the base station and the UE according to the state parameter of the air interface, if the base station and the UE If the transmission between the air interfaces is congested, the received video frames may be discarded according to other low-to-high priority or other discarding policies related to the priority of the video frames, and the video arriving at the base station is reduced. The number of frames further solves the congestion of the air interface between the base station and the UE; if the transmission of the air interface between the base station and the UE does not cause congestion, the proxy device can directly send the formed video frame to the base station, so that the base station will receive The video frame is forwarded to the UE for processing, such as receiving and playing by the UE.

In an optional implementation manner, before the discarding the video frame, the proxy device obtains, in advance, a status parameter of the air interface between the base station and the UE, where the proxy device receives the status parameter of the air interface sent by the base station. . In addition to the state parameter of the air interface between the base station and the UE, the proxy device may also obtain the state parameters of the air interface between the base station and the UE by other means, for example, may be pre-configured and periodically updated, or may be The status of the air interface between the base station and the UE is monitored by other devices, and reported to the proxy device in real time.

Further, the embodiment that the proxy device receives the state parameter of the air interface sent by the base station includes: the proxy device receives a state parameter of the air interface periodically sent by the base station. In this implementation manner, the base station periodically monitors the state of the air interface between the base station and the UE, and periodically sets the proxy to the proxy. The state parameter of the air interface between the base station and the UE is sent, so that the accuracy of the discarding process of the video frame according to the state parameter of the air interface between the base station and the UE can be improved.

Further, another embodiment of the proxy device receiving the state parameter of the air interface sent by the base station includes: the proxy device sends a parameter acquisition request to the base station to request to obtain a state parameter of the air interface between the base station and the UE; This parameter acquires the state parameter of the air interface returned by the request. In this implementation manner, the proxy device sends a parameter acquisition request to the base station to request the base station to request the state of the air interface between the base station and the UE before performing the discarding process on the video frame by using the state parameter of the air interface between the base station and the UE. After receiving the parameter acquisition request sent by the proxy device, the base station returns a state parameter of the air interface between the base station and the UE to the proxy device.

The state parameter of the air interface between the base station and the UE mainly refers to a parameter that can reflect the wireless transmission status of the air interface between the base station and the UE, and may include, for example, the size of the current buffer data of the air interface, the average delay of the air interface, and the air interface. At least one of a packet loss rate and the like.

Here, the video server and the proxy device are based on HTTP/TCP transport; the proxy device and the UE are also based on HTTP/TCP transport, and the two HTTP/TCP transport-based processes are independent of each other.

As can be seen from the above, in the video processing method provided by the embodiment, the proxy device receives the video data packet sent by the video server, parses the video data packet to obtain a video segment, and then forms a video frame, and then according to the priority of the video frame and the base station and The state parameters of the air interface between the UEs are discarded, and the video frames remaining after the discarding process are sent to the base station to forward the base station to the UE. The proxy device may discard the video frame according to the state parameter of the air interface between the base station and the UE, implement congestion control, and solve the problem of wireless transmission congestion between the base station and the UE. In addition, for the base station The proxy device is equivalent to the sender, and the discarding process is performed at the sending end by the proxy device, and the discarding process is performed on the TCP connection between the proxy device and the video server, and the proxy device and the UE The TCP connection is transparent. Therefore, the TCP retransmission mechanism is not triggered, and the related spoofing mechanism is not needed to avoid retransmission. Therefore, this embodiment can implement congestion control and does not need to be implemented. The falsification of the video data packet solves the problem that the video quality of the UE side is degraded due to the falsification of the video data packet, which is beneficial to improving the video quality of the UE side.

FIG. 2 is a flowchart of another video processing method according to an embodiment of the present invention. As shown in FIG. 2, the method in this embodiment includes:

Step 201: The base station sends a state parameter of the air interface between the base station and the UE to the proxy device. Step 202: The base station receives a video frame sent by the proxy device, where the video frame sent by the proxy device to the base station is at least one HTTP-based HTTP sent by the proxy server to the proxy device according to the state parameter of the air interface and the priority of the video frame. The video fragment in the video packet transmitted by the TCP/TCP performs video frame remaining after the discarding process is performed on at least one video frame formed by recombining the video frame.

Step 203: The base station sends the received video frame to the UE.

In this embodiment, a proxy device is disposed between the base station and the video server. The proxy device is responsible for the transfer of the video data packet between the video server and the base station, and processes the video data packet during the transfer process to form a video frame, and discards the video frame.

In this embodiment, the proxy device needs to discard the formed video frame according to the state parameter of the air interface between the base station and the UE. In order for the proxy device to obtain the state parameter of the air interface between the base station and the UE, the base station sends a state parameter of the air interface between the base station and the UE to the proxy device. For the proxy device, the status parameter of the air interface between the base station and the UE sent by the base station is received. The proxy device receives the video data packet from the video server according to the state parameter of the air interface, parses the video data packet from the video server, obtains the video fragment, and then performs video frame recombination on the video fragment to form a video frame. The video frame, and also the priority of the video frame. After the priority of the video frame and the state parameters of the air interface between the base station and the UE are obtained, the proxy device discards the video frame according to the state parameter of the air interface and the priority of the video frame. The proxy device sends the remaining video frames to the base station after the processing is discarded. The base station receives the video frame sent by the proxy device, where the video frame is sent to the proxy device.

The proxy device receives the video data packet sent by the video server, parses the video data packet to obtain a video segment, performs video frame recombination on the video segment to form a video frame, and identifies a video frame priority, and discards the video frame. For operations such as processing, refer to the description of the embodiment shown in FIG. 1, and details are not described herein again.

In an optional implementation manner, the method for the base station to send the status parameter of the air interface between the base station and the UE to the proxy device includes: the base station periodically sends the state parameter of the air interface between the base station and the UE to the proxy device.

In an optional implementation manner, another implementation manner in which the base station sends the state parameter of the air interface between the base station and the UE to the proxy device includes: receiving, by the base station, a parameter acquisition request sent by the proxy device; and then, the base station acquires the request according to the parameter, Sending an air interface between the base station and the UE to the proxy device State parameters.

The status parameter of the air interface between the base station and the UE mainly refers to information that can reflect the wireless transmission status of the air interface between the base station and the UE, and may include, for example, the size of the current buffer data of the air interface, the average delay of the air interface, and the air interface. At least one of a packet loss rate and the like.

In this embodiment, the base station provides the proxy device with the state parameter of the air interface between the base station and the UE, so that the proxy device can discard the video frame according to the air interface transmission between the base station and the UE, and discards the video frame. The remaining video frames are sent to the base station, and then forwarded to the UE by the base station. The base station does not need to perform packet loss processing on the video data packet according to the air interface transmission condition, but the proxy device replaces the video frame discarding process, implements congestion control, and solves the wireless transmission congestion problem between the base station and the UE. In addition, for the base station, the proxy device is equivalent to the discarding of the video frame, and the discarding process is performed on the TCP connection between the proxy device and the video server, and the TCP connection between the proxy device and the UE. Transparent, therefore, does not trigger the TCP retransmission mechanism, and does not require a related spoofing mechanism to evade retransmission. It can be seen that this embodiment can implement congestion control and falsify video data packets, thereby solving the forgery. The video data packet causes a problem of video quality degradation on the UE side, which is beneficial to improving the video quality on the UE side.

FIG. 3 is a schematic structural diagram of a proxy device according to an embodiment of the present invention. As shown in FIG. 3, the proxy device includes: a first receiving module 31, an analysis processing module 32, a discarding processing module 33, and a first sending module 34.

The first receiving module 31 is configured to receive at least one video data packet sent by the video server. The parsing processing module 32 is configured to determine that the at least one video data packet received by the first receiving module 31 is based on HTTP/TCP transmission, parse the at least one video data packet, and parse the at least one video data packet. The outgoing video segments perform video frame recombination to form at least one video frame and identify the priority of each of the video frames.

The discarding processing module 33 is connected to the parsing processing module 32 for forming the parsing processing module 32 according to the state parameters of the air interface between the base station and the UE and the priority of each of the video frames identified by the parsing processing module 32. The at least one video frame is subjected to discard processing. The first sending module 34 is connected to the discarding processing module 33, and configured to send the remaining video frames in the at least one video frame to the base station after the discarding processing module 33 performs the discarding process.

In an optional implementation, as shown in FIG. 4, the proxy device may further include: a second receiving module 35.

The second receiving module 35 is connected to the discarding processing module 33, and configured to receive the status parameter of the air interface sent by the base station before the discarding processing module 33 performs discarding processing on the at least one video frame. The second receiving module 35 provides the status parameter of the received air interface to the discarding processing module 33.

Optionally, the second receiving module 35 is specifically configured to receive a status parameter of the air interface periodically sent by the base station.

Further, as shown in FIG. 4, the proxy device may further include: a second sending module 36. The second sending module 36 is connected to the second receiving module 35, and is configured to send a parameter obtaining request to the base station before the second receiving module 35 receives the state parameter of the air interface. Based on this, the second receiving module 35 is specifically configured to receive a status parameter of the air interface returned by the base station according to the parameter obtaining request.

In an optional implementation, the parsing processing module 32 is specifically configured to determine, according to the content type field in the HTTP response header in the at least one video data packet, that the at least one video data packet is based on HTTP/TCP transmission, And parsing the at least one video data packet, performing video frame recombination on the video fragments parsed from the at least one video data packet, forming at least one video frame, and identifying a priority of each of the video frames. Or

The parsing processing module 32 is specifically configured to determine, according to the format of the at least one video data packet, that the at least one video data packet is based on HTTP/TCP transmission, and parse the at least one video data packet from the at least one The video fragments parsed in a video data packet are subjected to video frame recombination to form at least one video frame, and the priority of each of the video frames is identified.

The air interface status parameter received by the second receiving module 35 includes at least one of a size of the current buffer data of the air interface, an average delay of the air interface, and a packet loss rate of the air interface.

The function modules of the proxy device provided in this embodiment can be used to execute the process of the video processing method embodiment shown in FIG. 1. The specific working principle is not described here. For details, refer to the description of the method embodiment.

The proxy device provided in this embodiment may discard the video frame according to the state parameter of the air interface between the base station and the UE, implement congestion control, and solve the wireless transmission between the base station and the UE. In addition, for the base station, the proxy device provided in this embodiment is equivalent to the sender, the TCP connection between the proxy device and the video server, and the TCP connection between the proxy device and the UE. Transparent, therefore, does not trigger the TCP retransmission mechanism, and does not require a related spoofing mechanism to evade retransmission. Therefore, the proxy device provided by this embodiment can implement congestion control without forging video data. The packet solves the problem that the video quality of the UE side is degraded due to the forgery of the video data packet, which is beneficial to improving the video quality of the UE side.

FIG. 5 is a schematic structural diagram of still another proxy device according to an embodiment of the present invention. As shown in FIG. 5, the proxy device of this embodiment includes: a receiver 51, a processor 52, and a transmitter 53.

The receiver 51 is configured to receive at least one video data packet sent by the video server.

The processor 52 is configured to determine that the at least one video data packet is based on HTTP/TCP transmission, parse the at least one video data packet, and perform video segmentation parsed from the at least one video data packet. Video frame recombination, forming at least one video frame, and identifying a priority of each of the video frames, according to a state parameter of an air interface between the base station and the UE, and a priority of each of the video frames, to the at least one The video frame is discarded.

The transmitter 53 is configured to send the remaining video frames in the at least one video frame to the base station after the processor 52 performs the discarding process.

As shown in FIG. 5, the proxy device of this embodiment further includes: a memory 54 for storing a program, and a video data packet received by the receiver 51, a video frame formed by the processor 52, and the like. Specifically, the program may include program code, and the program code may include computer operation instructions.

Memory 54 may contain high speed RAM memory and may also include non-volatile memory, such as at least one disk memory.

The processor 52 can also be used to execute instructions stored in the memory 54 for implementing control logic or the like of the proxy device. Optionally, determining, by the processor 52, that the at least one video data packet is based on HTTP/TCP transmission, parsing the at least one video data packet, and parsing the at least one video data packet from the at least one video data packet Video segmentation performs video frame recombination to form at least one video frame, and identifies a priority of each of the video frames, according to a state parameter of an air interface between the base station and the UE, and a priority of each of the video frames, The at least one video frame performs operations such as discarding processing, and may also be implemented by executing a program.

The processor 52 may be a central processing unit (CPU). Either an Application Specific Integrated Circuit (ASIC), or one or more integrated circuits configured to implement the embodiments of the present invention.

In an optional implementation, the receiver 51 is further configured to receive, before the processor 52 performs the discarding process on the at least one video frame, the status parameter of the air interface sent by the base station.

Optionally, the receiver 51 is specifically configured to receive a status parameter of the air interface periodically sent by the base station.

Optionally, the transmitter 53 is further configured to send a parameter acquisition request to the base station before the receiver 51 receives the status parameter of the air interface. Based on this, the receiver 51 is specifically configured to receive a status parameter of the air interface returned by the base station according to the parameter acquisition request.

Optionally, the processor 52 is specifically configured to determine, according to the content type field in the HTTP response header in the at least one video data packet, the at least one video data packet, for the HTTP/TCP transmission, to the at least one Parsing the video data packet, performing video frame recombination on the video segment parsed from the at least one video data packet, forming at least one video frame, and identifying a priority of each of the video frames, according to the base station and the UE And discarding the at least one video frame by a state parameter of the air interface and a priority of each of the video frames. Or

The processor 52 is specifically configured to determine, according to a format of the at least one video data packet, that the at least one video data packet is based on HTTP/TCP transmission, and parse the at least one video data packet from the at least one The video segment parsed in the video data packet performs video frame recombination to form at least one video frame, and identifies a priority of each of the video frames, according to a state parameter of the air interface between the base station and the UE, and each of the The priority of the video frame, and the at least one video frame is discarded.

The air interface status parameter received by the receiver 51 includes at least one of a size of the current buffer data of the air interface, an average delay of the air interface, and a packet loss rate of the air interface.

Optionally, in a specific implementation, if the receiver 51, the processor 52, the transmitter 53 and the memory 54 are implemented independently, the receiver 51, the processor 52, the transmitter 53 and the memory 54 can be connected to each other through a bus and complete each other. Communication between. The bus may be an Industry Standard Architecture (ISA) bus, a Peripheral Component (PCI) bus, or an Extended Industry Standard Architecture (EISA). Bus, etc. The bus can be divided into an address bus, a data bus, a control bus, and the like. For the sake of convenience, only one thick line is shown in Figure 5, but it is not Show only one bus or one type of bus.

Optionally, in a specific implementation, if the receiver 51, the processor 52, the transmitter 53 and the memory 54 are integrated on one chip, the receiver 51, the processor 52, the transmitter 53 and the memory 54 can pass through an internal interface. Complete the same communication.

The proxy device provided in this embodiment may discard the video frame according to the state parameter of the air interface between the base station and the UE, implement congestion control, and solve the problem of wireless transmission congestion between the base station and the UE, and In this case, the proxy device provided by this embodiment is equivalent to the sender, and is transparent to the TCP connection between the proxy device and the video server, and the TCP connection between the proxy device and the UE, and therefore, does not trigger. The TCP retransmission mechanism does not require a related spoofing mechanism to evade the retransmission. Therefore, the proxy device provided in this embodiment can implement congestion control and falsify video data packets, thereby solving the problem of forging video data. The problem that the packet quality is degraded on the UE side is beneficial to improve the video quality on the UE side.

FIG. 6 is a schematic structural diagram of a base station according to an embodiment of the present invention. As shown in FIG. 6, the base station includes: a first sending module 61, a first receiving module 62, and a second sending module 63.

The first sending module 61 is configured to send, to the proxy device, a status parameter of the air interface between the base station and the UE.

The first receiving module 62 is connected to the first sending module 61, and configured to: after the first sending module 61 sends the status parameter of the air interface, receive a video frame sent by the proxy device, where the proxy device sends the The video frame is that the proxy device performs video segmentation in at least one HTTP/TCP-based video data packet sent by the video server to the proxy device according to the state parameter of the air interface and the priority of the video frame. At least one video frame formed by recombination of the video frame is subjected to a video frame remaining after the discarding process.

The second sending module 63 is connected to the first receiving module 62, and is configured to send the video frame received by the second receiving module 62 to the UE.

Optionally, the first sending module 61 is specifically configured to periodically send the state parameter of the air interface to the proxy device.

As shown in FIG. 7, the base station further includes: a second receiving module 64. The second receiving module 64 is configured to receive a parameter obtaining request sent by the proxy device before the first sending module 61 sends the state parameter of the air interface. Based on this, the first sending module 61 is specifically configured to send the state parameter of the air interface to the proxy device according to the parameter obtaining request.

The air interface status parameter sent by the first sending module 61 includes at least one of a size of the current buffer data of the air interface, an average delay of the air interface, and a packet loss rate of the air interface.

The function modules of the base station provided in this embodiment can be used to perform the process of the embodiment of the video processing method shown in FIG. 2. The specific working principle is not described here. For details, refer to the description of the method embodiment.

The base station provided in this embodiment cooperates with the proxy device provided by the foregoing embodiment, and provides the proxy device with the state parameter of the air interface between the base station and the UE, so that the proxy device can perform the air interface transmission between the base station and the UE. The video frame is discarded, and the video frame remaining after the discarding process is sent to the base station, and then sent by the base station to the UE. The base station provided by the implementation does not need to perform packet loss processing on the video data packet according to the air interface transmission condition. The proxy device replaces the video frame discarding process, implements congestion control, and solves the wireless transmission congestion problem between the base station and the UE. In addition, for the base station provided in this embodiment, the proxy device is equivalent to the video frame. The sender, and the discarding process is transparent to the TCP connection between the proxy device and the video server, and the TCP connection between the proxy device and the UE. Therefore, the TCP retransmission mechanism is not triggered, and thus A related spoofing mechanism is needed to avoid retransmission. It can be seen that the base station provided in this embodiment can be used. Nowadays, the congestion control does not need to forge the video data packet, which solves the problem that the video quality of the UE side is degraded due to the forged video data packet, and is beneficial to improving the video quality of the UE side.

FIG. 8 is a schematic structural diagram of still another base station according to an embodiment of the present invention. As shown in FIG. 8, the base station includes: a transmitter 81 and a receiver 82.

The transmitter 81 is configured to send, to the proxy device, a status parameter of the air interface between the base station and the UE, and send the video frame received by the receiver 82 to the UE.

a receiver 82, configured to receive a video frame sent by the proxy device, where the video frame sent by the proxy device to the base station is a priority of the proxy device according to a status parameter of the air interface and a video frame, The at least one video frame in the video data packet based on the HTTP/TCP transmission sent by the server to the proxy device performs at least one video frame formed by the video frame recombination to perform the video frame remaining after the discarding process.

As shown in FIG. 8, the base station further includes: a memory 83 and a processor 84. The memory 83 is used to store the program. Specifically, the program may include program code, and the program code includes computer operation instructions. The memory 83 may include a high speed RAM memory and may also include a non-volatile memory such as at least one disk memory.

The processor 84 is configured to execute instructions stored in the memory 83 for implementing control logic of the base station and the like. Processor 84 may be a CPU, or a particular ASIC, or one or more integrated circuits configured to implement embodiments of the present invention.

In an optional implementation, the transmitter 81 is specifically configured to periodically send the status parameter of the air interface to the proxy device.

In an optional implementation, the receiver 82 is further configured to receive a parameter acquisition request sent by the proxy device before the transmitter 81 sends the status parameter of the air interface. Based on this, the transmitter 81 is configured to send the state parameter of the air interface to the proxy device according to the parameter acquisition request.

The air interface status parameter sent by the transmitter 81 includes at least one of a size of the current buffer data of the air interface, an average delay of the air interface, and a packet loss rate of the air interface.

Optionally, in a specific implementation, if the transmitter 81, the receiver 82, the memory 83, and the processor 84 are implemented independently, the transmitter 81, the receiver 82, the memory 83, and the processor 84 may be connected to each other through a bus and complete each other. Communication between. The bus can be an ISA bus, a PCI bus or an EISA bus. The bus can be divided into an address bus, a data bus, a control bus, and the like. For ease of representation, only one thick line is shown in Figure 8, but it does not mean that there is only one bus or one type of bus.

Optionally, in a specific implementation, if the transmitter 81, the receiver 82, the memory 83, and the processor 84 are integrated on one chip, the transmitter 81, the receiver 82, the memory 83, and the processor 84 may pass through an internal interface. Complete the same communication.

The base station provided in this embodiment can be used to perform the process of the embodiment of the video processing method shown in FIG. 2. The specific working principle is not described here. For details, refer to the description of the method embodiment.

The base station provided in this embodiment cooperates with the proxy device provided by the foregoing embodiment, and provides the proxy device with the state parameter of the air interface between the base station and the UE, so that the proxy device can perform the air interface transmission between the base station and the UE. The video frame is discarded, and the video frame remaining after the discarding process is sent to the base station, and then sent by the base station to the UE. The base station provided by the implementation does not need to perform packet loss processing on the video data packet according to the air interface transmission condition. The proxy device replaces the video frame discarding process, implements congestion control, and solves the wireless transmission congestion problem between the base station and the UE; In addition, for the base station provided in this embodiment, the proxy device is equivalent to the sending end of the video frame, and the discarding process is performed on the TCP connection between the proxy device and the video server, and the TCP connection between the proxy device and the UE. All of them are transparent. Therefore, the TCP retransmission mechanism is not triggered, and the related spoofing mechanism is not needed to avoid retransmission. Therefore, the base station provided in this embodiment can implement congestion control and does not need to be implemented. Forging video data packets solves the problem of video quality degradation on the UE side caused by forged video data packets, which is beneficial to improving the video quality on the UE side.

The embodiment of the present invention provides a video processing system, including: the proxy device provided by the foregoing embodiment, and the base station provided by the foregoing embodiment.

Further, the video transmission system provided in this embodiment may further include: a UE and a video server. The workflow of the system includes: The video server sends a video packet to the proxy device. The proxy device receives the video data packet, parses the received video data packet, obtains the video fragment in the video data packet, performs video frame recombination on the video fragment, forms a complete video frame, and performs DPI processing on the video frame. The priority of the video frame is identified, and then the video frame is discarded according to the state parameter of the air interface between the base station and the UE and the priority of the video frame, and the video frame remaining after the discarding process is sent to the base station. The base station may send a status parameter of the air interface between the base station and the UE to the proxy device, and may receive the video frame sent by the proxy device, and send the received video frame to the UE. The UE receives the video frame sent by the base station, and parses, plays, and the like the video frame.

For the foregoing process, reference may be made to the description of the foregoing corresponding method embodiments, and details are not described herein again.

The video processing system provided in this embodiment can implement congestion control and falsify video data packets, and solves the problem that the video quality of the UE side is degraded due to the forged video data packet, which is beneficial to improving the video quality of the UE side.

A person skilled in the art can understand that all or part of the steps of implementing the above method embodiments may be completed by using hardware related to program instructions, and the foregoing program may be stored in a computer readable storage medium, and the program is executed when executed. The method includes the steps of the foregoing method embodiments; and the foregoing storage medium includes: a medium that can store program codes, such as a ROM, a RAM, a magnetic disk, or an optical disk.

Finally, it should be noted that the above embodiments are only for explaining the technical solutions of the present invention, and are not intended to be limiting thereof; although the present invention has been described in detail with reference to the foregoing embodiments, those skilled in the art will understand that The technical solutions described in the foregoing embodiments may be modified, or some or all of the technical features may be equivalently replaced; and the modifications or substitutions do not deviate from the technical solutions of the embodiments of the present invention. range.

Claims

claims

1. A video processing method, characterized by including:

The proxy device determines that the at least one video data packet is transmitted based on HTTP/TCP, parses the at least one video data packet, and performs video frame processing on the video fragments parsed from the at least one video data packet. Reorganize to form at least one video frame, and identify the priority of each video frame;

The proxy device discards the at least one video frame according to the status parameters of the air interface between the base station and the user equipment UE and the priority of each video frame;

The proxy device sends the remaining video frames in the at least one video frame to the base station after discarding.

2. The video processing method according to claim 1, characterized in that, the proxy device performs processing on the at least one video frame according to the status parameters of the air interface between the base station and the user equipment UE and the priority of each video frame. Before the video frame is discarded, it includes:

The proxy device receives the status parameter of the air interface sent by the base station.

3. The video processing method according to claim 2, wherein the proxy device receiving the status parameters of the air interface sent by the base station includes:

The proxy device receives the status parameters of the air interface periodically sent by the base station.

4. The video processing method according to claim 2, wherein the proxy device receiving the status parameters of the air interface sent by the base station includes:

The proxy device sends a parameter acquisition request to the base station;

The proxy device receives the status parameter of the air interface returned by the base station according to the parameter acquisition request.

5. The video processing method according to any one of claims 1 to 4, characterized in that the air interface status parameters include the size of the current buffered data of the air interface, the average delay of the air interface and the At least one of the packet loss rates.

6. The video processing method according to any one of claims 1-5, wherein the proxy device determines that the at least one video data packet is transmitted based on HTTP/TCP including:

The proxy device determines that the at least one video data packet is transmitted based on HTTP/TCP based on the content type field in the HTTP response header in the at least one video data packet; or The proxy device determines that the at least one video data packet is transmitted based on HTTP/TCP based on the format of the at least one video data packet.

7. A video processing method, characterized by including:

The base station sends the status parameters of the air interface between the base station and the user equipment UE to the proxy device; the base station receives the video frame sent by the proxy device, and the video frame sent by the proxy device to the base station is the proxy device According to the status parameters of the air interface and the priority of the video frame, at least one video is formed by reassembling the video frames in the video fragments in at least one video data packet based on HTTP/TCP transmission sent by the video server to the proxy device. The remaining video frames after the frames are discarded;

The base station sends the received video frame to the UE.

8. The video processing method according to claim 7, wherein the base station sending the status parameters of the air interface between the base station and the user equipment UE to the proxy device includes:

The base station periodically sends the status parameters of the air interface to the proxy device.

9. The video processing method according to claim 7, wherein the base station sending the state parameters of the air interface between the base station and the user equipment UE to the proxy device includes:

The base station receives the parameter acquisition request sent by the proxy device;

The base station sends the status parameter of the air interface to the proxy device according to the parameter acquisition request.

10. The video processing method according to claim 7 or 8 or 9, characterized in that the air interface status parameters include the size of the current buffered data of the air interface, the average delay of the air interface and the loss of the air interface. At least one of the packet rates.

11. A proxy device, characterized by including:

The first receiving module is used to receive at least one video data packet sent by the video server; the parsing processing module is used to determine that the at least one video data packet is transmitted based on HTTP/TCP, and parse the at least one video data packet. , perform video frame reorganization on the video fragments parsed from the at least one video data packet to form at least one video frame, and identify the priority of each video frame;

A discard processing module, configured to discard the at least one video frame according to the status parameters of the air interface between the base station and the user equipment UE and the priority of each video frame;

The first sending module is configured to discard the at least one The remaining video frames in the video frames are sent to the base station.

12. The proxy device according to claim 11, further comprising:

The second receiving module is configured to receive the status parameter of the air interface sent by the base station before the discard processing module discards the at least one video frame.

13. The proxy device according to claim 12, wherein the second receiving module is specifically configured to receive the status parameters of the air interface periodically sent by the base station.

14. The proxy device according to claim 12, further comprising:

The second sending module is configured to send a parameter acquisition request to the base station before the second receiving module receives the status parameter of the air interface;

The second receiving module is specifically configured to receive the status parameter of the air interface returned by the base station according to the parameter acquisition request.

15. The proxy device according to any one of claims 11 to 14, characterized in that the air interface status parameters include the size of the current buffered data of the air interface, the average delay of the air interface and the loss of the air interface. At least one of the packet rates.

16. The proxy device according to any one of claims 11 to 15, characterized in that the parsing and processing module is specifically configured to determine the content type field in the HTTP response header in the at least one video data packet. At least one video data packet is transmitted based on HTTP/TCP, the at least one video data packet is parsed, and the video fragments parsed from the at least one video data packet are reorganized into video frames to form at least one video frame. , and identify the priority of each video frame; or

The parsing and processing module is specifically configured to determine that the at least one video data packet is transmitted based on HTTP/TCP according to the format of the at least one video data packet, parse the at least one video data packet, and analyze the data from the at least one video data packet. The video fragments parsed in at least one video data packet are reorganized into video frames to form at least one video frame, and the priority of each video frame is identified.

17. A base station, characterized by including:

The first sending module is configured to send the state parameters of the air interface between the base station and the user equipment UE to the proxy device;

The first receiving module is configured to receive the video frame sent by the proxy device. The video frame sent by the proxy device to the base station is the proxy device based on the status parameter of the air interface and the priority of the video frame. The video frames remaining after discarding at least one video frame formed by video frame reassembly based on the video fragments in the video data packet transmitted by HTTP/TCP and sent to the proxy device by the video server; The second sending module is configured to send the video frame received by the first receiving module to the UE.

18. The base station according to claim 17, characterized in that the first sending module is specifically configured to periodically send the status parameters of the air interface to the proxy device.

19. The base station according to claim 17, further comprising:

The second receiving module is configured to receive the parameter acquisition request sent by the proxy device before the first sending module sends the status parameter of the air interface;

The first sending module is specifically configured to send the status parameter of the air interface to the proxy device according to the parameter acquisition request.

20. The base station according to claim 17 or 18 or 19, characterized in that the air interface status parameters include the size of the current buffered data of the air interface, the average delay of the air interface and the packet loss rate of the air interface. at least one of them.

21. A proxy device, characterized by including:

A receiver configured to receive at least one video data packet sent by the video server;

Processor, configured to determine that the at least one video data packet is transmitted based on HTTP/TCP, parse the at least one video data packet, and perform video processing on the video fragments parsed from the at least one video data packet. Frame reorganization, forming at least one video frame, and identifying the priority of each video frame, based on the status parameters of the air interface between the base station and the user equipment UE and the priority of each video frame, for the at least A video frame is discarded;

A transmitter, configured to send the remaining video frames in the at least one video frame to the base station after discarding by the processor.

22. A base station, characterized by: including:

A transmitter, configured to send the status parameters of the air interface between the base station and the user equipment UE to the proxy device, and send the video frames received by the receiver to the UE;

The receiver is configured to receive video frames sent by the proxy device. The video frames sent by the proxy device to the base station are determined by the proxy device according to the status parameters of the air interface and the priority of the video frames. The video server sends to the proxy device at least one video frame that is formed by reassembling video frames based on the video fragments in the video data packet transmitted by HTTP/TCP and discards the remaining video frames.

23. A video processing system, characterized by comprising: the agent device according to any one of claims 11-16, and the base station according to any one of claims 17-20.