CN114079652A

CN114079652A - Data processing method

Info

Publication number: CN114079652A
Application number: CN202210057464.0A
Authority: CN
Inventors: 孟子立; 郭雅宁; 孙晨; 刘洪强
Original assignee: Alibaba Damo Institute Hangzhou Technology Co Ltd
Current assignee: Alibaba Damo Institute Hangzhou Technology Co Ltd
Priority date: 2022-01-19
Filing date: 2022-01-19
Publication date: 2022-02-22

Abstract

The invention discloses a data processing method. Wherein, the method comprises the following steps: acquiring a target control signal of a target communication protocol used by a target router, wherein a sub-transmission link between the target router and a receiving end is a last-hop transmission link of a target transmission link between a sending end and the receiving end, and the target control signal is used for controlling transmission parameters for transmitting media data to the receiving end; determining network information to be fed back based on the target control signal, wherein the network information is used for representing the network state of the target transmission link; and feeding back the network information to the sending end, wherein the network information is used for enabling the sending end to adjust the transmission parameters of the media data. The invention solves the technical problem of low real-time communication quality of the media data.

Description

Data processing method

Technical Field

The invention relates to the field of computers, in particular to a data processing method.

Background

At present, in order to meet the requirements of audio and video functions on reliability, low delay and expandability, the throughput of a wireless router is generally improved, and a feedback signal completely depends on the structure and the sending of a receiving end, so that the network state still cannot be fed back in time, and the technical problem of low quality of media data real-time communication exists.

In view of the above problems, no effective solution has been proposed.

Disclosure of Invention

The embodiment of the invention provides a data processing method, which at least solves the technical problem of low real-time communication quality of media data.

According to an aspect of an embodiment of the present invention, there is provided a data processing method. The method can comprise the following steps: acquiring a target control signal of a target communication protocol used by a target router, wherein a sub-transmission link between the target router and a receiving end is a last-hop transmission link of a target transmission link between a sending end and the receiving end, and the target control signal is used for controlling transmission parameters for transmitting media data to the receiving end; determining network information to be fed back based on the target control signal, wherein the network information is used for representing the network state of the target transmission link; and feeding back the network information to the sending end, wherein the network information is used for enabling the sending end to adjust the transmission parameters of the media data.

According to another aspect of the embodiment of the invention, a data processing method is also provided. The method can comprise the following steps: acquiring media data to be transmitted from an entertainment playing platform; when the media data are detected to be transmitted to the target router, a target control signal of a target communication protocol used by the target router is obtained, wherein a sub-transmission link between the target router and the playing client is a last-hop transmission link of a target transmission link between the entertainment playing platform and the playing client, and the target control signal is used for controlling transmission parameters for transmitting the media data to the playing client; determining network information to be fed back based on the target control signal, wherein the network information is used for representing the network state of the target transmission link; and feeding back the network information to the entertainment playing platform, wherein the network information is used for enabling the entertainment playing platform to adjust the transmission parameters of the media data.

According to another aspect of the embodiment of the invention, a data processing method is also provided. The method can comprise the following steps: acquiring media data to be transmitted from a live broadcast platform; when the media data are detected to be transmitted to a target router, a target control signal of a target communication protocol used by the target router is obtained, wherein a sub-transmission link between the target router and a playing client is a last-hop transmission link of a target transmission link between a live playing platform and the playing client, and the target control signal is used for controlling transmission parameters for transmitting the media data to the playing client; determining network information to be fed back based on the target control signal, wherein the network information is used for representing the network state of the target transmission link; and feeding back the network information to the live broadcast platform, wherein the network information is used for enabling the live broadcast platform to adjust the transmission parameters of the media data.

According to another aspect of the embodiment of the invention, a data processing method is also provided. The method can comprise the following steps: acquiring media data to be transmitted from a road detection playing platform; when the media data are detected to be transmitted to the target router, a target control signal of a target communication protocol used by the target router is obtained, wherein a sub-transmission link between the target router and the playing client is a last-hop transmission link of a target transmission link between the road detection playing platform and the playing client, and the target control signal is used for controlling transmission parameters for transmitting the media data to the playing client; determining network information to be fed back based on the target control signal, wherein the network information is used for representing the network state of the target transmission link; and feeding back the network information to the road detection playing platform, wherein the network information is used for enabling the road detection playing platform to adjust the transmission parameters of the media data.

According to another aspect of the embodiment of the invention, a data processing device is also provided. The apparatus may include: the first acquiring unit is used for acquiring a target control signal of a target communication protocol used by a target router, wherein a sub-transmission link between the target router and a receiving end is a last-hop transmission link of a target transmission link between a sending end and the receiving end, and the target control signal is used for controlling transmission parameters for transmitting media data to the receiving end; the first determining unit is used for determining network information to be fed back based on the target control signal, wherein the network information is used for representing the network state of the target transmission link; the first feedback unit is configured to feed back network information to the sending end, where the network information is used to enable the sending end to adjust a transmission parameter of the media data.

According to another aspect of the embodiment of the invention, a data processing device is also provided. The apparatus may include: the second acquisition unit is used for acquiring the media data to be transmitted from the entertainment playing platform; a third obtaining unit, configured to obtain a target control signal of a target communication protocol used by a target router when the media data is detected to be transmitted to the target router, where a sub-transmission link between the target router and a playing client is a last-hop transmission link of a target transmission link between an entertainment playing platform and the playing client, and the target control signal is used to control a transmission parameter for transmitting the media data to the playing client; the second determining unit is used for determining network information to be fed back based on the target control signal, wherein the network information is used for representing the network state of the target transmission link; and the second feedback unit is used for feeding back the network information to the entertainment playing platform, wherein the network information is used for enabling the entertainment playing platform to adjust the transmission parameters of the media data.

According to another aspect of the embodiment of the invention, a data processing device is also provided. The apparatus may include: the fourth acquisition unit is used for acquiring the media data to be transmitted from the live broadcast platform; a fifth obtaining unit, configured to obtain a target control signal of a target communication protocol used by a target router when the media data is detected to be transmitted to the target router, where a sub-transmission link between the target router and a playing client is a last-hop transmission link of a target transmission link between a live playing platform and the playing client, and the target control signal is used to control a transmission parameter for transmitting the media data to the playing client; the third determining unit is used for determining network information to be fed back based on the target control signal, wherein the network information is used for representing the network state of the target transmission link; and the third feedback unit is used for feeding back the network information to the live broadcast platform, wherein the network information is used for enabling the live broadcast platform to adjust the transmission parameters of the media data.

According to another aspect of the embodiment of the invention, a data processing device is also provided. The apparatus may include: a sixth obtaining unit, configured to obtain media data to be transmitted from the road detection playing platform; a seventh obtaining unit, configured to obtain a target control signal of a target communication protocol used by a target router when the media data is detected to be transmitted to the target router, where a sub-transmission link between the target router and a playing client is a last-hop transmission link of a target transmission link between a road detection playing platform and the playing client, and the target control signal is used to control a transmission parameter for transmitting the media data to the playing client; the fourth determining unit is used for determining the network information to be fed back based on the target control signal, wherein the network information is used for representing the network state of the target transmission link; and the fourth feedback unit is used for feeding network information back to the road detection playing platform, wherein the network information is used for enabling the road detection playing platform to adjust the transmission parameters of the media data.

According to another aspect of the embodiments of the present invention, there is also provided a computer-readable storage medium, which includes a stored program, wherein when the program runs, the apparatus on which the storage medium is located is controlled to execute the data processing method of any one of the above.

According to another aspect of the embodiments of the present invention, there is also provided a processor for executing a program, where the program executes a data processing method according to any one of the above.

According to another aspect of the embodiments of the present invention, there is also provided a data processing system, including: a processor; a memory coupled to the processor for providing instructions to the processor for processing the following processing steps: acquiring a target control signal of a target communication protocol used by a target router, wherein a sub-transmission link between the target router and a receiving end is a last-hop transmission link of a target transmission link between a sending end and the receiving end, and the target control signal is used for controlling transmission parameters for transmitting media data to the receiving end; determining network information to be fed back based on the target control signal, wherein the network information is used for representing the network state of the target transmission link; and feeding back the network information to the sending end, wherein the network information is used for enabling the sending end to adjust the transmission parameters of the media data.

In the embodiment of the invention, a target control signal of a target communication protocol used by a target router is obtained, wherein a sub-transmission link between the target router and a receiving end is a last-hop transmission link of a target transmission link between a sending end and the receiving end, and the target control signal is used for controlling transmission parameters for transmitting media data to the receiving end; determining network information to be fed back based on the target control signal, wherein the network information is used for representing the network state of the target transmission link; and feeding back the network information to the sending end, wherein the network information is used for enabling the sending end to adjust the transmission parameters of the media data. That is to say, the invention feeds back the network information to be fed back to the sending end in time, so that the sending end adjusts the transmission parameters of the transmission media data in time, thereby avoiding the delay increase caused by the rate mismatching, achieving the technical effect of improving the real-time communication quality of the media data, and solving the technical problem of low real-time communication quality of the media data.

Drawings

The accompanying drawings, which are included to provide a further understanding of the invention and are incorporated in and constitute a part of this application, illustrate embodiment(s) of the invention and together with the description serve to explain the invention without limiting the invention. In the drawings:

fig. 1 is a block diagram of a hardware configuration of a computer terminal (or mobile device) of a data processing method according to an embodiment of the present invention;

FIG. 2 is a flow chart of a method of data processing according to an embodiment of the present invention;

FIG. 3 is a flow diagram of another data processing method according to an embodiment of the invention;

FIG. 4 is a flow diagram of another data processing method according to an embodiment of the invention;

FIG. 5 is a flow diagram of another data processing method according to an embodiment of the invention;

FIG. 6 is a schematic diagram of a real-time communication technique according to a related art embodiment;

fig. 7 is a flowchart of a data processing method of a transmission system according to an embodiment of the present invention;

FIG. 8 is a flow chart of selection of an in-network state-to-on-end signal according to an embodiment of the present invention;

FIG. 9 is a flow chart of a method of delay estimation according to an embodiment of the present invention;

fig. 10 is a flow chart of a feedback frequency control mechanism according to an embodiment of the present invention;

FIG. 11 is a schematic diagram of another data processing apparatus according to an embodiment of the present invention;

FIG. 12 is a schematic diagram of another data processing apparatus according to an embodiment of the present invention;

FIG. 13 is a schematic diagram of another data processing apparatus according to an embodiment of the present invention;

FIG. 14 is a schematic diagram of another data processing apparatus according to an embodiment of the present invention;

fig. 15 is a block diagram of a computer terminal according to an embodiment of the present invention.

Detailed Description

In order to make the technical solutions of the present invention better understood, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.

It should be noted that the terms "first," "second," and the like in the description and claims of the present invention and in the drawings described above are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used is interchangeable under appropriate circumstances such that the embodiments of the invention described herein are capable of operation in sequences other than those illustrated or described herein. Furthermore, the terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a process, method, system, article, or apparatus that comprises a list of steps or elements is not necessarily limited to those steps or elements expressly listed, but may include other steps or elements not expressly listed or inherent to such process, method, article, or apparatus.

First, some terms or terms appearing in the description of the embodiments of the present application are applicable to the following explanations:

real-time communication (RTC for short), which refers to any real-time communication without transmission delay;

long Term Evolution (Long Term Evolution, LTE for short), refers to a fourth generation mobile communication technology (4G) network access;

the phenomenon of silence of audio or video jamming in audio and video playing, which may be caused by poor network service quality, is an important part of the user experience quality evaluation standard;

a Real-time Transport Protocol (RTP) defines a standard data packet format for transmitting audio and video over the internet, and is the most widely used Transport Protocol in the current Real-time audio and video functions.

Example 1

There is also provided, in accordance with an embodiment of the present invention, an embodiment of a data processing method, to note that the steps illustrated in the flowchart of the figure may be performed in a computer system such as a set of computer-executable instructions, and that, although a logical order is illustrated in the flowchart, in some cases, the steps illustrated or described may be performed in an order different than here.

The method provided by the first embodiment of the present application may be executed in a mobile terminal, a computer terminal, or a similar computing device. Fig. 1 shows a hardware configuration block diagram of a computer terminal (or mobile device) for implementing a data processing method. As shown in fig. 1, the computer terminal 10 (or mobile device 10) may include one or more processors (shown as 102a, 102b, … …, 102n in the figures) which may include, but are not limited to, a processing device such as a microprocessor MCU or a programmable logic device FPGA, a memory 104 for storing data, and a transmission module 106 for communication functions. Besides, the method can also comprise the following steps: a display, an input/output interface (I/O interface), a Universal Serial BUS (USB) port (which may be included as one of the ports of the BUS), a network interface, a power source, and/or a camera. It will be understood by those skilled in the art that the structure shown in fig. 1 is only an illustration and is not intended to limit the structure of the electronic device. For example, the computer terminal 10 may also include more or fewer components than shown in FIG. 1, or have a different configuration than shown in FIG. 1.

It should be noted that the one or more processors 102 and/or other data processing circuitry described above may be referred to generally herein as "data processing circuitry". The data processing circuitry may be embodied in whole or in part in software, hardware, firmware, or any combination thereof. Further, the data processing circuit may be a single stand-alone processing module, or incorporated in whole or in part into any of the other elements in the computer terminal 10 (or mobile device). As referred to in the embodiments of the application, the data processing circuit acts as a processor control (e.g. selection of a variable resistance termination path connected to the interface).

The memory 104 may be used to store software programs and modules of application software, such as program instructions/data storage devices corresponding to the data processing method in the embodiment of the present invention, and the processor 102 executes various functional applications and data processing by executing the software programs and modules stored in the memory 104, that is, implementing the data processing method of the application program. The memory 104 may include high speed random access memory, and may also include non-volatile memory, such as one or more magnetic storage devices, flash memory, or other non-volatile solid-state memory. In some examples, the memory 104 may further include memory located remotely from the processor 102, which may be connected to the computer terminal 10 via a network. Examples of such networks include, but are not limited to, the internet, intranets, local area networks, mobile communication networks, and combinations thereof.

The transmission device 106 is used for receiving or transmitting data via a network. Specific examples of the network described above may include a wireless network provided by a communication provider of the computer terminal 10. In one example, the transmission device 106 includes a Network adapter (NIC) that can be connected to other Network devices through a base station to communicate with the internet. In one example, the transmission device 106 can be a Radio Frequency (RF) module, which is used to communicate with the internet in a wireless manner.

The display may be, for example, a touch screen type Liquid Crystal Display (LCD) that may enable a user to interact with a user interface of the computer terminal 10 (or mobile device).

It should be noted here that in some alternative embodiments, the computer device (or mobile device) shown in fig. 1 described above may include hardware elements (including circuitry), software elements (including computer code stored on a computer-readable medium), or a combination of both hardware and software elements. It should be noted that fig. 1 is only one example of a particular specific example and is intended to illustrate the types of components that may be present in the computer device (or mobile device) described above.

In the operating environment shown in fig. 1, the present application provides a data processing method as shown in fig. 2. It should be noted that the data processing method of this embodiment may be executed by the mobile terminal of the embodiment shown in fig. 1.

Fig. 2 is a flowchart of a data processing method according to a first embodiment of the present invention, and as shown in fig. 2, the method may include the following steps:

step S202, a target control signal of a target communication protocol used by the target router is obtained, where a sub-transmission link between the target router and the receiving end is a last-hop transmission link of a target transmission link between the sending end and the receiving end, and the target control signal is used to control a transmission parameter for transmitting media data to the receiving end.

In the technical solution provided in step S202 of the present invention, the target router is detected through a port or a protocol of a target communication protocol used by the target router, and the target router is identified and checked through information such as an Internet protocol (Internet protocol, abbreviated as IP) address and the port, so as to achieve the purpose of obtaining a target control signal of the target communication protocol used by the target router, where a sub-transmission link between the target router and the receiving end is a last-hop transmission link of a target transmission link between the sending end and the receiving end; the target control signal is used for controlling transmission parameters for transmitting the media data to the receiving end, and may include, but is not limited to, packet loss, Round Trip Time (RTT), delay gradient (delay gradient), receiving rate, and the like; the target communication protocol may be an IP address, port, and/or protocol format; the receiving end can be a client, and the sending end can be a server.

Optionally, real-time communication traffic that needs to be optimized on the current target router is detected through an IP address, a port, and/or other target communication protocols, a protocol format and characteristics of the current traffic are determined, and transmission parameters, such as target control signals, such as delay and rate, that need to transmit media data to the receiving end are acquired based on the acquired protocol format and characteristics of the current traffic.

For example, after identifying a real-time communication/real-time transmission protocol of network real-time communication (WebRTC) of the target router, the target router obtains the real-time communication/real-time transmission protocol by querying a protocol library, and rate control of the target router depends on a time interval of receiving a data packet by a receiving end carried in a real-time transmission protocol feedback packet, so as to achieve the purpose of acquiring transmission parameters of media data to be transmitted to the receiving end.

Step S204, determining the network information to be fed back based on the target control signal, wherein the network information is used for representing the network state of the target transmission link.

In the technical solution provided by step S204 of the present invention, the network information to be fed back is calculated based on the determined target control signal, where the network information is used to represent the network state of the target transmission link, such as an intra-network state signal, a feedback signal, and the like.

Optionally, the queue length and the dequeue time of the real-time communication data packet arriving at the target router are determined based on the target control signal to obtain the queue time of the real-time communication data packet and the transmission time of the real-time communication data packet leaving the queue, and the network information to be fed back, that is, the time of the data packet expected to arrive at the receiving end and the feedback signal are determined based on the determined queue time of the real-time communication data packet and the transmission time of the real-time communication data packet leaving the queue.

Step S206, feeding back the network information to the sending end, where the network information is used to enable the sending end to adjust the transmission parameters of the media data.

In the technical solution provided in step S206 of the present invention, the determined network information to be fed back is transmitted to the sending end, so that the sending end adjusts the transmission parameters of the media data.

Optionally, when the determined network information is fed back to the sending end, a feedback data packet is correspondingly generated, the estimated network information to be fed back is transmitted to the sending end, and the sending end adjusts the transmission parameters of the media data according to the received information.

Through the above steps S202 to S206 in the present application, a target control signal of a target communication protocol used by a target router is obtained, where a sub-transmission link between the target router and a receiving end is a last-hop transmission link of a target transmission link between the sending end and the receiving end, and the target control signal is used to control a transmission parameter for transmitting media data to the receiving end; determining network information to be fed back based on the target control signal, wherein the network information is used for representing the network state of the target transmission link; and feeding back the network information to the sending end, wherein the network information is used for enabling the sending end to adjust the transmission parameters of the media data. That is to say, the invention feeds back the network information to be fed back to the sending end in time, so that the sending end adjusts the transmission parameters of the transmission media data in time, thereby avoiding the delay increase caused by the rate mismatching, achieving the technical effect of improving the real-time communication quality of the media data, and solving the technical problem of low real-time communication quality of the media data.

The above method of this embodiment is further described below.

As an optional implementation manner, in step S202, acquiring a target control signal of a target communication protocol used by a target router includes: determining a protocol format of a target communication protocol; and determining a target control signal associated with the target communication protocol based on the protocol format.

In this embodiment, the target router is detected through a port or a protocol of a target communication protocol used by the target router, a real-time communication flow rate that needs to be optimized on the target router is obtained, a protocol format of the target communication protocol on the target router is determined, and a corresponding target control signal is matched according to the protocol format.

Optionally, the target router is detected through a port or a protocol of a target communication protocol used by the target router, real-time communication traffic needing to be optimized on the target router is obtained, a protocol format of a real-time communication traffic data packet protocol and a protocol format of a feedback control packet are read, and a target control signal matched with a current protocol is matched according to the protocol format.

For example, when the real-time communication adopts a network real-time communication framework and a real-time transmission Protocol, it may be checked that the real-time transmission Protocol data packet is transmitted by using a User data packet Protocol (UDP), and the extension packet header of the real-time transmission Protocol data packet contains a flag bit, such as 0 xBEDE; or, the protocol format of the target communication protocol can be obtained through a negotiation stage during connection establishment, so as to achieve the purpose of determining the protocol format and the characteristics of the target communication protocol.

Optionally, after the protocol format is identified, the pre-constructed real-time communication protocol library may be queried, and the features may be classified to match the corresponding target control signal according to the protocol format, for example, after the network real-time communication framework and the real-time transmission protocol are identified, the protocol library may be queried to know that the target control signal control depends on a time interval for the receiving end of the data packet, where the receiving end is mounted in the real-time transmission protocol feedback packet.

As an optional implementation manner, in response to determining that the target control signal associated with the target communication protocol fails, the corresponding first prompt message is displayed on the operation interface.

In this embodiment, when it is determined that the target control signal associated with the target communication protocol fails, the failure signal is fed back to the sending end in time and corresponding first prompt information is displayed on the operation interface, where the first prompt information may be information about a change in network state.

Optionally, when it is determined that the target control signal associated with the target communication protocol fails, the failure signal is fed back to the sending end in time, and corresponding first prompt information is displayed on the operation interface, so that the change of the network state can be found in time, adaptive adjustment can be made, and user experience is not affected.

As an optional implementation manner, detecting communication traffic of a target router; and determining the communication protocol of the communication flow as a target communication protocol.

In the embodiment, the communication traffic of the target router is detected, the communication protocol of the communication traffic of the target router is only used for identifying matching, and the existing transmission protocol is compatible, so that the target communication protocol is obtained, wherein the communication traffic can be real-time communication traffic.

Optionally, the real-time communication flow of the signal from the in-network state to the terminal is selected, and the identification and matching are performed according to the control signal of the current real-time communication protocol, so that the in-network state of the network can be converted into a readable state on the terminal, and the readable state is compatible with the existing transmission protocol, and a target communication protocol is obtained.

As an optional implementation manner, determining a target control signal associated with a target communication protocol based on a protocol format includes: displaying a plurality of identifications of a plurality of control signals associated with a target communication protocol on an operation interface based on a protocol format, wherein the plurality of identifications correspond to the plurality of control signals one to one; and displaying the identifier of the target control signal corresponding to the type of the network information in the plurality of identifiers on the operation interface.

In this embodiment, a plurality of identifiers of a plurality of control signals associated with a target communication protocol are displayed on an operation interface based on a protocol format, the plurality of identifiers correspond to the plurality of control signals one to one, the identifiers of the target control signals are matched, and an identifier of a target control signal corresponding to a type of network information among the plurality of identifiers is displayed on the operation interface, where the plurality of control signals may be a series of control signals sensitive to a transmission protocol.

Optionally, a series of control signals sensitive to the transmission protocol is used, sensitive factors of which the sending rate is affected are counted, the identification and matching are performed according to the control signal of the current real-time communication protocol, and the control signal of the current real-time communication protocol and the identification of the series of control signals sensitive to the current transmission protocol corresponding to the control signal of the real-time communication protocol are displayed on the operation interface.

As an optional implementation manner, displaying, on the operation interface, an identifier of a target control signal corresponding to a type of the network information, from among the plurality of identifiers, includes: displaying the matching degree of each control signal matched with the type of the network information on an operation interface to obtain a plurality of matching degrees; determining the control signal corresponding to the maximum matching degree in the matching degrees as a target control signal, or responding to a selection operation instruction acting on an operation interface, selecting the target matching degree from the matching degrees, and determining the control signal corresponding to the target matching degree as the target control signal; and displaying the identification of the target control signal on the operation interface.

In the embodiment, the matching degree of each control signal matched with the type of the network information is displayed on an operation interface to obtain a plurality of matching degrees, and the control signal with the maximum matching degree is selected from the plurality of matching degrees and determined as the target control signal; or selecting an operation instruction component on the operation interface, selecting a target matching degree from the multiple matching degrees according to actual requirements, determining a control signal corresponding to the target matching degree as a target control signal, and displaying the representation of the selected target control signal on the operation interface.

Optionally, a series of control signals sensitive to the current transmission protocol are provided on the operation interface, the supported feedback types are filtered, the most effective and sensitive control signal of the current protocol is extracted as the target control signal, and the identifier of the target control signal is displayed on the operation interface.

As an alternative implementation, step S204, determining the network information to be fed back based on the target control signal includes: determining a queuing delay time and a transmission delay time corresponding to a target control signal in response to the target router receiving the media data, wherein the queuing delay time is the delay time of media data queued in a target queue, and the transmission delay time is the delay time of media data transmitted in a target channel; the network information is determined based on the queuing delay time and the transmission delay time.

In this embodiment, the target router receives the media data, determines a queuing delay time and a transmission delay time corresponding to the target control signal, and determines the network information based on the queuing delay time and the transmission delay time, wherein the target channel may be a wireless channel.

Optionally, the queuing delay time is a delay time of media data queued in the target queue, and may be represented by qDelay, and may be that when a wireless router is normally used for performing a real-time communication function, another user connected to the same router suddenly starts downloading files, which causes data downloaded by the files to occupy a limited queue space on the router, so that data packets for real-time communication also cannot be queued in the queue that is lengthened, due to a delay generated by a queue in the router.

Alternatively, the transmission delay time may be a delay time of media data transmitted in a target channel, which may be denoted by xmitDelay, and may be a delay caused by other users in the channel using the same wireless channel when the wireless router is normally used for real-time communication, for example, a 2.4GHz wireless channel may be interfered by a surrounding wireless router, a bluetooth signal, or even a microwave oven, so that an error occurs in a data packet in the wireless channel, and the data packet has to be uploaded again, resulting in a transmission delay in the wireless channel.

As an optional implementation, determining the network information based on the queuing delay time and the transmission delay time includes: determining target time for the media data to be transmitted to a receiving end based on the queuing delay time and the transmission delay time; network information is determined based on the target time.

In this embodiment, a target time at which media data is to be transmitted to a receiving end is determined based on a queuing delay time and a transmission delay time, and network information is determined based on the target time, where the target time may be a time at which a data packet is expected to arrive at the receiving end, may be currently estimated information, may be a predicted/estimated control signal, may be represented by tsReceive, and may be calculated from a sum of the transmission delay time, the queuing delay time, and a current time of a target router, that is:

optionally, when the target time exceeds a target threshold, the network is determined to fluctuate, where the target threshold may be a certain time set according to practice, and is not specifically limited herein.

As an optional implementation manner, displaying network information on the operation interface, wherein the network information is used for representing the network state abnormality of the target transmission link; and responding to an adjusting operation instruction acting on the operation interface to adjust the target time.

In this embodiment, when the network state of the target transmission link is abnormal, the abnormal network information is displayed on the operation interface, an adjustment operation instruction on the operation interface is selected for the abnormal network information, and the target time is adjusted according to the actual situation.

Optionally, when the transmission state of the wireless channel is found to be abnormal, an abnormal signal is fed back to the sending end in time and is displayed on the operation interface, so that the sending end can find the change of the network state in time and respond to an adjustment operation instruction acting on the operation interface to perform adaptive adjustment on the target time.

As an optional implementation, the determining the network information based on the target time includes: determining the target time as network information; feeding back the network information to the transmitting end, including: and feeding back the target time to the transmitting end.

In this embodiment, the target time is determined as the network information, and a corresponding feedback packet is generated, so as to achieve the purpose of feeding back the estimated time to the transmitting end.

As an optional implementation manner, feeding back the network information to the sending end includes: and triggering the network information to be fed back to the sending end based on the sum of the queuing delay time and the transmission delay time.

In this embodiment, the sum of the queuing delay time and the transmission delay time may be calculated at intervals, and based on the result of the sum, the network information may be triggered to be fed back to the sending end, for example, when the sum of the queuing delay time and the transmission delay time falls within a certain interval, the feedback may be triggered immediately.

Optionally, the sum of the queuing delay time and the transmission delay time is calculated at intervals, and feedback may be triggered when the calculation result falls in the last p percentile of the historical distribution interval, for example, exceeds the historical value of 95%, where p may be set according to an actual situation, and is not specifically limited herein.

For example, if 3 consecutive measurements spaced 1ms apart (N =3, T =1 ms) are available

When the transmission delay exceeds the history value of 95% (p = 5%), the feedback is triggered immediately, and the network information feedback is triggered to the sending end.

As an optional implementation manner, step S208, feeding back the network information to the sending end, includes: and triggering the network information to be fed back to the sending end in response to the current time reaching the target cycle time.

In this embodiment, it is determined whether the feedback reaches the target cycle time, and if the feedback reaches or exceeds the target cycle time, the network information is triggered to be fed back to the sending end.

Optionally, it is determined whether the current feedback period T is reached. And if the time from the last feedback reaches or exceeds T, immediately generating a feedback packet and transmitting the feedback packet to the transmitting end.

The embodiment of the invention also provides a data processing method in the entertainment playing scene.

Fig. 3 is a flow chart of another data processing method according to an embodiment of the present invention. As shown in fig. 3, the method may include the following steps.

Step S302, the media data to be transmitted is obtained from the entertainment playing platform.

In the technical solution provided in step S302 of the present invention, the media data to be transmitted is obtained from the entertainment playing platform, where the entertainment playing scene may be a movie, television, drama video, news video, etc.; the media data may be pictures, video, audio, etc. with transmissions.

Step S304, when it is detected that the media data is transmitted to the target router, a target control signal of a target communication protocol used by the target router is obtained, wherein a sub-transmission link between the target router and the playing client is a last-hop transmission link of a target transmission link between the entertainment playing platform and the playing client, and the target control signal is used for controlling a transmission parameter for transmitting the media data to the playing client.

In the technical solution provided in step S304 of the present invention, when the media data is transmitted to the target router, the target router is detected through a port or a protocol of a target communication protocol used by the target router, and the target router is identified and checked through information such as an IP address and the port, so as to achieve the purpose of obtaining a target control signal of the target communication protocol used by the target router, where a sub-transmission link between the target router and a receiving end is a last-hop transmission link of a target transmission link between a entertainment playing flat and a playing client; the target control signal is used for controlling transmission parameters for transmitting the media data to the receiving end, and may include, but is not limited to, packet loss, Round Trip Time (RTT), delay gradient (delay gradient), receiving rate, and the like; the destination communication protocol may be an IP address, port, and/or protocol format.

Step S306, determining network information to be fed back based on the target control signal, where the network information is used to represent a network state of the target transmission link.

In the technical solution provided by step S306 of the present invention, the length and dequeuing rate of the current queue of the target transmission link are determined based on the target control signal, the rate (txRate) of the data packet leaving the queue within a specified period of time is determined based on the length and dequeuing rate of the queue, the queue length and dequeuing time of the real-time communication data packet arriving at the target router are determined based on the rate of the data packet, so as to obtain the queuing time of the real-time communication data packet and the transmission time of the real-time communication data packet leaving the queue, and the network information to be fed back is determined based on the determined queuing time of the real-time communication data packet and the transmission time of the real-time communication data packet leaving the queue.

Alternatively, when each new real-time communication packet arrives at the target router, the queue length (qLen) in the current queue is first measured and recorded. At the same time, the rate of packets leaving the queue over a specified period of time is measured by means of a running average.

Alternatively, if the current queue is a First-In-First-Out (FIFO) queue, the queuing time can be inferred by dividing the total queue length by the transmission rate of the data packet, i.e. the queue length is divided by the transmission rate of the data packet

It should be noted that, the calculation method can calculate according to the dequeue rule of the corresponding management mechanism. For example, if the Fair queuing management mechanism is adopted, the queue length and rate should be replaced with the length and transmission rate of the current real-time communication data stream.

Optionally for wireless channelsIn other words, only one data frame can be transmitted in the same link at the same time, so the interval between the data packets leaving the queue is the data frame transmission delay time. It should be noted that some new transmission mechanisms (e.g. 11 ac) employ frame aggregation and other techniques to aggregate multiple data packets into a same data frame for transmission, and there may be a case where multiple data packets are continuously dequeued and the interval is 0. Therefore, the dequeue time of each data packet in the past period is firstly aggregated according to a certain granularity (e.g. 1 ms), and the dequeue time interval txInterval of the aggregated data packet is calculated, and the transmission delay time xmitDelay in the wireless channel is estimated by using the interval, i.e. the time interval

。

Optionally, a target time at which the media data is to be transmitted to the receiving end is determined based on the queuing delay time and the transmission delay time, and network information is determined based on the target time, where the target time may be a time at which the data packet is expected to reach the receiving end, may be currently estimated information, may be a predicted/estimated control signal, may be represented by tsReceive, and may be calculated from the sum of the transmission delay time, the queuing delay time, and the current time of the target router, that is:

step S308, the network information is fed back to the entertainment playing platform, wherein the network information is used for enabling the entertainment playing platform to adjust the transmission parameters of the media data.

In the technical solution provided in step S308 of the present invention, the network information is fed back to the entertainment playing platform, so as to achieve the purpose of adjusting the transmission parameters of the media data by the entertainment playing platform.

As an optional implementation manner, the media data is transmitted to the playing client based on the adjusted transmission parameter, where the media data is used to enable the playing client to play the corresponding media content.

In this embodiment, the transmission parameter is adjusted, and the adjusted transmission parameter transmits the media data to the playing client, so as to achieve the purpose of adjusting the transmission parameter of the media data by the entertainment playing platform.

Optionally, the transmission parameter is modified to ensure that the sequence of the data packets is consistent before and after the data packets are maintained, when the network condition fluctuates, due to the difference of the computation time, when the rate of the data packet is smaller when the previous packet is computed and the rate of the data packet is larger when the next packet is computed, the time that the previous packet arrives at the receiving end may be later than the time that the next packet arrives, at this time, out-of-sequence may appear at the transmitting end, and in order to ensure the consistency of the control signal, the arrival time of the next packet is modified, and the transmitting end is enabled to process the data packets consistently by modifying the arrival time of the out-of-sequence data packet to the arrival time of the previous packet and adding the increment of the transmission time.

The embodiment of the invention also provides a data processing method in the live broadcast scene.

Fig. 4 is a flow chart of another data processing method according to an embodiment of the present invention. As shown in fig. 4, the method may include the following steps.

Step S402, the media data to be transmitted is obtained from the live broadcast platform.

Step S404, when it is detected that the media data is transmitted to the target router, a target control signal of a target communication protocol used by the target router is obtained, where a sub-transmission link between the target router and the playing client is a last-hop transmission link of a target transmission link between the live playing platform and the playing client, and the target control signal is used to control a transmission parameter for transmitting the media data to the playing client.

Step S406, determining network information to be fed back based on the target control signal, where the network information is used to represent a network state of the target transmission link.

Step S408, feeding back the network information to the live broadcast platform, where the network information is used to enable the live broadcast platform to adjust the transmission parameters of the media data.

The embodiment of the invention also provides a data processing method under the road detection playing scene.

Fig. 5 is a flow chart of another data processing method according to an embodiment of the present invention. As shown in fig. 5, the method may include the following steps.

Step S502, media data to be transmitted are obtained from the road detection playing platform.

Step S504, when it is detected that the media data is transmitted to the target router, a target control signal of a target communication protocol used by the target router is obtained, where a sub-transmission link between the target router and the playing client is a last-hop transmission link of a target transmission link between the road detection playing platform and the playing client, and the target control signal is used to control a transmission parameter for transmitting the media data to the playing client.

Step S506, determining network information to be fed back based on the target control signal, where the network information is used to represent a network state of the target transmission link.

Step S508, feeding back the network information to the road detection playing platform, where the network information is used to enable the road detection playing platform to adjust the transmission parameters of the media data.

In this embodiment, a target control signal of a target communication protocol used by a target router is obtained, where a sub-transmission link between the target router and a receiving end is a last-hop transmission link of a target transmission link between a sending end and the receiving end, and the target control signal is used to control a transmission parameter for transmitting media data to the receiving end; determining network information to be fed back based on the target control signal, wherein the network information is used for representing the network state of the target transmission link; and feeding back the network information to the sending end, wherein the network information is used for enabling the sending end to adjust the transmission parameters of the media data. That is to say, the invention feeds back the network information to be fed back to the sending end in time, so that the sending end adjusts the transmission parameters of the transmission media data in time, thereby avoiding the delay increase caused by the rate mismatching, achieving the technical effect of improving the real-time communication quality of the media data, and solving the technical problem of low real-time communication quality of the media data.

Example 2

The following further describes a preferred implementation of the above method of this embodiment, and specifically describes an intra-network transmission quality feedback method.

With the advent of the mobile internet era and the fifth-generation communication technology era, various real-time audio and video applications of a wireless network are developed vigorously, wherein the scale of network live broadcast users is continuously increased, and business modes are continuously expanded, such as real-time audio and video functions, live broadcast, video cloud, video conferences and the like, so that for numerous audio and video scenes, the guarantee of user experience is a core element for guaranteeing competitive advantages, improving market share and customer satisfaction.

In order to meet the requirements of large-scale audio and video functions on reliability, low delay and expandability, real-time communication technology is continuously developed and perfected. Quality of Service (QoS) is an important component of a real-time communication technology framework, and includes multiple dimensions such as congestion control, information source compression, packet loss resistance, and the like, which have a decisive influence on the Quality of user experience. One key problem of the current real-time communication technology is that the service quality between a real-time communication server and a client is poor in weak network resistance and weak network capacity, the problem seriously affects the user experience quality, and the solution of the problem is very important for improving the market occupancy rate and the customer satisfaction degree of the real-time audio and video function.

An important trend at present is that the last hop transmission delay of the mobile terminal gradually becomes a bottleneck component of the end-to-end delay, fig. 6 is a schematic diagram of a real-time communication technology according to an embodiment of the related art, as shown in fig. 6, the hop transmission from a wireless router (inclusive) to a client of a receiving terminal of the real-time communication is called the last hop transmission in a link, an access network supported by a mobile terminal handset at present includes a mobile communication technology, a wireless network and the like, and the wireless transmission delay from a base station/an access point to a user and a queuing delay derived from the wireless transmission delay in the access network become main contributors of the rise of the end-to-end delay.

Based on a transport layer protocol type (UDP or TCP), the existing multipath real-time audio and video transmission method mainly comprises the following modes:

the fast acknowledgement character (FastACK) is based on a transmission control protocol fast acknowledgement character (TCP ACK) early feedback scheme provided by a router, and the fast acknowledgement character (FastACK) early feedback scheme is used for connecting a fast acknowledgement character message fed back to a transmission control protocol in advance through a hijack transmission control protocol according to the connection state on the current router so as to accelerate rate control adjustment.

And secondly, an explicit control protocol (XCP) enables the router in the network to feed back the service condition of the current router to the sending end by simultaneously modifying the client and all routers in the network, and the sending end can adjust the rate according to the fed-back information.

Third, Rate Control Protocol (RCP) is similar to the explicit Control protocol, except that the information fed back by the RCP is more comprehensive and richer, and each router can estimate the sending rate to which different data streams should be distributed.

Fourth, a rate Control protocol (Accel Brake Control, ABC for short) is proposed for a wireless network, and a sending end and a router need to be modified simultaneously, so that on one hand, the downlink sending rate of the wireless network can be accurately estimated, and on the other hand, estimated information can be fed back to the sending end through some fields in the existing transmission Control protocol.

And fifthly, a rate control protocol (DCQCN) combining an in-network state and an end system, wherein the exchanger can measure the service condition of the current queue and the link utilization rate and directly feed back the measurement result to a sending end for rate control.

However, on one hand, compared with the existing compatible feedback design that does not require simultaneous coordination of a data stream sending and receiving end, the method still has the technical problem that further optimization control cannot be performed on the low delay requirement of real-time communication, for example, the main objective of the method for quickly confirming characters is to improve the throughput of a wireless router, but not to reduce the transmission delay of the last hop, and when the queuing delay of the router is increased, the method still faces the problem that the feedback is not timely, only can save the transmission delay of the reverse transmission control protocol quickly confirming characters on a wireless channel, and the tail delay of the method cannot meet the low delay requirement of the real-time communication function.

On the other hand, compared to the traditional framework combining the in-network state feedback and the on-end rate control, the above-mentioned problems still have the technical problem that it is difficult to be compatible with the existing transmission protocol downward, the traditional network state feedback protocol design (such as the rate control protocol combining the in-network state and the end system, the explicit control protocol and the rate control protocol) needs the sending end of the data stream to make corresponding modification to reasonably respond to the feedback message in the network, for example, when congestion and other events occur in the network, not only the in-network device, such as the router, needs to modify to make it generate new network state related messages (DCQCN) or write the network state into its self-defined transmission protocol (XCP, RCP), or write into some fields (ABC) of the existing IP messages, but also needs to modify at the sending end application at the same time, such as modifying the rate control module of the operating system transmission control protocol kernel or the application program to make the sending end send the new network state related messages to be able to make it possible to make the sending messages to respond to the sending messages reasonable The end understands the meaning of these messages generated by the devices within the network and resolves them correctly, however, such deployability is relatively poor: on one hand, as an in-network device manufacturer, the in-network device manufacturer lacks the control capability of a client for data traffic and is difficult to modify a large amount of applications, and on the other hand, the development cost and the operation and maintenance cost for changing a data flow client are high, so that the scheme has difficulty in scale deployment.

In order to solve the above problems, the present invention provides an in-network state in-band feedback method for real-time audio and video applications, including but not limited to VR, instant message, etc., which is implemented on a last-hop wireless router of an audio and video real-time transmission system, so as to solve the problems of weak network and network outage from a communication server to a client.

The above method of this embodiment is further described below.

Fig. 7 is a flowchart of a data processing method of a transmission system according to an embodiment of the present invention, and as shown in fig. 7, the method includes three sub-methods, corresponding to three stages of selecting, calculating and transmitting a feedback signal. One or more sub-methods can also be independently realized without dependence, the audio and video real-time communication experience under the weak network can also be improved, and the three sub-methods cooperate with each other to jointly complete the whole process.

Step S702, selecting a frame from the network state to the terminal signal.

The selection framework of the signals from the in-network state to the end can identify the protocol format of the real-time communication video stream on the current router and the feedback control signal.

Step S704, a queue-based hybrid delay estimation method.

The queue-based hybrid delay estimation method estimates the expected arrival time of the data packet currently coming to the router at the client, and predicts to obtain the control signal.

Step S706, the in-band feedback frequency control mechanism is adapted.

When the adaptive in-band feedback frequency control mechanism determines that the current estimated information needs to be fed back to the transmitting end, a feedback data packet is correspondingly generated, and the time estimated in step S704 is fed back to the transmitting end.

The following further describes a method for converting an intra-network state to an on-end signal for real-time communication audio/video transmission, that is, a method for selecting a frame from the intra-network state to the on-end signal.

And identifying and matching according to the control signal of the current real-time communication protocol, and counting sensitive factors of which the sending rate is influenced by using the signal sensitive to the current protocol. The present invention may be a general solution supporting arbitrary rate control signals including but not limited to packet loss, round trip time, delay gradient, and reception rate.

The selection frame of the signals from the internal state to the terminal is identified and matched according to the control signals of the current real-time communication protocol, the internal state of the network can be converted into a readable state on the terminal, the network is compatible with the existing standard protocol, the compatibility challenge is solved by summarizing and mapping the existing rate control signals and the internal state signals, and meanwhile, the change of the internal state of the network is sensed on the terminal in real time on the premise of realizing.

The feedback signal of the transmission method of the traditional real-time communication completely depends on the construction and the transmission of the receiving end. For example, in network real-time communication, a receiving client determines a period, defaults to 50ms, counts the arrival time of a received data packet in the period, constructs a feedback data packet and feeds back the interval of the arrival time to a sending end, and introduces a frame for selecting an in-network state to an end signal by taking a protocol as real-time communication and a feedback control signal as the time interval of the packet arriving at a receiving end as an example, and details of each execution step are described below.

Fig. 8 is a flow chart of the selection of an in-network state-to-peer signal according to an embodiment of the present invention, and as shown in fig. 8, the method may include the following steps.

Step S802, detecting real-time communication flow.

Detecting whether the real-time communication traffic needing to be optimized exists on the current wireless router or not through modes such as an IP address, a port and/or a protocol format, if the real-time communication traffic needing to be optimized does not exist, forwarding is normally carried out, otherwise, step S804 is executed.

Step S804, the protocol format of the real-time communication traffic data packet protocol and the feedback control packet is read.

The protocol format of the data traffic and the reverse feedback control packet are identified and checked by the IP address, port, etc. For example, when the real-time communication adopts a network real-time communication framework and a real-time communication/real-time transmission protocol, it should be checked that the real-time transmission protocol data packet is transmitted by using a user data packet protocol, and the extension packet header thereof contains the flag bits such as 0xBEDE, or can be known through a negotiation stage during connection establishment, so that the protocol format and the characteristics of the current flow can be known.

Step S806, matching the acquisition control signal depending on the current protocol according to the format classification.

According to the protocol format identified in step S804, a pre-established real-time communication protocol library is queried, and the features are classified to obtain a control signal on which the current protocol depends, for example, if a real-time communication/real-time transmission protocol of the network real-time communication framework is identified, the protocol library is queried to know that the rate control depends on a time interval for receiving the data packet by a receiving end carried in the real-time transmission control protocol feedback packet.

Step S808, a feedback control signal is constructed and selected.

In step S806, a series of control signals sensitive to the current transmission protocol are usually given, and at this time, the supported feedback types need to be filtered, and the control signal that is most effective and sensitive to the current protocol is extracted as the control signal to be predicted.

In summary, the selection framework of the signals from the state to the end in the network supports the filtering and selection of the control signals while being compatible with the existing protocol by identifying the current flow and the protocol, and the method provides a basis for constructing the feedback signals.

A queue-based hybrid delay estimation method for real-time communication audio-video transmission, i.e. a delay estimation method oriented to queuing delay and transmission delay, is further described below.

A mixed delay estimation method based on queues is provided, the combined estimation of a three-layer network queue and a two-layer link layer queue of a router is utilized, the transmission states of the queues in the current network and a wireless channel are combined, the control signals selected in the front are estimated, the signals of rate control, future delay and the like of a data packet to be fed back are accurately predicted by utilizing the current queue information, such as queuing time, queue length, dequeuing rate, dequeuing interval and the like, and meanwhile, the fed back signals can be attached to the real situation and are accurate.

Channel competition enhancement, increased competition flow of a router queue buffer area and the like can potentially cause conditions of delay increase, video playing jam, screen splash and the like in an access network, and the delay increase can be caused in various ways, for example, when a user normally uses the current wireless router to perform a real-time communication function, another user connected with the same router suddenly starts to download files, which can cause the downloaded data of the files to occupy the limited queue space on the current router, so that real-time communication data packets can not be queued in the lengthened queue, and higher queuing delay is experienced, and at the moment, the delay is mainly caused by the queue in the router; when a user normally uses the current wireless router to perform a real-time communication function, other users in the channel use the same frequency band, for example, the 2.4GHz wireless communication frequency band may be interfered by the surrounding wireless router, bluetooth signal, and even microwave oven, which may cause an error in the data packet in the wireless channel, so that retransmission has to be performed, and further, the transmission delay of the data packet in the wireless channel is increased.

Aiming at the two problems, the queue-based hybrid delay estimation method measures the length of a queue to estimate the queuing delay so as to obtain the stable delay in a steady state; on the other hand, the transmission time of the data packet in the wireless channel is estimated by measuring the dequeue time interval, and the delay estimation information of the two aspects is combined to obtain a more accurate estimation of the delay of the last hop. Each of the execution steps will be described in detail below.

Fig. 9 is a flowchart of a delay estimation method according to an embodiment of the present invention, and as shown in fig. 9, the method may include the following steps:

step S902, measure the current queue length and dequeue rate.

When each new real-time communication data packet arrives at the router to which the method belongs, the queue length (qLen) in the current queue is firstly measured and recorded. At the same time, the rate of packets leaving the queue (txRate) over a specified period of time in the past is measured by means of a running average. The queue refers to a transmission queue in a three-layer network, for example, a fifty-chord (QueueDisc) of an operating system transmission network card.

In step S904, the queuing time of the data packet in the queue is calculated and inferred.

Assuming that the current queue is a first-in-first-out queue, the expected queuing delay may be determined by the total queue lengthBy dividing by the sending rate of the data packet, i.e. by deduction

If the current queue adopts management mechanisms such as weighted fair queue, the calculation method can calculate according to the dequeuing rule of the corresponding management mechanism, and the length and rate of the queue at this time should be replaced by the length and sending rate of the current real-time communication data stream.

Step S906 measures the interval of the data packet leaving the queue and deduces its transmission delay in the wireless channel.

For a wireless channel, only one data frame can be transmitted in the same link at the same time, so the interval of a data packet leaving a queue is a data frame transmission delay, and it should be noted that some new transmission mechanisms (e.g., 11 ac) employ techniques such as frame aggregation, etc., to aggregate a plurality of data packets into the same data frame for transmission, at this time, there is a case that a plurality of data packets are continuously dequeued and the interval is 0, so the method first aggregates the dequeue time of each data packet in a past period according to a certain specific granularity (e.g., 1 ms), and calculates the dequeue time interval (txInterval) of the aggregated data packet, thereby estimating the transmission time xmitDelay in the wireless channel, i.e., the transmission time xmitval is estimated

。

Step S908 is to calculate the expected arrival time of the data packet at the receiving end and the feedback signal.

Based on the queuing delay and the transmission delay estimated in step S904 and step S906, the time of arrival of the data packet at the receiving end, i.e., the time of arrival of the data packet at the receiving end, can be calculated from the current time

Where tsNow is the current time on the router.

In step S910, the delay data is corrected to ensure that the sequence of the data packets is consistent.

When the network condition fluctuates, due to the difference of the calculation time, when the rate (txRate) of the data packet is smaller when the previous packet is calculated and the rate is larger when the next packet is calculated, the arrival time of the previous packet may be later than that of the next packet. At this time, it may appear out of order at the transmitting end. To ensure the consistency of the control signals, the arrival time of the next packet is corrected. The arrival time of the out-of-order data packets is corrected to be the arrival time of the last packet and added with the increment of the queuing delay time, so that the data packets can be processed by the sending end consistently.

An adaptive in-band feedback frequency control mechanism for real-time communication audio-video transmission is further described below.

The adaptive in-band feedback frequency control mechanism mainly overcomes the potential influence of frequent feedback on an uplink network and a current router, and mainly comprises in-band data feedback of a fixed period and in-band data feedback triggered by an event. The former is mainly responsible for reducing the overhead caused by frequent feedback when the network state is good, and the latter is mainly responsible for ensuring that a new feedback data packet can be generated in time when a network emergency (such as channel capacity reduction) occurs.

The self-adaptive in-band feedback frequency control mechanism solves the balance of feedback data frequency on link bandwidth and feedback timeliness by combining feedback triggered by a fixed period and time in different network states, and is suitable for transmission layer protocols such as a user-defined format and the like; through the dynamic adjustment of the feedback period, the additional burden brought by the feedback data message can be effectively reduced.

Since in-band feedback requires a specific data packet to carry the feedback information, too high or too low feedback frequency may affect network performance. If the feedback frequency is too high, for real-time communication audio and video transmission, because data is encoded in units of video frames, and there is a time interval of tens to hundreds of milliseconds between frames, if the feedback frequency is much higher than the frame rate, it may cause many feedback packets to have no feedback information, which may cause confusion of receiving the feedback packets by the sending end, for example, for audio and video transmission with a frame rate of 24fps, there is an interval of 42ms between frames, at this time, if the feedback period is 20ms, it may cause new feedback packets not to carry any information, and at the same time, too frequent feedback may consume reverse uplink data traffic, which may cause real feedback packets to be difficult to arrive in time.

If the feedback frequency is too low, when the network status changes, the information needs to be immediately carried back to the transmitting end, and if the feedback frequency is too low, for example, set to 40ms, the network status is good, but when the network status suddenly deteriorates, the change of the status still needs to wait until the next feedback packet can be sensed by the transmitting end, and therefore the timing of the transmission rate adjustment may be delayed.

Therefore, an adaptive feedback frequency control mechanism is proposed for the trade-off faced by the feedback frequency, fig. 10 is a flowchart of a feedback frequency control mechanism according to an embodiment of the present invention, as shown in fig. 10, the method may include the following steps:

step S1002, cycle trigger determination.

And after the feedback information calculation in the second sub-method is finished each time, judging whether the current feedback period T is reached, and if the time from the last feedback reaches or exceeds T, immediately generating a feedback packet and sending the feedback packet.

Step S1004, event triggering determination.

Continuously measuring whether the expected delay of the last N time slices with the length of T is changed significantly, wherein the time slices refer to queuing time at intervals (for example, 1 ms)

A calculation is performed, the significant change is that the calculation result falls in the last p percentile of the historical distribution interval (e.g. over 95% of the historical value), therefore, an example of event triggering is if there are 3 consecutive measurements with an interval of 1ms (N =3, T =1 ms), all of which have a value of 1ms

If the transmission delay exceeds 95% of the history (p = 5%), the feedback should be triggered immediately, and it should be noted that the number isWords are used by way of example only and are not meant to be limiting.

In the embodiment, based on a selection frame from an intranet state to an on-terminal signal, the change of the on-terminal real-time perception network state is realized on the premise of ensuring compatibility by aiming at a conversion method of the intranet state and the on-terminal signal of real-time communication audio transmission; a delay estimation method facing queuing delay and transmission delay is provided based on a mixed delay estimation method of queues, so that better balance between agility and stability is obtained; based on a self-adaptive in-band feedback frequency control mechanism, self-adaptive frequency control facing in-band feedback control is provided, and by combining periodic trigger and event trigger, the state in the network can be fed back in time while the expenditure is saved. That is to say, when the network state fluctuates, the embodiment can feed back the change of the network state to the sending end in time, so that the sending end can adjust the sending rate in time, thereby reducing the problems of delay increase and the like caused by rate mismatch.

It should be noted that, for simplicity of description, the above-mentioned method embodiments are described as a series of acts or combination of acts, but those skilled in the art will recognize that the present invention is not limited by the order of acts, as some steps may occur in other orders or concurrently in accordance with the invention. Further, those skilled in the art should also appreciate that the embodiments described in the specification are preferred embodiments and that the acts and modules referred to are not necessarily required by the invention.

Through the above description of the embodiments, those skilled in the art can clearly understand that the data processing method according to the above embodiments can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware, but the former is a better implementation mode in many cases. Based on such understanding, the technical solutions of the present invention may be embodied in the form of a software product, which is stored in a storage medium (e.g., ROM/RAM, magnetic disk, optical disk) and includes instructions for enabling a terminal device (e.g., a mobile phone, a computer, a server, or a network device) to execute the method according to the embodiments of the present invention.

Example 3

According to an embodiment of the present invention, there is also provided a data processing apparatus for implementing the data processing method shown in fig. 2.

Fig. 11 is a schematic diagram of a data processing apparatus according to an embodiment of the present invention. As shown in fig. 11, the data processing apparatus 1100 may include: a first acquisition unit 1102, a first determination unit 1104 and a first feedback unit 1106.

A first obtaining unit 1102, configured to obtain a target control signal of a target communication protocol used by a target router, where a sub transmission link between the target router and a receiving end is a last-hop transmission link of a target transmission link between a sending end and the receiving end, and the target control signal is used to control a transmission parameter for transmitting media data to the receiving end.

A first determining unit 1104, configured to determine network information to be fed back based on the target control signal, where the network information is used to characterize a network state of the target transmission link.

A first feedback unit 1106, configured to feedback network information to the sending end, where the network information is used to enable the sending end to adjust transmission parameters of the media data.

It should be noted here that the first obtaining unit 1102, the first determining unit 1104 and the first feedback unit 1106 correspond to steps S202 to S206 in embodiment 1, and the three units are the same as the corresponding steps in the implementation example and application scenario, but are not limited to the disclosure in the first embodiment. It should be noted that the above units as a part of the apparatus may operate in the computer terminal 10 provided in the first embodiment.

According to an embodiment of the present invention, there is also provided a data processing apparatus for implementing the data processing method shown in fig. 3.

FIG. 12 is a schematic diagram of another data processing apparatus according to an embodiment of the present invention. As shown in fig. 12, the data processing apparatus 1200 may include: a second acquisition unit 1202, a third acquisition unit 1204, a determination unit 1206, and a second feedback unit 1208.

A second obtaining unit 1202, configured to obtain media data to be transmitted from the entertainment playing platform.

A third obtaining unit 1204, configured to obtain a target control signal of a target communication protocol used by the target router when the media data is detected to be transmitted to the target router, where a sub-transmission link between the target router and the playing client is a last-hop transmission link of a target transmission link between the entertainment playing platform and the playing client, and the target control signal is used to control a transmission parameter for transmitting the media data to the playing client.

A determining unit 1206, configured to determine network information to be fed back based on the target control signal, where the network information is used to characterize a network state of the target transmission link.

A second feedback unit 1208, configured to feed back network information to the entertainment playing platform, where the network information is used to enable the entertainment playing platform to adjust a transmission parameter of the media data.

It should be noted here that the second acquiring unit 1202, the third acquiring unit 1204, the determining unit 1206 and the second feedback unit 1208 correspond to steps S302 to S308 in embodiment 1, and the four units are the same as the corresponding steps in the implementation example and application scenario, but are not limited to the disclosure in the first embodiment. It should be noted that the above units as a part of the apparatus may operate in the computer terminal 10 provided in the first embodiment.

According to an embodiment of the present invention, there is also provided a data processing apparatus for implementing the data processing method shown in fig. 4.

FIG. 13 is a schematic diagram of another data processing apparatus according to an embodiment of the present invention. As shown in fig. 13, the data processing apparatus 1300 may include: a fourth acquisition unit 1302, a fifth acquisition unit 1304, a third determination unit 1306 and a third feedback unit 1308.

A fourth obtaining unit 1302, configured to obtain media data to be transmitted from the live broadcast platform.

A fifth obtaining unit 1304, configured to obtain a target control signal of a target communication protocol used by the target router when the media data is detected to be transmitted to the target router, where a sub-transmission link between the target router and the playing client is a last-hop transmission link of a target transmission link between the live broadcast platform and the playing client, and the target control signal is used to control a transmission parameter for transmitting the media data to the playing client.

A third determining unit 1306, configured to determine, based on the target control signal, network information to be fed back, where the network information is used to characterize a network state of the target transmission link.

A third feedback unit 1308, configured to feed back network information to the live broadcast platform, where the network information is used to enable the live broadcast platform to adjust a transmission parameter of the media data.

It should be noted here that the fourth acquiring unit 1302, the fifth acquiring unit 1304, the third determining unit 1306 and the third feedback unit 1308 correspond to steps S402 to S408 in embodiment 1, and the four units are the same as the corresponding steps in the implementation example and the application scenario, but are not limited to the disclosure in the first embodiment. It should be noted that the above units as a part of the apparatus may operate in the computer terminal 10 provided in the first embodiment.

According to an embodiment of the present invention, there is also provided a data processing apparatus for implementing the data processing method shown in fig. 5.

FIG. 14 is a schematic diagram of another data processing apparatus according to an embodiment of the present invention. As shown in fig. 14, the data processing apparatus 1400 may include: a sixth acquisition unit 1402, a seventh acquisition unit 1404, a fourth determination unit 1406, and a fourth feedback unit 1408.

A sixth obtaining unit 1402, configured to obtain the media data to be transmitted from the road detection playing platform.

A seventh obtaining unit 1404, configured to obtain a target control signal of a target communication protocol used by the target router when the media data is detected to be transmitted to the target router, where a sub-transmission link between the target router and the playing client is a last-hop transmission link of a target transmission link between the road detection playing platform and the playing client, and the target control signal is used to control a transmission parameter for transmitting the media data to the playing client.

A fourth determining unit 1406 is configured to determine network information to be fed back based on the target control signal, where the network information is used to characterize a network state of the target transmission link.

A fourth feedback unit 1408, configured to feed back network information to the road detection playing platform, where the network information is used to enable the road detection playing platform to adjust transmission parameters of the media data.

It should be noted here that the sixth acquiring unit 1402, the seventh acquiring unit 1404, the fourth determining unit 1406, and the fourth feedback unit 1408 correspond to steps S502 to S508 in embodiment 1, and the four units are the same as the corresponding steps in the implementation example and application scenario, but are not limited to the disclosure in the first embodiment. It should be noted that the above units as a part of the apparatus may operate in the computer terminal 10 provided in the first embodiment.

In the data processing apparatus of this embodiment, a first obtaining unit obtains a target control signal of a target communication protocol used by a target router, where a sub-transmission link between the target router and a receiving end is a last-hop transmission link of a target transmission link between a sending end and the receiving end, and the target control signal is used to control a transmission parameter for transmitting media data to the receiving end; determining network information to be fed back based on the target control signal through a first determination unit, wherein the network information is used for representing the network state of a target transmission link; and feeding back the network information to the sending end through the first feedback unit, wherein the network information is used for enabling the sending end to adjust the transmission parameters of the media data. That is to say, the invention feeds back the network information to be fed back to the sending end in time, so that the sending end adjusts the transmission parameters of the transmission media data in time, thereby avoiding the delay increase caused by the rate mismatching, achieving the technical effect of improving the real-time communication quality of the media data, and solving the technical problem of low real-time communication quality of the media data.

Example 4

Embodiments of the present invention may provide a data processing system, which may include a computer terminal, which may be any one of computer terminal devices in a computer terminal group. Optionally, in this embodiment, the computer terminal may also be replaced with a terminal device such as a mobile terminal.

Optionally, in this embodiment, the computer terminal may be located in at least one network device of a plurality of network devices of a computer network.

In this embodiment, the computer terminal may execute program codes of the following steps in the data processing method: acquiring a target control signal of a target communication protocol used by a target router, wherein a sub-transmission link between the target router and a receiving end is a last-hop transmission link of a target transmission link between a sending end and the receiving end, and the target control signal is used for controlling transmission parameters for transmitting media data to the receiving end; determining network information to be fed back based on the target control signal, wherein the network information is used for representing the network state of the target transmission link; and feeding back the network information to the sending end, wherein the network information is used for enabling the sending end to adjust the transmission parameters of the media data.

Alternatively, fig. 15 is a block diagram of a computer terminal according to an embodiment of the present invention. As shown in fig. 15, the computer terminal a may include: one or more processors 1502 (only one of which is shown), a memory 1504, and a transmission 1506.

The memory may be configured to store software programs and modules, such as program instructions/modules corresponding to the data processing method and apparatus in the embodiments of the present invention, and the processor executes various functional applications and data processing by running the software programs and modules stored in the memory, so as to implement the data processing method. The memory may include high speed random access memory, and may also include non-volatile memory, such as one or more magnetic storage devices, flash memory, or other non-volatile solid-state memory. In some examples, the memory may further include memory located remotely from the processor, which may be connected to the computer terminal a via a network. Examples of such networks include, but are not limited to, the internet, intranets, local area networks, mobile communication networks, and combinations thereof.

The processor can call the information and application program stored in the memory through the transmission device to execute the following steps: acquiring a target control signal of a target communication protocol used by a target router, wherein a sub-transmission link between the target router and a receiving end is a last-hop transmission link of a target transmission link between a sending end and the receiving end, and the target control signal is used for controlling transmission parameters for transmitting media data to the receiving end; determining network information to be fed back based on the target control signal, wherein the network information is used for representing the network state of the target transmission link; and feeding back the network information to the sending end, wherein the network information is used for enabling the sending end to adjust the transmission parameters of the media data.

Optionally, the processor may further execute the program code of the following steps: determining a protocol format of a target communication protocol; and determining a target control signal associated with the target communication protocol based on the protocol format.

Optionally, the processor may further execute the program code of the following steps: and responding to the failure of determining the target control signal associated with the target communication protocol, and displaying corresponding first prompt information on the operation interface.

Optionally, the processor may further execute the program code of the following steps: detecting the communication flow of a target router; and determining the communication protocol of the communication flow as a target communication protocol.

Optionally, the processor may further execute the program code of the following steps: displaying a plurality of identifications of a plurality of control signals associated with a target communication protocol on an operation interface based on a protocol format, wherein the plurality of identifications correspond to the plurality of control signals one to one; and displaying the identifier of the target control signal corresponding to the type of the network information in the plurality of identifiers on the operation interface.

Optionally, the processor may further execute the program code of the following steps: displaying the matching degree of each control signal matched with the type of the network information on an operation interface to obtain a plurality of matching degrees; determining the control signal corresponding to the maximum matching degree in the matching degrees as a target control signal, or responding to a selection operation instruction acting on an operation interface, selecting the target matching degree from the matching degrees, and determining the control signal corresponding to the target matching degree as the target control signal; and displaying the identification of the target control signal on the operation interface.

Optionally, the processor may further execute the program code of the following steps: determining a queuing delay time and a transmission delay time corresponding to a target control signal in response to the target router receiving the media data, wherein the queuing delay time is the delay time of media data queued in a target queue, and the transmission delay time is the delay time of media data transmitted in a target channel; the network information is determined based on the queuing delay time and the transmission delay time.

Optionally, the processor may further execute the program code of the following steps: determining target time for the media data to be transmitted to a receiving end based on the queuing delay time and the transmission delay time; network information is determined based on the target time.

Optionally, the processor may further execute the program code of the following steps: displaying network information on an operation interface, wherein the network information is used for representing the network state abnormity of a target transmission link; and responding to an adjusting operation instruction acting on the operation interface to adjust the target time.

Optionally, the processor may further execute the program code of the following steps: determining the target time as network information; and feeding back the target time to the transmitting end.

Optionally, the processor may further execute the program code of the following steps: feeding back the network information to the transmitting end, including: and triggering the network information to be fed back to the sending end based on the sum of the queuing delay time and the transmission delay time.

Optionally, the processor may further execute the program code of the following steps: feeding back the network information to the transmitting end, including: and triggering the network information to be fed back to the sending end in response to the current time reaching the target cycle time.

As an alternative example, the processor may invoke the information stored in the memory and the application program via the transmission means to perform the following steps: acquiring media data to be transmitted from an entertainment playing platform; when the media data are detected to be transmitted to the target router, a target control signal of a target communication protocol used by the target router is obtained, wherein a sub-transmission link between the target router and the playing client is a last-hop transmission link of a target transmission link between the entertainment playing platform and the playing client, and the target control signal is used for controlling transmission parameters for transmitting the media data to the playing client; determining network information to be fed back based on the target control signal, wherein the network information is used for representing the network state of the target transmission link; and feeding back the network information to the entertainment playing platform, wherein the network information is used for enabling the entertainment playing platform to adjust the transmission parameters of the media data.

Optionally, the processor may further execute the program code of the following steps: and transmitting the media data to the playing client based on the adjusted transmission parameters, wherein the media data is used for enabling the playing client to play the corresponding media content.

As an alternative example, the processor may invoke the information stored in the memory and the application program via the transmission means to perform the following steps: acquiring media data to be transmitted from a live broadcast platform; when the media data are detected to be transmitted to a target router, a target control signal of a target communication protocol used by the target router is obtained, wherein a sub-transmission link between the target router and a playing client is a last-hop transmission link of a target transmission link between a live playing platform and the playing client, and the target control signal is used for controlling transmission parameters for transmitting the media data to the playing client; determining network information to be fed back based on the target control signal, wherein the network information is used for representing the network state of the target transmission link; and feeding back the network information to the live broadcast platform, wherein the network information is used for enabling the live broadcast platform to adjust the transmission parameters of the media data.

As an alternative example, the processor may invoke the information stored in the memory and the application program via the transmission means to perform the following steps: acquiring media data to be transmitted from a road detection playing platform; when the media data are detected to be transmitted to the target router, a target control signal of a target communication protocol used by the target router is obtained, wherein a sub-transmission link between the target router and the playing client is a last-hop transmission link of a target transmission link between the road detection playing platform and the playing client, and the target control signal is used for controlling transmission parameters for transmitting the media data to the playing client; determining network information to be fed back based on the target control signal, wherein the network information is used for representing the network state of the target transmission link; and feeding back the network information to the road detection playing platform, wherein the network information is used for enabling the road detection playing platform to adjust the transmission parameters of the media data.

The embodiment of the invention provides a data processing method, which enables a sending end to adjust transmission parameters of transmission media data in time by feeding back network information to be fed back to the sending end in time, thereby avoiding delay increase and the like caused by rate mismatching and improving the quality of real-time communication of the media data.

It can be understood by those skilled in the art that the structure shown in fig. 15 is only an illustration, and the computer terminal a may also be a terminal device such as a smart phone (e.g., an Android phone, an iOS phone, etc.), a tablet computer, a palmtop computer, a Mobile Internet Device (MID), a PAD, and the like. Fig. 15 is not intended to limit the structure of the computer terminal a. For example, the computer terminal a may also include more or fewer components (e.g., network interfaces, display devices, etc.) than shown in fig. 15, or have a different configuration than shown in fig. 15.

Those skilled in the art will appreciate that all or part of the steps in the methods of the above embodiments may be implemented by a program instructing hardware associated with the terminal device, where the program may be stored in a computer-readable storage medium, and the storage medium may include: flash disks, Read-Only memories (ROMs), Random Access Memories (RAMs), magnetic or optical disks, and the like.

Example 5

Embodiments of the present invention also provide a computer-readable storage medium. Optionally, in this embodiment, the computer-readable storage medium may be configured to store the program code executed by the data processing method provided in the first embodiment.

Optionally, in this embodiment, the storage medium may be located in any one of computer terminals in a computer terminal group in a computer network, or in any one of mobile terminals in a mobile terminal group.

Optionally, in this embodiment, the storage medium is configured to store program code for performing the following steps: acquiring a target control signal of a target communication protocol used by a target router, wherein a sub-transmission link between the target router and a receiving end is a last-hop transmission link of a target transmission link between a sending end and the receiving end, and the target control signal is used for controlling transmission parameters for transmitting media data to the receiving end; determining network information to be fed back based on the target control signal, wherein the network information is used for representing the network state of the target transmission link; and feeding back the network information to the sending end, wherein the network information is used for enabling the sending end to adjust the transmission parameters of the media data.

Optionally, the computer-readable storage medium may further include program code for performing the following steps: determining a protocol format of a target communication protocol; and determining a target control signal associated with the target communication protocol based on the protocol format.

Optionally, the computer-readable storage medium may further include program code for performing the following steps: and responding to the failure of determining the target control signal associated with the target communication protocol, and displaying corresponding first prompt information on the operation interface.

Optionally, the computer-readable storage medium may further include program code for performing the following steps: detecting the communication flow of a target router; and determining the communication protocol of the communication flow as a target communication protocol.

Optionally, the computer-readable storage medium may further include program code for performing the following steps: displaying a plurality of identifications of a plurality of control signals associated with a target communication protocol on an operation interface based on a protocol format, wherein the plurality of identifications correspond to the plurality of control signals one to one; and displaying the identifier of the target control signal corresponding to the type of the network information in the plurality of identifiers on the operation interface.

Optionally, the computer-readable storage medium may further include program code for performing the following steps: displaying the matching degree of each control signal matched with the type of the network information on an operation interface to obtain a plurality of matching degrees; determining the control signal corresponding to the maximum matching degree in the matching degrees as a target control signal, or responding to a selection operation instruction acting on an operation interface, selecting the target matching degree from the matching degrees, and determining the control signal corresponding to the target matching degree as the target control signal; and displaying the identification of the target control signal on the operation interface.

Optionally, the computer-readable storage medium may further include program code for performing the following steps: determining a queuing delay time and a transmission delay time corresponding to a target control signal in response to the target router receiving the media data, wherein the queuing delay time is the delay time of media data queued in a target queue, and the transmission delay time is the delay time of media data transmitted in a target channel; the network information is determined based on the queuing delay time and the transmission delay time.

Optionally, the computer-readable storage medium may further include program code for performing the following steps: determining target time for the media data to be transmitted to a receiving end based on the queuing delay time and the transmission delay time; network information is determined based on the target time.

Optionally, the computer-readable storage medium may further include program code for performing the following steps: displaying network information on an operation interface, wherein the network information is used for representing the network state abnormity of a target transmission link; and responding to an adjusting operation instruction acting on the operation interface to adjust the target time.

Optionally, the computer-readable storage medium may further include program code for performing the following steps: determining the target time as network information; and feeding back the target time to the transmitting end.

Optionally, the computer-readable storage medium may further include program code for performing the following steps: and triggering the network information to be fed back to the sending end based on the sum of the queuing delay time and the transmission delay time.

Optionally, the computer-readable storage medium may further include program code for performing the following steps: and triggering the network information to be fed back to the sending end in response to the current time reaching the target cycle time.

As an alternative example, the computer readable storage medium is arranged to store program code for performing the steps of: acquiring media data to be transmitted from an entertainment playing platform; when the media data are detected to be transmitted to the target router, a target control signal of a target communication protocol used by the target router is obtained, wherein a sub-transmission link between the target router and the playing client is a last-hop transmission link of a target transmission link between the entertainment playing platform and the playing client, and the target control signal is used for controlling transmission parameters for transmitting the media data to the playing client; determining network information to be fed back based on the target control signal, wherein the network information is used for representing the network state of the target transmission link; and feeding back the network information to the entertainment playing platform, wherein the network information is used for enabling the entertainment playing platform to adjust the transmission parameters of the media data.

Optionally, the computer-readable storage medium may further include program code for performing the following steps: and transmitting the media data to the playing client based on the adjusted transmission parameters, wherein the media data is used for enabling the playing client to play the corresponding media content.

As an alternative example, the computer readable storage medium is arranged to store program code for performing the steps of: acquiring media data to be transmitted from a live broadcast platform; when the media data are detected to be transmitted to a target router, a target control signal of a target communication protocol used by the target router is obtained, wherein a sub-transmission link between the target router and a playing client is a last-hop transmission link of a target transmission link between a live playing platform and the playing client, and the target control signal is used for controlling transmission parameters for transmitting the media data to the playing client; determining network information to be fed back based on the target control signal, wherein the network information is used for representing the network state of the target transmission link; and feeding back the network information to the live broadcast platform, wherein the network information is used for enabling the live broadcast platform to adjust the transmission parameters of the media data.

As an alternative example, the computer readable storage medium is arranged to store program code for performing the steps of: acquiring media data to be transmitted from a road detection playing platform; when the media data are detected to be transmitted to the target router, a target control signal of a target communication protocol used by the target router is obtained, wherein a sub-transmission link between the target router and the playing client is a last-hop transmission link of a target transmission link between the road detection playing platform and the playing client, and the target control signal is used for controlling transmission parameters for transmitting the media data to the playing client; determining network information to be fed back based on the target control signal, wherein the network information is used for representing the network state of the target transmission link; and feeding back the network information to the road detection playing platform, wherein the network information is used for enabling the road detection playing platform to adjust the transmission parameters of the media data.

The above-mentioned serial numbers of the embodiments of the present invention are merely for description and do not represent the merits of the embodiments.

In the above embodiments of the present invention, the descriptions of the respective embodiments have respective emphasis, and for parts that are not described in detail in a certain embodiment, reference may be made to related descriptions of other embodiments.

In the embodiments provided in the present application, it should be understood that the disclosed technology can be implemented in other ways. The above-described embodiments of the apparatus are merely illustrative, and for example, the division of the units is only one type of division of logical functions, and there may be other divisions when actually implemented, for example, a plurality of units or components may be combined or may be integrated into another system, or some features may be omitted, or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection through some interfaces, units or modules, and may be in an electrical or other form.

The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.

In addition, functional units in the embodiments of the present invention may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit. The integrated unit can be realized in a form of hardware, and can also be realized in a form of a software functional unit.

The integrated unit, if implemented in the form of a software functional unit and sold or used as a stand-alone product, may be stored in a computer readable storage medium. Based on such understanding, the technical solution of the present invention may be embodied in the form of a software product, which is stored in a storage medium and includes instructions for causing a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the steps of the method according to the embodiments of the present invention. And the aforementioned storage medium includes: a U-disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a removable hard disk, a magnetic or optical disk, and other various media capable of storing program codes.

The foregoing is only a preferred embodiment of the present invention, and it should be noted that, for those skilled in the art, various modifications and decorations can be made without departing from the principle of the present invention, and these modifications and decorations should also be regarded as the protection scope of the present invention.

Claims

1. A data processing method, comprising:

acquiring a target control signal of a target communication protocol used by a target router, wherein a sub-transmission link between the target router and a receiving end is a last-hop transmission link of a target transmission link between a sending end and the receiving end, and the target control signal is used for controlling transmission parameters for transmitting media data to the receiving end;

determining network information to be fed back based on the target control signal, wherein the network information is used for representing the network state of the target transmission link;

and feeding back the network information to the sending end, wherein the network information is used for enabling the sending end to adjust the transmission parameters of the media data.

2. The method of claim 1, wherein obtaining the target control signal of the target communication protocol used by the target router comprises:

determining a protocol format of the target communication protocol;

and determining the target control signal associated with the target communication protocol based on the protocol format.

3. The method of claim 2, further comprising:

and responding to the fact that the target control signal related to the target communication protocol fails, and displaying corresponding first prompt information on an operation interface.

4. The method of claim 2, further comprising:

detecting communication traffic of the target router;

and determining the communication protocol of the communication flow as the target communication protocol.

5. The method of claim 2, wherein determining the target control signal associated with the target communication protocol based on the protocol format comprises:

displaying a plurality of identifications of a plurality of control signals associated with the target communication protocol on an operation interface based on the protocol format, wherein the plurality of identifications are in one-to-one correspondence with the plurality of control signals;

and displaying the identifier of the target control signal corresponding to the type of the network information in the plurality of identifiers on the operation interface.

6. The method of claim 5, wherein displaying, on the operator interface, an identifier of the target control signal corresponding to the type of the network information from the plurality of identifiers comprises:

displaying the matching degree of each control signal matched with the type of the network information on the operation interface to obtain a plurality of matching degrees;

determining the control signal corresponding to the maximum matching degree in the matching degrees as the target control signal, or responding to a selection operation instruction acting on the operation interface, selecting a target matching degree from the matching degrees, and determining the control signal corresponding to the target matching degree as the target control signal;

and displaying the identification of the target control signal on the operation interface.

7. The method of claim 1, wherein determining the network information to be fed back based on the target control signal comprises:

determining a queuing delay time and a transmission delay time corresponding to the target control signal in response to the target router receiving the media data, wherein the queuing delay time is a delay time of the media data queued in a target queue, and the transmission delay time is a delay time of the media data transmitted in a target channel;

determining the network information based on the queuing delay time and the transmission delay time.

8. The method of claim 7, wherein determining the network information based on the queuing delay time and the transmission delay time comprises:

determining target time for the media data to be transmitted to the receiving end based on the queuing delay time and the transmission delay time;

determining the network information based on the target time.

9. The method of claim 8, further comprising:

displaying the network information on an operation interface, wherein the network information is used for representing the network state abnormity of the target transmission link;

and responding to an adjusting operation instruction acting on the operation interface to adjust the target time.

10. The method of claim 8,

determining the network information based on the target time comprises: determining the target time as the network information;

feeding back the network information to the transmitting end, including: and feeding back the target time to the sending end.

11. The method of claim 7, wherein feeding back the network information to the transmitting end comprises:

and triggering the network information to be fed back to the sending end based on the sum of the queuing delay time and the transmission delay time.

12. The method of claim 1, wherein feeding back the network information to the transmitting end comprises:

and triggering the network information to be fed back to the sending end in response to the current time reaching the target cycle time.

13. A data processing method, comprising:

acquiring media data to be transmitted from an entertainment playing platform;

when the media data is detected to be transmitted to a target router, acquiring a target control signal of a target communication protocol used by the target router, wherein a sub-transmission link between the target router and a playing client is a last-hop transmission link of a target transmission link between the entertainment playing platform and the playing client, and the target control signal is used for controlling transmission parameters for transmitting the media data to the playing client;

and feeding back the network information to the entertainment playing platform, wherein the network information is used for enabling the entertainment playing platform to adjust the transmission parameters of the media data.

14. The method of claim 13, further comprising:

and transmitting the media data to the playing client based on the adjusted transmission parameters, wherein the media data is used for enabling the playing client to play corresponding media contents.