CN118101553A

CN118101553A - Data transmission method, device, equipment and storage medium

Info

Publication number: CN118101553A
Application number: CN202410224497.9A
Authority: CN
Inventors: 俞贺镔; 王海萍; 郑高挺
Original assignee: Beijing Zitiao Network Technology Co Ltd
Current assignee: Beijing Zitiao Network Technology Co Ltd
Priority date: 2024-02-28
Filing date: 2024-02-28
Publication date: 2024-05-28

Abstract

The embodiment of the disclosure provides a data transmission method, a data transmission device, data transmission equipment and a storage medium. The method comprises the following steps: determining whether a redundant data cross-path transmission condition is currently satisfied based on current first network state information of the first network path and current second network state information of the second network path; if the transmission condition of the redundant data crossing the path is met currently, determining target redundant data corresponding to target media data to be transmitted currently; the target media data is transmitted over a first network path and the target redundancy data is transmitted over a second network path. By the technical scheme of the embodiment of the disclosure, cross-path transmission of redundant data can be realized, and the data transmission quality is improved with lower flow consumption, so that the user experience is improved.

Description

Data transmission method, device, equipment and storage medium

Technical Field

The embodiments of the present disclosure relate to computer technology, and in particular, to a data transmission method, apparatus, device, and storage medium.

Background

With the rapid development of computer technology, real-time transmission of media data is often required to realize real-time communication. At present, in real-time communication, a single network path established between a sending end and a receiving end is generally utilized to transmit media data, and when a packet transmission delay or loss occurs, the network path is utilized to simultaneously transmit media data and redundant data of the media data, so as to improve the success rate of receiving the data at the receiving end. However, when a problem occurs in a single network path in this transmission manner, the media data and the redundant data still face the situation of transmission delay or loss, so that the data cannot be decoded in time at the receiving end, and the user experience is affected.

Disclosure of Invention

The disclosure provides a data transmission method, a device, equipment and a storage medium, so as to realize cross-path transmission of redundant data, and improve data transmission quality with lower flow consumption, thereby improving user experience.

In a first aspect, an embodiment of the present disclosure provides a data transmission method, including:

Determining whether a redundant data cross-path transmission condition is currently satisfied based on current first network state information of the first network path and current second network state information of the second network path;

If the transmission condition of the redundant data crossing the path is met currently, determining target redundant data corresponding to target media data to be transmitted currently;

And transmitting the target media data through the first network path and the target redundant data through the second network path.

In a second aspect, an embodiment of the present disclosure further provides a data transmission apparatus, including:

The cross-path transmission detection module is used for determining whether the transmission condition of the redundant data cross-path is met currently or not based on the current first network state information of the first network path and the current second network state information of the second network path;

the redundant data determining module is used for determining target redundant data corresponding to target media data to be transmitted currently if the transmission condition of the redundant data across paths is met currently;

And the data transmission module is used for transmitting the target media data through the first network path and transmitting the target redundant data through the second network path.

In a third aspect, an embodiment of the present disclosure further provides an electronic device, including:

one or more processors;

storage means for storing one or more programs,

When the one or more programs are executed by the one or more processors, the one or more processors are caused to implement a data transmission method as in any of the embodiments of the present disclosure.

In a fourth aspect, the disclosed embodiments also provide a storage medium containing computer-executable instructions which, when executed by a computer processor, are used to perform a data transmission method as any of the disclosed embodiments.

According to the embodiment of the disclosure, whether the transmission condition of the redundant data crossing paths is met is determined based on the current first network state information of the first network path and the current second network state information of the second network path, if the transmission condition of the redundant data crossing paths is met, the target redundant data corresponding to the target media data to be transmitted is determined, the target media data is transmitted through the first network path, and the target redundant data is transmitted through the second network path, so that part of traffic of the first network path is dynamically unloaded to the second network path for transmission, the transmission of the redundant data crossing paths is realized, the success rate of data reception is improved, a large amount of traffic on the second network path is not consumed, the data transmission quality is improved with lower traffic consumption, and the user experience is improved.

Drawings

The above and other features, advantages, and aspects of embodiments of the present disclosure will become more apparent by reference to the following detailed description when taken in conjunction with the accompanying drawings. The same or similar reference numbers will be used throughout the drawings to refer to the same or like elements. It should be understood that the figures are schematic and that elements and components are not necessarily drawn to scale.

Fig. 1 is a flow chart of a data transmission method according to an embodiment of the disclosure;

fig. 2 is an exemplary diagram of a data transmission process according to an embodiment of the present disclosure;

fig. 3 is a flowchart of another data transmission method according to an embodiment of the disclosure;

fig. 4 is a schematic structural diagram of a data transmission device according to an embodiment of the present disclosure;

fig. 5 is a schematic structural diagram of an electronic device according to an embodiment of the disclosure.

Detailed Description

Embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. While certain embodiments of the present disclosure have been shown in the accompanying drawings, it is to be understood that the present disclosure may be embodied in various forms and should not be construed as limited to the embodiments set forth herein, but are provided to provide a more thorough and complete understanding of the present disclosure. It should be understood that the drawings and embodiments of the present disclosure are for illustration purposes only and are not intended to limit the scope of the present disclosure.

It should be understood that the various steps recited in the method embodiments of the present disclosure may be performed in a different order and/or performed in parallel. Furthermore, method embodiments may include additional steps and/or omit performing the illustrated steps. The scope of the present disclosure is not limited in this respect.

The term "including" and variations thereof as used herein are intended to be open-ended, i.e., including, but not limited to. The term "based on" is based at least in part on. The term "one embodiment" means "at least one embodiment"; the term "another embodiment" means "at least one additional embodiment"; the term "some embodiments" means "at least some embodiments. Related definitions of other terms will be given in the description below.

It should be noted that the terms "first," "second," and the like in this disclosure are merely used to distinguish between different devices, modules, or units and are not used to define an order or interdependence of functions performed by the devices, modules, or units.

It should be noted that references to "one", "a plurality" and "a plurality" in this disclosure are intended to be illustrative rather than limiting, and those of ordinary skill in the art will appreciate that "one or more" is intended to be understood as "one or more" unless the context clearly indicates otherwise.

The names of messages or information interacted between the various devices in the embodiments of the present disclosure are for illustrative purposes only and are not intended to limit the scope of such messages or information.

It will be appreciated that the data (including but not limited to the data itself, the acquisition or use of the data) involved in the present technical solution should comply with the corresponding legal regulations and the requirements of the relevant regulations.

Fig. 1 is a flow chart of a data transmission method provided by an embodiment of the present disclosure, where the embodiment of the present disclosure is applicable to a case of transmitting media data in a real-time communication scenario, where the real-time communication scenario may include a live broadcast, a teleconference, or a cloud game. The method may be performed by a data transmission device, which may be implemented in the form of software and/or hardware, optionally by an electronic device, which may be a mobile terminal, a PC-side or a server, etc.

As shown in fig. 1, the data transmission method specifically includes the following steps:

S110, determining whether the transmission condition of the redundant data crossing the path is met or not based on the current first network state information of the first network path and the current second network state information of the second network path.

Wherein the first network path may refer to a network transmission channel for transmitting media data. The second network path may be a network transmission channel for assisting the first network path in transmitting redundant data when a problem occurs in the first network path. The media data may refer to audio/video streaming data that needs to be transmitted in real-time communication. The redundant data may be data obtained by redundancy encoding the media data. For example, based on a forward error correction coding mode (Forward Error Correction, FEC), redundancy coding is performed on media data to be transmitted, so as to obtain redundancy data corresponding to the media data. The redundant data can be used as protection data of the media data, so that the receiving end can quickly recover the media data based on the redundant data.

The first network path in this embodiment may be used as a primary path, and the second network path may be used as a secondary path. The first network path and the second network path are two completely different network paths. For example, the first network path is a wireless local area network path and the second network path is a cellular network path. The wireless local area network path refers to a network path for wireless transmission by a WiFi method. The cellular network path refers to a network path for wireless transmission through a mobile network. In general, the network speed of the wireless local area network path is higher, the network access is more stable, and the user access generally does not charge a fee, and the bandwidth provider pays the fee, so that the wireless local area network path can be used as a main path for transmitting the media data. The cellular network path is provided by a communication carrier and uses the own data network of the user, so that the user needs to charge a certain fee when using the cellular network, and the cellular network path can be used as an auxiliary path for auxiliary transmission of data. In view of this, it is required to reduce traffic consumption of the cellular network path while improving data transmission quality, thereby saving use cost of the user and improving user experience.

The current first network state information of the first network path may refer to network state information of the first network path when data is currently transmitted. The current first network state information may be used to characterize a network quality condition of the first network path when data is currently being transmitted. For example, the current first network state information may include, but is not limited to: a current first Round Trip Time (RTT) of the first network path. The higher the current first round trip delay, the larger the current transmission delay of the first network path, and the worse the network quality. Similarly, the current second network state information may be used to characterize the network quality of the second network path when it is currently transmitting data. For example, the current second network state information may include, but is not limited to: the current second round trip delay of the second network path. The higher the current second round trip delay, the larger the current transmission delay of the second network path, and the worse the network quality. The redundant data cross-path transmission condition may be a preset condition that needs to be satisfied to allow the second network path to transmit the redundant data. For example, the transmission condition of redundant data across paths may mean that the transmission quality of the second network path is higher than the transmission quality of the first network path, so that the auxiliary transmission of the second network path may play an enhancing role, thereby improving the transmission quality of the overall data.

Specifically, current first network state information of the first network path and current second network state information of the second network path may be acquired in real time or periodically, and the current first network state information and the current second network state information may be compared to determine whether the transmission condition of redundant data across paths is currently satisfied.

Illustratively, step S110 may include: the current first round trip delay of the first network path is compared with the current second round trip delay of the second network path, and whether the transmission condition of redundant data across paths is met is determined based on the comparison result.

Specifically, if the current second round trip delay is smaller than or equal to the current first round trip delay, the transmission quality of the second network path is higher than that of the first network path, and the second network path can play an enhancement role, at this time, it can be determined that the transmission condition of the redundant data cross-path is currently met, or else, it is determined that the transmission condition of the redundant data cross-path is not currently met. Or adding the current first round-trip delay of the first network path with a preset delay (such as 50 ms), and obtaining an addition result as a target round-trip delay corresponding to the first network path. And comparing the target round-trip delay with the current second round-trip delay of the second network path, and determining whether the transmission condition of the redundant data crossing the path is met or not currently based on the comparison result. For example, if the current second round trip delay is less than or equal to the target round trip delay, it indicates that the transmission quality of the second network path is higher than or close to the transmission quality of the first network path, and the second network path can play an enhancement role, where it can be determined that the transmission condition of redundant data across paths is currently satisfied. If the current second round-trip delay is greater than the target round-trip delay, the transmission quality of the second network path is obviously lower than that of the second network path, namely, the transmission quality of the first network path is obviously higher than that of the second network path, and at the moment, the cross-path transmission of redundant data is not needed, namely, the condition that the cross-path transmission condition of the redundant data is not met is determined.

And S120, if the transmission condition of the redundant data crossing the path is met currently, determining target redundant data corresponding to the target media data to be transmitted currently.

The target media data may refer to audio/video stream data to be currently transmitted. The target redundant data can be used as protection data of the target media data, and is used for quickly recovering the target media data at the receiving end.

Specifically, when it is determined that the transmission condition of the redundant data across paths is currently met, the target media data to be transmitted currently can be subjected to redundancy coding based on the current packet loss rate of the first network path, so that the target redundant data to be transmitted of the second network path can be obtained. For example, the data amount of the target media data to be currently transmitted may be multiplied by the current packet loss rate of the first network path to obtain a target redundant data amount, and the target media data may be redundantly encoded based on the target redundant data amount to obtain target redundant data having the target redundant data amount. The data amount of the target redundant data is smaller than the data amount of the target media data. And a proper amount of target redundant data can be dynamically generated based on the current packet loss rate of the first network path, so that the traffic consumption of the second network path is further reduced while the data transmission quality is ensured.

S130, transmitting target media data through a first network path and transmitting target redundant data through a second network path.

Specifically, after the transmission condition of the redundant data is met, the target media data is transmitted through the first network path, and meanwhile, the target redundant data is transmitted through the second network path, so that the media data and the redundant data are respectively transmitted through the two network paths, the redundant data on the first network path are dynamically unloaded to the second network path for transmission, the success rate of the redundant data transmission is improved, and the recovery success rate of the data at the receiving end is further improved.

When determining that the transmission condition of the redundant data across paths is not met currently, the method indicates that the network quality of the first network path is good, and at the moment, after target redundant data corresponding to target media data to be transmitted currently can be generated according to original logic, the target media data and the target redundant data are transmitted simultaneously through the first network path, and participation of the second network path is not needed, so that the flow consumption of the second network path is reduced.

Illustratively, referring to fig. 2, two network paths, a first network path and a second network path, are established between the sender and the receiver. When the network state of the first network path is good, redundant data cannot be generated in a controller of the sending end, and the target media data to be transmitted currently are sent to the first network path for transmission. When the first network path is transmitted, the controller in the transmitting end generates a certain amount of target redundant data, and confirms that the second network path can play a good role in data recovery when the current transmission condition of the redundant data across paths is met, and the target redundant data is sent to the second network path for transmission at the moment, so that the transmission of the redundant data across paths is realized. If the current condition of the transmission of the redundant data across paths is not met, the target redundant data can be continuously sent to the first network path for transmission, and the waste of the transmission flow of the second network path is avoided. Compared with a single-path transmission mode, the method and the device can fully utilize the robustness of the two network paths to the network jitter, can also consider the traffic overhead, effectively balance the traffic consumption and the data transmission quality, and optimize the user experience while saving the traffic as much as possible.

According to the technical scheme, whether the transmission condition of the redundant data crossing paths is met or not is determined based on the current first network state information of the first network path and the current second network state information of the second network path, if the transmission condition of the redundant data crossing paths is met, the target redundant data corresponding to the target media data to be transmitted currently is determined, the target media data is transmitted through the first network path, and the target redundant data is transmitted through the second network path, so that part of traffic of the first network path is dynamically unloaded to the second network path for transmission, the transmission of the redundant data crossing paths is realized, the success rate of data reception is improved, a large amount of traffic on the second network path is not consumed, the data transmission quality is improved with lower traffic consumption, and the user experience is improved.

On the basis of the above technical solution, as an alternative, the "transmitting the target redundant data through the second network path" in step S130 may include: if the target sending code rate corresponding to the target redundant data is larger than the current network bandwidth of the second network path, determining a first sending code rate of the first network path for transmitting the redundant data and a second sending code rate of the second network path for transmitting the redundant data based on the target sending code rate and the current network bandwidth; and transmitting part of redundant data in the target redundant data at a first transmission code rate through the first network path, and transmitting the rest of redundant data in the target redundant data at a second transmission code rate through the second network path.

The target transmission code rate may refer to a data amount of target redundant data transmitted in a unit time. The current network bandwidth may refer to the available bandwidth at the current time of the second network path. The first transmission code rate may refer to a code rate at which the first network path transmits the redundant data. The second transmission code rate may refer to a code rate at which the second network path transmits the redundant data. The sum of the first transmission code rate and the second transmission code rate is equal to the target transmission code rate.

Specifically, whether the second network path has the capability of transmitting all the redundant data can be determined by detecting whether the target transmission code rate corresponding to the target redundant data is greater than the current network bandwidth of the second network path. If the target sending code rate corresponding to the target redundant data is larger than the current network bandwidth of the second network path, the second network path is indicated to be incapable of sending the corresponding target redundant data with the target sending code rate, and at the moment, the target sending code rate can be allocated based on the current network bandwidth to determine the first sending code rate of the first network path for transmitting the redundant data and the second sending code rate of the second network path for transmitting the redundant data. The first network path transmits partial redundant data at a first transmission code rate in addition to the target media data, and the second network path transmits the residual redundant data at a second transmission code rate, so that when the transmission bandwidth of the second network path is insufficient, the two network paths are utilized to simultaneously transmit the redundant data, the success rate of the transmission of the redundant data can be further improved, and the recovery success rate of the data at the receiving end is further ensured.

Illustratively, determining the first transmission rate at which the first network path transmits the redundant data and the second transmission rate at which the second network path transmits the redundant data based on the target transmission rate and the current network bandwidth may include: determining a difference value between a target sending code rate and a current network bandwidth; and determining the difference value as a first sending code rate of the first network path for transmitting the redundant data, and determining the current network bandwidth as a second sending code rate of the second network path for transmitting the redundant data.

Specifically, the current network bandwidth of the second network path is directly used as the second sending code rate of the second network path to transmit the redundant data, so that the second network path transmits more redundant data with the maximum bandwidth capability. And taking the difference value between the target sending code rate and the current network bandwidth as a first sending code rate of the first network path for transmitting the redundant data, so that the first network path transmits the residual redundant data with the first sending code rate, the data transmission pressure of the first network path is reduced as much as possible, and the data transmission efficiency and the user experience are optimized.

Fig. 3 is a flowchart of another data transmission method provided by an embodiment of the present disclosure, where the embodiment of the present disclosure optimizes the step of determining target redundancy data corresponding to target media data to be currently transmitted based on the above-described embodiment of the present disclosure. Wherein the same or corresponding terms as those of the above-described embodiments are not explained in detail herein.

As shown in fig. 3, the data transmission method specifically includes the following steps:

S310, determining whether the transmission condition of the redundant data crossing the path is met or not based on the current first network state information of the first network path and the current second network state information of the second network path.

S320, if the transmission condition of the redundant data is met, determining whether the enhancement condition of the redundant data is met or not based on at least one of the current first network state information of the first network path and the current playing katon information of the media data.

The current playing and blocking information of the media data may refer to blocking information that occurs when the receiving end plays the media data currently. As shown in fig. 2, the receiving end merges the media data and the redundant data received from the first network path and the second network path, which belong to the same stream, together to recover the data, and decodes and renders the recovered media data, thereby realizing the playing of the media data. The current play-out-card information may be used to characterize the quality of experience of the user. The more the currently played media data is stuck, the less fluent the media data is played, and the poorer the user experience quality is. The embodiment can utilize any index capable of representing the user experience quality to represent the current playing katon information. For example, the current play-out-of-media-data-clip information may include: the current decoding interval in which the current adjacent two frames in the media data are decoded. The current decoding interval may refer to a time difference in which the current most recently decoded frame is decoded from the last frame. The larger the current decoding interval, the greater the likelihood of play-out stuck. The redundant data enhancement condition may be a preset condition that needs to be satisfied for generating a larger amount of redundant data.

Specifically, after determining that the transmission condition of the redundant data across paths is currently met, it may be determined whether the network state of the first network path is in an extremely weak network condition based on at least one of current first network state information of the first network path and current playing katon information of the media data, so as to determine whether enhancement processing is required for the redundant data, so as to generate more redundant data.

Illustratively, step S320 may include: if the transmission condition of the redundant data across paths is met currently, detecting whether the current first round trip delay of the first network path is larger than or equal to the preset delay and whether the current decoding interval of the current adjacent two frames in the media data to be decoded is larger than or equal to the preset time interval, and determining whether the redundancy enhancement condition is met currently based on the detection result.

The preset delay may be preset, and the first network path cannot transmit the minimum round trip delay of the media data on time. The preset time interval may be a preset minimum decoding interval corresponding to play stuck, which is unacceptable to the user.

Specifically, when the current first network state information is the current first round trip delay and the current playing katon information is the current decoding interval of the current adjacent two frames, whether the redundancy enhancement condition is met currently can be determined by detecting whether the current first round trip delay of the first network path is greater than or equal to a preset delay and whether the current decoding interval of the current adjacent two frames in the media data is greater than or equal to a preset time interval.

Illustratively, determining whether the redundancy enhancement condition is currently satisfied based on the detection result may include: if the current first round trip delay of the first network path is greater than or equal to a preset delay or the current decoding interval of the current adjacent two frames in the media data to be decoded is greater than or equal to a preset time interval, determining that the redundancy enhancement condition is currently met; if the current first round trip delay of the first network path is smaller than the preset delay and the current decoding interval of the current adjacent two frames in the media data to be decoded is smaller than the preset time interval, determining that the redundancy enhancement condition is not met currently.

Specifically, when the current first round trip delay of the first network path is greater than or equal to a preset delay (for example, 500 ms), it indicates that the first network path cannot complete transmission of the media data on time, and at this time, it may be determined that the redundancy enhancement condition is currently met, or else, it is determined that the redundancy enhancement condition is not currently met. Or when the current decoding interval of the current adjacent two frames in the media data is greater than or equal to a preset time interval (such as 1000 ms), the play katon user appearing at the receiving end is indicated to be unacceptable, at the moment, the current meeting of the redundancy enhancement condition can be determined, or else, the current failing to meet the redundancy enhancement condition is determined. Whether the enhancement processing of the redundant data is needed or not can be determined more accurately by utilizing the current first round trip delay and the current decoding interval, and the success rate of data recovery is further improved.

Illustratively, the current decoding interval of the current two adjacent frames in the media data is obtained by parsing the feedback message sent by the receiving end.

Specifically, in the process of decoding and recovering the received data, the receiving end can count the time difference between the currently decoded frame and the decoded frame, wherein the time difference is the current decoding interval of the decoded frames, so that the current decoding interval can be obtained in real time. The receiving end may generate a feedback message including the current decoding interval based on the current decoding interval. The message type of the feedback message may be, but is not limited to, RTCP (RTP Control Protocol) network transmission protocol types. The receiving end can actively send the generated feedback message to the sending end at intervals (such as every 200 ms), so as to realize active transmission of the feedback message. The receiving end can also regenerate and send the corresponding feedback message when receiving the request message sent by the sending end, thereby realizing the passive transmission of the feedback message. After the sending end receives the feedback message, the feedback message is analyzed, so that the current decoding interval in the feedback message can be obtained, and the sending end can accurately acquire the media data playing blocking condition in the receiving end.

It should be noted that, the receiving end may send the feedback packet to the sending end through the first network path, or may send the feedback packet to the sending end through the second network path, which may perform fixed selection based on the service requirement or perform dynamic selection based on the network state.

S330, determining target redundant data corresponding to the target media data to be transmitted currently based on whether the redundant data enhancement condition is met currently.

Specifically, if the redundant data enhancement condition is not satisfied at present, the target redundant data corresponding to the target media data may be generated according to the original redundancy mode. If the current redundancy data enhancement condition is met, enhancement processing can be carried out on the redundancy data generated in the original redundancy mode, enhanced target redundancy data is generated, and the data volume of the enhanced target redundancy data is larger than that of the redundancy data generated in the original redundancy mode. By generating more target redundant data, the picture can be ensured to be fully restored under the extremely weak network condition.

Illustratively, step S330 may include: if the current redundancy data enhancement condition is met, determining target redundancy data equivalent to target media data to be transmitted currently; and if the current redundancy data enhancement condition is not met, determining target redundancy data corresponding to the target media data to be transmitted currently based on the current packet loss rate of the first network path.

Specifically, if the redundant data enhancement condition is currently satisfied, target redundant data equivalent to the target media data to be currently transmitted is determined, so that the data amount of the generated target redundant data is equal to the data amount of the target media data. If the redundancy data enhancement condition is not met currently, multiplying the data volume of the target media data to be transmitted currently with the current packet loss rate of the first network path to obtain a target redundancy data volume, and performing redundancy coding on the target media data based on the target redundancy data volume to obtain target redundancy data with the target redundancy data volume, wherein the generated data volume of the target redundancy data is smaller than the data volume of the target media data.

It should be noted that when the redundant data enhancement condition is currently met, the target redundant data equal to the target media data is determined and sent, so that the receiving end can still recover, decode, render and play the media data as long as the target redundant data is successfully transmitted even if all the media data transmitted by the first network path is lost, thereby ensuring that the data can be recovered at the receiving end, and improving the data recovery efficiency and success rate when the first network path condition is bad.

Alternatively, if the redundant data enhancement condition is currently satisfied, determining target redundant data equivalent to the target media data currently to be transmitted includes: if the number of times of meeting the redundant data enhancement condition in the current time window is greater than or equal to the preset number of times, determining target redundant data which is equal to the target media data to be transmitted currently in a preset time period, so as to continuously transmit the target redundant quantity in the preset time period.

The current time window may be a sliding time window having a preset window duration. For example, the preset window duration may be 3 seconds. Specifically, whether the redundant data enhancement condition is currently satisfied may be detected at intervals within the current time window, so that the detection of whether the redundant data enhancement condition is satisfied may be performed a plurality of times within the current time window. If the number of times of meeting the redundant data enhancement condition detected in the current time window is greater than or equal to the preset number of times (for example, 3 times), the network state of the first network path is indicated to be continuously bad, and at this time, the redundant enhancement can be continuously started within a preset time period (for example, 2 seconds), that is, the target redundant data which is equal to the target media data is always sent within the preset time period, so that the second network path is continuously used for carrying out the redundant enhancement when the network state of the first network path is bad is ensured.

It should be noted that, when the current time satisfies the redundancy data enhancing condition and the target redundancy data of the same amount of the target media data is transmitted, the decoding interval of the receiving end is shortened, the jamming rate is reduced, and at this time, the redundancy enhancement may be turned off due to the fact that the redundancy data enhancing condition is not satisfied at the next time, so that only the original redundancy data is transmitted, but the jamming occurs again after the redundancy enhancement is turned off, and thus the user experience cannot be effectively improved. For this, when the number of times of meeting the redundant data enhancement condition in the current time window is greater than or equal to the preset number of times, the embodiment of the disclosure continuously presets the opening of the redundant enhancement for a preset duration, so that the situation of repeatedly playing and blocking can be avoided, and further the user experience is effectively improved.

For example, if the number of times that the redundancy data enhancement condition is satisfied in the current time window is smaller than the preset number of times, the redundancy enhancement does not need to last for a preset duration, and at this time, target redundancy data equivalent to the target media data to be transmitted currently can be directly determined and sent.

S340, transmitting target media data through the first network path and transmitting target redundant data through the second network path.

According to the technical scheme, whether the redundant data enhancement condition is met or not is determined based on at least one of the current first network state information of the first network path and the current playing katon information of the media data, and more proper target redundant data can be determined based on whether the redundant data enhancement condition is met or not, so that the data can be restored at the receiving end, and the data restoration efficiency and success rate when the condition of the first network path is poor are improved.

Fig. 4 is a schematic structural diagram of a data transmission device according to an embodiment of the present disclosure, as shown in fig. 4, where the device specifically includes: a cross-path transmission detection module 410, a redundant data determination module 420, and a data transmission module 430.

The cross-path transmission detection module 410 is configured to determine whether a redundant data cross-path transmission condition is currently satisfied based on current first network state information of the first network path and current second network state information of the second network path; the redundant data determining module 420 is configured to determine target redundant data corresponding to target media data to be transmitted currently if the redundant data cross-path transmission condition is currently satisfied; the data transmission module 430 is configured to transmit the target media data through the first network path and transmit the target redundancy data through the second network path.

According to the technical scheme provided by the embodiment of the disclosure, whether the transmission condition of the redundant data crossing paths is met is determined based on the current first network state information of the first network path and the current second network state information of the second network path, if the transmission condition of the redundant data crossing paths is met, the target redundant data corresponding to the target media data to be transmitted is determined, the target media data is transmitted through the first network path, and the target redundant data is transmitted through the second network path, so that part of traffic of the first network path is dynamically unloaded to the second network path for transmission, the transmission of the redundant data crossing paths is realized, the success rate of data reception is improved, a large amount of traffic on the second network path is not consumed, the data transmission quality is improved with lower traffic consumption, and the user experience is improved.

Based on the above technical solution, the cross-path transmission detection module 410 is specifically configured to: the current first round trip delay of the first network path is compared with the current second round trip delay of the second network path, and whether the transmission condition of redundant data across paths is met is determined based on the comparison result.

Based on the above aspects, the redundant data determining module 420 includes:

a redundant data enhancement detection unit, configured to determine whether a redundant data enhancement condition is currently satisfied based on at least one of current first network state information of the first network path and current play katon information of the media data;

And the redundant data determining unit is used for determining target redundant data corresponding to the target media data to be transmitted currently based on whether the redundant data enhancing condition is met currently.

Based on the above technical solutions, the redundant data enhancement detection unit is specifically configured to:

detecting whether the current first round trip delay of the first network path is larger than or equal to preset delay and whether the current decoding interval of the current adjacent two frames in the media data is larger than or equal to preset time interval, and determining whether the current redundancy enhancement condition is met or not based on the detection result;

The current decoding interval of the current adjacent two frames in the media data is obtained by analyzing the feedback message sent by the receiving end.

On the basis of the above technical solutions, the redundant data determining unit includes:

a first determining subunit, configured to determine, if the redundancy data enhancement condition is currently satisfied, target redundancy data equivalent to target media data to be currently transmitted;

And the second determining subunit is used for determining target redundant data corresponding to the target media data to be transmitted currently based on the current packet loss rate of the first network path if the redundant data enhancement condition is not met currently.

Based on the above technical solutions, the first determining subunit is specifically configured to:

If the number of times of meeting the redundant data enhancement condition in the current time window is greater than or equal to the preset number of times, determining target redundant data which is equal to the target media data to be transmitted currently in a preset time period, so as to continuously transmit the target redundant quantity in the preset time period.

Based on the above technical solutions, the data transmission module 430 includes:

the transmission code rate determining unit is used for determining a first transmission code rate of the first network path for transmitting the redundant data and a second transmission code rate of the second network path for transmitting the redundant data based on the target transmission code rate and the current network bandwidth if the target transmission code rate corresponding to the target redundant data is larger than the current network bandwidth of the second network path;

And the redundant data transmission unit is used for transmitting part of redundant data in the target redundant data at a first transmission code rate through the first network path and transmitting the rest of redundant data in the target redundant data at a second transmission code rate through the second network path.

On the basis of the above technical solutions, the sending code rate determining unit is specifically configured to:

Determining a difference between the target transmission code rate and the current network bandwidth; and determining the difference value as a first sending code rate of the first network path for transmitting redundant data, and determining the current network bandwidth as a second sending code rate of the second network path for transmitting redundant data.

Based on the above technical solutions, the first network path is a wireless local area network path, and the second network path is a cellular network path.

The data transmission device provided by the embodiment of the disclosure can execute the data transmission method provided by any embodiment of the disclosure, and has the corresponding functional modules and beneficial effects of the execution method.

It should be noted that each unit and module included in the above apparatus are only divided according to the functional logic, but not limited to the above division, so long as the corresponding functions can be implemented; in addition, the specific names of the functional units are also only for convenience of distinguishing from each other, and are not used to limit the protection scope of the embodiments of the present disclosure.

Fig. 5 is a schematic structural diagram of an electronic device according to an embodiment of the disclosure. Referring now to fig. 5, a schematic diagram of an electronic device (e.g., a terminal device or server in fig. 5) 500 suitable for use in implementing embodiments of the present disclosure is shown. The terminal devices in the embodiments of the present disclosure may include, but are not limited to, mobile terminals such as mobile phones, notebook computers, digital broadcast receivers, PDAs (personal digital assistants), PADs (tablet computers), PMPs (portable multimedia players), in-vehicle terminals (e.g., in-vehicle navigation terminals), and the like, and stationary terminals such as digital TVs, desktop computers, and the like. The electronic device shown in fig. 5 is merely an example and should not be construed to limit the functionality and scope of use of the disclosed embodiments.

As shown in fig. 5, the electronic device 500 may include a processing means (e.g., a central processing unit, a graphics processor, etc.) 501, which may perform various appropriate actions and processes according to a program stored in a Read Only Memory (ROM) 502 or a program loaded from a storage means 508 into a Random Access Memory (RAM) 503. In the RAM 503, various programs and data required for the operation of the electronic apparatus 500 are also stored. The processing device 501, the ROM 502, and the RAM 503 are connected to each other via a bus 504. An edit/output (I/O) interface 505 is also connected to bus 504.

In general, the following devices may be connected to the I/O interface 505: input devices 506 including, for example, a touch screen, touchpad, keyboard, mouse, camera, microphone, accelerometer, gyroscope, etc.; an output device 507 including, for example, a Liquid Crystal Display (LCD), a speaker, a vibrator, and the like; storage 508 including, for example, magnetic tape, hard disk, etc.; and communication means 509. The communication means 509 may allow the electronic device 500 to communicate with other devices wirelessly or by wire to exchange data. While fig. 5 shows an electronic device 500 having various means, it is to be understood that not all of the illustrated means are required to be implemented or provided. More or fewer devices may be implemented or provided instead.

In particular, according to embodiments of the present disclosure, the processes described above with reference to flowcharts may be implemented as computer software programs. For example, embodiments of the present disclosure include a computer program product comprising a computer program embodied on a non-transitory computer readable medium, the computer program comprising program code for performing the method shown in the flow chart. In such an embodiment, the computer program may be downloaded and installed from a network via the communication means 509, or from the storage means 508, or from the ROM 502. The above-described functions defined in the methods of the embodiments of the present disclosure are performed when the computer program is executed by the processing device 501.

The electronic device provided by the embodiment of the present disclosure and the data transmission method provided by the foregoing embodiment belong to the same inventive concept, and technical details not described in detail in the present embodiment may be referred to the foregoing embodiment, and the present embodiment has the same beneficial effects as the foregoing embodiment.

The present disclosure provides a computer storage medium having stored thereon a computer program which, when executed by a processor, implements the data transmission method provided by the above embodiments.

It should be noted that the computer readable medium described in the present disclosure may be a computer readable signal medium or a computer readable storage medium, or any combination of the two. The computer readable storage medium can be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or a combination of any of the foregoing. More specific examples of the computer-readable storage medium may include, but are not limited to: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In the context of this disclosure, a computer-readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. In the present disclosure, however, the computer-readable signal medium may include a data signal propagated in baseband or as part of a carrier wave, with the computer-readable program code embodied therein. Such a propagated data signal may take any of a variety of forms, including, but not limited to, electro-magnetic, optical, or any suitable combination of the foregoing. A computer readable signal medium may also be any computer readable medium that is not a computer readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device. Program code embodied on a computer readable medium may be transmitted using any appropriate medium, including but not limited to: electrical wires, fiber optic cables, RF (radio frequency), and the like, or any suitable combination of the foregoing.

In some embodiments, the clients, servers may communicate using any currently known or future developed network protocol, such as HTTP (HyperText Transfer Protocol ), and may be interconnected with any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include a local area network ("LAN"), a wide area network ("WAN"), the internet (e.g., the internet), and peer-to-peer networks (e.g., ad hoc peer-to-peer networks), as well as any currently known or future developed networks.

The computer readable medium may be contained in the electronic device; or may exist alone without being incorporated into the electronic device.

The computer readable medium carries one or more programs which, when executed by the electronic device, cause the electronic device to: determining whether a redundant data cross-path transmission condition is currently satisfied based on current first network state information of the first network path and current second network state information of the second network path; if the transmission condition of the redundant data crossing the path is met currently, determining target redundant data corresponding to target media data to be transmitted currently; and transmitting the target media data through the first network path and the target redundant data through the second network path.

Computer program code for carrying out operations of the present disclosure may be written in one or more programming languages, including, but not limited to, an object oriented programming language such as Java, smalltalk, C ++ and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any kind of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or may be connected to an external computer (for example, through the Internet using an Internet service provider).

The flowcharts and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present disclosure. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.

The units involved in the embodiments of the present disclosure may be implemented by means of software, or may be implemented by means of hardware. The name of the unit does not in any way constitute a limitation of the unit itself, for example the first acquisition unit may also be described as "unit acquiring at least two internet protocol addresses".

The functions described above herein may be performed, at least in part, by one or more hardware logic components. For example, without limitation, exemplary types of hardware logic components that may be used include: a Field Programmable Gate Array (FPGA), an Application Specific Integrated Circuit (ASIC), an Application Specific Standard Product (ASSP), a system on a chip (SOC), a Complex Programmable Logic Device (CPLD), and the like.

In the context of this disclosure, a machine-readable medium may be a tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. The machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. The machine-readable medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any suitable combination of the foregoing. More specific examples of a machine-readable storage medium would include an electrical connection based on one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

According to one or more embodiments of the present disclosure, there is provided a data transmission method, including:

According to one or more embodiments of the present disclosure, there is provided a data transmission method [ example two ] further comprising:

Optionally, the determining whether the transmission condition of the redundant data across paths is currently met based on the current first network state information of the first network path and the current second network state information of the second network path includes:

The current first round trip delay of the first network path is compared with the current second round trip delay of the second network path, and whether the transmission condition of redundant data across paths is met is determined based on the comparison result.

According to one or more embodiments of the present disclosure, there is provided a data transmission method [ example three ], further comprising:

Optionally, the determining the target redundancy data corresponding to the target media data to be transmitted currently includes:

Determining whether a redundant data enhancement condition is currently satisfied based on at least one of current first network state information of the first network path and current play katon information of the media data;

And determining target redundant data corresponding to the target media data to be transmitted currently based on whether the redundant data enhancement condition is met currently.

According to one or more embodiments of the present disclosure, there is provided a data transmission method [ example four ], further comprising:

optionally, the determining whether the redundancy enhancement condition is currently met based on at least one of the current first network state information of the first network path and the current playing katon information of the media data includes:

According to one or more embodiments of the present disclosure, there is provided a data transmission method [ example five ]:

optionally, the determining, based on whether the redundancy data enhancement condition is currently satisfied, the target redundancy data corresponding to the target media data to be transmitted currently includes:

if the current redundancy data enhancement condition is met, determining target redundancy data equivalent to target media data to be transmitted currently;

And if the current redundancy data enhancement condition is not met, determining target redundancy data corresponding to the target media data to be transmitted currently based on the current packet loss rate of the first network path.

According to one or more embodiments of the present disclosure, there is provided a data transmission method [ example six ], further comprising:

Optionally, if the redundant data enhancement condition is currently satisfied, determining target redundant data equal to the target media data to be transmitted currently includes:

According to one or more embodiments of the present disclosure, there is provided a data transmission method [ example seventh ], further comprising:

optionally, the transmitting the target redundant data through the second network path includes:

if the target sending code rate corresponding to the target redundant data is larger than the current network bandwidth of the second network path, determining a first sending code rate of the first network path for transmitting the redundant data and a second sending code rate of the second network path for transmitting the redundant data based on the target sending code rate and the current network bandwidth;

And transmitting part of redundant data in the target redundant data at a first transmission code rate through the first network path, and transmitting the rest of redundant data in the target redundant data at a second transmission code rate through the second network path.

According to one or more embodiments of the present disclosure, there is provided a data transmission method [ example eight ]:

optionally, the determining, based on the target sending code rate and the current network bandwidth, a first sending code rate of the first network path for transmitting redundant data and a second sending code rate of the second network path for transmitting redundant data includes:

determining a difference between the target transmission code rate and the current network bandwidth;

And determining the difference value as a first sending code rate of the first network path for transmitting redundant data, and determining the current network bandwidth as a second sending code rate of the second network path for transmitting redundant data.

According to one or more embodiments of the present disclosure, there is provided a data transmission method [ example nine ] further comprising:

optionally, the first network path is a wireless local area network path, and the second network path is a cellular network path.

According to one or more embodiments of the present disclosure, there is provided a data transmission apparatus, including:

The foregoing description is only of the preferred embodiments of the present disclosure and description of the principles of the technology being employed. It will be appreciated by persons skilled in the art that the scope of the disclosure referred to in this disclosure is not limited to the specific combinations of features described above, but also covers other embodiments which may be formed by any combination of features described above or equivalents thereof without departing from the spirit of the disclosure. Such as those described above, are mutually substituted with the technical features having similar functions disclosed in the present disclosure (but not limited thereto).

Moreover, although operations are depicted in a particular order, this should not be understood as requiring that such operations be performed in the particular order shown or in sequential order. In certain circumstances, multitasking and parallel processing may be advantageous. Likewise, while several specific implementation details are included in the above discussion, these should not be construed as limiting the scope of the present disclosure. Certain features that are described in the context of separate embodiments can also be implemented in combination in a single embodiment. Conversely, various features that are described in the context of a single embodiment can also be implemented in multiple embodiments separately or in any suitable subcombination.

Although the subject matter has been described in language specific to structural features and/or methodological acts, it is to be understood that the subject matter defined in the appended claims is not necessarily limited to the specific features or acts described above. Rather, the specific features and acts described above are example forms of implementing the claims.

Claims

1. A data transmission method, comprising:

2. The data transmission method according to claim 1, wherein the determining whether the redundant data cross-path transmission condition is currently satisfied based on the current first network state information of the first network path and the current second network state information of the second network path, comprises:

3. The method for data transmission according to claim 1, wherein the determining target redundancy data corresponding to target media data to be currently transmitted includes:

4. The data transmission method according to claim 3, wherein the determining whether the redundancy-enhancing condition is currently satisfied based on at least one of current first network state information of the first network path and current play-on-card information of the media data, comprises:

5. The data transmission method according to claim 3, wherein the determining target redundant data corresponding to the target media data to be currently transmitted based on whether the redundant data enhancement condition is currently satisfied comprises:

6. The method according to claim 5, wherein determining the target redundant data equivalent to the target media data to be currently transmitted if the redundant data enhancement condition is currently satisfied comprises:

7. The data transmission method according to claim 1, wherein the transmitting the target redundant data through the second network path includes:

8. The data transmission method according to claim 7, wherein the determining the first transmission rate of the first network path for transmitting the redundant data and the second transmission rate of the second network path for transmitting the redundant data based on the target transmission rate and the current network bandwidth comprises:

9. The data transmission method according to any one of claims 1 to 8, wherein the first network path is a wireless local area network path and the second network path is a cellular network path.

10. A data transmission apparatus, comprising:

11. An electronic device, characterized in that the electronic device comprises:

one or more processors;

storage means for storing one or more programs,

When executed by one or more processors, causes the one or more processors to implement the data transmission method of any of claims 1-9.

12. A storage medium containing computer executable instructions which, when executed by a computer processor, are for performing the data transmission method of any of claims 1-9.