CN116094652A - Audio and video data transmission method and device, electronic equipment and readable medium - Google Patents

Audio and video data transmission method and device, electronic equipment and readable medium Download PDF

Info

Publication number
CN116094652A
CN116094652A CN202211557593.2A CN202211557593A CN116094652A CN 116094652 A CN116094652 A CN 116094652A CN 202211557593 A CN202211557593 A CN 202211557593A CN 116094652 A CN116094652 A CN 116094652A
Authority
CN
China
Prior art keywords
audio
video
packet
packets
error correction
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202211557593.2A
Other languages
Chinese (zh)
Inventor
王业明
龚著期
彭庆太
王艳辉
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Visionvera Information Technology Co Ltd
Original Assignee
Visionvera Information Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Visionvera Information Technology Co Ltd filed Critical Visionvera Information Technology Co Ltd
Priority to CN202211557593.2A priority Critical patent/CN116094652A/en
Publication of CN116094652A publication Critical patent/CN116094652A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L1/00Arrangements for detecting or preventing errors in the information received
    • H04L1/004Arrangements for detecting or preventing errors in the information received by using forward error control
    • H04L1/0041Arrangements at the transmitter end
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/433Content storage operation, e.g. storage operation in response to a pause request, caching operations
    • H04N21/4331Caching operations, e.g. of an advertisement for later insertion during playback
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/439Processing of audio elementary streams
    • H04N21/4398Processing of audio elementary streams involving reformatting operations of audio signals
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
    • H04N21/4402Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
    • H04N21/440218Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display by transcoding between formats or standards, e.g. from MPEG-2 to MPEG-4
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/63Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
    • H04N21/647Control signaling between network components and server or clients; Network processes for video distribution between server and clients, e.g. controlling the quality of the video stream, by dropping packets, protecting content from unauthorised alteration within the network, monitoring of network load, bridging between two different networks, e.g. between IP and wireless
    • H04N21/64723Monitoring of network processes or resources, e.g. monitoring of network load
    • H04N21/64738Monitoring network characteristics, e.g. bandwidth, congestion level
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/14Systems for two-way working
    • H04N7/15Conference systems

Landscapes

  • Engineering & Computer Science (AREA)
  • Signal Processing (AREA)
  • Multimedia (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Computer Security & Cryptography (AREA)
  • Detection And Prevention Of Errors In Transmission (AREA)

Abstract

The application provides a transmission method and device of audio and video data, electronic equipment and a readable medium, and belongs to the technical field of computers. The method comprises the following steps: when the packet loss rate of data transmission between the audio and video coding end and the receiving end is detected to be larger than the packet loss resistance rate, packaging the audio and video frames provided by the audio and video coding end into an audio and video packet carrying an error correction packet header, and caching the audio and video packet, wherein the error correction packet header is used for indicating the receiving end to perform forward error correction decoding operation on the audio and video packet; when the cached audio-video packets meet the requirement of forward error correction coding, performing forward error correction coding operation on the cached audio-video packets to obtain redundant packets of the audio-video packets, wherein the redundant packets are used for performing forward error correction decoding operation on the audio-video packets; and sending the audio and video packets added with the redundant packets to a receiving end.

Description

Audio and video data transmission method and device, electronic equipment and readable medium
Technical Field
The application belongs to the technical field of computers, and particularly relates to a transmission method and device of audio and video data, electronic equipment and a readable medium.
Background
In the related art, certain packet loss rate exists in data transmission between terminals, so that anti-packet loss codes are added in the transmission process to reduce the packet loss rate.
However, for data transmission among a plurality of terminals, there is often a situation that some terminals do not have anti-packet-loss capability, and at this time, if only the anti-packet-loss function is started for some terminals, the terminals which do not support anti-packet-loss cannot normally be compatible with the data packet added with the anti-packet-loss code, so that the anti-packet-loss compatibility is reduced.
Disclosure of Invention
The application provides a transmission method and device of audio and video data, electronic equipment and a readable medium.
Some embodiments of the present application provide a method for transmitting audio and video data, where the method includes:
when the packet loss rate of data transmission between the audio and video coding end and the receiving end is detected to be larger than the packet loss resistance rate, packaging the audio and video frames provided by the audio and video coding end into an audio and video packet carrying an error correction packet header, and caching the audio and video packet, wherein the error correction packet header is used for indicating the receiving end to perform forward error correction decoding operation on the audio and video packet;
when the cached audio-video packets meet the requirement of forward error correction coding, performing forward error correction coding operation on the cached audio-video packets to obtain redundant packets of the audio-video packets, wherein the redundant packets are used for performing forward error correction decoding operation on the audio-video packets;
And sending the audio and video packets added with the redundant packets to a receiving end.
Optionally, the performing a forward error correction encoding operation on the buffered multiple audio/video packets to obtain redundant packets of the multiple audio/video packets includes:
calculating redundant data amounts of the plurality of audio data packets according to the positive correlation between the packet loss resistance rate and the redundancy rate;
and performing forward error correction coding operation on the cached audio and video packets to obtain redundant packets with the data volume being the redundant data volume, wherein the anti-packet loss rate and the anti-packet loss rate issued by the conference management end are in positive correlation.
Optionally, the encapsulating the audio and video frame into an audio and video packet carrying an error correction packet header includes:
and adding each target number of audio and video frames to a data load part of a target transmission protocol data packet, and adding an error correction packet header to the tail part of the target transmission protocol data packet to obtain an audio and video packet.
Optionally, when the buffered audio and video packets meet the requirement of forward error correction coding, performing forward error correction coding operation on the buffered audio and video packets to obtain redundant packets of the audio and video packets, including:
and when the number of the cached audio and video packets reaches a number threshold, performing forward error correction coding operation on the cached audio and video packets to obtain redundant packets of the audio and video packets.
Optionally, when the buffered audio and video packets meet the requirement of forward error correction coding, performing forward error correction coding operation on the buffered audio and video packets to obtain redundant packets of the audio and video packets, including:
and when the frame delay of the buffered audio and video packets reaches a delay threshold, performing forward error correction coding operation on the buffered audio and video packets to obtain redundant packets of the buffered audio and video packets.
Optionally, before the sending the plurality of audio/video packets added with the redundancy packet to the receiving end, the method further includes:
and adding the redundant packet to the appointed position of the audio-video packet where the appointed audio-video frame is positioned.
Some embodiments of the present application provide a method for transmitting audio and video data, where the method further includes:
receiving the current packet loss rate sent by a receiving end;
issuing an anti-packet loss rate to the transmitting end under the condition that the current packet loss rate is larger than the historical packet loss rate received from the receiving end at the last time or the number of times that the current packet loss rate is smaller than the historical packet loss rate is larger than a number threshold;
the anti-packet loss rate is used for indicating the sending end to perform data transmission through executing the steps of the audio and video data transmission method.
Some embodiments of the present application provide a method for transmitting audio and video data, where the method includes:
receiving an audio and video packet sent by a sending end;
when the audio and video packet carries an error correction packet header, caching the audio and video packet;
when the number of the cached audio and video packets reaches the forward error correction decoding requirement, extracting redundant packets from the cached audio and video packets;
performing forward error correction decoding operation on the plurality of audio and video packets by utilizing the redundant packets, and sending the decoded audio and video packets to an audio and video decoding end;
and when the audio and video packet does not carry an error correction packet header, the audio and video packet is sent to an audio and video decoding end.
Some embodiments of the present application provide an apparatus for transmitting audio and video data, the apparatus including:
the packaging module is used for packaging the audio and video frames provided by the audio and video coding end into audio and video packets carrying error correction packet heads when the packet loss rate of data transmission between the audio and video coding end and the receiving end is detected to be larger than the packet loss resistance rate, and caching the audio and video packets, wherein the error correction packet heads are used for indicating the receiving end to perform forward error correction decoding operation on the audio and video packets;
the encoding module is used for executing forward error correction encoding operation on the cached audio-video packets when the cached audio-video packets meet the forward error correction encoding requirement to obtain redundant packets of the plurality of audio-video packets, wherein the redundant packets are used for executing forward error correction decoding operation on the plurality of audio-video packets;
And the sending module is used for sending the audio and video packets added with the redundant packets to a receiving end.
Optionally, the encoding module is further configured to:
calculating redundant data amounts of the plurality of audio data packets according to the positive correlation between the packet loss resistance rate and the redundancy rate;
and performing forward error correction coding operation on the cached audio and video packets to obtain redundant packets with the data volume being the redundant data volume, wherein the anti-packet loss rate and the anti-packet loss rate issued by the conference management end are in positive correlation.
Optionally, the packaging module is further configured to:
and adding each target number of audio and video frames to a data load part of a target transmission protocol data packet, and adding an error correction packet header to the tail part of the target transmission protocol data packet to obtain an audio and video packet.
Optionally, the encoding module is further configured to:
and when the number of the cached audio and video packets reaches a number threshold, performing forward error correction coding operation on the cached audio and video packets to obtain redundant packets of the audio and video packets.
Optionally, the encoding module is further configured to:
and when the frame delay of the buffered audio and video packets reaches a delay threshold, performing forward error correction coding operation on the buffered audio and video packets to obtain redundant packets of the buffered audio and video packets.
Optionally, the encoding module is further configured to:
and adding the redundant packet to the appointed position of the audio-video packet where the appointed audio-video frame is positioned.
Some embodiments of the present application provide an apparatus for transmitting audio and video data, where the apparatus further includes:
the detection module is used for receiving the current packet loss rate sent by the receiving end;
the issuing module is used for issuing an anti-packet loss rate to the sending end under the condition that the current packet loss rate is larger than the historical packet loss rate received from the receiving end at last time or the number of times that the current packet loss rate is smaller than the historical packet loss rate is larger than a number threshold;
the anti-packet loss rate is used for indicating the sending end to perform data transmission through executing the steps of the audio and video data transmission device.
Some embodiments of the present application provide an apparatus for transmitting audio and video data, the apparatus including:
the receiving module is used for receiving the audio and video packet sent by the sending end;
the decoding module is used for caching the audio and video packet when the audio and video packet carries an error correction packet header;
when the number of the cached audio and video packets reaches the forward error correction decoding requirement, extracting redundant packets from the cached audio and video packets;
Performing forward error correction decoding operation on the plurality of audio and video packets by utilizing the redundant packets, and sending the decoded audio and video packets to an audio and video decoding end;
and when the audio and video packet does not carry an error correction packet header, the audio and video packet is sent to an audio and video decoding end.
Some embodiments of the present application provide a computing processing device comprising:
a memory having computer readable code stored therein;
one or more processors, the computing processing device performing the method of transmitting audio video data as described above when the computer readable code is executed by the one or more processors.
Some embodiments of the present application provide a non-transitory computer readable medium storing computer readable code which, when executed on a computing processing device, causes the computing processing device to perform the above-described method of transmitting audio-video data.
According to the audio and video data transmission method, device, electronic equipment and readable medium, the packet loss rate of the transmitting end is detected in real time according to the preset packet loss rate, when the packet loss rate exceeds the packet loss rate, an anti-packet loss mechanism is adaptively started, an error correction packet header is added to audio and video packets packaged by audio and video frames, forward error correction coding operation is carried out on the cached audio and video packets according to the self forward error correction coding requirement, so that the encoded audio and video packets and redundant packets are transmitted to the receiving end, the receiving end can identify the forward error correction coded audio and video packets according to the error correction packet header, and forward error correction decoding is carried out on the received audio and video packets by utilizing the redundant packets, so that the packet loss rate of audio and video data transmission is reduced. And for the audio and video packets without carrying the error correction packet header, the receiving end can directly deliver the audio and video packets to the audio and video decoding end for decoding, so that the terminal which does not support the packet loss prevention function is compatible, and the compatibility of the packet loss prevention function is improved.
The foregoing description is only an overview of the technical solutions of the present application, and may be implemented according to the content of the specification in order to make the technical means of the present application more clearly understood, and in order to make the above-mentioned and other objects, features and advantages of the present application more clearly understood, the following detailed description of the present application will be given.
Drawings
In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, a brief description will be given below of the drawings that are needed in the embodiments or the description of the prior art, and it is obvious that, in the following description, the drawings are some embodiments of the present application, and that, to a person of ordinary skill in the art, other drawings may be obtained according to these drawings without inventive effort.
Fig. 1 schematically illustrates a system architecture diagram of a method for transmitting audio and video data according to some embodiments of the present application;
fig. 2 schematically illustrates a system architecture diagram of another audio/video data transmission method according to some embodiments of the present application;
fig. 3 schematically illustrates a flowchart of a method for transmitting audio and video data according to some embodiments of the present application;
Fig. 4 schematically illustrates a flowchart of another method for transmitting audio and video data according to some embodiments of the present application;
fig. 5 schematically illustrates a flowchart of another method for transmitting audio and video data according to some embodiments of the present application;
fig. 6 schematically illustrates a structural diagram of an audio/video data transmission device according to some embodiments of the present application;
fig. 7 schematically illustrates a structural diagram of another audio/video data transmission device according to some embodiments of the present application;
fig. 8 schematically illustrates a structural diagram of a transmission device for audio and video data according to some embodiments of the present application;
FIG. 9 schematically illustrates a block diagram of a computing processing device for performing methods according to some embodiments of the present application;
fig. 10 schematically illustrates a storage unit for holding or carrying program code for implementing methods according to some embodiments of the present application.
Detailed Description
For the purposes of making the objects, technical solutions and advantages of the embodiments of the present application more clear, the technical solutions of the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is apparent that the described embodiments are some embodiments of the present application, but not all embodiments. All other embodiments, which are obtained by a person of ordinary skill in the art without creative efforts, are within the scope of protection of the present application based on the embodiments in the present application.
Fig. 1 schematically illustrates a system architecture diagram of a transmission method of audio and video data provided in the present application, where the system includes: a transmitting end 10, a receiving end 20 and a conference management end 30.
The transmitting end 10 is an electronic device for providing audio and video data to the receiving end 20, and may be a personal computer, a notebook, a tablet computer, a server, etc., which may be specifically set according to actual requirements, and is not limited herein.
The receiving end 20 is an electronic device for acquiring audio and video data from the transmitting end 10 and outputting the audio and video data, and may be a personal computer, a notebook, a tablet computer, a server, etc., which may be specifically set according to actual requirements, and is not limited herein.
The conference management end 30 is a server for managing data transmission between the sending end 10 and the receiving end 20, for example, the sending end 10 and the receiving end 20 may perform online conference or online call through audio/video data interaction, and the conference management end may manage parameter indexes related to data interaction such as coding protocol, communication authority, interaction rate, packet loss rate and the like in the data interaction process between the sending end 10 and the receiving end 20.
Furthermore, the system can realize the packet loss prevention function through the following steps:
step S1, a conference management end responds to a received packet loss prevention starting instruction and sends a packet loss prevention rate to a sending end;
step S2, the conference management end transmits the anti-packet loss rate to the transmitting end;
step S4, when the transmitting end detects that the packet loss rate of data interaction with the receiving end is larger than the packet loss resistance rate, performing forward error correction coding on the audio and video frames provided by the audio and video coding end based on the determined redundancy rate, and caching the audio and video packets obtained by coding to delay and transmit the audio and video packets to the receiving end;
step S5, when the audio and video packets are forward error correction coding packets, the receiving end caches the received audio and video packets, and when the number of the cached audio and video packets meets the decoding requirement, the cached video packets are subjected to forward error correction decoding;
step S6, the receiving end sends the decoded audio and video packet to an audio and video decoding end;
and S7, when the audio and video packet is not the forward error correction coding packet, the receiving end sends the received audio and video packet to the audio and video decoding end.
Optionally, referring to fig. 2, a core server may be further configured between the conference management end 30 and the receiving end 20, and between the receiving end 10 and the sending end, to issue the packet loss resistance to the sending end, and report the packet loss resistance of the receiving end to the conference management end.
According to the embodiment of the disclosure, the conference management end is utilized to provide the anti-packet loss rate for the sending end, so that the sending end can automatically start the anti-packet loss function when the self-packet loss rate exceeds the anti-packet loss rate, namely, the sent audio and video packets are delayed to be sent to the receiving end after forward error correction coding is carried out on the sent audio and video packets, so that the receiving end ensures the integrity of data according to forward error correction decoding, the system packet loss rate is reduced, and the receiving end can directly deliver the audio and video packets to the audio and video decoding end for decoding the audio and video packets sent by the sending end without or without the anti-packet loss function, thereby improving the compatibility of the system.
Fig. 3 schematically illustrates a flowchart of a method for transmitting audio and video data provided in the present application, where the method includes:
step 101, when detecting that the packet loss rate of data transmission between the audio and video encoding end is greater than the packet loss resistance rate, packaging the audio and video frames provided by the audio and video encoding end into an audio and video packet carrying an error correction packet header, and caching the audio and video packet, wherein the error correction packet header is used for indicating the receiving end to perform forward error correction decoding operation on the audio and video packet.
It should be noted that, the audio/video encoding end is a functional module for encoding audio data and video data, for example, encoding audio/video data into MP4, HLS, etc., and the specific audio/video encoding format may be set according to actual requirements, which is not limited herein. The error correction packet header is identification information for identifying the audio data packet as a data packet subjected to forward error correction coding, and may further include a sequence number of an audio/video frame or the like for subsequent forward error correction decoding. The anti-packet loss rate is the highest packet loss rate that can be received by the transmitting end, for example, 10%, 15%, 30%, etc.
In the embodiment of the disclosure, the sending end can detect the packet loss rate of data transmission between the sending end and the receiving end in real time, so as to self-adaptively start the packet loss resistance function when the packet loss rate is detected to exceed the packet loss resistance rate. Specifically, when an audio and video frame is packaged into an audio and video packet according to a data transmission protocol, an error correction identifier is added in the audio and video packet, and then the audio and video packet is cached and used for subsequent forward error correction coding. Compared with the traditional audio and video frame encapsulation package, the audio and video frame encapsulation package is added with the error correction package head, and the error correction package head can be convenient for a receiving end to know whether the audio and video package is a data package coded according to forward error correction before decoding the audio and video package.
And 102, when the cached audio-video packets meet the requirement of forward error correction coding, performing forward error correction coding operation on the cached audio-video packets to obtain redundant packets of the audio-video packets, wherein the redundant packets are used for performing forward error correction decoding operation on the audio-video packets.
In this embodiment of the present application, the requirement for forward error correction coding is a requirement for measuring the delay degree of an audio/video packet, for example, the time length from the current time to the last time of sending the audio/video packet needs to reach a time length threshold, or the time length from the current time to the original sending time of the audio/video packet needs to reach a time length threshold, which may specifically be set according to actual requirements, and is not limited herein. It can be understood that, because the fec encoding performs integrity detection by using the correlation between multiple data packets, there are multiple requirements for fec encoding, so that the fec encoding requirement is to accumulate the number of the fec packets, so as to perform fec encoding on the multiple fec packets.
Further, when the buffered audio and video packets meet the requirement of forward error correction coding, the receiving end extracts the audio and video packets from the buffer, performs the forward error correction coding operation on the buffered audio and video packets, and calculates to obtain redundant packets of a plurality of audio and video packets. It should be noted that, forward error correction coding (FEC, forward ErrorCorrection) is a technology for controlling packet loss rate of received data packets, and the purpose of correcting transmission errors is achieved by adding redundancy codes to the data packets, specifically, the redundancy codes are used to characterize data features among multiple data packets, so that the redundancy codes can be used to identify the loss or error in the transmission process. Therefore, in the embodiment of the application, the plurality of audio/video packets are used as a frame group to perform forward error correction coding, and the obtained redundancy packets in the redundancy coding package are added into the audio/video packets and sent to the receiving end, so that the receiving end can perform forward error correction decoding on the plurality of audio/video packets after receiving the plurality of audio/video packets according to the redundancy packets.
And step 103, transmitting the audio and video packets added with the redundant packets to a receiving end.
In the embodiment of the application, the transmitting end transmits the plurality of audio and video packets added with the redundancy packets to the receiving end one by one, the receiving end does not directly decode the received audio and video packets added with the error correction packet header, but caches the audio and video packets until the number of the received audio and video packets reaches the decoding requirement, and performs forward error correction decoding on the plurality of audio and video packets according to the redundancy packets carried by the audio and video packets, so that a complete audio and video packet is obtained, and the audio and video packets are delivered to the audio and video decoding end to be decoded to obtain an audio and video frame.
According to the embodiment of the application, the packet loss rate of the sending end is detected in real time according to the preset packet loss rate, when the packet loss rate exceeds the packet loss rate, an anti-packet loss mechanism is adaptively started, an error correction packet header is added to an audio/video packet encapsulated by an audio/video frame, the method is suitable for forward error correction coding operation of the buffered audio/video packet required by forward error correction coding of the method, the coded audio/video packet and a redundancy packet are sent to the receiving end, the receiving end can identify the forward error correction coded audio/video packet according to the error correction packet header, and the redundancy packet is utilized to carry out forward error correction decoding on the received audio/video packet, so that the packet loss rate of audio/video data transmission is reduced.
Optionally, the step 102 includes:
a1, calculating redundant data amounts of the plurality of audio data packets according to a positive correlation relation between the anti-packet loss rate and the redundancy rate;
a2, performing forward error correction coding operation on the cached audio and video packets to obtain a redundant packet with the data volume being the redundant data volume.
In the embodiment of the present application, the redundancy rate is a duty ratio of the data amount of the redundancy number to the data amount of the original data. The higher the redundancy rate, the greater the data size of the redundancy packet. The data of the redundant packet is used for carrying out error correction on the audio/video packet by utilizing the data characteristics of the audio/video packet, and the larger the data volume of the redundant data is, the higher the data volume of error correction is, namely the higher the packet loss rate is, so that the larger the packet loss resistance is, the larger the redundancy rate is needed, and the smaller the packet loss resistance is, the smaller the redundancy rate is needed. And by utilizing the positive correlation between the packet loss resistance and the redundancy rate, the conversion can be carried out on the packet loss resistance and the redundancy rate by setting a positive correlation function, so that the required redundancy rate is calculated, and then the redundancy rate is multiplied by the data volume of the audio/video packet subjected to forward error correction coding according to the required data volume, so that the redundancy data volume of the redundancy packet can be obtained.
Further, after the calculated redundant data amount, the receiving end executes forward error correction coding operation on the cached audio and video packets according to the redundant data amount, so as to obtain a redundant packet with the data amount being the redundant data amount.
According to the method and the device for achieving the anti-lost function, the data quantity of the redundant packet is dynamically adjusted according to the anti-lost rate, so that the receiving end can adjust the anti-lost capacity in a self-adaptive mode through adjusting the data quantity of the redundant packet in the process of achieving the anti-lost function by utilizing forward error correction coding, and the flexibility of data transmission is improved.
Optionally, the step 101 includes: and adding each target number of audio and video frames to a data load part of a target transmission protocol data packet, and adding an error correction packet header to the tail part of the target transmission protocol data packet to obtain an audio and video packet.
It should be noted that, the target number is the number of frames of the audio and video frames contained in each audio and video packet, which may be set by default or by the user, specifically may be set according to actual requirements, and is not limited herein.
In this embodiment of the present application, after a transmitting end obtains a plurality of audio and video frames from an audio and video encoding end, the transmitting end divides the plurality of audio and video frames according to a target number, and encapsulates each target number of audio and video frames according to a target transmission protocol, that is, adds the audio and video frames to a data load portion of a target transmission protocol encapsulation packet, and an error correction packet header may be added to a tail portion of the target transmission protocol packet, so that a receiving end quickly identifies whether the audio and video packet is a forward error correction encoded data packet.
For the video networking protocol, a data field with a certain length can be reserved at the tail of a video networking data packet for adding an error correction packet header for use, so that the packet load length in the video networking protocol is reduced, and the situation that a terminal which does not support the packet loss prevention function cannot identify an audio/video packet carrying the error correction packet header due to overlong packet load is avoided, so that the terminal which does not support the packet loss prevention function is compatible.
According to the embodiment of the invention, the error correction packet header is added at the tail part of the target transmission protocol, so that the receiving end can know whether the audio/video packet is the data packet after forward error correction coding without unpacking the whole data packet, and the packet loss resistance efficiency is improved.
Optionally, the step 102 includes: and when the number of the cached audio and video packets reaches a number threshold, performing forward error correction coding operation on the cached audio and video packets to obtain redundant packets of the audio and video packets.
In this embodiment of the present application, the number threshold is the number of data packets required for performing forward error correction coding, which may be set by default or set by the user. The receiving end can count through the number of the cached audio and video packets, when the number of the audio and video packets reaches a data threshold, the cached audio and video packets are extracted from the cache, and the extracted audio and video packets can be deleted from the cache or deleted when new audio and video packets are stored.
According to the embodiment of the application, the data quantity of the cached audio and video packets is counted, so that forward error correction coding is automatically executed on the audio and video packets when the data quantity threshold is reached, and the quantity of the participating forward error correction coding is ensured to meet the coding requirement.
Optionally, the step 102 includes: and when the frame delay of the buffered audio and video packets reaches a delay threshold, performing forward error correction coding operation on the buffered audio and video packets to obtain redundant packets of the buffered audio and video packets.
In this embodiment of the present application, the delay threshold refers to a frame delay required for delay transmission, which may be set by default of the system or set by the user. The receiving end can count the frame time sequence of the audio and video frames in the cached audio and video packets, so that the time period formed by the time sequence of the cached audio and video frames is used as frame delay, and when the frame delay reaches a delay threshold value, the receiving end automatically executes forward error correction coding operation on the audio and video packets, thereby ensuring that the number of video frames participating in forward error correction coding meets the coding requirement.
Optionally, before the step 103, the method further includes: and adding the redundant packet to the appointed position of the audio-video packet where the appointed audio-video frame is positioned.
In the embodiment of the present application, it is considered that the redundant packet is sent as a data packet alone, which increases the data amount of data transmission and causes unnecessary resource waste, so that the redundant packet may be added to a certain audio/video packet for sending. Specifically, the redundancy packet may be added to the tail or the head of the first audio/video frame, the last audio/video frame, or the audio/video frame in the middle position, so that the redundancy packet may be sent to the receiving end together with the audio/video packet. The specific adding position of the redundant packet can be set according to actual requirements, and is not limited herein.
According to the embodiment of the application, the redundant packet is added to the appointed position of the appointed audio-video packet, so that the data volume transmitted by the forward error correction coding data packet is saved, and the transmission resource is saved.
Fig. 4 schematically illustrates a flowchart of another method for transmitting audio and video data provided in the present application, where the method includes:
step 201, receiving an audio/video packet sent by a sending end.
Step 202, when the audio and video packet carries an error correction packet header, buffering the audio and video packet.
In the embodiment of the application, the receiving end stores the error correction packet header into the cache according to the sequence of the sequence numbers in the error correction packet header.
And 203, extracting redundant packets from the cached audio and video packets when the number of the cached audio and video packets reaches the requirement of forward error correction decoding.
In the embodiment of the present application, the fec decoding requirement is an index parameter requirement of a data packet required for fec decoding. Forward error correction decoding operations may be performed on the buffered audio-video packets, for example, when the number of buffered audio-video packets reaches a number threshold, or when there are redundant packets in the audio-video packets.
And 204, performing forward error correction decoding operation on the audio and video packets by using the redundancy packets, and sending the decoded audio and video packets to an audio and video decoding end.
In the embodiment of the application, the forward error correction decoding operation is to verify the data in the received audio and video packet by utilizing the data characteristics of the described audio and video packet in the redundant packet, so that the error code is identified and corrected, the integrity of the data in the audio and video packet is ensured, and the packet loss rate is reduced.
Step 205, when the audio/video packet does not carry an error correction packet header, the audio/video packet is sent to an audio/video decoding end.
In the embodiment of the application, for the audio and video frames which do not carry the error correction packet header, the receiving end can directly transmit the audio and video packet to the audio and video decoding end for decoding so as to be compatible with the transmitting end which does not support the packet loss prevention function.
According to the embodiment of the application, the packet loss rate of the sending end is detected in real time according to the preset packet loss rate, when the packet loss rate exceeds the packet loss rate, an anti-packet loss mechanism is adaptively started, an error correction packet header is added to an audio/video packet encapsulated by an audio/video frame, the method is suitable for forward error correction coding operation of the buffered audio/video packet required by forward error correction coding of the method, the coded audio/video packet and a redundancy packet are sent to the receiving end, the receiving end can identify the forward error correction coded audio/video packet according to the error correction packet header, and the redundancy packet is utilized to carry out forward error correction decoding on the received audio/video packet, so that the packet loss rate of audio/video data transmission is reduced. And for the audio and video packets without carrying the error correction packet header, the receiving end can directly deliver the audio and video packets to the audio and video decoding end for decoding, so that the terminal which does not support the packet loss prevention function is compatible, and the compatibility of the packet loss prevention function is improved.
Fig. 5 schematically illustrates a flowchart of another method for transmitting audio and video data provided in the present application, where the method includes:
step 301, receiving a current packet loss rate sent by a receiving end.
Step 302, when the current packet loss rate is greater than the historical packet loss rate received from the receiving end at the last time, or the number of times that the current packet loss rate is less than the historical packet loss rate is greater than a number threshold, issuing an anti-packet loss rate to the sending end.
The anti-packet loss rate is used for indicating the sending end to perform data transmission through executing the steps of the audio and video data transmission method.
In the embodiment of the application, the receiving end detects whether the data transmission of the receiving end has packet loss, and when the packet loss occurs, the current packet loss rate is reported to the conference management end according to specific time intervals such as 5s, 10s and the like.
Furthermore, the conference management end counts the packet loss rate reported by the receiving end each time, and when finding that the current packet loss rate reported this time is higher than the historical packet loss rate reported last time, the conference management end can directly issue an anti-packet loss function starting instruction carrying the anti-packet loss rate to the sending end so as to instruct the sending end to reduce the packet loss rate by utilizing forward error correction coding operation. When the current packet loss rate reported at this time is lower than the historical packet loss rate reported last time, the anti-packet loss rate can be temporarily not issued, and if the situation occurs twice or more times continuously, the anti-packet loss rate is issued to the sending terminal, so that the sending terminal is instructed to reduce the packet loss rate by utilizing forward error correction coding operation.
For the description of the sender implementing the anti-packet function according to the anti-packet rate, reference may be made to the description in some embodiments, which are not repeated herein.
According to the embodiment of the application, the packet loss rate of the sending end is detected in real time according to the preset packet loss rate, when the packet loss rate exceeds the packet loss rate, an anti-packet loss mechanism is adaptively started, an error correction packet header is added to an audio/video packet encapsulated by an audio/video frame, the method is suitable for forward error correction coding operation of the buffered audio/video packet required by forward error correction coding of the method, the coded audio/video packet and a redundancy packet are sent to the receiving end, the receiving end can identify the forward error correction coded audio/video packet according to the error correction packet header, and the redundancy packet is utilized to carry out forward error correction decoding on the received audio/video packet, so that the packet loss rate of audio/video data transmission is reduced.
Fig. 6 schematically illustrates a structural diagram of an audio/video data transmission apparatus 40 provided in the present application, where the apparatus includes:
the packaging module 401 is configured to package an audio and video frame provided by an audio and video encoding end into an audio and video packet carrying an error correction packet header when detecting that a packet loss rate of data transmission with a receiving end is greater than an anti-packet loss rate, and cache the audio and video packet, where the error correction packet header is configured to instruct the receiving end to perform forward error correction decoding operation on the audio and video packet;
The encoding module 402 is configured to perform a forward error correction encoding operation on the buffered audio and video packets when the buffered audio and video packets meet a forward error correction encoding requirement, so as to obtain redundant packets of the buffered audio and video packets, where the redundant packets are used to perform a forward error correction decoding operation on the buffered audio and video packets;
and a sending module 403, configured to send the plurality of audio/video packets added with the redundancy packet to a receiving end.
Optionally, the encoding module 402 is further configured to:
calculating redundant data amounts of the plurality of audio data packets according to the positive correlation between the packet loss resistance rate and the redundancy rate;
and performing forward error correction coding operation on the cached audio and video packets to obtain redundant packets with the data volume being the redundant data volume, wherein the anti-packet loss rate and the anti-packet loss rate issued by the conference management end are in positive correlation.
Optionally, the packaging module 401 is further configured to:
and adding each target number of audio and video frames to a data load part of a target transmission protocol data packet, and adding an error correction packet header to the tail part of the target transmission protocol data packet to obtain an audio and video packet.
Optionally, the encoding module 402 is further configured to:
And when the number of the cached audio and video packets reaches a number threshold, performing forward error correction coding operation on the cached audio and video packets to obtain redundant packets of the audio and video packets.
Optionally, the encoding module 402 is further configured to:
and when the frame delay of the buffered audio and video packets reaches a delay threshold, performing forward error correction coding operation on the buffered audio and video packets to obtain redundant packets of the buffered audio and video packets.
Optionally, the encoding module 402 is further configured to:
and adding the redundant packet to the appointed position of the audio-video packet where the appointed audio-video frame is positioned.
According to the embodiment of the application, the packet loss rate of the sending end is detected in real time according to the preset packet loss rate, when the packet loss rate exceeds the packet loss rate, an anti-packet loss mechanism is adaptively started, an error correction packet header is added to an audio/video packet encapsulated by an audio/video frame, the method is suitable for forward error correction coding operation of the buffered audio/video packet required by forward error correction coding of the method, the coded audio/video packet and a redundancy packet are sent to the receiving end, the receiving end can identify the forward error correction coded audio/video packet according to the error correction packet header, and the redundancy packet is utilized to carry out forward error correction decoding on the received audio/video packet, so that the packet loss rate of audio/video data transmission is reduced.
Fig. 7 schematically illustrates a structural diagram of another audio/video data transmission apparatus 50 provided in the present application, where the apparatus includes:
the detection module 501 is configured to receive a current packet loss rate sent by a receiving end;
the issuing module 502 is configured to issue an anti-packet loss rate to the transmitting end when the current packet loss rate is greater than a historical packet loss rate received from the receiving end last time, or the number of times that the current packet loss rate is less than the historical packet loss rate is greater than a number threshold;
the anti-packet loss rate is used for indicating the sending end to perform data transmission through executing the steps of the audio and video data transmission device.
According to the embodiment of the application, the packet loss rate of the sending end is detected in real time according to the preset packet loss rate, when the packet loss rate exceeds the packet loss rate, an anti-packet loss mechanism is adaptively started, an error correction packet header is added to an audio/video packet encapsulated by an audio/video frame, the method is suitable for forward error correction coding operation of the buffered audio/video packet required by forward error correction coding of the method, the coded audio/video packet and a redundancy packet are sent to the receiving end, the receiving end can identify the forward error correction coded audio/video packet according to the error correction packet header, and the redundancy packet is utilized to carry out forward error correction decoding on the received audio/video packet, so that the packet loss rate of audio/video data transmission is reduced. And for the audio and video packets without carrying the error correction packet header, the receiving end can directly deliver the audio and video packets to the audio and video decoding end for decoding, so that the terminal which does not support the packet loss prevention function is compatible, and the compatibility of the packet loss prevention function is improved.
Fig. 8 schematically illustrates a structural diagram of still another audio/video data transmission apparatus 60 provided in the present application, where the apparatus includes:
the receiving module 601 is configured to receive an audio/video packet sent by a sending end;
the decoding module 602 is configured to buffer the audio/video packet when the audio/video packet carries an error correction packet header;
when the number of the cached audio and video packets reaches the forward error correction decoding requirement, extracting redundant packets from the cached audio and video packets;
performing forward error correction decoding operation on the plurality of audio and video packets by utilizing the redundant packets, and sending the decoded audio and video packets to an audio and video decoding end;
and when the audio and video packet does not carry an error correction packet header, the audio and video packet is sent to an audio and video decoding end.
According to the embodiment of the application, the packet loss rate of the sending end is detected in real time according to the preset packet loss rate, when the packet loss rate exceeds the packet loss rate, an anti-packet loss mechanism is adaptively started, an error correction packet header is added to an audio/video packet encapsulated by an audio/video frame, the method is suitable for forward error correction coding operation of the buffered audio/video packet required by forward error correction coding of the method, the coded audio/video packet and a redundancy packet are sent to the receiving end, the receiving end can identify the forward error correction coded audio/video packet according to the error correction packet header, and the redundancy packet is utilized to carry out forward error correction decoding on the received audio/video packet, so that the packet loss rate of audio/video data transmission is reduced.
The above described embodiments of the apparatus are only illustrative, wherein the elements illustrated as separate elements may or may not be physically separate, and the elements shown as elements may or may not be physical elements, may be located in one place, or may be distributed over a plurality of network elements. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of this embodiment. Those of ordinary skill in the art will understand and implement the present invention without undue burden.
Various component embodiments of the present application may be implemented in hardware, or in software modules running on one or more processors, or in a combination thereof. Those skilled in the art will appreciate that some or all of the functions of some or all of the components in a computing processing device according to embodiments of the present application may be implemented in practice using a microprocessor or Digital Signal Processor (DSP). The present application may also be embodied as an apparatus or device program (e.g., computer program and computer program product) for performing a portion or all of the methods described herein. Such a program embodying the present application may be stored on a non-transitory computer readable medium, or may have the form of one or more signals. Such signals may be downloaded from an internet website, provided on a carrier signal, or provided in any other form.
For example, FIG. 9 illustrates a computing processing device in which methods according to the present application may be implemented. The computing processing device conventionally includes a processor 710 and a computer program product in the form of a memory 720 or a non-transitory computer readable medium. The memory 720 may be an electronic memory such as a flash memory, an EEPROM (electrically erasable programmable read only memory), an EPROM, a hard disk, or a ROM. Memory 720 has storage space 730 for program code 731 for performing any of the method steps described above. For example, the memory space 730 for program code may include individual program code 731 for implementing the various steps in the above methods, respectively. The program code can be read from or written to one or more computer program products. These computer program products comprise a program code carrier such as a hard disk, a Compact Disc (CD), a memory card or a floppy disk. Such a computer program product is typically a portable or fixed storage unit as described with reference to fig. 10. The storage unit may have memory segments, memory spaces, etc. arranged similarly to the memory 720 in the computing processing device of fig. 9. The program code may be compressed, for example, in a suitable form. Typically, the storage unit comprises computer readable code 731', i.e. code that can be read by a processor, such as 710, for example, which when run by a computing processing device causes the computing processing device to perform the steps in the method described above.
It should be understood that, although the steps in the flowcharts of the figures are shown in order as indicated by the arrows, these steps are not necessarily performed in order as indicated by the arrows. The steps are not strictly limited in order and may be performed in other orders, unless explicitly stated herein. Moreover, at least some of the steps in the flowcharts of the figures may include a plurality of sub-steps or stages that are not necessarily performed at the same time, but may be performed at different times, the order of their execution not necessarily being sequential, but may be performed in turn or alternately with other steps or at least a portion of the other steps or stages.
Reference herein to "one embodiment," "an embodiment," or "one or more embodiments" means that a particular feature, structure, or characteristic described in connection with the embodiment is included in at least one embodiment of the present application. Furthermore, it is noted that the word examples "in one embodiment" herein do not necessarily all refer to the same embodiment.
In the description provided herein, numerous specific details are set forth. However, it is understood that embodiments of the present application may be practiced without these specific details. In some instances, well-known methods, structures and techniques have not been shown in detail in order not to obscure an understanding of this description.
In the claims, any reference signs placed between parentheses shall not be construed as limiting the claim. The word "comprising" does not exclude the presence of elements or steps not listed in a claim. The word "a" or "an" preceding an element does not exclude the presence of a plurality of such elements. The application may be implemented by means of hardware comprising several distinct elements, and by means of a suitably programmed computer. In the unit claims enumerating several means, several of these means may be embodied by one and the same item of hardware. The use of the words first, second, third, etc. do not denote any order. These words may be interpreted as names.
Finally, it should be noted that: the above embodiments are only for illustrating the technical solution of the present application, and are not limiting thereof; although the present application has been described in detail with reference to the foregoing embodiments, it should be understood by those of ordinary skill in the art that: the technical scheme described in the foregoing embodiments can be modified or some technical features thereof can be replaced by equivalents; such modifications and substitutions do not depart from the spirit and scope of the corresponding technical solutions.

Claims (13)

1. A method for transmitting audio and video data, the method comprising:
when the packet loss rate of data transmission between the audio and video coding end and the receiving end is detected to be larger than the packet loss resistance rate, packaging the audio and video frames provided by the audio and video coding end into an audio and video packet carrying an error correction packet header, and caching the audio and video packet, wherein the error correction packet header is used for indicating the receiving end to perform forward error correction decoding operation on the audio and video packet;
when the cached audio-video packets meet the requirement of forward error correction coding, performing forward error correction coding operation on the cached audio-video packets to obtain redundant packets of the audio-video packets, wherein the redundant packets are used for performing forward error correction decoding operation on the audio-video packets;
and sending the audio and video packets added with the redundant packets to a receiving end.
2. The method of claim 1, wherein performing a forward error correction encoding operation on the buffered plurality of audio-video packets results in a redundant packet of the plurality of audio-video packets, comprising:
calculating redundant data amounts of the plurality of audio data packets according to the positive correlation between the packet loss resistance rate and the redundancy rate;
And performing forward error correction coding operation on the cached audio and video packets to obtain redundant packets with the data volume being the redundant data volume, wherein the anti-packet loss rate and the anti-packet loss rate issued by the conference management end are in positive correlation.
3. The method of claim 1, wherein encapsulating the audio-video frames into audio-video packets carrying an error correction header comprises:
and adding each target number of audio and video frames to a data load part of a target transmission protocol data packet, and adding an error correction packet header to the tail part of the target transmission protocol data packet to obtain an audio and video packet.
4. The method of claim 1, wherein performing a forward error correction encoding operation on the buffered audio-video packets when the buffered audio-video packets meet a forward error correction encoding requirement, to obtain redundant packets of the buffered audio-video packets, comprises:
and when the number of the cached audio and video packets reaches a number threshold, performing forward error correction coding operation on the cached audio and video packets to obtain redundant packets of the audio and video packets.
5. The method of claim 1, wherein performing a forward error correction encoding operation on the buffered audio-video packets when the buffered audio-video packets meet a forward error correction encoding requirement, to obtain redundant packets of the buffered audio-video packets, comprises:
And when the frame delay of the buffered audio and video packets reaches a delay threshold, performing forward error correction coding operation on the buffered audio and video packets to obtain redundant packets of the buffered audio and video packets.
6. The method according to claim 1, wherein before the transmitting the plurality of audio-video packets to which the redundancy packet is added to a receiving end, the method further comprises:
and adding the redundant packet to the appointed position of the audio-video packet where the appointed audio-video frame is positioned.
7. A method for transmitting audio and video data, the method further comprising:
receiving the current packet loss rate sent by a receiving end;
issuing an anti-packet loss rate to the transmitting end under the condition that the current packet loss rate is larger than the historical packet loss rate received from the receiving end at the last time or the number of times that the current packet loss rate is smaller than the historical packet loss rate is larger than a number threshold;
the anti-packet loss rate is used for indicating the sending end to perform data transmission by executing the steps of the audio/video data transmission method according to any one of claims 1 to 6.
8. A method for transmitting audio and video data, the method comprising:
receiving an audio and video packet sent by a sending end;
When the audio and video packet carries an error correction packet header, caching the audio and video packet;
when the number of the cached audio and video packets reaches the forward error correction decoding requirement, extracting redundant packets from the cached audio and video packets;
performing forward error correction decoding operation on the plurality of audio and video packets by utilizing the redundant packets, and sending the decoded audio and video packets to an audio and video decoding end;
and when the audio and video packet does not carry an error correction packet header, the audio and video packet is sent to an audio and video decoding end.
9. An apparatus for transmitting audio and video data, the apparatus comprising:
the packaging module is used for packaging the audio and video frames provided by the audio and video coding end into audio and video packets carrying error correction packet heads when the packet loss rate of data transmission between the audio and video coding end and the receiving end is detected to be larger than the packet loss resistance rate, and caching the audio and video packets, wherein the error correction packet heads are used for indicating the receiving end to perform forward error correction decoding operation on the audio and video packets;
the encoding module is used for executing forward error correction encoding operation on the cached audio-video packets when the cached audio-video packets meet the forward error correction encoding requirement to obtain redundant packets of the plurality of audio-video packets, wherein the redundant packets are used for executing forward error correction decoding operation on the plurality of audio-video packets;
And the sending module is used for sending the audio and video packets added with the redundant packets to a receiving end.
10. An apparatus for transmitting audio and video data, the apparatus further comprising:
the detection module is used for receiving the current packet loss rate sent by the receiving end;
the issuing module is used for issuing an anti-packet loss rate to the sending end under the condition that the current packet loss rate is larger than the historical packet loss rate received from the receiving end at last time or the number of times that the current packet loss rate is smaller than the historical packet loss rate is larger than a number threshold;
the anti-packet loss rate is used for indicating the sending end to perform data transmission through executing the steps of the audio/video data transmission device according to any one of claims 1 to 6.
11. An apparatus for transmitting audio and video data, the apparatus comprising:
the receiving module is used for receiving the audio and video packet sent by the sending end;
the decoding module is used for caching the audio and video packet when the audio and video packet carries an error correction packet header;
when the number of the cached audio and video packets reaches the forward error correction decoding requirement, extracting redundant packets from the cached audio and video packets;
Performing forward error correction decoding operation on the plurality of audio and video packets by utilizing the redundant packets, and sending the decoded audio and video packets to an audio and video decoding end;
and when the audio and video packet does not carry an error correction packet header, the audio and video packet is sent to an audio and video decoding end.
12. A computing processing device, comprising:
a memory having computer readable code stored therein;
one or more processors, the computing processing device performing the method of transmission of audiovisual data as claimed in any one of claims 1-8 when the computer readable code is executed by the one or more processors.
13. A non-transitory computer readable medium storing computer readable code which, when executed on a computing processing device, causes the computing processing device to perform a method of transmitting audio-video data according to any one of claims 1-8.
CN202211557593.2A 2022-12-06 2022-12-06 Audio and video data transmission method and device, electronic equipment and readable medium Pending CN116094652A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202211557593.2A CN116094652A (en) 2022-12-06 2022-12-06 Audio and video data transmission method and device, electronic equipment and readable medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202211557593.2A CN116094652A (en) 2022-12-06 2022-12-06 Audio and video data transmission method and device, electronic equipment and readable medium

Publications (1)

Publication Number Publication Date
CN116094652A true CN116094652A (en) 2023-05-09

Family

ID=86201532

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202211557593.2A Pending CN116094652A (en) 2022-12-06 2022-12-06 Audio and video data transmission method and device, electronic equipment and readable medium

Country Status (1)

Country Link
CN (1) CN116094652A (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN117240833A (en) * 2023-11-15 2023-12-15 北京蔚领时代科技有限公司 Error correction method, system and storage medium for video transmission

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN117240833A (en) * 2023-11-15 2023-12-15 北京蔚领时代科技有限公司 Error correction method, system and storage medium for video transmission
CN117240833B (en) * 2023-11-15 2024-02-09 北京蔚领时代科技有限公司 Error correction method, system and storage medium for video transmission

Similar Documents

Publication Publication Date Title
CN110312147B (en) Method, system and storage medium for service data transmission
CN110943800A (en) Method, device and system for sending data packet, storage medium and electronic device
US11023412B2 (en) RDMA data sending and receiving methods, electronic device, and readable storage medium
CN116094652A (en) Audio and video data transmission method and device, electronic equipment and readable medium
CN114499993A (en) High-reliability safe transmission and control system and method based on one-way optical gate
CN111371887B (en) Internet of things log transmission method, client, server, equipment and storage medium
CN113131972B (en) Method, device, electronic equipment and storage medium for receiving and transmitting audio data packet
CN113364508B (en) Voice data transmission control method, system and equipment
CN111181698A (en) Data processing method, device, equipment and medium
CN113301051A (en) Data transmission method and device, computer storage medium and processor
CN112887054B (en) Data stream packaging method, data stream unpacking method and data stream unpacking system based on length escape
CN112351049B (en) Data transmission method, device, equipment and storage medium
CN114666776A (en) Data transmission method, device, equipment and readable storage medium
CN114531332A (en) Data transmission method, data processing method, device and storage medium
CN111245566B (en) Method and device for preventing packet loss of unreliable network, storage medium and electronic equipment
CN114500672A (en) Data transmission method and system
CN117157921A (en) Data transmission method, device, equipment and storage medium based on low-power consumption Bluetooth
CN113242473B (en) Data processing method, system, data acquisition equipment and readable storage medium
CN116896567B (en) Method and device for transmitting data by network layer protocol
CN117118573B (en) Data network transmission method, device, equipment and storage medium
CN114337917B (en) Data transmission method based on forward error correction and short message sending method
CN114979794B (en) Data transmission method and device
CN113207045B (en) Video stream data processing system
CN114448957B (en) Audio data transmission method and device
CN114422082B (en) Transmission control method, system, device and medium based on linear network coding

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination