CN110933513A - Audio and video data transmission method and device - Google Patents

Audio and video data transmission method and device Download PDF

Info

Publication number
CN110933513A
CN110933513A CN201911128668.3A CN201911128668A CN110933513A CN 110933513 A CN110933513 A CN 110933513A CN 201911128668 A CN201911128668 A CN 201911128668A CN 110933513 A CN110933513 A CN 110933513A
Authority
CN
China
Prior art keywords
audio
network signal
video data
rtp
signal parameter
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201911128668.3A
Other languages
Chinese (zh)
Inventor
卢科昌
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Vivo Mobile Communication Co Ltd
Original Assignee
Vivo Mobile Communication Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Vivo Mobile Communication Co Ltd filed Critical Vivo Mobile Communication Co Ltd
Priority to CN201911128668.3A priority Critical patent/CN110933513A/en
Publication of CN110933513A publication Critical patent/CN110933513A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/63Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
    • H04N21/643Communication protocols
    • H04N21/6437Real-time Transport Protocol [RTP]
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/63Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
    • H04N21/647Control signaling between network components and server or clients; Network processes for video distribution between server and clients, e.g. controlling the quality of the video stream, by dropping packets, protecting content from unauthorised alteration within the network, monitoring of network load, bridging between two different networks, e.g. between IP and wireless
    • H04N21/64784Data processing by the network
    • H04N21/64792Controlling the complexity of the content stream, e.g. by dropping packets

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Computer Security & Cryptography (AREA)
  • Data Exchanges In Wide-Area Networks (AREA)

Abstract

The invention provides an audio and video data transmission method and device, and belongs to the technical field of communication. The audio and video data transmission method comprises the following steps: the method comprises the steps of obtaining audio and video data and network signal parameters of first electronic equipment, generating a real-time transport protocol (RTP) audio and video data packet according to the audio and video data and the network signal parameters, enabling the network signal parameters to be located in an extension header of an RTP packet header in the RTP audio and video data packet, and sending the RTP audio and video data packet to second electronic equipment. By adding the network signal parameter in the extension header of the RTP packet header of the RTP audio and video data packet, the audio and video data and the network signal parameter can be synchronously sent, the real-time interaction of the network signal parameter is realized, and the problems that the transmission efficiency and the transmission quality of the audio and video data are reduced because the control information is not transmitted in real time based on the RTCP and the electronic equipment cannot timely adjust the audio and video coding rate can be solved.

Description

Audio and video data transmission method and device
Technical Field
The invention belongs to the technical field of communication, and particularly relates to an audio and video data transmission method and device.
Background
With the development of the information industry, the demand of people for information resources has gradually transited from characters and pictures to audio and video data. Real-time Transport Protocol (RTP) and Real-time Transport Control Protocol (RTCP) are used in cooperation, and Real-time transmission of audio and video data can be achieved.
At present, in order to ensure the real-time property of transmitting audio and video data, the audio and video data are transmitted in real time between electronic devices based on RTP. Meanwhile, in order to improve the transmission efficiency and transmission quality of audio and video data, control information is transmitted among the electronic equipment based on the RTCP, so that the electronic equipment adjusts the audio and video coding rate according to the control information.
However, since the control information transmitted based on RTCP is not transmitted in real time, the interaction of the control information between the electronic devices cannot be realized in time, so that the electronic devices cannot adjust the audio/video coding rate in time, thereby reducing the transmission efficiency and transmission quality of the audio/video data.
Disclosure of Invention
The invention provides an audio and video data transmission method and electronic equipment, which are used for solving the problem that the audio and video transmission efficiency and transmission quality are reduced because the electronic equipment cannot adjust the audio and video coding rate in real time.
In order to solve the technical problem, the invention is realized as follows:
in a first aspect, an embodiment of the present invention provides an audio and video data transmission method, which is applied to a first electronic device, and the method includes:
acquiring audio and video data and network signal parameters of the first electronic equipment;
generating a real-time transport protocol (RTP) audio and video data packet according to the audio and video data and the network signal parameter, wherein the network signal parameter is positioned in an extension header of an RTP packet header in the RTP audio and video data packet;
and sending the RTP audio and video data packet to a second electronic device.
In a second aspect, an embodiment of the present invention provides an audio and video data transmission method, which is applied to a second electronic device, and the method includes:
receiving an RTP audio and video data packet sent by first electronic equipment, wherein a network signal parameter of the first electronic equipment is added into an extension header of an RTP packet header in the RTP audio and video data packet;
analyzing the RTP audio and video data packet to obtain the network signal parameter;
and adjusting the audio and video coding rate of the second electronic equipment according to the network signal parameter to obtain the adjusted audio and video coding rate.
In a third aspect, an embodiment of the present invention provides an audio/video data transmission device, which is disposed in a first electronic device, and includes:
the acquisition module is used for acquiring audio and video data and network signal parameters of the first electronic equipment;
the generating module is used for generating an RTP audio and video data packet according to the audio and video data and the network signal parameter, wherein the network signal parameter is positioned in an extension header of an RTP packet header in the RTP audio and video data packet;
and the sending module is used for sending the RTP audio and video data packet to second electronic equipment.
In a fourth aspect, an embodiment of the present invention provides an audio/video data transmission device, which is disposed in a second electronic device, and includes:
the receiving module is used for receiving an RTP audio and video data packet sent by first electronic equipment, and network signal parameters of the first electronic equipment are added into an extension header of an RTP packet header in the RTP audio and video data packet;
the analysis module is used for analyzing the RTP audio and video data packet to obtain the network signal parameter;
and the adjusting module is used for adjusting the audio and video coding rate of the second electronic equipment according to the network signal parameter so as to obtain the adjusted audio and video coding rate.
In the embodiment of the invention, the first electronic device acquires audio and video data and a network signal parameter of the first electronic device, generates a real-time transport protocol (RTP) audio and video data packet according to the audio and video data and the network signal parameter, the network signal parameter is positioned in an extension header of an RTP packet header in the RTP audio and video data packet, and sends the RTP audio and video data packet to the second electronic device, and the second electronic device can adjust audio and video coding rate in real time according to the network signal parameter in the extension header of the RTP packet header in the RTP audio and video data packet to obtain a coding rate suitable for the current network condition, and transmits the audio and video data by adopting the adjusted audio and video coding rate. In the embodiment of the invention, the network signal parameter is added in the extension header of the RTP packet header of the RTP audio and video data packet, so that the audio and video data and the network signal parameter can be synchronously sent, the real-time interaction of the network signal parameter is realized, and the problems of the transmission efficiency and the transmission quality reduction of the audio and video data caused by the fact that the control information is not transmitted in real time based on RTCP and the audio and video coding rate cannot be timely adjusted by electronic equipment can be solved.
Drawings
Fig. 1 is a flowchart illustrating steps of an audio-video data transmission method provided in an embodiment of the present invention;
fig. 2 is a schematic structural diagram illustrating an RTP packet header including an extended header according to an embodiment of the present invention;
fig. 3 is a flowchart illustrating steps of an audio/video data transmission method provided in an embodiment of the present invention;
fig. 4 is a schematic structural diagram illustrating an RTP packet header that does not include an extension header according to an embodiment of the present invention;
fig. 5 is a schematic structural diagram illustrating an extended header of an RTP packet header provided in an embodiment of the present invention;
fig. 6 is a schematic structural diagram illustrating a one-byte extension header of an RTP protocol provided in an embodiment of the present invention;
fig. 7 is a schematic structural diagram illustrating an RTP protocol two-byte extension header provided in an embodiment of the present invention;
fig. 8 is a block diagram illustrating a structure of an audio-video data transmission apparatus provided in an embodiment of the present invention;
fig. 9 is a block diagram showing another structure of the audio-video data transmission apparatus provided in the embodiment of the present invention;
fig. 10 shows a block diagram of a further audio-video data transmission apparatus provided in the embodiment of the present invention;
fig. 11 is a block diagram showing a structure of still another audio-video data transmission apparatus provided in the embodiment of the present invention;
fig. 12 is a schematic diagram showing a hardware configuration of the electronic device provided in the embodiment of the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are some, not all, embodiments of the present invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
Referring to fig. 1, a flowchart illustrating steps of an audio and video data transmission method provided in an embodiment of the present invention is shown, where the method may be applied to a first electronic device, and as shown in fig. 1, the method may include the following steps:
step 101, audio and video data and network signal parameters of the first electronic device are obtained.
The first electronic device may be an electronic device capable of performing audio and video data transmission, such as a mobile phone, a computer, and a server. The audio and video data is audio and video data which needs to be sent to other electronic equipment by the first electronic equipment, and the audio and video data can be audio and video data which is pre-stored by the first electronic equipment and can also be audio and video data which is input by a user and received by the first electronic equipment in real time. The network signal parameter may be at least one of a reference signal power, a reference signal quality, a received signal strength, a signal-to-noise ratio, etc. of the network signal parameter representing the signal quality of the current network of the first electronic device. For example, if the first electronic device is using a fourth generation mobile communication technology (4G) to transmit audio/video data, the network signal parameter of the first electronic device may include at least one of a current reference signal power, a reference signal quality, a received signal strength, a signal-to-noise ratio, and other network signal parameters of the 4G network. If the first electronic device is using a fifth generation mobile communication technology (5G) to transmit audio/video data, the network signal parameter of the first electronic device may include at least one of a reference signal power, a reference signal quality, a received signal strength, a signal-to-noise ratio, and other network signal parameters of the 5G network. In practical use, specific parameters included in the network signal parameters may be set according to requirements, and this embodiment does not limit this.
In the embodiment of the invention, the first electronic device can acquire the audio and video data from the preset storage position and can also directly receive the audio and video data input by a user. The first electronic device may acquire at least one of the network signal parameters of the current network to obtain the network signal parameter. The process of acquiring the audio and video data and the network signal parameter by the first electronic device may be set according to requirements, which is not limited in this embodiment.
It should be noted that, the processes of acquiring the audio and video data and acquiring the network signal parameter by the first electronic device may be performed synchronously or step by step, which is not limited in this embodiment.
And 102, generating an RTP audio and video data packet according to the audio and video data and the network signal parameters.
The network signal parameter is located in an extension header of an RTP packet header in an RTP audio and video data packet.
It should be noted that, the first electronic device uses RTP to send audio/video data, and the RTP provides an extension mechanism, which allows an extension header of one byte or two bytes to be added to an RTP packet header of an RTP packet, so as to implement personalized function development. Referring to fig. 2, which shows a schematic structural diagram of an RTP packet header including an extension header provided in an embodiment of the present invention, as shown in fig. 2, an extension bit (X)202 in the RTP packet header may be set to add an extension header 203 to an RTP packet header 201. The specific structure of the RTP packet header, the setting of the extension bit (X) in the RTP packet header, and the process of adding the extension header in the RTP packet header may refer to the prior art, which is not described in detail in this embodiment.
In this embodiment, after the first electronic device acquires the audio and video data, an RTP packet header may be set to obtain an RTP packet header including an extension header, the acquired network signal parameter is added to the extension header of the RTP packet header, and the RTP packet header added with the network signal parameter and the audio and video data are encapsulated into an RTP audio and video data packet to obtain the RTP audio and video data packet added with the network signal parameter.
And 103, sending an RTP audio and video data packet to the second electronic equipment.
In the prior art, in the process of transmitting audio and video data by using an RTP, control information such as the number of bytes, the number of packets, the number of lost packets and the like is transmitted by using an RTCP, and an electronic device dynamically adjusts an audio and video coding rate by using the control information transmitted by the RTCP. Since the control information is transmitted by using the RTCP, the RTCP transmission is not real-time, and generally, the control information is fed back once in five seconds for an RTP audio data packet and once in one second for an RTP video data packet. That is, the control information transmitted by using RTCP has hysteresis, so that the electronic device cannot adjust the audio/video coding rate in time according to the real-time control information. For example, when the second electronic device receives an RTP packet transmitted by the first electronic device in 20 seconds, and then receives control information corresponding to the RTP packet in 25 seconds, the control information may only reflect a network condition of the 20 seconds and may not reflect a network condition at the current time (i.e., in 25 seconds), so that the second electronic device may not adjust the audio/video coding rate in time according to the control information corresponding to the RTCP packet.
In the embodiment of the present invention, the first electronic device may add the network signal parameter to an extension header of an RTP packet header in the RTP audio/video data packet, and send the RTP audio/video data packet added with the network signal parameter to the second electronic device. After receiving the RTP audio and video data packet sent by the first electronic device, the second electronic device can analyze the RTP audio and video data packet, acquire a network signal parameter in an extension header of an RTP packet header in the RTP audio and video data packet, acquire a real-time network signal parameter of the first electronic device, accurately judge a signal change trend of the first electronic device according to the acquired network signal parameter and by combining the acquired historical network signal parameter, calculate an audio and video coding rate suitable for a signal condition at the current moment, and timely adjust the audio and video coding rate to a coding rate suitable for the network condition at the current moment. Because the coding rate refers to the number of data bits transmitted in unit time during data transmission, generally, the unit used is kbps, that is, kilobits per second, that is, the data volume to be sent out per second, and the transmission rate is the data volume that can be transmitted per second in the current network, if the data volume sent per second by the second electronic device is greater than the data volume that can be transmitted per second by the network (that is, the coding rate is greater than the transmission rate), part of data is sent with delay, which causes the problem of audio and video jam. On the contrary, if the amount of data sent by the second electronic device per second is much smaller than the amount of data that can be transmitted by the network per second, the situation that the audio and video data with a low coding rate are transmitted under a high network condition may occur, and audio and video resources with poor quality (the audio and video resources are not clear) are obtained, which causes the waste of network resources. In the embodiment, the second electronic device can adjust the audio and video coding rate to a coding rate suitable for the current network condition, so that the audio and video blockage problem can be reduced to a certain extent, and the transmission efficiency and quality of audio and video data are improved. The process of calculating the audio/video coding rate of the second electronic device by the second electronic device according to the network signal parameter of the first electronic device may refer to the prior art, which is not described in detail in this embodiment.
In summary, in the transmission method for audio and video data provided in the first embodiment of the present invention, a first electronic device obtains audio and video data and a network signal parameter of the first electronic device, and generates a real-time transport protocol RTP audio and video data packet according to the audio and video data and the network signal parameter, where the network signal parameter is located in an extension header of an RTP packet header in the RTP audio and video data packet, and sends the RTP audio and video data packet to a second electronic device, and the second electronic device may adjust an audio and video coding rate in real time according to the network signal parameter in the extension header of the RTP packet header in the RTP audio and video data packet to obtain a coding rate suitable for a current network condition, and transmit the audio and video data by using the adjusted audio and video coding rate. In the embodiment of the invention, the network signal parameter is added in the extension header of the RTP packet header in the RTP audio/video data packet, so that the audio/video data and the network signal parameter can be synchronously sent, the real-time interaction of the network signal parameter is realized, and the problems of the transmission efficiency and the transmission quality reduction of the audio/video data caused by the fact that the control information is not transmitted in real time based on RTCP and the electronic equipment cannot timely adjust the audio/video coding rate can be solved.
Referring to fig. 3, a flowchart illustrating steps of an audio and video data transmission method provided in an embodiment of the present invention is shown, and as shown in fig. 3, the method may include:
step 301, the first electronic device obtains audio and video data and a network signal parameter of the first electronic device.
In this embodiment, reference may be made to step 101 in a process of acquiring, by a first electronic device, audio and video data and a network signal parameter of the first electronic device, which is not described herein again in this embodiment.
Step 302, the first electronic device sets an RTP packet header to obtain an RTP packet header including an extended header.
In the embodiment of the present invention, after obtaining audio and video data and signal condition parameters, an RTP packet header may be set, referring to fig. 4, which shows a schematic structural diagram of the RTP packet header that does not include an extension header provided in the embodiment of the present invention, referring to fig. 4, parameters such as a version number, an extension bit, and a timestamp in the RTP packet header may be set, so as to obtain the RTP packet header that includes the extension header 203 shown in fig. 2.
Step 303, the first electronic device adds the network signal parameter to an extension header of the RTP packet header.
In the embodiment of the present invention, after the first electronic device sets the RTP packet header and obtains the RTP packet header including the extension header, the first electronic device may add the acquired network signal parameter to the extension header of the RTP packet header. Referring to fig. 5, a schematic structural diagram of an extension header of an RTP packet header provided in an embodiment of the present invention is shown, where a network signal parameter may be added in the extension header shown in fig. 5.
Optionally, before adding the network signal parameter to the extension header of the RTP packet header, the first electronic device may encode the network signal parameter to obtain an encoded network signal parameter.
Accordingly, the step of adding the network signal parameter to the extension header of the RTP packet header may include: and adding the encoded network signal parameters into an extension header of the RTP packet header.
In the embodiment of the invention, after the network signal parameters are obtained, the obtained network signal parameters can be coded to compress the network signal parameters and reduce the data volume of the network signal parameters. For example, if the network signal parameter is the reference signal power of the current network, the original data range of the reference signal power is between-44 db mw and-140 db mw, and at least 7 bits are required for transmitting the reference signal power with the original data. Therefore, the reference signal power can be hierarchically encoded, and set to 7 levels. For example: level 0: reference signal power < -125 decibel milliwatts; level 1: -125 dB milliwatt ≦ reference signal power < -115 dB milliwatt; and 2, stage: -115 dB milliwatts ≦ reference signal power < -105 dB milliwatts; and 3, level: -105 dB milliwatts ≦ reference signal power < -95 dB milliwatts; 4, level: -95 dB milliwatt ≦ reference signal power < -85 dB milliwatt; and 5, stage: -85 db mw ≦ reference signal power < -75 db mw; and 6, level: the power of the reference signal is more than or equal to-75 decibel milliwatts. It can be known that after encoding, only the level corresponding to the reference signal power needs to be transmitted, and the original reference signal power does not need to be transmitted, and at this time, only 3 bits are needed for transmitting the reference signal power.
The encoded network signal parameters are obtained and may be added to an extension header of the RTP packet header. For example, if the current reference signal power is 110 db mw and the network signal parameter obtained after encoding is 2 (level corresponding to the 110 db mw reference signal power), the network signal parameter 2 may be added to the extension header. In practical use, the encoding mode of the network signal parameter may be set according to requirements, which is not limited in this embodiment.
For a detailed description of the extension header, it is illustrated here in connection with fig. 6 and 7. Fig. 6 shows a schematic structural diagram of an RTP protocol one-byte extension header provided in an embodiment of the present invention, and fig. 7 shows a schematic structural diagram of an RTP protocol two-byte extension header provided in an embodiment of the present invention. In this embodiment, by encoding the network signal parameter, the data amount of the network signal parameter can be reduced, and the data amount added to the extension header of the RTP packet header can be reduced, for example, the two-byte extension header in fig. 7 can be replaced with the one-byte extension header in fig. 6. Meanwhile, in the case where the capacity of the extension header of the RTP packet header is limited (one-byte extension header or two-byte extension header), the kind of transmission data may be increased, for example, parameters such as received signal strength, signal-to-noise ratio, and the like may be transmitted while transmitting the reference signal power.
And step 304, the first electronic device packages the audio and video data and the RTP packet header added with the network signal parameter into an RTP audio and video data packet.
In this embodiment, with reference to fig. 2, fig. 4 and fig. 5, the extended header added with the network signal parameter, the RTP packet header, the audio and video data may be encapsulated into an RTP audio and video data packet, and the encapsulation process may refer to a process of encapsulating an RTP data packet in the prior art, which is not described in detail herein.
And 305, the first electronic device sends an RTP audio and video data packet to the second electronic device.
In this embodiment, reference may be made to the prior art for a process in which the first electronic device sends an RTP audio/video data packet to the second electronic device, which is not described in detail in this embodiment.
And step 306, the second electronic device receives the RTP audio/video data packet sent by the first electronic device.
The network signal parameter of the first electronic device is added in the extension head of the RTP packet head in the RTP audio and video data packet.
In this embodiment, reference may be made to the prior art for a process of receiving, by the second electronic device, an RTP audio/video data packet sent by the first electronic device, which is not described in detail in this embodiment.
And 307, the second electronic device analyzes the RTP audio/video data packet to obtain a network signal parameter.
In the embodiment of the invention, after receiving the RTP audio and video data packet sent by the first electronic device, the second electronic device can analyze the RTP audio and video data packet, acquire the audio and video data in the RTP audio and video data packet, and play and/or store the acquired audio and video data. Meanwhile, the network signal parameters in the extension header of the RTP packet header can be acquired. The process of the second electronic device parsing the RTP audio/video data packet may refer to the prior art, which is not described in detail in this embodiment.
And 308, the second electronic equipment adjusts the audio and video coding rate of the second electronic equipment according to the network signal parameter to obtain the adjusted audio and video coding rate.
In the embodiment of the invention, after the second electronic device obtains the network signal parameter of the first electronic device, the audio and video coding rate of the second electronic device can be adjusted according to the obtained network signal parameter of the first electronic device.
When the network signal parameter is the encoded network signal parameter, the second electronic device may decode the encoded network signal parameter to obtain the decoded network signal parameter before adjusting the audio/video encoding rate of the second electronic device according to the network signal parameter.
Correspondingly, the second electronic device can adjust the audio and video coding rate of the second electronic device according to the decoded network signal parameter, and obtain the adjusted audio and video coding rate.
In the embodiment of the present invention, the second electronic device may decode the encoded network signal parameter to obtain a decoded network signal parameter. For example, with reference to steps 302 to 304, if the network signal parameter in the extension header of the RTP packet header is 2, after decoding the network signal parameter, it may be determined that the reference signal power of the first electronic device is between 115 and 105 dbm. In practical use, the method for decoding the encoded network signal parameter by the second electronic device may be set according to the encoding method of the first electronic device, which is not limited in this embodiment.
For example, in the process of transmitting audio and video data to the second electronic device through RTP, the first electronic device may add the reference signal power of the first electronic device in an extension header of an RTP packet header of each RTP audio and video data packet. And the second electronic equipment receives each RTP audio and video data packet sent by the first electronic equipment, records and analyzes the reference signal power in each RTP audio and video data packet, and judges the signal change trend of the first electronic equipment according to the recorded reference signal power and the reference signal power in the RTP audio and video data packet received at the current moment. For example, with reference to steps 301 to 307, if the level of the reference signal power received by the second electronic device at the current time is 2, and the levels of the reference signal powers received by the second electronic device before the current time are sequentially 6, 5, and 3 in the recorded time sequence, it may be determined that the signal quality of the first electronic device gradually decreases and is in a decreasing trend. At this time, the second electronic device may reduce the current audio coding rate, and adjust the current audio/video coding rate of 12.65HZ to 8.85HZ, where 8.85HZ is the adjusted audio/video coding rate. Similarly, if the signal quality of the first electronic device is determined to be in the ascending trend according to the recorded reference signal power, the second electronic device may increase the current audio and video coding rate, and may adjust the current audio and video coding rate of 12.65HZ to 14.25HZ, and 14.25HZ is the adjusted audio and video coding rate. In practical use, the method for adjusting the audio/video coding rate of the second electronic device by the second electronic device according to the signal quality trend of the first electronic device may be set according to requirements, and this embodiment does not limit this.
In this embodiment, the second electronic device may also adjust the audio/video coding rate by combining its own network signal parameter and the original packet loss judgment mechanism of RTP/RTCP. The method for adjusting the audio and video coding rate of the second electronic device by the second electronic device according to the decoded network signal parameter, the network signal parameter of the second electronic device and the original packet loss judgment mechanism of RTP/RTCP can be set according to the requirement, and this embodiment does not limit this.
The first electronic device adds the real-time network signal parameters into the extension header of the RTP packet header in the RTP audio and video data packet being sent, so that the network signal parameters at the current moment can be sent to the second electronic device in real time, the real-time performance of network signal parameter transmission is improved, the second electronic device can timely adjust the audio and video coding rate of the second electronic device according to the real-time network signal parameters, and the audio and video coding rate is suitable for the network condition at the current moment.
Optionally, after adjusting the coding rate of the second electronic device to obtain the adjusted audio/video coding rate, the second electronic device may send the adjusted audio/video coding rate to the first electronic device.
In the embodiment of the invention, after the second electronic device adjusts the adjusted audio and video coding rate according to the network signal parameter of the first electronic device, the adjusted audio and video coding rate can be sent to the first electronic device, so that the first electronic device adjusts the audio and video coding rate of the first electronic device according to the adjusted audio and video coding rate, the unification of the audio and video coding rate between the first electronic device and the second electronic device is realized, and the first electronic device and the second electronic device transmit audio and video data by adopting the adjusted coding rate.
For example, if the second electronic device encodes the audio data through an Adaptive Multi-rate wideband (AMR-WB), the adjusted audio/video encoding rate may be configured in a header field of an audio data packet sent to the first electronic device, and after receiving the audio data packet sent by the second electronic device, the first electronic device adjusts the audio/video encoding rate of the first electronic device according to the audio/video encoding rate in the header field of the audio data packet. In practical use, the second electronic device may also send the adjusted audio/video coding rate to the second electronic device through RTCP, and the method for sending the adjusted audio/video coding rate to the first electronic device by the second electronic device may be set according to requirements, which is not limited in this embodiment.
In summary, in the audio/video data transmission method provided in the second embodiment of the present invention, the first electronic device obtains the audio/video data and the network signal parameter of the first electronic device, generates an RTP audio/video data packet according to the audio/video data and the network signal parameter, and sends the RTP audio/video data packet to the second electronic device, and the second electronic device may adjust the audio/video coding rate of the second electronic device in real time according to the network signal parameter in the extension header of the RTP packet header in the RTP audio/video data packet. In the embodiment of the invention, the network signal parameter is added in the extension header of the RTP packet header of the RTP audio and video data packet, so that the audio and video data and the network signal parameter can be synchronously sent, the real-time interaction of the network signal parameter is realized, and the problems of the transmission efficiency and the transmission quality reduction of the audio and video data caused by the fact that the control information is not transmitted in real time based on RTCP and the audio and video coding rate cannot be adjusted in time can be solved.
Fig. 8 shows a block diagram of a structure of an audio/video data transmission apparatus provided in an embodiment of the present invention, and as shown in fig. 8, the apparatus 800 may be disposed in a first electronic device, and may include: an acquisition module 801, a generation module 802 and a sending module 803.
The obtaining module 801 is configured to obtain audio and video data and a network signal parameter of the first electronic device.
The generating module 802 is configured to generate an RTP audio/video data packet according to the audio/video data and a network signal parameter, where the network signal parameter is located in an extension header of an RTP packet header in the RTP audio/video data packet.
The sending module 803 is configured to send an RTP audio/video data packet to the second electronic device.
Optionally, referring to fig. 9, which shows a block diagram of another structure of an audio/video data transmission apparatus provided in the embodiment of the present invention, a generating module 802 included in the apparatus 900 may include:
a setting unit 8021, configured to set an RTP packet header, and obtain the RTP packet header including an extended header;
an adding unit 8022, configured to add the network signal parameter in an extension header of the RTP packet header;
the encapsulating unit 8023 is configured to encapsulate the audio/video data and the RTP packet header added with the network signal parameter into an RTP audio/video data packet.
Optionally, the generating module 802 may further include: the encoding unit 8024.
The encoding module 8024 is configured to encode the network signal parameter before adding the network signal parameter in the extension header of the RTP packet header, so as to obtain an encoded network signal parameter.
The adding unit 8022 is specifically configured to add the encoded network signal parameter in an extension header of an RTP packet header.
In summary, the audio/video data transmission apparatus provided in the embodiment of the present invention can implement each process in the method embodiment of fig. 1, and is not described herein again to avoid repetition. In the audio/video data transmission apparatus provided in the embodiment of the present invention, the obtaining module is configured to obtain audio/video data and a network signal parameter of the first electronic device, and the generating module is configured to generate an RTP audio/video data packet according to the audio/video data and the network signal parameter, where the network signal parameter is located in an extension header of an RTP packet header in the RTP audio/video data packet, and send the RTP audio/video data packet to the second electronic device. In the embodiment of the invention, the network signal parameter is added in the extension header of the RTP packet header of the RTP audio and video data packet, so that the audio and video data and the network signal parameter can be synchronously sent, the real-time interaction of the network signal parameter is realized, and the problems of the transmission efficiency and the transmission quality reduction of the audio and video data caused by the fact that the control information is not transmitted in real time based on RTCP and the audio and video coding rate cannot be timely adjusted by electronic equipment can be solved.
Referring to fig. 10, fig. 10 is a block diagram illustrating a structure of another audio/video data transmission apparatus provided in an embodiment of the present invention, and as shown in fig. 10, the apparatus 1000 is disposed in a second electronic device, and may include:
the receiving module 1001 is configured to receive an RTP audio/video data packet sent by a first electronic device, where a network signal parameter of the first electronic device is added to an extension header of an RTP packet header in the RTP audio/video data packet.
The parsing module 1002 is configured to parse the RTP audio/video data packet to obtain a network signal parameter.
The adjusting module 1003 is configured to adjust an audio/video encoding rate of the second electronic device according to the network signal parameter.
Optionally, referring to fig. 11, a block diagram of a structure of another audio/video data transmission apparatus provided in the embodiment of the present invention is shown. The network signal parameter is an encoded network signal parameter, and the apparatus 1100 may further include: a decoding module 1101.
The decoding module 1101 is configured to decode the encoded network signal parameter before adjusting the audio/video encoding rate of the second electronic device according to the network signal parameter, so as to obtain a decoded network signal parameter.
The adjusting module 1003 is specifically configured to adjust the audio/video coding rate of the second electronic device according to the decoded network signal parameter, so as to obtain the adjusted audio/video coding rate.
Optionally, the apparatus 1100 further comprises: a sending module 1102.
The sending module 1102 is configured to send the adjusted audio/video coding rate to the first electronic device, so that the first electronic device adjusts the audio/video coding rate of the first electronic device according to the adjusted audio/video coding rate.
In summary, in the audio/video data transmission apparatus provided in the embodiment of the present invention, the receiving module is configured to receive an RTP audio/video data packet sent by a first electronic device, a network signal parameter of the first electronic device is added in an extension header of an RTP packet header in the RTP audio/video data packet, the parsing module is configured to parse the RTP audio/video data packet to obtain the network signal parameter, and the adjusting module is configured to adjust an audio/video coding rate of a second electronic device according to the network signal parameter to obtain the adjusted audio/video coding rate. In the embodiment of the invention, the network signal parameter is added in the extension header of the RTP packet header of the RTP audio and video data packet, so that the audio and video data and the network signal parameter can be synchronously sent, the real-time interaction of the network signal parameter is realized, and the problems of the transmission efficiency and the transmission quality reduction of the audio and video data caused by the fact that the control information is not transmitted in real time based on RTCP and the audio and video coding rate cannot be adjusted in time can be solved.
Figure 12 is a schematic diagram of a hardware configuration of an electronic device implementing various embodiments of the invention,
the electronic device 1200 includes, but is not limited to: radio frequency unit 1201, network module 1202, audio output unit 1203, input unit 1204, sensor 1205, display unit 1206, user input unit 1207, interface unit 1208, memory 1209, processor 1210, and power source 1211. Those skilled in the art will appreciate that the electronic device configuration shown in fig. 12 does not constitute a limitation of the electronic device, and that the electronic device may include more or fewer components than shown, or some components may be combined, or a different arrangement of components. In the embodiment of the present invention, the electronic device includes, but is not limited to, a mobile phone, a tablet computer, a notebook computer, a palm computer, a vehicle-mounted electronic device, a wearable device, a pedometer, and the like.
The processor 1210 is configured to obtain audio and video data and a network signal parameter of the first electronic device.
And the processor 1210 is configured to generate an RTP audio/video data packet according to the audio/video data and the network signal parameter, where the network signal parameter is located in an extension header of an RTP packet header in the RTP audio/video data packet.
And the processor 1210 is configured to send an RTP audio/video data packet to the second electronic device.
In the embodiment of the invention, the electronic equipment can acquire the audio and video data and the network signal parameter of the electronic equipment, generate the RTP audio and video data packet according to the audio and video data and the network signal parameter, the network signal parameter is positioned in the extension header of the RTP packet header in the RTP audio and video data packet, and send the RTP audio and video data packet to the second electronic equipment. In the embodiment of the invention, the network signal parameter is added in the extension header of the RTP packet header of the RTP audio and video data packet, so that the audio and video data and the network signal parameter can be synchronously sent, the real-time interaction of the network signal parameter is realized, and the problems of the transmission efficiency and the transmission quality reduction of the audio and video data caused by the fact that the control information is not transmitted in real time based on RTCP and the audio and video coding rate cannot be timely adjusted by electronic equipment can be solved.
It should be understood that, in the embodiment of the present invention, the radio frequency unit 1201 may be used for receiving and sending signals during information transmission and reception or during a call, and specifically, receives downlink data from a base station and then processes the received downlink data to the processor 1210; in addition, the uplink data is transmitted to the base station. Typically, the radio frequency unit 1201 includes, but is not limited to, an antenna, at least one amplifier, a transceiver, a coupler, a low noise amplifier, a duplexer, and the like. In addition, the radio frequency unit 1201 can also communicate with a network and other devices through a wireless communication system.
The electronic device provides wireless broadband internet access to the user via the network module 1202, such as to assist the user in emailing, browsing web pages, and accessing streaming media.
The audio output unit 1203 may convert audio data received by the radio frequency unit 1201 or the network module 1202 or stored in the memory 1209 into an audio signal and output as sound. Also, the audio output unit 1203 may also provide audio output related to a specific function performed by the electronic apparatus 1200 (e.g., a call signal reception sound, a message reception sound, and the like). The audio output unit 1203 includes a speaker, a buzzer, a receiver, and the like.
The input unit 1204 is used to receive audio or video signals. The input Unit 1204 may include a Graphics Processing Unit (GPU) 12041 and a microphone 12042, and the Graphics processor 12041 processes image data of a still picture or video obtained by an image capturing apparatus (such as a camera) in a video capturing mode or an image capturing mode. The processed image frames may be displayed on the display unit 1206. The image frames processed by the graphics processor 12041 may be stored in the memory 1209 (or other storage medium) or transmitted via the radio frequency unit 1201 or the network module 1202. The microphone 12042 can receive sound, and can process such sound into audio data. The processed audio data may be converted into a format output transmittable to a mobile communication base station via the radio frequency unit 1201 in case of the phone call mode.
The electronic device 1200 also includes at least one sensor 1205, such as a light sensor, motion sensor, and other sensors. Specifically, the light sensor includes an ambient light sensor that adjusts the brightness of the display panel 12061 according to the brightness of ambient light, and a proximity sensor that turns off the display panel 12061 and/or the backlight when the electronic device 1200 moves to the ear. As one type of motion sensor, an accelerometer sensor can detect the magnitude of acceleration in each direction (generally three axes), detect the magnitude and direction of gravity when stationary, and can be used to identify the posture of an electronic device (such as horizontal and vertical screen switching, related games, magnetometer posture calibration), and vibration identification related functions (such as pedometer, tapping); the sensors 1205 may also include a fingerprint sensor, a pressure sensor, an iris sensor, a molecular sensor, a gyroscope, a barometer, a hygrometer, a thermometer, an infrared sensor, etc., and will not be described further herein.
The display unit 1206 is used to display information input by the user or information provided to the user. The Display unit 1206 may include a Display panel 12061, and the Display panel 12061 may be configured in the form of a Liquid Crystal Display (LCD), an Organic Light-Emitting Diode (OLED), or the like.
The user input unit 1207 may be used to receive input numeric or character information and generate key signal inputs related to user settings and function control of the electronic apparatus. Specifically, the user input unit 1207 includes a touch panel 12071 and other input devices 12072. The touch panel 12071, also referred to as a touch screen, may collect touch operations by a user on or near the touch panel 12071 (e.g., operations by a user on or near the touch panel 12071 using a finger, a stylus, or any suitable object or attachment). The touch panel 12071 may include two parts of a touch detection device and a touch controller. The touch detection device detects the touch direction of a user, detects a signal brought by touch operation and transmits the signal to the touch controller; the touch controller receives touch information from the touch sensing device, converts the touch information into touch point coordinates, sends the touch point coordinates to the processor 1210, receives a command from the processor 1210, and executes the command. In addition, the touch panel 12071 may be implemented by using various types such as a resistive type, a capacitive type, an infrared ray, and a surface acoustic wave. The user input unit 1207 may include other input devices 12072 in addition to the touch panel 12071. In particular, the other input devices 12072 may include, but are not limited to, a physical keyboard, function keys (such as volume control keys, switch keys, etc.), a trackball, a mouse, and a joystick, which are not described herein again.
Further, the touch panel 12071 may be overlaid on the display panel 12061, and when the touch panel 12071 detects a touch operation thereon or nearby, the touch operation is transmitted to the processor 1210 to determine the type of the touch event, and then the processor 1210 provides a corresponding visual output on the display panel 12061 according to the type of the touch event. Although the touch panel 12071 and the display panel 12061 are shown as two separate components in fig. 5 to implement the input and output functions of the electronic device, in some embodiments, the touch panel 12071 and the display panel 12061 may be integrated to implement the input and output functions of the electronic device, and is not limited herein.
The interface unit 1208 is an interface for connecting an external device to the electronic apparatus 1200. For example, the external device may include a wired or wireless headset port, an external power supply (or battery charger) port, a wired or wireless data port, a memory card port, a port for connecting a device having an identification module, an audio input/output (I/O) port, a video I/O port, an earphone port, and the like. The interface unit 1208 may be used to receive input from an external device (e.g., data information, power, etc.) and transmit the received input to one or more elements within the electronic apparatus 1200 or may be used to transmit data between the electronic apparatus 1200 and the external device.
The memory 1209 may be used to store software programs as well as various data. The memory 1209 may mainly include a storage program area and a storage data area, where the storage program area may store an operating system, an application program (such as a sound playing function, an image playing function, etc.) required by at least one function, and the like; the storage data area may store data (such as audio data, a phonebook, etc.) created according to the use of the cellular phone, and the like. Further, the memory 1209 may include high-speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid-state storage device.
The processor 1210 is a control center of the electronic device, connects various parts of the whole electronic device using various interfaces and lines, and performs various functions of the electronic device and processes data by running or executing software programs and/or modules stored in the memory 1209 and calling data stored in the memory 1209, thereby performing overall monitoring of the electronic device. Processor 1210 may include one or more processing units; preferably, the processor 1210 may integrate an application processor, which mainly handles operating systems, user interfaces, application programs, etc., and a modem processor, which mainly handles wireless communications. It is to be appreciated that the modem processor described above may not be integrated into processor 1210.
The electronic device 1200 may further include a power source 1211 (e.g., a battery) for providing power to the various components, and preferably, the power source 1211 may be logically coupled to the processor 1211 via a power management system, such that the power management system may be utilized to manage the charging, discharging, and power consumption.
In addition, the electronic device 1200 includes some functional modules that are not shown, and are not described in detail herein.
Preferably, an embodiment of the present invention further provides an electronic device, which includes a processor 1210, a memory 1209, and a computer program that is stored in the memory 1209 and can be run on the processor 1210, and when the computer program is executed by the processor 1210, the processes of the above-described embodiment of the audio/video data transmission method are implemented, and the same technical effect can be achieved, and in order to avoid repetition, details are not described here again.
The embodiment of the present invention further provides a computer-readable storage medium, where a computer program is stored on the computer-readable storage medium, and when the computer program is executed by a processor, the computer program implements each process of the above-mentioned audio/video data transmission method embodiment, and can achieve the same technical effect, and in order to avoid repetition, details are not repeated here. The computer-readable storage medium may be a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk.
It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element.
Through the above description of the embodiments, those skilled in the art will clearly understand that the method of the above embodiments can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware, but in many cases, the former is a better implementation manner. Based on such understanding, the technical solutions of the present invention may be embodied in the form of a software product, which is stored in a storage medium (such as ROM/RAM, magnetic disk, optical disk) and includes instructions for enabling an electronic device (such as a mobile phone, a computer, a server, an air conditioner, or a network device) to execute the method according to the embodiments of the present invention.
While the present invention has been described with reference to the embodiments shown in the drawings, the present invention is not limited to the embodiments, which are illustrative and not restrictive, and it will be apparent to those skilled in the art that various changes and modifications can be made therein without departing from the spirit and scope of the invention as defined in the appended claims.

Claims (12)

1. The audio and video data transmission method is applied to first electronic equipment, and comprises the following steps:
acquiring audio and video data and network signal parameters of the first electronic equipment;
generating a real-time transport protocol (RTP) audio and video data packet according to the audio and video data and the network signal parameter, wherein the network signal parameter is positioned in an extension header of an RTP packet header in the RTP audio and video data packet;
and sending the RTP audio and video data packet to a second electronic device.
2. The method of claim 1, wherein generating a real-time transport protocol (RTP) audio/video data packet according to the audio/video data and the network signal parameter comprises:
setting the RTP packet header to obtain the RTP packet header comprising the extended header;
adding the network signal parameters in the extension header of the RTP packet header;
and encapsulating the audio and video data and the RTP packet header added with the network signal parameters into the RTP audio and video data packet.
3. The method of claim 2, wherein before adding the network signal parameter in the extension header of the RTP packet header, further comprising;
coding the network signal parameter to obtain a coded network signal parameter;
the adding the network signal parameter in the extension header of the RTP packet header includes:
adding the encoded network signal parameters into the extension header of the RTP packet header.
4. The audio and video data transmission method is applied to a second electronic device, and comprises the following steps:
receiving an RTP audio and video data packet sent by first electronic equipment, wherein a network signal parameter of the first electronic equipment is added into an extension header of an RTP packet header in the RTP audio and video data packet;
analyzing the RTP audio and video data packet to obtain the network signal parameter;
and adjusting the audio and video coding rate of the second electronic equipment according to the network signal parameter to obtain the adjusted audio and video coding rate.
5. The method according to claim 4, wherein the network signal parameter is an encoded network signal parameter, and before the adjusting the audio/video encoding rate of the second electronic device according to the network signal parameter, the method further comprises:
decoding the encoded network signal parameters to obtain decoded network signal parameters;
the adjusting the audio and video coding rate of the second electronic device according to the network signal parameter includes:
and adjusting the audio and video coding rate of the second electronic equipment according to the decoded network signal parameter so as to obtain the adjusted audio and video coding rate.
6. The method of claim 4, wherein after the adjusting the coding rate of the second electronic device to obtain the adjusted audio/video coding rate, further comprising:
and sending the adjusted audio and video coding rate to the first electronic equipment so that the first electronic equipment adjusts the audio and video coding rate of the first electronic equipment according to the adjusted audio and video coding rate.
7. The utility model provides an audio and video data transmission device which characterized in that sets up in first electronic equipment, the device includes:
the acquisition module is used for acquiring audio and video data and network signal parameters of the first electronic equipment;
the generating module is used for generating an RTP audio and video data packet according to the audio and video data and the network signal parameter, wherein the network signal parameter is positioned in an extension header of an RTP packet header in the RTP audio and video data packet;
and the sending module is used for sending the RTP audio and video data packet to second electronic equipment.
8. The apparatus of claim 7, wherein the generating module comprises:
a setting unit, configured to set the RTP packet header, and obtain the RTP packet header including the extension header;
an adding unit, configured to add the network signal parameter into the extension header of the RTP packet header;
and the packaging unit is used for packaging the audio and video data and the RTP packet header added with the network signal parameters into the RTP audio and video data packet.
9. The apparatus of claim 8, wherein the generating module further comprises:
a coding unit, configured to code the network signal parameter before adding the network signal parameter to the extension header of the RTP packet header, to obtain a coded network signal parameter;
the adding unit is specifically configured to add the encoded network signal parameter to the extension header of the RTP packet header.
10. The utility model provides an audio and video data transmission device which characterized in that sets up in second electronic equipment, the device includes:
the receiving module is used for receiving an RTP audio and video data packet sent by first electronic equipment, and network signal parameters of the first electronic equipment are added into an extension header of an RTP packet header in the RTP audio and video data packet;
the analysis module is used for analyzing the RTP audio and video data packet to obtain the network signal parameter;
and the adjusting module is used for adjusting the audio and video coding rate of the second electronic equipment according to the network signal parameter so as to obtain the adjusted audio and video coding rate.
11. The apparatus of claim 10, wherein the network signal parameter is an encoded network signal parameter, the apparatus further comprising:
the decoding module is used for decoding the coded network signal parameter to obtain a decoded network signal parameter before the audio and video coding rate of the second electronic equipment is adjusted according to the network signal parameter;
the adjusting module is specifically configured to adjust the audio and video coding rate of the second electronic device according to the decoded network signal parameter, so as to obtain the adjusted audio and video coding rate.
12. The apparatus of claim 10, further comprising:
and the sending module is used for sending the adjusted audio and video coding rate to the first electronic equipment so that the first electronic equipment adjusts the audio and video coding rate of the first electronic equipment according to the adjusted audio and video coding rate.
CN201911128668.3A 2019-11-18 2019-11-18 Audio and video data transmission method and device Pending CN110933513A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201911128668.3A CN110933513A (en) 2019-11-18 2019-11-18 Audio and video data transmission method and device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201911128668.3A CN110933513A (en) 2019-11-18 2019-11-18 Audio and video data transmission method and device

Publications (1)

Publication Number Publication Date
CN110933513A true CN110933513A (en) 2020-03-27

Family

ID=69853277

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201911128668.3A Pending CN110933513A (en) 2019-11-18 2019-11-18 Audio and video data transmission method and device

Country Status (1)

Country Link
CN (1) CN110933513A (en)

Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101646074A (en) * 2008-08-05 2010-02-10 中兴通讯股份有限公司 Real-time transmission method for video data
WO2010049312A1 (en) * 2008-10-30 2010-05-06 Thomson Licensing Data container for transferring high resolution audio/video data in a high speed ip network
CN102056235A (en) * 2009-11-09 2011-05-11 华为技术有限公司 Data transmission method, equipment and system
CN102802089A (en) * 2012-09-13 2012-11-28 浙江大学 Shifting video code rate regulation method based on experience qualitative forecast
CN103997434A (en) * 2014-05-21 2014-08-20 华为技术有限公司 Method for detecting network transmission condition and related device
CN106231353A (en) * 2016-07-22 2016-12-14 北京小米移动软件有限公司 VoIP communication means and device
CN107222781A (en) * 2017-06-30 2017-09-29 深圳市九洲电器有限公司 The method and system of intelligent gateway dynamic translation code check
CN108933917A (en) * 2017-05-22 2018-12-04 大唐移动通信设备有限公司 A kind of video retransmission method and device
CN109936744A (en) * 2017-12-19 2019-06-25 腾讯科技(深圳)有限公司 Video coding processing method, device and the application with Video coding function

Patent Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101646074A (en) * 2008-08-05 2010-02-10 中兴通讯股份有限公司 Real-time transmission method for video data
WO2010049312A1 (en) * 2008-10-30 2010-05-06 Thomson Licensing Data container for transferring high resolution audio/video data in a high speed ip network
CN102056235A (en) * 2009-11-09 2011-05-11 华为技术有限公司 Data transmission method, equipment and system
CN102802089A (en) * 2012-09-13 2012-11-28 浙江大学 Shifting video code rate regulation method based on experience qualitative forecast
CN103997434A (en) * 2014-05-21 2014-08-20 华为技术有限公司 Method for detecting network transmission condition and related device
CN106231353A (en) * 2016-07-22 2016-12-14 北京小米移动软件有限公司 VoIP communication means and device
CN108933917A (en) * 2017-05-22 2018-12-04 大唐移动通信设备有限公司 A kind of video retransmission method and device
CN107222781A (en) * 2017-06-30 2017-09-29 深圳市九洲电器有限公司 The method and system of intelligent gateway dynamic translation code check
CN109936744A (en) * 2017-12-19 2019-06-25 腾讯科技(深圳)有限公司 Video coding processing method, device and the application with Video coding function

Similar Documents

Publication Publication Date Title
CN113472480B (en) Transmission processing method and equipment
WO2015058656A1 (en) Live broadcast control method and main broadcast device
WO2019052582A1 (en) Audio encoding and decoding method and device, and audio encoding and decoding system
CN108347529B (en) Audio playing method and mobile terminal
CN111128203B (en) Audio data encoding method, audio data decoding method, audio data encoding device, audio data decoding device, electronic equipment and storage medium
CN111010576B (en) Data processing method and related equipment
CN113223539A (en) Audio transmission method and electronic equipment
CN112423076B (en) Audio screen-throwing synchronous control method, equipment and computer readable storage medium
CN111836310B (en) UCI transmission method, terminal and network equipment
CN111147919A (en) Play adjustment method, electronic equipment and computer readable storage medium
US20230326467A1 (en) Encoding method and apparatus, electronic device, and storage medium
CN110457716B (en) Voice output method and mobile terminal
CN109302207B (en) Parameter setting method and mobile terminal
CN108235084B (en) Video playing method and mobile terminal
WO2021121119A1 (en) Data processing method and electronic device
CN110198560B (en) Power configuration method and terminal
CN107682360B (en) Voice call processing method and mobile terminal
CN113411787B (en) Audio transmission method and electronic equipment
CN111818657B (en) Uplink transmission discarding method, uplink transmission discarding configuration method and related equipment
CN109005377B (en) Video processing method and terminal equipment
CN108881775B (en) Video communication method and mobile terminal
CN110839108A (en) Noise reduction method and electronic equipment
CN111050108A (en) Method and device for realizing multi-channel video call and electronic equipment
CN110933513A (en) Audio and video data transmission method and device
CN113472479B (en) Transmission processing method and equipment

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication

Application publication date: 20200327

RJ01 Rejection of invention patent application after publication