CN111541897A - Data transmission method and device - Google Patents

Abstract

The disclosure provides a data transmission method and a data transmission device, relates to the technical field of electronic information, and can solve the problem of poor image transmission quality when transmission resources are poor. The specific technical scheme is as follows: when the target frame image is transmitted, acquiring a target transmission parameter corresponding to the target frame image, if the target transmission parameter is greater than a preset threshold value, switching the target frame image, and transmitting the target video through the switched target frame image. The present disclosure is for data transmission.

Description

Data transmission method and device

technical field

The present disclosure relates to the field of electronic information technology, and in particular, to a data transmission method and device.

Background technique

At present, the graphic image transmission protocol in the prior art divides a series of images into multiple groups of pictures (GOPs, Group of Pictures), and performs inter-frame coding based on each GOP. The first frame of each GOP is an I frame, and subsequent frames are P frames. The data of the I frame will be completely transmitted, and the P frame needs to be encoded according to the I frame. Based on this protocol, when transmitting video images, when the network condition is poor, the transmission of I-frames will be slow, and the image quality of the I-frames received by the decoding end will be poor, which directly affects the decoded image quality in the entire GOP. Meanwhile, when inter-coding an image, the size of the GOP is the interval between two I-frames. If the GOP setting is small, it will lead to more I-frames and larger code streams; if the GOP is set too large, the amount of computation will increase, so the GOP setting will affect the encoding effect and efficiency.

SUMMARY OF THE INVENTION

Embodiments of the present disclosure provide a data transmission method and apparatus, which can solve the problem of poor image transmission quality when transmission resources are poor. The technical solution is as follows:

According to a first aspect of the embodiments of the present disclosure, there is provided a data transmission method, the method comprising:

Obtain the target frame image and the target transmission parameter corresponding to the target frame image, the target frame image is an I frame in the target video, and the target transmission parameter includes: the transmission delay time of the target frame image, the number of retransmissions and the target packet loss rate at least one of;

When the target transmission parameter is greater than the preset threshold, switching processing is performed on the target frame image;

The target video is encoded and transmitted according to the target frame image that has been switched.

In one embodiment, before performing the switching process on the target frame image in the method, the method includes:

Acquire a preset threshold corresponding to the target transmission parameter, and compare the target transmission parameter with the preset threshold, where the preset threshold includes: a preset threshold of transmission delay time, a preset threshold of the number of retransmissions, and a predicted packet loss rate. Set at least one of the thresholds;

According to the preset threshold, compare the target transmission parameters one by one;

If at least one data value in the target transmission parameter is greater than the preset threshold, it is determined that the target transmission parameter is greater than the preset threshold.

In one embodiment, encoding the target video in the method includes:

Obtain the next frame P frame corresponding to the target frame image, and use the next frame P frame as the target reference frame;

Perform intra-frame coding processing on the target frame image, and perform coding processing on the target video according to the target reference frame.

In one embodiment, the method further includes:

Obtain target transmission resources and target GOP;

If the target transmission resource meets the preset transmission requirements, encoding and transmitting the target video according to the target GOP;

If the target transmission resource does not meet the preset transmission requirements, the GOP is adjusted according to the preset rule, and the target video is encoded and transmitted according to the adjusted target GOP.

In one embodiment, in the method, the GOP is adjusted according to preset rules, including:

Obtain the target load of the data transmission device;

When the target load of the data transmission device exceeds a threshold, the GOP is adjusted by increasing the number of frames in the target GOP.

When transmitting the target frame image, the method obtains the target transmission parameter corresponding to the target frame image, and if the target transmission parameter is greater than the preset threshold, the target frame image is switched, and the target frame after the switching processing is passed. The image is transmitted to the target video, which solves the poor video encoding and transmission effect caused by network reasons or the large amount of I-frame data.

According to a second aspect of the embodiments of the present disclosure, there is provided a data transmission device, comprising: a receiver and a processor, the receiver and the processor are connected,

The receiver is used to obtain a target frame image and a target transmission parameter corresponding to the target frame image, the target frame image is an I frame in the target video, and the target transmission parameter includes: the transmission delay time of the target frame image, the retransmission time At least one of the number of times and the target packet loss rate;

The processor is configured to perform switching processing on the target frame image when the target transmission parameter is greater than a preset threshold;

And according to the target frame image that has been switched, the target video is encoded and sent.

It is to be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the present disclosure.

Description of drawings

The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the disclosure and together with the description serve to explain the principles of the disclosure.

1 is a flowchart of a data transmission method provided by an embodiment of the present disclosure;

FIG. 2 is a structural diagram of a data transmission apparatus provided by an embodiment of the present disclosure.

Detailed ways

Exemplary embodiments will be described in detail herein, examples of which are illustrated in the accompanying drawings. Where the following description refers to the drawings, the same numerals in different drawings refer to the same or similar elements unless otherwise indicated. The implementations described in the illustrative examples below are not intended to represent all implementations consistent with this disclosure. Rather, they are merely examples of apparatus and methods consistent with some aspects of the present disclosure as recited in the appended claims.

An embodiment of the present disclosure provides a data transmission method. As shown in FIG. 1 , the data transmission method includes the following steps:

101. Acquire a target frame image and target transmission parameters corresponding to the target frame image.

The target frame image is an I frame in the target video.

The target transmission parameters include: the transmission delay time of the target frame image, the number of retransmissions and the target packet loss rate;

The transmission delay of the I frame refers to the difference between the current time and the time when the I frame starts to transmit.

The number of retransmissions refers to when the I frame is transmitted, if the I frame is not successfully transmitted after the preset time period, the retransmission will be performed after the preset time period is exceeded.

The target packet loss rate refers to the ratio of the number of lost data packets to the transmitted data group when the target frame image is sent. Here is an example calculation method:

Get the preset time;

According to the preset time, obtain the data volume S corresponding to the target frame image sent by the data transmission device within the preset time and the data volume R corresponding to the target frame image received by the receiving device within the preset time;

According to the data amount S and the data amount S, the calculation formula of the packet loss rate is: (S-R)/S.

102. When the target transmission parameter is greater than a preset threshold, perform switching processing on the target frame image.

The method provided by the present disclosure further includes setting a preset threshold according to the parameter information of the data transmission device and the target video, which may specifically include:

The preset transmission delay time, the preset number of retransmissions and the preset packet loss rate are respectively set for the transmission delay time, the number of retransmissions and the target packet loss rate of the target frame image.

Before the method provided by the present disclosure performs switching processing on the target frame image, it is also necessary to determine whether the target transmission parameter is greater than a preset threshold, and the determining steps include:

Acquire a preset threshold corresponding to the target transmission parameter, and compare the target transmission parameter with the preset threshold, where the preset threshold includes: a preset threshold of transmission delay time, a preset threshold of the number of retransmissions, and a predicted packet loss rate. Set at least one of the thresholds;

According to the preset threshold, compare the target transmission parameters one by one;

If at least one data value in the target transmission parameter is greater than the preset threshold, it is determined that the target transmission parameter is greater than the preset threshold.

In the method provided by the present disclosure, if the target transmission parameters are all smaller than the preset threshold, the target transmission parameters of the next frame of image are continuously monitored according to the preset threshold parameters.

In the method provided by the present disclosure, the target frame image is switched, that is, the next frame P frame corresponding to the target frame image is acquired, and the next frame P frame is used as the target reference frame. Specifically, the switching processing process Can include:

Assuming that the composition of an image sequence is IPPPIPPP, if the transmission delay or the number of retransmissions of the first I frame or the current packet loss rate is greater than the preset threshold, the second frame (original P frame) will be regarded as a new I frame, in If the GOP (Group of Pictures) size is not changed, it is equivalent to skipping the original I frame and continuing to perform inter-frame coding. After switching the I frame, the above image sequence can be symbolically represented as XIPPIPP, where X represents the original I frame.

In the present disclosure, when the target frame image is switched, the target frame image can be processed in the following two ways: directly discarding the target frame image; or performing intra-frame encoding processing on the target frame image before sending.

103. Perform encoding processing on the target video according to the switched target frame image.

Encoding the target video in the method provided by the present disclosure includes:

Obtain the next frame P frame corresponding to the target frame image, and use the next frame P frame as the target reference frame;

Perform intra-frame coding processing on the target frame image, and perform coding processing on the target video according to the target reference frame.

The present disclosure can switch the I-frame image by switching the I-frame image when the transmission resources cannot meet the transmission quality of the I-frame, or when the quality of the images decoded from the subsequent P-frames decoded according to the I-frame is poor due to the poor transmission quality of the I-frame Processing, quickly switch the I frame to prevent the screen from being stuck on the display side.

After switching the target frame image, the method provided by the present disclosure further includes encoding and transmitting the target video. Specifically, during encoding and transmission, it is also determined whether to change the target video according to network conditions and device load conditions. The target GOP in . The specific transmission steps include:

Obtain target transmission resources and target GOP;

If the target transmission resource satisfies the preset transmission requirements, encoding and sending the target video according to the target GOP;

If the target transmission resource does not meet the preset transmission requirements, the GOP is adjusted according to the preset rule, and the target video is encoded and sent according to the adjusted target GOP.

Among them, the network delay can be used to determine whether the target transmission resource meets the preset transmission requirements, that is, the network status is good. It can be seen from experiments that when the network status is good, the network delay is <= 10ms; when the network status is normal, 10ms<= network delay<= 50ms; when the network state is poor, 50ms<=network delay<=100ms; when the network state is extremely poor, 100ms<=network delay<500ms;

Therefore, based on the network conditions in the above experiments, the preset network delay can be set to 50ms. If the target network delay<=50ms, the network status is considered to be good or normal; when 50ms<network delay, the network status is considered to be poor.

Further, the above-mentioned adjustment of the GOP according to the preset rules includes:

Obtain the target load of the data transmission device;

When the target load exceeds the threshold, the GOP is adjusted by increasing the number of frames in the GOP.

The target load of the above-mentioned data transmission device may be determined by the utilization rate of the CPU and/or memory of the data transmission device.

Here are specific examples to illustrate: the situation where the target load exceeds the threshold means: the usage of CPU and/or memory exceeds 70%, that is, the usage of CPU and memory is greater than or equal to 70%; The usage rate of one is greater than or equal to 70%.

The method provided by the present disclosure can dynamically adjust the frame size of the GOP when the network condition is poor but the system load is low when the target frame image is transmitted, thereby reducing the number of frames in the target video when the transmission of the I frame is difficult. The number of I frames to avoid the frequent problem of difficult I frame transmission

In the data transmission method provided by the embodiment of the present disclosure, when a target frame image is transmitted, a target transmission parameter corresponding to the target frame image is acquired, and if the target transmission parameter is greater than a preset threshold, the target frame image is switched, and the target frame image is switched. The target video is transmitted through the switched target frame image, thereby solving the problem of poor video coding and transmission due to network reasons or a large amount of I-frame data.

Embodiment 2

Based on the data transmission method described in the above-mentioned embodiment corresponding to FIG. 1 , the following device embodiments of the present disclosure can be used to execute the method embodiments of the present disclosure.

An embodiment of the present disclosure provides a data transmission apparatus. As shown in FIG. 2 , the data transmission apparatus 20 includes: a receiver 201 and a processor 202, and the receiver 201 and the processor 202 are connected,

The receiver 201 is configured to acquire a target frame image and a target transmission parameter corresponding to the target frame image, where the target frame image is an I frame in the target video, and the target transmission parameter includes: the transmission delay time of the target frame image, the repetition rate At least one of the number of transmissions and the target packet loss rate;

The processor 202 is configured to perform switching processing on the target frame image when the target transmission parameter is greater than a preset threshold;

And according to the target frame image that has been switched, the target video is encoded and sent.

In one embodiment, the processor 202 in the apparatus 20 provided by the present disclosure is further configured to obtain a preset threshold value corresponding to the target transmission parameter before performing the switching processing on the target frame image, and compare the target transmission parameter with The preset threshold value, the preset threshold value includes: at least one of a preset threshold value of transmission delay time, a preset threshold value of retransmission times, and a preset threshold value of packet loss rate;

and compare the target transmission parameters one by one according to the preset threshold;

If at least one data value in the target transmission parameter is greater than the preset threshold, it is determined that the target transmission parameter is greater than the preset threshold.

In one embodiment, the processor 202 in the apparatus 20 provided by the present disclosure is further configured to:

Obtain the next frame P frame corresponding to the target frame image, and use the next frame P frame as the target reference frame;

Perform intra-frame coding processing on the target frame image, and perform coding processing on the target frame video according to the target reference frame.

In one embodiment, the processor 202 in the apparatus 20 provided by the present disclosure is further configured to:

Obtain target transmission resources and target GOP;

If the target transmission resource meets the preset transmission requirements, encode and send the target video according to the target GOP;

If the target transmission resource does not meet the preset transmission requirements, the GOP is adjusted according to the preset rule, and the target video is encoded and sent according to the adjusted target GOP.

In one embodiment, the processor 202 in the device 20 provided by the present disclosure is further configured to acquire the target load of the data transmission device if the target transmission resource does not meet the preset transmission requirements;

When the target load of the data transmission device exceeds a threshold, the GOP is adjusted by increasing the number of frames in the target GOP.

The data transmission device provided by the embodiment of the present disclosure obtains the target transmission parameter corresponding to the target frame image when transmitting the target frame image, and if the target transmission parameter is greater than the preset threshold, performs switching processing on the target frame image, and The target video is transmitted through the switched target frame image, thereby solving the problem of poor video coding and transmission due to network reasons or a large amount of I-frame data.

Based on the data transmission method described in the embodiment corresponding to FIG. 1 , an embodiment of the present disclosure further provides a computer-readable storage medium. For example, the non-transitory computer-readable storage medium may be a read-only memory (English: ReadOnly Memory). , ROM), random access memory (English: Random Access Memory, RAM), CD-ROM, magnetic tape, floppy disk and optical data storage devices, etc. The storage medium stores computer instructions for executing the data transmission method described in the embodiment corresponding to FIG. 1 , which will not be repeated here.

Other embodiments of the present disclosure will readily occur to those skilled in the art upon consideration of the specification and practice of the disclosure disclosed herein. This application is intended to cover any variations, uses, or adaptations of the present disclosure that follow the general principles of the present disclosure and include common knowledge or techniques in the technical field not disclosed by the present disclosure . The specification and examples are to be regarded as exemplary only, with the true scope and spirit of the disclosure being indicated by the following claims.

Claims (10)

1. A data transmission method, applied to a data transmission apparatus, the method comprising:

acquiring a target frame image and a target transmission parameter corresponding to the target frame image, wherein the target frame image is an I frame in a target video, and the target transmission parameter comprises: at least one of transmission delay time, retransmission times and target packet loss rate of the target frame image;

when the target transmission parameter is larger than a preset threshold value, switching the target frame image;

and according to the target frame image which is switched and processed, carrying out coding processing on the target video and transmitting the target video.

2. The method according to claim 1, wherein before the switching process on the target frame image, the method comprises:

acquiring a preset threshold corresponding to the target transmission parameter, and comparing the target transmission parameter with the preset threshold, wherein the preset threshold comprises: at least one of a preset threshold of transmission delay time, a preset threshold of retransmission times and a preset threshold of packet loss rate;

comparing the target transmission parameters one by one according to the preset threshold;

and if at least one data value in the target transmission parameters is greater than the preset threshold value, determining that the target transmission parameters are greater than the preset threshold value.

3. The method according to claim 2, wherein said encoding said target video comprises:

acquiring a next frame P frame corresponding to the target frame image, and taking the next frame P frame as a target reference frame;

and carrying out intra-frame coding processing on the target frame image, and carrying out coding processing on the target video according to the target reference frame.

4. The method of claim 1, further comprising:

acquiring target transmission resources and a target GOP;

if the target transmission resource meets the preset transmission requirement, encoding and transmitting the target video according to the target GOP;

and if the target transmission resource does not meet the preset transmission requirement, adjusting the GOP according to a preset rule, and encoding and transmitting the target video according to the adjusted target GOP.

5. The method of claim 4, wherein the adjusting the GOP according to the preset rules comprises:

acquiring a target load of the data transmission device;

and when the target load of the data transmission device exceeds a threshold value, adjusting the target GOP by increasing the number of frames in the target GOP.

6. A data transmission apparatus, comprising: a receiver and a processor, the receiver and the processor being connected,

the receiver is configured to obtain a target frame image and a target transmission parameter corresponding to the target frame image, where the target frame image is an I frame in a target video, and the target transmission parameter includes: at least one of transmission delay time, retransmission times and target packet loss rate of the target frame image;

the processor is used for switching the target frame image when the target transmission parameter is larger than a preset threshold value;

and according to the target frame image which is switched and processed, carrying out coding processing on the target video and sending the target video.

7. The apparatus according to claim 6, wherein the processor is further configured to, before performing the switching process on the target frame image, obtain a preset threshold corresponding to the target transmission parameter, and compare the target transmission parameter with the preset threshold, where the preset threshold includes: at least one of a preset threshold of transmission delay time, a preset threshold of retransmission times and a preset threshold of packet loss rate;

comparing the target transmission parameters one by one according to the preset threshold;

and if at least one data value in the target transmission parameters is greater than the preset threshold value, determining that the target transmission parameters are greater than the preset threshold value.

8. The apparatus of claim 7, wherein the processor is further configured to,

acquiring a next frame P frame corresponding to the target frame image, and taking the next frame P frame as a target reference frame;

and carrying out intra-frame coding processing on the target frame image, and carrying out coding processing on the target video according to the target reference frame.

9. The apparatus of claim 7, wherein the processor is further configured to,

acquiring target transmission resources and a target GOP;

if the target transmission resource meets the preset transmission requirement, encoding and sending a target video according to the target GOP;

and if the target transmission resource does not meet the preset transmission requirement, adjusting the GOP according to a preset rule, and encoding and transmitting the target video according to the adjusted target GOP.

10. The apparatus of claim 9, wherein the processor is further configured to obtain a target load of the data transmission apparatus if the target transmission resource does not meet a predetermined transmission requirement;

and when the target load of the data transmission device exceeds a threshold value, adjusting the target GOP by increasing the number of frames in the target GOP.

Images