CN117914796B

CN117914796B - HTCP transmission method and HTCP transmission device of portable communication equipment in complex network environment

Info

Publication number: CN117914796B
Application number: CN202311666237.9A
Authority: CN
Inventors: 钟志旺; 夏柯青; 喻芳; 陈文林; 莫中民; 金雨和
Original assignee: ZHUZHOU HUATONG TECHNOLOGY CO LTD
Current assignee: ZHUZHOU HUATONG TECHNOLOGY CO LTD
Priority date: 2023-12-06
Filing date: 2023-12-06
Publication date: 2024-09-10
Anticipated expiration: 2043-12-06
Also published as: CN117914796A

Abstract

The invention relates to HTCP transmission technology field, and discloses a HTCP transmission method and device of portable communication equipment in complex network environment, comprising: inquiring a current target congestion window value according to the current intra-frame time difference of a single-frame data packet set, calculating a current window regulation time length by utilizing a window regulation time length formula according to the data reading speed and the number of single-frame data packets, calculating a current window regulation speed by utilizing a window speed regulation formula according to a current dynamic sending window value, the current target congestion window value and the current window regulation time length, regulating the size of the current dynamic sending window according to the current window regulation speed to obtain a dynamic HTCP sending buffer, and sending the single-frame data packets in the dynamic HTCP sending buffer to the HTCP receiving buffer and then sending the single-frame data packets to an application layer. The invention mainly aims to solve the problem that the current congestion window regulation mode only triggers regulation when congestion occurs, so that the current congestion window regulation mode has poor regulation effect.

Description

HTCP transmission method and HTCP transmission device of portable communication equipment in complex network environment

Technical Field

The invention relates to a HTCP transmission method and a HTCP transmission device of portable communication equipment in a complex network environment, belonging to the HTCP transmission technical field.

Background

The conventional integrated portable communication device generally adopts UDP (User Datagram Protocol) protocol to transmit audio and video media data, and compared with TCP (Transmission Control Protocol) protocol, which needs to ensure a retransmission and congestion control mechanism of reliable transmission, the UDP protocol has the advantage of real time, so that the UDP protocol is suitable for media transmission with relatively high real-time requirements such as video conference systems, monitoring systems, VOIP and the like. The integrated portable communication equipment is generally used in the field, and more wireless transmission is adopted, so that the network environment is complex, the problems of network packet loss, jitter, delay and the like are serious, and even if an FEC (forward error correction) mechanism for recovering the network packet loss is adopted, a better audio and video transmission effect is difficult to achieve.

When the TCP protocol is used for transmitting data, a sliding window mechanism, congestion control mechanism and other mechanisms are generally adopted to optimize the data transmission effect, and the sliding window mechanism is a flow control mechanism in the TCP protocol and is used for controlling the data transmission rate of a sender and a receiver so as to avoid the situation that the data cannot be processed in time due to excessive data. The congestion control mechanism defines a congestion window CWND (congestion window) at the transmitting end, when the transmitted data exceeds the range of the congestion window, the data can not be continuously transmitted, the congestion window can dynamically call the size of the congestion window along with the change of the network condition, for example, congestion does not occur, the size of the congestion window is enlarged, otherwise, the size of the congestion window is reduced, the size of the congestion window is regulated in a slow starting, congestion avoidance and other modes, but the regulation mode of the congestion window can be triggered and regulated only when congestion occurs, so that the current regulation mode of the congestion window has the problem of poor regulation effect.

Disclosure of Invention

The invention provides a HTCP transmission method, a HTCP transmission device and a computer readable storage medium of portable communication equipment in a complex network environment, which mainly aim to solve the problem that the current congestion window regulation mode only triggers regulation when congestion occurs, so that the regulation effect is poor.

In order to achieve the above object, the present invention provides a HTCP transmission method of a portable communication device in a complex network environment, including:

acquiring a plurality of groups of test transmission frame sets, and sequentially extracting the test transmission frame sets from the plurality of groups of test transmission frame sets, wherein the intra-frame time differences of all the test transmission frames in the test transmission frame sets are the same, and the intra-frame time differences of all the groups of test transmission frame sets are different;

Transmitting the test transmission frame set in a preset complex network environment according to a pre-constructed congestion window sequence, and evaluating the transmission effect of the test transmission frame set to obtain a transmission evaluation value of each congestion window in the congestion window sequence;

Acquiring a target congestion window value corresponding to the test transmission frame set according to the transmission evaluation value, identifying a test intra-frame time difference of the test transmission frame set, and constructing a corresponding relation between the target congestion window value and the test intra-frame time difference to obtain an intra-frame time difference-congestion window association table;

Acquiring a single frame data packet set, and identifying the number of single frame data packets in the single frame data packet set;

Acquiring the current intra-frame time difference of the single-frame data packet set, and inquiring a current target congestion window value in the intra-frame time difference-congestion window association table according to the current intra-frame time difference;

Obtaining HTCP a data reading speed of a receiving buffer memory, and calculating the current window regulation time length by utilizing a pre-constructed window regulation time length formula according to the data reading speed and the number of single frame data packets, wherein the window regulation time length formula is as follows:

Wherein t _n represents the current window regulation duration, S _d represents the number of single frame data packets, and v _d represents the data reading speed;

Acquiring a current dynamic sending window value of a current dynamic sending window, and calculating a current window regulating speed by utilizing a pre-constructed window speed regulating formula according to the current dynamic sending window value, a current target congestion window value and a current window regulating duration, wherein the window speed regulating formula is as follows:

Wherein v _t represents the current window regulation speed, l ₁ represents the current dynamic transmission window value, and l ₂ represents the current target congestion window value;

the size of the current dynamic sending window is adjusted according to the current window regulation speed, and a dynamic HTCP sending buffer is obtained;

transmitting a single-frame data packet of a current dynamic transmission window in the dynamic HTCP transmission buffer memory to the HTCP receiving buffer memory by utilizing a pre-constructed UDP protocol to obtain a current HTCP receiving buffer memory;

and sending the current HTCP receiving buffer to a pre-constructed application layer to finish HTCP transmission of the portable communication device in a complex network environment.

Optionally, the evaluating the transmission effect of the test transmission frame set to obtain a transmission evaluation value of each congestion window in the congestion window sequence includes:

monitoring the transmission packet loss rate and the transmission time delay of the test transmission frame set, and obtaining a test transmission bandwidth;

calculating a transmission evaluation value of each congestion window in the congestion window sequence according to the transmission packet loss rate, the transmission delay and the test transmission bandwidth by using a pre-constructed transmission evaluation formula, wherein the transmission evaluation formula is as follows:

Wherein p represents a transmission evaluation value, d represents a test transmission bandwidth, t _c represents a transmission delay, r _loss represents a transmission packet loss rate, α represents a transmission delay adjustment factor, γ represents a transmission delay power weight, β represents a transmission packet loss rate adjustment factor, and δ represents a transmission packet loss rate power weight.

Optionally, the identifying the test intra-frame time difference of the test transmission frame set includes:

Acquiring the frame rate of the test transmission frame set and the number of single frame data packets of each test transmission frame;

calculating the test frame time difference by using a pre-constructed frame time difference formula according to the frame rate of the test transmission frame set and the number of single frame data packets, wherein the frame time difference formula is as follows:

Where t _z denotes the time difference in the test frame, f denotes the frame rate of the test transmission frame set, S, _d denotes the number of single frame packets of the test transmission frame.

Optionally, before the acquiring the single frame data packet set, the method further includes:

Acquiring media data in an application layer, and placing the media data at the tail of a pre-constructed initial RTP transmission queue to obtain a target RTP transmission queue;

Smoothing the media data in the target RTP transmission queue by utilizing a pre-constructed HTCP protocol to obtain a smoothed media data frame set;

Sequentially extracting smooth media data frames from the smooth media data frame set, and splitting and packaging the smooth media data frames to obtain a smooth single-frame data packet set;

acquiring a smooth frame rate of the smooth media data frame and a smooth single-frame data packet number of the smooth single-frame data packet set;

Calculating the intra-frame time difference of the smooth media data frame according to the smooth frame rate and the number of the smooth single-frame data packets, and sequencing each smooth single-frame data packet in the smooth single-frame data packet set to obtain the intra-frame sequence number of the smooth single-frame data packet;

constructing HTCP-format data packets of the smooth single-frame data packets according to the intra-frame time difference and the intra-frame sequence number of the smooth media data frame;

And sequencing HTCP format data packets in the initial RTP transmission queue according to the intra-frame sequence number of the smooth media data frame to obtain a target HTCP transmission queue.

Optionally, the acquiring a single frame data packet set includes:

identifying a frame sequence number and an intra-frame sequence number of a last single-frame data packet which is positioned at the last position of a preset available window in a preset current dynamic sending window;

Judging whether the last single frame data packet is a preset retransmission data packet or not;

If the last single frame data packet is a retransmission data packet, returning to the step of identifying the frame sequence number and the intra-frame sequence number of the last single frame data packet which is positioned at the last position of the preset available window in the preset current dynamic transmission window;

if the last single frame data packet is not a retransmission data packet, acquiring the number of smooth single frame data packets of a smooth media data frame where the last single frame data packet is located according to the frame sequence number;

judging whether the last single frame data packet is the last single frame data packet in a single smooth frame data packet set where the last single frame data packet is located according to the number of single smooth frame data packets and the sequence number in the frame;

if the last single frame data packet is not the last smooth single frame data packet in the smooth single frame data packet set where the last single frame data packet is located, returning to the step of identifying the frame sequence number and the intra-frame sequence number of the last single frame data packet located at the last preset available window in the current dynamic sending window;

And if the last single frame data packet is the last smooth single frame data packet in the smooth single frame data packet set where the last single frame data packet is located, extracting a single frame data packet set from the target HTCP transmission queue according to the sequence, wherein the single frame data packet in the single frame data packet set is a HTCP format data packet.

Optionally, the adjusting the size of the current dynamic sending window according to the current window adjusting speed to obtain a dynamic HTCP sending buffer, includes:

Judging the sizes of the current dynamic sending window value and the current target congestion window value;

If the current dynamic sending window value is larger than the current target congestion window value, reducing the current dynamic sending window according to the current window regulation speed to obtain a dynamic HTCP sending cache;

If the current dynamic sending window value is smaller than the current target congestion window value, increasing the current dynamic sending window according to the current window regulation speed to obtain a dynamic HTCP sending cache;

and if the current dynamic sending window value is equal to the current target congestion window value, obtaining a dynamic HTCP sending cache according to the condition that the current dynamic sending window is kept unchanged.

Optionally, after the adjusting the size of the current dynamic sending window according to the current window adjusting speed to obtain the dynamic HTCP sending buffer, the method further includes:

Identifying a dynamic transmission window value of a current dynamic transmission window in the dynamic HTCP transmission buffer;

And setting a retransmission timeout value according to the dynamic sending window value by using a pre-built retransmission timeout adjustment formula, wherein the retransmission timeout adjustment formula is as follows:

t_a＝k×l_d

where t _a denotes a retransmission timeout value, k denotes a retransmission timeout adjustment coefficient, and l _d denotes a dynamic transmission window value.

Optionally, before the single frame data packet of the current dynamic sending window in the dynamic HTCP sending buffer is sent to the HTCP receiving buffer by using the pre-constructed UDP protocol, the method further includes:

Judging whether a preset request retransmission packet exists or not;

If the request retransmission packet exists, counting the number of the request retransmission packets;

judging whether the number of the request retransmission packets is larger than a preset request retransmission threshold value or not;

if the number of the request retransmission packets is not greater than the request retransmission threshold, identifying HTCP start sequence numbers and HTCP end sequence numbers of the request retransmission packets;

Acquiring a HTCP sequence number set to be retransmitted between the HTCP start sequence number and the HTCP end sequence number;

acquiring a retransmission data packet set according to the HTCP sequence number set to be retransmitted;

Preferentially sending the retransmission data packet set to the HTCP receiving buffer;

if the number of the request retransmission packets is larger than the request retransmission threshold, starting a preset video dynamic frame loss mechanism, and acquiring a retransmission data packet set according to the request retransmission packets;

If the request retransmission packet does not exist, acquiring a current expected sequence number, and judging whether a current jump sequence number for jumping over the current expected sequence number exists or not;

if the current jump sequence number which skips the current expected sequence number exists, acquiring a retransmission data packet set according to the current expected sequence number and the current jump sequence number;

and if the current skip sequence number which skips the current expected sequence number does not exist, completing the preset abnormal retransmission judgment.

Optionally, the sending the current HTCP receive cache to a pre-built application layer includes:

sequentially extracting a single-frame data packet set from the current HTCP receiving buffer;

smoothing the single-frame data packet set to obtain an RTP receiving queue;

and sending the RTP receiving queue to the application layer.

In order to solve the above-mentioned problem, the present invention further provides a HTCP transmission device for a portable communication device in a complex network environment, where the device includes:

An intra-frame time difference-congestion window association table acquisition module, configured to acquire a plurality of groups of test transmission frame sets, and sequentially extract the test transmission frame sets from the plurality of groups of test transmission frame sets, where intra-frame time differences of all test transmission frames in the test transmission frame sets are the same, and intra-frame time differences of all groups of test transmission frame sets are different; transmitting the test transmission frame set in a preset complex network environment according to a pre-constructed congestion window sequence, and evaluating the transmission effect of the test transmission frame set to obtain a transmission evaluation value of each congestion window in the congestion window sequence; acquiring a target congestion window value corresponding to the test transmission frame set according to the transmission evaluation value, identifying a test intra-frame time difference of the test transmission frame set, and constructing a corresponding relation between the target congestion window value and the test intra-frame time difference to obtain an intra-frame time difference-congestion window association table;

the current target congestion window value query module is used for acquiring a single frame data packet set and identifying the number of single frame data packets in the single frame data packet set; acquiring the current intra-frame time difference of the single-frame data packet set, and inquiring a current target congestion window value in the intra-frame time difference-congestion window association table according to the current intra-frame time difference;

The current dynamic sending window regulation and control module is used for acquiring HTCP the data reading speed of the receiving buffer memory, calculating the current window regulation and control duration by utilizing a pre-constructed window regulation and control duration formula according to the data reading speed and the number of single frame data packets, wherein the window regulation and control duration formula is as follows:

Wherein t _n represents the current window regulation duration, S _d represents the number of single frame data packets, and v _d represents the data reading speed; acquiring a current dynamic sending window value of a current dynamic sending window, and calculating a current window regulating speed by utilizing a pre-constructed window speed regulating formula according to the current dynamic sending window value, a current target congestion window value and a current window regulating duration, wherein the window speed regulating formula is as follows:

wherein v _t represents the current window regulation speed, l ₁ represents the current dynamic transmission window value, and l ₂ represents the current target congestion window value; the size of the current dynamic sending window is adjusted according to the current window regulation speed, and a dynamic HTCP sending buffer is obtained;

HTCP a buffer data sending module, configured to send a single frame data packet of a current dynamic sending window in the dynamic HTCP sending buffer to the HTCP receiving buffer by using a pre-constructed UDP protocol, so as to obtain a current HTCP receiving buffer; and sending the current HTCP receiving cache to a pre-constructed application layer.

In order to solve the above-mentioned problems, the present invention also provides an electronic apparatus including:

at least one processor; and

A memory communicatively coupled to the at least one processor; wherein,

The memory stores instructions executable by the at least one processor to implement the method of HTCP transmissions of the portable communication device in a complex network environment described above.

In order to solve the above-mentioned problems, the present invention further provides a computer readable storage medium, where at least one instruction is stored, where the at least one instruction is executed by a processor in an electronic device to implement the above-mentioned HTCP transmission method of a portable communication device in a complex network environment.

Compared with the prior art, because the single frame data packet set with the time difference in each current frame has an optimal target congestion window value, the invention firstly needs to test the target congestion window value of each type of single frame data packet set, when testing, firstly obtains a plurality of groups of test transmission frame sets with different time differences in the frames, sequentially extracts the test transmission frame sets in the plurality of groups of test transmission frame sets, then transmits the test transmission frame sets in a complex network environment according to a pre-constructed congestion window sequence, evaluates the transmission effect of the test transmission frame sets, obtains the transmission evaluation value of each congestion window in the congestion window sequence, and can obtain the target congestion window value corresponding to the test transmission frame sets according to the transmission evaluation value because the higher the transmission evaluation value indicates the better the transmission effect, at this time, the test intra-frame time difference of the test transmission frame set can be identified, the corresponding relation between the target congestion window value and the test intra-frame time difference is reconstructed to obtain an intra-frame time difference-congestion window correlation table, the intra-frame time difference-congestion window correlation table can realize the function of inquiring the corresponding target congestion window value according to the intra-frame time difference, at this time, a single-frame data packet set needs to be transmitted, therefore, the current target congestion window value of the single-frame data packet set needs to be obtained firstly, namely the current intra-frame time difference of the single-frame data packet set is obtained, then the current target congestion window value is inquired in the intra-frame time difference-congestion window correlation table according to the current intra-frame time difference, at this time, the current dynamic sending window can be regulated and controlled by knowing the current target congestion window value, and the current window regulating and controlling speed needs to be known, the current window regulation speed can be calculated according to the current window regulation time length and the regulation value, when the current window regulation time length is calculated, the data reading speed of a current dynamic transmission window in the dynamic HTCP transmission buffer can be obtained by acquiring HTCP the data reading speed and the number of single frame data packets, so that the current window regulation time length can be calculated by utilizing a window regulation time length formula, at this moment, the current window regulation speed can be calculated according to the current dynamic transmission window value, the current target congestion window value and the current window regulation time length by utilizing a window speed regulation formula, finally, the size of the current dynamic transmission window is regulated according to the current window regulation speed, the dynamic HTCP transmission buffer is obtained, after the dynamic HTCP transmission buffer is obtained, the single frame data packets of the current dynamic transmission window in the dynamic HTCP transmission buffer can be transmitted to the HTCP by utilizing a UDP protocol, the current HTCP reception buffer is obtained, and the current HTCP reception buffer is transmitted to a pre-constructed application layer. Therefore, the method, the device, the electronic equipment and the computer readable storage medium for HTCP transmission of the portable communication equipment in the complex network environment mainly aim to solve the problem that the current congestion window regulation mode only triggers regulation when congestion occurs, so that the regulation effect is poor.

Drawings

Fig. 1 is a schematic flow chart of a HTCP transmission method of a portable communication device in a complex network environment according to an embodiment of the present invention;

Fig. 2 is a schematic diagram of a video packet of a HTCP transmission method of a portable communication device in a complex network environment according to an embodiment of the present invention;

fig. 3 is a schematic diagram of an audio packet of a HTCP transmission method of a portable communication device in a complex network environment according to an embodiment of the present invention;

Fig. 4 is a schematic diagram of a reception acknowledgement packet of a HTCP transmission method of a portable communication device in a complex network environment according to an embodiment of the present invention;

Fig. 5 is a schematic diagram of a request retransmission packet of a HTCP transmission method of a portable communication device in a complex network environment according to an embodiment of the present invention;

Fig. 6 is a schematic diagram of a transmission flow of a HTCP transmission method of a portable communication device in a complex network environment according to an embodiment of the present invention;

FIG. 7 is a functional block diagram of a HTCP transmission device of a portable communication device in a complex network environment according to an embodiment of the present invention;

Fig. 8 is a schematic structural diagram of an electronic device for implementing HTCP transmission methods of the portable communication device in a complex network environment according to an embodiment of the present invention.

The achievement of the objects, functional features and advantages of the present invention will be further described with reference to the accompanying drawings, in conjunction with the embodiments.

Detailed Description

It should be understood that the specific embodiments described herein are for purposes of illustration only and are not intended to limit the scope of the invention.

The embodiment of the application provides a HTCP transmission method of portable communication equipment in a complex network environment. The execution subject of the HTCP transmission method of the portable communication device in the complex network environment includes, but is not limited to, at least one of a server, a terminal and the like, which can be configured to execute the method provided by the embodiment of the application. In other words, the HTCP transmission method of the portable communication device in the complex network environment may be performed by software or hardware installed in the terminal device or the server device. The service end includes but is not limited to: a single server, a server cluster, a cloud server or a cloud server cluster, and the like.

Example 1:

Referring to fig. 1, a flow chart of a HTCP transmission method of a portable communication device in a complex network environment according to an embodiment of the present invention is shown. In this embodiment, the HTCP transmission method of the portable communication device in the complex network environment includes:

S1, acquiring a plurality of groups of test transmission frame sets, and sequentially extracting the test transmission frame sets from the plurality of groups of test transmission frame sets, wherein the intra-frame time differences of all the test transmission frames in the test transmission frame sets are the same, and the intra-frame time differences of all the groups of test transmission frame sets are different.

In the embodiment of the invention, the multiple groups of test transmission frame sets are used for multiple groups of test media data frame sets, and for convenience in testing, the intra-frame time difference of each group of test transmission frame sets needs to be changed in a gradient manner. For example: the system comprises a plurality of groups of test videos, wherein each group of videos consists of a group of test transmission frames with consistent intra-frame time difference. The intra-frame time differences of the test transmission frames in each set of test videos may be 1ms, 5ms, 10ms, 15ms, 20ms, etc.

S2, transmitting the test transmission frame set in a preset complex network environment according to a pre-constructed congestion window sequence, and evaluating the transmission effect of the test transmission frame set to obtain a transmission evaluation value of each congestion window in the congestion window sequence.

It is understood that the congestion window (Congestion Window, CWND) sequence refers to a sequence of congestion windows of different sizes. For example: the congestion window sequence may be a congestion window of 1 segment, a congestion window of 5 segments, a congestion window of 10 segments, a congestion window of 15 segments, a congestion window of 20 segments, etc.

In the embodiment of the present invention, the evaluation of the transmission effect of the test transmission frame set to obtain a transmission evaluation value of each congestion window in the congestion window sequence includes:

Furthermore, the adjustment factors and the power weights of the test transmission frame sets of different types are different, the adjustment factors and the power weights of the transmission delay of the test transmission frame sets with high real-time requirements are utilized to be improved, and the adjustment factors and the power weights of the transmission packet loss rate of the test transmission frame sets with high data transmission accuracy can be increased.

It should be appreciated that by testing the transmission effect of the set of test transmission frames of different intra-frame time differences under the blind congestion window, an optimal congestion window for the set of test transmission frames of each intra-frame time difference is obtained.

And S3, acquiring a target congestion window value corresponding to the test transmission frame set according to the transmission evaluation value, identifying the time difference in the test frames of the test transmission frame set, and constructing a corresponding relation between the target congestion window value and the time difference in the test frames to obtain an intra-frame time difference-congestion window association table.

The target congestion window value refers to the number of message segments of the congestion window corresponding to the maximum transmission evaluation value.

In the embodiment of the present invention, the identifying the time difference in the test frame of the test transmission frame set includes:

Where t _z denotes the time difference in the test frame, f denotes the frame rate of the test transmission frame set, and S' _d denotes the number of single frame packets of the test transmission frame.

It will be appreciated that the Intra-frame time difference (Intra-FRAME TIME DIFFERENCE) refers to the time difference between different objects or regions in the same video frame, i.e. the time interval between single frame data packets in the test transmission frame, for example: when the frame rate of the test transmission frame set is 1/30, that is, the duration of a single test transmission frame is 1/30, if the number of single frame data packets is 10, the intra-frame time difference is 1/300. The number of single frame data packets refers to the number of data packets divided into the test transmission frame, and when data transmission is performed, the test transmission frame generally needs to be divided into a plurality of data packets.

S4, acquiring a single frame data packet set, and identifying the number of single frame data packets in the single frame data packet set.

It can be understood that the single-frame data packet set refers to a data packet set of a media data frame to be currently transmitted, and the data packet of the media data frame is not yet transmitted to the pre-constructed HTCP transmission buffer. The HTCP sending buffer refers to a buffer space for storing HTCP format data packets to be sent, the HTCP sending buffer includes a first portion (data packets that have been sent and received with ACK acknowledgements), a second portion (data packets that have been sent but not received with ACK acknowledgements), a third portion (data packets that have not been sent but are within a buffer processing range are received at HTCP), and a fourth portion (data packets that have not been sent and are outside the buffer processing range are received at HTCP), where the second portion and the third portion constitute a sending window of the HTCP sending buffer.

Further, the single frame data packet may be shown in fig. 7 and fig. 8. The single frame data packet may be a video packet or an audio packet, where HTCP sequence numbers are used to determine whether the packet is lost, frame types are used to distinguish between an I frame and a P frame, frame markers are used to mark whether the frame ends, and intra sequence numbers are used to determine whether the packet is lost in the frame and to discard the P frame. The intra-frame time difference needs to calculate the duration of each frame through the frame rate, then calculate the frame rate, and finally calculate the time interval difference of each HTCP format data packet in a media data frame according to the number of single frame data packets and the frame rate, namely the intra-frame time difference, for smoothing.

In the embodiment of the present invention, before the acquiring the single frame data packet set, the method further includes:

Further, the initial RTP sending queue refers to an RTP priority queue between media data that has not been acquired, and the RTP priority queue is a queue technology for solving the quality of service of real-time services (including voice and video services). The principle is that RTP message carrying voice or video is sent into high priority queue to be sent preferentially, so as to ensure minimum time delay and jitter, and thus ensure service quality of voice or video to time delay sensitive service.

It should be appreciated that, referring to fig. 6, when the application layer sends media data, instead of directly sending the media data through UDP, the application layer discards the media data at the end of the RTP transmission queue and waits HTCP for processing. HTCP analyzes the media data of the RTP transmission queue, performs smoothing treatment on the video data packet, especially the I frame data, generates HTCP intra-frame sequence number and intra-frame time difference according to the frame rate and the number of single frame data packets, obtains the media data from the queue head of the RTP transmission queue, packages the media data according to UTCP protocol format, forms HTCP format data, and discards the HTCP format data to HTCP transmission buffer to wait for UDP transmission.

In an embodiment of the present invention, the acquiring a single frame data packet set includes:

It can be appreciated that the current dynamic transmission window refers to the current transmission window in the HTCP transmission buffer. And the last bit of the available window refers to the last message segment in the current dynamic sending window. The frame number refers to the frame number of the media data frame where the last single frame data packet is located, a video segment may be composed of a plurality of media data frames, the frame number of the first media data frame may be 001, the frame number of the second media data frame may be 002, and so on. The intra-frame sequence number refers to the sequence number of the last single-frame data packet in the corresponding media data frame.

Further, since there may be a single frame packet set to be retransmitted when a single frame packet of a media data frame is transmitted, at this time, a single frame packet immediately following the single frame packet set may not be consecutive to the single frame packet set to be retransmitted, and a packet connected to the single frame packet to be retransmitted is not to be retransmitted, the last single frame packet may not be a single frame packet to be retransmitted.

It should be appreciated that if the number of smooth single frame data packets is equal to the intra sequence number, the last single frame data packet is the last smooth single frame data packet in the set of smooth single frame data packets in which the last single frame data packet is located. At this time, it indicates that a part of the media data corresponding to the previous frame of the single-frame data packet set is completely transmitted, and another part of the media data is completely in the current dynamic transmission window and is being transmitted, so that the single-frame data packet set can start to be transmitted to the current dynamic transmission window of the HTCP transmission buffer.

S5, obtaining the current intra-frame time difference of the single-frame data packet set, and inquiring the current target congestion window value in the intra-frame time difference-congestion window association table according to the current intra-frame time difference.

Further, after knowing the current intra-frame time difference of the single-frame data packet set, the optimal current target congestion window value can be queried in the intra-frame time difference-congestion window association table according to the current intra-frame time difference, and the number of message segments contained in the optimal current dynamic sending window of the single-frame data packet is represented according to the current target congestion window value, so that when the single-frame data packet starts to be transmitted, the current dynamic sending window can be adjusted according to the current target congestion window value until the single-frame data packet set corresponding to the next frame media data of the single-frame data packet set starts to be sent, the adjustment is stopped at the moment, and the adjustment of the current dynamic sending window is started according to the optimal target congestion window value corresponding to the next frame media data.

S6, acquiring HTCP a data reading speed of the receiving buffer, and calculating the current window regulation time by using a pre-constructed window regulation time formula according to the data reading speed and the number of single frame data packets.

It can be understood that the current window regulation duration represents the duration of the single-frame data packet set for regulating the current dynamic sending window, when the current window regulation duration is reached, the number of message segments contained in the current dynamic sending window is exactly equal to the current target congestion window value, and at this time, the regulation of the dynamic sending window of the single-frame data packet in the next stage needs to be started.

In detail, the window regulation duration formula is as follows:

Wherein t _n represents the current window regulation duration, S _d represents the number of single frame data packets, and v _d represents the data reading speed.

S7, acquiring a current dynamic sending window value of a current dynamic sending window, and calculating a current window regulation speed by utilizing a pre-constructed window speed regulation formula according to the current dynamic sending window value, a current target congestion window value and a current window regulation duration.

In detail, the window speed regulation formula is as follows:

Where v _t denotes the current window regulation speed, l ₁ denotes the current dynamic transmission window value, and l ₂ denotes the current target congestion window value.

It may be explained that the current window regulation speed may not be an integer, so when the current window regulation speed is not an integer, rounding may be performed, for example: when the current window adjustment speed is 0.6 message segments/s and the initial value of the current dynamic sending window is 10 message segments, the adjusted current dynamic sending window value of the 1 st s is 10.6 message segments (10 message segments are taken), the current dynamic sending window value of the 2 nd s is 11.2 message segments (11 message segments are taken), the current dynamic sending window value of the 4 th s is 12.4 message segments (12 message segments are taken), and so on.

And S8, adjusting the size of the current dynamic sending window according to the current window regulation speed to obtain a dynamic HTCP sending cache.

The dynamic HTCP send buffer, as explained, refers to the send window being the HTCP send buffer of the current dynamic send window.

In the embodiment of the present invention, the adjusting the size of the current dynamic sending window according to the current window adjusting speed to obtain the dynamic HTCP sending buffer includes:

In the embodiment of the present invention, after the size of the current dynamic sending window is adjusted according to the current window regulation speed to obtain the dynamic HTCP sending buffer, the method further includes:

t_a＝k×l_d

It can be appreciated that the dynamic send window value in HTCP send buffer should be associated with the retransmission timeout value, the larger the dynamic send window value in HTCO send buffer, the larger the retransmission timeout value.

And S9, transmitting the single-frame data packet of the current dynamic transmission window in the dynamic HTCP transmission buffer to the HTCP receiving buffer by utilizing the pre-constructed UDP protocol to obtain a current HTCP receiving buffer.

It will be appreciated that the UDP (User Datagram Protocol) protocol is a message-oriented transport layer protocol, and that although UDP provides integrity verification of the header and payload (via checksums), it does not guarantee that messaging is provided to the upper layer protocol.

Further, the transmission process of the single frame data packet may be shown in fig. 6.

In the embodiment of the present invention, before the single frame data packet of the current dynamic sending window in the dynamic HTCP sending buffer is sent to the HTCP receiving buffer by using the pre-constructed UDP protocol, the method further includes:

Judging whether a preset request retransmission packet exists or not;

In detail, referring to fig. 6, if data that the counterpart requests retransmission is recognized, it is required to directly discard the UDP transmission. The request retransmission packet and the Acknowledgement (ACK) packet also have independent HTCP sequence numbers, the sending end of the HTCP sending buffer finds that the request retransmission packet or the acknowledgement packet sent by the receiving end of the HTCP receiving buffer has a packet loss condition, or the request retransmission packet exceeds a certain threshold, HTCP starts a video dynamic frame loss mechanism, and a plurality of P frame data packets which are requested to be retransmitted are cleared from the HTCP sending buffer and the HTCP receiving buffer, so as to reduce the network pressure. When the data confirmation packet sequence number received by the transmitting end skips the expected sequence number at the moment and is continuously accumulated for a plurality of times (the times can be set), HTCP considers that packet loss occurs, and the transmitting end directly transmits the skipped sequence number packet without waiting for overtime, so that the transmission speed during packet loss is improved.

Further, referring to fig. 6, after receiving HTCP format data, UDP firstly determines whether the received HTCP format data is normal, and if HTCP format data is normal, HTCP format data is directly inserted into HTCP receiving buffer according to HTCP sequence numbers, and in a certain time window period, acknowledgement information is formed and lost to an acknowledgement queue, so as to inform a sender that the data has received a plurality of data packets between the HTCP sequence number and a previous HTCP sequence number (as indicated by arrow lines of receiving acknowledgement packets in fig. 6). If the HTCP sequence number of the data is not the expected sequence number (if the video packet also appears as HTCP intra sequence number and intra time difference are abnormal), the packet loss or disorder occurs, and the data packet with the sequence number is not received within the receiving window period (reaching the retransmission timeout value), the HTCP sequence number packet is considered to be lost, and the sender is informed of the sequence number of the lost data packet HTCP, and requests to resend the data packet (as shown by the arrow line of the request for resending the data packet in fig. 6).

Further, the receipt acknowledgement packet may be shown in fig. 4, and the request retransmission packet may be shown in fig. 5. Wherein the ACK sequence number and the REQ sequence number are HTCP sequence numbers of a received acknowledgement packet and a request retransmission packet, respectively. HTCP start sequence number and HTCP end sequence number indicate that packets from this start sequence number to the end sequence number are received or that packets between are to be retransmitted.

And S10, sending the current HTCP receiving cache to a pre-constructed application layer, and finishing HTCP transmission of the portable communication equipment in a complex network environment.

It will be appreciated that the current HTCP receive buffered transmission process may be described with reference to fig. 6.

In the embodiment of the present invention, the sending the current HTCP receive buffer to the pre-built application layer includes:

smoothing the single-frame data packet set to obtain an RTP receiving queue;

and sending the RTP receiving queue to the application layer.

It can be appreciated that after the data is fetched from the HCTP receive buffer, the video data is also smoothed, and the smoothing is mainly to readjust the intra-frame time difference, so that the RTP receive queue can smoothly send the data to the upper layer application.

Example 2:

Fig. 7 is a functional block diagram of a HTCP transmission device of a portable communication device in a complex network environment according to an embodiment of the present invention.

The HTCP transmission device 100 of the portable communication device in the complex network environment according to the present invention may be installed in an electronic device. Depending on the implementation function, the HTCP transmission device 100 of the portable communication device in the complex network environment may include an intra-frame time difference-congestion window association table obtaining module 101, a current target congestion window value query module 102, a current dynamic sending window regulation module 103 and a module 104. The module of the invention, which may also be referred to as a unit, refers to a series of computer program segments, which are stored in the memory of the electronic device, capable of being executed by the processor of the electronic device and of performing a fixed function.

The intra-frame time difference-congestion window association table obtaining module 101 is configured to obtain multiple groups of test transmission frame sets, and sequentially extract the test transmission frame sets from the multiple groups of test transmission frame sets, where intra-frame time differences of all test transmission frames in the test transmission frame sets are the same, and intra-frame time differences of all groups of test transmission frame sets are different; transmitting the test transmission frame set in a preset complex network environment according to a pre-constructed congestion window sequence, and evaluating the transmission effect of the test transmission frame set to obtain a transmission evaluation value of each congestion window in the congestion window sequence; acquiring a target congestion window value corresponding to the test transmission frame set according to the transmission evaluation value, identifying a test intra-frame time difference of the test transmission frame set, and constructing a corresponding relation between the target congestion window value and the test intra-frame time difference to obtain an intra-frame time difference-congestion window association table;

The current target congestion window value query module 102 is configured to obtain a single frame data packet set, and identify a number of single frame data packets in the single frame data packet set; acquiring the current intra-frame time difference of the single-frame data packet set, and inquiring a current target congestion window value in the intra-frame time difference-congestion window association table according to the current intra-frame time difference;

the current dynamic sending window adjusting module 103 is configured to obtain HTCP a data reading speed of the receiving buffer, calculate a current window adjusting time length according to the data reading speed and the number of single frame data packets by using a pre-constructed window adjusting time length formula, where the window adjusting time length formula is as follows:

The HTCP buffer data sending module 104 is configured to send, using a pre-constructed UDP protocol, a single frame packet of a current dynamic sending window in the dynamic HTCP sending buffer to the HTCP receiving buffer, to obtain a current HTCP receiving buffer; and sending the current HTCP receiving cache to a pre-constructed application layer.

In detail, the modules in the HTCP transmission device 100 of the portable communication device in the complex network environment in the embodiment of the present invention use the same technical means as the HTCP transmission method of the portable communication device in the complex network environment described in fig. 1, and can produce the same technical effects, which are not described herein.

Example 3:

Fig. 8 is a schematic structural diagram of an electronic device for implementing HTCP transmission methods of a portable communication device in a complex network environment according to an embodiment of the present invention.

The electronic device 1 may comprise a processor 10, a memory 11, a bus 12 and a communication interface 13, and may further comprise a computer program stored in the memory 11 and executable on the processor 10, such as HTCP transmission programs of a portable communication device in a complex network environment.

The memory 11 includes at least one type of readable storage medium, including flash memory, a mobile hard disk, a multimedia card, a card memory (e.g., SD or DX memory, etc.), a magnetic memory, a magnetic disk, an optical disk, etc. The memory 11 may in some embodiments be an internal storage unit of the electronic device 1, such as a removable hard disk of the electronic device 1. The memory 11 may in other embodiments also be an external storage device of the electronic device 1, such as a plug-in mobile hard disk, a smart memory card (SMARTMEDIACARD, SMC), a secure digital (SecureDigital, SD) card, a flash memory card (FLASHCARD) or the like, which are provided on the electronic device 1. Further, the memory 11 may also include both an internal storage unit and an external storage device of the electronic device 1. The memory 11 may be used not only for storing application software installed in the electronic device 1 and various types of data, such as codes of HTCP transmission programs of portable communication devices in a complex network environment, but also for temporarily storing data that has been output or is to be output.

The processor 10 may be comprised of integrated circuits in some embodiments, for example, a single packaged integrated circuit, or may be comprised of multiple integrated circuits packaged with the same or different functions, including one or more central processing units (CentralProcessingunit, CPU), microprocessors, digital processing chips, graphics processors, various control chips, and the like. The processor 10 is a control core (ControlUnit) of the electronic device, connects the various components of the overall electronic device using various interfaces and lines, runs or executes programs or modules stored in the memory 11 (e.g., HTCP transmission programs of portable communication devices in complex network environments, etc.), and invokes data stored in the memory 11 to perform various functions of the electronic device 1 and process data.

The bus may be a peripheral component interconnect standard (peripheralcomponentinterconnect, PCI) bus, or an extended industry standard architecture (extendedindustrystandardarchitecture, EISA) bus, among others. The bus may be classified as an address bus, a data bus, a control bus, etc. The bus is arranged to enable a connection communication between the memory 11 and at least one processor 10 etc.

Fig. 8 shows only an electronic device with components, and it will be appreciated by a person skilled in the art that the structure shown in fig. 8 does not constitute a limitation of the electronic device 1, and may comprise fewer or more components than shown, or may combine certain components, or may be arranged in different components.

For example, although not shown, the electronic device 1 may further include a power source (such as a battery) for supplying power to each component, and preferably, the power source may be logically connected to the at least one processor 10 through a power management device, so that functions of charge management, discharge management, power consumption management, and the like are implemented through the power management device. The power supply may also include one or more of any of a direct current or alternating current power supply, recharging device, power failure detection circuit, power converter or inverter, power status indicator, etc. The electronic device 1 may further include various sensors, bluetooth modules, wi-Fi modules, etc., which will not be described herein.

Further, the electronic device 1 may also comprise a network interface, optionally the network interface may comprise a wired interface and/or a wireless interface (e.g. WI-FI interface, bluetooth interface, etc.), typically used for establishing a communication connection between the electronic device 1 and other electronic devices.

The electronic device 1 may optionally further comprise a user interface, which may be a Display, an input unit, such as a Keyboard (Keyboard), or a standard wired interface, a wireless interface. Alternatively, in some embodiments, the display may be an LED display, a liquid crystal display, a touch-sensitive liquid crystal display, an OLED (organic light-emitting diode) touch, or the like. The display may also be referred to as a display screen or display unit, as appropriate, for displaying information processed in the electronic device 1and for displaying a visual user interface.

It should be understood that the embodiments described are for illustrative purposes only and are not limited to this configuration in the scope of the patent application.

The portable communication device stored in the memory 11 of the electronic device 1 is a combination of instructions in HTCP transmission program of a complex network environment, which when run in the processor 10, can implement:

Specifically, the specific implementation method of the above instruction by the processor 10 may refer to descriptions of related steps in the corresponding embodiments of fig. 1 to 7, which are not repeated herein.

Further, the modules/units integrated in the electronic device 1 may be stored in a computer readable storage medium if implemented in the form of software functional units and sold or used as separate products. The computer readable storage medium may be volatile or nonvolatile. For example, the computer readable medium may include: any entity or device capable of carrying the computer program code, a recording medium, a U disk, a removable hard disk, a magnetic disk, an optical disk, a computer memory, a Read-only memory (ROM).

The present invention also provides a computer readable storage medium storing a computer program which, when executed by a processor of an electronic device, can implement:

The modules described as separate components may or may not be physically separate, and components shown as modules may or may not be physical units, may be located in one place, or may be distributed over multiple network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

In addition, each functional module in the embodiments of the present invention may be integrated in one processing unit, or each unit may exist alone physically, or two or more units may be integrated in one unit. The integrated units can be realized in a form of hardware or a form of hardware and a form of software functional modules.

It will be evident to those skilled in the art that the invention is not limited to the details of the foregoing illustrative embodiments, and that the present invention may be embodied in other specific forms without departing from the spirit or essential characteristics thereof.

Finally, it should be noted that the above-mentioned embodiments are merely for illustrating the technical solution of the present invention and not for limiting the same, and although the present invention has been described in detail with reference to the preferred embodiments, it should be understood by those skilled in the art that modifications and equivalents may be made to the technical solution of the present invention without departing from the spirit and scope of the technical solution of the present invention.

Claims

1. A method for HTCP transmissions by a portable communication device in a complex network environment, the method comprising:

Acquiring a plurality of groups of test transmission frame sets, and sequentially extracting the test transmission frame sets from the plurality of groups of test transmission frame sets, wherein the intra-frame time differences of all the test transmission frames in the test transmission frame sets are the same, and the intra-frame time differences of all the groups of test transmission frame sets are different; the intra-frame time difference refers to the time difference between different objects or areas in the same video frame, namely the time interval between single frame data packets in the test transmission frame;

Acquiring HTCP a data reading speed of a receiving buffer, HTCP refers to a hypertext buffer protocol, and calculating a current window regulation time length according to the data reading speed and the number of single frame data packets by using a pre-constructed window regulation time length formula, wherein the window regulation time length formula is as follows:

2. The method for HTCP transmission of a portable communication device in a complex network environment according to claim 1, wherein the evaluating the transmission effect of the test transmission frame set to obtain a transmission evaluation value of each congestion window in the congestion window sequence includes:

3. The method for HTCP transmissions by a portable communication device in a complex network environment of claim 1, wherein said identifying a test intra-frame time difference for the set of test transmission frames comprises:

4. The method of HTCP transmissions by a portable communication device in a complex network environment of claim 1, wherein prior to said obtaining a single frame data packet set, the method further comprises:

5. The method for HTCP transmission of a portable communication device in a complex network environment of claim 4, wherein said obtaining a single frame data packet set comprises:

6. The method for HTCP transmission of a portable communication device in a complex network environment according to claim 1, wherein said adjusting the size of the current dynamic transmission window according to the current window regulation speed to obtain a dynamic HTCP transmission buffer includes:

7. The method for HTCP transmission of a portable communication device in a complex network environment according to claim 1, wherein after the step of adjusting the size of the current dynamic transmission window according to the current window adjustment speed to obtain the dynamic HTCP transmission buffer, the method further comprises:

t_a＝k×l_d

Where t _a denotes a retransmission timeout value, k denotes a retransmission timeout adjustment coefficient, and t _d denotes a dynamic transmission window value.

8. The method for HTCP transmission in a complex network environment of claim 7 wherein said method further comprises, prior to said transmitting single frame packets of a current dynamic transmission window in said dynamic HTCP transmit buffer to said HTCP receive buffer using a pre-constructed UDP protocol:

Judging whether a preset request retransmission packet exists or not;

9. The method for HTCP transmission of a portable communication device in a complex network environment of claim 8, wherein said sending the current HTCP receive buffer to a pre-built application layer comprises:

smoothing the single-frame data packet set to obtain an RTP receiving queue;

and sending the RTP receiving queue to the application layer.

10. A HTCP transmission apparatus for a portable communication device in a complex network environment, the apparatus comprising:

An intra-frame time difference-congestion window association table obtaining module, configured to obtain multiple groups of test transmission frame sets, and sequentially extract the test transmission frame sets from the multiple groups of test transmission frame sets, where intra-frame time differences of each test transmission frame in the test transmission frame sets are the same, and intra-frame time differences of each group of test transmission frame sets are different, where the intra-frame time differences refer to time differences between different objects or regions in the same video frame, that is, time intervals between single frame data packets in the test transmission frame; transmitting the test transmission frame set in a preset complex network environment according to a pre-constructed congestion window sequence, and evaluating the transmission effect of the test transmission frame set to obtain a transmission evaluation value of each congestion window in the congestion window sequence; acquiring a target congestion window value corresponding to the test transmission frame set according to the transmission evaluation value, identifying a test intra-frame time difference of the test transmission frame set, and constructing a corresponding relation between the target congestion window value and the test intra-frame time difference to obtain an intra-frame time difference-congestion window association table;

The current dynamic sending window regulation and control module is used for acquiring HTCP a data reading speed of a receiving buffer, HTCP refers to a hypertext buffer protocol, and calculating the current window regulation and control duration by utilizing a pre-constructed window regulation and control duration formula according to the data reading speed and the number of single frame data packets, wherein the window regulation and control duration formula is as follows: