CN104754339B

CN104754339B - I framing control method, apparatus and system

Info

Publication number: CN104754339B
Application number: CN201310731550.6A
Authority: CN
Inventors: 成建敏; 王亮
Original assignee: TD Tech Ltd
Current assignee: TD Tech Ltd
Priority date: 2013-12-26
Filing date: 2013-12-26
Publication date: 2018-02-13
Anticipated expiration: 2033-12-26
Also published as: CN104754339A

Abstract

The present invention provides a kind of I framing control method, apparatus and system.Wherein, transmitting terminal is sending RTP bags, sender report；While receiving the receiving terminal report that receiving terminal is sent, transmitting terminal can obtain I dither frame parameters, and the I dither frame parameters include：First time stamp, the second time stamp, the 3rd time stamp, the 4th time stamp, the first processing delay and second processing time delay.Transmitting terminal is according to the delay jitters of I dither frame parameter acquiring I frames.If the delay jitter of I frames is more than dithering threshold, transmitting terminal increases the interval of adjacent I frame, the configuration of I frame periods is adjusted, and the encoder for notifying transmitting terminal video coding layer encodes according to new I frame periods to video data, it is achieved thereby that the shake according to I frames carries out the adjustment of I frame periods, so as to while video data stream decoding quality is ensured, avoid because I dither frames are uneven and cause the phenomenon of video cardton.

Description

I framing control method, apparatus and system

Technical field

The present invention relates to video communication technology, more particularly to a kind of I framing control method, apparatus and system.

Background technology

Video coding of the prior art, generally use I frames, P frames and B frames carry out coding transmission.Wherein, I frames are mainly Encoded with reference to this frame, and P frames Primary Reference I frames or P frames, B frames can typically refer to I frames, P frames, or B frames.Therefore, I Frame coding exports coding bit generally has higher code check.Also, code check be usually P frames either tens times of B frames or on Hundred times.Due to when there is the output of I frames, it is necessary to the data of transmission are more, therefore the video bag for causing an I frame or I pieces to export Larger, in the case where resolution ratio is higher, the bag of I pieces or the output of I frames would generally unpack processing.

During the real-time Transmission of image, prior art can typically use RTP (Real-time Transport Protocol, referred to as：RTP) carry the video bag of Video coding, while correspondingly carry out video packet delay, The real-time estimation of code check etc..In a typical protocol architecture of video stream media application, RTP needs real-time Transmission control Agreement (RTP Control Protocol, abbreviation processed：RTCP guarantee) is provided for its service quality, RTCP major function is： The monitoring of service quality is synchronous between feedback, media, and in multicast group member mark.It is each to participate in RTP ession for telecommunication Person periodically transmits RTCP bags.The systems such as the quantity of packet of quantity, loss containing the packet sent in RTCP bags Meter data, therefore, each participant can dynamically change transmission rate using these information, or even change PT Payload Type.

But when using Real-time Transport Protocol and the rtcp protocol of prior art to carry out video data transmission, during due to usual transmission Prolong just it is bigger, the time delay of transmission is long, and the delay variation so between different frame is unbalanced, carry out I bags transmission During, I packet delays will be bigger, the problem of so as to cause video decoding end video frequency output that video cardton still occurs.

The content of the invention

The present invention provides a kind of I framing control method, apparatus and system, to ensure the same of video data stream decoding quality When, avoid because I dither frames are uneven and cause the phenomenon of video cardton.

The first aspect of the invention is to provide a kind of I framing control method, including：

Transmitting terminal sends an I frame real time transport protocol RTP bag to receiving terminal every time, corresponding each I frames RTP bags to The receiving terminal sends the first real time transport control protocol RTCP sender reports, the first RTCP sender reports and I frames Association, the first RTCP sender reports are identified as the special report of corresponding I frames using special bit；

The transmitting terminal receives the first RTCP receiving terminals report that the receiving terminal is sent, the first RTCP receiving terminal reports Announcement associates with I frames, and the first RTCP receiving terminals report includes the first processing delay, and first processing delay is the reception End receives the time delay that first sender report sends the first receiving terminal report to the receiving terminal；

The transmitting terminal is based on RTCP report interval and sends the 2nd RTCP sender reports to the receiving terminal；

The transmitting terminal receives the 2nd RTCP receiving terminals report that the receiving terminal is sent based on RTCP report interval, described The report of 2nd RTCP receiving terminals includes second processing time delay, and the second processing time delay is that the receiving terminal receives described second RTCP sender reports send the time delay of the 2nd RTCP receiving terminals report to the receiving terminal；

The transmitting terminal records the first time stamp, the second time stamp, the 3rd time stamp and the 4th time stamp, and first time stamp is described Transmitting terminal send the first RTCP sender reports at the time of, second time stamp be the transmitting terminal receive described first RTCP receiving terminals report at the time of, the 3rd time stamp be the transmitting terminal transmission the 2nd RTCP sender reports at the time of, institute At the time of stating the 4th time stamp and receive the 2nd RTCP receiving terminals report for the transmitting terminal；

The transmitting terminal is according to first time stamp, second time stamp, the 3rd time stamp, the 4th time stamp, institute State the first processing delay and the second processing time delay obtains the delay jitter of the I frames；

If the delay jitter of the I frames is more than dithering threshold, the interval of increase adjacent I pin is encoded.

With reference to one side, in the first possible implementation, the transmitting terminal is according to first time stamp, institute State the second time stamp and the processing delay obtains the delay jitter of the I frames, including：

The effective transmission time delay of the I frames is obtained by formula below：

Wherein, D_IkFor the effective transmission time delay of k-th of I frames,Described first is sent for the transmitting terminal First time stamp of RTCP sender reports, the first RTCP sender reports and n-th of RTP bag pair of k-th of I frames Should,The second time stamp of the first RTCP receiving terminals report, the first RTCP receiving terminals are received for the transmitting terminal Report, DLSR corresponding with n-th of RTP bag of k-th of I frames_IknReported for the first RTCP receiving terminals at include first Time delay is managed, N decomposes corresponding RTP bag numbers by k-th of I frames, should be the integer more than or equal to 1, the value of the n Scope is [1, N], and k is the call number of the I frames of journal；

The effective transmission time delay of frame of video is obtained by formula below：

Wherein, D_lFor the effective transmission time delay of rtp streaming data,For it is described based on time interval send described second 3rd time stamp corresponding to RTCP sender reports,To receive the 2nd RTCP receiving terminal reports based on time interval with described 4th time stamp corresponding to announcement, DLSR_aThe second processing time delay included for the report of standard RTCP receiving terminals, a are the base of journal In the call number for the RTCP report that time interval is sequentially sent；

The delay jitter of the I frames is obtained by formula below：

D^I _jetter=D_{Ik_avg}-D_{a_avg}

Wherein, D^I _jetterFor the delay jitter of the I frames, D_{Ik_avg}For the I frames propagation delay time it is long-term smooth, D_{a_avg}For frame of video propagation delay time it is long-term smooth；

The D is obtained by formula below_{Ik_avg}：

Wherein,To carry out long-term smooth filtering factor to I frame effective transmissions time delay, span is [0.0,1.0], D_I(k-1)For the effective transmission time delay of -1 I frame of kth；

The long-term smooth of the propagation delay time of the frame of video is obtained by formula below：

Wherein,To carry out long-term smooth filtering factor to frame of video effective transmission time delay, span for [0.0, 1.0], D_a-1For the effective transmission time delay of a-1 second RTCP reports, D_aFor a-th second RTCP report etc. Imitate propagation delay time.

With reference to the first possible implementation of one side, in second of possible implementation, if in the presence of The first RTCP sender reports or the first RTCP receiving terminals report loss can not be calculated, then pass through formula below Obtain the D_Ik：

D_Ik=D_Max

Wherein, D_MaxFor defined maximum transmitted time delay；

If the 2nd RTCP sender reports or the 2nd RTCP receiving terminals report loss be present can not be calculated, The D is then obtained by formula below_a：

D_a=D_Max。

With reference to one side or any one above-mentioned possible implementation of one side, in the third possible reality In existing mode, the dithering threshold includes：First dithering threshold and the second dithering threshold；

If the delay jitter of the I frames is more than dithering threshold, the interval of increase adjacent I pin is encoded, including：

If the D^I _jetterMore than first dithering threshold, then the conversion of I frames is triggered, every an I frame, by next I Frame is converted to P frames or B frames are encoded, and often changes an I frame format, then adds 1 to accumulative conversion times m；

When the m values have reached M times, the M is the integer or the D more than or equal to 1^I _jetterIt is big continuous R times In second dithering threshold, then increase the interval of adjacent I frames, the R is the integer more than or equal to 1, second shake Threshold value is more than first dithering threshold；

Wherein, the interval of new adjacent I frames is obtained by below equation：

D_{Ist_new}=D_{Ist_old}+D_iststep

Wherein, D_{Ist_new}For the interval of the new adjacent I frames, D_{Ist_old}The I frame periods used for the last time, D_iststep The step-length changed for default I frame periods.

With reference to the third possible implementation of one side, in the 4th kind of possible implementation, D_{Ist_old}Just Initial value is D_{Ist_I}, D_{Ist_I}For the interval of the adjacent I frames of standard.

With reference to the third possible implementation of one side, in the 5th kind of possible implementation, if described D_{Ist_new}More than or equal to spacer maximum value, then the interval value of the new adjacent I frames is the spacer maximum value.

With reference to the third possible implementation of one side, in the 6th kind of possible implementation, in addition to：

If the accumulative conversion times m is not up to M times, and the D^I _jetterLess than or equal to first dithering threshold, Then stop I frame switching motions.

With reference to the third possible implementation of one side, in the 7th kind of possible implementation, in addition to：

If the D^I _jetterIt is less than or equal to second dithering threshold continuous R time, then reduction I frame periods；Wherein, newly The interval D of adjacent I frames_{Ist_new}Obtained by below equation：

D_{Ist_new}=D_{Ist_old}-D_iststep。

With reference to the 7th kind of possible implementation of one side, in the 8th kind of possible implementation, if described D_{Ist_new}The interval D of I frames adjacent less than or equal to standard_{Ist_I}, then the interval value of the new adjacent I frames is the D_{Ist_I}。

The second aspect of the invention is to provide a kind of I framing control method, including：

Receiving terminal receives a first real time transport control protocol RTCP sender report of transmitting terminal transmission, and described the One RTCP sender reports associate with I frames, and the first RTCP sender reports are identified as the special of corresponding I frames using special bit Report；

The receiving terminal sends the report of the first RTCP receiving terminals to the transmitting terminal, the first RTCP receiving terminals report with I frames associate, and the first RTCP receiving terminals report includes the first processing delay, and first processing delay is received for the receiving terminal The time delay of the first RTCP receiving terminals report is sent to the first RTCP sender reports to the receiving terminal；

The receiving terminal receives the 2nd RTCP sender reports that the transmitting terminal is sent based on RTCP report interval；

The receiving terminal is based on RTCP report interval and reported to the transmitting terminal the 2nd RTCP receiving terminals of transmission, and described second The report of RTCP receiving terminals includes second processing time delay, and the second processing time delay is that the receiving terminal receives the 2nd RTCP hairs Sending end report sends the time delay of the 2nd RTCP receiving terminals report to the receiving terminal.

The third aspect of the invention is to provide a kind of I framing control device, including：

Sending module, for sending an I frame real time transport protocol RTP bag, corresponding each I frames to receiving terminal every time RTP bags send the first real time transport control protocol RTCP sender reports, the first RTCP transmitting terminal reports to the receiving terminal Announcement associates with I frames, and the first RTCP sender reports are identified as the special report of corresponding I frames using special bit；

Receiving module, the first RTCP receiving terminals report sent for receiving the receiving terminal, the first RTCP are received End report associates with I frames, and the first RTCP receiving terminals report includes the first processing delay, and first processing delay is described Receiving terminal receives the time delay that first sender report sends the first receiving terminal report to the receiving terminal；

The sending module, it is additionally operable to send the 2nd RTCP transmitting terminal reports to the receiving terminal based on RTCP report interval Accuse；

The receiving module, it is additionally operable to receive the 2nd RTCP receiving terminals that the receiving terminal is sent based on RTCP report interval Report, the 2nd RTCP receiving terminals report include second processing time delay, and the second processing time delay is that the receiving terminal receives The 2nd RTCP sender reports send the time delay of the 2nd RTCP receiving terminals report to the receiving terminal；

Processing module, it is for recording the first time stamp, the second time stamp, the 3rd time stamp and the 4th time stamp, first time stamp At the time of the transmitting terminal sends the first RTCP sender reports, second time stamp be that the transmitting terminal receives described the One RTCP receiving terminals report at the time of, the 3rd time stamp be the transmitting terminal send the 2nd RTCP sender reports at the time of, At the time of 4th time stamp is that the transmitting terminal receives the 2nd RTCP receiving terminals report；

The processing module, it is additionally operable to according to first time stamp, second time stamp, the 3rd time stamp, described Four time stamps, first processing delay and the second processing time delay obtain the delay jitter of the I frames；

Adjusting module, if the delay jitter for the I frames is more than dithering threshold, the interval of increase adjacent I pin is carried out Coding.

With reference to the 3rd aspect, in the first possible implementation, the processing module, specifically for by following Formula obtains the effective transmission time delay of the I frames：

Wherein, D_IkFor the effective transmission time delay of k-th of I frame,The first RTCP is sent for the transmitting terminal First time stamp of sender report, the first RTCP sender reports are corresponding with n-th of RTP bag of k-th of I frames,The second time stamp of the first RTCP receiving terminals report, the first RTCP receiving terminals report are received for the transmitting terminal It is corresponding with n-th of RTP bag of k-th of I frames, DLSR_IknWhen being handled for the first RTCP receiving terminals report includes first Prolong, N decomposes corresponding RTP bag numbers by k-th of I frames, should be the integer more than or equal to 1, the span of the n For [1, N], k is the call number of the I frames of journal；

The processing module, specifically it is additionally operable to obtain the effective transmission time delay of frame of video by formula below：

Wherein, D_aFor the effective transmission time delay of rtp streaming data,For it is described based on time interval send described second 3rd time stamp corresponding to RTCP sender reports,To receive the 2nd RTCP receiving terminal reports based on time interval with described 4th time stamp corresponding to announcement, institute DLSR_aThe second processing time delay included for the report of standard RTCP receiving terminals, a are journal The call number of the RTCP report sequentially sent based on time interval；

The processing module, specifically it is additionally operable to obtain the delay jitter of the I frames by formula below：

D^I _jetter=D_{Ik_avg}-D_{a_avg}

Wherein, D^I _jetterFor the delay jitter of the I frames, D_{Ik_avg}For the I frames propagation delay time it is long-term smooth, D_{l_avg}For frame of video propagation delay time it is long-term smooth；

The processing module, specifically it is additionally operable to obtain the D by formula below_{Ik_avg}：

The processing module, the long-term of propagation delay time for being specifically additionally operable to obtain the frame of video by formula below are put down It is sliding：

With reference to the first possible implementation of the 3rd aspect, in second of possible implementation, the place Module is managed, if being specifically additionally operable to exist the first RTCP sender reports or the first RTCP receiving terminals report loss can not Calculated, then the D is obtained by formula below_Ik：

D_Ik=D_Max

Wherein, D_MaxFor defined maximum transmitted time delay；

The processing module, if being specifically additionally operable to have the 2nd RTCP sender reports or the 2nd RTCP receptions End report loss can not be calculated, then obtain the D by formula below_a：

D_a=D_Max。

With reference to the 3rd aspect or the 3rd any one above-mentioned possible implementation of aspect, in the third possible reality In existing mode, the dithering threshold includes：First dithering threshold and the second dithering threshold；

The adjusting module, if specifically for the D^I _jetterMore than first dithering threshold, then the conversion of I frames is triggered, Every an I frame, next I frames are converted into P frames or B frames are encoded, and often change an I frame format, then to accumulative Conversion times m adds 1；

The adjusting module, specifically for being had reached M times when the m values, the M be integer more than or equal to 1 or D described in person^I _jetterBe more than second dithering threshold continuous R time, then increase the interval of adjacent I frames, the R for more than or equal to 1 integer, second dithering threshold are more than first dithering threshold；

The processing module is additionally operable to obtain the interval of new adjacent I frames by below equation：

D_{Ist_new}=D_{Ist_old}+D_iststep

With reference to the third possible implementation of the 3rd aspect, in the 4th kind of possible implementation, D_{Ist_old}Just Initial value is D_{Ist_I}, D_{Ist_I}For the interval of the adjacent I frames of standard.

With reference to the third possible implementation of the 3rd aspect, in the 5th kind of possible implementation, the adjustment Module, if being specifically additionally operable to the D_{Ist_new}More than or equal to spacer maximum value, then the interval value of the new adjacent I frames is institute State spacer maximum value.

With reference to the third possible implementation of the 3rd aspect, in the 6th kind of possible implementation, the adjustment Module, it is not up to M times if being additionally operable to the accumulative conversion times m, and the D^I _jetterLess than or equal to the described first shake threshold Value, then stop I frame switching motions.

With reference to the third possible implementation of the 3rd aspect, in the 7th kind of possible implementation, the adjustment Module, if being additionally operable to the D^I _jetterIt is less than or equal to second dithering threshold continuous R time, then reduction I frame periods；

The processing module is additionally operable to obtain the interval D of new adjacent I frames by below equation_{Ist_new}：

D_{Ist_new}=D_{Ist_old}-D_iststep。

With reference to the 7th kind of possible implementation of the 3rd aspect, in the 8th kind of possible implementation, the adjustment Module, if being specifically additionally operable to the D_{Ist_new}The interval D of I frames adjacent less than or equal to standard_{Ist_I}, then the new adjacent I frames Interval value is the D_{Ist_I}。

The fourth aspect of the invention is to provide a kind of I framing control device, including：

Receiving module, for receiving a first real time transport control protocol RTCP transmitting terminal report of transmitting terminal transmission Accuse, the first RTCP sender reports are associated with I frames, and the first RTCP sender reports are identified as correspondingly using special bit The special report of I frames；

Sending module, for sending the report of the first RTCP receiving terminals, the first RTCP receiving terminal reports to the transmitting terminal Announcement associates with I frames, and the first RTCP receiving terminals report includes the first processing delay, and first processing delay is the reception End receives the time delay that the first RTCP sender reports send the first RTCP receiving terminals report to the receiving terminal；

The receiving module, it is additionally operable to receive the 2nd RTCP transmitting terminals that the transmitting terminal is sent based on RTCP report interval Report；

The sending module, it is additionally operable to send the 2nd RTCP receiving terminal reports to the transmitting terminal based on RTCP report interval Accuse, the 2nd RTCP receiving terminals report includes second processing time delay, and the second processing time delay receives institute for the receiving terminal State the time delay that the 2nd RTCP sender reports send the 2nd RTCP receiving terminals report to the receiving terminal.

The fifth aspect of the invention is to provide a kind of I framing control system, including：Above-mentioned 3rd aspect or the 3rd side The I framing control devices described in I framing control device, above-mentioned 4th aspect described in any one possible implementation of face.

The I framing control method, apparatus and system that the present embodiment provides, by sending an I frame RTP bag to receiving terminal every time While, transmitting terminal sends the first RTCP sender reports associated with I frames for each I frames RTP bags to receiving terminal, and receives The first RTCP receiving terminals report that receiving end is sent, the report of the first RTCP receiving terminals include the first processing delay, the first processing delay The first sender report is received to the time delay of receiving terminal transmission the first receiving terminal report for receiving terminal.Also, transmitting terminal will also be to Receiving terminal sends the 2nd RTCP sender reports, and receives the 2nd RTCP receiving terminals report of receiving terminal transmission, and the 2nd RTCP connects Receiving end report includes second processing time delay, and second processing time delay is that receiving terminal receives the 2nd RTCP sender reports to receiving terminal hair The time delay for sending the 2nd RTCP receiving terminals to report.Further, transmitting terminal records the first time stamp, the second time stamp, the 3rd time stamp and the Four time stamps, the first time stamp be transmitting terminal send the first RTCP sender reports at the time of, the second time stamp be that transmitting terminal receives first RTCP receiving terminals report at the time of, the 3rd time stamp be transmitting terminal send the 2nd RTCP sender reports at the time of, the 4th time stamp be At the time of transmitting terminal receives the report of the 2nd RTCP receiving terminals.Transmitting terminal is according to the first time stamp, the second time stamp, the 3rd time stamp, the 4th Time stamp, the first processing delay and second processing time delay obtain the delay jitter of I frames, if the delay jitter of I frames is more than dithering threshold, The interval for then increasing adjacent I frame is encoded.It is achieved thereby that the shake according to I frames carries out the adjustment of I frame periods, so as to protect While demonstrate,proving video data stream decoding quality, avoid because I dither frames are uneven and cause the phenomenon of video cardton.

Brief description of the drawings

Fig. 1 is a kind of I framing control method flow schematic diagram provided in an embodiment of the present invention；

Fig. 2 is a kind of I framing control method schematic diagram provided in an embodiment of the present invention；

Fig. 3 is a kind of I framing control apparatus structure schematic diagram provided in an embodiment of the present invention；

Fig. 4 is a kind of I framing control apparatus structure schematic diagram provided in an embodiment of the present invention；

Fig. 5 is a kind of I framing control system schematic provided in an embodiment of the present invention.

Embodiment

In scene is monitored, there can be the scene change of interframe because video pictures are different from film or television image, So monitor between the consecutive frame of scene there can be certain correlation in time, so being set to for I frames is larger Interval will not produce considerable influence to video quality, in addition, in scene is monitored, if there is scene switching in picture, the P brought The larger situation of frame code check, in such cases video cardton phenomenon do not allow perceptible yet, it is possible to using the side at increase I intervals Formula alleviates video cardton, or the code check that can be carried according to channel, the interval that adjustment I frames occur, or switching to I frames P frames.

But if there was only P frames or B frames for a long time, video coding parameter may be unstable, will influence coding quality, In order to obtain the balance between video quality and I frame periods, I frame period settings can be carried out according to the delay variation of I frame data, The interim card brought due to I frame propagation delay times is reduced as far as possible, and the scheme for adjusting I frame periods is said below by specific embodiment It is bright：

Fig. 1 is a kind of I framing control method flow schematic diagram provided in an embodiment of the present invention, as shown in figure 1, the executive agent For the transmitting terminal of video data stream.This method comprises the following steps：

Step 100, transmitting terminal send an I frame real time transport protocols (Real-timeTransport to receiving terminal every time Protocol, referred to as：RTP) wrap, corresponding each I frames RTP bags send the first real time transport control protocol (Real- to receiving terminal Time Transport Control Protocol, referred to as：RTCP) sender report, the first RTCP sender reports and I frames Association, the first RTCP sender reports are identified as the special report of corresponding I frames using special bit.

Specifically, transmitting terminal during the RTP bags of I frames, may once send out a RTP bag, it is also possible to simultaneously when sending data Send it is multiple, when sending RTP bags every time, first RTCP sender report of corresponding transmission.

First RTCP sender reports identify：" profile-specific extensions ", high 16 definition are solid for utilization Definite value, such as 1010, are not repeated, and can not be invalid value with real profile-specific extensions values.Least-significant byte For indicating that this first RTCP sender report is the special RTCP report that corresponding I frames are sent.

Step 101, transmitting terminal receive receiving terminal send the first RTCP receiving terminals report, the first RTCP receiving terminals report with I frames associate, and the report of the first RTCP receiving terminals includes the first processing delay, and the first processing delay is that receiving terminal receives the first transmitting terminal Report that receiving terminal sends the time delay of the first receiving terminal report.

Specifically, the first RTCP sender reports synchronously sent when sending data every time, therefore the first RTCP transmitting terminals The transmission time of the transmission time Approximate Equivalent data of report.The time delay of data can be assessed by the loopback of report.

Step 102, transmitting terminal are based on RTCP report interval and send the 2nd RTCP sender reports to receiving terminal.

It should be noted that the 2nd RTCP sender reports do not associate with I frames.

Step 103, transmitting terminal are received receiving terminal and reported based on the 2nd RTCP receiving terminals that RTCP report interval is sent, and second The report of RTCP receiving terminals include second processing time delay, and second processing time delay receives the 2nd RTCP sender reports to connecing for receiving terminal Receiving end sends the time delay of the 2nd RTCP receiving terminals report.

Step 104, transmitting terminal record the first time stamp, the second time stamp, the 3rd time stamp and the 4th time stamp, and the first time stamp is transmission End send the first RTCP sender reports at the time of, the second time stamp be transmitting terminal receive the first RTCP receiving terminals report at the time of, 3rd time stamp be transmitting terminal send the 2nd RTCP sender reports at the time of, the 4th time stamp be transmitting terminal receive the 2nd RTCP reception At the time of the report of end.

Step 105, transmitting terminal according to the first time stamp, the second time stamp, the 3rd time stamp, the 4th time stamp, the first processing delay and Second processing time delay obtains the delay jitter of I frames.

If the delay jitter of step 106, I frames is more than dithering threshold, the interval of increase adjacent I pin is encoded.

The present embodiment provide I framing control methods, by every time to receiving terminal send an I frame RTP bag while, transmission End sends the first RTCP sender reports associated with I frames for each I frames RTP bags to receiving terminal, and receives receiving end transmission First RTCP receiving terminals report that the report of the first RTCP receiving terminals includes the first processing delay, and the first processing delay is received for receiving terminal The time delay of the first receiving terminal report is sent to the first sender report to receiving terminal.Also, transmitting terminal will also be sent to receiving terminal 2nd RTCP sender reports, and the 2nd RTCP receiving terminals report of receiving terminal transmission is received, the 2nd RTCP receiving terminals report bag Time delay containing second processing, second processing time delay are that receiving terminal receives the 2nd RTCP sender reports to the 2nd RTCP of receiving terminal transmission The time delay of receiving terminal report.Further, the first time stamp of transmitting terminal record, the second time stamp, the 3rd time stamp and the 4th time stamp, first Time stamp be transmitting terminal send the first RTCP sender reports at the time of, the second time stamp be that transmitting terminal receives the first RTCP receiving terminal reports At the time of announcement, the 3rd time stamp at the time of be that transmitting terminal sends the 2nd RTCP sender reports, the 4th time stamp be that transmitting terminal receives the At the time of two RTCP receiving terminals are reported.Transmitting terminal is according to the first time stamp, the second time stamp, the 3rd time stamp, the 4th time stamp, the first processing Time delay and second processing time delay obtain the delay jitter of I frames, if the delay jitter of I frames is more than dithering threshold, increase adjacent I frame Interval encoded.It is achieved thereby that the shake according to I frames carries out the adjustment of I frame periods, so as to ensure video data stream While decoding quality, avoid because I dither frames are uneven and cause the phenomenon of video cardton.

Preferably, a kind of feasible implementation of the step 105 in Fig. 1 is：

The effective transmission time delay of I frames is obtained by formula below：

Wherein, D_IkFor the effective transmission time delay of k-th of I frame,The first RTCP sender reports are sent for transmitting terminal The first time stamp, the first RTCP sender reports are corresponding with n-th of RTP bag of k-th of I frame,The is received for transmitting terminal Second time stamp of one RTCP receiving terminals report, the report of the first RTCP receiving terminals is corresponding with n-th of RTP bag of k-th of I frame, DLSR_IknThe first processing delay included for the report of the first RTCP receiving terminals, N decompose corresponding RTP bag numbers by k-th of I frame Mesh, the integer more than or equal to 1 is should be, n span is [1, N], and k is the call number of the I frames of journal.

Wherein, D_aFor the effective transmission time delay of rtp streaming data,The 2nd RTCP to be sent based on time interval is sent 3rd time stamp corresponding to the report of end,During for receiving the 2nd RTCP receiving terminals report the corresponding 4th based on time interval Stamp, DLSR_aFor the second processing time delay that includes of standard RTCP receiving terminals report, a be journal based on time interval sequentially The call number of the RTCP report of transmission.

The delay jitter of I frames is obtained by formula below：

D^I _jetter=D_{Ik_avg}-D_{a_avg}

Wherein, D^I _jetterFor the delay jitter of I frames, D_{Ik_avg}For long-term smooth, the D of the propagation delay time of I frames_{a_avg}For video The propagation delay time of frame it is long-term smooth.

D is obtained by formula below_{Ik_avg}：

Wherein,To carry out long-term smooth filtering factor to I frame effective transmissions time delay, span is [0.0,1.0], Can based on experience value or simulation value set, only consider that the delay character of this I frame value can be set to 0.0.D_I(k-1)For -1 I of kth The effective transmission time delay of frame.

The long-term smooth of the propagation delay time of frame of video is obtained by formula below：

Wherein,To carry out long-term smooth filtering factor to frame of video effective transmission time delay, span for [0.0, 1.0], D_a-1For the effective transmission time delay of a-1 the second RTCP reports, D_aFor a-th second RTCP reports effective transmission when Prolong.

Further, if for that can not be carried out in the presence of the first RTCP sender reports or the first RTCP receiving terminals report loss The scene of calculating, then obtain D by formula below_Ik：

D_Ik=D_Max

Wherein, D_Max, can based on experience value or simulation value configuration for defined maximum transmitted time delay.

If for losing the field that can not be calculated in the presence of the 2nd RTCP sender reports or the report of the 2nd RTCP receiving terminals Scape, then D is obtained by formula below_a：

D_a=D_Max。

Preferably, the dithering threshold in above-described embodiment includes：First dithering threshold and the second dithering threshold.

Also, for Fig. 1 steps 106, a kind of possible implementation is：

When I frames propagation delay time continues larger, it is believed that current signal condition can not be adapted to, it is necessary to carry out I frame period tune Whole, the adjustment of I frame periods has following two ways, can use or use simultaneously one:

Mode one：If D^I _jetterMore than the first dithering threshold, then the conversion of I frames is triggered, every an I frame, by next I frames Be converted to P frames or B frames are encoded, and often change an I frame format, then 1 is added to accumulative conversion times m.

Mode two：When m values have reached M times, M is the integer or D more than or equal to 1^I _jetterContinuous R times more than second Dithering threshold, then increase the interval of adjacent I frames, R is the integer more than or equal to 1, and the second dithering threshold is more than the first shake threshold Value.

Wherein, the interval of new adjacent I frames is obtained by below equation：

D_{Ist_new}=D_{Ist_old}+D_iststep

Wherein, D_{Ist_new}For the interval of new adjacent I frames, D_{Ist_old}The I frame periods used for the last time, D_iststepTo be pre- If I frame periods change step-length.

If specifically, D_{Ist_new}More than or equal to spacer maximum value, then the interval value of new adjacent I frames is maximum for interval Value.

It should be noted that D_{Ist_old}Initial value be D_{Ist_I}, D_{Ist_I}For the interval of the adjacent I frames of standard, and continue more New D_{Ist_old}=D_{Ist_new}。

Further, if accumulative conversion times m is not up to M times, and D^I _jetterLess than or equal to the first dithering threshold, then stop Only I frames switching motion.

If D^I _jetterIt is less than or equal to the second dithering threshold continuous R time, then reduction I frame periods；Wherein, new adjacent I frames Interval D_{Ist_new}Obtained by below equation：

D_{Ist_new}=D_{Ist_old}-D_iststep。

If specifically, D_{Ist_new}The interval D of I frames adjacent less than or equal to standard_{Ist_I}, then the interval value of new adjacent I frames For D_{Ist_I}。

It should be noted that after above-mentioned I frame periods are calculated in transmitting terminal, corresponding I frame periods are delivered to encoder, Adjust encoder coding output.And using a nearest I frame as starting point, the interval of new I frames is redefined, and corresponding frame Type configuration is I frames.

Fig. 2 is a kind of I framing control method schematic diagram provided in an embodiment of the present invention, and the executive agent is video data stream Receiving terminal.This method comprises the following steps：

Step 200, receiving terminal receive a first RTCP sender report of transmitting terminal transmission, the first RTCP transmitting terminals Report associates with I frames, and the first RTCP sender reports are identified as the special report of corresponding I frames using special bit.

Step 201, receiving terminal send the report of the first RTCP receiving terminals, the report of the first RTCP receiving terminals and I frames to transmitting terminal Association, the report of the first RTCP receiving terminals include the first processing delay, and the first processing delay is that receiving terminal receives the first RTCP transmissions End report sends the time delay of the first RTCP receiving terminals report to receiving terminal.

Receiving terminal receives the first RTCP sender reports, then often receives a first RTCP sender report, that is, reply One the first RTCP receiving terminals report.First RTCP receiving terminals report need one it is corresponding with the first RTCP sender reports Mark.

The 2nd RTCP sender reports that step 202, receiving terminal receiving end/sending end are sent based on RTCP report interval.

Step 203, receiving terminal are based on RTCP report interval and send the report of the 2nd RTCP receiving terminals, the 2nd RTCP to transmitting terminal Receiving terminal report includes second processing time delay, and second processing time delay is that receiving terminal receives the 2nd RTCP sender reports to receiving terminal Send the time delay of the 2nd RTCP receiving terminals report.

The present embodiment provide I framing control methods, by every time to receiving terminal send an I frame RTP bag while, reception Hold receiving end/sending end to be directed to the first RTCP sender reports associated with I frames that each I frames RTP bags are sent, and sent out to transmitting terminal The first RTCP receiving terminals are sent to report, the report of the first RTCP receiving terminals includes the first processing delay, and the first processing delay is receiving terminal Receive the time delay that the first sender report sends the report of the first receiving terminal to receiving terminal.Also, receiving terminal also wants receiving end/sending end The 2nd RTCP sender reports sent, and send the report of the 2nd RTCP receiving terminals, the report of the 2nd RTCP receiving terminals to transmitting terminal Comprising second processing time delay, second processing time delay is that receiving terminal receives the 2nd RTCP sender reports to receiving terminal transmission second The time delay of RTCP receiving terminals report.So that the first time stamp of transmitting terminal record, the second time stamp, the 3rd time stamp and the 4th time stamp, first Time stamp be transmitting terminal send the first RTCP sender reports at the time of, the second time stamp be that transmitting terminal receives the first RTCP receiving terminal reports At the time of announcement, the 3rd time stamp at the time of be that transmitting terminal sends the 2nd RTCP sender reports, the 4th time stamp be that transmitting terminal receives the At the time of two RTCP receiving terminals are reported, and according to the first time stamp, the second time stamp, the 3rd time stamp, the 4th time stamp, the first processing delay The delay jitter of I frames is obtained with second processing time delay, if the delay jitter of I frames is more than dithering threshold, between increase adjacent I frame Every being encoded.It is achieved thereby that the shake according to I frames carries out the adjustment of I frame periods, so as to ensure video data stream decoding While quality, avoid because I dither frames are uneven and cause the phenomenon of video cardton.

Fig. 3 is a kind of I framing control apparatus structure schematic diagram provided in an embodiment of the present invention, and the I framing control devices are arranged at On transmitting terminal, the I framing control devices include：Sending module 10, receiving module 11, processing module 12, adjusting module 13.

Sending module 10, for sending an I frame RTP bag to receiving terminal every time, each I frames RTP bags are corresponded to receiving terminal The first RTCP sender reports are sent, the first RTCP sender reports associate with I frames, and the first RTCP sender reports are using special Bit identification is the special report of corresponding I frames.

Receiving module 11, for receiving the first RTCP receiving terminals report of receiving terminal transmission, the report of the first RTCP receiving terminals Associated with I frames, the report of the first RTCP receiving terminals includes the first processing delay, and the first processing delay is that receiving terminal receives the first transmission End report sends the time delay of the first receiving terminal report to receiving terminal.

Sending module 10, it is additionally operable to send the 2nd RTCP sender reports to receiving terminal based on RTCP report interval.

Receiving module 11, it is additionally operable to receive the 2nd RTCP receiving terminals report that receiving terminal is sent based on RTCP report interval, The report of 2nd RTCP receiving terminals includes second processing time delay, and second processing time delay is that receiving terminal receives the 2nd RTCP sender reports The time delay of the 2nd RTCP receiving terminals report is sent to receiving terminal.

Processing module 12, for recording the first time stamp, the second time stamp, the 3rd time stamp and the 4th time stamp, the first time stamp is hair Sending end send the first RTCP sender reports at the time of, the second time stamp be transmitting terminal receive the first RTCP receiving terminals report when Carve, the 3rd time stamp be transmitting terminal send the 2nd RTCP sender reports at the time of, the 4th time stamp be that transmitting terminal receives the 2nd RTCP At the time of receiving terminal is reported.

Processing module 12, it is additionally operable to according to the first time stamp, the second time stamp, the 3rd time stamp, the 4th time stamp, the first processing delay The delay jitter of I frames is obtained with second processing time delay.

Adjusting module 13, if the delay jitter for I frames is more than dithering threshold, the interval of increase adjacent I pin is compiled Code.

The present embodiment provide I framing control methods, by every time to receiving terminal send an I frame RTP bag while, transmission Module sends the first RTCP sender reports associated with I frames for each I frames RTP bags to receiving terminal, and receiving module, which receives, to be received The first RTCP receiving terminals report that end is sent, the report of the first RTCP receiving terminals include the first processing delay, and the first processing delay is Receiving terminal receives the time delay that the first sender report sends the report of the first receiving terminal to receiving terminal.Also, sending module will also be to Receiving terminal sends the 2nd RTCP sender reports, and receiving module receives the 2nd RTCP receiving terminals that receiving terminal is sent and reported, and second The report of RTCP receiving terminals include second processing time delay, and second processing time delay receives the 2nd RTCP sender reports to connecing for receiving terminal Receiving end sends the time delay of the 2nd RTCP receiving terminals report.Further, processing module records the first time stamp, the second time stamp, the 3rd Time stamp and the 4th time stamp, the first time stamp be transmitting terminal send the first RTCP sender reports at the time of, the second time stamp be transmitting terminal At the time of receiving the report of the first RTCP receiving terminals, the 3rd time stamp at the time of be that transmitting terminal sends the 2nd RTCP sender reports, the At the time of four time stamps are that transmitting terminal receives the report of the 2nd RTCP receiving terminals.Processing module is according to the first time stamp, the second time stamp, the 3rd Time stamp, the 4th time stamp, the first processing delay and second processing time delay obtain the delay jitter of I frames, if the delay jitter of I frames is more than Dithering threshold, then adjusting module increase adjacent I frame interval encoded.It is achieved thereby that the shake according to I frames carries out I interframe Every adjustment, so as to while video data stream decoding quality is ensured, avoid because I dither frames are uneven and cause video The phenomenon of interim card.

Further, processing module 12, the effective transmission time delay specifically for obtaining I frames by formula below：

Wherein, D_IkFor the effective transmission time delay of k-th of I frame,The first RTCP transmitting terminal reports are sent for transmitting terminal The first time stamp accused, the first RTCP sender reports are corresponding with n-th of RTP bag of k-th of I frame,Received for transmitting terminal Second time stamp of the first RTCP receiving terminals report, the report of the first RTCP receiving terminals is corresponding with n-th of RTP bag of k-th of I frame, DLSR_IknThe first processing delay included for the report of the first RTCP receiving terminals, N decompose corresponding RTP bag numbers by k-th of I frame Mesh, the integer more than or equal to 1 is should be, n span is [1, N], and k is the call number of the I frames of journal.

Processing module 12, specifically it is additionally operable to obtain the effective transmission time delay of frame of video by formula below：

Processing module 12, specifically it is additionally operable to obtain the delay jitter of I frames by formula below：

D^I _jetter=D_{Ik_avg}-D_{a_avg}

Processing module 12, specifically it is additionally operable to obtain D by formula below_{Ik_avg}：

Wherein,To carry out long-term smooth filtering factor to I frame effective transmissions time delay, span is [0.0,1.0], D_I(k-1)For the effective transmission time delay of -1 I frame of kth.

Processing module 12, be specifically additionally operable to by formula below obtain frame of video propagation delay time it is long-term smooth：

Preferably, processing module 12, if being specifically additionally operable in the presence of the first RTCP sender reports or the first RTCP receiving terminals Report loss can not be calculated, then obtain D by formula below_Ik：

D_Ik=D_Max

Wherein, D_MaxFor defined maximum transmitted time delay.

Processing module 12, if being specifically additionally operable to lose in the presence of the 2nd RTCP sender reports or the report of the 2nd RTCP receiving terminals It can not be calculated, then D be obtained by formula below_a：

D_a=D_Max。

Further, dithering threshold includes：First dithering threshold and the second dithering threshold.

Thus, adjusting module 13, if specifically for D^I _jetterMore than the first dithering threshold, then the conversion of I frames, Mei Geyi are triggered Individual I frames, next I frames are converted into P frames or B frames are encoded, and often change an I frame format, then to accumulative conversion time Number m adds 1.

Adjusting module 13, specifically for being had reached M times when m values, M is the integer or D more than or equal to 1^I _jetterEven Continue R times and be more than the second dithering threshold, then increase the interval of adjacent I frames, R is the integer more than or equal to 1, and the second dithering threshold is big In the first dithering threshold.

Processing module 12, it is additionally operable to obtain the interval of new adjacent I frames by below equation：

D_{Ist_new}=D_{Ist_old}+D_iststep

Wherein, D_{Ist_new}For the interval of the first adjacent I frames, D_{Ist_old}The I frame periods used for the last time, D_iststepTo be pre- If I frame periods change step-length.

It should be noted that D_{Ist_old}Initial value be D_{Ist_I}, D_{Ist_I}For the interval of the adjacent I frames of standard.

Preferably, adjusting module 13, if being specifically additionally operable to D_{Ist_new}More than or equal to spacer maximum value, then new adjacent I frames Interval value be spacer maximum value.

Further, adjusting module 13, it is not up to M times if being additionally operable to accumulative conversion times m, and D^I _jetterIt is less than or equal to First dithering threshold, then stop I frame switching motions.

Further, adjusting module 13, if being additionally operable to D^I _jetterIt is less than or equal to the second dithering threshold continuous R times, then subtracts Few I frame periods；

Processing module 12 is additionally operable to obtain the interval D of new adjacent I frames by below equation_{Ist_new}：

D_{Ist_new}=D_{Ist_old}-D_iststep。

Preferably, adjusting module 13, if being specifically additionally operable to D_{Ist_new}The interval D of I frames adjacent less than or equal to standard_{Ist_I}, then The interval value of new adjacent I frames is D_{Ist_I}。

Fig. 4 is a kind of I framing control apparatus structure schematic diagram provided in an embodiment of the present invention, and the I framing control devices are arranged at Receiving terminal, the I framing control devices include：Receiving module 20, sending module 21.

Receiving module 20, for receiving a first RTCP sender report of transmitting terminal transmission, the first RTCP is sent End report associates with I frames, and the first RTCP sender reports are identified as the special report of corresponding I frames using special bit.

Sending module 21, for sending the report of the first RTCP receiving terminals, the report of the first RTCP receiving terminals and I frames to transmitting terminal Association, the report of the first RTCP receiving terminals include the first processing delay, and the first processing delay is that receiving terminal receives the first RTCP transmissions End report sends the time delay of the first RTCP receiving terminals report to receiving terminal.

Receiving module 20, it is additionally operable to the 2nd RTCP sender reports that receiving end/sending end is sent based on RTCP report interval.

Sending module 21, it is additionally operable to report to transmitting terminal the 2nd RTCP receiving terminals of transmission based on RTCP report interval, second The report of RTCP receiving terminals include second processing time delay, and second processing time delay receives the 2nd RTCP sender reports to connecing for receiving terminal Receiving end sends the time delay of the 2nd RTCP receiving terminals report.

The present embodiment provide I framing control methods, by every time to receiving terminal send an I frame RTP bag while, reception Module receiving end/sending end for each I frames RTP bags transmission the first RTCP sender reports associated with I frames, sending module to Transmitting terminal sends the report of the first RTCP receiving terminals, and the report of the first RTCP receiving terminals includes the first processing delay, the first processing delay The first sender report is received to the time delay of receiving terminal transmission the first receiving terminal report for receiving terminal.Also, receiving module will also The 2nd RTCP sender reports that receiving end/sending end is sent, sending module send the report of the 2nd RTCP receiving terminals to transmitting terminal, the The report of two RTCP receiving terminals includes second processing time delay, and second processing time delay receives the 2nd RTCP sender reports for receiving terminal and arrived Receiving terminal sends the time delay of the 2nd RTCP receiving terminals report.So that transmitting terminal record the first time stamp, the second time stamp, the 3rd time stamp and At the time of 4th time stamp, the first time stamp are that transmitting terminal sends the first RTCP sender reports, the second time stamp be that transmitting terminal receives the One RTCP receiving terminals report at the time of, the 3rd time stamp be transmitting terminal send the 2nd RTCP sender reports at the time of, the 4th time stamp At the time of the report of the 2nd RTCP receiving terminals being received for transmitting terminal, and during according to the first time stamp, the second time stamp, the 3rd time stamp, the 4th Stamp, the first processing delay and second processing time delay obtain the delay jitter of I frames, if the delay jitter of I frames is more than dithering threshold, The interval of increase adjacent I frame is encoded.It is achieved thereby that the shake according to I frames carries out the adjustment of I frame periods, so as to ensure While video data stream decoding quality, avoid because I dither frames are uneven and cause the phenomenon of video cardton.

Fig. 5 is a kind of I framing control system schematic provided in an embodiment of the present invention, and the system includes：It is above-mentioned to be arranged at hair The I framing control device of sending end and the above-mentioned I framing control devices for being arranged at receiving terminal.Specifically, reference picture 5, the adjustment of transmitting terminal Module 13 is connected by the video coding layer of transmitting terminal with sending module 10.Wherein, the sending module 10 of transmitting terminal is sending RTP Bag, sender report (sender report can be the first sender report or the second sender report)；Receiving module 11 exists The receiving terminal for receiving the transmission of sending module 21 of receiving terminal reports that (receiving terminal report can be the report of the first receiving terminal or second Receiving terminal is reported) while, sending module 10 and receiving module 11 can send I dither frame parameters, the I frames to processing module 12 Jitter parameter includes described above：First time stamp, the second time stamp, the 3rd time stamp, the 4th time stamp, at the first processing delay and second Manage time delay.Processing module 12 is according to the I dither frames reference record I dither frame parameters, and according to the first time stamp, the second time stamp, Three time stamps, the 4th time stamp, the first processing delay and second processing time delay obtain the delay jitter of I frames.If the delay jitter of I frames is big In dithering threshold, adjusting module 13 increases the interval of adjacent I frame, the configuration of I frame periods is adjusted, and notify transmitting terminal video The encoder of coding layer encodes according to new I frame periods to video data, and is sent to receiving terminal by sending module 10 Receiving module 20.It is achieved thereby that the shake according to I frames carries out the adjustment of I frame periods, so as to ensure video data stream decoding While quality, avoid because I dither frames are uneven and cause the phenomenon of video cardton.

One of ordinary skill in the art will appreciate that：Realizing all or part of step of above-mentioned each method embodiment can lead to The related hardware of programmed instruction is crossed to complete.Foregoing program can be stored in a computer read/write memory medium.The journey Sequence upon execution, execution the step of including above-mentioned each method embodiment；And foregoing storage medium includes：ROM, RAM, magnetic disc or Person's CD etc. is various can be with the medium of store program codes.

Finally it should be noted that：Various embodiments above is merely illustrative of the technical solution of the present invention, rather than its limitations；To the greatest extent The present invention is described in detail with reference to foregoing embodiments for pipe, it will be understood by those within the art that：Its according to The technical scheme described in foregoing embodiments can so be modified, either which part or all technical characteristic are entered Row equivalent substitution；And these modifications or replacement, the essence of appropriate technical solution is departed from various embodiments of the present invention technology The scope of scheme.

Claims

1. a kind of I framing control method, the transmitting terminal applied to video data stream, it is characterised in that including：

Transmitting terminal sends an I frame real time transport protocol RTP bag to receiving terminal every time, and corresponding each I frames RTP bags are to described Receiving terminal sends the first real time transport control protocol RTCP sender reports, and the first RTCP sender reports associate with I frames, The first RTCP sender reports are identified as the special report of corresponding I frames using special bit；

The transmitting terminal receives the first RTCP receiving terminals report that the receiving terminal is sent, the first RTCP receiving terminals report with I frames associate, and the first RTCP receiving terminals report includes the first processing delay, and first processing delay is received for the receiving terminal The time delay of the first RTCP receiving terminals report is sent to the first RTCP sender reports to the receiving terminal；

The transmitting terminal is received the receiving terminal and reported based on the 2nd RTCP receiving terminals that RTCP report interval is sent, and described second The report of RTCP receiving terminals includes second processing time delay, and the second processing time delay is that the receiving terminal receives the 2nd RTCP hairs Sending end report sends the time delay of the 2nd RTCP receiving terminals report to the receiving terminal；

It is the transmission that the transmitting terminal, which records the first time stamp, the second time stamp, the 3rd time stamp and the 4th time stamp, first time stamp, Hold at the time of transmission the first RTCP sender reports, second time stamp receives the first RTCP for the transmitting terminal and connect Receiving end report at the time of, the 3rd time stamp be the transmitting terminal send the 2nd RTCP sender reports at the time of, the described 4th At the time of time stamp is that the transmitting terminal receives the 2nd RTCP receiving terminals report；

The transmitting terminal is according to first time stamp, second time stamp, the 3rd time stamp, the 4th time stamp, described One processing delay and the second processing time delay obtain the delay jitter of the I frames；

If the delay jitter of the I frames is more than dithering threshold, the interval of increase adjacent I pin is encoded；

Wherein, the transmitting terminal obtains prolonging for the I frames according to first time stamp, second time stamp and the processing delay When shake, including：

<mrow> <msub> <mi>D</mi> <mrow> <mi>I</mi> <mi>k</mi> </mrow> </msub> <mo>=</mo> <mrow> <mo>(</mo> <munderover> <mo>&Sigma;</mo> <mrow> <mi>n</mi> <mo>=</mo> <mn>1</mn> </mrow> <mi>N</mi> </munderover> <mfrac> <mrow> <msub> <mi>T</mi> <mrow> <msub> <mi>RR</mi> <mrow> <mi>s</mi> <mi>n</mi> </mrow> </msub> <mi>I</mi> <mi>k</mi> <mi>n</mi> </mrow> </msub> <mo>-</mo> <msub> <mi>T</mi> <mrow> <msub> <mi>SR</mi> <mrow> <mi>s</mi> <mi>n</mi> </mrow> </msub> <mi>I</mi> <mi>k</mi> <mi>n</mi> </mrow> </msub> <mo>-</mo> <msub> <mi>DLSR</mi> <mrow> <mi>I</mi> <mi>k</mi> <mi>n</mi> </mrow> </msub> </mrow> <mn>2</mn> </mfrac> <mo>)</mo> </mrow> <mo>&divide;</mo> <mi>N</mi> </mrow>

Wherein, D_IkFor the effective transmission time delay of k-th of I frame,The first RTCP transmitting terminals are sent for the transmitting terminal First time stamp of report, the first RTCP sender reports are corresponding with n-th of RTP bag of k-th of I frames,For The transmitting terminal receives the second time stamp of the first RTCP receiving terminals report, the first RTCP receiving terminals report and described the N-th of RTP bag of k I frame is corresponding, DLSR_IknThe first processing delay included for the first RTCP receiving terminals report, N is institute To state k-th of I frame and decompose corresponding RTP bag numbers, should be the integer more than or equal to 1, the span of the n is [1, N], K is the call number of the I frames of journal；

Wherein, D_aFor the effective transmission time delay of rtp streaming data,For the 2nd RTCP sent based on time interval 3rd time stamp corresponding to sender report,To receive the 2nd RTCP receiving terminals report pair based on time interval with described The 4th time stamp answered, DLSR_aFor the second processing time delay that includes of standard RTCP receiving terminals report, a be journal based on when Between be spaced the call number of the RTCP report sequentially sent；

The delay jitter of the I frames is obtained by formula below：

D^I _jetter=D_{Ik_avg}-D_{a_avg}

Wherein, D^I _jetterFor the delay jitter of the I frames, D_{Ik_avg}For long-term smooth, the D of the propagation delay time of the I frames_{a_avg}For The propagation delay time of frame of video it is long-term smooth；

The D is obtained by formula below_{Ik_avg}：

<mrow> <msub> <mi>D</mi> <mrow> <mi>I</mi> <mi>k</mi> <mo>_</mo> <mi>a</mi> <mi>v</mi> <mi>g</mi> </mrow> </msub> <mo>=</mo> <msub> <mo>&part;</mo> <mn>1</mn> </msub> <mo>&times;</mo> <msub> <mi>D</mi> <mrow> <mi>I</mi> <mrow> <mo>(</mo> <mi>k</mi> <mo>-</mo> <mn>1</mn> <mo>)</mo> </mrow> </mrow> </msub> <mo>+</mo> <mrow> <mo>(</mo> <mn>1</mn> <mo>-</mo> <msub> <mo>&part;</mo> <mn>1</mn> </msub> <mo>)</mo> </mrow> <msub> <mi>D</mi> <mrow> <mi>I</mi> <mi>k</mi> </mrow> </msub> </mrow>

Wherein,To carry out long-term smooth filtering factor to I frame effective transmissions time delay, span is [0.0,1.0], D_I(k-1) For the effective transmission time delay of -1 I frame of kth；

<mrow> <msub> <mi>D</mi> <mrow> <mi>a</mi> <mo>_</mo> <mi>a</mi> <mi>v</mi> <mi>g</mi> </mrow> </msub> <mo>=</mo> <msub> <mo>&part;</mo> <mn>2</mn> </msub> <mo>&times;</mo> <msub> <mi>D</mi> <mrow> <mi>a</mi> <mo>-</mo> <mn>1</mn> </mrow> </msub> <mo>+</mo> <mrow> <mo>(</mo> <mn>1</mn> <mo>-</mo> <msub> <mo>&part;</mo> <mn>2</mn> </msub> <mo>)</mo> </mrow> <msub> <mi>D</mi> <mi>a</mi> </msub> </mrow>

Wherein,To carry out long-term smooth filtering factor to frame of video effective transmission time delay, span is [0.0,1.0], D_a-1For the effective transmission time delay of a-1 second RTCP reports, D_aFor the equivalent biography of a-th of second RTCP report Defeated time delay.

2. according to the method for claim 1, it is characterised in that if the first RTCP sender reports or described the be present One RTCP receiving terminals report loss can not be calculated, then obtain the D by formula below_Ik：

D_Ik=D_Max

Wherein, D_MaxFor defined maximum transmitted time delay；

If the 2nd RTCP sender reports or the 2nd RTCP receiving terminals report loss be present can not be calculated, lead to Cross formula below and obtain the D_a：

D_a=D_Max。

3. method according to claim 1 or 2, it is characterised in that the dithering threshold includes：First dithering threshold and Two dithering thresholds；

If the D^I _jetterMore than first dithering threshold, then the conversion of I frames is triggered, every an I frame, next I frames are changed Encoded for P frames or B frames, and often change an I frame format, then 1 is added to accumulative conversion times m；

When the m values have reached M times, the M is the integer or the D more than or equal to 1^I _jetterContinuous R times more than described Second dithering threshold, then increase the interval of adjacent I frames, the R is the integer more than or equal to 1, and second dithering threshold is big In first dithering threshold；

Wherein, the interval of new adjacent I frames is obtained by below equation：

D_{Ist_new}=D_{Ist_old}+D_iststep

Wherein, D_{Ist_new}For the interval of the new adjacent I frames, D_{Ist_old}The I frame periods used for the last time, D_iststepTo be pre- If I frame periods change step-length.

4. according to the method for claim 3, it is characterised in that D_{Ist_old}Initial value is D_{Ist_I}, D_{Ist_I}For the adjacent I frames of standard Interval.

5. according to the method for claim 3, it is characterised in that if the D_{Ist_new}It is more than or equal to spacer maximum value, then described The interval value of new adjacent I frames is the spacer maximum value.

6. according to the method for claim 3, it is characterised in that also include：

7. according to the method for claim 3, it is characterised in that also include：

If the D^I _jetterIt is less than or equal to second dithering threshold continuous R time, then reduction I frame periods；Wherein, new adjacent I The interval D of frame_{Ist_new}Obtained by below equation：

D_{Ist_new}=D_{Ist_old}-D_iststep。

8. according to the method for claim 7, it is characterised in that if the D_{Ist_new}The interval of I frames adjacent less than or equal to standard D_{Ist_I}, then the interval value of the new adjacent I frames is the D_{Ist_I}。

9. a kind of I framing control method, the receiving terminal applied to video data stream, it is characterised in that including：

Receiving terminal receive transmitting terminal transmission a first real time transport control protocol RTCP sender report, described first RTCP sender reports associate with I frames, and the first RTCP sender reports are identified as the special report of corresponding I frames using special bit Accuse；

The receiving terminal sends the report of the first RTCP receiving terminals, the first RTCP receiving terminals report and I frames to the transmitting terminal Association, the first RTCP receiving terminals report include the first processing delay, and first processing delay is that the receiving terminal receives The first RTCP sender reports send the time delay of the first RTCP receiving terminals report to the receiving terminal；

The receiving terminal is based on RTCP report interval and sends the report of the 2nd RTCP receiving terminals, the 2nd RTCP to the transmitting terminal Receiving terminal report includes second processing time delay, and the second processing time delay is that the receiving terminal receives the 2nd RTCP transmitting terminals Report that the receiving terminal sends the time delay of the 2nd RTCP receiving terminals report.

10. a kind of I framing control device, is arranged at transmitting terminal, it is characterised in that including：

Sending module, for sending an I frame real time transport protocol RTP bag, corresponding each I frames RTP to receiving terminal every time Wrap to the receiving terminal send the first real time transport control protocol RTCP sender reports, the first RTCP sender reports with I frames associate, and the first RTCP sender reports are identified as the special report of corresponding I frames using special bit；

Receiving module, the first RTCP receiving terminals report sent for receiving the receiving terminal, the first RTCP receiving terminal reports Announcement associates with I frames, and the first RTCP receiving terminals report includes the first processing delay, and first processing delay is the reception End receives the time delay that the first RTCP sender reports send the first RTCP receiving terminals report to the receiving terminal；

The sending module, it is additionally operable to send the 2nd RTCP sender reports to the receiving terminal based on RTCP report interval；

The receiving module, it is additionally operable to receive the 2nd RTCP receiving terminal reports that the receiving terminal is sent based on RTCP report interval Accuse, the 2nd RTCP receiving terminals report includes second processing time delay, and the second processing time delay receives institute for the receiving terminal State the time delay that the 2nd RTCP sender reports send the 2nd RTCP receiving terminals report to the receiving terminal；

Processing module, for recording the first time stamp, the second time stamp, the 3rd time stamp and the 4th time stamp, first time stamp is described Transmitting terminal send the first RTCP sender reports at the time of, second time stamp be the transmitting terminal receive described first RTCP receiving terminals report at the time of, the 3rd time stamp be the transmitting terminal transmission the 2nd RTCP sender reports at the time of, institute At the time of stating the 4th time stamp and receive the 2nd RTCP receiving terminals report for the transmitting terminal；

The processing module, be additionally operable to according to first time stamp, second time stamp, the 3rd time stamp, it is described 4th when Stamp, first processing delay and the second processing time delay obtain the delay jitter of the I frames；

Adjusting module, if the delay jitter for the I frames is more than dithering threshold, the interval of increase adjacent I pin is encoded；

Wherein, the processing module, the effective transmission time delay specifically for obtaining the I frames by formula below：

D^I _jetter=D_{Ik_avg}-D_{a_avg}

The processing module, be specifically additionally operable to by formula below obtain the frame of video propagation delay time it is long-term smooth：

11. device according to claim 10, it is characterised in that the processing module, if being specifically additionally operable to described in presence First RTCP sender reports or the first RTCP receiving terminals report loss can not be calculated, then obtained by formula below The D_Ik：

D_Ik=D_Max

Wherein, D_MaxFor defined maximum transmitted time delay；

The processing module, if being specifically additionally operable to have the 2nd RTCP sender reports or the 2nd RTCP receiving terminal reports Accusing loss can not be calculated, then obtains the D by formula below_a：

D_a=D_Max。

12. the device according to claim 10 or 11, it is characterised in that the dithering threshold includes：First dithering threshold With the second dithering threshold；

The adjusting module, if specifically for the D^I _jetterMore than first dithering threshold, then the conversion of I frames, Mei Geyi are triggered Individual I frames, next I frames are converted into P frames or B frames are encoded, and often change an I frame format, then to accumulative conversion time Number m adds 1；

The adjusting module, specifically for being had reached M times when the m values, the M is the integer more than or equal to 1 or institute State D^I _jetterIt is more than second dithering threshold continuous R time, then increases the interval of adjacent I frames, the R is more than or equal to 1 Integer, second dithering threshold are more than first dithering threshold；

D_{Ist_new}=D_{Ist_old}+D_iststep

13. device according to claim 12, it is characterised in that D_{Ist_old}Initial value is D_{Ist_I}, D_{Ist_I}For the adjacent I of standard The interval of frame.

14. device according to claim 12, it is characterised in that the adjusting module, if being specifically additionally operable to the D_{Ist_new} More than or equal to spacer maximum value, then the interval value of the new adjacent I frames is the spacer maximum value.

15. device according to claim 12, it is characterised in that the adjusting module, if being additionally operable to the accumulative conversion Number m is not up to M times, and the D^I _jetterLess than or equal to first dithering threshold, then stop I frame switching motions.

16. device according to claim 12, it is characterised in that the adjusting module, if being additionally operable to the D^I _jetterContinuously It is less than or equal to second dithering threshold R times, then reduces I frame periods；

D_{Ist_new}=D_{Ist_old}-D_iststep。

17. device according to claim 16, it is characterised in that the adjusting module, if being specifically additionally operable to the D_{Ist_new} The interval D of I frames adjacent less than or equal to standard_{Ist_I}, then the interval value of the new adjacent I frames is the D_{Ist_I}。

18. a kind of I framing control device, is arranged at receiving terminal, it is characterised in that including：

Receiving module, for receiving a first real time transport control protocol RTCP sender report of transmitting terminal transmission, institute State the first RTCP sender reports to associate with I frames, the first RTCP sender reports are identified as corresponding I frames using special bit Special report；

Sending module, for sending the report of the first RTCP receiving terminals, the first RTCP receiving terminals report and I to the transmitting terminal Frame associates, and the first RTCP receiving terminals report includes the first processing delay, and first processing delay is received for the receiving terminal The time delay of the first RTCP receiving terminals report is sent to the first RTCP sender reports to the receiving terminal；

The receiving module, it is additionally operable to receive the 2nd RTCP transmitting terminal reports that the transmitting terminal is sent based on RTCP report interval Accuse；

The sending module, it is additionally operable to send the report of the 2nd RTCP receiving terminals, institute to the transmitting terminal based on RTCP report interval State the report of the 2nd RTCP receiving terminals and include second processing time delay, the second processing time delay is that the receiving terminal receives described second RTCP sender reports send the time delay of the 2nd RTCP receiving terminals report to the receiving terminal.

A kind of 19. I framing control system, it is characterised in that including：I framing control dress described in claim 10-17 any one Put, the I framing control devices described in the claim 18.