CN104754339A - Method, device and system for adjusting I frame - Google Patents

Abstract

The invention provides a method, a device and a system for adjusting I frame. A transmitting terminal sends a real time protocol (RTP) packet and a transmitting terminal report; while receiving a receiving terminal report sent by a receiving terminal, the transmitting terminal acquires jitter parameters of the I frame, wherein the jitter parameters of the I frame comprise a first timestamp, a second time stamp, a third timestamp, a fourth timestamp, a first processing delay and a second processing delay; the transmitting terminal acquires delay jitter of the I frame according to the jitter parameters of the I frame; if the delay jitter of the I frame is greater than a jitter threshold, the transmitting terminal increases an interval adjacent to the I frame, adjusts interval configuration of the I frame, and informs an encoder of a video coding layer of the transmitting terminal of coding the video data according to the new I frame interval, so that the I frame interval can be adjusted according to jitter of the I frame, unsmooth video caused by uneven jitter of the I frame is prevented while the decoding quality of the video data flow is guaranteed.

Description

I framing control method, Apparatus and system

Technical field

The present invention relates to video communication technology, particularly relate to a kind of I framing control method, Apparatus and system.

Background technology

Video coding of the prior art, usually adopt I frame, P frame and B frame carry out coding transmission.Wherein, I frame is mainly encoded with reference to this frame, and P frame Primary Reference I frame or P frame, B frame generally can with reference to I frame, P frame, or B frame.Therefore, I frame coding output encoder bit has higher code check usually.Further, code check is generally tens times or hundreds of times of P frame or B frame.Due to when there being I frame to export, need the data of transmission more, the video packets therefore causing an I frame or I sheet to export is comparatively large, and when resolution is higher, the bag that I sheet or I frame export can be unpacked process usually.

In the real-time Transmission process of image, prior art generally can adopt RTP (Real-time Transport Protocol, be called for short: video packets RTP) carrying Video coding, correspondingly carry out video packets time delay, the real-time estimation of code check etc. simultaneously.In a typical protocol architecture of video stream media application, RTP needs RTCP Real-time Transport Control Protocol (RTP ControlProtocol, be called for short: RTCP) for its service quality is given security, the major function of RTCP is: the supervision of service quality and synchronous between feedback, media, and the mark of member in multicast group.During RTP session, each participant periodically transmits RTCP bag.The statistics such as the quantity containing the quantity of packet sent, the packet of loss in RTCP bag, therefore, each participant can utilize these information dynamically to change transmission rate, even changes PT Payload Type.

But when adopting the Real-time Transport Protocol of prior art and rtcp protocol to carry out video data transmission, because usual propagation delay time is just larger, the time delay of transmission is long, delay variation like this between different frame is unbalanced, in the transmittance process carrying out I bag, I packet delay will be larger, thus the problem causing video decode end video frequency output still to there will be video card pausing.

Summary of the invention

The invention provides a kind of I framing control method, Apparatus and system, in order to while guarantee video data stream decoding quality, avoid and that cause video card pause phenomenon uneven due to I dither frame.

First aspect of the present invention is to provide a kind of I framing control method, comprising:

Transmitting terminal sends an I frame real time transport protocol RTP to receiving terminal at every turn and wraps, corresponding each described I frame RTP wraps and sends the first real-time transfer control agreement RTCP sender report to described receiving terminal, a described RTCP sender report associates with I frame, and a described RTCP sender report adopts special bit to be designated the special report of corresponding I frame;

Described transmitting terminal receives the RTCP receiving terminal report that described receiving terminal sends, a described RTCP receiving terminal report associates with I frame, a described RTCP receiving terminal report comprises the first processing delay, and described first processing delay is the time delay that described receiving terminal receives that described first sender report sends described first receiving terminal report to described receiving terminal;

Described transmitting terminal sends the 2nd RTCP sender report based on RTCP report interval to described receiving terminal;

Described transmitting terminal receives the 2nd RTCP receiving terminal report that described receiving terminal sends based on RTCP report interval, described 2nd RTCP receiving terminal report comprises the second processing delay, and described second processing delay is the time delay that described receiving terminal receives that described 2nd RTCP sender report sends described 2nd RTCP receiving terminal report to described receiving terminal;

Described transmitting terminal record first time stamp, the second time stamp, the 3rd time stamp and the 4th time stamp, described first time stamp is that described transmitting terminal sends the moment of a described RTCP sender report, described second time stamp is that described transmitting terminal receives the moment of a described RTCP receiving terminal report, described 3rd time stamp is that described transmitting terminal sends the moment of the 2nd RTCP sender report, described 4th time stamp is the moment that described transmitting terminal receives described 2nd RTCP receiving terminal report;

Described transmitting terminal obtains the delay jitter of described I frame according to described first time stamp, described second time stamp, described 3rd time stamp, described 4th time stamp, described first processing delay and described second processing delay;

If the delay jitter of described I frame is greater than dithering threshold, then encode in the interval increasing adjacent I pin.

In conjunction with first aspect, in the implementation that the first is possible, described transmitting terminal obtains the delay jitter of described I frame according to described first time stamp, described second time stamp and described processing delay, comprising:

The effective transmission time delay of described I frame is obtained by formula below:

$D_{\mathrm{Ik}}=\left(\underset{n=1}{\overset{N}{\mathrm{\Σ}}}\frac{T_{{\mathrm{RR}}_{\mathrm{sn}}\mathrm{Ikn}}-T_{{\mathrm{SR}}_{\mathrm{sn}}\mathrm{Ikn}}-{\mathrm{DLSR}}_{\mathrm{Ikn}}}{2}\right)\÷N$

Wherein, described D _ikfor the effective transmission time delay of a described kth I frame, described in for described transmitting terminal sends the first time stamp of a described RTCP sender report, a described RTCP sender report is wrapped corresponding with the n-th RTP of a described kth I frame, described in for described transmitting terminal receives the second time stamp of a described RTCP receiving terminal report, a described RTCP receiving terminal report is wrapped corresponding with the n-th RTP of a described kth I frame, described DLSR _infor the first processing delay that described RTCP receiving terminal report comprises, N decomposes by the described kth I frame corresponding RTP bag number, and should be the integer being more than or equal to 1, the span of described n is [1, N], and described k is the call number of the I frame of journal;

Effective transmission time delay by the frame of video of formula acquisition below:

$D_l=\frac{T_{{\mathrm{RR}}_l}-T_{{\mathrm{SR}}_l}-{\mathrm{DLSR}}_l}{2}$

Wherein, described D _lfor the effective transmission time delay of rtp streaming data, described in for described three time stamp corresponding based on the described 2nd RTCP sender report of time interval transmission, described in for receiving described 2nd RTCP receiving terminal based on the time interval report the 4th corresponding time stamp, described DLSR with described _lfor the second processing delay that the report of described standard RTCP receiving terminal comprises, described l is the call number of the RTCP sent according to the order of sequence based on the time interval report of journal;

The delay jitter of described I frame is obtained by formula below:

D ^I _jetter=D _{Ik_avg}-D _{l_avg}

Wherein, described D ⁱ _jetterfor the delay jitter of described I frame, described D _{ik_avg}for propagation delay time long-term level and smooth of described I frame, described D _{l_avg}for propagation delay time long-term level and smooth of frame of video;

Described D is obtained by formula below _{ik_avg}:

$D_{\mathrm{Ik}\_\mathrm{avg}}={\∂}_1\×D_{I(k-1)}+(1-{\∂}_1)D_{\mathrm{Ik}}$

Wherein, described in for carrying out filtering factor level and smooth for a long time to I frame effective transmission time delay, span is [0.0,1.0], described D _{l (k-1)}for the effective transmission time delay of kth-1 I frame;

The long-term level and smooth of the propagation delay time of described frame of video is obtained by formula below:

$D_{l\_\mathrm{avg}}={\∂}_2\×D_{l-1}+(1-{\∂}_2)D_l$

Wherein, described in for carrying out filtering factor level and smooth for a long time to frame of video effective transmission time delay, span is [0.0,1.0], described D _l-1be the effective transmission time delay of l-1 described 2nd RTCP report, described D _lit is the effective transmission time delay of l described 2nd RTCP report.

In conjunction with the first possible implementation of first aspect, in the implementation that the second is possible, if there is a described RTCP sender report or a described RTCP receiving terminal report loss cannot calculate, then obtain described D by formula below _ik:

D _Ik=D _Max

Wherein, described D _maxfor defined maximum transmitted time delay;

If there is described 2nd RTCP sender report or described 2nd RTCP receiving terminal report loss cannot calculate, then obtain described D by formula below _l:

D _l=D _Max。

In conjunction with first aspect or first aspect any one possible implementation above-mentioned, in the implementation that the third is possible, described dithering threshold comprises: the first dithering threshold and the second dithering threshold;

If the delay jitter of described I frame is greater than dithering threshold, then encoding in the interval increasing adjacent I pin, comprising:

If described D ⁱ _jetterbe greater than described first dithering threshold, then trigger the conversion of I frame, every an I frame, next I frame is converted to P frame or B frame is encoded, and often changes an I frame format, then 1 is added to accumulative conversion times m;

Reach M time when described m value is accumulative, described M is more than or equal to the integer of 1 or described D ⁱ _jetterbe greater than described second dithering threshold for R time continuously, then increase the interval of adjacent I frame, described R be more than or equal to 1 integer, described second dithering threshold is greater than described first dithering threshold;

Wherein, the interval of new adjacent I frame is obtained by following formula:

D _{Ist_new}=D _{Ist_old}+D _iststep

Wherein, described D _{ist_new}for the interval of described adjacent I frame newly, described D _{ist_old}for the I frame period that the last time adopts, described D _iststepfor the step-length that the I frame period preset changes.

In conjunction with the third possible implementation of first aspect, in the 4th kind of possibility implementation, described D _{ist_old}initial value is D _{ist_I}, described D _{ist_I}for the interval of the adjacent I frame of standard.

In conjunction with the third possible implementation of first aspect, in the 5th kind of possibility implementation, if described D _{ist_new}be more than or equal to spacer maximum value, then the interval value of described adjacent I frame is newly described spacer maximum value.

In conjunction with the third possible implementation of first aspect, in the 6th kind of possibility implementation, also comprise:

If described accumulative conversion times m does not reach M time, and described D ⁱ _jetterbe less than or equal to described first dithering threshold, then stop I frame switching motion.

In conjunction with the third possible implementation of first aspect, in the 7th kind of possibility implementation, also comprise:

If described D ⁱ _jetterbe less than or equal to described second dithering threshold for R time continuously, then reduce I frame period; Wherein, the interval D of new adjacent I frame _{ist_new}obtained by following formula:

D _{Ist_new}=D _{Ist_old}-D _iststep。

In conjunction with the 7th kind of possible implementation of first aspect, in the 8th kind of possibility implementation, if described D _{ist_new}be less than or equal to the interval D of the adjacent I frame of standard _{ist_I}, then the interval value of described adjacent I frame is newly described D _{ist_I}.

Second aspect of the present invention is to provide a kind of I framing control method, comprising:

Receiving terminal receives one the first real-time transfer control agreement RTCP sender report that transmitting terminal sends, and a described RTCP sender report associates with I frame, and a described RTCP sender report adopts special bit to be designated the special report of corresponding I frame;

Described receiving terminal sends a RTCP receiving terminal report to described transmitting terminal, a described RTCP receiving terminal report associates with I frame, a described RTCP receiving terminal report comprises the first processing delay, and described first processing delay is the time delay that described receiving terminal receives that a described RTCP sender report sends a described RTCP receiving terminal report to described receiving terminal;

Described receiving terminal receives the 2nd RTCP sender report that described transmitting terminal sends based on RTCP report interval;

Described receiving terminal sends the 2nd RTCP receiving terminal report based on RTCP report interval to described transmitting terminal, described 2nd RTCP receiving terminal report comprises the second processing delay, and described second processing delay is the time delay that described receiving terminal receives that described 2nd RTCP sender report sends described 2nd RTCP receiving terminal report to described receiving terminal.

3rd aspect of the present invention is to provide a kind of I framing control device, comprising:

Sending module, wrap for sending an I frame real time transport protocol RTP to receiving terminal at every turn, corresponding each described I frame RTP wraps and sends the first real-time transfer control agreement RTCP sender report to described receiving terminal, a described RTCP sender report associates with I frame, and a described RTCP sender report adopts special bit to be designated the special report of corresponding I frame;

Receiver module, for receiving the RTCP receiving terminal report that described receiving terminal sends, a described RTCP receiving terminal report associates with I frame, a described RTCP receiving terminal report comprises the first processing delay, and described first processing delay is the time delay that described receiving terminal receives that described first sender report sends described first receiving terminal report to described receiving terminal;

Described sending module, also for sending the 2nd RTCP sender report based on RTCP report interval to described receiving terminal;

Described receiver module, also for receiving the 2nd RTCP receiving terminal report that described receiving terminal sends based on RTCP report interval, described 2nd RTCP receiving terminal report comprises the second processing delay, and described second processing delay is the time delay that described receiving terminal receives that described 2nd RTCP sender report sends described 2nd RTCP receiving terminal report to described receiving terminal;

Processing module, for recording the first time stamp, the second time stamp, the 3rd time stamp and the 4th time stamp, described first time stamp is that described transmitting terminal sends the moment of a described RTCP sender report, described second time stamp is that described transmitting terminal receives the moment of a described RTCP receiving terminal report, described 3rd time stamp is that described transmitting terminal sends the moment of the 2nd RTCP sender report, described 4th time stamp is the moment that described transmitting terminal receives described 2nd RTCP receiving terminal report;

Described processing module, also for obtaining the delay jitter of described I frame according to described first time stamp, described second time stamp, described 3rd time stamp, described 4th time stamp, described first processing delay and described second processing delay;

Adjusting module, if be greater than dithering threshold for the delay jitter of described I frame, then encode in the interval increasing adjacent I pin.

In conjunction with the 3rd aspect, in the implementation that the first is possible, described processing module, specifically for obtaining the effective transmission time delay of described I frame by formula below:

$D_{\mathrm{Ik}}=\left(\underset{n=1}{\overset{N}{\mathrm{\Σ}}}\frac{T_{{\mathrm{RR}}_{\mathrm{sn}}\mathrm{Ikn}}-T_{{\mathrm{SR}}_{\mathrm{sn}}\mathrm{Ikn}}-{\mathrm{DLSR}}_{\mathrm{Ikn}}}{2}\right)\÷N$

Wherein, described D _ikfor the effective transmission time delay of a described kth I frame, described in for described transmitting terminal sends the first time stamp of a described RTCP sender report, a described RTCP sender report is wrapped corresponding with the n-th RTP of a described kth I frame, described in for described transmitting terminal receives the second time stamp of a described RTCP receiving terminal report, a described RTCP receiving terminal report is wrapped corresponding with the n-th RTP of a described kth I frame, described DLSR _infor the first processing delay that described RTCP receiving terminal report comprises, N decomposes by the described kth I frame corresponding RTP bag number, and should be the integer being more than or equal to 1, the span of described n is [1, N], and described k is the call number of the I frame of journal;

Described processing module, specifically also for the effective transmission time delay by the frame of video of formula acquisition below:

$D_l=\frac{T_{{\mathrm{RR}}_l}-T_{{\mathrm{SR}}_l}-{\mathrm{DLSR}}_l}{2}$

Wherein, described D _lfor the effective transmission time delay of rtp streaming data, described in for described three time stamp corresponding based on the described 2nd RTCP sender report of time interval transmission, described in for receiving described 2nd RTCP receiving terminal based on the time interval report the 4th corresponding time stamp, described DLSR with described _lfor the second processing delay that the report of described standard RTCP receiving terminal comprises, described l is the call number of the RTCP sent according to the order of sequence based on the time interval report of journal;

Described processing module, specifically also for obtaining the delay jitter of described I frame by formula below:

D ^I _jetter=D _{Ik_avg}-D _{l_avg}

Wherein, described D ⁱ _jetterfor the delay jitter of described I frame, described D _{ik_avg}for propagation delay time long-term level and smooth of described I frame, described D _{l_avg}for propagation delay time long-term level and smooth of frame of video;

Described processing module, specifically also for obtaining described D by formula below _{ik_avg}:

$D_{\mathrm{Ik}\_\mathrm{avg}}={\∂}_1\×D_{I(k-1)}+(1-{\∂}_1)D_{\mathrm{Ik}}$

Wherein, described in for carrying out filtering factor level and smooth for a long time to I frame effective transmission time delay, span is [0.0,1.0], described D _{l (k-1)}for the effective transmission time delay of kth-1 I frame;

Described processing module, specifically also for being obtained the long-term level and smooth of the propagation delay time of described frame of video by formula below:

$D_{l\_\mathrm{avg}}={\∂}_2\×D_{l-1}+(1-{\∂}_2)D_l$

Wherein, described in for carrying out filtering factor level and smooth for a long time to frame of video effective transmission time delay, span is [0.0,1.0], described D _l-1be the effective transmission time delay of l-1 described 2nd RTCP report, described D _lit is the effective transmission time delay of l described 2nd RTCP report.

In conjunction with the first possible implementation of the 3rd aspect, in the implementation that the second is possible, described processing module, if specifically also for there is a described RTCP sender report or a described RTCP receiving terminal report loss cannot calculate, then obtain described D by formula below _ik:

D _Ik=D _Max

Wherein, described D _maxfor defined maximum transmitted time delay;

Described processing module, if specifically also for there is described 2nd RTCP sender report or described 2nd RTCP receiving terminal report loss cannot calculate, then obtain described D by formula below _l:

D _l=D _Max。

In conjunction with the 3rd aspect or the 3rd aspect any one possible implementation above-mentioned, in the implementation that the third is possible, described dithering threshold comprises: the first dithering threshold and the second dithering threshold;

Described adjusting module, if specifically for described D ⁱ _jetterbe greater than described first dithering threshold, then trigger the conversion of I frame, every an I frame, next I frame is converted to P frame or B frame is encoded, and often changes an I frame format, then 1 is added to accumulative conversion times m;

Described adjusting module, specifically for reaching M time when described m value is accumulative, described M is more than or equal to the integer of 1 or described D ⁱ _jetterbe greater than described second dithering threshold for R time continuously, then increase the interval of adjacent I frame, described R be more than or equal to 1 integer, described second dithering threshold is greater than described first dithering threshold;

Described processing module is also for obtaining the interval of new adjacent I frame by following formula:

D _{Ist_new}=D _{Ist_old}+D _iststep

Wherein, described D _{ist_new}for the interval of described first adjacent I frame, described D _{ist_old}for the I frame period that the last time adopts, described D _iststepfor the step-length that the I frame period preset changes.

In conjunction with the third possible implementation of the 3rd aspect, in the 4th kind of possibility implementation, described D _{ist_old}initial value is D _{ist_I}, described D _{ist_I}for the interval of the adjacent I frame of standard.

In conjunction with the third possible implementation of the 3rd aspect, in the 5th kind of possibility implementation, described adjusting module, if specifically also for described D _{ist_new}be more than or equal to spacer maximum value, then the interval value of described adjacent I frame is newly described spacer maximum value.

In conjunction with the third possible implementation of the 3rd aspect, in the 6th kind of possibility implementation, described adjusting module, if also do not reach M time for described accumulative conversion times m, and described D ⁱ _jetterbe less than or equal to described first dithering threshold, then stop I frame switching motion.

In conjunction with the third possible implementation of the 3rd aspect, in the 7th kind of possibility implementation, described adjusting module, if also for described D ⁱ _jetterbe less than or equal to described second dithering threshold for R time continuously, then reduce I frame period;

Described processing module is also for obtaining the interval D of new adjacent I frame by following formula _{ist_new}:

D _{Ist_new}=D _{Ist_old}-D _iststep。

In conjunction with the 7th kind of possible implementation of the 3rd aspect, in the 8th kind of possibility implementation, described adjusting module, if specifically also for described D _{ist_new}be less than or equal to the interval D of the adjacent I frame of standard _{ist_I}, then the interval value of described adjacent I frame is newly described D _{ist_I}.

4th aspect of the present invention is to provide a kind of I framing control device, comprising:

Receiver module, for receiving one the first real-time transfer control agreement RTCP sender report that transmitting terminal sends, a described RTCP sender report associates with I frame, and a described RTCP sender report adopts special bit to be designated the special report of corresponding I frame;

Sending module, for sending a RTCP receiving terminal report to described transmitting terminal, a described RTCP receiving terminal report associates with I frame, a described RTCP receiving terminal report comprises the first processing delay, and described first processing delay is the time delay that described receiving terminal receives that a described RTCP sender report sends a described RTCP receiving terminal report to described receiving terminal;

Described receiver module, also for receiving the 2nd RTCP sender report that described transmitting terminal sends based on RTCP report interval;

Described sending module, also for sending the 2nd RTCP receiving terminal report based on RTCP report interval to described transmitting terminal, described 2nd RTCP receiving terminal report comprises the second processing delay, and described second processing delay is the time delay that described receiving terminal receives that described 2nd RTCP sender report sends described 2nd RTCP receiving terminal report to described receiving terminal.

5th aspect of the present invention is to provide a kind of I framing control system, comprising: above-mentioned 3rd aspect or the 3rd any one I framing control device described in possible implementation of aspect, above-mentioned 4th I framing control device described in aspect.

I framing control method, Apparatus and system that the present embodiment provides, send while I frame RTP wraps by each to receiving terminal, transmitting terminal sends to receiving terminal the RTCP sender report associated with I frame for each I frame RTP bag, and receive a RTCP receiving terminal report of receiving end transmission, one RTCP receiving terminal report comprises the first processing delay, and the first processing delay is the time delay that receiving terminal receives that the first sender report sends the first receiving terminal report to receiving terminal.And, transmitting terminal also will send the 2nd RTCP sender report to receiving terminal, and receive the 2nd RTCP receiving terminal report of receiving terminal transmission, 2nd RTCP receiving terminal report comprises the second processing delay, and the second processing delay is the time delay that receiving terminal receives that the 2nd RTCP sender report sends the 2nd RTCP receiving terminal report to receiving terminal.Further, transmitting terminal record first time stamp, the second time stamp, the 3rd time stamp and the 4th time stamp, the first time stamp is that transmitting terminal sends moment of a RTCP sender report, the second time stamp is that transmitting terminal receives moment of a RTCP receiving terminal report, the 3rd time stamp is that transmitting terminal sends moment of the 2nd RTCP sender report, the 4th time stamp is the moment that transmitting terminal receives the 2nd RTCP receiving terminal report.Transmitting terminal obtains the delay jitter of I frame according to the first time stamp, the second time stamp, the 3rd time stamp, the 4th time stamp, the first processing delay and the second processing delay, if the delay jitter of I frame is greater than dithering threshold, then encode in the interval increasing adjacent I frame.Thus the adjustment of I frame period is carried out in the shake achieved according to I frame, thus while guarantee video data stream decoding quality, avoid and that cause video card pause phenomenon uneven due to I dither frame.

Accompanying drawing explanation

A kind of I framing control method flow schematic diagram that Fig. 1 provides for the embodiment of the present invention;

A kind of I framing control method schematic diagram that Fig. 2 provides for the embodiment of the present invention;

A kind of I framing control apparatus structure schematic diagram that Fig. 3 provides for the embodiment of the present invention;

A kind of I framing control apparatus structure schematic diagram that Fig. 4 provides for the embodiment of the present invention;

A kind of I framing control system schematic that Fig. 5 provides for the embodiment of the present invention.

Embodiment

In supervision scene, because video pictures is different from the scene change that film or television image can exist interframe, certain correlation can be there is in time between the consecutive frame of such supervision scene, so being set to larger interval and can not producing considerable influence to video quality of I frame, in addition, in supervision scene, if there is scene to switch in picture, the larger situation of P frame code check brought, video Caton phenomenon is also not easy to perceive in such cases, pause so the mode increasing I interval can be adopted to alleviate video card, or according to the code check that channel can carry, the interval that adjustment I frame occurs, or I frame switched to P frame.

If but only have P frame or B frame for a long time, video coding parameter may be unstable, coding quality will be affected, in order to obtain the balance between video quality and I frame period, the setting of I frame period can be carried out according to the delay variation of I frame data, the card that minimizing brings due to I frame propagation delay time as far as possible pauses, and is described below by the scheme of specific embodiment to adjustment I frame period:

A kind of I framing control method flow schematic diagram that Fig. 1 provides for the embodiment of the present invention, as shown in Figure 1, this executive agent is the transmitting terminal of video data stream.The method comprises the steps:

Step 100, transmitting terminal send an I frame real time transport protocol (Real-timeTransport Protocol to receiving terminal at every turn, be called for short: RTP) wrap, corresponding each I frame RTP wraps and sends the first real-time transfer control agreement (Real-time Transport Control Protocol to receiving terminal, be called for short: RTCP) sender report, one RTCP sender report associates with I frame, and a RTCP sender report adopts special bit to be designated the special report of corresponding I frame.

Concrete, when the RTP of transmitting terminal I frame when sending data wraps, once may send out a RTP bag, also may send multiple simultaneously, when sending RTP bag, correspondence sends a first RTCP sender report at every turn.

One RTCP sender report identification: utilize " profile-specific extensions ", high 16 definition fixed values, as 1010, do not repeat with real profile-specific extensions value, and can not be invalid value.It is the special RTCP report that corresponding I frame sends that least-significant byte is used to indicate this RTCP sender report.

Step 101, transmitting terminal receive the RTCP receiving terminal report that receiving terminal sends, one RTCP receiving terminal report associates with I frame, one RTCP receiving terminal report comprises the first processing delay, and the first processing delay is the time delay that receiving terminal receives that the first sender report sends the first receiving terminal report to receiving terminal.

Concrete, the one RTCP sender report of synchronized transmission during each transmission data, the therefore transmission time of the transmission time Approximate Equivalent data of a RTCP sender report.The time delay of assessment data can be carried out by the loopback of report.

Step 102, transmitting terminal send the 2nd RTCP sender report based on RTCP report interval to receiving terminal.

It should be noted that, the 2nd RTCP sender report does not associate with I frame.

Step 103, transmitting terminal receive the 2nd RTCP receiving terminal report that receiving terminal sends based on RTCP report interval, 2nd RTCP receiving terminal report comprises the second processing delay, and the second processing delay is the time delay that receiving terminal receives that the 2nd RTCP sender report sends the 2nd RTCP receiving terminal report to receiving terminal.

Step 104, transmitting terminal record first time stamp, the second time stamp, the 3rd time stamp and the 4th time stamp, the first time stamp is that transmitting terminal sends moment of a RTCP sender report, the second time stamp is that transmitting terminal receives moment of a RTCP receiving terminal report, the 3rd time stamp is that transmitting terminal sends moment of the 2nd RTCP sender report, the 4th time stamp is the moment that transmitting terminal receives the 2nd RTCP receiving terminal report.

Step 105, transmitting terminal obtain the delay jitter of I frame according to the first time stamp, the second time stamp, the 3rd time stamp, the 4th time stamp, the first processing delay and the second processing delay.

If the delay jitter of step 106 I frame is greater than dithering threshold, then encode in the interval increasing adjacent I pin.

The I framing control method that the present embodiment provides, send while I frame RTP wraps by each to receiving terminal, transmitting terminal sends to receiving terminal the RTCP sender report associated with I frame for each I frame RTP bag, and receive a RTCP receiving terminal report of receiving end transmission, one RTCP receiving terminal report comprises the first processing delay, and the first processing delay is the time delay that receiving terminal receives that the first sender report sends the first receiving terminal report to receiving terminal.And, transmitting terminal also will send the 2nd RTCP sender report to receiving terminal, and receive the 2nd RTCP receiving terminal report of receiving terminal transmission, 2nd RTCP receiving terminal report comprises the second processing delay, and the second processing delay is the time delay that receiving terminal receives that the 2nd RTCP sender report sends the 2nd RTCP receiving terminal report to receiving terminal.Further, transmitting terminal record first time stamp, the second time stamp, the 3rd time stamp and the 4th time stamp, the first time stamp is that transmitting terminal sends moment of a RTCP sender report, the second time stamp is that transmitting terminal receives moment of a RTCP receiving terminal report, the 3rd time stamp is that transmitting terminal sends moment of the 2nd RTCP sender report, the 4th time stamp is the moment that transmitting terminal receives the 2nd RTCP receiving terminal report.Transmitting terminal obtains the delay jitter of I frame according to the first time stamp, the second time stamp, the 3rd time stamp, the 4th time stamp, the first processing delay and the second processing delay, if the delay jitter of I frame is greater than dithering threshold, then encode in the interval increasing adjacent I frame.Thus the adjustment of I frame period is carried out in the shake achieved according to I frame, thus while guarantee video data stream decoding quality, avoid and that cause video card pause phenomenon uneven due to I dither frame.

Preferably, a kind of feasible implementation of the step 105 in Fig. 1 is:

Effective transmission time delay by the I of formula acquisition below frame:

$D_{\mathrm{Ik}}=\left(\underset{n=1}{\overset{N}{\mathrm{\Σ}}}\frac{T_{{\mathrm{RR}}_{\mathrm{sn}}\mathrm{Ikn}}-T_{{\mathrm{SR}}_{\mathrm{sn}}\mathrm{Ikn}}-{\mathrm{DLSR}}_{\mathrm{Ikn}}}{2}\right)\÷N$

Wherein, D _ikfor the effective transmission time delay of a kth I frame, for transmitting terminal sends the first time stamp of a RTCP sender report, a RTCP sender report is wrapped corresponding with the n-th RTP of a kth I frame, for transmitting terminal receives the second time stamp of a RTCP receiving terminal report, a RTCP receiving terminal report is wrapped corresponding with the n-th RTP of a kth I frame, DLSR _inbe the first processing delay that RTCP receiving terminal report comprises, N decomposes by the kth I frame corresponding RTP bag number, and should be the integer being more than or equal to 1, the span of n is [1, N], and k is the call number of the I frame of journal.

Effective transmission time delay by the frame of video of formula acquisition below:

$D_l=\frac{T_{{\mathrm{RR}}_l}-T_{{\mathrm{SR}}_l}-{\mathrm{DLSR}}_l}{2}$

Wherein, D _lfor the effective transmission time delay of rtp streaming data, for the 3rd time stamp that the 2nd RTCP sender report sent based on the time interval is corresponding, for with receive the 2nd RTCP receiving terminal based on the time interval and report the 4th corresponding time stamp, DLSR _lfor the second processing delay that the report of standard RTCP receiving terminal comprises, l is the call number of the RTCP sent according to the order of sequence based on the time interval report of journal.

Delay jitter by the I of formula acquisition below frame:

D ^I _jetter=D _{Ik_avg}-D _{l_avg}

Wherein, D ⁱ _jetterfor the delay jitter of I frame, D _{ik_avg}for propagation delay time long-term level and smooth of I frame, D _{l_avg}for propagation delay time long-term level and smooth of frame of video.

By the D of formula acquisition below _{ik_avg}:

$D_{\mathrm{Ik}\_\mathrm{avg}}={\∂}_1\×D_{I(k-1)}+(1-{\∂}_1)D_{\mathrm{Ik}}$

Wherein, for carrying out filtering factor level and smooth for a long time to I frame effective transmission time delay, span is [0.0,1.0], can based on experience value or simulation value arrange, only consider that this value of delay character of this I frame can be set to 0.0.D _{l (k-1)}for the effective transmission time delay of kth-1 I frame.

The long-term level and smooth of the propagation delay time of frame of video is obtained by formula below:

$D_{l\_\mathrm{avg}}={\∂}_2\×D_{l-1}+(1-{\∂}_2)D_l$

Wherein, for carrying out filtering factor level and smooth for a long time to frame of video effective transmission time delay, span is [0.0,1.0], D _l-1be the effective transmission time delay of l-1 the 2nd RTCP report, D _lit is the effective transmission time delay of l the 2nd RTCP report.

Further, if lose for existence the one RTCP sender report or a RTCP receiving terminal report scene cannot carrying out calculating, then by the D of formula acquisition below _ik:

D _Ik=D _Max

Wherein, D _maxfor defined maximum transmitted time delay, can based on experience value or simulation value configuration.

If lose for existence the 2nd RTCP sender report or the report of the 2nd RTCP receiving terminal the scene cannot carrying out calculating, then by the D of formula acquisition below _l:

D _l=D _Max。

Preferably, the dithering threshold in above-described embodiment comprises: the first dithering threshold and the second dithering threshold.

Further, for Fig. 1 step 106, a kind of possible implementation is:

When I frame propagation delay time continues larger, think and cannot adapt to current signal condition, need to carry out the adjustment of I frame period, the adjustment of I frame period has the following two kinds mode, can use simultaneously or use one:

Mode one: if D ⁱ _jetterbe greater than the first dithering threshold, then trigger the conversion of I frame, every an I frame, next I frame is converted to P frame or B frame is encoded, and often changes an I frame format, then 1 is added to accumulative conversion times m.

Mode two: reach M time when m value is accumulative, M be more than or equal to 1 integer or D ⁱ _jetterbe greater than the second dithering threshold for R time continuously, then increase the interval of adjacent I frame, R be more than or equal to 1 integer, the second dithering threshold is greater than the first dithering threshold.

Wherein, the interval of new adjacent I frame is obtained by following formula:

D _{Ist_new}=D _{Ist_old}+D _iststep

Wherein, D _{ist_new}for the interval of new adjacent I frame, D _{ist_old}for the I frame period that the last time adopts, D _iststepfor the step-length that the I frame period preset changes.

Concrete, if D _{ist_new}be more than or equal to spacer maximum value, then the interval value of new adjacent I frame is spacer maximum value.

It should be noted that, D _{ist_old}initial value be D _{ist_I}, D _{ist_I}for the interval of the adjacent I frame of standard, and continuous updating D _{ist_old}=D _{ist_new}.

Further, if accumulative conversion times m does not reach M time, and D ⁱ _jetterbe less than or equal to the first dithering threshold, then stop I frame switching motion.

If D ⁱ _jetterbe less than or equal to the second dithering threshold for R time continuously, then reduce I frame period; Wherein, the interval D of new adjacent I frame _{ist_new}obtained by following formula:

D _{Ist_new}=D _{Ist_old}-D _iststep。

Concrete, if D _{ist_new}be less than or equal to the interval D of the adjacent I frame of standard _{ist_I}, then the interval value of new adjacent I frame is D _{ist_I}.

It should be noted that, after transmitting terminal calculates above-mentioned I frame period, corresponding I frame period is delivered to encoder, adjustment encoder encodes exports.And with a nearest I frame for starting point, redefine the interval of new I frame, and corresponding frame type is configured to I frame.

A kind of I framing control method schematic diagram that Fig. 2 provides for the embodiment of the present invention, this executive agent is the receiving terminal of video data stream.The method comprises the steps:

Step 200, receiving terminal receive the RTCP sender report that transmitting terminal sends, and a RTCP sender report associates with I frame, and a RTCP sender report adopts special bit to be designated the special report of corresponding I frame.

Step 201, receiving terminal send a RTCP receiving terminal report to transmitting terminal, one RTCP receiving terminal report associates with I frame, one RTCP receiving terminal report comprises the first processing delay, and the first processing delay is the time delay that receiving terminal receives that a RTCP sender report sends a RTCP receiving terminal report to receiving terminal.

Receiving terminal receives a RTCP sender report, then often receive a first RTCP sender report, namely replys a RTCP receiving terminal report.One RTCP receiving terminal report needs a mark corresponding with a RTCP sender report.

The 2nd RTCP sender report that step 202, receiving terminal receiving end/sending end send based on RTCP report interval.

Step 203, receiving terminal send the 2nd RTCP receiving terminal report based on RTCP report interval to transmitting terminal, 2nd RTCP receiving terminal report comprises the second processing delay, and the second processing delay is the time delay that receiving terminal receives that the 2nd RTCP sender report sends the 2nd RTCP receiving terminal report to receiving terminal.

The I framing control method that the present embodiment provides, send while I frame RTP wraps by each to receiving terminal, receiving terminal receiving end/sending end wraps the RTCP sender report associated with I frame sent for each I frame RTP, and send a RTCP receiving terminal report to transmitting terminal, one RTCP receiving terminal report comprises the first processing delay, and the first processing delay is the time delay that receiving terminal receives that the first sender report sends the first receiving terminal report to receiving terminal.And, the 2nd RTCP sender report that receiving terminal also wants receiving end/sending end to send, and send the 2nd RTCP receiving terminal report to transmitting terminal, 2nd RTCP receiving terminal report comprises the second processing delay, and the second processing delay is the time delay that receiving terminal receives that the 2nd RTCP sender report sends the 2nd RTCP receiving terminal report to receiving terminal.To make transmitting terminal record first time stamp, second time stamp, 3rd time stamp and the 4th time stamp, first time stamp is the moment that transmitting terminal sends a RTCP sender report, second time stamp is the moment that transmitting terminal receives a RTCP receiving terminal report, 3rd time stamp is the moment that transmitting terminal sends the 2nd RTCP sender report, 4th time stamp is the moment that transmitting terminal receives the 2nd RTCP receiving terminal report, and according to the first time stamp, second time stamp, 3rd time stamp, 4th time stamp, first processing delay and the second processing delay obtain the delay jitter of I frame, if the delay jitter of I frame is greater than dithering threshold, encode in the interval then increasing adjacent I frame.Thus the adjustment of I frame period is carried out in the shake achieved according to I frame, thus while guarantee video data stream decoding quality, avoid and that cause video card pause phenomenon uneven due to I dither frame.

A kind of I framing control apparatus structure schematic diagram that Fig. 3 provides for the embodiment of the present invention, this I framing control device is arranged on transmitting terminal, and this I framing control device comprises: sending module 10, receiver module 11, processing module 12, adjusting module 13.

Sending module 10, wrap for sending an I frame RTP to receiving terminal at every turn, corresponding each I frame RTP wraps and sends a RTCP sender report to receiving terminal, and a RTCP sender report associates with I frame, and a RTCP sender report adopts special bit to be designated the special report of corresponding I frame.

Receiver module 11, for receiving the RTCP receiving terminal report that receiving terminal sends, one RTCP receiving terminal report associates with I frame, one RTCP receiving terminal report comprises the first processing delay, and the first processing delay is the time delay that receiving terminal receives that the first sender report sends the first receiving terminal report to receiving terminal.

Sending module 10, also for sending the 2nd RTCP sender report based on RTCP report interval to receiving terminal.

Receiver module 11, also for receiving the 2nd RTCP receiving terminal report that receiving terminal sends based on RTCP report interval, 2nd RTCP receiving terminal report comprises the second processing delay, and the second processing delay is the time delay that receiving terminal receives that the 2nd RTCP sender report sends the 2nd RTCP receiving terminal report to receiving terminal.

Processing module 12, for recording the first time stamp, the second time stamp, the 3rd time stamp and the 4th time stamp, the first time stamp is that transmitting terminal sends moment of a RTCP sender report, the second time stamp is that transmitting terminal receives moment of a RTCP receiving terminal report, the 3rd time stamp is that transmitting terminal sends moment of the 2nd RTCP sender report, the 4th time stamp is the moment that transmitting terminal receives the 2nd RTCP receiving terminal report.

Processing module 12, also for obtaining the delay jitter of I frame according to the first time stamp, the second time stamp, the 3rd time stamp, the 4th time stamp, the first processing delay and the second processing delay.

Adjusting module 13, if be greater than dithering threshold for the delay jitter of I frame, then encode in the interval increasing adjacent I pin.

The I framing control method that the present embodiment provides, send while I frame RTP wraps by each to receiving terminal, sending module sends to receiving terminal the RTCP sender report associated with I frame for each I frame RTP bag, receiver module receives the RTCP receiving terminal report that receiving end sends, one RTCP receiving terminal report comprises the first processing delay, and the first processing delay is the time delay that receiving terminal receives that the first sender report sends the first receiving terminal report to receiving terminal.And, sending module also will send the 2nd RTCP sender report to receiving terminal, receiver module receives the 2nd RTCP receiving terminal report that receiving terminal sends, 2nd RTCP receiving terminal report comprises the second processing delay, and the second processing delay is the time delay that receiving terminal receives that the 2nd RTCP sender report sends the 2nd RTCP receiving terminal report to receiving terminal.Further, processing module record first time stamp, the second time stamp, the 3rd time stamp and the 4th time stamp, the first time stamp is that transmitting terminal sends moment of a RTCP sender report, the second time stamp is that transmitting terminal receives moment of a RTCP receiving terminal report, the 3rd time stamp is that transmitting terminal sends moment of the 2nd RTCP sender report, the 4th time stamp is the moment that transmitting terminal receives the 2nd RTCP receiving terminal report.Processing module obtains the delay jitter of I frame according to the first time stamp, the second time stamp, the 3rd time stamp, the 4th time stamp, the first processing delay and the second processing delay, if the delay jitter of I frame is greater than dithering threshold, then encode in the interval of adjusting module increase adjacent I frame.Thus the adjustment of I frame period is carried out in the shake achieved according to I frame, thus while guarantee video data stream decoding quality, avoid and that cause video card pause phenomenon uneven due to I dither frame.

Further, processing module 12, the effective transmission time delay specifically for by the I of formula acquisition below frame:

$D_{\mathrm{Ik}}=\left(\underset{n=1}{\overset{N}{\mathrm{\Σ}}}\frac{T_{{\mathrm{RR}}_{\mathrm{sn}}\mathrm{Ikn}}-T_{{\mathrm{SR}}_{\mathrm{sn}}\mathrm{Ikn}}-{\mathrm{DLSR}}_{\mathrm{Ikn}}}{2}\right)\÷N$

Wherein, D _ikfor the effective transmission time delay of a kth I frame, for transmitting terminal sends the first time stamp of a RTCP sender report, a RTCP sender report is wrapped corresponding with the n-th RTP of a kth I frame, for transmitting terminal receives the second time stamp of a RTCP receiving terminal report, a RTCP receiving terminal report is wrapped corresponding with the n-th RTP of a kth I frame, DLSR _inbe the first processing delay that RTCP receiving terminal report comprises, N decomposes by the kth I frame corresponding RTP bag number, and should be the integer being more than or equal to 1, the span of n is [1, N], and k is the call number of the I frame of journal.

Processing module 12, specifically also for the effective transmission time delay by the frame of video of formula acquisition below:

$D_l=\frac{T_{{\mathrm{RR}}_l}-T_{{\mathrm{SR}}_l}-{\mathrm{DLSR}}_l}{2}$

Wherein, D _lfor the effective transmission time delay of rtp streaming data, for the 3rd time stamp that the 2nd RTCP sender report sent based on the time interval is corresponding, for with receive the 2nd RTCP receiving terminal based on the time interval and report the 4th corresponding time stamp, DLSR _lfor the second processing delay that the report of standard RTCP receiving terminal comprises, l is the call number of the RTCP sent according to the order of sequence based on the time interval report of journal.

Processing module 12, specifically also for the delay jitter by the I of formula acquisition below frame:

D ^I _jetter=D _{Ik_avg}-D _{l_avg}

Wherein, D ⁱ _jetterfor the delay jitter of I frame, D _{ik_avg}for propagation delay time long-term level and smooth of I frame, D _{l_avg}for propagation delay time long-term level and smooth of frame of video.

Processing module 12, specifically also obtains D for passing through formula below _{ik_avg}:

$D_{\mathrm{Ik}\_\mathrm{avg}}={\∂}_1\×D_{I(k-1)}+(1-{\∂}_1)D_{\mathrm{Ik}}$

Wherein, for carrying out filtering factor level and smooth for a long time to I frame effective transmission time delay, span is [0.0,1.0], D _{l (k-1)}for the effective transmission time delay of kth-1 I frame.

Processing module 12, specifically also obtains the long-term level and smooth of the propagation delay time of frame of video for passing through formula below:

$D_{l\_\mathrm{avg}}={\∂}_2\×D_{l-1}+(1-{\∂}_2)D_l$

Wherein, for carrying out filtering factor level and smooth for a long time to frame of video effective transmission time delay, span is [0.0,1.0], D _l-1be the effective transmission time delay of l-1 the 2nd RTCP report, D _lit is the effective transmission time delay of l the 2nd RTCP report.

Preferably, processing module 12, if specifically also cannot calculate for existence the one RTCP sender report or RTCP receiving terminal report loss, then by the D of formula acquisition below _ik:

D _Ik=D _Max

Wherein, D _maxfor defined maximum transmitted time delay.

Processing module 12, if specifically also cannot calculate for existence the 2nd RTCP sender report or the 2nd RTCP receiving terminal report loss, then by the D of formula acquisition below _l:

D _l=D _Max。

Further, dithering threshold comprises: the first dithering threshold and the second dithering threshold.

Thus, adjusting module 13, if specifically for D ⁱ _jetterbe greater than the first dithering threshold, then trigger the conversion of I frame, every an I frame, next I frame is converted to P frame or B frame is encoded, and often changes an I frame format, then 1 is added to accumulative conversion times m.

Adjusting module 13, specifically for when m value add up reach M time, M be more than or equal to 1 integer or D ⁱ _jetterbe greater than the second dithering threshold for R time continuously, then increase the interval of adjacent I frame, R be more than or equal to 1 integer, the second dithering threshold is greater than the first dithering threshold.

Processing module 12, also for being obtained the interval of new adjacent I frame by following formula:

D _{Ist_new}=D _{Ist_old}+D _iststep

Wherein, D _{ist_new}be the interval of the first adjacent I frame, D _{ist_old}for the I frame period that the last time adopts, D _iststepfor the step-length that the I frame period preset changes.

It should be noted that, D _{ist_old}initial value be D _{ist_I}, D _{ist_I}for the interval of the adjacent I frame of standard.

Preferably, adjusting module 13, if specifically also for D _{ist_new}be more than or equal to spacer maximum value, then the interval value of new adjacent I frame is spacer maximum value.

Further, adjusting module 13, if also do not reach M time for accumulative conversion times m, and D ⁱ _jetterbe less than or equal to the first dithering threshold, then stop I frame switching motion.

Further, adjusting module 13, if also for D ⁱ _jetterbe less than or equal to the second dithering threshold for R time continuously, then reduce I frame period;

Processing module 12 is also for obtaining the interval D of new adjacent I frame by following formula _{ist_new}:

D _{Ist_new}=D _{Ist_old}-D _iststep。

Preferably, adjusting module 13, if specifically also for D _{ist_new}be less than or equal to the interval D of the adjacent I frame of standard _{ist_I}, then the interval value of new adjacent I frame is D _{ist_I}.

A kind of I framing control apparatus structure schematic diagram that Fig. 4 provides for the embodiment of the present invention, this I framing control device is arranged at receiving terminal, and this I framing control device comprises: receiver module 20, sending module 21.

Receiver module 20, for receiving the RTCP sender report that transmitting terminal sends, a RTCP sender report associates with I frame, and a RTCP sender report adopts special bit to be designated the special report of corresponding I frame.

Sending module 21, for sending a RTCP receiving terminal report to transmitting terminal, one RTCP receiving terminal report associates with I frame, one RTCP receiving terminal report comprises the first processing delay, and the first processing delay is the time delay that receiving terminal receives that a RTCP sender report sends a RTCP receiving terminal report to receiving terminal.

Receiver module 20, also for the 2nd RTCP sender report that receiving end/sending end sends based on RTCP report interval.

Sending module 21, also for sending the 2nd RTCP receiving terminal report based on RTCP report interval to transmitting terminal, 2nd RTCP receiving terminal report comprises the second processing delay, and the second processing delay is the time delay that receiving terminal receives that the 2nd RTCP sender report sends the 2nd RTCP receiving terminal report to receiving terminal.

The I framing control method that the present embodiment provides, send while I frame RTP wraps by each to receiving terminal, receiver module receiving end/sending end wraps the RTCP sender report associated with I frame sent for each I frame RTP, sending module sends a RTCP receiving terminal report to transmitting terminal, one RTCP receiving terminal report comprises the first processing delay, and the first processing delay is the time delay that receiving terminal receives that the first sender report sends the first receiving terminal report to receiving terminal.And, the 2nd RTCP sender report that receiver module also wants receiving end/sending end to send, sending module sends the 2nd RTCP receiving terminal report to transmitting terminal, 2nd RTCP receiving terminal report comprises the second processing delay, and the second processing delay is the time delay that receiving terminal receives that the 2nd RTCP sender report sends the 2nd RTCP receiving terminal report to receiving terminal.To make transmitting terminal record first time stamp, second time stamp, 3rd time stamp and the 4th time stamp, first time stamp is the moment that transmitting terminal sends a RTCP sender report, second time stamp is the moment that transmitting terminal receives a RTCP receiving terminal report, 3rd time stamp is the moment that transmitting terminal sends the 2nd RTCP sender report, 4th time stamp is the moment that transmitting terminal receives the 2nd RTCP receiving terminal report, and according to the first time stamp, second time stamp, 3rd time stamp, 4th time stamp, first processing delay and the second processing delay obtain the delay jitter of I frame, if the delay jitter of I frame is greater than dithering threshold, encode in the interval then increasing adjacent I frame.Thus the adjustment of I frame period is carried out in the shake achieved according to I frame, thus while guarantee video data stream decoding quality, avoid and that cause video card pause phenomenon uneven due to I dither frame.

A kind of I framing control system schematic that Fig. 5 provides for the embodiment of the present invention, this system comprises: be above-mentionedly arranged at the I framing control device of transmitting terminal and the above-mentioned I framing control device being arranged at receiving terminal.Concrete, with reference to Fig. 5, the adjusting module 13 of transmitting terminal is connected with sending module 10 by the video coding layer of transmitting terminal.Wherein, the sending module 10 of transmitting terminal is in transmission RTP bag, sender report (this sender report can be the first sender report or the second sender report); While the receiving terminal report (report of this receiving terminal can be the first receiving terminal report or the report of the second receiving terminal) that receiver module 11 sends at the sending module 21 receiving receiving terminal, sending module 10 and receiver module 11 can send I dither frame parameter to processing module 12, and this I dither frame parameter comprises mentioned above: the first time stamp, the second time stamp, the 3rd time stamp, the 4th time stamp, the first processing delay and the second processing delay.Processing module 12 according to this I dither frame parameter of I dither frame reference record, and obtains the delay jitter of I frame according to the first time stamp, the second time stamp, the 3rd time stamp, the 4th time stamp, the first processing delay and the second processing delay.If the delay jitter of I frame is greater than dithering threshold, adjusting module 13 increases the interval of adjacent I frame, the configuration of I frame period is adjusted, and the encoder of notifying transmitting terminal video coding layer according to new I frame period to coding video data, and send to receiving terminal receiver module 20 by sending module 10.Thus the adjustment of I frame period is carried out in the shake achieved according to I frame, thus while guarantee video data stream decoding quality, avoid and that cause video card pause phenomenon uneven due to I dither frame.

One of ordinary skill in the art will appreciate that: all or part of step realizing above-mentioned each embodiment of the method can have been come by the hardware that program command is relevant.Aforesaid program can be stored in a computer read/write memory medium.This program, when performing, performs the step comprising above-mentioned each embodiment of the method; And aforesaid storage medium comprises: ROM, RAM, magnetic disc or CD etc. various can be program code stored medium.

Last it is noted that above each embodiment is only in order to illustrate technical scheme of the present invention, be not intended to limit; Although with reference to foregoing embodiments to invention has been detailed description, those of ordinary skill in the art is to be understood that: it still can be modified to the technical scheme described in foregoing embodiments, or carries out equivalent replacement to wherein some or all of technical characteristic; And these amendments or replacement, do not make the essence of appropriate technical solution depart from the scope of various embodiments of the present invention technical scheme.

Claims (21)

1. an I framing control method, is characterized in that, comprising:

Transmitting terminal sends an I frame real time transport protocol RTP to receiving terminal at every turn and wraps, corresponding each described I frame RTP wraps and sends the first real-time transfer control agreement RTCP sender report to described receiving terminal, a described RTCP sender report associates with I frame, and a described RTCP sender report adopts special bit to be designated the special report of corresponding I frame;

Described transmitting terminal receives the RTCP receiving terminal report that described receiving terminal sends, a described RTCP receiving terminal report associates with I frame, a described RTCP receiving terminal report comprises the first processing delay, and described first processing delay is the time delay that described receiving terminal receives that described first sender report sends described first receiving terminal report to described receiving terminal;

Described transmitting terminal sends the 2nd RTCP sender report based on RTCP report interval to described receiving terminal;

Described transmitting terminal receives the 2nd RTCP receiving terminal report that described receiving terminal sends based on RTCP report interval, described 2nd RTCP receiving terminal report comprises the second processing delay, and described second processing delay is the time delay that described receiving terminal receives that described 2nd RTCP sender report sends described 2nd RTCP receiving terminal report to described receiving terminal;

Described transmitting terminal record first time stamp, the second time stamp, the 3rd time stamp and the 4th time stamp, described first time stamp is that described transmitting terminal sends the moment of a described RTCP sender report, described second time stamp is that described transmitting terminal receives the moment of a described RTCP receiving terminal report, described 3rd time stamp is that described transmitting terminal sends the moment of the 2nd RTCP sender report, described 4th time stamp is the moment that described transmitting terminal receives described 2nd RTCP receiving terminal report;

Described transmitting terminal obtains the delay jitter of described I frame according to described first time stamp, described second time stamp, described 3rd time stamp, described 4th time stamp, described first processing delay and described second processing delay;

If the delay jitter of described I frame is greater than dithering threshold, then encode in the interval increasing adjacent I pin.

2. method according to claim 1, is characterized in that, described transmitting terminal obtains the delay jitter of described I frame according to described first time stamp, described second time stamp and described processing delay, comprising:

The effective transmission time delay of described I frame is obtained by formula below:

$D_{\mathrm{Ik}}=\left(\underset{n=1}{\overset{N}{\mathrm{\Σ}}}\frac{T_{{\mathrm{RR}}_{\mathrm{sn}}\mathrm{Ikn}}-T_{{\mathrm{SR}}_{\mathrm{sn}}\mathrm{Ikn}}-{\mathrm{DLSR}}_{\mathrm{Ikn}}}{2}\right)\÷N$

Wherein, described D _ikfor the effective transmission time delay of a described kth I frame, described in for described transmitting terminal sends the first time stamp of a described RTCP sender report, a described RTCP sender report is wrapped corresponding with the n-th RTP of a described kth I frame, described in for described transmitting terminal receives the second time stamp of a described RTCP receiving terminal report, a described RTCP receiving terminal report is wrapped corresponding with the n-th RTP of a described kth I frame, described DLSR _infor the first processing delay that described RTCP receiving terminal report comprises, N decomposes by the described kth I frame corresponding RTP bag number, and should be the integer being more than or equal to 1, the span of described n is [1, N], and described k is the call number of the I frame of journal;

Effective transmission time delay by the frame of video of formula acquisition below:

$D_l=\frac{T_{{\mathrm{RR}}_l}-T_{{\mathrm{SR}}_l}-{\mathrm{DLSR}}_l}{2}$

Wherein, described D _lfor the effective transmission time delay of rtp streaming data, described in for described three time stamp corresponding based on the described 2nd RTCP sender report of time interval transmission, described in for receiving described 2nd RTCP receiving terminal based on the time interval report the 4th corresponding time stamp, described DLSR with described _lfor the second processing delay that the report of described standard RTCP receiving terminal comprises, described l is the call number of the RTCP sent according to the order of sequence based on the time interval report of journal;

The delay jitter of described I frame is obtained by formula below:

D ^I _jetter=D _{Ik_avg}-D _{l_avg}

Wherein, described D ⁱ _jetterfor the delay jitter of described I frame, described D _{ik_avg}for propagation delay time long-term level and smooth of described I frame, described D _{l_avg}for propagation delay time long-term level and smooth of frame of video;

Described D is obtained by formula below _{ik_avg}:

$D_{\mathrm{Ik}\_\mathrm{avg}}={\∂}_1\×D_{I(k-1)}+(1-{\∂}_1)D_{\mathrm{Ik}}$

Wherein, described in for carrying out filtering factor level and smooth for a long time to I frame effective transmission time delay, span is [0.0,1.0], described D _{l (k-1)}for the effective transmission time delay of kth-1 I frame;

The long-term level and smooth of the propagation delay time of described frame of video is obtained by formula below:

$D_{l\_\mathrm{avg}}={\∂}_2\×D_{l-1}+(1-{\∂}_2)D_l$

Wherein, described in for carrying out filtering factor level and smooth for a long time to frame of video effective transmission time delay, span is [0.0,1.0], described D _l-1be the effective transmission time delay of l-1 described 2nd RTCP report, described D _lit is the effective transmission time delay of l described 2nd RTCP report.

3. method according to claim 2, is characterized in that, if there is a described RTCP sender report or a described RTCP receiving terminal report loss cannot calculate, then obtains described D by formula below _ik:

D _Ik=D _Max

Wherein, described D _maxfor defined maximum transmitted time delay;

If there is described 2nd RTCP sender report or described 2nd RTCP receiving terminal report loss cannot calculate, then obtain described D by formula below _l:

D _l=D _Max。

4. the method according to claim 1-3 any one, is characterized in that, described dithering threshold comprises: the first dithering threshold and the second dithering threshold;

If the delay jitter of described I frame is greater than dithering threshold, then encoding in the interval increasing adjacent I pin, comprising:

If described D ⁱ _jetterbe greater than described first dithering threshold, then trigger the conversion of I frame, every an I frame, next I frame is converted to P frame or B frame is encoded, and often changes an I frame format, then 1 is added to accumulative conversion times m;

Reach M time when described m value is accumulative, described M is more than or equal to the integer of 1 or described D ⁱ _jetterbe greater than described second dithering threshold for R time continuously, then increase the interval of adjacent I frame, described R be more than or equal to 1 integer, described second dithering threshold is greater than described first dithering threshold;

Wherein, the interval of new adjacent I frame is obtained by following formula:

D _{Ist_new}=D _{Ist_old}+D _iststep

Wherein, described D _{ist_new}for the interval of described adjacent I frame newly, described D _{ist_old}for the I frame period that the last time adopts, described D _iststepfor the step-length that the I frame period preset changes.

5. method according to claim 4, is characterized in that, described D _{ist_old}initial value is D _{ist_I}, described D _{ist_I}for the interval of the adjacent I frame of standard.

6. method according to claim 4, is characterized in that, if described D _{ist_new}be more than or equal to spacer maximum value, then the interval value of described adjacent I frame is newly described spacer maximum value.

7. method according to claim 4, is characterized in that, also comprises:

If described accumulative conversion times m does not reach M time, and described D ⁱ _jetterbe less than or equal to described first dithering threshold, then stop I frame switching motion.

8. method according to claim 4, is characterized in that, also comprises:

If described D ⁱ _jetterbe less than or equal to described second dithering threshold for R time continuously, then reduce I frame period; Wherein, the interval D of new adjacent I frame _{ist_new}obtained by following formula:

D _{Ist_new}=D _{Ist_old}-D _iststep。

9. method according to claim 8, is characterized in that, if described D _{ist_new}be less than or equal to the interval D of the adjacent I frame of standard _{ist_I}, then the interval value of described adjacent I frame is newly described D _{ist_I}.

10. an I framing control method, is characterized in that, comprising:

Receiving terminal receives one the first real-time transfer control agreement RTCP sender report that transmitting terminal sends, and a described RTCP sender report associates with I frame, and a described RTCP sender report adopts special bit to be designated the special report of corresponding I frame;

Described receiving terminal sends a RTCP receiving terminal report to described transmitting terminal, a described RTCP receiving terminal report associates with I frame, a described RTCP receiving terminal report comprises the first processing delay, and described first processing delay is the time delay that described receiving terminal receives that a described RTCP sender report sends a described RTCP receiving terminal report to described receiving terminal;

Described receiving terminal receives the 2nd RTCP sender report that described transmitting terminal sends based on RTCP report interval;

Described receiving terminal sends the 2nd RTCP receiving terminal report based on RTCP report interval to described transmitting terminal, described 2nd RTCP receiving terminal report comprises the second processing delay, and described second processing delay is the time delay that described receiving terminal receives that described 2nd RTCP sender report sends described 2nd RTCP receiving terminal report to described receiving terminal.

11. 1 kinds of I framing control devices, is characterized in that, comprising:

Sending module, wrap for sending an I frame real time transport protocol RTP to receiving terminal at every turn, corresponding each described I frame RTP wraps and sends the first real-time transfer control agreement RTCP sender report to described receiving terminal, a described RTCP sender report associates with I frame, and a described RTCP sender report adopts special bit to be designated the special report of corresponding I frame;

Receiver module, for receiving the RTCP receiving terminal report that described receiving terminal sends, a described RTCP receiving terminal report associates with I frame, a described RTCP receiving terminal report comprises the first processing delay, and described first processing delay is the time delay that described receiving terminal receives that described first sender report sends described first receiving terminal report to described receiving terminal;

Described sending module, also for sending the 2nd RTCP sender report based on RTCP report interval to described receiving terminal;

Described receiver module, also for receiving the 2nd RTCP receiving terminal report that described receiving terminal sends based on RTCP report interval, described 2nd RTCP receiving terminal report comprises the second processing delay, and described second processing delay is the time delay that described receiving terminal receives that described 2nd RTCP sender report sends described 2nd RTCP receiving terminal report to described receiving terminal;

Processing module, for recording the first time stamp, the second time stamp, the 3rd time stamp and the 4th time stamp, described first time stamp is that described transmitting terminal sends the moment of a described RTCP sender report, described second time stamp is that described transmitting terminal receives the moment of a described RTCP receiving terminal report, described 3rd time stamp is that described transmitting terminal sends the moment of the 2nd RTCP sender report, described 4th time stamp is the moment that described transmitting terminal receives described 2nd RTCP receiving terminal report;

Described processing module, also for obtaining the delay jitter of described I frame according to described first time stamp, described second time stamp, described 3rd time stamp, described 4th time stamp, described first processing delay and described second processing delay;

Adjusting module, if be greater than dithering threshold for the delay jitter of described I frame, then encode in the interval increasing adjacent I pin.

12. devices according to claim 11, is characterized in that, described processing module, specifically for obtaining the effective transmission time delay of described I frame by formula below:

$D_{\mathrm{Ik}}=\left(\underset{n=1}{\overset{N}{\mathrm{\Σ}}}\frac{T_{{\mathrm{RR}}_{\mathrm{sn}}\mathrm{Ikn}}-T_{{\mathrm{SR}}_{\mathrm{sn}}\mathrm{Ikn}}-{\mathrm{DLSR}}_{\mathrm{Ikn}}}{2}\right)\÷N$

Wherein, described D _ikfor the effective transmission time delay of a described kth I frame, described in for described transmitting terminal sends the first time stamp of a described RTCP sender report, a described RTCP sender report is wrapped corresponding with the n-th RTP of a described kth I frame, described in for described transmitting terminal receives the second time stamp of a described RTCP receiving terminal report, a described RTCP receiving terminal report is wrapped corresponding with the n-th RTP of a described kth I frame, described DLSR _infor the first processing delay that described RTCP receiving terminal report comprises, N decomposes by the described kth I frame corresponding RTP bag number, and should be the integer being more than or equal to 1, the span of described n is [1, N], and described k is the call number of the I frame of journal;

Described processing module, specifically also for the effective transmission time delay by the frame of video of formula acquisition below:

$D_l=\frac{T_{{\mathrm{RR}}_l}-T_{{\mathrm{SR}}_l}-{\mathrm{DLSR}}_l}{2}$

Wherein, described D _lfor the effective transmission time delay of rtp streaming data, described in for described three time stamp corresponding based on the described 2nd RTCP sender report of time interval transmission, described in for receiving described 2nd RTCP receiving terminal based on the time interval report the 4th corresponding time stamp, described DLSR with described _lfor the second processing delay that the report of described standard RTCP receiving terminal comprises, described l is the call number of the RTCP sent according to the order of sequence based on the time interval report of journal;

Described processing module, specifically also for obtaining the delay jitter of described I frame by formula below:

D ^I _jetter=D _{Ik_avg}-D _{l_avg}

Wherein, described D ⁱ _jetterfor the delay jitter of described I frame, described D _{ik_avg}for propagation delay time long-term level and smooth of described I frame, described D _{l_avg}for propagation delay time long-term level and smooth of frame of video;

Described processing module, specifically also for obtaining described D by formula below _{ik_avg}:

$D_{\mathrm{Ik}\_\mathrm{avg}}={\∂}_1\×D_{I(k-1)}+(1-{\∂}_1)D_{\mathrm{Ik}}$

Wherein, described in for carrying out filtering factor level and smooth for a long time to I frame effective transmission time delay, span is [0.0,1.0], described D _{l (k-1)}for the effective transmission time delay of kth-1 I frame;

Described processing module, specifically also for being obtained the long-term level and smooth of the propagation delay time of described frame of video by formula below:

$D_{l\_\mathrm{avg}}={\∂}_2\×D_{l-1}+(1-{\∂}_2)D_l$

Wherein, described in for carrying out filtering factor level and smooth for a long time to frame of video effective transmission time delay, span is [0.0,1.0], described D _l-1be the effective transmission time delay of l-1 described 2nd RTCP report, described D _lit is the effective transmission time delay of l described 2nd RTCP report.

13. devices according to claim 12, is characterized in that, described processing module, if specifically also for there is a described RTCP sender report or a described RTCP receiving terminal report loss cannot calculate, then obtain described D by formula below _ik:

D _Ik=D _Max

Wherein, described D _maxfor defined maximum transmitted time delay;

Described processing module, if specifically also for there is described 2nd RTCP sender report or described 2nd RTCP receiving terminal report loss cannot calculate, then obtain described D by formula below _l:

D _l=D _Max。

14. devices according to claim 11-13 any one, it is characterized in that, described dithering threshold comprises: the first dithering threshold and the second dithering threshold;

Described adjusting module, if specifically for described D ⁱ _jetterbe greater than described first dithering threshold, then trigger the conversion of I frame, every an I frame, next I frame is converted to P frame or B frame is encoded, and often changes an I frame format, then 1 is added to accumulative conversion times m;

Described adjusting module, specifically for reaching M time when described m value is accumulative, described M is more than or equal to the integer of 1 or described D ⁱ _jetterbe greater than described second dithering threshold for R time continuously, then increase the interval of adjacent I frame, described R be more than or equal to 1 integer, described second dithering threshold is greater than described first dithering threshold;

Described processing module is also for obtaining the interval of new adjacent I frame by following formula:

D _{Ist_new}=D _{Ist_old}+D _iststep

Wherein, described D _{ist_new}for the interval of described first adjacent I frame, described D _{ist_old}for the I frame period that the last time adopts, described D _iststepfor the step-length that the I frame period preset changes.

15. devices according to claim 14, is characterized in that, described D _{ist_old}initial value is D _{ist_I}, described D _{ist_I}for the interval of the adjacent I frame of standard.

16. devices according to claim 14, is characterized in that, described adjusting module, if specifically also for described D _{ist_new}be more than or equal to spacer maximum value, then the interval value of described adjacent I frame is newly described spacer maximum value.

17. devices according to claim 14, is characterized in that, described adjusting module, if also do not reach M time for described accumulative conversion times m, and described D ⁱ _jetterbe less than or equal to described first dithering threshold, then stop I frame switching motion.

18. devices according to claim 14, is characterized in that, described adjusting module, if also for described D ⁱ _jetterbe less than or equal to described second dithering threshold for R time continuously, then reduce I frame period;

Described processing module is also for obtaining the interval D of new adjacent I frame by following formula _{ist_new}:

D _{Ist_new}=D _{Ist_old}-D _iststep。

19. devices according to claim 18, is characterized in that, described adjusting module, if specifically also for described D _{ist_new}be less than or equal to the interval D of the adjacent I frame of standard _{ist_I}, then the interval value of described adjacent I frame is newly described D _{ist_I}.

20. 1 kinds of I framing control devices, is characterized in that, comprising:

Receiver module, for receiving one the first real-time transfer control agreement RTCP sender report that transmitting terminal sends, a described RTCP sender report associates with I frame, and a described RTCP sender report adopts special bit to be designated the special report of corresponding I frame;

Sending module, for sending a RTCP receiving terminal report to described transmitting terminal, a described RTCP receiving terminal report associates with I frame, a described RTCP receiving terminal report comprises the first processing delay, and described first processing delay is the time delay that described receiving terminal receives that a described RTCP sender report sends a described RTCP receiving terminal report to described receiving terminal;

Described receiver module, also for receiving the 2nd RTCP sender report that described transmitting terminal sends based on RTCP report interval;

Described sending module, also for sending the 2nd RTCP receiving terminal report based on RTCP report interval to described transmitting terminal, described 2nd RTCP receiving terminal report comprises the second processing delay, and described second processing delay is the time delay that described receiving terminal receives that described 2nd RTCP sender report sends described 2nd RTCP receiving terminal report to described receiving terminal.

21. 1 kinds of I framing control systems, is characterized in that, comprising: the I framing control device described in claim 11-19 any one, described I framing control device according to claim 20.