CN105376614A - Video quality optimizing method and device - Google Patents
Video quality optimizing method and device Download PDFInfo
- Publication number
- CN105376614A CN105376614A CN201510707561.XA CN201510707561A CN105376614A CN 105376614 A CN105376614 A CN 105376614A CN 201510707561 A CN201510707561 A CN 201510707561A CN 105376614 A CN105376614 A CN 105376614A
- Authority
- CN
- China
- Prior art keywords
- client
- current network
- time
- code check
- state
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/25—Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
- H04N21/266—Channel or content management, e.g. generation and management of keys and entitlement messages in a conditional access system, merging a VOD unicast channel into a multicast channel
- H04N21/2662—Controlling the complexity of the video stream, e.g. by scaling the resolution or bitrate of the video stream based on the client capabilities
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/442—Monitoring of processes or resources, e.g. detecting the failure of a recording device, monitoring the downstream bandwidth, the number of times a movie has been viewed, the storage space available from the internal hard disk
- H04N21/44209—Monitoring of downstream path of the transmission network originating from a server, e.g. bandwidth variations of a wireless network
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/478—Supplemental services, e.g. displaying phone caller identification, shopping application
- H04N21/4788—Supplemental services, e.g. displaying phone caller identification, shopping application communicating with other users, e.g. chatting
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client
- H04N21/63—Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
- H04N21/637—Control signals issued by the client directed to the server or network components
- H04N21/6371—Control signals issued by the client directed to the server or network components directed to network
Abstract
The invention discloses a video quality optimizing method. The method comprises the steps that when video frame jamming time of a first client exceeds first preset time, the first client sends a code rate reducing instruction to a second client, so that the second client returns response according to the code rate reducing instruction; when the response returned by the second client is received, whether the present network is in an unblocked state is determined according to a preset algorithm; and when the present network is in the unblocked state, a code rate recovering instruction is sent to a second client, so that the second client transmits video data to the first client according to the code rate in the unblocked state. The invention also discloses a video quality optimizing device. When jamming occurs in the present video frame, the sharpness of the video frame is reduced to prevent serious frame jamming, and user experience is improved.
Description
Technical field
The present invention relates to video network technical field, particularly relate to a kind of video quality optimization method and device.
Background technology
Along with popularizing of intelligent television, the Video chat application on intelligent television is more and more accepted and knows.Because the Video chat on intelligent television is simple to operate, without the need to being concerned about power consumption and flow, screen is enough large, and can bring the experience as video conference, therefore, increasing user likes Video chat on intelligent television.But because intelligent television is by the condition of software and hardware own and probabilistic restriction of network condition, also there is uncertainty in video quality.When intelligent television is when network condition is good, the quality of video is usually no problem; And when a small amount of packet loss (within 20%) or slight time delay (within 1s) appear in network, certain time delay and card may be there is in picture, but video quality is in still acceptable scope, and when network condition become suddenly very poor time, the sharply decline of network capacity, there will be Video chat picture and feel serious immediately, even block motionless phenomenon, reduce Consumer's Experience effect.
Foregoing, only for auxiliary understanding technical scheme of the present invention, does not represent and admits that foregoing is prior art.
Summary of the invention
Main purpose of the present invention is to provide a kind of video quality optimization method and device, is intended to solution existing when network state becomes very poor suddenly, there will be video pictures and feel serious immediately, even block motionless technical problem.
For achieving the above object, a kind of video quality optimization method provided by the invention, comprises step:
When the time that the first client video pictures card pauses more than the first Preset Time time, described first client sends and reduces the instruction of code check to the second client, returns response for described second client according to the instruction of described reduction code check;
When receive described second client return response time, judge whether current network is in unimpeded state according to preset algorithm;
When described current network is in unimpeded state, sends and recover the instruction of code check to described second client, code check when being in unimpeded state for described second client according to current network sends video data to described first client.
Preferably, described when receive described second client return response time, judge that the step whether current network is in unimpeded state comprises according to preset algorithm:
When receive described second client return response time, described current network is labeled as low bit-rate state, and judges whether current network is in unimpeded state according to preset algorithm;
Described when described current network is in unimpeded state, send and recover the instruction of code check to described second client, code check when being in unimpeded state for described second client according to current network sends video data and comprises to the step of described first client:
When described current network is in unimpeded state, judge that whether described current network is in the time of low bit-rate state more than the second Preset Time;
When the time that described current network is in low bit-rate state exceedes described second Preset Time, send and recover the instruction of code check to described second client, code check when being in unimpeded state for described second client according to current network sends video data to described first client.
Preferably, described when receive described second client return response time, judge that the step whether current network is in unimpeded state comprises according to preset algorithm:
When receive described second client return response time, receive described second client send realtime transmission protocol RTP packet;
Obtain described second client send the time of a RTP packet and send the time of the 2nd RTP packet;
According to obtained Time Calculation receive described RTP packet real time interval and ideal time interval difference;
According to described difference, judge whether described current network is in unimpeded state by Kalman filtering algorithm.
Preferably, when the described time of pausing when the first client video pictures card is more than the first Preset Time, described first client sends and reduces the instruction of code check to the second client, after returning the step of response, also comprises for described second client according to the instruction of described reduction code check:
When do not receive described second client return response time, continue to send and reduce the instruction of code check to described second client.
Preferably, it is described when described current network is in unimpeded state, send and recover the instruction of code check to described second client, code check when being in unimpeded state for described second client according to current network sends video data to after the step of described first client, also comprises:
During the video data that the code check when receiving described second client and being in unimpeded state according to current network sends, described video data is decoded;
When decoding the video data of a frame, exporting information, returning to unimpeded state from congestion state to point out current network described in the user of described first client.
In addition, for achieving the above object, the present invention also provides a kind of video quality optimization device, and described video quality optimization device comprises:
First sending module, for when the time that the first client video pictures card pauses more than the first Preset Time time, described first client sends the instruction of reduction code check to the second client, returns response for described second client according to the instruction of described reduction code check;
Judge module, for when receive described second client return response time, judge whether current network is in unimpeded state according to preset algorithm;
Second sending module, for when described current network is in unimpeded state, send and recover the instruction of code check to described second client, code check when being in unimpeded state for described second client according to current network sends video data to described first client.
Preferably, described judge module, also for when receive described second client return response time, described current network is labeled as low bit-rate state, and judges whether current network is in unimpeded state according to preset algorithm;
Described second sending module comprises:
Judging unit, for when described current network is in unimpeded state, judges that whether described current network is in the time of low bit-rate state more than the second Preset Time;
Transmitting element, for when the time that described current network is in low bit-rate state exceedes described second Preset Time, send and recover the instruction of code check to described second client, code check when being in unimpeded state for described second client according to current network sends video data to described first client.
Preferably, described judge module comprises:
Receiving element, for when receive described second client return response time, receive described second client send realtime transmission protocol RTP packet;
Acquiring unit, sends the time of a RTP packet for obtaining described second client and sends the time of the 2nd RTP packet;
Computing unit, for receive according to obtained Time Calculation described RTP packet real time interval and ideal time interval difference;
By Kalman filtering algorithm, judging unit, for according to described difference, judges whether described current network is in unimpeded state.
Preferably, described first sending module, also for when do not receive described second client return response time, continue to send and reduce the instruction of code check to described second client.
Preferably, described video quality optimization device also comprises:
Described video quality optimization device also comprises:
Decoder module, during the video data sent for the code check when receiving described second client and being in unimpeded state according to current network, decodes to described video data;
Output module, for when decoding the video data of a frame, exporting information, returning to unimpeded state from congestion state to point out current network described in the user of described first client.
The present invention by when the time that the first client video pictures card pauses more than the first Preset Time time, described first client sends the instruction of reduction code check to the second client, response is returned according to the instruction of described reduction code check when receiving described second client, and described current video quality situation is when being in unimpeded state, send and recover the instruction of code check to described second client, code check when being in unimpeded state for described second client according to current network sends video data to described first client.Achieve when network state is in congestion state, namely during network capacity difference, notify that the second client sends video data to described first client with low bit-rate, the first client is made to reduce the transmitting-receiving amount of data, reduce video pictures definition, feel serious immediately to prevent video pictures, even block motionless phenomenon, and when network returns to unimpeded state from congestion state, notify that the second client sends video data with normal code check, recover the definition of video pictures, improve Consumer's Experience.
Accompanying drawing explanation
Fig. 1 is the schematic flow sheet of video quality optimization method first embodiment of the present invention;
Fig. 2 is the schematic flow sheet of video quality optimization method second embodiment of the present invention;
Fig. 3 be in the embodiment of the present invention when receive described second client return response time, judge whether current network is in a kind of schematic flow sheet of unimpeded state according to preset algorithm;
Fig. 4 is the schematic flow sheet of video quality optimization method the 3rd embodiment of the present invention;
Fig. 5 is the high-level schematic functional block diagram of video quality optimization device first embodiment of the present invention;
Fig. 6 is a kind of high-level schematic functional block diagram of the second sending module in the embodiment of the present invention;
Fig. 7 is a kind of high-level schematic functional block diagram of judge module in the embodiment of the present invention;
Fig. 8 is the high-level schematic functional block diagram of video quality optimization device second embodiment of the present invention.
The realization of the object of the invention, functional characteristics and advantage will in conjunction with the embodiments, are described further with reference to accompanying drawing.
Embodiment
Should be appreciated that specific embodiment described herein only in order to explain the present invention, be not intended to limit the present invention.
The invention provides a kind of video quality optimization method.
With reference to the schematic flow sheet that Fig. 1, Fig. 1 are video quality optimization method first embodiment of the present invention.
In the present embodiment, described video quality optimization method comprises:
Step S10, when the time that the first client video pictures card pauses more than the first Preset Time time, described first client sends and reduces the instruction of code check to the second client, returns response for described second client according to the instruction of described reduction code check;
When the user of the first client and the user of the second client are when carrying out video communication, described second client sends video data network capacity and sharply declines, namely when network condition is in congestion state, described second client sends video data in the process of described first client, can there is the loss of video packets of data.After described first client receives described video data, owing to lost some packets in transmitting procedure, then described first client cannot go out a complete picture according to received video data decoding, and the video pictures that the display interface of therefore described first client shows there will be Caton phenomenon.
When the time that video pictures card in described first client display interface pauses more than the first Preset Time time, described first client sends to described second client the instruction reducing code check, returns response for described second client according to the instruction of described reduction code check.Described first client exports prompting message in its display interface, points out its user will reduce the image quality of video, namely reduces code check.As described in the first client by using RTCP (RTPControlProtocol, RTP Control Protocol) instruction of described reduction code check sends to described second client by packet, simultaneously, described first client empties local re-transmission sequence number queue, in order to avoid when sending described RTCP packet to described second client, send the request of the packet of retransmission of lost in the lump to described second client.When described second client receives the instruction of the reduction code check that described first client sends, notify that its encoder reduces the encoder bit rate of video data, and return response to the first client, notify that described first client has reduced the encoder bit rate of described video data.Meanwhile, the video data not reducing encoder bit rate is deleted by described second client from transmit queue, to adapt to the situation of current network congestion, and shields the operation of the video packets of data of losing before it retransmits.Described first client and described second client are the equipment that can carry out video communication, include but not limited to intelligent television and mobile phone.Described first Preset Time sets as the case may be, as 1 second can be set to, and 2 seconds, 3 seconds etc.As in the present embodiment, described first Preset Time is set to 2 seconds.
Step S20, when receive described second client return response time, judge whether current network is in unimpeded state according to preset algorithm;
When described first client receive described second client according to the instruction of described reduction code check return response time, namely, when described first client has started to receive described second client by low bit-rate transmission video data, according to preset algorithm, described first client has judged whether current network is in congestion state.Described first client is according to the RTP (Real-timeTransportProtocol receiving the video data that described second client sends, RTP) time of packet, judge whether current network is in congestion state according to preset algorithm.Described preset algorithm is the algorithm judging that whether network congested, as described in preset algorithm be: the throughput of network and communication subnet load (packet count namely transmitted in communication subnet) have close relationship.When communication subnet duty ratio is less, the throughput (packet count/second) of network linearly increases with the increase of network load (average divided into groups in each node).After network load is increased to a certain value, if network throughput declines on the contrary, then there is congestion phenomenon in characterizing network.
Step S30, when described current network is in unimpeded state, sends and recovers the instruction of code check to described second client, and code check when being in unimpeded state for described second client according to current network sends video data to described first client.
When described first client judges that described current network is in unimpeded state, send the instruction of recovery code check to described second client, code check when being in unimpeded state for described second client according to current network sends video data to described first client, recovers the image quality of described video.When described second client receives the instruction of described recovery code check, notify its encoder return to network unimpeded time encoder bit rate, namely return to normal code check state.
The present embodiment by when the time that the first client video pictures card pauses more than the first Preset Time time, described first client sends the instruction of reduction code check to the second client, response is returned according to the instruction of described reduction code check when receiving described second client, and described current video quality situation is when being in unimpeded state, send and recover the instruction of code check to described second client, code check when being in unimpeded state for described second client according to current network sends video data to described first client.Achieve when network state is in congestion state, namely during network capacity difference, notify that the second client sends video data to described first client with low bit-rate, the first client is made to reduce the transmitting-receiving amount of data, reduce video pictures definition, feel serious immediately to prevent video pictures, even block motionless phenomenon, and when network returns to unimpeded state from congestion state, notify that the second client sends video data with normal code check, recover the definition of video pictures, improve Consumer's Experience.
With reference to the schematic flow sheet that Fig. 2, Fig. 2 are video quality optimization method second embodiment, based on the first embodiment, video quality optimization method second embodiment of the present invention is proposed.
In the present embodiment, described step S20 comprises:
Step S21, when receive described second client return response time, described current network is labeled as low bit-rate state, and judges whether current network is in unimpeded state according to preset algorithm;
When described first client receive described second client according to the instruction of described reduction code check return response time, described current network is labeled as low bit-rate state, allow to send to described second client the instruction recovering code check, and judge whether current network is in unimpeded state according to preset algorithm.When described first client do not receive described second client according to the instruction of described reduction code check return response time, current network is made to keep normal code check state, be not labeled as low bit-rate state, and do not allow the instruction sending recovery code check to described second client, continue transmission and reduce the instruction of code check to described second client.
Described step S30 comprises:
Step S31, when described current network is in unimpeded state, judges that whether described current network is in the time of low bit-rate state more than the second Preset Time;
When described first client judges that current network is in unimpeded state, namely when described first client video pictures Caton phenomenon is eliminated, when video pictures quality is recovered, judge that whether described current network is in the time of low bit-rate state more than the second Preset Time.Described second Preset Time can be arranged according to real needs, as being set to 15 seconds, and 20 seconds, 25 seconds etc.In the present embodiment, described second Preset Time is 20 seconds.
Step S32, when the time that described current network is in low bit-rate state exceedes described second Preset Time, send and recover the instruction of code check to described second client, code check when being in unimpeded state for described second client according to current network sends video data to described first client.
When described first client judges that the time that described current network is in low bit-rate state exceedes described second Preset Time, described current network is switched to normal code check state from described low bit-rate state, the low encoder bit rate being about to be in congestion state returns to encoder bit rate during described unimpeded state, and send and recover the instruction of code check to described second client, code check when being in unimpeded state for described second client according to current network sends video data to described first client.When described first client judges that the time that described current network is in low bit-rate state does not exceed described second Preset Time, described current network continues to keep low bit-rate state, until the time that described current network is in low bit-rate state exceedes described second Preset Time.
The present embodiment by time of being in low bit-rate state in current network more than the second Preset Time time, just send recover code check instruction to described second client.Thus avoid network and be in congestion state in last second, and be just converted to unimpeded state from congestion state in next second, then one second again from unimpeded condition conversion be congestion state, cause needing frequent transmission to recover the order of code check to the phenomenon of described second client, improve Consumer's Experience effect.
With reference to Fig. 3, Fig. 3 be in the embodiment of the present invention when receive described second client return response time, judge whether current network is in a kind of schematic flow sheet of unimpeded state according to preset algorithm.
In the present embodiment, step S20 comprises:
Step S21, when receive described second client return response time, receive described second client send realtime transmission protocol RTP packet;
Step S22, obtains described second client and sends the time of a RTP packet and send the time of the 2nd RTP packet;
Step S23, according to obtained Time Calculation receive described RTP packet real time interval and ideal time interval difference;
When described first client receive described second client according to the instruction of described reduction code check return response time, described first client receives the RTP packet of the video data that described second client sends, in the present embodiment, a video data only has a RTP packet.The time t11 of described first client record reception the one RTP packet and the time t21 of reception the 2nd RTP packet, resolve a described RTP packet and described 2nd RTP packet, correspondence obtains the time t12 of the described RTP packet of described second client coding and the time t22 of the described 2nd RTP packet of coding.Encode time of described RTP packet of described second client is stored in described RTP packet by the mode of timestamp.The real time that described first client receives described RTP packet is spaced apart t1=t21-t11, and 1/t1 is then the actual received frame rate that described first client receives described RTP packet; And the ideal time that described first client receives described RTP packet is spaced apart t2=t22-t12,1/t2 is then the desirable received frame rate that described first client receives described RTP packet.Described first client receive described RTP packet real time interval and described ideal time interval difference be Delta=t1-t2.Described first client constantly receives RTP packet, also just constantly produces Delta value.
By Kalman filtering algorithm, step S24, according to described difference, judges whether described current network is in unimpeded state.
Described Delta value is substituted into Kalman kalman filtering algorithm, therefrom can extract data queuing time variable m (ti), when this m (ti) exceedes certain threshold value or m (ti) >m (ti-1) i.e. described m (ti) increases within a certain period of time, so described first client judges that described current network is in congestion state, otherwise described current network is in unobstructed state, in the present embodiment, described threshold value is 25/60.A described video data may comprise multiple RTP packet, and as when a video data is made up of 5 RTP packets, it is t11 that so described first client receives the described video data time, t21, t31, t41, t51, t61 have been exactly first RTP packet of next video data.Encode time of described video data of described second client be t12, t22, t32, t42, t52, t62 has been exactly first RTP packet of the next video data of coding.The real time that then described first client receives described RTP packet is spaced apart t1=t61-t11, and the ideal time that described first client receives described RTP packet is spaced apart t2=t62-t12; Described first client receive described RTP packet real time interval and described ideal time interval difference be Delta=t1-t2.
With reference to the schematic flow sheet that Fig. 4, Fig. 4 are video quality optimization method the 3rd embodiment of the present invention, based on the first embodiment, video quality optimization method the 3rd embodiment of the present invention is proposed.
In the present embodiment, after step S30, also comprise:
Step S40, during the video data that the code check when receiving described second client and being in unimpeded state according to current network sends, decodes to described video data;
Step S50, when decoding the video data of a frame, exporting information, returning to unimpeded state from congestion state to point out current network described in the user of described first client.
When described first client receives the video data that code check when described second client is in unimpeded state according to current network sends, described video data is decoded.When described first client decodes the video data of a frame in the video data that it receives, export information, to point out current network described in the user of described first client to return to unimpeded state from congestion state, video pictures quality described in user is namely pointed out to return to normal condition.
The present embodiment, by when described current network is changed to unimpeded state from congestion state, exports information, and the quality of the video pictures reduced because of network problem before prompting user has been recovered, and further increases the experience effect of user.
The present invention further provides a kind of video quality optimization device.
With reference to the high-level schematic functional block diagram that Fig. 5, Fig. 5 are video quality optimization device first embodiment of the present invention.
In the present embodiment, described video quality optimization device comprises:
First sending module 10, for when the time that the first client video pictures card pauses more than the first Preset Time time, described first client sends the instruction of reduction code check to the second client, returns response for described second client according to the instruction of described reduction code check;
When the user of the first client and the user of the second client are when carrying out video communication, described second client sends video data network capacity and sharply declines, namely when network condition is in congestion state, described second client sends video data in the process of described first client, can there is the loss of video packets of data.After described first client receives described video data, owing to lost some packets in transmitting procedure, then described first client cannot go out a complete picture according to received video data decoding, and the video pictures that the display interface of therefore described first client shows there will be Caton phenomenon.
When the time that video pictures card in described first client display interface pauses more than the first Preset Time time, described first client sends to described second client the instruction reducing code check, returns response for described second client according to the instruction of described reduction code check.Described first client exports prompting message in its display interface, points out its user will reduce the image quality of video, namely reduces code check.As described in the first client by using RTCP (RTPControlProtocol, RTP Control Protocol) instruction of described reduction code check sends to described second client by packet, simultaneously, described first client empties local re-transmission sequence number queue, in order to avoid when sending described RTCP packet to described second client, send the request of the packet of retransmission of lost in the lump to described second client.When described second client receives the instruction of the reduction code check that described first client sends, notify that its encoder reduces the encoder bit rate of video data, and return response to the first client, notify that described first client has reduced the encoder bit rate of described video data.Meanwhile, the video data not reducing encoder bit rate is deleted by described second client from transmit queue, to adapt to the situation of current network congestion, and shields the operation of the video packets of data of losing before it retransmits.Described first client and described second client are the equipment that can carry out video communication, include but not limited to intelligent television and mobile phone.Described first Preset Time sets as the case may be, as 1 second can be set to, and 2 seconds, 3 seconds etc.As in the present embodiment, described first Preset Time is set to 2 seconds.
Judge module 20, for when receive described second client return response time, judge whether current network is in unimpeded state according to preset algorithm;
When described first client receive described second client according to the instruction of described reduction code check return response time, namely, when described first client has started to receive described second client by low bit-rate transmission video data, according to preset algorithm, described first client has judged whether current network is in congestion state.Described first client is according to the RTP (Real-timeTransportProtocol receiving the video data that described second client sends, RTP) time of packet, judge whether current network is in congestion state according to preset algorithm.Described preset algorithm is the algorithm judging that whether network congested, as described in preset algorithm be: the throughput of network and communication subnet load (packet count namely transmitted in communication subnet) have close relationship.When communication subnet duty ratio is less, the throughput (packet count/second) of network linearly increases with the increase of network load (average divided into groups in each node).After network load is increased to a certain value, if network throughput declines on the contrary, then there is congestion phenomenon in characterizing network.
Second sending module 30, for when described current network is in unimpeded state, send and recover the instruction of code check to described second client, code check when being in unimpeded state for described second client according to current network sends video data to described first client.
When described first client judges that described current network is in unimpeded state, send the instruction of recovery code check to described second client, code check when being in unimpeded state for described second client according to current network sends video data to described first client, recovers the image quality of described video.When described second client receives the instruction of described recovery code check, notify its encoder return to network unimpeded time encoder bit rate, namely return to normal code check state.
The present embodiment by when the time that the first client video pictures card pauses more than the first Preset Time time, described first client sends the instruction of reduction code check to the second client, response is returned according to the instruction of described reduction code check when receiving described second client, and described current video quality situation is when being in unimpeded state, send and recover the instruction of code check to described second client, code check when being in unimpeded state for described second client according to current network sends video data to described first client.Achieve when network state is in congestion state, namely during network capacity difference, notify that the second client sends video data to described first client with low bit-rate, the first client is made to reduce the transmitting-receiving amount of data, reduce video pictures definition, feel serious immediately to prevent video pictures, even block motionless phenomenon, and when network returns to unimpeded state from congestion state, notify that the second client sends video data with normal code check, recover the definition of video pictures, improve Consumer's Experience.
With reference to a kind of refinement high-level schematic functional block diagram that Fig. 6, Fig. 6 are the second sending module in the embodiment of the present invention.
In the present embodiment, described judge module 20, also for when receive described second client return response time, described current network is labeled as low bit-rate state, and judges whether current network is in unimpeded state according to preset algorithm;
When described first client receive described second client according to the instruction of described reduction code check return response time, described current network is labeled as low bit-rate state, allow to send to described second client the instruction recovering code check, and judge whether current network is in unimpeded state according to preset algorithm.When described first client do not receive described second client according to the instruction of described reduction code check return response time, current network is made to keep normal code check state, be not labeled as low bit-rate state, and do not allow the instruction sending recovery code check to described second client, continue transmission and reduce the instruction of code check to described second client.
Described second sending module 30 comprises:
Judging unit 31, for when described current network is in unimpeded state, judges that whether described current network is in the time of low bit-rate state more than the second Preset Time;
When described first client judges that current network is in unimpeded state, namely when described first client video pictures Caton phenomenon is eliminated, when video pictures quality is recovered, judge that whether described current network is in the time of low bit-rate state more than the second Preset Time.Described second Preset Time can be arranged according to real needs, as being set to 15 seconds, and 20 seconds, 25 seconds etc.In the present embodiment, described second Preset Time is 20 seconds.
Transmitting element 32, for when the time that described current network is in low bit-rate state exceedes described second Preset Time, send and recover the instruction of code check to described second client, code check when being in unimpeded state for described second client according to current network sends video data to described first client.
When described first client judges that the time that described current network is in low bit-rate state exceedes described second Preset Time, described current network is switched to normal code check state from described low bit-rate state, the low encoder bit rate being about to be in congestion state returns to encoder bit rate during described unimpeded state, and send and recover the instruction of code check to described second client, code check when being in unimpeded state for described second client according to current network sends video data to described first client.When described first client judges that the time that described current network is in low bit-rate state does not exceed described second Preset Time, described current network continues to keep low bit-rate state, until the time that described current network is in low bit-rate state exceedes described second Preset Time.
The present embodiment by time of being in low bit-rate state in current network more than the second Preset Time time, just send recover code check instruction to described second client.Thus avoid network and be in congestion state in last second, and be just converted to unimpeded state from congestion state in next second, then one second again from unimpeded condition conversion be congestion state, cause needing frequent transmission to recover the order of code check to the phenomenon of described second client, improve Consumer's Experience effect.
With reference to a kind of refinement high-level schematic functional block diagram that Fig. 7, Fig. 7 are judge module in the embodiment of the present invention.
In the present embodiment, described judge module 20 comprises:
Receiving element 21, for when receive described second client return response time, receive described second client send realtime transmission protocol RTP packet;
Acquiring unit 22, sends the time of a RTP packet for obtaining described second client and sends the time of the 2nd RTP packet;
Computing unit 23, for receive according to obtained Time Calculation described RTP packet real time interval and ideal time interval difference;
When described first client receive described second client according to the instruction of described reduction code check return response time, described first client receives the RTP packet of the video data that described second client sends, in the present embodiment, a video data only has a RTP packet.The time t11 of described first client record reception the one RTP packet and the time t21 of reception the 2nd RTP packet, resolve a described RTP packet and described 2nd RTP packet, correspondence obtains the time t12 of the described RTP packet of described second client coding and the time t22 of the described 2nd RTP packet of coding.Encode time of described RTP packet of described second client is stored in described RTP packet by the mode of timestamp.The real time that described first client receives described RTP packet is spaced apart t1=t21-t11, and 1/t1 is then the actual received frame rate that described first client receives described RTP packet; And the ideal time that described first client receives described RTP packet is spaced apart t2=t22-t12,1/t2 is then the desirable received frame rate that described first client receives described RTP packet.Described first client receive described RTP packet real time interval and described ideal time interval difference be Delta=t1-t2.Described first client constantly receives RTP packet, also just constantly produces Delta value.
By Kalman filtering algorithm, judging unit 24, for according to described difference, judges whether described current network is in unimpeded state.
Described Delta value is substituted into Kalman kalman filtering algorithm, therefrom can extract data queuing time variable m (ti), when this m (ti) exceedes certain threshold value or m (ti) >m (ti-1) i.e. described m (ti) increases within a certain period of time, so described first client judges that described current network is in congestion state, otherwise described current network is in unobstructed state, in the present embodiment, described threshold value is 25/60.A described video data may comprise multiple RTP packet, and as when a video data is made up of 5 RTP packets, it is t11 that so described first client receives the described video data time, t21, t31, t41, t51, t61 have been exactly first RTP packet of next video data.Encode time of described video data of described second client be t12, t22, t32, t42, t52, t62 has been exactly first RTP packet of the next video data of coding.The real time that then described first client receives described RTP packet is spaced apart t1=t61-t11, and the ideal time that described first client receives described RTP packet is spaced apart t2=t62-t12; Described first client receive described RTP packet real time interval and described ideal time interval difference be Delta=t1-t2.
With reference to the high-level schematic functional block diagram that Fig. 8, Fig. 8 are video quality optimization device second embodiment of the present invention, based on the first embodiment, video quality optimization device second embodiment of the present invention is proposed.
In the present embodiment, described video quality optimization device also comprises:
Decoder module 40, during the video data sent for the code check when receiving described second client and being in unimpeded state according to current network, decodes to described video data;
Output module 50, for when decoding the video data of a frame, exporting information, returning to unimpeded state from congestion state to point out current network described in the user of described first client.
When described first client receives the video data that code check when described second client is in unimpeded state according to current network sends, described video data is decoded.When described first client decodes the video data of a frame in the video data that it receives, export information, to point out current network described in the user of described first client to return to unimpeded state from congestion state, video pictures quality described in user is namely pointed out to return to normal condition.
The present embodiment, by when described current network is changed to unimpeded state from congestion state, exports information, and the quality of the video pictures reduced because of network problem before prompting user has been recovered, and further increases the experience effect of user.
It should be noted that, in this article, term " comprises ", " comprising " or its any other variant are intended to contain comprising of nonexcludability, thus make to comprise the process of a series of key element, method, article or device and not only comprise those key elements, but also comprise other key elements clearly do not listed, or also comprise by the intrinsic key element of this process, method, article or device.When not more restrictions, the key element limited by statement " comprising ... ", and be not precluded within process, method, article or the device comprising this key element and also there is other identical element.
The invention described above embodiment sequence number, just to describing, does not represent the quality of embodiment.
Through the above description of the embodiments, those skilled in the art can be well understood to the mode that above-described embodiment method can add required general hardware platform by software and realize, hardware can certainly be passed through, but in a lot of situation, the former is better execution mode.Based on such understanding, technical scheme of the present invention can embody with the form of software product the part that prior art contributes in essence in other words, this computer software product is stored in a storage medium (as ROM/RAM, magnetic disc, CD), comprising some instructions in order to make a station terminal equipment (can be mobile phone, computer, server, air conditioner, or video quality equipment etc.) perform method described in each embodiment of the present invention.
These are only the preferred embodiments of the present invention; not thereby the scope of the claims of the present invention is limited; every utilize specification of the present invention and accompanying drawing content to do equivalent structure or equivalent flow process conversion; or be directly or indirectly used in other relevant technical fields, be all in like manner included in scope of patent protection of the present invention.
Claims (10)
1. a video quality optimization method, is characterized in that, described video quality optimization method comprises the following steps:
When the time that the first client video pictures card pauses more than the first Preset Time time, described first client sends and reduces the instruction of code check to the second client, returns response for described second client according to the instruction of described reduction code check;
When receive described second client return response time, judge whether current network is in unimpeded state according to preset algorithm;
When described current network is in unimpeded state, sends and recover the instruction of code check to described second client, code check when being in unimpeded state for described second client according to current network sends video data to described first client.
2. video quality optimization method as claimed in claim 1, is characterized in that, described when receive described second client return response time, judge that the step whether current network is in unimpeded state comprises according to preset algorithm:
When receive described second client return response time, described current network is labeled as low bit-rate state, and judges whether current network is in unimpeded state according to preset algorithm;
Described when described current network is in unimpeded state, send and recover the instruction of code check to described second client, code check when being in unimpeded state for described second client according to current network sends video data and comprises to the step of described first client:
When described current network is in unimpeded state, judge that whether described current network is in the time of low bit-rate state more than the second Preset Time;
When the time that described current network is in low bit-rate state exceedes described second Preset Time, send and recover the instruction of code check to described second client, code check when being in unimpeded state for described second client according to current network sends video data to described first client.
3. video quality optimization method as claimed in claim 1, is characterized in that, described when receive described second client return response time, judge that the step whether current network is in unimpeded state comprises according to preset algorithm:
When receive described second client return response time, receive described second client send realtime transmission protocol RTP packet;
Obtain described second client send the time of a RTP packet and send the time of the 2nd RTP packet;
According to obtained Time Calculation receive described RTP packet real time interval and ideal time interval difference;
According to described difference, judge whether described current network is in unimpeded state by Kalman filtering algorithm.
4. video quality optimization method as claimed in claim 1, it is characterized in that, when the described time of pausing when the first client video pictures card is more than the first Preset Time, described first client sends the instruction of reduction code check to the second client, after returning the step of response for described second client according to the instruction of described reduction code check, also comprise:
When do not receive described second client return response time, continue to send and reduce the instruction of code check to described second client.
5. the video quality optimization method as described in any one of Claims 1-4, it is characterized in that, it is described when described current network is in unimpeded state, send the instruction of recovery code check to described second client, code check when being in unimpeded state for described second client according to current network sends video data to after the step of described first client, also comprises:
During the video data that the code check when receiving described second client and being in unimpeded state according to current network sends, described video data is decoded;
When decoding the video data of a frame, exporting information, returning to unimpeded state from congestion state to point out current network described in the user of described first client.
6. a video quality optimization device, is characterized in that, described video quality optimization device comprises:
First sending module, for when the time that the first client video pictures card pauses more than the first Preset Time time, described first client sends the instruction of reduction code check to the second client, returns response for described second client according to the instruction of described reduction code check;
Judge module, for when receive described second client return response time, judge whether current network is in unimpeded state according to preset algorithm;
Second sending module, for when described current network is in unimpeded state, send and recover the instruction of code check to described second client, code check when being in unimpeded state for described second client according to current network sends video data to described first client.
7. video quality optimization device as claimed in claim 6, it is characterized in that, described judge module, also for when receive described second client return response time, described current network is labeled as low bit-rate state, and judges whether current network is in unimpeded state according to preset algorithm;
Described second sending module comprises:
Judging unit, for when described current network is in unimpeded state, judges that whether described current network is in the time of low bit-rate state more than the second Preset Time;
Transmitting element, for when the time that described current network is in low bit-rate state exceedes described second Preset Time, send and recover the instruction of code check to described second client, code check when being in unimpeded state for described second client according to current network sends video data to described first client.
8. video quality optimization device as claimed in claim 6, it is characterized in that, described judge module comprises:
Receiving element, for when receive described second client return response time, receive described second client send realtime transmission protocol RTP packet;
Acquiring unit, sends the time of a RTP packet for obtaining described second client and sends the time of the 2nd RTP packet;
Computing unit, for receive according to obtained Time Calculation described RTP packet real time interval and ideal time interval difference;
By Kalman filtering algorithm, judging unit, for according to described difference, judges whether described current network is in unimpeded state.
9. video quality optimization device as claimed in claim 6, is characterized in that, described first sending module, also for when do not receive described second client return response time, continue to send reduce code check instruction to described second client.
10. the video quality optimization device as described in any one of claim 6 to 9, is characterized in that, described video quality optimization device also comprises:
Decoder module, during the video data sent for the code check when receiving described second client and being in unimpeded state according to current network, decodes to described video data;
Output module, for when decoding the video data of a frame, exporting information, returning to unimpeded state from congestion state to point out current network described in the user of described first client.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510707561.XA CN105376614A (en) | 2015-10-27 | 2015-10-27 | Video quality optimizing method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510707561.XA CN105376614A (en) | 2015-10-27 | 2015-10-27 | Video quality optimizing method and device |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN105376614A true CN105376614A (en) | 2016-03-02 |
Family
ID=55378349
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201510707561.XA Pending CN105376614A (en) | 2015-10-27 | 2015-10-27 | Video quality optimizing method and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN105376614A (en) |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106411640A (en) * | 2016-09-19 | 2017-02-15 | 北京小米移动软件有限公司 | Video communication fault detection method, device and source communication terminal |
| CN106998328A (en) * | 2017-03-30 | 2017-08-01 | 北京奇艺世纪科技有限公司 | A kind of video transmission method and device |
| CN107734282A (en) * | 2017-08-25 | 2018-02-23 | 北京元心科技有限公司 | Video communication method and device |
| CN112019873A (en) * | 2020-09-08 | 2020-12-01 | 北京金山云网络技术有限公司 | Video code rate adjusting method and device and electronic equipment |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101035365A (en) * | 2007-04-03 | 2007-09-12 | 中国科学院计算技术研究所 | Multimedia session service quality management method under multiple radio network integrated environment |
| CN101483547A (en) * | 2009-02-12 | 2009-07-15 | 中国人民解放军信息工程大学 | Evaluation method and system for network burst affair |
| CN103220585A (en) * | 2012-11-26 | 2013-07-24 | 佛山络威网络技术有限公司 | Network video transmission method supporting quality of service (QoS) |
| CN103248682A (en) * | 2013-04-27 | 2013-08-14 | 华为技术有限公司 | Optimization method and device for bandwidth usage |
| CN104580985A (en) * | 2015-01-30 | 2015-04-29 | 深圳市云之讯网络技术有限公司 | Video bitrate self-adaption method and system |
| CN104618195A (en) * | 2015-02-16 | 2015-05-13 | 腾讯科技（深圳）有限公司 | Bandwidth estimation method and device |
| CN104869461A (en) * | 2015-05-22 | 2015-08-26 | 南京创维信息技术研究院有限公司 | Video data processing system and method |
-
2015
- 2015-10-27 CN CN201510707561.XA patent/CN105376614A/en active Pending
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101035365A (en) * | 2007-04-03 | 2007-09-12 | 中国科学院计算技术研究所 | Multimedia session service quality management method under multiple radio network integrated environment |
| CN101483547A (en) * | 2009-02-12 | 2009-07-15 | 中国人民解放军信息工程大学 | Evaluation method and system for network burst affair |
| CN103220585A (en) * | 2012-11-26 | 2013-07-24 | 佛山络威网络技术有限公司 | Network video transmission method supporting quality of service (QoS) |
| CN103248682A (en) * | 2013-04-27 | 2013-08-14 | 华为技术有限公司 | Optimization method and device for bandwidth usage |
| CN104580985A (en) * | 2015-01-30 | 2015-04-29 | 深圳市云之讯网络技术有限公司 | Video bitrate self-adaption method and system |
| CN104618195A (en) * | 2015-02-16 | 2015-05-13 | 腾讯科技（深圳）有限公司 | Bandwidth estimation method and device |
| CN104869461A (en) * | 2015-05-22 | 2015-08-26 | 南京创维信息技术研究院有限公司 | Video data processing system and method |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106411640A (en) * | 2016-09-19 | 2017-02-15 | 北京小米移动软件有限公司 | Video communication fault detection method, device and source communication terminal |
| CN106411640B (en) * | 2016-09-19 | 2019-12-03 | 北京小米移动软件有限公司 | Video communication fault detection method, device and sources traffic terminal |
| CN106998328A (en) * | 2017-03-30 | 2017-08-01 | 北京奇艺世纪科技有限公司 | A kind of video transmission method and device |
| CN106998328B (en) * | 2017-03-30 | 2019-12-13 | 北京奇艺世纪科技有限公司 | Video transmission method and device |
| CN107734282A (en) * | 2017-08-25 | 2018-02-23 | 北京元心科技有限公司 | Video communication method and device |
| CN112019873A (en) * | 2020-09-08 | 2020-12-01 | 北京金山云网络技术有限公司 | Video code rate adjusting method and device and electronic equipment |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109068187B (en) | Real-time traffic delivery system and method | |
| US8971415B2 (en) | Video communication system, device and method based on feedback reference frames | |
| Kwon et al. | MPMTP: Multipath multimedia transport protocol using systematic raptor codes over wireless networks | |
| KR101122143B1 (en) | Signaling buffer parameters indicative of receiver buffer architecture | |
| CN109600610B (en) | Data encoding method, terminal and computer readable storage medium | |
| CN103580773A (en) | Method and device for transmitting data frame | |
| US10320520B2 (en) | Communication device, system and method | |
| CN102137436A (en) | Radio communication apparatus, radio communication method, communication control apparatus, and program | |
| WO2014035833A2 (en) | Device and method for adaptive rate multimedia communications on a wireless network | |
| CN101552660A (en) | Method as well as device and communication system for retransmitting streaming media data | |
| CN105376614A (en) | Video quality optimizing method and device | |
| CN107104908B (en) | Communication method and device | |
| CN107210843A (en) | Use the system and method for the live video communication of fountain coding | |
| CN104104924A (en) | Third-generation (3G) network based video monitoring system bandwidth self-adaption transmission method | |
| CN102065372B (en) | Method for transmitting data in broadcast mode and related device | |
| Ho et al. | QoS-supporting video streaming system with minimum data service cost over heterogeneous wireless networks | |
| US7729311B2 (en) | Image data communication system and image data communication method | |
| CN114142968A (en) | Data packet transmission method and device, terminal equipment and storage medium | |
| Chen et al. | A qoe-based app layer scheduling scheme for scalable video transmissions over multi-rat systems? | |
| WO2004112420A1 (en) | Medium signal reception device, transmission device, and transmission/reception system | |
| US20230231787A1 (en) | Communication method and an apparatus | |
| D'haenens et al. | Transmitting scalable video with unequal error protection over 802.11 b/g | |
| JP3530094B2 (en) | Data communication device and communication control method | |
| CN109196870B (en) | Method and apparatus for transmitting and receiving MMTP packets | |
| Ho et al. | Networking cost effective video streaming system over heterogeneous wireless networks |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20160302 |