CN101547369A - Fault tolerance method for removing mosaic phenomenon in playing network video - Google Patents
Fault tolerance method for removing mosaic phenomenon in playing network video Download PDFInfo
- Publication number
- CN101547369A CN101547369A CN200810043195A CN200810043195A CN101547369A CN 101547369 A CN101547369 A CN 101547369A CN 200810043195 A CN200810043195 A CN 200810043195A CN 200810043195 A CN200810043195 A CN 200810043195A CN 101547369 A CN101547369 A CN 101547369A
- Authority
- CN
- China
- Prior art keywords
- frame
- idr
- playing
- data frame
- network video
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Abstract
The invention discloses a fault tolerance method for removing a mosaic phenomenon in playing network video, which comprises the following steps: 1, detecting that a data frame in a buffering region of a client playing end has an error; 2, judging the error kind of the data frame and making corresponding measures; 3, judging whether a subsequent data frame contains a synchronous sign, and if so, judging whether the subsequent data frame is an IDR frame; and 4, if the subsequent data frame is the IDR frame, clearing up the data frame in the buffering region of the client playing end, removing the needed synchronous sign and carrying out the normal playing flow; and if the subsequent data frame is not the IDR frame, discharging the data frame, reading the next data frame, judging whether the next data frame is the IDR frame and repeating the step four. The method carries out detection on the data in the buffering region of the client playing end, when a wrong frame or a lost frame is detected, and a subsequent non-IDR frame is discarded to effectively remove the mosaic phenomenon.
Description
Technical field
The present invention relates to the video playback fault-toleranr technique of Computer Multimedia Technology, particularly a kind of fault-tolerance approach of removing mosaic phenomenon in playing network video.
Background technology
The network program request is a technological means commonly used in the network, can cause all mistakes but the programme content of network program request is subjected to the influence of network environment, thereby it is unclear that user side is shown, occurs mosaic phenomenon especially easily.For example, program request impacts to network for data packet loss that may exist in the Network Transmission and time-delay arrival meeting, the user drags progress bar and also can cause link down in on-demand process, the display device of player is lost, and the Frame of decoder decode failure and player is made mistakes and can be influenced the video effect of network program request.
According to the definition of MPEG, frame is divided into the IDR frame, B frame and P frame.Wherein, the IDR frame is a key frame, adopts the reference frame pattern, and compression in the frame only is provided, and when promptly two field picture being compressed to the IDR frame, has only considered the image in the frame.The compression of IDR frame can not be removed interframe redundancy.Compression is based on discrete cosine transform in the frame, is similar to JPEG and the compression standard of use discrete cosine transform in the image H.261.The compression of IDR frame can obtain the 6:1 ratio and not produce any noticeable blooming.The B frame is two-way interframe encode.It extracts data from the IDR frame of front and back or P frame.The B frame compresses based on the difference between present frame and former frame and back one two field picture.B frame compression can reach the 200:1 compression ratio, and its document size is generally 15% of IDR frame reduced size, less than half of P frame reduced size.The P frame has adopted forward prediction, and promptly the P frame is to get according to the P frame of front or the prediction of I frame.The P frame adopts predictive coding, utilizes the general statistical information of consecutive frame to predict.That is to say that it considers kinetic characteristic, and interframe encode is provided.The IDR frame that P frame prediction present frame and front are nearest or the difference of P frame.
When video be with H.264 the coding the ASF file format time, owing to H.264 have flexible macro-block order, by being set, macro-block order shine upon at random the assignment macro block to different sheet groups, but this flexible macro-block order pattern has been upset former macro block order, reduced code efficiency, increase time-delay, but strengthened the performance of anti-error code.When the loss of data of a sheet group, can carry out error concealment with the data of another sheet group.Although the encoder that has is exactly a sheet as the frame of X264, it still can make error concealment with consecutive frame. using the topmost discomfort of fault-toleranr technique of error concealment is to cause mosaic phenomenon, and this can the very big user experience that influences.
Summary of the invention
Technical problem to be solved by this invention provides a kind of fault-tolerance approach of removing mosaic phenomenon in playing network video, can realize the filtering of optimization in the video decode reduction, avoids blank screen and mosaic phenomenon, satisfies user's demand for experience preferably.
For solving the problems of the technologies described above, a kind of technical scheme of removing the fault-tolerance approach of mosaic phenomenon in playing network video of the present invention is may further comprise the steps:
The first step, the Frame that detects in the buffering area of client playing end is wrong;
In second step, judgment data frame error kind if the reconstruction filter link mistake of link down appears then in Frame, and is provided with and needs synchronous mark, if Frame the mistake of the asynchronous or decoding failure of data occurs then directly be provided with needing synchronous mark;
The 3rd step, judge whether subsequent data frame comprises synchronous mark, if do not comprise synchronous mark, then carry out normal playing flow, if comprise synchronous mark, judge that then subsequent data frame is the IDR frame;
The 4th step, if subsequent data frame is the IDR frame, then empty the Frame in the buffering area of client playing end, removing needs synchronous mark, and carries out normal playing flow, if subsequent data frame is not the IDR frame, then abandon this Frame, read next Frame, and judge that this next one Frame is the IDR frame, and repeated for the 4th step.
The present invention is by to the detection of client playing end buffer data, when having detected when makeing mistakes frame or lost frames, abandons follow-up non-IDR frame, up to new IDR frame, so effective removal mosaic phenomenon occurring.
Description of drawings
The present invention is further detailed explanation below in conjunction with drawings and Examples:
Fig. 1 is a schematic flow sheet of the present invention;
Fig. 2 is a client playing end buffer data schematic diagram of the present invention.
Embodiment
As shown in Figure 1, adopt based on DirectShow (DirectShow be Microsoft provide one be enclosed within and carry out the kit that Streaming Media is handled on the windows platform, its supports the seizure and the playback of media stream.) mechanism the player plays Internet video time, need carry out judgment processing to Frame, whether the Frame that at first detects in the buffering area of client playing end is wrong, if there is not mistake, then carry out normal playing program, if the Frame that detects in the buffering area of client playing end is wrong, and judges its error kind.
When the judgment data frame is made mistakes classification, generally be divided into following three kinds of error category: a, the link down mistake appears in Frame; B, the decoder decode failure; C, the data of Frame are asynchronous.When the user dragged progress bar or packet loss occurs, the link down mistake appearred in Frame, needed the reconstruction filter link, and was provided with on the played data frame and needs synchronous mark; When decoder decode failure wrong occurring, mean that data may make mistakes, this is this Frame need be abandoned, and needs directly be provided with on Frame to need synchronous mark; When the nonsynchronous mistake of the data that Frame occurs, then being provided with on Frame needs synchronous mark.If when the Frame mistake not occurring, then not being provided with on Frame needs synchronous mark.
Whether need synchronous mark, if if do not comprise synchronous mark, then carry out normal playing flow, if comprise synchronous mark, judge that then subsequent data frame is the IDR frame if detecting to be provided with on the Frame.In the present invention, IDR is set to 50 to 100 frames coding once, and an IDR frame refresh sequence also can be got 80 frames among the present invention.
In the present invention, the buffering area of client playing end has 20 seconds played data at least, and as shown in Figure 2, the data of the buffering area of client playing end comprise IDR frame and P frame.Wherein, the I frame of IDR frame for refreshing immediately, the image after the IDR frame can be not reference with the image before the IDR frame more, it adopts the reference frame pattern, and compression in the frame only is provided, and the P frame is a forward reference frame, next for referencial use with the frame of front when encoding and decoding, it considers kinetic characteristic, and interframe encode is provided.P1 frame among Fig. 2, P2 frame and P3 frame are frame or the lost frames of makeing mistakes, if play these frames, can cause mosaic phenomenon, and therefore, the present invention abandons this frame, judge that subsequent data frame is the IDR frame.
If subsequent data frame is the IDR frame, then empty the Frame in the buffering area of client playing end, removal needs synchronous mark, and carry out normal playing flow, if subsequent data frame is not the IDR frame, then abandon this Frame, read next Frame, and judge that this next one Frame is the IDR frame, and repeated for the 4th step.
The present invention detects by the data to the client playing end buffering area, in time find the mistake of Frame, and the various mistakes that Frame occurs are done corresponding processing, and abandon follow-up non-IDR frame and play new IDR frame, realize removing the technical goal of Internet video mosaic phenomenon.
Claims (5)
1. a fault-tolerance approach of removing mosaic phenomenon in playing network video is characterized in that, may further comprise the steps:
The first step, the Frame that detects in the buffering area of client playing end is wrong;
In second step, judgment data frame error kind if the reconstruction filter link mistake of link down appears then in Frame, and is provided with and needs synchronous mark, if Frame the mistake of the asynchronous or decoding failure of data occurs then directly be provided with needing synchronous mark;
The 3rd step, judge whether subsequent data frame comprises synchronous mark, if do not comprise synchronous mark, then carry out normal playing flow, if comprise synchronous mark, judge that then subsequent data frame is the IDR frame;
The 4th step, if subsequent data frame is the IDR frame, then empty the Frame in the buffering area of client playing end, removing needs synchronous mark, and carries out normal playing flow, if subsequent data frame is not the IDR frame, then abandon this Frame, read next Frame, and judge that this next one Frame is the IDR frame, and repeated for the 4th step.
2. a kind of fault-tolerance approach of removing mosaic phenomenon in playing network video according to claim 1 is characterized in that the buffering area of client playing end has 20 seconds played data at least.
3. a kind of fault-tolerance approach of removing mosaic phenomenon in playing network video according to claim 1 is characterized in that the data of the buffering area of client playing end comprise IDR frame and P frame.
4. a kind of fault-tolerance approach of removing mosaic phenomenon in playing network video according to claim 1 is characterized in that, described IDR is set to 50 to 100 frames coding once.
5. a kind of fault-tolerance approach of removing mosaic phenomenon in playing network video according to claim 4 is characterized in that, described IDR is set to 80 frames coding once.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2008100431952A CN101547369B (en) | 2008-03-26 | 2008-03-26 | Fault tolerance method for removing mosaic phenomenon in playing network video |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2008100431952A CN101547369B (en) | 2008-03-26 | 2008-03-26 | Fault tolerance method for removing mosaic phenomenon in playing network video |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN101547369A true CN101547369A (en) | 2009-09-30 |
| CN101547369B CN101547369B (en) | 2013-02-06 |
Family
ID=41194194
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN2008100431952A Expired - Fee Related CN101547369B (en) | 2008-03-26 | 2008-03-26 | Fault tolerance method for removing mosaic phenomenon in playing network video |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN101547369B (en) |
Cited By (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101986388A (en) * | 2010-09-06 | 2011-03-16 | 建荣集成电路科技(珠海)有限公司 | MP3 intelligent error detection method |
| CN102752670A (en) * | 2012-06-13 | 2012-10-24 | 广东威创视讯科技股份有限公司 | Method, device and system for reducing phenomena of mosaics in network video transmission |
| CN102883157A (en) * | 2011-07-12 | 2013-01-16 | 浙江大学 | Video coding method and video coder |
| CN103167283A (en) * | 2011-12-19 | 2013-06-19 | 华为技术有限公司 | Video coding method and device |
| US9538137B2 (en) | 2015-04-09 | 2017-01-03 | Microsoft Technology Licensing, Llc | Mitigating loss in inter-operability scenarios for digital video |
| CN106331835A (en) * | 2015-06-26 | 2017-01-11 | 成都鼎桥通信技术有限公司 | Method of dynamically adjusting data reception cache and video decoding device |
| CN107302523A (en) * | 2017-05-26 | 2017-10-27 | 中国科学院西安光学精密机械研究所 | A kind of transport stream packet loss causes the solution of mosaic |
| CN109729380A (en) * | 2018-12-24 | 2019-05-07 | 聚好看科技股份有限公司 | Audio and video playing method and apparatus |
Family Cites Families (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN2466852Y (en) * | 2001-02-28 | 2001-12-19 | 北京瑞斯康达科技发展有限公司 | Opto-electronic signal converter for Ethernet |
| CN101102485A (en) * | 2006-07-07 | 2008-01-09 | 乐金电子（昆山）电脑有限公司 | Audio and video synchronization device and method of mobile terminal |
-
2008
- 2008-03-26 CN CN2008100431952A patent/CN101547369B/en not_active Expired - Fee Related
Cited By (15)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101986388A (en) * | 2010-09-06 | 2011-03-16 | 建荣集成电路科技(珠海)有限公司 | MP3 intelligent error detection method |
| CN102883157A (en) * | 2011-07-12 | 2013-01-16 | 浙江大学 | Video coding method and video coder |
| CN102883157B (en) * | 2011-07-12 | 2015-09-09 | 浙江大学 | Method for video coding and video encoder |
| CN103167283B (en) * | 2011-12-19 | 2016-03-02 | 华为技术有限公司 | A kind of method for video coding and equipment |
| CN103167283A (en) * | 2011-12-19 | 2013-06-19 | 华为技术有限公司 | Video coding method and device |
| WO2013091391A1 (en) * | 2011-12-19 | 2013-06-27 | 华为技术有限公司 | Video encoding method and device |
| CN102752670B (en) * | 2012-06-13 | 2015-11-25 | 广东威创视讯科技股份有限公司 | Reduce method, the Apparatus and system of mosaic phenomenon in Network Video Transmission |
| CN102752670A (en) * | 2012-06-13 | 2012-10-24 | 广东威创视讯科技股份有限公司 | Method, device and system for reducing phenomena of mosaics in network video transmission |
| US9538137B2 (en) | 2015-04-09 | 2017-01-03 | Microsoft Technology Licensing, Llc | Mitigating loss in inter-operability scenarios for digital video |
| CN106331835A (en) * | 2015-06-26 | 2017-01-11 | 成都鼎桥通信技术有限公司 | Method of dynamically adjusting data reception cache and video decoding device |
| CN106331835B (en) * | 2015-06-26 | 2019-06-07 | 成都鼎桥通信技术有限公司 | A kind of dynamic adjusting data receives the method and video decoding apparatus of caching |
| CN107302523A (en) * | 2017-05-26 | 2017-10-27 | 中国科学院西安光学精密机械研究所 | A kind of transport stream packet loss causes the solution of mosaic |
| CN107302523B (en) * | 2017-05-26 | 2019-08-27 | 中国科学院西安光学精密机械研究所 | A kind of transport stream packet loss causes the solution of mosaic |
| CN109729380A (en) * | 2018-12-24 | 2019-05-07 | 聚好看科技股份有限公司 | Audio and video playing method and apparatus |
| CN109729380B (en) * | 2018-12-24 | 2021-07-27 | 聚好看科技股份有限公司 | Audio and video playing method and equipment |
Also Published As
| Publication number | Publication date |
|---|---|
| CN101547369B (en) | 2013-02-06 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN101547369B (en) | Fault tolerance method for removing mosaic phenomenon in playing network video | |
| CN101584221B (en) | Video data loss recovery using low bit rate stream in an IPTV system | |
| CN102264004B (en) | Method and device for preventing deficiency of key frame from causing seek incapability | |
| CN100515068C (en) | Static frame loss method in video playing | |
| MX2020013419A (en) | System and method for encoding 360-degree immersive video. | |
| CN1220065A (en) | System and method for creating trick play video streams from compressed normal play video bitstream | |
| CN103237218A (en) | Image signal decoding apparatus, image signal decoding method, image signal encoding apparatus, image signal encoding method, and program | |
| CN102217272A (en) | Encoder and method for generating a stream of data | |
| CN106603564A (en) | Unlimited high-resolution image and video playing methods and systems | |
| CN101917612A (en) | Streaming media video coding method and device | |
| CN106303379A (en) | A kind of video file backward player method and system | |
| CN101557522A (en) | Adaptive filtering for bit-depth scalable video coder | |
| CN101605252A (en) | Program stream is converted to the method and system of transport stream | |
| CN109168083A (en) | A kind of Streaming Media real time playing method and device | |
| CN101909210A (en) | Network streaming media server and low-bandwidth high-quality solution thereof | |
| TWI423674B (en) | System and method for reducing the zapping time | |
| CN1589025A (en) | Vido decoder based on software and hardware cooperative control | |
| CN105227991B (en) | Reliable video storage method and its device | |
| CN102625104A (en) | Video coding method | |
| CN101138246A (en) | Buffering of video stream data | |
| CN103037209B (en) | The decoding processing method of frame of video and device | |
| CN101192903B (en) | Data frame coding and decoding control method | |
| CN102342117A (en) | Multiview video decoding apparatus and multiview video decoding method | |
| CN113038126B (en) | Multi-description video coding method and decoding method based on frame prediction neural network | |
| CN114339316A (en) | Video stream coding processing method based on live video |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20130206 Termination date: 20200326 |
|
| CF01 | Termination of patent right due to non-payment of annual fee |