CN102256138A - Method for improving video display effect - Google Patents
Method for improving video display effect Download PDFInfo
- Publication number
- CN102256138A CN102256138A CN2010101817473A CN201010181747A CN102256138A CN 102256138 A CN102256138 A CN 102256138A CN 2010101817473 A CN2010101817473 A CN 2010101817473A CN 201010181747 A CN201010181747 A CN 201010181747A CN 102256138 A CN102256138 A CN 102256138A
- Authority
- CN
- China
- Prior art keywords
- frame
- current
- reference cycle
- decoding
- time interval
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Abstract
The invention discloses a method for improving a video display effect. The method particularly comprises the following steps of: (1) determining whether a compressed video bit-stream is required to abandon a current B frame or not by a decoder according to a current decoding speed, normally decoding when the current B frame is not required to be abandoned, or otherwise entering a step (2); (2) determining whether the current B frame is required to be interpolated or not; not interpolating when one frame of the B frame exists in a reference cycle, and only decoding the reference frame of the current B frame; interpolating when the B frame is more than one frame in the reference frame, and entering a step (3); (3) selecting the current B frame to be interpolated; and (4) interpolating the selected current B frame. In the method, on the premise that B frame decoding is abandoned, the B frame which is abandoned to be decoded is selectively interpolated, so that the correlation and the continuity between frames are enhanced, the time for decoding can be saved, and the jumping sense of an image is reduced.
Description
Technical field
The present invention relates to the video playback technology, particularly a kind of method of improving the video playback effect.
Background technology
In recent years, along with entertainment growth in the living standard and video playback development of technology, people increase day by day to the requirement of high-quality video result of broadcast, make the video decode technology be faced with unprecedented test, this be because, in the prior art, when speed of video decoding does not reach requirement, tend to select to abandon the B frame, the mode of B frame of not decoding is come balance decoding speed and play quality, so just caused when having abandoned too much B frame, relevance between residue frame and the frame weakens significantly, it takes the form of: when people watch video, the sense that pauses can appear in broadcasting pictures, and especially when watching the sports tournament scene, such result of broadcast is not often accepted by spectators.
Particularly, as depicted in figs. 1 and 2, be video decode and playing flow block diagram in the prior art, under the situation that the B frame is arranged, decoding order and playing sequence are different, and the B frame generally has two reference frames, and one is forward reference frame I (0), one is reference frame P (4) backward, can know the relation of finding out B frame and reference frame from playing sequence; And the order of decoding is, the necessary reference frame of decoding earlier, the B frame of could decoding again, owing to need when decoding B frame with reference to reference frame P (4) backward, simultaneously, the B frame is not again as the reference frame of other frame, therefore when decoding speed is not enough, can abandon the decoding of B frame, because do not decode the B frame, to the not influence of decoding of subsequent frames.But, abandon the B frame decoding too much, can lose the continuity between frame and the frame, the former video that should watch has not just existed, and therefore, visually is prone to the sense of jumping.
Summary of the invention
The object of the present invention is to provide a kind of method of improving the video playback effect, after abandoning the B frame decoding, optionally the B frame of being abandoned is carried out the B frame interpolation, realization can be accelerated decoding speed by abandoning the B frame, can guarantee play quality again, remove the pause sense in the playing process, eliminated and improved decoding speed and abandon the negative effect that the B frame decoding is brought.
Purpose of the present invention can realize by following scheme: a kind of method of improving the video playback effect is characterized in that specifically may further comprise the steps:
(1) decoder judges according to current decoding speed whether needs abandon current B frame to compressed video stream, when not needing to abandon current B frame, and normal decoder; When needs abandon current B frame, change step (2) over to;
(2) judge whether and to carry out interpolation to current B frame: when a frame B frame is arranged, do not need to carry out interpolation in a reference cycle, only the reference frame of current B frame is decoded; When the B frame that in a reference cycle, has greater than a frame, need carry out interpolation, change step (3) over to;
(3) selection needs the current B frame of interpolation;
(4) selected current B frame is carried out interpolation.
The present invention is under the prerequisite of having abandoned the B frame decoding, selectively the B frame of being abandoned decoding is carried out interpolation, correlation and continuity between frame and the frame have been increased, eliminated in the prior art and abandoned the negative effect that too much B frame decoding is brought because improve decoding speed, not only can save the time of decoding, and reduce the jump sense of picture.
As one embodiment of the present invention, in described step (4), in the decode procedure of compressed video stream, the value that the pixel residual error is set is zero, save inverse quantization and inverse transformation process, with reference to the forward reference frame of current B frame and reference frame backward, predict by direct mode to obtain predict pixel that output has the predictive frame of front and back correlation.The interpolation process of current B frame has been reduced the time of decoded stream, and predict pixel be by current B frame reference frame prediction obtains forward, backward, the relevant predictive frame of current B frame that is with is dropped of output, continuity and correlation before and after therefore can increasing between two frames.
As of the present invention preferred embodiment a kind of, in described step (3), need the current B frame of interpolation to be: when two frame B frames were arranged in a reference cycle, and current B frame is first frame in the current reference cycle; When three frame B frames were arranged in a reference cycle, and current B frame is second frame in the current reference cycle; When having greater than three frame B frames in a reference cycle, and current B frame is an odd-numbered frame in the current reference cycle.The above-mentioned current B frame of being abandoned is carried out interpolation, can realize the optimum balance state between decoding speed and the play quality.
The present invention determines the quantity of B frame in a reference cycle, may further comprise the steps:
(1) time interval of calculating B frame;
(2) time difference of the forward reference frame of the reference frame backward of the current B frame of calculating and current B frame, the i.e. time interval sum of interior all B frames of reference cycle;
(3) with the numerical value of step (2) gained the time interval, deduct 1 then, obtain the quantity of B frame in a reference cycle divided by step (1) gained B frame.
The present invention determines the position of current B frame in a reference cycle, may further comprise the steps:
(1) time difference of current B frame of calculating and forward reference frame, the time interval of promptly current B frame and forward reference frame;
(2) time interval of calculating B frame;
(3) with time interval time difference of step (1) gained, obtain current B frame position in the current reference cycle divided by step (2) gained B frame.
Compared with prior art, the present invention has following significant technique effect:
(1) the present invention is under the prerequisite of having abandoned the B frame decoding, selectively the B frame of being abandoned decoding is carried out interpolation, correlation and continuity between frame and the frame have been increased, eliminated in the prior art and abandoned the negative effect that too much B frame decoding is brought because improve decoding speed, not only can save the time of decoding, and reduce the jump sense of picture.
(2) when selecting to need the B frame of interpolation, be not whenever to abandon a B frame just to insert a frame, but adopt the present invention to select the mode of interpolation B frame, can realize the optimum balance state between decoding speed and the play quality.
(3) the present invention is to the mode of current B frame interpolation, need not the inverse quantization inverse transformation of decoded residual pixel and front and back thereof, also need not to decode motion-vector residual error and macro block header have not only reduced time of decoded stream, export the predictive frame of correlation before and after having again, reduced the jump sense of picture.
(4) the applicable various video decoding standard of the present invention comprises RMVB, H264 etc., and therefore the video type that is suitable for is extensive.
Description of drawings
The present invention is described in further detail below in conjunction with the drawings and specific embodiments.
Fig. 1 has under the B frame condition, existing compressed video stream playing flow block diagram;
Fig. 2 is Fig. 1 compressed video stream decoding process block diagram;
Fig. 3 is the decoding process block diagram of the complete frame code stream of the present invention;
Fig. 4 is the FB(flow block) that the present invention need to select the B frame of interpolation;
Fig. 5 is a FB(flow block) of the present invention;
Fig. 6 is the playing flow block diagram that compressed video stream does not carry out frame losing;
Fig. 7 is that compressed video stream abandons the playing flow block diagram that the B frame does not carry out the B frame interpolation;
Fig. 8 is that compressed video stream abandons the B frame and carries out the playing flow block diagram of B frame interpolation.
Embodiment
Shown in Fig. 3～8, be a kind of method of improving the video playback effect of the present invention, specifically may further comprise the steps:
(1) decoder judges according to current decoding speed whether needs abandon current B frame to compressed video stream, and when not needing to abandon current B frame, normal decoder is play according to the playing sequence of not frame losing shown in Figure 6; When needs abandon current B frame, change step (2) over to, referring to Fig. 5;
(2) judge whether and to carry out interpolation to current B frame: when a frame B frame was arranged in a reference cycle, do not need to carry out interpolation, directly abandon the B frame decoding, only to the reference frame decoding of current B frame, according to shown in Figure 7 abandon the B frame not the playing sequence of B frame interpolation play; When the B frame that in a reference cycle, has greater than a frame, need carry out interpolation, change step (3) over to;
(3) as shown in Figure 4, need to select the B frame of interpolation: when two frame B frames were arranged in a reference cycle, and current B frame is first frame in the current reference cycle; When three frame B frames were arranged in a reference cycle, and current B frame is second frame in the current reference cycle; When having greater than three frame B frames in a reference cycle, and current B frame is an odd-numbered frame in the current reference cycle;
More than determine the quantity of B frame in a reference cycle, may further comprise the steps:
(1) time interval of calculating B frame;
(2) time difference of the forward reference frame of the reference frame backward of the current B frame of calculating and current B frame, the i.e. time interval sum of interior all B frames of reference cycle;
(3) with the numerical value of step (2) gained the time interval, deduct 1 then, obtain the quantity of B frame in a reference cycle divided by step (1) gained B frame.
Determine the position of current B frame in a reference cycle, may further comprise the steps:
(1) time difference of current B frame of calculating and forward reference frame, the time interval of promptly current B frame and forward reference frame;
(2) time interval of calculating B frame;
(3) with the time interval divided by step (2) gained B frame time difference of step (1) gained, obtain current B frame position in the current reference cycle, which frame promptly current B frame is.
Change step (4) over to;
(4) selected current B frame is carried out interpolation: in the decode procedure of compressed video stream, the value that the pixel residual error is set is zero, save inverse quantization and inverse transformation process, with reference to the forward reference frame of current B frame and reference frame backward, predict to obtain predict pixel the predictive frame of correlation before and after output has by direct mode.
As shown in Figure 3, be the decoding process of the complete frame code stream of the present invention.
The decoding order that has a complete frame code stream now is:
A) the entropy decoding decodes variation coefficient, motion vector, macro block header from compressed bit stream;
B) obtain decoded pixel residual error after variation coefficient process inverse quantization and the inverse transformation;
C) according to decoded motion vector, the picture frame after decoder reconstruct and as in reference to frame is predicted, obtains predict pixel;
D) pixel residual sum predict pixel addition, and be reconstructed, reconstruction frames obtained.
In the solid line boxes among Fig. 3, shown that the present invention carries out the decoding process of interpolation to current B frame, its be with reference to current B frame forward, reference frame backward, predict by direct (direct) mode, obtain predict pixel; Wherein, directly (direct) prediction mode is: according to macro block in the forward reference frame (macro block that will predict in this macro block and the current B frame has identical locus) and backward in the reference frame weighted average of macro block (macro block that will predict in this macro block and the current B frame has identical locus) obtain predict pixel; The weighted average here be current B frame and corresponding forward, the ratio of the time gap between the prediction reference frame backward.
In above-mentioned decode procedure, different with the decoding that has a complete frame code stream now is: before predicting, and the value of pixel residual error in the compressed bit stream of not decoding, it all is zero that this value promptly is set, and also saves inverse quantization and inverse transformation process; The macro block (mb) type (mb_type) that the B frame is set is direct (direct) type, does not do the decoding and the macro block header of motion-vector (MV) residual error, and operations such as motion-vector (MV) and reconstruct only give a forecast.
So B frame interpolation of the present invention has reduced time of a lot of decoded stream, but predict pixel obtains by the prediction of front and back reference frame again, so both saved decode time, has exported the predictive frame of correlation before and after having again.
Therefore the video decode standard that the present invention is suitable for comprises RMVB, H264 etc., applicable to the broadcast of polytype video.
Embodiments of the present invention are not limited thereto, according to foregoing of the present invention,, do not breaking away under the above-mentioned basic fundamental thought of the present invention prerequisite according to the ordinary skill knowledge and the customary means of this area, when the present invention to need to select the current B frame of interpolation, also can adopt other selection mode; In addition, determine the quantity of B frame in a reference cycle and the position of current B frame, also can adopt other account form; Therefore the present invention can also make modification, replacement or the change of other various ways, all drops within the rights protection scope of the present invention.
Claims (5)
1. method of improving the video playback effect is characterized in that specifically may further comprise the steps:
(1) decoder judges according to current decoding speed whether needs abandon current B frame to compressed video stream, when not needing to abandon current B frame, and normal decoder; When needs abandon current B frame, change step (2) over to;
(2) judge whether and to carry out interpolation to current B frame: when a frame B frame is arranged, do not need to carry out interpolation in a reference cycle, only the reference frame of current B frame is decoded; When the B frame that in a reference cycle, has greater than a frame, need carry out interpolation, change step (3) over to;
(3) selection needs the current B frame of interpolation;
(4) selected current B frame is carried out interpolation.
2. the method for improving the video playback effect according to claim 1, it is characterized in that: in described step (4), in the decode procedure of compressed video stream, the value that the pixel residual error is set is zero, save inverse quantization and inverse transformation process, with reference to the forward reference frame of current B frame and reference frame backward, predict by direct mode to obtain predict pixel that output has the predictive frame of front and back correlation.
3. the method for improving the video playback effect according to claim 1 and 2, it is characterized in that: in described step (3), need the current B frame of interpolation to be: when two frame B frames were arranged in a reference cycle, and current B frame is first frame in the current reference cycle; When three frame B frames were arranged in a reference cycle, and current B frame is second frame in the current reference cycle; When having greater than three frame B frames in a reference cycle, and current B frame is an odd-numbered frame in the current reference cycle.
4. the method for improving the video playback effect according to claim 3 is characterized in that: determine the quantity of B frame in a reference cycle, may further comprise the steps:
(1) time interval of calculating B frame;
(2) time difference of the forward reference frame of the reference frame backward of the current B frame of calculating and current B frame, the i.e. time interval sum of interior all B frames of reference cycle;
(3) with the numerical value of step (2) gained the time interval, deduct 1 then, obtain the quantity of B frame in a reference cycle divided by step (1) gained B frame.
5. the method for improving the video playback effect according to claim 4 is characterized in that: determine the position of current B frame in a reference cycle, may further comprise the steps:
(1) time difference of current B frame of calculating and forward reference frame, the time interval of promptly current B frame and forward reference frame;
(2) time interval of calculating B frame;
(3) with time interval time difference of step (1) gained, obtain current B frame position in the current reference cycle divided by step (2) gained B frame.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2010101817473A CN102256138A (en) | 2010-05-18 | 2010-05-18 | Method for improving video display effect |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2010101817473A CN102256138A (en) | 2010-05-18 | 2010-05-18 | Method for improving video display effect |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN102256138A true CN102256138A (en) | 2011-11-23 |
Family
ID=44983081
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN2010101817473A Pending CN102256138A (en) | 2010-05-18 | 2010-05-18 | Method for improving video display effect |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN102256138A (en) |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103533356A (en) * | 2013-10-10 | 2014-01-22 | 深圳市智美达科技有限公司 | Video data transmission method and device |
| CN104053002A (en) * | 2014-06-05 | 2014-09-17 | 乐视网信息技术（北京）股份有限公司 | Video decoding method and device |
| CN104079950A (en) * | 2014-07-04 | 2014-10-01 | 福建天晴数码有限公司 | Video output processing method, device and system and video receiving processing method, device and system |
| CN106911932A (en) * | 2015-12-22 | 2017-06-30 | 晨星半导体股份有限公司 | Bit stream decoding method and bit stream decoding circuit |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20020097797A1 (en) * | 2001-01-23 | 2002-07-25 | Kenji Sugiyama | Method and apparatus for decoding picture signal at variable picture rate |
| CN1364031A (en) * | 2001-01-10 | 2002-08-14 | 华为技术有限公司 | Method for processing error codes in compressed coded image transmission |
| CN101018341A (en) * | 2007-02-06 | 2007-08-15 | 浙江大学 | Control device and method of audio and video playing status based on the built-in system |
| CN101079993A (en) * | 2006-05-23 | 2007-11-28 | 中国科学院声学研究所 | Static frame loss method in video playing |
| CN101411198A (en) * | 2006-04-04 | 2009-04-15 | 高通股份有限公司 | Video decoding in a receiver |
-
2010
- 2010-05-18 CN CN2010101817473A patent/CN102256138A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1364031A (en) * | 2001-01-10 | 2002-08-14 | 华为技术有限公司 | Method for processing error codes in compressed coded image transmission |
| US20020097797A1 (en) * | 2001-01-23 | 2002-07-25 | Kenji Sugiyama | Method and apparatus for decoding picture signal at variable picture rate |
| CN101411198A (en) * | 2006-04-04 | 2009-04-15 | 高通股份有限公司 | Video decoding in a receiver |
| CN101079993A (en) * | 2006-05-23 | 2007-11-28 | 中国科学院声学研究所 | Static frame loss method in video playing |
| CN101018341A (en) * | 2007-02-06 | 2007-08-15 | 浙江大学 | Control device and method of audio and video playing status based on the built-in system |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103533356A (en) * | 2013-10-10 | 2014-01-22 | 深圳市智美达科技有限公司 | Video data transmission method and device |
| CN104053002A (en) * | 2014-06-05 | 2014-09-17 | 乐视网信息技术（北京）股份有限公司 | Video decoding method and device |
| CN104079950A (en) * | 2014-07-04 | 2014-10-01 | 福建天晴数码有限公司 | Video output processing method, device and system and video receiving processing method, device and system |
| CN106911932A (en) * | 2015-12-22 | 2017-06-30 | 晨星半导体股份有限公司 | Bit stream decoding method and bit stream decoding circuit |
| CN106911932B (en) * | 2015-12-22 | 2020-08-28 | 联发科技股份有限公司 | Bit stream decoding method and bit stream decoding circuit |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| KR100964526B1 (en) | Multimedia coding techniques for transitional effects | |
| TW545064B (en) | Methods and apparatus for transcoding progressive I-slice refreshed MPEG data streams to enable trick play mode features on a television appliance | |
| CN1941913B (en) | Method and apparatus for skipping pictures | |
| CA2286448C (en) | Splicing of video data in progressively refreshed video streams | |
| KR101819618B1 (en) | Trick play in digital video streaming | |
| US8428145B2 (en) | System and method for providing fast trick modes | |
| CN101778277B (en) | Video player | |
| US7035526B2 (en) | Advancing playback of video data based on parameter values of video data | |
| CN102256138A (en) | Method for improving video display effect | |
| JP2000244929A (en) | Moving picture re-encoding device | |
| US6963611B1 (en) | Process and device for switching digital television programs | |
| US20100061697A1 (en) | Motion picture decoding method, motion picture decoding device, and electronic apparatus | |
| JP2008301335A (en) | Video signal switching apparatus | |
| CN101127900A (en) | Coding/decoding method and device for image signals at basic layer | |
| US8692934B2 (en) | Method and system for frame rate adaptation | |
| JP5248583B2 (en) | Moving picture decoding apparatus and moving picture decoding method | |
| KR100731884B1 (en) | Method and Apparatus for a Temporal Scalable Encoding/Decoding Based on Multiple Reference Frames | |
| JP2947089B2 (en) | Moving picture decoding method and apparatus | |
| JP2003169296A (en) | Method for reproducing moving picture | |
| JP4193162B2 (en) | Image signal encoding device | |
| JP4228537B2 (en) | Image signal decoding / encoding device | |
| CN101651805A (en) | TV program guide method and set top box | |
| JP4641023B2 (en) | Video signal playback device | |
| JP2010206715A (en) | Broadcast receiver | |
| JP2010041123A (en) | Image data processor, image recorder and image data processing method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C12 | Rejection of a patent application after its publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20111123 |