CN101080006A - Hierarchical processing method of video frames in video playing - Google Patents
Hierarchical processing method of video frames in video playing Download PDFInfo
- Publication number
- CN101080006A CN101080006A CNA2006100810540A CN200610081054A CN101080006A CN 101080006 A CN101080006 A CN 101080006A CN A2006100810540 A CNA2006100810540 A CN A2006100810540A CN 200610081054 A CN200610081054 A CN 200610081054A CN 101080006 A CN101080006 A CN 101080006A
- Authority
- CN
- China
- Prior art keywords
- frame
- video
- rank
- present
- processing method
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Landscapes
- Compression Or Coding Systems Of Tv Signals (AREA)
Abstract
This invention discloses a grading-process method for video play including: a video terminal receives video frames, computes balance between labels of the system time and the display time of the received current frames and determines region where the balance locates, analyzes frame head of the current frames to determine their kinds and classifies the current frames based on the balance and the kinds of the video frames, decodes and displays the current video frames and repeats the above mentioned steps to all video frames received by the terminal.
Description
Technical field
The present invention relates to video playing terminal, specially refer to the limited video playing terminal of multimedia processing capability.
Background technology
In video display process, run into such problem through regular meeting: the complexity difference of the scene of different phase in the video sequence, the scene more complicated in some stage, decoding complex degree is higher, and exceeded the disposal ability of terminal, after several frame video images of the intact a certain complex scene of decoder decode, the current time of system just lags behind the normal demonstration time of frame of video, decode frame by frame and show if proceed, then can further aggravate the hysteresis that video image shows, what cause that the user sees is the video of slow play; If the complexity of different scenes differs greatly in the whole video sequence, then cause broadcasting speed inhomogeneous, and whole playing progress rate lag behind.
The method of handling this problem at present is generally: the video sequence to input is decoded as possible, and the Presentation Time Stamp of reference video frames shows; If current system time has lagged behind the input video frame that will decode in the playing process, judge then whether incoming frame is reference frame, if not reference frame, then abandon this frame of video, do not decode, if reference frame then abandons the arrival up to next I frame of present frame and subsequent frame.This method can be alleviated decoding pressure to a certain extent, the demonstration that as far as possible keeps decoded video image is demonstration time of requiring of video image around, is applied in the middle of the player commonly used such as Windows Media Player, Real Player.But, this method is as broad as long treats the frame losing standard of reference frame and non-reference frame, and does not consider the independence that video decode and video show in the video playback, in the video display process of terminal, particularly when the terminal processing capacity wretched insufficiency, cause pause and discontinuous easily.So at the decoding complex degree of video sequence different phase dynamic adjustments decoding processing strategy how, the continuous smooth and easy broadcast that keeps video when terminal processing capacity is not enough just has actual application value as far as possible.
Summary of the invention
The objective of the invention is to: overcome prior art when running into high complexity video sequence or terminal processing capacity wretched insufficiency, the unfavorable drawback of video playback, the video decode pressure of dynamic equilibrium terminal, the fluency of raising video playback improves user's viewing effect; Thereby provide a kind of video playback hierarchical processing method.
To achieve these goals, the invention provides a kind of video playback hierarchical processing method, comprise following steps:
1), video terminal receiver, video frame, calculate the difference between the Presentation Time Stamp of the present frame that current system time and video terminal received of video terminal, and the zone at definite difference place;
2), resolve the frame head of present frame, determine the type of frame of video;
3), the difference between the Presentation Time Stamp of the system time that obtains according to step 1 and present frame, and the type of the frame of video that obtains of step 2 is the present frame classification;
4), according to the rank of frame of video, current video frame is decoded and is shown processing;
5), to all received frame of video of video terminal, repeating step 1) to the operation of step 4).
In the technique scheme, in described step 1), the zone at described definite difference place is at first to set several threshold values, will the time be divided into the zone according to threshold values, then difference and each zone is compared, and determines which zone is difference specifically be in.
Described threshold values has two, represents with x millisecond and y millisecond respectively, will be divided into 3 zones the time according to this threshold values, uses S1, and S2 and S3 represent, represent difference with D, then:
S1：D＜x
S2：x＜＝D＜y
S3：D＞＝y。
In described step 2) in, the type of described frame of video comprises I frame, P frame and B frame, described I frame and P frame are reference frames, described B frame is a non-reference frame, in reference frame, the I frame is a key frame, does not need other reference frame that reference is provided when decoding, the P frame is common reference frame, needs other reference frame that reference is provided when decoding.
In described step 3), described when being the present frame classification, can be divided into four ranks, use L1 respectively, L2, L3, L4 represent, and when described D value belongs to S1, incoming frame is the arbitrary frame type, and rank is L1; When described D value belongs to S2, incoming frame is I frame or P frame, and rank is L2; When described D value belongs to S2, incoming frame is the B frame, and rank is L3; When described D value belongs to S3, incoming frame is the B frame, and rank is L3; When described D value belongs to S3, incoming frame is I frame or P frame, and rank is L4.
In described step 4), to the frame of video of different stage, different handling processes is arranged when show handling in decoding, when the rank of present frame is L1, decodes and show this present frame; When the rank of present frame is L2, the decoding present frame, but do not show; When the rank of present frame is L3, abandon present frame, do not decode and show; When the rank of present frame is L4, abandon current incoming frame and follow-up non-key frame, when receiving next I frame, the rank of this I frame is changed to L1.
Compared with prior art, the present invention has following advantage:
(1) according to the decoding pressure of video playback situation dynamic equilibrium terminal;
(2) take into full account the amplitude of decode time and the difference that shows the time, handle according to the grading of difference;
(3) take into full account the decoding characteristics of dissimilar frame of video, classification alleviates video playback pressure under the prerequisite of the independence of correctness that guarantees decoding and processing;
(4) fluency of raising video playback keeps visual effect as far as possible.
Description of drawings
Fig. 1 is that video playback hierarchical processing method of the present invention is applied in the schematic diagram in the set-top box;
Fig. 2 is the difference of current system time and present frame Presentation Time Stamp;
Fig. 3 is the flow chart of video playback hierarchical processing method of the present invention.
Embodiment
The present invention will be further described below in conjunction with the drawings and specific embodiments.
Video playback hierarchical processing method of the present invention can be applicable in as shown in Figure 1 the scene.Set-top box is sent the Video service request by broadband network to streaming media server, and streaming media server responds this request, and sends video data by network to set-top box, and set-top box is decoded after receiving video data, delivers to television set then and shows.In this scene, the network bandwidth can satisfy the transmission demand of video flowing, and the network receiver module of set-top box also has enough abilities to carry out Data Receiving, but the video decoding capability deficiency of set-top box can't satisfy the total data of video flowing is carried out real-time decoding.Video playback hierarchical processing method of the present invention just is being applicable to the situation of this video terminal decoding capability deficiency.
As shown in Figure 3, utilize video playback hierarchical processing method of the present invention that a sequence of frames of video is handled, comprise following frame of video in this sequence of frames of video:
I、P、B、B、P、B、B、I、P、B。
The specific implementation step that frame of video in the above-mentioned sequence of frames of video is handled is as follows:
1, the difference between the Presentation Time Stamp of the current system time of computing set-top box and present frame is the zone that difference is determined the place according to pre-set threshold.As shown in Figure 2, in one embodiment, represent the difference of the Presentation Time Stamp of current system time and present frame with D, x and y are the thresholdings of difference, are set at 0 millisecond and 500 milliseconds respectively, and the then whole time period can be divided into three zones, use S1 respectively, S2 and S3 represent.Wherein:
The Presentation Time Stamp of the current system time-present frame of D=
S1：D＜0
S2：0＜＝D＜500
S3：D＞＝500。
In one embodiment, set-top box at first receives a frame of video, the difference between the current system time of computing set-top box and the Presentation Time Stamp of present frame, and the difference of supposing this frame of video is 10 milliseconds, the time difference of this frame of video is arranged in region S 2.
2, resolve the frame head of frame of video, determine the type of current input video frame.The type of frame of video can be divided into I frame, P frame and B frame, and wherein I frame and P frame are reference frames, and the B frame is a non-reference frame.In reference frame, the I frame is a key frame, and key frame does not need other reference frame that the reference frame of reference is provided when being meant decoding, and the P frame is common reference frame, and common reference frame needs other reference frame that the reference frame of reference is provided when being meant decoding.When frame of video being done decoding, the information that the dependence of I frame itself is comprised can realize decoding, the information of an I frame or other P frames that needs the P frame could realize the decoding to it, a B frame I frame of needs and a P frame, or two P frames could be realized the decoding to it.The frame head of parse for frame can be determined the type of present frame.
In the described embodiment of step 1, the frame head of the frame of video that set-top box is received is done parsing, and this frame of video is the I frame as can be known.
The type of the input video frame that 3, the difference between the Presentation Time Stamp of current system time that obtains according to step 1 and present frame, and step 2 obtains is classified to current frame of video as standard.In the present embodiment, for frame of video is provided with four ranks, use L1 respectively, L2, L3, L4 represent, make L represent other value of level, and then the value of L is determined by table 1
| Temporal interpolation (D) | Frame type (T) | Handle rank (L) |
| S1 | I/P/B | L1 |
| S2 | I/P | L2 |
| S2 | B | L3 |
| S3 | B | L3 |
| S3 | I/P | L4 |
Table 1
In the last table 5 kinds of situations of branch fraction of input video frame are discussed:
(I) the D value belongs to S1, and incoming frame is arbitrary frame type (I frame, P frame or a B frame), L value L1;
(II) the D value belongs to S2, and incoming frame is reference frame (I frame or a P frame), L value L2;
(III) the D value belongs to S2, and incoming frame is non-reference frame (a B frame), L value L3;
(IV) the D value belongs to S3, and incoming frame is non-reference frame (a B frame), L value L3;
(V) the D value belongs to S3, and incoming frame is reference frame (I frame or a P frame), L value L4.
In step 1 and the described embodiment of step 2, the time difference of I frame is in S2, and as shown in Table 1, the processing rank of this frame is L2.
4,, frame of video is decoded and shown processing according to the rank of frame of video.For the frame of video of different stage, different processing procedures is arranged, it is implemented as follows:
(A) L=L1, decoding also shows incoming frame;
(B) L=L2, the decoding incoming frame, but do not show;
(C) L=L3 abandons incoming frame, does not decode and shows
(D) L=L4 abandons incoming frame and follow-up non-key frame, when receiving next I frame the value of L is changed to L1.
The I frame that aforesaid processing rank is L2, this incoming frame of decoding, but do not show.
5,, repeat by the operation of step 1 to step 4 to all received input video frame of set-top box.
P in the sequence of frames of video, B, B, P, B, B, I, P, B are repeated above-mentioned step successively, and all frames in this sequence of frames of video are all finished decoding and display operation.
Claims (6)
1, a kind of video playback hierarchical processing method comprises following steps:
1), video terminal receiver, video frame, calculate the difference between the Presentation Time Stamp of the present frame that current system time and video terminal received of video terminal, and the zone at definite difference place;
2), resolve the frame head of present frame, determine the type of frame of video;
3), the difference between the Presentation Time Stamp of the system time that obtains according to step 1 and present frame, and the type of the frame of video that obtains of step 2 is the present frame classification;
4), according to the rank of frame of video, current video frame is decoded and is shown processing;
5), to all received frame of video of video terminal, repeating step 1) to the operation of step 4).
2, video playback hierarchical processing method according to claim 1, it is characterized in that, in described step 1), the zone at described definite difference place is at first to set several threshold values, to the time be divided into the zone according to threshold values, then difference and each zone are compared, determine which zone is difference specifically be in.
3, video playback hierarchical processing method according to claim 2 is characterized in that, described threshold values has two, represents with x millisecond and y millisecond respectively, will be divided into 3 zones the time according to this threshold values, uses S1, and S2 and S3 represent, represent difference with D, then:
S1：D＜x
S2：x＜＝D＜y
S3：D＞＝y。
4, video playback hierarchical processing method according to claim 3, it is characterized in that, in described step 2) in, the type of described frame of video comprises I frame, P frame and B frame, described I frame and P frame are reference frames, described B frame is a non-reference frame, in reference frame, the I frame is a key frame, does not need other reference frame that reference is provided when decoding, the P frame is common reference frame, needs other reference frame that reference is provided when decoding.
5, video playback hierarchical processing method according to claim 4 is characterized in that, and is in described step 3), described when being the present frame classification, can be divided into four ranks, use L1 respectively, L2, L3, L4 represents, when described D value belongs to S1, incoming frame is the arbitrary frame type, and rank is L1; When described D value belongs to S2, incoming frame is I frame or P frame, and rank is L2; When described D value belongs to S2, incoming frame is the B frame, and rank is L3; When described D value belongs to S3, incoming frame is the B frame, and rank is L3; When described D value belongs to S3, incoming frame is I frame or P frame, and rank is L4.
6, video playback hierarchical processing method according to claim 5 is characterized in that, in described step 4), frame of video to different stage, different handling processes is arranged in decoding when show handling, when the rank of present frame is L1, decodes and show this present frame; When the rank of present frame is L2, the decoding present frame, but do not show; When the rank of present frame is L3, abandon present frame, do not decode and show; When the rank of present frame is L4, abandon current incoming frame and follow-up non-key frame, when receiving next I frame, the rank of this I frame is changed to L1.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CNB2006100810540A CN100531383C (en) | 2006-05-23 | 2006-05-23 | Hierarchical processing method of video frames in video playing |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CNB2006100810540A CN100531383C (en) | 2006-05-23 | 2006-05-23 | Hierarchical processing method of video frames in video playing |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN101080006A true CN101080006A (en) | 2007-11-28 |
| CN100531383C CN100531383C (en) | 2009-08-19 |
Family
ID=38907194
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CNB2006100810540A Expired - Fee Related CN100531383C (en) | 2006-05-23 | 2006-05-23 | Hierarchical processing method of video frames in video playing |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN100531383C (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103856812A (en) * | 2014-03-25 | 2014-06-11 | 北京奇艺世纪科技有限公司 | Video playing method and device |
| CN104717509A (en) * | 2015-03-31 | 2015-06-17 | 北京奇艺世纪科技有限公司 | Method and device for decoding video |
| CN107832377A (en) * | 2017-10-30 | 2018-03-23 | 北京小米移动软件有限公司 | Image information indication method, apparatus and system, storage medium |
Family Cites Families (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JPH08214265A (en) * | 1995-01-31 | 1996-08-20 | Sony Corp | Method and device for reproducing encoded data |
| IL138870A (en) * | 1998-04-06 | 2005-08-31 | Seachange International Inc | Synchronizing, switching and editing mpeg files |
| JP2000165812A (en) * | 1998-11-25 | 2000-06-16 | Sony Corp | Mpeg reproducing device and mpeg reproducing method |
| JP3917363B2 (en) * | 2000-12-12 | 2007-05-23 | 株式会社東芝 | Image decoding apparatus and image decoding method |
| US20020075961A1 (en) * | 2000-12-19 | 2002-06-20 | Philips Electronics North America Corporaton | Frame-type dependent reduced complexity video decoding |
| EP1551185A1 (en) * | 2004-01-05 | 2005-07-06 | Thomson Licensing S.A. | Encoding method, decoding method, and encoding apparatus for a digital picture sequence |
-
2006
- 2006-05-23 CN CNB2006100810540A patent/CN100531383C/en not_active Expired - Fee Related
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103856812A (en) * | 2014-03-25 | 2014-06-11 | 北京奇艺世纪科技有限公司 | Video playing method and device |
| CN104717509A (en) * | 2015-03-31 | 2015-06-17 | 北京奇艺世纪科技有限公司 | Method and device for decoding video |
| CN104717509B (en) * | 2015-03-31 | 2017-09-26 | 北京奇艺世纪科技有限公司 | A kind of video encoding/decoding method and device |
| CN107832377A (en) * | 2017-10-30 | 2018-03-23 | 北京小米移动软件有限公司 | Image information indication method, apparatus and system, storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN100531383C (en) | 2009-08-19 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN101079993A (en) | Static frame loss method in video playing | |
| US9264475B2 (en) | Use of objective quality measures of streamed content to reduce streaming bandwidth | |
| CN101917613B (en) | Acquiring and coding service system of streaming media | |
| CN102067551B (en) | Media stream processing | |
| CN1171158C (en) | Mobile method of activ image in video program requesting system | |
| CN1745526A (en) | Apparatus and method for synchronization of audio and video streams. | |
| CN103210642B (en) | Occur during expression switching, to transmit the method for the scalable HTTP streams for reproducing naturally during HTTP streamings | |
| CN1802858A (en) | System and method for internet broadcasting of mpeg-4-based stereoscopic video | |
| CN1949846A (en) | Method, system apparatus and set top box for displaying mutli-channel information in identical picture | |
| CN1571508A (en) | A method for implementing multi-frame | |
| CN1666515A (en) | High-definition de-interlacing and frame doubling circuit and method | |
| CN101699867A (en) | Dynamic adjustment method of video data transmission rate | |
| CN110072137A (en) | A kind of data transmission method and transmitting device of net cast | |
| CN1791227A (en) | Mobile television receiver | |
| CN1554188A (en) | Time stamp value controller | |
| CN1640150A (en) | Image processing method and system to increase perceived visual output quality in case of lack of image data | |
| CN101080926A (en) | Wireless communication system | |
| CN101068192A (en) | Computer system and method for transmitting digital content | |
| US20020106023A1 (en) | Distributed intraframe transmission in digital video compression | |
| CN101080006A (en) | Hierarchical processing method of video frames in video playing | |
| CN1992901A (en) | Method and apparatus for transmitting and receiving basic image frames and additional optional frames | |
| CN1798348A (en) | Personal video recorder system and method for reproducing a signal in the system | |
| CN1933480A (en) | Method for multimedia data switching gateway | |
| CN1852423A (en) | Network flow-medium performance broadcasting system and method | |
| CN1682206A (en) | Dynamic quality adjustment based on changing streaming constraints |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| ASS | Succession or assignment of patent right |
Owner name: BEIJING ZHONGKE CHINA FILM MEDIA TECHNOLOGY CO., L Free format text: FORMER OWNER: BEIJING YISHIWEI INFORMATION TECHNOLOGY CO., LTD. |
|
| C41 | Transfer of patent application or patent right or utility model | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20100609 Address after: 100080, No. 21 West Fourth Ring Road, Beijing, Haidian District Co-patentee after: Beijing Zhongke Chinese Shadow Media Technology Co.,Ltd. Patentee after: Institute of acoustics, Chinese Academy of Sciences Address before: 100080, No. 21 West Fourth Ring Road, Beijing, Haidian District Co-patentee before: Beijing EZTV Technology Co., Ltd. Patentee before: Institute of acoustics, Chinese Academy of Sciences |
|
| C17 | Cessation of patent right | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20090819 Termination date: 20110523 |