WO2008031263A1 - Method and apparatus for encoding groups of pictures of a video sequence, each of said groups including an intra encoded picture and more than two predicted encoded pictures - Google Patents

Method and apparatus for encoding groups of pictures of a video sequence, each of said groups including an intra encoded picture and more than two predicted encoded pictures Download PDF

Info

Publication number
WO2008031263A1
WO2008031263A1 PCT/CN2006/002308 CN2006002308W WO2008031263A1 WO 2008031263 A1 WO2008031263 A1 WO 2008031263A1 CN 2006002308 W CN2006002308 W CN 2006002308W WO 2008031263 A1 WO2008031263 A1 WO 2008031263A1
Authority
WO
WIPO (PCT)
Prior art keywords
pictures
picture
encoded
groups
predicted
Prior art date
Application number
PCT/CN2006/002308
Other languages
French (fr)
Inventor
Quqing Chen
Zhibo Chen
Xiaodong Gu
Original Assignee
Thomson Licensing
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Thomson Licensing filed Critical Thomson Licensing
Priority to US12/733,265 priority Critical patent/US8335252B2/en
Priority to CN2006800557875A priority patent/CN101601297B/en
Priority to KR1020097004781A priority patent/KR101345073B1/en
Priority to JP2009526993A priority patent/JP5190059B2/en
Priority to PCT/CN2006/002308 priority patent/WO2008031263A1/en
Priority to EP20060775618 priority patent/EP2060120A4/en
Publication of WO2008031263A1 publication Critical patent/WO2008031263A1/en

Links

Classifications

    • G—PHYSICS
    • G11—INFORMATION STORAGE
    • G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B27/00—Editing; Indexing; Addressing; Timing or synchronising; Monitoring; Measuring tape travel
    • G11B27/005—Reproducing at a different information rate from the information rate of recording
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
    • H04N19/177—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being a group of pictures [GOP]
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/103—Selection of coding mode or of prediction mode
    • H04N19/114—Adapting the group of pictures [GOP] structure, e.g. number of B-frames between two anchor frames
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • H04N19/503—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal prediction
    • H04N19/51—Motion estimation or motion compensation
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • H04N19/587—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal sub-sampling or interpolation, e.g. decimation or subsequent interpolation of pictures in a video sequence
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/60—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding
    • H04N19/61—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding in combination with predictive coding
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/65—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using error resilience
    • H04N19/66—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using error resilience involving data partitioning, i.e. separation of data into packets or partitions according to importance
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/85—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using pre-processing or post-processing specially adapted for video compression
    • H04N19/89—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using pre-processing or post-processing specially adapted for video compression involving methods or arrangements for detection of transmission errors at the decoder
    • H04N19/895—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using pre-processing or post-processing specially adapted for video compression involving methods or arrangements for detection of transmission errors at the decoder in combination with error concealment

Definitions

  • the invention relates to a method and to an apparatus for encoding groups of pictures of a video sequence, each of said groups including an intra encoded picture and more than two predicted encoded pictures, using forward prediction as well as backward prediction.
  • I picture does not use other pictures as reference so that it can be used as re-synchroni- sation point in error-prone video transmission. It can also be used as random access point in video editing and fast forward/backward play.
  • a P picture can use one or more previous pictures as reference so that it increases the coding efficiency due to the prediction.
  • B pictures can use previ- ous and subsequent pictures for prediction and further improve the coding efficiency.
  • Video sequences are usually coded in a group of picture (GOP) structure, wherein several P (Pl, P2, P3) and/or B pictures are coded following one I picture, as is shown in Fig. 1.
  • GOP structure has some disadvantages especially in the following two kinds of applications: a) Error resilience
  • a simple fast backward play can be achieved by only accessing I pictures in backward direction, but if smoother picture-by-picture reverse-play is desired, much more complexity, bandwidth, and/or storage buffer will be required. For example, one can decode the GOP up to the current frame, and then go back to decode from the beginning of the GOP again up to the next frame to be displayed. However, this requires high bandwidth of throughput. Otherwise a great deal of storage buffer is needed if the bit stream is expected to be decoded only once .
  • the subscript is the temporal number of the picture in the original video sequence, where the subscripts are monotonously increasing as i>l, n-1 > m+i+1, j>l, and k-1 > n+j+1. If B pictures are included, the structure will not be virtually affected. Obviously, if one P picture is corrupt, at most it will affect only half of the GOP, while the other half of the GOP which is arranged at the other side of picture I n will not be affected. In fact, this GOP structure is another form of two prediction chains, wherein one chain is forward and the other is backward. On one hand, this GOP structure makes the reverse-play partly easy since one half of the P frames in the GOP are already reverse-encoded.
  • this GOP structure still has disadvantages in both, the error resilience and the reverse-play. If P m +i is lost, then P m + ⁇ to P m +i are corrupt and error artefacts will be noticed in this time pe- riod. Although the picture chain P n _i to P m +i+i may be received correctly, it will not offer help for decoding the pictures of the time period from P m + ⁇ to P m +i • Therefore this GOP structure can not provide an error resilient performance as good as the GOP structure depicted in Fig. 2. Further, this GOP structure can not provide a continuous reverse-play function because half of the consecutive P frames are still forward encoded.
  • the processing order for reverse-play is: I ⁇ —» Pk-I —> ••• —> p n+j+l ⁇ ⁇ n ⁇ p n-l —> ... —> P m +i+i —> Im ⁇ • • • •
  • P n +j to P n +i and P m +i to P m +i that will cause a big jitter in the reverse play. If the pictures from P n +j to P n +i and p m+i to P m +i really need to be displayed, then normal multipass decoding or huge buffering is necessary, which is the same problem like in the standard GOP structure.
  • a problem to be solved by the invention is to provide a GOP structure that increases the error resilience for video transmission and facilitates a fluent reverse-play function. This problem is solved by the method disclosed in claims 1 and 3. Apparatuses that utilise these methods are disclosed in claims 2 and 4.
  • a reversible GOP (RGOP) structure is used for the video encoding and decoding.
  • the RGOP structure contains both, a forward encoding chain and a backward encoding chain.
  • Each picture in the RGOP structure is assigned to only one of these chains and the video pic- tures of the two chains are interleaved.
  • This RGOP structure improves the error resilience because, if one prediction chain is corrupt and the other prediction chain is intact, the video sequence can still be decoded and displayed fluently without any noticeable artefact, as is explained below.
  • This RGOP structure also provides an easy and fluent reverse-play function for recording applications.
  • the additional cost of the inventive processing is a small decrease of the coding efficiency due ' to the prediction in the encoding not using the nearest frame. But the redundant bits are valuable for increasing the error resilience or recovery.
  • the inventive encoding method is suited for encoding groups of pictures of a video sequence, each of said groups including an intra encoded picture and more than two predicted encoded pictures, wherein one part of said predicted encoded pictures is backward predicted encoded starting from said intra encoded picture and the other part of said predicted encoded pictures is forward predicted encoded starting from said intra encoded picture, whereby pictures are omitted in these forward and backward predicted encoded picture chains and whereby every two adjacent groups of pictures of said video sequence are arranged in an overlapping manner such that said missing pictures in the for- ward and backward predicted encoded picture chains in a current groups of pictures are included in an interleaved manner in one of said adjacent overlapping groups of pictures.
  • the inventive encoding apparatus is suited for encoding groups of pictures of a video sequence, each of said groups including an intra encoded picture and more than two predicted encoded pictures, said apparatus including means being adapted for backward predicted encoding starting from said intra encoded picture one part of said predicted encoded pictures, and for forward predicted encoding starting from said intra encoded picture the other part of said predicted encoded pictures, whereby pictures are omitted in these forward and backward predicted encoded picture chains and whereby every two adjacent groups of pictures of said video sequence are arranged in an overlapping manner such that said missing pictures in the forward and backward predicted encoded picture chains in a current groups of pictures are included in an interleaved manner in one of said adjacent overlapping groups of pictures.
  • the inventive decoding method is suited for decoding groups of pictures of a video sequence, each of said groups including an intra encoded picture and more than two predicted encoded pictures, wherein one part of said predicted encoded pictures was backward predicted encoded starting from said intra encoded picture and the other part of said predicted encoded pictures was forward predicted encoded starting from said intra encoded picture and said de- coding of said pictures is performed in a corresponding order, whereby pictures were omitted in these forward and backward predicted encoded picture chains and whereby every two adjacent groups of pictures of said video sequence were arranged in an overlapping manner such that said missing pictures in the forward and backward predicted encoded picture chains in a current groups of pictures were included in an interleaved manner in one of said adjacent overlapping groups of pictures, and in said decoding the correspondingly decoded pictures are assembled for the decoded output signal in the original picture order of said video sequence.
  • the inventive decoding apparatus is suited for decoding groups of pictures of a video sequence, each of said groups including an intra encoded picture and more than two predicted encoded pictures, wherein one part of said predicted encoded pictures was backward predicted encoded starting from said intra encoded picture and the other part of said predicted encoded pictures was forward predicted encoded starting from said intra encoded picture, whereby pictures were omitted in these forward and backward predicted encoded picture chains and whereby every two adjacent groups of pictures of said video sequence were arranged in an overlapping manner such that said missing pictures in the forward and backward predicted encoded picture chains in a current groups of pictures were included in an interleaved man- ner in one of said adjacent overlapping groups of pictures, said apparatus including means being adapted for decoding the pictures of said groups of pictures in a corresponding order and assembling the correspondingly decoded pictures for the decoded output signal in the original picture order of said video sequence.
  • Fig. 1 typical MPEG GOP Structure
  • Fig. 2 known GOP structure with two prediction chains
  • Fig. 3 known GOP structure in which the I picture is arranged in the middle of the GOP
  • FIG. 5 another example of an inventive RGOP structure
  • Fig. 6 inventive RGOP structure with uneven interleaving
  • Fig. 7 inventive RGOP structure with B pictures included
  • Fig. 9 example of an inventive decoder.
  • a group of temporally consecutive pictures are interleaved re-scheduled into two prediction chains. That is, half of the pictures are forward encoded by prediction initially from a previous I picture, while the rest of the pictures are backward encoded by prediction initially from a later I picture.
  • the bit stream of the reverse pictures is sent following the bit stream of the forward encoded pictures, to form a new RGOP.
  • FIG. 4 A typical RGOP structure is shown in Fig. 4.
  • the pic ⁇ tures P m +2 ' p m+4' • ⁇ •/ p n-l are selected for the reverse prediction encoding chain that starts from picture I n in backward direction
  • the pictures P n +1 > p n+3' ⁇ •' P j r-2 are selected for the forward prediction encoding chain that starts from picture I n in forward direction.
  • pictures P m +i/ p m+3' •••/ p n-2 f° rm the forward prediction encoded chain in the previous RGOPj__]_ while pictures P n +2? p n+4' •••/ p k-l f° rrtl the backward pre- diction encoded chain in the following RGOPj+i, i.e. each RGOP contains a backward prediction encoding chain and a forward prediction encoding chain.
  • the neighbouring RGOPs and their pictures are interleaved, i.e. within a GOP length section of the video sequence every second picture belongs to the current RGOPj_ and the intermediate pictures belong to the corresponding adjacent RGOP ⁇ -i or RGOP j _+i .
  • each RGOP contains an I picture, a backward prediction encoded chain, and a forward prediction encoded chain. This can be denoted as ⁇ I, ⁇ backward prediction encoded chain ⁇ , ⁇ forward prediction encoded chain ⁇ .
  • ⁇ I ⁇ backward prediction encoded chain ⁇
  • ⁇ forward prediction encoded chain ⁇ ⁇ forward prediction encoded chain ⁇
  • Fig. 5 depicts a second embodiment of the inventive RGOP structure having the same features like that depicted in Fig. 4.
  • Pictures ⁇ m+2 , p m +4' ⁇ -, P n -I* and ⁇ p n+2' p n+4' ..., Pk-I ⁇ are forward prediction encoded to form a forward prediction chain while pictures ⁇ P n -2f ---t p m+3' p m+l ⁇ and f p k-2' • ' •/ p n+3' p n+l ⁇ are reverse prediction encoded to form a backward prediction chain.
  • the transmission order is ⁇ RGOPi_ 2 ⁇ , ⁇ I m , ⁇ ... ⁇ , ⁇ P m+2 , p m+4' •••' p n-lH' (I n , ⁇ P n _2, •.., P m +3' Pm+lK ⁇ p n+2' p n+4' ⁇ ••/ p k-lH, ⁇ I k/ ⁇ P k _2, -.., P n +3' p n+l>' ⁇ •• ⁇ / (RGOP 1+2 I.
  • Fig. 6 shows an inventive RGOP structure in which the interleaving is uneven. That is, the number of pictures in the forward prediction chain is higher than the number of pic- tures in the backward prediction chain.
  • Pictures ⁇ P ⁇ +i, p m+2' p m+4' p m+5' •••/ p k-3' p k-2 ⁇ are forward prediction encoded to form the forward prediction chain while pictures (Pk-I' •• ⁇ ' p m+6' p m+3 ⁇ are reverse prediction encoded to form the backward prediction chain.
  • This structure benefits forward play more than reverse play.
  • the proportion of forward encoded pictures to reverse encoded pictures can vary according to the application requirements.
  • Multiple reference frames can be employed in each of the forward prediction and backward prediction chains. But the pictures in the forward prediction chain can not predict from the backward prediction chain pictures and vice versa.
  • the inventive RGOP structure can be generalised to cases where the video sequence includes B pictures.
  • An example is shown in Fig. 7. It is useful for error resilient video coding and for DVD and VCR applications.
  • Pictures ⁇ Pm+1' Bm+3' P m- l-5, B m +7, Pm+9, ••., Pk-2 ⁇ are forward prediction encoded to form the forward prediction chain while pictures ⁇ P k -1' ..., Pm -1 -IO/ Bm+8' p m+6' B m+4' p m+2 ⁇ are reverse prediction encoded to form the backward prediction chain.
  • the chains can also start and/or end with corresponding B pictures.
  • the video data input signal IE of the pixel block encoder in Fig. 8 contains macroblock data for encoding.
  • the pictures are processed in a manner corresponding to that described in figures 6 or 7.
  • a sub- tractor SUB simply allows these to pass. They are processed in transform means T and quantising means Q and are fed to an entropy encoder ECOD, which outputs the encoder output signal OE.
  • ECOD can, for example, carry out Huffman coding for the coefficients and add header information and motion vector data.
  • predicted block or macroblock data PMD are subtracted from the input signal IE in the subtractor SUB and the difference data are fed to the entropy encoder ECOD via the transform means T and the quantising means Q.
  • the output signal of Q is also processed in inverse quantising means QE " ⁇ , the output signal of which is fed via inverse transform means T ⁇ " ⁇ to the combiner ADDE in the form of reconstructed block or macrob- lock difference data RMDD.
  • the output signal of ADDE is buffer-stored in a frame store in motion estimation and compensation means FS_MC_E, which carry out motion compensation for reconstructed block or macroblock data in the direction as described in figures 6 or 7, and output block or macrob- lock data PMD predicted in this way to the subtracting input of SUB and to the other input of the combiner ADDE.
  • the quantising means Q and the inverse quantising means QE " "*" can be controlled by the occupancy level of the encoder buffer ENCB.
  • the output signal of ADDE is output by the encoder COD as reconstructed frame data REC.
  • the output signal of SUB is output by the encoder COD as residual frame data RES.
  • the encoded pixel data input signal ID is fed via entropy decoder means EDEC, inverse quantising means QD- ⁇ and inverse transform means T ⁇ " ⁇ as residual frame data RES to a combiner ADDD, which outputs the reconstructed pixel data output signal OD.
  • EDEC can, for example, carry out Huffman decoding for the coefficients and decode and/or evaluate header information and mo- tion vector data.
  • QE "1 / QD "1 ' ⁇ E ⁇ ' 11 O "1 and EDEC have a function which is the corresponding inverse of the function of Q, T and ECOD.
  • the output signal of ADDD is buffer-stored in a frame store in motion compensation means FS_MC_D.
  • FS_MC_D effects a motion compensation for reconstructed block or macroblock data, in the direction as described in figures 6 or 7.
  • the block or macroblock data PMD predicted in FS_MC_D are passed to the second input of the combiner ADDE in the case of interframe-decoded block or macroblock data.
  • the combiner ADDD simply passes on the output signal from T ⁇ "1 .
  • an error signal ES indicates that a picture (i.e.
  • the remaining pictures in the corresponding prediction chain can not be decoded but concealed or interpolated using the corresponding interleaved decoded pictures from the adjacent group of pictures to generate the missing output pictures of said video sequence (IE) , or the remaining pictures in the corresponding prediction chain are not decoded but the de- coding continues with the following intra encoded picture and the current chain output signal OD can be adapted correspondingly in its frame rate.
  • IE video sequence
  • the transform and the inverse transform in figures 8 and 9 can be a DCT or inverse DCT, respectively.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Compression Or Coding Systems Of Tv Signals (AREA)

Abstract

In known video coding standards there are basically three types of pictures: I, P and B. Video sequences are usually coded in a group of picture structure (GOPi) wherein several P or B pictures are coded following one I picture. However, this GOP structure has some disadvantages with respect to error resilience and storage medium recording. If a P picture is lost e.g. due to transmission channel error, then the subsequent P pictures can not be reconstructed correctly, and the error will propagate temporally and cause unpleasing artefacts. This GOP structure is designed for forward play only and makes complicated a reverse play operation. According to the invention, a reversible GOP structure is used for the video encoding and decoding. The RGOP structure contains both, a forward encoding chain and a backward encoding chain. Each picture in the RGOP structure is assigned to only one of these chains and the video pictures of adjacent RGOP chains are interleaved.

Description

Method and Apparatus for encoding groups of pictures of a video sequence, each of said groups including an intra encoded picture and more than two predicted encoded pictures
The invention relates to a method and to an apparatus for encoding groups of pictures of a video sequence, each of said groups including an intra encoded picture and more than two predicted encoded pictures, using forward prediction as well as backward prediction.
Background
In known MPEG/H.26x video coding standards (e.g. MPEG-I, MPEG-2, MPEG-4, MPEG-4 AVC/H.264, H.263, VC-I), there are basically three types of pictures: I (intraframe coded) pictures, P (interframe coded) pictures and B (bi-directionally- predicted) pictures. An I picture does not use other pictures as reference so that it can be used as re-synchroni- sation point in error-prone video transmission. It can also be used as random access point in video editing and fast forward/backward play. A P picture can use one or more previous pictures as reference so that it increases the coding efficiency due to the prediction. B pictures can use previ- ous and subsequent pictures for prediction and further improve the coding efficiency.
Video sequences are usually coded in a group of picture (GOP) structure, wherein several P (Pl, P2, P3) and/or B pictures are coded following one I picture, as is shown in Fig. 1. However, this GOP structure has some disadvantages especially in the following two kinds of applications: a) Error resilience
If picture Pl is lost e.g. due to transmission channel error, then the subsequent P pictures can not be reconstructed correctly, and the error will propagate temporally and cause some unpleasing artefacts . Although error concealment can be employed at decoder side, it can not remove the artefact very well because some vital information is lost. b) Storage medium recording, e.g. on DVD or VCR DVD (digital versatile disc) or VGR (video cassette re- corder) usually require functions like forward, backward, stop, pause, fast forward, fast backward and random access. However, the known MPEG GOP structure is designed for forward play only and makes complicate the reverse play operation. A simple fast backward play can be achieved by only accessing I pictures in backward direction, but if smoother picture-by-picture reverse-play is desired, much more complexity, bandwidth, and/or storage buffer will be required. For example, one can decode the GOP up to the current frame, and then go back to decode from the beginning of the GOP again up to the next frame to be displayed. However, this requires high bandwidth of throughput. Otherwise a great deal of storage buffer is needed if the bit stream is expected to be decoded only once .
Some different GOP structures have been proposed to solve the above problems. For error resilience, a video redundancy coding method has been disclosed by S. Wenger, G. Knorr, J. Ott, F. Kossentini, "Error Resilience Support in H.263+", IEEE Transactions on Circuits and Systems for Video Technol- ogy, Vol.8, No.7, November 1998, for H.263+ codec applications. This method divides the video sequences into two or more chains in such a way that every picture is assigned to one of the chains. Each chain is coded independently. A GOP structure using two prediction chains is shown in Fig. 2. In case one of these chains is damaged because of a packet loss, the remaining chains stay intact and can be decoded and displayed. It is possible to continue a decoding of the damaged chain, or do some error concealment, by using the information in the other undamaged chain, which leads to only a slight subjective quality degradation. It is also possible to stop the decoding of the damaged chain, and this will only lead to a drop of the frame rate, which has much less effect on subjective quality than other error artefacts. In both cases the resulting error resilient performance is much better than for the Fig. 1 GOP prediction structure. However, this structure does not support the function of reverse-play.
For reverse replay, CW. Lin, J. Zhou, J. Youn, M. T. Sun, "MPEG Video Streaming with VCR Functionality", IEEE Transac- tions on Circuits and Systems for Video Technology, Vol.11, No.3, March 2001, have proposed to add a reverse-encoded bit stream in the server, i.e. in the encoding process. Upon finishing the encoding and reaching the last picture of the video sequence, the video pictures are encoded in the re- verse order to generate a reverse-encoded bit stream. If the server has only the forward encoded bit stream (i.e. the original sequence is unavailable), the forward bit stream can be decoded up to two GOPs each time in the reverse direction (i.e. from the last GOP to the first GOP) and the video sequence is then re-encoded in the reverse order. The generation of the reverse-encoded bit stream is performed off-line. However, each picture is encoded twice and hence the bit stream size is almost doubled.
T. Fang, L. P. Chau, "An error-resilient GOP structure for robust video transmission", IEEE Transactions on Multimedia, Vol.7, No.6, December 2005, have proposed a new GOP structure which takes both error resilience and VCR reverse-play into account. By putting the I picture (In) in the middle of each GOP, the predicted P pictures are partitioned into two parts: half of them (Pn-I, ..., ∑Wi+l) are backward-predic¬ ted encoded and half of them (Pn+i, ..., Pn+j ) are forward- predicted encoded, as shown in the corresponding GOP structure (without B pictures) in Fig. 3. The subscript is the temporal number of the picture in the original video sequence, where the subscripts are monotonously increasing as i>l, n-1 > m+i+1, j>l, and k-1 > n+j+1. If B pictures are included, the structure will not be virtually affected. Obviously, if one P picture is corrupt, at most it will affect only half of the GOP, while the other half of the GOP which is arranged at the other side of picture In will not be affected. In fact, this GOP structure is another form of two prediction chains, wherein one chain is forward and the other is backward. On one hand, this GOP structure makes the reverse-play partly easy since one half of the P frames in the GOP are already reverse-encoded. On the other hand, this GOP structure still has disadvantages in both, the error resilience and the reverse-play. If Pm+i is lost, then Pm+χ to Pm+i are corrupt and error artefacts will be noticed in this time pe- riod. Although the picture chain Pn_i to Pm+i+i may be received correctly, it will not offer help for decoding the pictures of the time period from Pm+χ to Pm+i • Therefore this GOP structure can not provide an error resilient performance as good as the GOP structure depicted in Fig. 2. Further, this GOP structure can not provide a continuous reverse-play function because half of the consecutive P frames are still forward encoded. In detail, the processing order for reverse-play is: I^ —» Pk-I —> ••• —> pn+j+l → ^n → pn-l —> ... —> Pm+i+i —> Im ■ • • • Hence, there are gaps during Pn+j to Pn+i and Pm+i to Pm+i that will cause a big jitter in the reverse play. If the pictures from Pn+j to Pn+i and pm+i to Pm+i really need to be displayed, then normal multipass decoding or huge buffering is necessary, which is the same problem like in the standard GOP structure.
Invention
A problem to be solved by the invention is to provide a GOP structure that increases the error resilience for video transmission and facilitates a fluent reverse-play function. This problem is solved by the method disclosed in claims 1 and 3. Apparatuses that utilise these methods are disclosed in claims 2 and 4.
According to the invention, a reversible GOP (RGOP) structure is used for the video encoding and decoding. The RGOP structure contains both, a forward encoding chain and a backward encoding chain. Each picture in the RGOP structure is assigned to only one of these chains and the video pic- tures of the two chains are interleaved.
This RGOP structure improves the error resilience because, if one prediction chain is corrupt and the other prediction chain is intact, the video sequence can still be decoded and displayed fluently without any noticeable artefact, as is explained below. This RGOP structure also provides an easy and fluent reverse-play function for recording applications.
The additional cost of the inventive processing is a small decrease of the coding efficiency due ' to the prediction in the encoding not using the nearest frame. But the redundant bits are valuable for increasing the error resilience or recovery.
In principle, the inventive encoding method is suited for encoding groups of pictures of a video sequence, each of said groups including an intra encoded picture and more than two predicted encoded pictures, wherein one part of said predicted encoded pictures is backward predicted encoded starting from said intra encoded picture and the other part of said predicted encoded pictures is forward predicted encoded starting from said intra encoded picture, whereby pictures are omitted in these forward and backward predicted encoded picture chains and whereby every two adjacent groups of pictures of said video sequence are arranged in an overlapping manner such that said missing pictures in the for- ward and backward predicted encoded picture chains in a current groups of pictures are included in an interleaved manner in one of said adjacent overlapping groups of pictures.
In principle the inventive encoding apparatus is suited for encoding groups of pictures of a video sequence, each of said groups including an intra encoded picture and more than two predicted encoded pictures, said apparatus including means being adapted for backward predicted encoding starting from said intra encoded picture one part of said predicted encoded pictures, and for forward predicted encoding starting from said intra encoded picture the other part of said predicted encoded pictures, whereby pictures are omitted in these forward and backward predicted encoded picture chains and whereby every two adjacent groups of pictures of said video sequence are arranged in an overlapping manner such that said missing pictures in the forward and backward predicted encoded picture chains in a current groups of pictures are included in an interleaved manner in one of said adjacent overlapping groups of pictures.
In principle, the inventive decoding method is suited for decoding groups of pictures of a video sequence, each of said groups including an intra encoded picture and more than two predicted encoded pictures, wherein one part of said predicted encoded pictures was backward predicted encoded starting from said intra encoded picture and the other part of said predicted encoded pictures was forward predicted encoded starting from said intra encoded picture and said de- coding of said pictures is performed in a corresponding order, whereby pictures were omitted in these forward and backward predicted encoded picture chains and whereby every two adjacent groups of pictures of said video sequence were arranged in an overlapping manner such that said missing pictures in the forward and backward predicted encoded picture chains in a current groups of pictures were included in an interleaved manner in one of said adjacent overlapping groups of pictures, and in said decoding the correspondingly decoded pictures are assembled for the decoded output signal in the original picture order of said video sequence.
In principle the inventive decoding apparatus is suited for decoding groups of pictures of a video sequence, each of said groups including an intra encoded picture and more than two predicted encoded pictures, wherein one part of said predicted encoded pictures was backward predicted encoded starting from said intra encoded picture and the other part of said predicted encoded pictures was forward predicted encoded starting from said intra encoded picture, whereby pictures were omitted in these forward and backward predicted encoded picture chains and whereby every two adjacent groups of pictures of said video sequence were arranged in an overlapping manner such that said missing pictures in the forward and backward predicted encoded picture chains in a current groups of pictures were included in an interleaved man- ner in one of said adjacent overlapping groups of pictures, said apparatus including means being adapted for decoding the pictures of said groups of pictures in a corresponding order and assembling the correspondingly decoded pictures for the decoded output signal in the original picture order of said video sequence.
Advantageous additional embodiments of the invention are disclosed in the respective dependent claims.
Drawings
Exemplary embodiments of the invention are described with reference to the accompanying drawings, which show in: Fig. 1 typical MPEG GOP Structure;
Fig. 2 known GOP structure with two prediction chains; Fig. 3 known GOP structure in which the I picture is arranged in the middle of the GOP;
Fig. 4 inventive RGOP structure;
Fig. 5 another example of an inventive RGOP structure; Fig. 6 inventive RGOP structure with uneven interleaving;
Fig. 7 inventive RGOP structure with B pictures included;
Fig. 8 example of an inventive encoder;
Fig. 9 example of an inventive decoder.
Exemplary embodiments
In the RGOP structure, a group of temporally consecutive pictures are interleaved re-scheduled into two prediction chains. That is, half of the pictures are forward encoded by prediction initially from a previous I picture, while the rest of the pictures are backward encoded by prediction initially from a later I picture. Preferably, the bit stream of the reverse pictures is sent following the bit stream of the forward encoded pictures, to form a new RGOP.
A typical RGOP structure is shown in Fig. 4. In the original video sequence containing the pictures Im, Pm+i, Pm+2' pm+3' Pm+4, ..., Pn-2' Pn-I/ 1Ii' pn+l' pn+2> pn+3' pn+4' •••' pk- 2' pk-l' ^k' •■•/ an<3 having a length of two GOPs, the pic¬ tures Pm+2 ' pm+4' •■•/ pn-l are selected for the reverse prediction encoding chain that starts from picture In in backward direction, whereas the pictures Pn+1> pn+3' ■■•' Pjr-2 are selected for the forward prediction encoding chain that starts from picture In in forward direction. These two chains together build up a new RGOPj.
Correspondingly, pictures Pm+i/ pm+3' •••/ pn-2 f°rm the forward prediction encoded chain in the previous RGOPj__]_ while pictures Pn+2? pn+4' •••/ pk-l f°rrtl the backward pre- diction encoded chain in the following RGOPj+i, i.e. each RGOP contains a backward prediction encoding chain and a forward prediction encoding chain. The neighbouring RGOPs and their pictures are interleaved, i.e. within a GOP length section of the video sequence every second picture belongs to the current RGOPj_ and the intermediate pictures belong to the corresponding adjacent RGOP^-i or RGOPj_+i .
The bit stream of each RGOP contains an I picture, a backward prediction encoded chain, and a forward prediction encoded chain. This can be denoted as {I, {backward prediction encoded chain}, {forward prediction encoded chain}}. For the case of Fig. 4, the transmission order is:
{RGOPi_2}, {Im, {...}, {Pm+i, Pm+3' •••/ Pn-2}}'
(In, { Pn-Ir ■•-, Pm+4' pm+2>' <pn+l' pn+3' •••' Pk-2H,
{Ik, {Pk-i, ..., Pn+4, Pn+2 }, {...}}, {RGOPi+2}.
For error resilience or recovery, if one picture (e.g. Pm+i) in one prediction chain is lost, then turn to the next I picture (e.g. In) which is in the next GOP, and then decode backwards or reversely. Hence Pn-I, •••r pm+4' pm+2 can ^e decoded correctly. By using these correctly decoded pictures, pictures {Pm+i, Pm+3' •••! Pn-2Ϊ can ^e better recov- ered by error concealment or interpolation schemes. Even if error concealment algorithms are not used, a lower frame rate sequence {Pm+2' pm+4' •■■/ pn-l^ can ke displayed in¬ stead without producing much annoying artefacts. Moreover, this RGOP structure has a good capacity to over- come burst errors which appear widely in wireless transmission. Pictures Pm+1, Pm+2, Pm+3, Pm+4, ..., Pn_2, Pn_i, which are continuous in temporal direction, are assigned to different RGOPs, so that there is a delay between the transmission of {Pm+i, Pm+3' •••/ pn-2^ anc* the transmission of {Vn-i, ..., Pm+4, Pm+2}- When a burst error happens in one prediction chain, the other chain is usually intact, and hence the quality of the decoded video sequence can be nearly kept. Also, the inventive RGOP structure provides forward play as well as reverse play easily because it contains a forward prediction chain and a backward prediction chain. Fig. 5 depicts a second embodiment of the inventive RGOP structure having the same features like that depicted in Fig. 4. Pictures {Εm+2, p m+4' ■■-, Pn-I* and <pn+2' pn+4' ..., Pk-I } are forward prediction encoded to form a forward prediction chain while pictures {Pn-2f ---t pm+3' pm+l} and fpk-2' •'•/ pn+3' pn+l^ are reverse prediction encoded to form a backward prediction chain. The transmission order is {RGOPi_2}, {Im, {...}, {Pm+2, pm+4' •••' pn-lH' (In, {Pn_2, •.., Pm+3' Pm+lK <pn+2' pn+4' ■••/ pk-lH, {Ik/ {Pk_2, -.., Pn+3' pn+l>' {••■}}/ (RGOP1+2I.
Fig. 6 shows an inventive RGOP structure in which the interleaving is uneven. That is, the number of pictures in the forward prediction chain is higher than the number of pic- tures in the backward prediction chain. Pictures {P^+i, pm+2' pm+4' pm+5' •••/ pk-3' pk-2} are forward prediction encoded to form the forward prediction chain while pictures (Pk-I' ••■' pm+6' pm+3} are reverse prediction encoded to form the backward prediction chain. This structure benefits forward play more than reverse play. The proportion of forward encoded pictures to reverse encoded pictures can vary according to the application requirements.
Multiple reference frames can be employed in each of the forward prediction and backward prediction chains. But the pictures in the forward prediction chain can not predict from the backward prediction chain pictures and vice versa.
The inventive RGOP structure can be generalised to cases where the video sequence includes B pictures. An example is shown in Fig. 7. It is useful for error resilient video coding and for DVD and VCR applications. Pictures {Pm+1' Bm+3' Pm-l-5, Bm+7, Pm+9, ••., Pk-2Ϊ are forward prediction encoded to form the forward prediction chain while pictures {Pk-1' ..., Pm-1-IO/ Bm+8' pm+6' Bm+4' pm+2} are reverse prediction encoded to form the backward prediction chain. The chains can also start and/or end with corresponding B pictures.
The video data input signal IE of the pixel block encoder in Fig. 8 contains macroblock data for encoding. The pictures are processed in a manner corresponding to that described in figures 6 or 7. In the case of intraframe video data, a sub- tractor SUB simply allows these to pass. They are processed in transform means T and quantising means Q and are fed to an entropy encoder ECOD, which outputs the encoder output signal OE. ECOD can, for example, carry out Huffman coding for the coefficients and add header information and motion vector data. In the case of interframe video data, predicted block or macroblock data PMD are subtracted from the input signal IE in the subtractor SUB and the difference data are fed to the entropy encoder ECOD via the transform means T and the quantising means Q. The output signal of Q is also processed in inverse quantising means QE"^, the output signal of which is fed via inverse transform means T^"^ to the combiner ADDE in the form of reconstructed block or macrob- lock difference data RMDD. The output signal of ADDE is buffer-stored in a frame store in motion estimation and compensation means FS_MC_E, which carry out motion compensation for reconstructed block or macroblock data in the direction as described in figures 6 or 7, and output block or macrob- lock data PMD predicted in this way to the subtracting input of SUB and to the other input of the combiner ADDE. The quantising means Q and the inverse quantising means QE""*" can be controlled by the occupancy level of the encoder buffer ENCB. The output signal of ADDE is output by the encoder COD as reconstructed frame data REC. The output signal of SUB is output by the encoder COD as residual frame data RES.
In Fig. 9, the encoded pixel data input signal ID is fed via entropy decoder means EDEC, inverse quantising means QD-^ and inverse transform means T^"^ as residual frame data RES to a combiner ADDD, which outputs the reconstructed pixel data output signal OD. The pictures are processed in a manner corresponding to that described in figures 6 or 7. EDEC can, for example, carry out Huffman decoding for the coefficients and decode and/or evaluate header information and mo- tion vector data. QE"1/ QD"1' ΎE~^' 11O"1 and EDEC have a function which is the corresponding inverse of the function of Q, T and ECOD. The output signal of ADDD is buffer-stored in a frame store in motion compensation means FS_MC_D. FS_MC_D effects a motion compensation for reconstructed block or macroblock data, in the direction as described in figures 6 or 7. The block or macroblock data PMD predicted in FS_MC_D are passed to the second input of the combiner ADDE in the case of interframe-decoded block or macroblock data. In the case of intraframe-decoded block or macroblock data, the combiner ADDD simply passes on the output signal from T^"1. In case an error signal ES indicates that a picture (i.e. at least one picture) in a backward or forward prediction chain has not been received correctly, the remaining pictures in the corresponding prediction chain can not be decoded but concealed or interpolated using the corresponding interleaved decoded pictures from the adjacent group of pictures to generate the missing output pictures of said video sequence (IE) , or the remaining pictures in the corresponding prediction chain are not decoded but the de- coding continues with the following intra encoded picture and the current chain output signal OD can be adapted correspondingly in its frame rate.
The transform and the inverse transform in figures 8 and 9 can be a DCT or inverse DCT, respectively.

Claims

Claims
1. Method for encoding groups of pictures (RGOPjJ of a video sequence (IE), each of said groups including an intra en- coded picture (I) and more than two predicted encoded pictures (P), characterised in that one part (Pn-I/ Pm+4'
■•■' pm+2'" pn-2' •••' pm+3' pm+l) of said predicted en¬ coded pictures is backward predicted encoded starting from said intra encoded picture (In) and the other part (Pn+1' pn+3' • ■' pk-2'* pn+2/ pn+4> ■••/ pk-l) of said predicted encoded pictures is forward predicted encoded starting from said intra encoded picture (In) , whereby pictures are omitted in these forward and backward predicted encoded picture chains and whereby every two adja- cent groups of pictures (RGOPj__i_, RGOPj_; RGOPj_, RGOPj_+]_) of said video sequence are arranged in an overlapping manner such that said missing pictures (Pn-2f •••/ pm+3' pn+2' pn+4'" pn-l' •■•' pm+4'- pn+l' pn+3) in the forward and backward predicted encoded picture chains in a cur- rent groups of pictures (RGOPjJ are included in an interleaved manner in one of said adjacent overlapping groups of pictures (RGOPj__χ; RGOPi+i) .
2. Apparatus for encoding groups of pictures (RGOPjj of a video sequence (IE), each of said groups including an intra encoded picture (I) and more than two predicted encoded pictures (P) , said apparatus including means (SUB, T, Q, QE"1 / Tg"1, ADDE, FS_MC_E, ECOD) being adapted for backward predicted encoding starting from said intra en- coded picture (In) one part (Pn-I, p m+4/ •••/ pm+2' pn-2> ..., Pm+3/ pm+l) °f said predicted encoded pictures, and for forward predicted encoding starting from said intra encoded picture (In) the other part (Pn+i/ p n+3/ •••/ pk-2' pn+2' pn+4' ■•■/ pk-l) °f said predicted encoded pictures, whereby pictures are omitted in these forward and backward predicted encoded picture chains and whereby every two adjacent groups of pictures (RGOPj__]_, RGOPj_; RGOPi, RGOPi+i) of said video sequence are arranged in an overlapping manner such that said missing pictures (Pn_2/
• • ■/ pm+3'" pn+2' pn+4'* pn-l' • ■ > pm+4'" pn+l' pn+3) in the forward and backward predicted encoded picture chains in a current groups of pictures (RGOPjJ are included in an interleaved manner in one of said adjacent overlapping groups of pictures (RGOP-L_]_; RGOP-L+I) .
3. Method for decoding groups of pictures (RGOPj-) of a video sequence (IE), each of said groups including an intra encoded picture (I) and more than two predicted encoded pictures (P), wherein one part (Pn-I, Pm+4' ••■/ pm+2' Pn_2, •••! Pm+3' pm+l) °f said predicted encoded pictures was backward predicted encoded starting from said intra encoded picture (In) and the other part (Pn+i, pn+3' •••' pk-2; pn+2' pn+4' •■•/ pk-l) °f said predicted encoded pictures was forward predicted encoded starting from said intra encoded picture (In) and said decoding of said pic- tures is performed in a corresponding order, whereby pictures were omitted in these forward and backward predicted encoded picture chains and whereby every two adjacent groups of pictures (RGOPj__i, RGOPj_; RGOPj_, RGOPj_+i) of said video sequence were arranged in an overlapping manner such that said missing pictures (Pn-2? •••r pm+3' pn+2' pn+4'- Pn-I' ••■' pm+4'" pn+l' pn+3) in tne forward and backward predicted encoded picture chains in a current groups of pictures (RGOPj_) were included in an interleaved manner in one of said adjacent overlapping groups of pictures (RGOPj__]_; RGOPj_+]_) , and in said decoding the correspondingly decoded pictures are assembled for the decoded output signal (OD) in the original picture order of said video sequence (IE) .
:. Apparatus for decoding groups of pictures (RGOPj_) of a video sequence (IE), each of said groups including an in tra encoded picture (I) and more than two predicted encoded pictures (P), wherein one part (Pn-If pm+4' •••/ pm+2'- pn-2' •■■/ pm+3' pm+l) of said predicted encoded pictures was backward predicted encoded starting from said intra encoded picture (In) and the other part (Pn+1/ Pn+3, ..., Pk-2' pn+2' pn+4' •••/ pk-l) of said predicted encoded pictures was forward predicted encoded starting from said intra encoded picture (In) , whereby pictures were omitted in these forward and backward predicted en- coded picture chains and whereby every two adjacent groups of pictures (RGOPj__]_, RGOPj_; RGOPj_, RGOP-L+I) of said video sequence were arranged in an overlapping manner such that said missing pictures (Pn-2' •••? pm+3' pn+2> pn+4'" pn-l' •••/ pm+4'" pn+l' pn+3) in the forward and backward predicted encoded picture chains in a current groups of pictures (RGOPjJ were included in an interleaved manner in one of said adjacent overlapping groups of pictures (RGOPj__]_; RGOP-L+I) , said apparatus including means (EDEC, QD"1, T0 "1, ADDD, FS__MC_D) being adapted for decoding the pictures of said groups of pictures in a corresponding order and assembling the correspondingly decoded pictures for the decoded output signal (OD) in the original picture order of said video sequence (IE) .
5. Method according to claim 1 or 3, or apparatus according to claim 2 or 4, wherein said interleaving is uneven.
6. Method according to claim 1 or 3, or apparatus according to claim 2 or 3, wherein said forward and backward predicted encoded picture chains include bi-directionally predicted encoded pictures (B) .
7. Method according to one of claims 3, 5 or 6, or apparatus according to one of claims 4 to 6 wherein, if at least one picture in said backward or forward predicted encoded picture chains is received with errors, the remaining pictures in the corresponding prediction chain are not decoded but the decoding continues with the following intra encoded picture (In, Ij^) .
8. Method or apparatus according to claim 7, wherein the frame rate of said decoded output signal (OD) is adapted correspondingly.
9. Method according to one of claims 3, 5 or 6, or apparatus according to one of claims 4 to 6 wherein, if at least one picture in said backward or forward predicted encoded picture chains is received with errors (ES), the remaining pictures in the corresponding prediction chain are not decoded but concealed (CONC) or interpolated using the corresponding interleaved decoded pictures from the adjacent group of pictures (RGOPj_) .
10. Storage medium, for example on optical disc, that con- tains or stores, or has recorded on it, a digital video signal encoded according to the method of one of claims 1, 5 and 6.
PCT/CN2006/002308 2006-09-07 2006-09-07 Method and apparatus for encoding groups of pictures of a video sequence, each of said groups including an intra encoded picture and more than two predicted encoded pictures WO2008031263A1 (en)

Priority Applications (6)

Application Number Priority Date Filing Date Title
US12/733,265 US8335252B2 (en) 2006-09-07 2006-09-07 Method and apparatus for encoding groups of pictures of a video sequence, each of said groups including an intra encoded picture and more than two encoded pictures
CN2006800557875A CN101601297B (en) 2006-09-07 2006-09-07 Method and apparatus for encoding groups of pictures of a video sequence
KR1020097004781A KR101345073B1 (en) 2006-09-07 2006-09-07 Method and apparatus for encoding groups of pictures of a video sequence, each of said groups including an intra encoded picture and more than two predicted encoded pictures
JP2009526993A JP5190059B2 (en) 2006-09-07 2006-09-07 Method and apparatus for encoding a group of pictures of a video sequence, each group including an intra-coded picture and more than two predictive coded pictures
PCT/CN2006/002308 WO2008031263A1 (en) 2006-09-07 2006-09-07 Method and apparatus for encoding groups of pictures of a video sequence, each of said groups including an intra encoded picture and more than two predicted encoded pictures
EP20060775618 EP2060120A4 (en) 2006-09-07 2006-09-07 Method and apparatus for encoding groups of pictures of a video sequence, each of said groups including an intra encoded picture and more than two predicted encoded pictures

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2006/002308 WO2008031263A1 (en) 2006-09-07 2006-09-07 Method and apparatus for encoding groups of pictures of a video sequence, each of said groups including an intra encoded picture and more than two predicted encoded pictures

Publications (1)

Publication Number Publication Date
WO2008031263A1 true WO2008031263A1 (en) 2008-03-20

Family

ID=39183346

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2006/002308 WO2008031263A1 (en) 2006-09-07 2006-09-07 Method and apparatus for encoding groups of pictures of a video sequence, each of said groups including an intra encoded picture and more than two predicted encoded pictures

Country Status (6)

Country Link
US (1) US8335252B2 (en)
EP (1) EP2060120A4 (en)
JP (1) JP5190059B2 (en)
KR (1) KR101345073B1 (en)
CN (1) CN101601297B (en)
WO (1) WO2008031263A1 (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2011524682A (en) * 2008-06-16 2011-09-01 テレフオンアクチーボラゲット エル エム エリクソン（パブル） Media stream processing
CN109819317A (en) * 2019-01-07 2019-05-28 北京奇艺世纪科技有限公司 A kind of method for processing video frequency, device, terminal and storage medium

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102970616B (en) * 2012-12-04 2015-04-29 华为技术有限公司 Method and device for transmitting videos
WO2015170364A1 (en) * 2014-05-08 2015-11-12 三菱電機株式会社 Image encoding apparatus and image decoding apparatus
EP3145172B1 (en) * 2015-07-07 2021-06-09 Panasonic Intellectual Property Management Co., Ltd. Image capturing device and still image generating method

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH10313462A (en) * 1998-06-17 1998-11-24 Matsushita Electric Ind Co Ltd Video signal compression coding system
US20040223723A1 (en) * 2003-05-05 2004-11-11 Shu Lin Reverse trick modes on non-progressive video using special groups of pictures
US20060045491A1 (en) * 2004-09-02 2006-03-02 Dirk Adolph Method and apparatus for decoding encoded groups of pictures of a video sequence and presenting said video sequence and said groups of pictures in temporally backward direction

Family Cites Families (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2671820B2 (en) * 1994-09-28 1997-11-05 日本電気株式会社 Bidirectional prediction method and bidirectional prediction device
US5510844A (en) * 1994-11-18 1996-04-23 At&T Corp. Video bitstream regeneration using previously agreed to high priority segments
JPH1198513A (en) * 1997-09-18 1999-04-09 Toshiba Corp Moving image coding/decoding device
GB2343321B (en) 1998-11-02 2003-03-26 Nokia Mobile Phones Ltd Error concealment in a video signal
JP4018859B2 (en) * 2000-01-19 2007-12-05 パイオニア株式会社 Information playback device
GB2364459B (en) * 2000-06-30 2004-03-31 Nokia Mobile Phones Ltd Video error resilience
US6816552B2 (en) * 2001-07-11 2004-11-09 Dolby Laboratories Licensing Corporation Interpolation of video compression frames
FI114527B (en) * 2002-01-23 2004-10-29 Nokia Corp Grouping of picture frames in video encoding
MXPA04007020A (en) * 2002-01-23 2004-10-11 Nokia Corp Grouping of image frames in video coding.
JP4010889B2 (en) * 2002-07-01 2007-11-21 富士フイルム株式会社 Recording head, image recording method, and image recording apparatus
EP1383334B1 (en) * 2002-07-17 2012-02-01 Panasonic Corporation Video data transmitting apparatus, video data receiving apparatus, and broadcasting system
US7302105B2 (en) * 2002-07-22 2007-11-27 Canon Kabushiki Kaisha Moving image coding apparatus, moving image decoding apparatus, and methods therefor
US7024098B2 (en) * 2003-05-05 2006-04-04 Thomson Licensing Reverse trick modes on progressive video using special groups of pictures
US20040223735A1 (en) * 2003-05-05 2004-11-11 Shu Lin Forward trick modes on non-progressive video using special groups of pictures

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH10313462A (en) * 1998-06-17 1998-11-24 Matsushita Electric Ind Co Ltd Video signal compression coding system
US20040223723A1 (en) * 2003-05-05 2004-11-11 Shu Lin Reverse trick modes on non-progressive video using special groups of pictures
US20060045491A1 (en) * 2004-09-02 2006-03-02 Dirk Adolph Method and apparatus for decoding encoded groups of pictures of a video sequence and presenting said video sequence and said groups of pictures in temporally backward direction

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See also references of EP2060120A4 *

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2011524682A (en) * 2008-06-16 2011-09-01 テレフオンアクチーボラゲット エル エム エリクソン（パブル） Media stream processing
US8831402B2 (en) 2008-06-16 2014-09-09 Telefonaktiebolaget Lm Ericsson (Publ) Media stream processing
CN109819317A (en) * 2019-01-07 2019-05-28 北京奇艺世纪科技有限公司 A kind of method for processing video frequency, device, terminal and storage medium

Also Published As

Publication number Publication date
JP2010503296A (en) 2010-01-28
JP5190059B2 (en) 2013-04-24
KR20090064375A (en) 2009-06-18
US8335252B2 (en) 2012-12-18
CN101601297A (en) 2009-12-09
EP2060120A1 (en) 2009-05-20
US20110044386A1 (en) 2011-02-24
KR101345073B1 (en) 2013-12-26
CN101601297B (en) 2011-09-14
EP2060120A4 (en) 2012-01-04

Similar Documents

Publication Publication Date Title
US7212576B2 (en) Picture encoding method and apparatus and picture decoding method and apparatus
US6600835B1 (en) Moving-picture compressing technique
CA2412722A1 (en) Video error resilience
JP2004056797A (en) Image decoding method and apparatus
US8335252B2 (en) Method and apparatus for encoding groups of pictures of a video sequence, each of said groups including an intra encoded picture and more than two encoded pictures
KR20100012060A (en) Method and apparatus for variable accuracy inter-picture timing specification for digital video encoding
US5557331A (en) Image encoding method, an image encoding circuit, an image encoding apparatus, and an optical disk
JP3245496B2 (en) Image encoding method, image encoding circuit, image encoding device, and playback device
Tsai et al. H. 264 error resilience coding based on multi-hypothesis motion-compensated prediction
Fan et al. Bidirectionally decodable Wyner-Ziv video coding
KR100237307B1 (en) Dual speed decoding apparatus
van Gassel et al. MPEG-2 compliant trick play over a digital interface
JP2009049826A (en) Coding device, coding method, program of coding method, and recording medium with program of coding method recorded thereon
JP2007151163A (en) Image decoding method and apparatus

Legal Events

Date Code Title Description
WWE Wipo information: entry into national phase

Ref document number: 200680055787.5

Country of ref document: CN

121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 06775618

Country of ref document: EP

Kind code of ref document: A1

WWE Wipo information: entry into national phase

Ref document number: 2006775618

Country of ref document: EP

ENP Entry into the national phase

Ref document number: 2009526993

Country of ref document: JP

Kind code of ref document: A

WWE Wipo information: entry into national phase

Ref document number: 12733265

Country of ref document: US

WWE Wipo information: entry into national phase

Ref document number: 1020097004781

Country of ref document: KR

NENP Non-entry into the national phase

Ref country code: DE