WO2011046231A1 - Methods for parallel video encoding and decoding - Google Patents
Methods for parallel video encoding and decoding Download PDFInfo
- Publication number
- WO2011046231A1 WO2011046231A1 PCT/JP2010/068541 JP2010068541W WO2011046231A1 WO 2011046231 A1 WO2011046231 A1 WO 2011046231A1 JP 2010068541 W JP2010068541 W JP 2010068541W WO 2011046231 A1 WO2011046231 A1 WO 2011046231A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- entropy
- slice
- slices
- bins
- reconstruction
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Ceased
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
- H04N19/119—Adaptive subdivision aspects, e.g. subdivision of a picture into rectangular or non-rectangular coding blocks
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
- H04N19/146—Data rate or code amount at the encoder output
- H04N19/15—Data rate or code amount at the encoder output by monitoring actual compressed data size at the memory before deciding storage at the transmission buffer
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
- H04N19/17—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object
- H04N19/174—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a slice, e.g. a line of blocks or a group of blocks
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/189—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the adaptation method, adaptation tool or adaptation type used for the adaptive coding
- H04N19/192—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the adaptation method, adaptation tool or adaptation type used for the adaptive coding the adaptation method, adaptation tool or adaptation type being iterative or recursive
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/42—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by implementation details or hardware specially adapted for video compression or decompression, e.g. dedicated software implementation
- H04N19/436—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by implementation details or hardware specially adapted for video compression or decompression, e.g. dedicated software implementation using parallelised computational arrangements
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/44—Decoders specially adapted therefor, e.g. video decoders which are asymmetric with respect to the encoder
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/70—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by syntax aspects related to video coding, e.g. related to compression standards
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/90—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using coding techniques not provided for in groups H04N19/10-H04N19/85, e.g. fractals
- H04N19/91—Entropy coding, e.g. variable length coding [VLC] or arithmetic coding
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/12—Systems in which the television signal is transmitted via one channel or a plurality of parallel channels, the bandwidth of each channel being less than the bandwidth of the television signal
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
- H04N19/136—Incoming video signal characteristics or properties
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/40—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using video transcoding, i.e. partial or full decoding of a coded input stream followed by re-encoding of the decoded output stream
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/60—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding
- H04N19/61—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding in combination with predictive coding
Definitions
- Embodiments of the present invention relate generally to video coding and, in particular, to methods for parallel video encoding and decoding.
- H .264 / MPEG-4 AVC H .264 /AVC
- H .264 /AVC MPEG-4 AVC
- Decoders that support parallel decoding may improve decoding speeds and reduce memory requirements. Additionally, advances in multi-core processors may make encoders and decoders that support parallel decoding desirable.
- H .264/ MPEG-4 AVC Joint Video Team of ITU-T VCEG and ISO / IEC MPEG, "H .264 : Advanced video coding for generic audiovisual services," ITU-T Rec . H .264 and ISO / IEC 14496- 10 (MPEG4 - Part 10) , November 2007] , which is hereby incorporated by reference herein in its entirety, is a video codec (coder/ decoder) specification that uses macroblock prediction followed by residual coding to reduce temporal and spatial redundancy in a video sequence for compression efficiency.
- codec codec
- Some embodiments of the present invention comprise methods for parallel entropy encoding and decoding of a video bitstream based on partitioning of data into entropy slices that may be entropy encoded and decoded independently.
- a first portion and second portion of an input compressed-video bitstream may be entropy decoded independently.
- a block of samples of a video frame associated with the second portion of the input compressed-video bitstream may be reconstructed using decoded data from the first portion and the second portion.
- the reconstruction neighbor definition and the entropy decoding neighbor definition are not the same.
- an encoder may partition input data into entropy slices.
- the encoder may entropy encode the entropy slices independently.
- the encoder may form a bitstream comprising entropy-slice headers each of which may indicate the location in the bitstream of the associated data for the entropy slice.
- a decoder may parse a received bitstream for entropy-slice headers, and the decoder may entropy decode a plurality of entropy slices according to a decoder-defined level of parallelism.
- data may be multiplexed at a picture level to form entropy slices.
- entropy slices may correspond to prediction data, and one, or more, entropy slices may correspond to residual data.
- one, or more, entropy slices may correspond to each of a plurality of color planes.
- a bitstream may be trans-coded to comprise entropy slices.
- a received bitstream may be entropy decoded, a plurality of entropy slices may be constructed, and each of the entropy slices may be independently entropy encoded and written to a trans-coded bitstream with an associated entropy-slice header.
- an encoder may partition a reconstruction slice into a plurality of entropy slices, wherein the number of bins associated with each entropy slice in the plurality of entropy slices does not exceed a predefined number of bins.
- an encoder may partition a reconstruction slice into a plurality of entropy slices, wherein the number of macroblocks associated with each entropy slice in the plurality of entropy slices does not exceed a predefined number of macroblocks.
- an encoder may partition a reconstruction slice into a plurality of entropy slices, wherein the number of bits associated with each entropy slice in the plurality of entropy slices does not exceed a predefined number of bits.
- Fig. 1 is a picture showing an H .264 /AVC video encoder (prior art) ;
- Fig. 2 is a picture showing an H .264 /AVC video decoder (prior art) ;
- Fig. 3 is a picture showing an exemplary slice structure (prior art) ;
- Fig. 4 is a picture showing an exemplary slice group structure (prior art) ;
- Fig. 5 is a picture showing an exemplary slice partition according to embodiments of the present invention, wherein a picture may be partitioned in at least one reconstruction slice and a reconstruction slice may be partitioned into more than one entropy slice;
- Fig. 6 is chart showing exemplary embodiments of the present invention comprising an entropy slice
- Fig. 7 is a chart showing exemplary embodiments of the present invention comprising parallel entropy decoding of multiple entropy slices followed by slice reconstruction;
- Fig. 8 is a chart showing exemplary embodiments of the present invention comprising prediction data / residual data multiplexing at the picture level for entropy slice construction;
- Fig. 9 is a chart showing exemplary embodiments of the present invention comprising color-plane multiplexing at the picture level for entropy slice construction
- Fig. 10 is a chart showing exemplary embodiments of the present invention comprising trans-coding a bitstream by entropy decoding, forming entropy slices and entropy encoding;
- Fig. 1 1 is a chart showing exemplary embodiments of the present invention comprising partitioning a reconstruction slice into a plurality of entropy slices, wherein the number of bins associated with each entropy slice in the plurality of entropy slices does not exceed a predefined number of bins;
- Fig. 12 is a chart showing exemplary embodiments of the present invention comprising partitioning a reconstruction slice into a plurality of entropy slices, wherein bins may be associated with an entropy slice until the number of bins in the entropy slice exceeds a threshold based on a predefined maximum number of bins;
- Fig. 13 is a chart showing exemplary embodiments of the present invention comprising partitioning a reconstruction slice into a plurality of entropy slices, wherein the number of bins associated with each entropy slice in the plurality of entropy slices does not exceed a predefined number of bins and each reconstruction slice contains no more than a predefined number of macroblocks;
- Fig. 14 is a chart showing exemplary embodiments of the present invention comprising partitioning a reconstruction slice into a plurality of entropy slices, wherein bins may be associated with an entropy slice until the number of bins in the entropy slice exceeds a threshold based on a predefined maximum number of bins and each reconstruction slice contains no more than a predefined number of macroblocks;
- Fig. 15 is a chart showing exemplary embodiments of the present invention comprising partitioning a reconstruction slice into a plurality of entropy slices, wherein the number of bits associated with each entropy slice in the plurality of entropy slices does not exceed a predefined number of bits;
- Fig. 16 is a chart showing exemplary embodiments of the present invention comprising partitioning a reconstruction slice into a plurality of entropy slices, wherein bits may be associated with an entropy slice until the number of bits in the entropy slices exceeds a threshold based on a predefined maximum number of bits.
- State-of-the-art video-coding methods and standards may provide higher coding efficiency than older methods and standards at the expense of higher complexity. Increasing quality requirements and resolution requirements on video coding methods and standards may also increase their complexity. Decoders that support parallel decoding may improve decoding speeds and reduce memory requirements. Additionally, advances in multi-core processors may make encoders and decoders that support parallel decoding desirable.
- H .264 /AVC and many other video coding standards and methods, are based on a block-based hybrid video-coding approach, wherein the source-coding algorithm is a hybrid of inter-picture, also considered inter-frame, prediction, intra- picture , also considered intra-frame, prediction and transform coding of a prediction residual.
- Inter-frame prediction may exploit temporal redundancies
- intra-frame and transform coding of the prediction residual may exploit spatial redundancies.
- Figure 1 shows a block diagram of an exemplary H .264 /AVC video encoder 2.
- An input picture 4 also considered an input frame, may be presented for encoding.
- a predicted signal 6 and a residual signal 8 may be produced, wherein the predicted signal 6 may be based on either an inter-frame prediction 10 or an intra-frame prediction 12.
- the inter-frame prediction 10 may be determined by a motion compensating section 14 using (i) a reference picture stored in frame memory 16, also considered a reference frame , and (ii) motion information 19 determined by a motion estimation section 18 performing an estimation process for motion between the input frame (input picture) 4 and the reference frame (reference picture) 16.
- the intra-frame prediction 12 may be determined by intra-frame prediction section 20 using a decoded signal 22.
- the residual signal 8 may be determined by subtracting the prediction (predicted signal) 6 from the input frame 4.
- the residual signal 8 is transformed, scaled and quantized by transform/ scale/ quantize section 24 , thereby producing quantized, transform coefficients 26.
- the decoded signal 22 may be generated by adding the predicted signal 6 to a signal 28 generated by an inverse (transform/ scale / quantize) section 30 performing inverse transformation, scaling and inverse quantization of the quantized, transform coefficients 26.
- the motion information 19 and the quantized, transform coefficients 26 may be entropy coded by entropy coding section 32 and written to the compressed-video bitstream 34.
- An output image region 38 for example a portion of the reference frame , may be generated at the encoder 2 , by a de-blocking filter section 36, through filtering the signal 22 that is reconstructed and is to be filtered.
- Figure 2 shows a block diagram of an exemplary computing environment
- H .264 /AVC video decoder 50 H .264 /AVC video decoder 50.
- An input signal 52 also considered a bitstream, may be presented for decoding.
- Received symbols may be entropy decoded by entropy decoding section 54 , thereby producing motion information 56 and quantized, scaled, transform coefficients 58.
- the motion information 56 may be combined by motion compensation section 60 with a portion of a reference frame 84 which may reside in frame memory 64 , and an inter-frame prediction 68 may be generated.
- the quantized, scaled, transform coefficients 58 may be inversely quantized, scaled and inversely transformed by inverse (transform/ scale/ quantize) section 62 , thereby producing a decoded residual signal 70.
- the residual signal 70 may be added to a prediction signal 78: either the inter-frame prediction signal 68 or an intra-frame prediction signal 76, and become combined signal 72.
- the intra-frame prediction signal 76 may be predicted by intra- frame prediction section 74 from previously decoded information (previously combined signal) 72 in the current frame.
- the combined signal 72 may be filtered by de-blocking filter section 80 and the filtered signal 82 may be written to frame memory 64.
- H .264 /AVC In H .264 /AVC, an input picture is partitioned into fixed- size macroblocks, wherein each macroblock covers a rectangular picture area of 16x 16 samples of the luma component and 8x8 samples of each of the two chroma components .
- the decoding process of the H .264 /AVC standard is specified for processing units which are macroblocks.
- the entropy decoding section 54 parses the syntax elements of the compressed-video bitstream 52 and demultiplexes them.
- H .264 /AVC specifies two alternative methods of entropy decoding: a low-complexity technique that is based on the usage of context-adaptively switched sets of variable length codes, referred to as CAVLC, and a computationally more demanding algorithm of context-based adaptively binary arithmetic coding, referred to as CABAG .
- CAVLC context-adaptively switched sets of variable length codes
- CABAG computationally more demanding algorithm of context-based adaptively binary arithmetic coding
- decoding of a current symbol may rely on previously, correctly decoded symbols and adaptively updated context models.
- different data information for example, prediction data information, residual data information and different color planes, may be multiplexed together. De-multiplexing may not be done until elements are entropy decoded.
- a macroblock may be reconstructed by obtaining: the residual signal through inverse quantization and the inverse transform, and the prediction signal, either the intra-frame prediction signal or the inter-frame prediction signal.
- Blocking distortion may be reduced by applying a de-blocking filter to every decoded macroblock. No processing may begin until the input signal is entropy decoded, thereby making entropy decoding a potential bottleneck in decoding.
- entropy decoding may be requisite prior to all processing at the decoder, thereby making entropy decoding a potential bottleneck.
- an input picture comprising a plurality of macroblocks may be partitioned into one or several slices.
- the values of the samples in the area of the picture that a slice represents may be correctly decoded without the use of data from other slices provided that the reference pictures used at the encoder and the decoder are identical. Therefore, entropy decoding and macroblock reconstruction for a slice do not depend on other slices. In particular, the entropy coding state is reset at the start of each slice. The data in other slices are marked as unavailable when defining neighborhood availability for both entropy decoding and reconstruction.
- slices may be entropy decoded and reconstructed in parallel. No intra prediction and motion-vector prediction are allowed across the slice boundary. De-blocking filtering may use information across slice boundaries.
- Figure 3 shows an exemplary video picture 90 comprising eleven macroblocks in the horizontal direction and nine macroblocks in the vertical direction (nine exemplary macroblocks labeled 9 1 -99) .
- Figure 3 shows three exemplary slices: a first slice denoted "SLICE #0" 100 , a second slice denoted “SLICE # 1 " 10 1 and a third slice denoted "SLICE #2" 102.
- An H .264 /AVC decoder may decode and reconstruct the three slices 100, 101 , 102 in parallel.
- context models are initialized or reset and macroblocks in other slices are marked as unavailable for both entropy decoding and macroblock reconstruction.
- macroblocks for example, the macroblock labeled 93, in “SLICE # 1 ,” macroblocks (for example , macroblocks labeled 9 1 and 92) in “SLICE #0" may not be used for context model selection or reconstruction.
- macroblock labeled 95, in “SLICE # 1 ” other macroblocks (for example, macroblocks labeled 93 and 94) in “SLICE # 1 " may be used for context model selection or reconstruction. Therefore, entropy decoding and macroblock reconstruction must proceed serially within a slice. Unless slices are defined using flexible macroblock ordering (FMO) , macroblocks within a slice are processed in the order of a raster scan.
- FMO flexible macroblock ordering
- Flexible macroblock ordering defines a slice group to modify how a picture is partitioned into slices.
- the macroblocks in a slice group are defined by a macroblock-to- slice-group map, which is signaled by the content of the picture parameter set and additional information in the slice headers.
- the macroblock-to- slice-group map consists of a slice-group identification number for each macroblock in the picture.
- the slice-group identification number specifies to which slice group the associated macroblock belongs.
- Each slice group may be partitioned into one or more slices, wherein a slice is a sequence of macroblocks within the same slice group that is processed in the order of a raster scan within the set of macroblocks of a particular slice group. Entropy decoding and macroblock reconstruction must proceed serially within a slice.
- Figure 4 depicts an exemplary macroblock allocation into three slice groups: a first slice group denoted "SLICE GROUP #0" 103 , a second slice group denoted “SLICE GROUP # 1 " 104 and a third slice group denoted "SLICE GROUP #2” 105.
- These slice groups 103, 104 , 105 may be associated with two foreground regions and a background region, respectively, in the picture 90.
- Some embodiments of the present invention may comprise partitioning a picture into one or more reconstruction slices, wherein a reconstruction slice may be self-contained in the respect that values of the samples in the area of the picture that the reconstruction slice represents may be correctly reconstructed without use of data from other reconstruction slices, provided that the references pictures used are identical at the encoder and the decoder. All reconstructed macroblocks within a reconstruction slice may be available in the neighborhood definition for reconstruction.
- Some embodiments of the present invention may comprise partitioning a reconstruction slice into more than one entropy slice, wherein an entropy slice may be self- contained in the respect that symbol values in the area of the picture that the entropy slice represents may be correctly entropy decoded without the use of data from other entropy slices.
- the entropy coding state may be reset at the decoding start of each entropy slice.
- the data in other entropy slices may be marked as unavailable when defining neighborhood availability for entropy decoding.
- macroblocks in other entropy slices may not be used in a current block's context model selection.
- the context models may be updated only within an entropy slice.
- each entropy decoder associated with an entropy slice may maintain its own set of context models.
- ITU Telecommunication Standardization Sector, Study Group 16 - Contribution 405 entitled "Entropy slices for parallel entropy decoding," April 2008, is hereby incorporated by reference herein in its entirety.
- Some embodiments of the present invention may comprise CABAC encoding/ decoding.
- the CABAC encoding process includes the following four elementary steps: binarization; context model selection; binary arithmetic coding; and probability update.
- Binarization A non-binary-valued symbol (for example , a transform coefficient, a motion vector, or other coding data) is converted into a binary code, also referred to as a bin string or a binarized symbol. When a binary-valued syntax element is given, the initial step of binarization may be bypassed.
- a binary-valued syntax element or an element of a binarized symbol may be referred to as a bin.
- a context model is a probability model for one or more bins.
- the context model comprises, for each bin, the probability of the bin being a " 1 " or a "0.”
- the model may be chosen for a selection of available models depending on the statistics of recently coded data symbols, usually based on the left and above neighboring symbols, if available .
- An arithmetic coder encodes each bin according to the selected probability model and is based on recursive interval subdivision .
- Probability Update The selected context model is updated based on the actual coded value.
- all of the context models may be initialized or reset to predefined models.
- Figure 5 shows an exemplary video frame 110 comprising eleven macroblocks in the horizontal direction and nine macroblocks in the vertical direction (nine exemplary macroblocks labeled 115-123).
- Figure 5 shows three exemplary reconstruction slices: a first reconstruction slice denoted "R_SLICE #0" 111, a second reconstruction slice denoted "R_SLICE #1” 112 and a third reconstruction slice denoted "R_SLICE #2” 113.
- Figure 5 further shows a partitioning of the second reconstruction slice "R_SLICE #1" 112 into three entropy slices: a first entropy slice denoted “E_SLICE #0" shown in cross-hatch 112-1, a second entropy slice denoted “E_SLICE #1” shown in vertical-hatch 112-2 and a third entropy slice denoted “E_SLICE #2” shown in angle-hatch 112-3.
- Each entropy slice 112-1, 112-2, 112-3 may be entropy decoded in parallel.
- first entropy slice denoted "E_SLICE #0" and second entropy slice denoted "E_SLICE #1” may also be referred to as first portion and second portion of the bitstream.
- only data from macroblocks within an entropy slice may be available for context model selection during entropy decoding of the entropy slice. All other macroblocks may be marked as unavailable.
- macroblocks labeled 117 and 118 are unavailable for context model selection when decoding symbols corresponding to the area of macroblock labeled 1 19 because macroblocks labeled 1 17 and 1 18 are outside of the entropy slice containing macroblock 1 19. However, these macroblocks 1 17, 1 18 are available when macroblock 1 19 is reconstructed .
- an encoder may determine whether or not to partition a reconstruction slice into entropy slices, and the encoder may signal the decision in the bitstream.
- the signal may comprise an entropy- slice flag, which may be denoted "entropy_slice_flag" in some embodiments of the present invention.
- an entropy-slice flag may be examined (S I 30) , and if the entropy-slice flag indicates that there are no entropy slices associated with a picture, or a reconstruction slice (NO in the step S 130) , then the header may be parsed as a regular slice header (S 134) .
- the entropy decoder state may be reset (S 136) , and the neighbor information for the entropy decoding and the reconstruction may be defined (S I 38) .
- the slice data may then be entropy decoded (S 140) , and the slice may be reconstructed (S 142) .
- the header may be parsed as an entropy-slice header (S 148) .
- the entropy decoder state may be reset (S 150)
- the neighbor information for entropy decoding may be defined (S 152)
- the entropy-slice data may be entropy decoded (S I 54) .
- the neighbor information for reconstruction may then be defined (S 156)
- the slice may be reconstructed (S 142) .
- the next slice, or picture may be examined (back to the step S 130) .
- the decoder may be capable of parallel decoding and may define its own degree of parallelism, for example, consider a decoder comprising the capability of decoding N entropy slices in parallel.
- the decoder may identify N entropy slices (S 170) .
- the decoder may decode entropy slices from subsequent pictures, or reconstruction slices, if they are available.
- the decoder may wait until the current picture, or reconstruction slice, is completely processed before decoding portions of a subsequent picture, or reconstruction slice.
- each of the identified entropy slices may be independently entropy decoded.
- a first entropy slice may be decoded (S 172-S 176) .
- the decoding of the first entropy slice may comprise resetting the decoder state (S 172) .
- the CABAC state may be reset.
- the neighbor information for the entropy decoding of the first entropy slice may be defined (S I 74) , and the first entropy slice data may be decoded (S 176) . For each of the up to N entropy slices, these steps may be performed
- the decoder may reconstruct the entropy slices when all of the entropy slices are entropy decoded (S 184) . In alternative embodiments of the present invention, the decoder may begin reconstruction in the step of
- a decode thread may begin entropy decoding a next entropy slice upon the completion of entropy decoding of an entropy slice.
- the thread may commence decoding additional entropy slices without waiting for other threads to finish their decoding.
- an entropy slice may share most of the slice attributes of a regular slice according to the standard or method. Therefore, an entropy slice may require a small header.
- the entropy slice header may allow a decoder to identify the start of an entropy slice and start entropy decoding.
- the entropy slice header may be the regular header, or a reconstruction slice header.
- an entropy slice may be signaled by adding a new bit, "entropy_slice_flag" to the existing slice header.
- Table 1 lists the syntax for an entropy slice header according to embodiments of the present invention, wherein C indicates Category and Descriptor u( l ) , ue(v) indicate some fixed length or variable length coding methods.
- Embodiments of the present invention comprising an "entropy_slice_flag" may realize improved coding efficiency.
- first_mb_in_slice specifies the address of the first macroblock in the entropy slice associated with the entropy- slice header.
- the entropy slice may comprise a sequence of macroblocks.
- cabac_init_idc specifies the index for determining the initialization table used in the initialization process for the context mode.
- Table 1 Syntax Table for Entropy Slice Header
- an entropy slice may be assigned a different network abstraction layer (NAL) unit type from the regular slices.
- NAL network abstraction layer
- a decoder may distinguish between regular slices and entropy slices based on the NAL unit type .
- the bit field entropy_slice_flag is not required.
- the bit field "entropy_slice_flag” may not be transmitted in all profiles. In some embodiments of the present invention, the bit field “entropy_slice_flag” may not be transmitted in a baseline profile, but the bit field “entropy_slice_flag” may be transmitted in higher profiles such as a main, an extended or a professional profile. In some embodiments of the present invention, the bit field "entropy_slice_flag” may only be transmitted in bitstreams associated with characteristics greater than a fixed characteristic value . Exemplary characteristics may include spatial resolution, frame rate, bit depth, bit rate and other bitstream characteristics.
- the bit field "entropy_slice_flag" may oiily be transmitted in bitstreams associated with spatial resolutions greater than 1920x 1080 interlaced. In some embodiments of the present invention, the bit field “entropy_slice_flag” may only be transmitted in bitstreams associated with spatial resolutions greater than 1920x 1080 progressive. In some embodiments of the present invention, if the bit field "entropy_slice_flag" is not transmitted, a default value may be used.
- an entropy slice may be constructed by altering the data multiplexing.
- the group of symbols contained in an entropy slice may be multiplexed at the macroblock level.
- the group of symbols contained in an entropy slice may be multiplexed at the picture level.
- the group of symbols contained in an entropy slice may be multiplexed by data type.
- the group of symbols contained in an entropy slice may be multiplexed in a combination of the above .
- prediction data 190 and residual data 192 may be entropy encoded by prediction encoder 194 , , and residual encoder 196 separately and multiplexed by picture-level multiplexer 198 at the picture level.
- the prediction data for a picture 190 may be associated with a first entropy slice
- the residual data for a picture 192 may be associated with a second entropy slice.
- the encoded prediction data and the encoded entropy data may be decoded in parallel.
- each partition comprising prediction data or residual data may be partitioned into entropy slices which may be decoded in parallel.
- the residual of each color plane for example, the luma (Y) residual 200 and the two chroma (U and Y) residuals
- the luma (Y) residual for a picture 200 may be associated with a first entropy slice
- the first chroma (U) residual for a picture 202 may be associated with a second entropy slice
- the second chroma (V) residual for a picture 204 may be associated with a third entropy slice.
- the encoded residual data for the three color planes may be decoded in parallel.
- each partition comprising color-plane residual data may be partitioned into entropy slices which may be decoded in parallel.
- the luma residual 200 may have relatively more entropy slices compared to the chroma residuals 202 , 204.
- a compressed-video bitstream may be trans-coded to comprise entropy slices, thereby allowing for parallel entropy decoding as accommodated by embodiments of the present invention described above.
- Some embodiments of the present invention may be described in relation to Figure 10.
- An input bitstream without entropy slices may be processed picture-by-picture according to Figure 10.
- a picture from the input bitstream may be entropy decoded (S220) .
- the data which had been coded for example, mode data, motion information, residual information and other data, may be obtained.
- Entropy slices may be constructed one at a time from the data (S222) .
- An entropy- slice header corresponding to an entropy slice may be inserted in a new bitstream (S224) .
- the encoder state may be reset and the neighbor information may be defined (S226) .
- the entropy slice may be entropy encoded 228 and written to the new bitstream. If there is picture data that has not been consumed by the constructed entropy slices (NO in the step
- macroblocks in other slices are not available for both entropy decoding and macroblock reconstruction.
- some embodiments of the present invention differ from these conventional techniques, in the following point.
- only data from macroblocks within an entropy slice may be available for context model selection during entropy decoding of the entropy slice.
- a macroblock within a reconstruction slice may be reconstructed by using the other macroblocks within the reconstruction slice.
- entropy slices are entropy encoded (decoded) in parallel (independently) and reconstructed by batch process, so that it is possible to perform the reconstruction by continuous prediction in reconstruction slices.
- prediction process is performed without the prediction process being interrupted at boundaries of . the entropy slices (i. e. other entropy slice information is usable in the entropy slices) . This enables parallel entropy processings while holding down the fall in coding efficiency.
- an encoder may partition a reconstruction slice into a plurality of entropy slices in a similar way to that shown in Figure 5 , wherein the size of each entropy slice may be less than, or may not exceed, a fixed number of bins.
- the encoder may restrict the size of each entropy slice, the maximum number of bins may be signaled in the bitstream.
- the encoder may restrict the size of each entropy slice, the maximum number of bins may be defined by the profile and level conformance point of the encoder. For example, Annex A of the H .264 /AVC video coding specification may be extended to comprise a definition of the maximum number of bins allowed in an entropy slice.
- the maximum number of bins allowed in an entropy slice may be indicated for each level conformance point of the encoder according to a table, for example, as shown in Table 2, where M m m.n nickname denotes the maximum number of bins allowed in an entropy slice for a level m.n conformance point.
- Some embodiments of the present invention may disclose methods in which the predefined size is associated with a level conformance point associated with the video bitstream.
- a set of maximum number of bins allowed in an entropy slice may be determined for all levels based on bit rate, image size, number of macroblocks and other encoding parameters .
- the maximum number of bins allowed in an entropy slice may be the set to the same number for all levels . Exemplary values are 38 , 000 bins and 120 , 000 bins .
- an encoder may determine a worst case number of bins associated with a macroblock, and the encoder may write the bins associated with :
- ESLICE MaxNumberBins may denote the maximum number of bins allowed in an entropy slice and BinsPerMB may denote the worst case number of bins associated with a macroblock.
- the macroblocks may be selected in raster- scan order. In alternative embodiments , the macroblocks may be selected in another, predefined order. In some embodiments, the worst case number of bins associated with a macroblock may be a fixed number. In alternative embodiments , the encoder may update the worst case number based on measurements of the size s of previously processed macroblocks .
- an encoder may, for a reconstruction slice , partition the reconstruction slice into a plurality of entropy slices wherein no entropy slice may be larger in size than a predetermined (predefined) number of bins.
- the encoder may initialize to zero a counter associated with the number of bins in a current entropy slice (S240) .
- the counter value may be denoted A for illustrative purposes in the remainder of the description of the embodiments of the present invention described in relation to Figure 1 1 .
- the syntax elements for a next macroblock may be obtained (S242) .
- the next macroblock may be determined according to a predefined macroblock processing order.
- the macroblock processing order may correspond to a raster- scan ordering.
- Non-binary syntax elements in the macroblock may be converted to a string of bins (S244) .
- Binary syntax elements may not require conversion .
- the number of bins associated with the macroblock may be determined (S246) .
- the number of bins associated with the macroblock may include the bins in the strings of bins associated with the non-binary syntax elements in addition to the binary syntax elements, and the number of bins associated with the macroblock may be denoted num for illustrative purposes in the remainder of the description of the embodiments of the present invention described in relation to Figure 1 1 .
- the encoder may determine whether or not a sum of the number of bins associated with the macroblock and the number of already accumulated bins associated with the current entropy slice is greater than a maximum number of bins allowed for an entropy slice (S248) .
- a maximum number of bins allowed for an entropy slice S248 . If the number of bins associated with the macroblock may be added to the number of already accumulated bins associated with the current entropy slice without (NO in the step S248) exceeding the maximum number of bins allowed for an entropy slice, then the number of accumulated bins associated with the current entropy slice may.
- the bins associated with the macroblock may be updated to include the bins associated with the macroblock (S250) , and the bins associated with the macroblock may be written, by the entropy encoder, to the bitstream (S252) and associated with the current entropy slice.
- the syntax elements for the next macroblock may be obtained (back to the step S242) , and the partitioning process may continue .
- step S248 if the sum of the number of bins associated with the macroblock and the number of already accumulated bins associated with the current entropy slice exceeds the maximum number of bins allowed for an entropy slice (YES in the S248) , then the encoder may start a new entropy slice associated with the current reconstruction slice (S254) , and the counter associated with the number of bins in the current entropy slice may be initialized to zero (S256) .
- the number of accumulated bins associated with the current entropy slice may be updated to include the bins associated with the macroblock (S250) , and the bins associated with the macroblock may be written, by the entropy encoder, to the bitstream and associated with the current entropy slice (S252) .
- the syntax elements for the next macroblock may be obtained (back to the step S242) , and the partitioning process may continue.
- a reconstruction slice is partitioned into entropy slices.
- the entropy encode (decode) processing is performed independently per slice, and in a reconstruction processing, information of other entropy slices is usable.
- the present invention includes the technique in which (i) a frame can be portioned into slices, based on the number of bins, and (ii) the number of bins is arranged variable according to a level. As a result, the fall in coding efficiency caused by achieving the parallel entropy processing is held down to its least degree .
- an encoder may, for a reconstruction slice, partition the reconstruction slice into a plurality of entropy slices wherein no entropy slice may be larger in size than a predetermined maximum (predefined) number of bins.
- the encoder may associate macroblock syntax elements with an entropy slice until the size of the entropy slice reaches a threshold associated with the predetermined maximum number of bins allowed in an entropy slice .
- the threshold may be a percentage of the maximum number of bins allowed in an entropy slice .
- the threshold may be 90% of the maximum number of bins allowed in an entropy slice, supposing that the greatest number of bins expected in a macroblock is less than 10% of the maximum number of bins.
- the threshold may be a percentage of the maximum number of bins allowed in an entropy slice wherein the percentage may be based on the greatest number of bins expected in a macroblock.
- the threshold size may be selected to ensure that the entropy slice does not exceed the maximum number of bins allowed in an entropy slice.
- the threshold size may be a function of the maximum number of bins allowed in an entropy slice and an estimate of the maximum number of bins expected for a macroblock.
- the encoder may initialize to zero a counter associated with the number of bins in a current entropy slice (S270) .
- the counter value may be denoted A for illustrative purposes in the remainder of the description of the embodiments of the present invention described in relation to Figure 12.
- the syntax elements for a next macroblock may be obtained (S272) .
- the next macroblock may be determined according to a predefined macroblock processing order.
- the macroblock proce ssing order may correspond to a raster-scan ordering.
- Non-binary syntax elements in the macroblock may be converted to a string of bins (S274) .
- Binary syntax elements may not require conversion .
- the bins associated with the macroblock may be written, by the entropy encoder, to the bitstream and associated with the current entropy slice (S276) .
- the number of bins associated with the macroblock may be determined (S278) , and the number of accumulated bins associated with the current entropy slice may be updated to include the bins associated with the macroblock (S280) .
- the encoder may start a new entropy slice (S286) , and initialize to zero the counter associated with the number of bins in a current entropy slice (S288) .
- the syntax elements for the next macroblock may be obtained (back to the step S272) , and the partitioning process may continue .
- the syntax elements for the next macroblock may be obtained (back to the step S272) , and the partitioning process may continue .
- an encoder may start a new reconstruction slice when a predetermined number of macroblocks have been assigned to the current reconstruction slice .
- an encoder may start a new reconstruction slice when a predetermined number of macroblocks have been assigned to the current reconstruction slice .
- the encoder may initialize to zero a counter associated with the number of macroblocks in a current reconstruction slice (S300) .
- the counter value may be denoted AMB for illustrative purposes in the remainder of the description of the embodiments of the present invention described in relation to Figure 13.
- the encoder may initialize to zero a counter associated with the number of bins in a current entropy slice (S3 10) .
- the counter value may be denoted ABin for illustrative purposes in the remainder of the description of the embodiments of the present invention described in relation to Figure 1 3.
- a new entropy slice may be started (S332) , and a new reconstruction slice may be started (S334) .
- the maximum number of macroblocks allowed in a reconstruction slice may be denoted MaxMBperRSlice for illustrative purposes in the remainder of the description of the embodiments of the present invention described in relation to Figure 13.
- the syntax elements for a next macroblock may be obtained (S3 14) .
- the next macroblock may be determined according to a predefined macroblock processing order.
- the macroblock processing order may correspond to a raster-scan ordering.
- Non-binary syntax elements in the macroblock may be converted to a string of bins (S3 16) .
- Binary syntax elements may not require conversion.
- the number of bins associated with the macroblock may be determined (S3 18) .
- the number of bins associated with the macroblock may include the bins in the strings of bins associated with the non-binary syntax elements in addition to the binary syntax elements, and the number of bins associated with the macroblock may be denoted num for illustrative purposes in the remainder of the description of the embodiments of the present invention described in relation to Figure 1 3.
- the encoder may determine whether or not a sum of the number of bins associated with the macroblock and the number of already accumulated bins associated with the current entropy slice is greater than a maximum number of bins allowed for an entropy slice (S320) .
- the number of bins associated with the macroblock may be added to the number of already accumulated bins associated with the current entropy slice without exceeding a maximum number of bins allowed for an entropy slice (NO in the step S320) , then the number of accumulated bins associated with the current entropy slice may be updated to include the bins associated with the macroblock (S322 ) , the bins associated with the macroblock may be written , by the entropy encoder, to the bitstream and associated with the current entropy slice (S324) , and the number of macroblocks associated with the current reconstruction slice may be incremented (S326) .
- the number of macroblocks associated with the current reconstruction slice may be compared to the predetermined maximum number of macroblocks allowed in a reconstruction slice (back to the step S3 12) , and the partitioning process may continue .
- the encoder may start a new entropy slice associated with the current reconstruction slice (S328) , and the counter associated with the number of bins in the current entropy slice may be initialized to zero (S 330) .
- the number of accumulated bins associated with the current entropy slice may be updated to include the bins associated with the macroblock (S322) , the bins associated with the macroblock may be written, by the entropy encoder, to the bitstream and associated with the current entropy slice (S324) , and the number of macroblocks associated with the current reconstruction slice may be incremented (S326) .
- the number of macroblocks associated with the current reconstruction slice may be compared to the predetermined maximum number of macroblocks allowed in a reconstruction slice (back to the step 3 12) , and the partitioning process may continue.
- an encoder may start a new reconstruction slice when a predetermined number of macroblocks have been assigned to the current reconstruction slice.
- the encoder may associate macroblock syntax elements with an entropy slice until the size of the entropy slice reaches a thre shold associated with the predetermined maximum number of bins allowed in an entropy slice .
- the threshold may be a percentage of the maximum number of bins allowed in an entropy slice .
- the threshold may be 90% of the maximum number of bins allowed in an entropy slice, supposing that the greatest number of bins expected in a macroblock is less than 1 0% of the maximum number of bins .
- the threshold may be a percentage of the maximum number of bins allowed in an entropy slice wherein the percentage may be based on the greatest number of bins expected in a macroblock.
- once the size of an entropy slice exceeds a threshold size then another entropy slice may be created .
- the threshold size may be selected to ensure that the entropy slice does not exceed the maximum number of bins allowed in an entropy slice .
- the threshold size may be a function of the maximum number of bins allowed in an entropy slice and an estimate of the maximum number of bins expected for a macroblock.
- the encoder may initialize to zero a counter associated with the number of macroblocks in a current reconstruction slice (S350) .
- the counter value may be denoted AMB for illustrative purposes in the remainder of the description of the embodiments of the present invention described in relation to Figure 14.
- the encoder may initialize to zero a counter associated with the number of bins in a current entropy slice (S352) .
- the counter value may be denoted ABin for illustrative purposes in the remainder of the description of the embodiments of the present invention described in relation to Figure 14.
- a new entropy slice may be started (S374) , and a new reconstruction slice may be started (S376) .
- the maximum number of macroblocks allowed in a reconstruction slice may be denoted MaxMBperRSlice for illustrative purposes in the remainder of the description of the embodiments of the present invention described in relation to Figure 14.
- the syntax elements for a next macroblock may be obtained (S356) .
- the next macroblock may be determined according to a predefined macroblock processing order.
- the macroblock processing order may correspond to a raster-scan ordering.
- Non-binary syntax elements in the macroblock may be converted to a string of bins (S358) .
- Binary syntax elements may not require conversion .
- the bins associated with the macroblock may be written, by the entropy encoder, to the bitstream and associated with the current entropy slice (S360) .
- the number of bins associated with the macroblock may be determined (S362) , and the number of accumulated bins associated with the current entropy slice may be updated to include the bins associated with the macroblock (S364) . If the number of accumulated bins associated with the current entropy slice is greater than a threshold (S366) , which may be denoted TH (MaxNumBins) , based on the maximum number of bins allowed in an entropy slice (YES in the step S366) , then the encoder may start a new entropy slice (S370) , and initialize to zero the counter associated with the number of bins in a current entropy slice (S372 ) .
- TH MaxNumBins
- the number of macroblocks associated with the current reconstruction slice may be incremented (S368) .
- the number of macroblocks associated with the current reconstruction slice may be compared to the predetermined maximum number of macroblocks allowed in a reconstruction slice (back to the step S354) , and the partitioning process may continue .
- the number of accumulated bins associated with the current entropy slice is not greater than the threshold based on the maximum number of bins allowed in an entropy slice (NO in the step S366) , then the number of macroblocks associated with the current reconstruction slice may be incremented (S368) , and the number of macroblocks associated with the current reconstruction slice may be compared to the predetermined maximum number of macroblocks allowed in a reconstruction slice (back to the step S354) , and the partitioning process may continue.
- an encoder may partition a reconstruction slice into a plurality of entropy slices, wherein each entropy slice may be associated with no more than a predefined number of bits.
- an encoder may, for a reconstruction slice, partition the reconstruction slice into a plurality of entropy slices wherein no entropy slice may be larger in size than a predetermined (predefined) number of bits.
- the encoder may initialize to zero a counter associated with the number of bits in a current entropy slice (S400) .
- the counter value may be denoted A for illustrative purposes in the remainder of the description of the embodiments of the present invention described in relation to Figure 15.
- the syntax elements for a next macroblock may be obtained (S402) .
- the next macroblock may be determined according to a predefined macroblock processing order.
- the macroblock processing order may correspond to a raster- scan ordering.
- Non-binary syntax elements in the macroblock may be converted to a string of bins (S404) .
- Binary syntax elements may not require conversion .
- the bins , converted non-binary elements and binary elements , associated with the macroblock may be presented to the entropy encoder, and the bins may be entropy encoded (S406) .
- the number of bits associated with the macroblock may be determined (S408) .
- the number of bits associated with the macroblock may be denoted num for illustrative purposes in the remainder of the description of the embodiments of the pre sent invention described in relation to Figure 1 5.
- the encoder may determine whether or not a sum of the number of bits associated with the macroblock and the number of already accumulated bits associated with the current entropy slice is greater than a maximum number of bits allowed for an entropy slice (S4 1 0) .
- step S4 10 if the number of bits associated with the macroblock may be added to the number of already accumulated bits associated with the current entropy slice without exceeding the maximum number of bits allowed for an entropy slice (NO in the step S4 10) , then the number of accumulated bits associated with the current entropy slice may be updated to include the bits associated with the macroblock (S412) , and the bits associated with the macroblock may be written to the bitstream and associated with the current entropy slice (S4 14) .
- the syntax elements for the next macroblock may be obtained (back to the step S402) , and the partitioning process may continue .
- the encoder may start a new entropy slice associated with the current reconstruction slice (S4 16) , and the counter associated with the number of bits in the current entropy slice may be initialized to zero (S418) .
- the number of accumulated bits associated with the current entropy slice may be updated to include the bits associated with the macroblock (S4 12) , and the bits associated with the macroblock may be written to the bitstream and associated with the current entropy slice (S4 14) .
- the syntax elements for the next macroblock may be obtained (back to the step S402) , and the partitioning process may continue.
- an encoder may, for a reconstruction slice, partition the reconstruction slice into a plurality of entropy slices wherein no entropy slice may be larger in size than a predetermined maximum number of bits.
- the encoder may associate macroblock syntax elements with an entropy slice until the size of the entropy slice reaches a threshold associated with the predetermined maximum number of bits allowed in an entropy slice.
- the threshold may be a percentage of the maximum number of bits allowed in an entropy slice.
- the threshold may be 90% of the maximum number of bits allowed in an entropy slice, supposing that the greatest number of bits expected in a macroblock is less than 10% of the maximum number of bits.
- the threshold may be a percentage of the maximum number of bits allowed in an entropy slice wherein the percentage may be based on the greatest number of bits expected in a macroblock.
- the threshold size may be a function of the maximum number of bits allowed in an entropy slice and an estimate of the maximum number of bits expected for a macroblock.
- the encoder may initialize to zero a counter associated with the number of bits in a current entropy slice (S440) .
- the counter value may be denoted A for illustrative purposes in the remainder of the description of the embodiments of the present invention described in relation to Figure 16.
- the syntax elements for a next macroblock may be obtained (S442) .
- the next macroblock may be determined according to a predefined macroblock processing order.
- the macroblock processing order may correspond to a raster-scan ordering.
- Non-binary syntax elements in the macroblock may be converted to a string of bins (S444) .
- Binary syntax elements may not require conversion .
- the bins associated with the macroblock may be entropy encoded (S446) , and the number of bins associated with the macroblock may be determined (S448) .
- the number of accumulated bits associated with the current entropy slice may be updated to include the bins associated with the macroblock (S450) , and the entropy encoded bins associated with the macroblock may be written to the bitstream (S452) .
- the encoder may start a new entropy slice (S458) , and initialize to zero the counter associated with the number of bits in a current entropy slice (S460) .
- the syntax elements for the next macroblock may be obtained (back to the step S442) , and the partitioning process may continue.
- the syntax elements for the next macroblock may be obtained (back to the step 442) , and the partitioning process may continue.
- an encoder may partition a reconstruction slice into a plurality of entropy slices, wherein each entropy slice may be associated with no more than a predefined number of macroblocks.
- a restriction on the maximum number of macroblocks in a reconstruction slice may be imposed in addition to a restriction on the size of an entropy slice .
- an encoder may partition a reconstruction slice into a plurality of entropy slices, wherein the size of each entropy slice may be restricted to less than a predefined number of macroblocks and to less than a predefined number of bins.
- an encoder may partition a reconstruction slice into a plurality of entropy slices, wherein the size of each entropy slice may be restricted to less than a predefined number of macroblocks and to less than a predefined number of bits.
- an encoder may partition a reconstruction slice into a plurality of entropy slices, wherein the size of each entropy slice may be restricted to less than a predefined number of macroblocks, to less than a predefined number of bins and to less than a predefined number of bits.
- Table 3 shows a comparison of rate distortion performance for all-intra coding.
- the first comparison shown in the two sub-columns of column three, is a comparison, using the H .264 /AVC Joint Model (JM) software, version 13.0 , between encoding using multiple slices, wherein entropy decoding and macroblock reconstruction for a slice does not depend on other slices, and encoding using no slices.
- JM Joint Model
- the quality is degraded by - 0.3380 dB encoding using multiple slices over using no slices .
- the bit rate is increased by 7% by encoding using multiple slices over using no slices.
- the second comparison is a comparison between encoding using one reconstruction slice partitioned, according to embodiments of the present invention, into multiple entropy slices (two rows of macroblocks per entropy slice) and encoding using JM 13.0 with no slices.
- the quality is degraded by -0.0860 dB using one reconstruction slice with multiple entropy slices over encoding using no slices.
- the bit rate is increased by 1 .83% by encoding using one reconstruction slice with multiple entropy slices over encoding using no slices.
- Table 4 shows a comparison of rate distortion performance for IBBP coding.
- the first comparison shown in the two sub-columns of column three, is a comparison, using the H .264 /AVC Joint Model (JM) software, version 13.0, between encoding using multiple slices, wherein entropy decoding and macroblock reconstruction for a slice does not depend on other slices, and encoding using no slices.
- JM Joint Model
- the quality is degraded by - 0.5460 dB encoding using multiple slices.
- the bit rate is increased by 2 1.4 1 % by encoding using multiple slices over using no slices .
- the second comparison is a comparison between encoding using one reconstruction slice partitioned, according to embodiments of the present invention, into multiple entropy slices (two rows of macroblocks per entropy slice) and encoding using JM 13.0 with no slices.
- the quality is degraded by -0.3 1 dB using one reconstruction slice with multiple entropy slices over encoding using no slices.
- the bit rate is increased by 1 1 .45% by encoding using one reconstruction slice with multiple entropy slices over encoding using no slices.
- encoding using multiple entropy slices in one reconstruction slice provides a bit rate savings of 5. 17% and 9.96% for all-intra and IBBP coding, respectively, over encoding using slices, wherein entropy decoding and macroblock reconstruction for a slice does not depend on other slices, although both allow for parallel decoding.
- Table 5 shows a comparison of rate distortion performance for all-intra and IBBP coding.
- the comparison is a comparison between encoding using no slices and encoding using one reconstruction slice partitioned into entropy slices, according to embodiments of the present invention, of maximum size 26k bins per entropy slice .
- the first comparison shown in the two sub-columns of column two, is a comparison using all-intra coding.
- the quality is degraded by -0.062 dB by encoding using a reconstruction slice with multiple entropy slices.
- the bit rate is increased by 1 .86% by encoding using a reconstruction slice with multiple entropy slices.
- the second comparison is a comparison using IBBP coding.
- the quality is degraded by 0.022 dB using one reconstruction slice with multiple entropy slices over encoding using no slices.
- the bit rate is increased by 0.787% by encoding using one reconstruction slice with multiple entropy slices over encoding using no slices.
- Table 5 Comparison of rate distortion performance - all-intra and IBBP encoding using entropy slices with less than 26k bins per entropy slice
- entropy slices allows for parallel decoding, and encoder partitioning of a reconstruction slice into entropy slices, wherein each entropy slice is less than a maximum number of bins may provide considerable bit rate savings over entropy slices of a fixed number of macroblocks.
- the above methods can also be used on devices for encoding a video frame and decoding a video bitstream.
- Some embodiments of the present invention may disclose methods in which the predefined number of bins is associated with a profile associated with a video bitstream generated by the encoder.
- Some embodiments of the present invention may disclose methods in which the predefined size is associated with a profile associated with a video bitstream generated by the encoder.
- Some embodiments of the present invention may disclose methods in which the predefined size is associated with a level associated with a video bitstream generated by the encoder.
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Computing Systems (AREA)
- Theoretical Computer Science (AREA)
- Compression Or Coding Systems Of Tv Signals (AREA)
Priority Applications (5)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| JP2012515843A JP2013509006A (ja) | 2009-10-14 | 2010-10-14 | 動画像の並列的な符号化および復号のための方法 |
| CN2010800462585A CN102577381A (zh) | 2009-10-14 | 2010-10-14 | 并行视频编码和解码方法 |
| US13/502,012 US20120201294A1 (en) | 2009-10-14 | 2010-10-14 | Methods for parallel video encoding and decoding |
| BR112012008770A BR112012008770A2 (pt) | 2009-10-14 | 2010-10-14 | métodos para codificação e decodificação paralelas de vídeo. |
| EP10823498A EP2489191A1 (en) | 2009-10-14 | 2010-10-14 | Methods for parallel video encoding and decoding |
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| US12/579,236 | 2009-10-14 | ||
| US12/579,236 US20100027680A1 (en) | 2008-03-28 | 2009-10-14 | Methods and Systems for Parallel Video Encoding and Decoding |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| WO2011046231A1 true WO2011046231A1 (en) | 2011-04-21 |
Family
ID=43876277
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| PCT/JP2010/068541 Ceased WO2011046231A1 (en) | 2009-10-14 | 2010-10-14 | Methods for parallel video encoding and decoding |
Country Status (6)
| Country | Link |
|---|---|
| US (1) | US20120201294A1 (enExample) |
| EP (1) | EP2489191A1 (enExample) |
| JP (1) | JP2013509006A (enExample) |
| CN (1) | CN102577381A (enExample) |
| BR (1) | BR112012008770A2 (enExample) |
| WO (1) | WO2011046231A1 (enExample) |
Families Citing this family (17)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US10244246B2 (en) * | 2012-02-02 | 2019-03-26 | Texas Instruments Incorporated | Sub-pictures for pixel rate balancing on multi-core platforms |
| US9485506B2 (en) * | 2012-09-11 | 2016-11-01 | Texas Instruments Incorporated | Method and system for constraining slice header processing overhead in video coding |
| US20140072027A1 (en) * | 2012-09-12 | 2014-03-13 | Ati Technologies Ulc | System for video compression |
| US10785482B2 (en) | 2012-09-24 | 2020-09-22 | Texas Instruments Incorporated | Method and system for constraining tile processing overhead in video coding |
| CN103414902A (zh) * | 2013-08-26 | 2013-11-27 | 上海富瀚微电子有限公司 | 用于低功耗应用的avc并行编码方法 |
| US10645385B2 (en) * | 2017-06-28 | 2020-05-05 | Mediatek Inc. | Method and apparatus for performing fixed-size slice encoding with slice boundary prediction |
| US10567780B2 (en) | 2018-06-14 | 2020-02-18 | Telefonaktiebolaget Lm Ericsson (Publ) | System and method for encoding 360° immersive video |
| US10432970B1 (en) * | 2018-06-14 | 2019-10-01 | Telefonaktiebolaget Lm Ericsson (Publ) | System and method for encoding 360° immersive video |
| US10419738B1 (en) | 2018-06-14 | 2019-09-17 | Telefonaktiebolaget Lm Ericsson (Publ) | System and method for providing 360° immersive video based on gaze vector information |
| US10623736B2 (en) | 2018-06-14 | 2020-04-14 | Telefonaktiebolaget Lm Ericsson (Publ) | Tile selection and bandwidth optimization for providing 360° immersive video |
| US10841662B2 (en) | 2018-07-27 | 2020-11-17 | Telefonaktiebolaget Lm Ericsson (Publ) | System and method for inserting advertisement content in 360° immersive video |
| US10757389B2 (en) | 2018-10-01 | 2020-08-25 | Telefonaktiebolaget Lm Ericsson (Publ) | Client optimization for providing quality control in 360° immersive video during pause |
| US10440416B1 (en) | 2018-10-01 | 2019-10-08 | Telefonaktiebolaget Lm Ericsson (Publ) | System and method for providing quality control in 360° immersive video during pause |
| US12003786B2 (en) * | 2019-08-06 | 2024-06-04 | Hyundai Motor Company | Entropy-coding for video encoding and decoding |
| CN119520783A (zh) * | 2019-08-06 | 2025-02-25 | 现代自动车株式会社 | 熵解码、编码方法,发送比特流的方法 |
| CN113259675B (zh) * | 2021-05-06 | 2021-10-01 | 北京中科大洋科技发展股份有限公司 | 一种超高清晰度视频图像并行处理方法 |
| CN118764650B (zh) * | 2024-09-06 | 2024-12-03 | 杭州海康威视数字技术股份有限公司 | 一种熵解码方法、熵解码器、熵解码装置及熵解码设备 |
Citations (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2008172599A (ja) * | 2007-01-12 | 2008-07-24 | Mitsubishi Electric Corp | 動画像符号化装置、動画像復号装置、動画像符号化方法、および動画像復号方法 |
Family Cites Families (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6856701B2 (en) * | 2001-09-14 | 2005-02-15 | Nokia Corporation | Method and system for context-based adaptive binary arithmetic coding |
| US20080151998A1 (en) * | 2006-12-21 | 2008-06-26 | General Instrument Corporation | Method and Apparatus for Providing Rate Control for Panel-Based Real Time Video Encoder |
| US8938009B2 (en) * | 2007-10-12 | 2015-01-20 | Qualcomm Incorporated | Layered encoded bitstream structure |
| US7932843B2 (en) * | 2008-10-17 | 2011-04-26 | Texas Instruments Incorporated | Parallel CABAC decoding for video decompression |
-
2010
- 2010-10-14 EP EP10823498A patent/EP2489191A1/en not_active Withdrawn
- 2010-10-14 JP JP2012515843A patent/JP2013509006A/ja active Pending
- 2010-10-14 US US13/502,012 patent/US20120201294A1/en not_active Abandoned
- 2010-10-14 CN CN2010800462585A patent/CN102577381A/zh active Pending
- 2010-10-14 BR BR112012008770A patent/BR112012008770A2/pt not_active IP Right Cessation
- 2010-10-14 WO PCT/JP2010/068541 patent/WO2011046231A1/en not_active Ceased
Patent Citations (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2008172599A (ja) * | 2007-01-12 | 2008-07-24 | Mitsubishi Electric Corp | 動画像符号化装置、動画像復号装置、動画像符号化方法、および動画像復号方法 |
Non-Patent Citations (3)
| Title |
|---|
| "Entropy slices for parallel entropy decoding", ITU TELECOMMUNICATION STANDARDIZATION SECTOR, STUDY GROUP 16 - CONTRIBUTION 405, April 2008 (2008-04-01) |
| JIE ZHAO ET AL.: "New Results using Entropy Slices for Parallel Decoding (VCEG-AI32)", ITU-T SG16 Q.6 VCEG, 16 July 2008 (2008-07-16), pages 1 - 9 * |
| JIE ZHAO ET AL.: "Parallel entropy decoding for high-resolution video coding", PROC. SPIE, vol. 7257, 19 January 2009 (2009-01-19) * |
Also Published As
| Publication number | Publication date |
|---|---|
| BR112012008770A2 (pt) | 2018-11-06 |
| CN102577381A (zh) | 2012-07-11 |
| US20120201294A1 (en) | 2012-08-09 |
| JP2013509006A (ja) | 2013-03-07 |
| EP2489191A1 (en) | 2012-08-22 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US12231699B2 (en) | Methods, devices and systems for parallel video encoding and decoding | |
| EP2489191A1 (en) | Methods for parallel video encoding and decoding | |
| CN106060549B (zh) | 视频编码和解码中上下文初始化的方法和系统 | |
| CN107105253B (zh) | 用于编码和解码视频帧的装置 | |
| WO2012043887A1 (en) | Methods and systems for entropy coder initialization | |
| US20120014431A1 (en) | Methods and Systems for Parallel Video Encoding and Parallel Video Decoding | |
| WO2012008612A1 (en) | Methods and systems for parallel video encoding and parallel video decoding | |
| HK40050071A (en) | Method for parallel video decoding | |
| HK40045328B (en) | Device for parallel video decoding | |
| HK40045328A (en) | Device for parallel video decoding | |
| HK1229106A1 (en) | Methods, devices and systems for parallel video encoding and decoding | |
| HK1238832B (zh) | 视频帧编码方法及装置、视频帧解码方法及装置 | |
| HK1229106B (en) | Method for parallel video decoding | |
| HK1229099A1 (en) | Methods and systems for context initialization in video coding and decoding | |
| HK1227561A1 (en) | Methods and systems for context initialization in video coding and decoding | |
| HK1227186A1 (en) | Methods and systems for context initialization in video coding and decoding | |
| HK1228606A1 (en) | Video decoding device, video encoding device and methods thereof |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| WWE | Wipo information: entry into national phase |
Ref document number: 201080046258.5 Country of ref document: CN |
|
| 121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 10823498 Country of ref document: EP Kind code of ref document: A1 |
|
| WWE | Wipo information: entry into national phase |
Ref document number: 2012515843 Country of ref document: JP |
|
| WWE | Wipo information: entry into national phase |
Ref document number: 13502012 Country of ref document: US |
|
| WWE | Wipo information: entry into national phase |
Ref document number: 1201001698 Country of ref document: TH |
|
| NENP | Non-entry into the national phase |
Ref country code: DE |
|
| WWE | Wipo information: entry into national phase |
Ref document number: 3735/CHENP/2012 Country of ref document: IN Ref document number: 2010823498 Country of ref document: EP |
|
| REG | Reference to national code |
Ref country code: BR Ref legal event code: B01A Ref document number: 112012008770 Country of ref document: BR |
|
| ENP | Entry into the national phase |
Ref document number: 112012008770 Country of ref document: BR Kind code of ref document: A2 Effective date: 20120413 |