KR101178085B1 - Weighted prediction based on vectorized entropy coding - Google Patents

Abstract

This disclosure describes a method for controlling the selection of prediction coding techniques for such an enhancement layer video block based on the characteristics of the vectorized entropy coding for the enhancement layer video block. According to the present disclosure, the prediction technique used for prediction based video coding of an enhancement layer video block depends on the vectorized entropy coding used for this enhancement layer video block. For each coded unit, the predictive coding technique (depending on whether the vectorized entropy coding defines a single vector for the video block of the coded unit or multiple vectors for the video block of the coded unit) For example, weighted prediction or unweighted prediction) may be selected.

Description

Weighted prediction based on vectorized entropy coding {WEIGHTED PREDICTION BASED ON VECTORIZED ENTROPY CODING}

Related application

This application claims priority to US Provisional Patent Application 61 / 106,039, filed October 16, 2008, and incorporated herein by reference.

Technical Field

The present disclosure relates to block-based digital video coding used to compress video data.

Digital video capabilities include digital television, digital direct broadcast systems, wireless communication devices such as cordless telephone handsets, wireless broadcast systems, personal digital assistants (PDAs), laptop or desktop computers, digital cameras, digital recording devices, video gaming It can be integrated into a wide range of devices, including devices, video game consoles, and the like. Digital video devices implement video compression techniques such as MPEG-2, MPEG-4 or H.264 / MPEG-4, Part 10, Advanced Video Coding (AVC) to transmit and receive digital video more efficiently. Video compression techniques perform spatial and temporal prediction to reduce or eliminate redundancy inherent in video signals.

Block-based video compression techniques generally perform spatial prediction and / or temporal prediction. Intra-coding relies on spatial prediction to reduce or remove spatial redundancy between video blocks within a given coded unit, which may include video frames, slices of video frames, and the like. In contrast, inter-coding relies on temporal prediction to reduce or remove temporal redundancy between video blocks of successively coded units of a video sequence. In intra-coding, the video encoder performs spatial prediction to compress the data based on other data in the same coded unit. In inter-coding, the video encoder performs motion estimation and motion compensation to track the motion of corresponding video blocks of two or more adjacent coded units.

A coded video block may be represented by predictive information that can be used to generate or identify a predictive block, and a residual block of data that indicates a difference between the block being coded and the predictive block. In the case of inter-coding, one or more motion vectors are used to identify the predictive block of data, while in intra-coding, the prediction mode may be used to generate the predictive block. Both intra- and inter-coding may define several different prediction modes, which may define different block sizes and / or prediction techniques used for coding. Additional types of syntax elements may also be included as part of the encoded video data to control or define coding techniques or parameters used in the coding process.

After block-based predictive coding, the video encoder may apply a transform, quantization, and entropy coding process to further reduce the bit rate associated with communication of the residual block. The transformation technique may include conceptually similar processes such as discrete cosine transformation, wavelet transformation, integer transformation, or other type of transformation. In one example, in a discrete cosine transform (DCT) process, the transform process transforms a set of pixel values into transform coefficients, which transform coefficients may represent the energy of the pixel values in the frequency domain. Quantization is applied to transform coefficients and generally involves a process of limiting the number of bits associated with any given transform coefficient. Entropy coding includes one or more processes to comprehensively compress a sequence of quantized transform coefficients.

In various cases, the video sequence may be coded with a base layer and one or more enhancement layers. In this case, the base layer may define a base level of video quality, and one or more enhancement layers may improve the quality of the decoded video signal. The enhancement layer is decoded by, for example, possibly providing a spatial enhancement to the base layer frame, possibly providing a signal to noise enhancement, or possibly adding additional frames between the base layer frames. It is also possible to improve the video quality in a variety of possible ways, such as providing temporal enhancements to the video. In either case, the encoded video may be sent to a video decoding device, which performs the reciprocal process of the video encoder to reconstruct the video sequence.

summary

In general, the present disclosure describes a method for controlling the selection of a predictive coding technique for an enhancement layer video block based on the characteristics of the vectorized entropy coding for such enhancement layer video block. Vectorized entropy coding refers to entropy coding of a video block that depends on a vector syntax element that defines the number of vectors associated with the video block. The vector syntax element may be defined for each coded unit, such as, for example, each video frame or each independently decodable slice or some video frame. Each vector defined by the vector syntax element defines a set of coefficients of the video block to be entropy coded together. If several vectors are defined for the video block of the coded unit, several individual sets of coefficients will be entropy coded separately for each video block. If only one vector is defined for the video block of the coded unit, then all of the coefficients for each given video block will be entropy coded together.

According to the present disclosure, the prediction technique used for prediction based video coding of an enhancement layer video block depends on the vectorized entropy coding used for this enhancement layer video block. For each coded unit, depending on whether the vectorized entropy coding defines a single vector for the video block of the coded unit or multiple vectors for the video block of the coded unit (eg Predictive coding techniques (such as, weighted or unweighted prediction) may be selected. More specifically, weighted prediction may be selected if vectorized entropy coding establishes two or more vectors for the enhancement layer video block.

Alternatively, unweighted prediction, such as sequential prediction, may be selected when vectorized entropy coding establishes a single vector for the enhancement layer video block. In this disclosure, weighted prediction refers to prediction that refers to weighted prediction data that includes a combination of predicted enhancement layer data and predicted base layer data. In contrast, sequential prediction refers to prediction that refers to precoded data, such as prediction frames of the same layer associated with the block to be coded.

In one example, the present disclosure provides a method of coding data of a video sequence. The method includes defining one or more vectors for vectorized entropy coding of an enhancement layer video block of a coded unit within a video sequence, the enhancement layer video block of the coded unit based on the defined vectorized entropy coding. Selecting a prediction mode for the prediction mode, wherein the selection of the prediction mode comprises selecting weighted prediction if the defined vectorized entropy coding establishes two or more vectors for the enhancement layer video block. Selecting, and coding an enhancement layer video block based on the selected prediction mode and vectorized entropy coding.

As another example, the present disclosure provides an apparatus for coding data of a video sequence. The apparatus defines one or more vectors for vectorized entropy coding of an enhancement layer video block of units coded in a video sequence and predicts for the enhancement layer video blocks of the coded unit based on the defined vectorized entropy coding. A control unit that selects a mode, which selects weighted prediction if its defined vectorized entropy coding establishes two or more vectors for the enhancement layer video block. The apparatus also includes a prediction unit for performing predictive coding techniques and an entropy coding unit for performing vectorized entropy coding based on the selected prediction mode.

In another example, the present disclosure provides a device for coding data of a video sequence, the device comprising: means for defining one or more vectors for vectorized entropy coding of an enhancement layer video block of a unit coded within a video sequence, Means for selecting a prediction mode for an enhancement layer video block of a coded unit based on the defined vectorized entropy coding, wherein the defined vectorized entropy coding establishes two or more vectors for the enhancement layer video block Means for selecting a prediction mode, comprising means for selecting a prediction, and means for coding an enhancement layer video block based on the selected prediction mode and vectorized entropy coding.

As another example, the present disclosure defines one or more vectors for vectorized entropy encoding of an enhancement layer video block of a unit coded within a video sequence and enhances the enhancement layer video of the coded unit based on the defined vectorized entropy coding. A control unit for selecting a prediction mode for a block, wherein the control unit for selecting weighted prediction when the defined vectorized entropy coding establishes two or more vectors for the enhancement layer video block, the prediction based on the selected prediction mode A device includes a prediction unit for performing an encoding technique, an entropy encoding unit for performing at least a portion of a bitstream by performing vectorized entropy encoding, and a wireless transmitter for transmitting the bitstream to another device.

As another example, the present disclosure provides a wireless receiver for receiving a bitstream including entropy coded coefficient values of an enhancement layer video block of a unit coded within a video sequence, vectorization of an enhancement layer video block of a unit coded within a video sequence. A control unit that defines one or more vectors for defined entropy decoding and selects a prediction mode for an enhancement layer video block of the coded unit based on the defined vectorized entropy coding, wherein the defined vectorized entropy coding is enhanced. The control unit for selecting weighted prediction when establishing two or more vectors for the hierarchical video block, a prediction unit for performing a prediction decoding technique based on the selected prediction mode, and an entropy decoding unit for performing vectorized entropy decoding; Provide a device.

The techniques described in this disclosure may be implemented in hardware, software, firmware, or any combination thereof. If implemented in hardware, the device may be implemented in an integrated circuit, a processor, discrete logic, or any combination thereof. If implemented in software, the software may be executed on one or more processors, such as a microprocessor, application specific integrated circuit (ASIC), field programmable gate array (FPGA), or digital signal processor (DSP). Software implementing these techniques may be initially stored on a computer readable medium and loaded and executed on a processor.

Thus, the present disclosure also contemplates a computer readable medium containing instructions that when executed in a video coding device cause the device to code data in a video sequence. More specifically, these instructions cause the device to define one or more vectors for vectorized entropy coding of an enhancement layer video block of a coded unit within a video sequence, and code based on the defined vectorized entropy coding. Select a prediction mode for the enhancement layer video block of the given unit, and if the defined vectorized entropy coding establishes two or more vectors for the enhancement layer video block, select weighted prediction, and select the selected prediction block and Code an enhancement layer video block based on vectorized entropy coding.

The details of one or more aspects of the disclosure are set forth in the accompanying drawings and the description below. Other features, objects, and advantages of the techniques described in this disclosure will be apparent from the description and drawings, and from the claims.

Brief description of the drawings

1 is an exemplary block diagram illustrating a video encoding and decoding system.

2A is a conceptual diagram illustrating sequential prediction.

2B is a conceptual diagram illustrating weighted prediction.

2C is another conceptual diagram illustrating weighted prediction.

3A is a conceptual diagram illustrating zigzag scanning of a 4x4 video block.

FIG. 3B is a diagram illustrating vectors associated with another vector control signal applied during zigzag scanning for the block of FIG. 3A.

4 is a block diagram illustrating an example video encoder in accordance with this disclosure.

5 is a block diagram illustrating an example video decoder according to this disclosure.

6 and 7 are flow diagrams illustrating a technique in accordance with the present disclosure.

details

This disclosure describes a method for controlling the selection of predictive coding techniques for such enhancement layer video blocks based on the characteristics of the vectorized entropy coding for the enhancement layer video blocks. According to the present disclosure, the prediction techniques used for prediction based video coding of an enhancement layer video block depend on the vectorized entropy coding used for such enhancement layer video block. For each coded unit, depending on whether the vectorized entropy coding defines a single vector for the video block of the coded unit or multiple vectors for the video block of the coded unit (eg Predictive coding techniques (such as, weighted or unweighted prediction) may be selected.

Vectorized entropy coding refers to entropy coding of a video block that depends on a vector syntax element that defines the number of vectors associated with the video block. The vector syntax element may be defined for each coded unit, such as, for example, each video frame or each independently decodable slice or some video frame. Each vector defined by the vector syntax element defines a set of coefficients of the video block to be entropy coded together. If several vectors are defined for a video block of a coded unit, several individual sets of coefficients will be entropy coded separately for that coded unit. If only one vector is defined for a video block of a coded unit, then all of the coefficients for each given video block will be entropy coded together for that coded unit.

According to this disclosure, weighted prediction may be selected when vectorized entropy coding establishes two or more vectors for an enhancement layer video block. Alternatively, unweighted prediction, such as sequential prediction, may be selected when vectorized entropy coding establishes a single vector for the enhancement layer video block. In this disclosure, weighted prediction refers to prediction that refers to weighted prediction data that includes a combination of predicted enhancement layer data and predicted base layer data. In contrast, sequential prediction refers to prediction that refers to precoded data, such as prediction frames of the same layer associated with the block to be coded.

1 is a block diagram illustrating an example video encoding and decoding system 10 that may implement the techniques of this disclosure. As shown in FIG. 1, system 10 includes a source device 12 that transmits encoded video to a destination device 16 over a communication channel 15. Source device 12 and destination device 16 may include any of a wide variety of devices. In some cases, source device 12 and destination device 16 may include a wireless communication device handset, such as a so-called cellular or satellite radiotelephone. However, the techniques of this disclosure that apply more generally to predictive coding and entropy coding need not be limited to wireless applications or settings, and may be applied to non-wireless devices that include video encoding and / or decoding capabilities.

In the example of FIG. 1, source device 12 may include video source 20, video encoder 22, modulator / demodulator (modem) 23, and transmitter 24. Destination device 16 may include receiver 26, modem 27, video decoder 28, and display device 30. According to this disclosure, video encoder 22 of source device 12 may be configured to perform a vectorized entropy encoding, and a prediction technique defined or selected based on the vectorized entropy encoding. Similarly, video decoder 28 of destination device 16 may be configured to perform vectorized entropy decoding, and a prediction technique defined or selected based on the vectorized entropy decoding. In either case, the illustrated system 10 of FIG. 1 is exemplary only. The vectorized entropy coding technique and associated prediction technique of the present disclosure may be performed by any encoding or decoding device. Source device 12 and destination device 16 are only examples of coding devices that can support these techniques.

Video encoder 22 of source device 12 may encode the video data received from video source 20 using the techniques of this disclosure. Video source 20 may include a video capture device, such as a video camera, a video archive containing previously captured video, or a video feed from a video content provider. As another alternative, video source 20 may generate computer graphics based data as the source video, or a combination of live video, archived video, and computer generated video. In some cases, if video source 20 is a video camera, source device 12 and destination device 16 may form a so-called cameraphone or videophone. In each case, the captured video, pre-captured video or computer-generated video may be encoded by video encoder 22.

When video data is encoded by video encoder 22, the encoded video information is modulated by modem 23 in accordance with a communication standard such as, for example, code division multiple access (CDMA) or other communication standard or technology. And to the destination device 16 via the transmitter 24. Modem 23 may include various mixers, filters, amplifiers, or other components designed for signal modulation. Transmitter 24 may include circuits designed to transmit data, including amplifiers, filters, and one or more antennas.

Receiver 26 of destination device 16 receives information over channel 15, and modem 27 demodulates that information. The video decoding process performed by video decoder 28 may include vectorized entropy decoding, and a prediction technique defined or selected based on the vectorized entropy decoding, as described herein. Display device 28 displays decoded video data to a user, and any various displays such as cathode ray tube (CRT), liquid crystal display (LCD), plasma display, organic light emitting diode (OLED) display or other types of display devices. It may also include a device.

Communication channel 15 may include any wireless or wired transmission line, such as a radio frequency (RF) spectrum or one or more physical transmission lines, and may include any combination of wired and wireless media. Communication channel 15 may form part of a packet-based network, such as a local area network, a wide area network, or a global network such as the Internet. Communication channel 15 generally represents any suitable communication medium or collection of different communication media for transmitting video data from source device 12 to destination device 16.

Video encoder 22 and video decoder 28 may operate according to a video compression standard, such as the ITU-T H.264 standard, otherwise referred to as MPEG-4, Part 10, Advanced Video Coding (AVC). However, the techniques of this disclosure may be readily applied to any of a variety of other video coding standards. Specifically, any standard that allows vectorized entropy coding will benefit from the teachings of this disclosure.

Although not shown in FIG. 1, in some aspects, video encoder 22 and video decoder 28 may each be integrated with an audio encoder and decoder, including appropriate MUX-DEMUX units or other hardware and software, The encoding of both videos may be manipulated in a common data stream or in separate data streams. If applicable, the MUX-DEMUX unit may conform to other protocols such as the ITU H.223 Multiplexer Protocol, or User Datagram Protocol (UDP).

Each of video encoder 22 and video decoder 28 may include one or more microprocessors, digital signal processors (DSPs), application specific integrated circuits (ASICs), field programmable gate arrays (FPGAs), discrete logic, software, hardware, firmware or It may be implemented in any combination of these. Each of video encoder 22 and video decoder 28 may be included in one or more encoders or decoders, which may be combined encoder / decoder (CODECs) in each mobile device, subscriber device, broadcast device, server, or the like. May be incorporated as part of

In some cases, devices 12, 16 may operate in a substantially symmetrical manner. For example, each device 12, 16 may include a video encoding and decoding component. Thus, system 10 may support one-way or two-way video transmission between video devices 12, 16, for example, for video streaming, video playback, video broadcasting, or video telephony.

During the encoding process, video encoder 22 may execute a number of coding techniques or steps. In general, video encoder 22 operates on a video block within individual video frames (or other independently coded units such as slices) to encode a video block. The video block may have a fixed size or a variable size, and may vary in size depending on a particular coding standard. In some cases, each video frame may comprise a series of independently decodable slices, and each slice may include a series of macroblocks that may be arranged in very small blocks. Macroblocks typically refer to 16 × 16 blocks of data. The ITU-T H.264 standard not only provides intra prediction of various block sizes such as 16 × 16, 8 × 8, 4 × 4, and 8 × 8 for chroma components, Inter prediction of various block sizes such as 16 × 16, 16 × 8, 8 × 16, 8 × 8, 8 × 4, 4 × 8, and 4 × 4 for the corresponding scaled sizes for the luma component and chroma component Support. In this disclosure, the term video block refers to video blocks of any size. A video block may refer to a block of video data in the pixel domain, or may refer to a block of data in a transform domain, such as a discrete cosine transform (DCT) domain.

Video encoder 22 may perform predictive coding in which the video block being coded is compared to the predictive frame (or other coded unit) to identify the predictive block. The difference between the current video block being coded and the prediction block is coded as a residual block, and the prediction syntax is used to identify the prediction block. The residual block may be transformed and quantized. The transformation technique may include discrete cosine transformation (DCT) or a conceptually similar process, integer transformation, wavelet transformation, or other type of transformation. In one example, in a DCT process, this transform process transforms a set of pixel values into transform coefficients, which may represent the energy of those pixel values in the frequency domain. Quantization is applied to transform coefficients and generally involves a process of limiting the number of bits associated with any given transform coefficient.

Following transform and quantization, entropy coding may be performed on the quantized transformed residual video block. Syntax elements may also be included in entropy coding. In general, entropy coding includes one or more processes that collectively comprise a sequence of quantized transform coefficients. In order to define one or more serialized one-dimensional vectors of coefficients from the two-dimensional video block, a scanning technique, such as a zigzag scanning technique, is performed on the quantized transform coefficients. The scanned coefficients are then entropy coded via, for example, content adaptive variable length coding (CAVLC), context adaptive binary arithmetic coding (CABAC) or other entropy coding process.

Vectorized entropy coding refers to entropy coding of a video block that depends on a vector syntax element that defines the number of vectors associated with the video block. The vector syntax element may be defined for each coded unit, such as, for example, each video frame or each independently decodable slice or some video frame. Each vector defined by the vector syntax element defines a set of coefficients of the video block to be entropy coded together. If multiple vectors are defined for a video block of a coded unit, several individual sets of coefficients will be entropy coded separately for each video block of the coded unit. If only one vector is defined for a video block of a coded unit, then all of the coefficients for each video block will be entropy coded together for that coded unit.

According to this disclosure, different types of prediction techniques may be used depending on the number of vectors defined for vectorized entropy coding of a video block of a coded unit (eg, frame or slice). For example, video encoder 22 may select weighted prediction if vectorized entropy coding establishes two or more vectors for the enhancement layer video block. Alternatively, video encoder 22 may select unweighted prediction, such as sequential prediction, when vectorized entropy coding establishes a single vector for the enhancement layer video block. In this disclosure, weighted prediction refers to prediction that refers to weighted prediction data that includes a combination of predicted enhancement layer data and predicted base layer data. In contrast, sequential prediction refers to prediction that refers to precoded data, such as prediction frames of the same layer (eg, base layer or enhancement layer) associated with the block being coded.

2A is a conceptual diagram illustrating sequential prediction. 2B is a conceptual diagram illustrating weighted prediction (which may include so-called “adaptive segmentation” prediction). Further, in accordance with the present disclosure, video encoder 22 and video decoder 28 are predictive techniques (e.g., weighted prediction versus ratio) for enhancement layer video blocks based on vectorized entropy coding applied to the enhancement layer video blocks. Middle prediction). For example, if vectorized entropy coding defines two or more vectors for each video block of a coded unit, an adaptive segmentation prediction technique may be selected.

Scalable video coding (SVC) refers to video coding using a base layer and one or more enhancement layers. In this case, the base layer may define the base level video quality, and one or more enhancement layers may improve the quality of the decoded video signal. The enhancement layer may, for example, provide spatial enhancement to the base layer frame, provide signal-to-noise enhancement by adding additional bit depths to the pixel values of the base layer frame, or additional frames between the base layer frames. By adding them, the video quality may be improved in various possible ways, such as providing temporal enhancement to the decoded video. Video blocks coded in the base layer are referred to as base layer video blocks, and video blocks encoded in the enhancement layer are referred to as enhancement layer video blocks. In FIGS. 2A and 2B, the base layer frames are labeled B1 to B5 and B1 'to B5', and the enhancement layer frames are labeled E1 to E14 and E1 'to E14'. Also, while slices or other portions of a frame may define a smaller decodable unit, a frame may define a decodable unit.

2A illustrates sequential prediction used in an intra coding base layer and an enhancement layer video block. In this case, blocks of base layer frame B1 are used as prediction references for the blocks of base layer frame B2. Similarly, blocks of base layer frame B2 are used as prediction references to blocks of base layer frame B3, blocks of base layer frame B3 are used as prediction references to blocks of base layer frame B4, and so on. Motion estimation may be used to define a motion vector that indicates the displacement of the current video block in the current frame relative to the predictive video block of the predictive frame. The motion compensation then uses the motion vector to fetch or generate the predictive video block from the predictive frame.

In the enhancement layer, the blocks of the enhancement layer frame E1 are used as the prediction reference for the blocks of the enhancement layer frame E2. Similarly, blocks of enhancement layer frame E2 are used as prediction references to blocks of enhancement layer frame E3, blocks of enhancement layer frame E3 are used as prediction references to blocks of enhancement layer frame E4, and enhancement layer frames Blocks of E4 are used as prediction references to the blocks of enhancement layer frame E5, and so on. However, one possible problem with the sequential prediction techniques shown in FIG. 2A is the potential for error drift. In this case, because the video block of each successive frame depends on the video block of the previous frame, errors within one frame may be propagated to subsequent frames.

In order to address this error drift problem, especially in the enhancement layer, weighted prediction techniques are being developed. In this case, the enhancement layer video block may be predicted from the predictive blocks of the predictive frame, including a weighted average of previous base and enhancement layer frames. For example, prediction frame P1 ′ may include weighted interpolation of base layer frame B1 ′ and enhancement layer frame E1 ′. The block of the enhancement layer frame E2 may be coded based on the block of the prediction frame P1 '. Prediction frame P2 'may include weighted interpolation of base layer frame B1' and enhancement layer frame E2 ', and enhancement layer frame E3 may be coded based on a block of prediction frame P2'. Prediction frame P3 'may include weighted interpolation of base layer frame B1' and enhancement layer frame E3 ', and enhancement layer frame E4 may be coded based on a block of prediction frame P3'. The dotted line shown in FIG. 2B represents interpolation, and the reverse arrow represents the predictive frame used to code the given frame.

Weighted prediction as shown in FIG. 2B may help to avoid error drift. For example, if an error appears in enhancement layer frame E2 ', this error may be mitigated in prediction frame P2' due to the partial dependence of P2 'on base layer frame B1'. As shown in FIG. 2A, sequential prediction has the advantage of using temporal redundancy with the disadvantage of error propagation. Conversely, prediction of an enhancement layer frame based only on the base layer frame may have the advantage of reduced error propagation, but does not exploit the phenomenon of temporal redundancy (which can improve compression) as well as sequential prediction. The weighted prediction scheme shown in FIG. 2B balances these advantages and disadvantages to provide high compression (due to using temporal redundancy) and mitigated error propagation (due to dependence on robust base layer frames). Desirable balance can be achieved.

Weighted prediction may assign weights to the enhancement layer and base layer frames used to generate the weighted prediction frames. In addition, these weight factors may be changed or adapted over time. Weight factors are sometimes referred to as "leaky factors" and may be defined in other terms. In any case, the techniques of this disclosure do not depend on the type of weight factor used to define differently weighted prediction frames.

As mentioned above, different types of prediction techniques may be used depending on the number of vectors defined for vectorized entropy coding of the video block of the coded unit. For example, if vectorized entropy coding establishes two or more vectors for an enhancement layer video block, weighted prediction similar to that shown in FIG. 2B may be selected. Alternatively, if vectorized entropy coding establishes a single vector for the enhancement layer video block, unweighted prediction, such as sequential prediction similar to that shown in FIG. 2A, may be selected. Vectorized entropy coding may establish a single vector by either defining a single vector for a given frame or other coded unit, or disabling the ability to define several vectors for a given frame or other coded unit. .

2C is another conceptual diagram illustrating prediction of enhancement layer frames E1 ″ through E5 ″ based on weighted prediction frames P1 ″ through P5 ″. In this case, weighted interpolation between the base layer frame B2 " and the enhancement layer frame E1 " defines the prediction frame P2 ". Similarly, weighted interpolation of base layer frame B3 " and enhancement layer frame E2 " defines prediction frame P3 " As in FIG. 2B, the weight factors may change or adapt over time. In any case, in the example of FIG. 2C, the temporally aligned base layer frame (aligned by the current enhancement layer frame) and the previous enhancement layer frame may be interpolated to define the prediction frame. Other weighted combinations of base layer and enhancement layer interpolation may also be used to define the predictive frame.

3A and 3B help explain the concept of vectorized entropy coding. 3A is a conceptual diagram illustrating zigzag scanning of a 4x4 video block, such as, for example, a transformed residual block of data associated with an enhancement layer. FIG. 3B is a diagram illustrating vectors associated with different vector control signals applied during zigzag scanning of the block of FIG. 3A.

In FIG. 3A, the arrows show the zigzag pattern used to serialize a two-dimensional block of data into a linear sequence of data. Zigzag scanning is just one example, and in general, scanning may follow a wide variety of patterns or scan orders. However, it is important that scanning is vectorized to support vectorized entropy coding. More specifically, the vector control signal (or other syntax element) may define the number and size of one-dimensional vectors that will appear from scanning the video block shown in FIG. 3A.

For example, as shown in FIG. 3B, if the vector control signal specifies the number 16 (see item 101), this means that 16 different coefficients of the 4 × 4 coefficient video block shown in FIG. 3A are included in a single vector. It may also indicate. More specifically, the vector control signal of 16 may produce a single vector comprising coefficients 1-16. In this case, entropy coding is applied to the entire set of coefficients 1-16. This scenario may also be defined for vectorized entropy coding by disabling the ability to define several vectors for a given coded unit, rather than defining a single vector via control signal 16 (see item 101). . If the vector is disabled, this has the same effect as defining a single vector for a given coded unit in vectorized coding.

Conversely, if the vector control signal specifies numbers 3 and 16 (see item 102), this means that different coefficients of the video block shown in FIG. 3A have one coefficients 1 to 3 and the other coefficients 4 to 16 It may be included in two different vectors. In this case, entropy coding is applied separately to two different sets of coefficients 1-3 and coefficients 4-16.

If the vector control signal specifies the numbers 2, 8, and 16 (see item 103), this means that the different coefficients of the video block shown in FIG. 3A, one has coefficients 1 and 2 and one has coefficients 3 to 8 , One may indicate inclusion in three different vectors having coefficients 9-16. In this case, entropy coding is applied separately to three different sets of coefficients 1 and 2, coefficients 3 to 8 and coefficients 9 to 16. If the vector control signal specifies the numbers 3, 6, 11, 16 (see item 104), this means that the different coefficients of the video block shown in FIG. 3A, one has coefficients 1 to 3 and one coefficients 4 to 6 May be included in four different vectors having coefficients 7-11, and one having coefficients 12-16. In this case, entropy coding is applied separately to four different sets of coefficients 1-3, coefficients 4-6, coefficients 7-11 and coefficients 12-16.

The actual syntax used to specify the number or size of different vectors follows a wide variety of implementations. Thus, the example syntax shown in FIG. 3B is used only to illustrate the concepts of the present disclosure and should not be considered as limiting the content or format of the control signal. The format for defining a vector for a video block of a coded unit can vary widely.

The techniques of this disclosure specify whether vectorized entropy coding specifies a single vector (as in the example of item 101 of FIG. 3B) or specifies a plurality of vectors (as in the examples of items 102, 103 and 104 of FIG. 3B). Define predictions (eg, weighted predictions or unweighted predictions) based on whether they More specifically, for entropy coding, weighted prediction is always used when vectorized entropy coding defines a plurality of vectors for a video block of a coded unit, and for the video block of the coded unit for entropy coding Whenever a single vector is defined, unweighted prediction such as sequential prediction is used. Coding for entropy coding by selecting 16 vector control signals (eg, as shown in item 101 of FIG. 6) or possibly disabling the vector coding mode for a given coded unit completely A single vector may be defined for the video block of a given unit. In any way, unweighted prediction may be used if a single vector is defined for the video block of the coded unit for entropy coding.

Encoder 22 of source device 12 may communicate the control signal to decoder 28 of destination device 18 as part of the syntax to define the type of prediction that should be used, or alternatively Encoder 22 and decoder 28 may automatically determine the type of prediction to use based on whether vectorized entropy coding is enabled and whether two or more vectors are defined for the video block.

4 is a block diagram illustrating video encoder 50 according to this disclosure. Video encoder 50 may correspond to video encoder 22 of device 20 or video encoder of another device. As shown in FIG. 4, video encoder 50 includes a control unit 31, a prediction unit 32, and a reference frame storage element 34. The video encoder also includes inverse quantization unit 42, inverse transform unit 44, and adders 48 and 51 as well as transform unit 38 and quantization unit 40. Finally, video encoder 50 also includes vector scan unit 45 and entropy coding unit 46.

According to the present disclosure, control unit 31 defines one or more vectors for vectorized entropy coding of the enhancement layer video block of the coded unit in the video sequence being coded. Control unit 31 also selects a prediction mode for the enhancement layer video block of the coded unit based on the defined vectorized entropy coding. More specifically, control unit 31 selects weighted prediction if its defined vectorized entropy coding establishes two or more vectors for the enhancement layer video block. Alternatively, control unit 31 may select unweighted prediction, such as sequential prediction, when its defined vectorized entropy coding establishes a single vector for the enhancement layer video block. In addition, enhancement layer video of the coded unit for entropy coding, by selecting 16 vector control signals (as shown in item 101 of FIG. 3B) or completely disabling the vector coding mode for a given coded unit. A single vector may be defined for the block. The vector may be defined in any manner, or may be defined to balance or define the amount of data allocated to different layers.

Prediction unit 32 performs a prediction coding technique based on the selected prediction mode defined by the prediction control signal from control unit 31. Thus, prediction unit 32 may support weighted prediction or unweighted prediction, but applies an appropriate prediction technique in accordance with the instruction of control unit 31. The corresponding vector control signal is also sent from the control unit 31 to the vector scan unit 45 and the entropy coding unit 46. Vector scan unit 45 performs vectorized scanning, and entropy coding unit 46 performs vectorized entropy coding.

In inter coding of an enhancement layer video block, prediction unit 32 compares the video block to be encoded with various blocks in one or more video reference frames. The predicted data may be retrieved from the reference frame store 34, and may include a video block of a previous enhancement layer frame (as shown in FIG. 2A) or a previous enhancement layer frame (as shown in FIG. 2B). It may also include a weighted combination of base layer frames.

Prediction unit 32 may generate a prediction syntax, such as a motion vector, which may be used to identify the predictive block used to code the current enhancement layer video block. Prediction unit 32 may include a motion estimation and motion compensation unit that indicates the predictive block and identifies the motion vector that generates the predictive block based on the motion vector. Typically, motion estimation is considered a process of generating a motion vector and estimates motion. For example, the motion vector may represent the displacement of the prediction block in the prediction frame relative to the current block being coded in the current frame. Motion compensation is typically considered a process of fetching or generating a predictive block based on a motion vector determined by motion estimation.

Transform unit 38 applies a transform, such as a discrete cosine transform (DCT) or a conceptually similar transform, to the residual block, producing a video block comprising residual transform block coefficients. Block transform unit 38 may, for example, perform other transforms defined by the H.264 standard conceptually similar to DCT. Alternatively, wavelet transform or integer transform may be used.

Quantization unit 40 quantizes the residual transform coefficients to further reduce bit rate. Quantization unit 40 may, for example, limit the number of bits used to code each of the coefficients. After quantization, vector scan unit 45 scans the quantized coefficient blocks from the two-dimensional representation into one or more serialized one-dimensional vectors. Also, the number of vectors scanned for a given video block is initially defined by the control unit 31, which selects the number of vectors and selects the prediction technique. The vector control signal from the control unit 31 to the vector scan unit 45 informs the vector scan unit 45 of how to scan the video block and the number of vectors to generate. The scan order may be preprogrammed (such as zigzag scanning) or may be adaptive based on previous coding statistics.

Following this scanning process, entropy encoding unit 46 encodes the quantized transform coefficients according to an entropy coding method such as CAVLC or CABAC to further compress the data. More specifically, entropy encoding unit 46 applies vectorized coding based on the vector control signal sent from control unit 31. For example, entropy coding unit 46 may apply entropy coding separately for each of the different vectors scanned by vector scan unit 45. If a single vector is defined for a video block, entropy coding unit 46 may apply entropy coding to the set of coefficients that correspond to all of the coefficients of each video block. In this disclosure, entropy coding refers to any of a wide range of entropy coding methods, such as content adaptive variable length coding (CAVLC), context adaptive binary arithmetic coding (CABAC), or other entropy coding methods.

CAVLC is a type of entropy coding technique supported by the ITU H.264 / MPEG4, AVC standard, and may be applied on a vectorization basis by entropy coding unit 46. CAVLC uses a variable length coding (VLC) table in a manner that effectively compresses the serialized "runs" of the transform coefficients. In this case, each individual vector scanned by vector scan unit 45 is coded by entropy coding unit 46 according to CAVLC. In this case, entropy coding unit 46 codes each individual vector scanned by vector scan unit 45 according to CAVLC.

CABAC is another type of entropy coding technique supported by the ITU H.264 / MPEG4, AVC standard, and may be applied on a vectorization basis by entropy coding unit 46. CABAC may be involved in multiple stages, including binary evolution, context model selection, and binary arithmetic coding. In this case, entropy coding unit 46 codes each individual vector scanned by vector scan unit 45 according to CABAC. Many other types of entropy coding techniques also exist, and new entropy coding techniques will be created in the future. The present disclosure is not limited to any particular entropy coding technique, and simply applies certain entropy coding techniques on the vectorization basis, for example, in accordance with the indication of the vectorized control signal from the control unit 31.

Following entropy coding by entropy encoding unit 46, the encoded video may be transmitted to another device or may be archived for later transmission or retrieval. The encoded video may include entropy coded vectors and various syntaxes, which may be used by the decoder to properly configure the decoding process. Inverse quantization unit 42 and inverse transform unit 44 apply inverse quantization and inverse transformation, respectively, to reconstruct the residual block in the pixel domain. Summer 51 adds the reconstructed residual block to the prediction block generated by prediction unit 32 to generate a reconstructed video block for storing in reference frame store 34. If desired, the reconstructed video block may also pass through a deblocking filter unit (not shown) before being stored in reference frame store 34. The reconstructed video block may be used by prediction unit 32 as a reference block for intercoding a block in a subsequent video frame, or as a weighted portion of a prediction block used for weighted prediction of a block of a subsequent video frame. have.

5 is a block diagram illustrating an example of a video decoder 60 that decodes a video sequence encoded in the manner described herein. The received video sequence includes an encoded set of image frames, groups of pictures (GOPs), or a wide variety of coded videos, which defines how to decode such video blocks, including encoded video blocks and syntax.

Video decoder 60 includes a control unit 31 that controls predictive decoding and vectorized entropy decoding in the manner described herein. More specifically, control unit 31 receives the encoded video bitstream and parses the bitstream to determine whether the vectorized entropy coding is enabled and the syntax identifying the size and number of the vector. . Control unit 31 forwards the coded video to entropy decoding unit 52, and also forwards the control signal to prediction unit 54, scan unit 55, and entropy decoding unit 52. The control signal always uses weighted prediction when two or more vectors are defined for vectorized entropy decoding (eg, by defining a single vector or disabling the vector coding mode for a given coding unit). When a single vector is defined for vectorized entropy decoding, it is ensured that unweighted prediction is always used.

Entropy decoding unit 52 performs a mutual decoding function of the encoding performed by the entropy encoding unit of FIG. 4. More specifically, entropy decoding may be vectorized in that CAVLC and CABAC decoding may operate on a vectorized set of coefficients. Control unit 31 transmits a control signal that defines the vectorized entropy decoding performed by entropy decoding unit 52. Video decoder 60 also includes a scan unit 55 that performs reverse anti-scanning on the scanning performed by scan unit 45 of FIG. 2. In this case, scan unit 45 may combine one or more one-dimensional vectors of the coefficients in a two-dimensional block format. The number and size of vectors as well as the scan order defined for the video block define how the two-dimensional block is reconstructed.

Video decoder 60 also includes prediction unit 54, inverse quantization unit 56, inverse transform unit 58, reference frame store 62, and summer 64. Optionally, video decoder 60 may also include a deblocking filter (not shown) that filters the output of summer 64. Prediction unit 54 receives a prediction syntax (such as a motion vector) from entropy decoding unit 52. Prediction unit 54 also receives a control signal from control unit 31, which defines whether weighted prediction should be used or unweighted prediction should be used. In addition, weighted prediction is defined when a video block is scanned into a plurality of vectors, and entropy coding is applied separately for different vectors of the video block.

Inverse quantization unit 56 performs quantization, and inverse transform unit 58 performs inverse transformation to change the coefficients of the video block back to the pixel domain. Summer 64 combines the predictive block from unit 54 with the reconstructed residual block from inverse transform unit 58 to produce a reconstructed block that is stored in reference frame store 62. If desired, the reconstructed video block may also pass through a deblocking filter unit (not shown) before being stored in the reference frame store 62. Decoded video may be output from reference frame store 62 and fed back to prediction unit 54 for use in subsequent prediction.

6 is a flow chart illustrating a coding (ie, encoding or decoding) technique for encoding an enhancement layer video block according to the present disclosure. Although FIG. 6 is described in terms of video encoder 50, similar techniques may be applied by video decoder 60. That is, both encoder 50 and decoder 60 may define a vector and select a prediction (eg, weighted prediction or unweighted prediction) based on the defined vector. At the encoder side, vectors may be defined to enhance coding efficiency. At the decoder side, the vector may be defined based on the syntax defined by the encoder and received as part of the encoded video stream. Of course, on the encoder side, scanning defines a one-dimensional vector based on the two-dimensional block, while on the decoder side, scanning operates in reverse, defining a two-dimensional block based on the one-dimensional vector.

As shown in FIG. 6, control unit 31 of video encoder 50 defines a vector for entropy coding of the enhancement layer video block (81). The control unit 31 then selects a prediction mode (eg, weighted prediction or unweighted prediction) based on the defined vector (82). More specifically, if a plurality of vectors are defined for the video block, the control unit 31 selects weighted prediction, while if a single vector is defined for the video block, the control unit 31 selects the weighted prediction. do. Vector scan unit 45 with prediction unit 32 and entropy coding unit 46 codes the enhancement layer video block based on the defined vector and the selected prediction mode (83). More specifically, prediction unit 32 uses the selected prediction mode in predictive coding, and vector scan unit 45 and entropy coding unit 46 vector scan and entropy the video block based on the defined vector. Coding In this case, vector scan unit 45 transforms the two-dimensional block into one or more one-dimensional vectors, and entropy coding unit 46 entropy codes one or more one-dimensional vectors. By making the prediction mode (weighted prediction or unweighted prediction) dependent on whether a single vector or multiple vectors are defined for the video block, the coding process may be improved.

7 is another flowchart illustrating a coding (ie, encoding or decoding) technique for encoding an enhancement layer video block according to the present disclosure. Although FIG. 7 is described in terms of video encoder 50, similar techniques may also be applied by video decoder 60. As shown in FIG. 7, control unit 31 of video encoder 50 defines a vector for entropy coding of an enhancement layer video block (101). The control unit 31 then determines whether there is one vector per block 102 or a plurality of vectors per block. If there is one vector defined per video block (“YES” at 102), control unit 31 causes prediction unit 32 to perform sequential prediction, as shown in FIG. 2A and described above (103). ). However, if there are a plurality of vectors defined per video block (“No” at 102), control unit 31 causes prediction unit 32 to perform weighted prediction, as shown in FIG. 2B and described above. (104). Control unit 31 then causes vector scan unit 45 and entropy coding unit 46 to perform vectorized entropy coding based on the defined vector for the video block (106). In this case, scan unit 45 scans the predictively coded video block (eg, residual block) from the two-dimensional format into one or more one-dimensional vectors, based on the vectorized decision of control unit 31. Entropy coding unit 46 performs entropy coding separately on the coefficients of each one-dimensional vector defined for the video block.

The techniques of this disclosure may be realized in a wide variety of devices or apparatuses, including: a wireless handset, and an integrated circuit (IC) or set of ICs (ie, a chipset). Although certain components, modules, or units have been described to provide a functional aspect, they do not necessarily require realization by other hardware units.

Thus, the techniques disclosed herein may be implemented in hardware, software, firmware, or any combination thereof. Any features described as modules or components may be implemented together in an integrated circuit device or may be implemented separately in discrete but cooperative logic devices. If implemented in software, the techniques may be at least partially realized by a computer readable medium containing instructions that, when executed, perform one or more of the above-described methods. The computer readable data storage medium may form part of a computer program product, which may include packaging material. Computer-readable media may include RAM, such as synchronous dynamic random access memory (SDRAM), read-only memory (ROM), non-volatile random access memory (NVRAM), electrically erasable programmable read-only memory (EEPROM), FLASH memory, magnetic Or an optical data storage medium. These techniques may additionally or alternatively be realized at least in part by a computer readable communication medium carrying or communicating code in the form of instructions or data structures that can be accessed, read and / or executed by a computer. .

The code may be executed by one or more processors, such as one or more digital signal processors (DSPs), general purpose microprocessors, application specific integrated circuits (ASICs), field programmable gate arrays (FPGAs), or other equivalent integrated or discrete logic circuits. . Thus, the term “processor” as used herein may refer to any of the foregoing structures or any other structure suitable for the implementation of the techniques described herein. In addition, in some aspects, the functionality described herein may be provided within a dedicated software module or hardware module configured for encoding and decoding, and integrated into a combined video encoder-decoder (CODEC). In addition, these techniques may be fully implemented in one or more circuits or logic elements.

Various aspects of the disclosure have been described. These and other aspects are within the scope of the following claims.

Claims (46)

A method of coding data of a video sequence,
Defining one or more vectors for vectorized entropy coding of enhancement layer video blocks of a coded unit in the video sequence, wherein the vectorized entropy coding defines a vector syntax that defines the vectors associated with the enhancement layer video blocks. Defining one or more vectors, including entropy coding the enhancement layer video blocks using an element;
Selecting a prediction mode for the enhancement layer video blocks of the coded unit based on the defined vectorized entropy coding, wherein the defined vectorized entropy coding comprises two or more vectors for the enhancement layer video blocks. Selecting weighted prediction, and if the defined vectorized entropy coding defines a single vector for the enhancement layer video blocks, selecting weighted prediction; Wherein the weighted prediction comprises prediction using weighted prediction data comprising a combination of prediction enhancement layer data and prediction base layer data; And
Coding the enhancement layer video blocks based on the selected prediction mode and the vectorized entropy coding. The method of claim 1,
Wherein the weighted prediction comprises prediction based on prediction blocks formed of weighted combinations of prediction enhancement layer video blocks and prediction base layer video blocks in the video sequence. delete The method of claim 1,
Wherein the unweighted prediction comprises sequential prediction. The method of claim 1,
Disabling a vector coding mode for the coded unit to define a single vector for vectorized entropy coding. The method of claim 1,
The coded unit comprises a frame of the video sequence or a slice of a frame of the video sequence. The method according to claim 6,
And the method of coding data of the video sequence is repeated for different coded units of the video sequence. The method of claim 1,
The vectorized entropy coding includes scanning the enhancement layer video blocks from two-dimensional blocks of transform coefficients into the one or more vectors, and individually entropy coding the one or more vectors,
Wherein the one or more vectors comprise one-dimensional sets of transform coefficients. The method of claim 1,
The coding comprises encoding,
The method of coding data of the video sequence further comprises transmitting a bitstream comprising encoded video blocks. The method of claim 1,
The coding comprises decoding,
The method of coding data of the video sequence further comprises receiving the video sequence as a bitstream comprising encoded video blocks. An apparatus for coding data of a video sequence,
Define one or more vectors for vectorized entropy coding of the enhancement layer video blocks of the coded unit in the video sequence, and predict the enhancement layer video blocks of the coded unit based on the defined vectorized entropy coding A control unit for selecting a mode, wherein the vectorized entropy coding includes entropy coding the enhancement layer video blocks using a vector syntax element defining vectors associated with the enhancement layer video blocks, wherein the control unit comprises: If the defined vectorized entropy coding establishes two or more vectors for the enhancement layer video blocks, then weighted prediction is selected, and the defined vectorized entropy coding is single for the enhancement layer video blocks. Unweighted example if defining a vector To choose from, the weighted prediction, including a prediction to use the weighted prediction data comprising a combination of predictive enhancement layer data and predictive base layer data, the control unit;
A prediction unit for performing prediction coding techniques based on the selected prediction mode; And
And an entropy coding unit to perform the vectorized entropy coding. The method of claim 11,
And the weighted prediction comprises prediction based on prediction blocks formed of weighted combinations of prediction enhancement layer video blocks and prediction base layer video blocks in the video sequence. delete The method of claim 11,
Wherein the unweighted prediction comprises sequential prediction. The method of claim 11,
And the control unit disables a vector coding mode for the coded unit to define a single vector for vectorized entropy coding. The method of claim 11,
The coded unit comprises a frame of the video sequence or a slice of a frame of the video sequence. 17. The method of claim 16,
The control unit defines one or more vectors and selects the prediction mode for each of a plurality of different coded units of the video sequence. The method of claim 11,
Further comprising a scanning unit,
The scanning unit scans the enhancement layer video blocks from the two-dimensional blocks of transform coefficients into the one or more vectors, the entropy coding unit entropy codes the one or more vectors separately,
And the one or more vectors comprise one-dimensional sets of transform coefficients. The method of claim 11,
The coding comprises encoding,
And the entropy coding unit comprises an entropy encoding unit. The method of claim 11,
The coding comprises decoding,
And the entropy coding unit comprises an entropy decoding unit. The method of claim 11,
And the apparatus for coding the data of the video sequence comprises an integrated circuit. The method of claim 11,
And the apparatus for coding data of the video sequence comprises a microprocessor. A computer readable medium comprising instructions that, when executed on a video coding device, cause the video coding device to code data of a video sequence, the computer readable medium comprising:
The instructions cause the video coding device to:
Define one or more vectors for vectorized entropy coding of the enhancement layer video blocks of the coded unit in the video sequence;
Select a prediction mode for enhancement layer video blocks of the coded unit based on the defined vectorized entropy coding;
Code the enhancement layer video blocks based on the selected prediction mode and the vectorized entropy coding,
The vectorized entropy coding includes entropy coding the enhancement layer video blocks using a vector syntax element that defines vectors associated with the enhancement layer video blocks,
The instructions cause the video coding device to select weighted prediction when the defined vectorized entropy coding establishes two or more vectors for the enhancement layer video blocks, and the defined vectorized entropy coding. In the case of defining a single vector for these enhancement layer video blocks, unweighted prediction is selected,
Wherein the weighted prediction comprises prediction using weighted prediction data comprising a combination of prediction enhancement layer data and prediction base layer data. 24. The method of claim 23,
The weighted prediction comprises prediction based on prediction blocks formed of weighted combinations of prediction enhancement layer video blocks and prediction base layer video blocks in the video sequence. delete 24. The method of claim 23,
And the unweighted prediction comprises sequential prediction. 24. The method of claim 23,
The instructions cause the video coding device to disable a vector coding mode for the coded unit to define a single vector for vectorized entropy coding. 24. The method of claim 23,
And the coded unit comprises a frame of the video sequence or a slice of a frame of the video sequence. 29. The method of claim 28,
The instructions cause the video coding device to define one or more vectors and to select the prediction mode for each of a plurality of different coded units of the video sequence. 24. The method of claim 23,
The vectorized entropy coding comprises scanning the enhancement layer video blocks from two-dimensional blocks of transform coefficients into the one or more vectors, and individually entropy coding the one or more vectors,
And the one or more vectors comprise one-dimensional sets of transform coefficients. 24. The method of claim 23,
The coding comprises encoding,
And the instructions cause the video coding device to transmit a bitstream comprising encoded video blocks. 24. The method of claim 23,
The coding comprises decoding,
And the instructions cause the video coding device to receive the video sequence as a bitstream that includes encoded video blocks. A device for coding data of a video sequence,
Means for defining one or more vectors for vectorized entropy coding of enhancement layer video blocks of a coded unit in the video sequence, wherein the vectorized entropy coding defines a vector syntax that defines the vectors associated with the enhancement layer video blocks. Means for defining the one or more vectors, including entropy coding the enhancement layer video blocks using an element;
Means for selecting a prediction mode for the enhancement layer video blocks of the coded unit based on the defined vectorized entropy coding, wherein the defined vectorized entropy coding comprises two or more vectors for the enhancement layer video blocks. Means for selecting weighted prediction, and if the defined vectorized entropy coding defines a single vector for the enhancement layer video blocks, Means for selecting the prediction mode, wherein the weighted prediction comprises prediction using weighted prediction data comprising a combination of prediction enhancement layer data and prediction base layer data; And
Means for coding the enhancement layer video blocks based on the selected prediction mode and the vectorized entropy coding. 34. The method of claim 33,
Wherein the weighted prediction comprises prediction based on prediction blocks formed of weighted combinations of prediction enhancement layer video blocks and prediction base layer video blocks in the video sequence. delete 34. The method of claim 33,
And the unweighted prediction comprises sequential prediction. 34. The method of claim 33,
And means for disabling a vector coding mode for the coded unit to define a single vector for vectorized entropy coding. 34. The method of claim 33,
And the coded unit comprises a frame of the video sequence or a slice of a frame of the video sequence. The method of claim 38,
Wherein the means for defining defines one or more vectors, and the means for selecting the prediction mode selects the prediction mode for each of a plurality of different coded units of the video sequence. 34. The method of claim 33,
The vectorized entropy coding comprises scanning the enhancement layer video blocks from two-dimensional blocks of transform coefficients into the one or more vectors, and individually entropy coding the one or more vectors,
And the one or more vectors comprise one-dimensional sets of transform coefficients. 34. The method of claim 33,
The coding comprises encoding,
And the device for coding data of the video sequence further comprises means for transmitting a bitstream comprising encoded video blocks. 34. The method of claim 33,
The coding comprises decoding,
And the device for coding the data of the video sequence further comprises means for receiving the video sequence as a bitstream comprising encoded video blocks. As a device,
Define one or more vectors for vectorized entropy encoding of the enhancement layer video blocks of the coded unit in the video sequence, and based on the defined vectorized entropy coding, the prediction mode for the enhancement layer video blocks of the coded unit. Wherein the vectorized entropy coding comprises entropy coding the enhancement layer video blocks using a vector syntax element defining vectors associated with the enhancement layer video blocks, wherein the control unit comprises: If defined vectorized entropy coding establishes two or more vectors for the enhancement layer video blocks, then weighted prediction is selected and the defined vectorized entropy coding is a single vector for the enhancement layer video blocks. If you define a line, And, wherein the weighted prediction is, the control unit including a prediction to use the weighted prediction data comprising a combination of predictive enhancement layer data and predictive base layer data;
A prediction unit for performing prediction encoding techniques based on the selected prediction mode;
An entropy encoding unit for performing at least a portion of the bitstream by performing the vectorized entropy encoding; And
A wireless transmitter for transmitting said bitstream to another device 44. The method of claim 43,
And the device comprises a wireless communication handset. A wireless receiver receiving a bitstream comprising entropy coded coefficient values of enhancement layer video blocks of a coded unit in a video sequence;
Define one or more vectors for vectorized entropy decoding of the enhancement layer video blocks of the coded unit in the video sequence, and predict the enhancement layer video blocks of the coded unit based on the defined vectorized entropy decoding. A control unit for selecting a mode, wherein the vectorized entropy decoding includes entropy decoding the enhancement layer video blocks using a vector syntax element that defines vectors associated with the enhancement layer video blocks, wherein the control unit comprises: Select weighted prediction if the defined vectorized entropy decoding establishes two or more vectors for the enhancement layer video blocks, and wherein the defined vectorized entropy decoding is single for the enhancement layer video blocks. If you define a vector of Select a non-weighted prediction, wherein the weighted prediction comprises prediction using weighted prediction data comprising a combination of prediction enhancement layer data and prediction base layer data;
A prediction unit for performing prediction decoding techniques based on the selected prediction mode; And
And an entropy decoding unit for performing the vectorized entropy decoding. 46. The method of claim 45,
And the device comprises a wireless communication handset.

Images