AU2012267737A1 - Enhanced intra-prediction mode signaling for video coding using neighboring mode - Google Patents

Enhanced intra-prediction mode signaling for video coding using neighboring mode

Info

Publication number
AU2012267737A1
AU2012267737A1 AU2012267737A AU2012267737A AU2012267737A1 AU 2012267737 A1 AU2012267737 A1 AU 2012267737A1 AU 2012267737 A AU2012267737 A AU 2012267737A AU 2012267737 A AU2012267737 A AU 2012267737A AU 2012267737 A1 AU2012267737 A1 AU 2012267737A1
Authority
AU
Australia
Prior art keywords
intra
mode
prediction
block
modes
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
AU2012267737A
Other versions
AU2012267737B2 (en
Inventor
Wei-Jung Chien
Marta Karczewicz
Xianglin Wang
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Qualcomm Inc
Original Assignee
Qualcomm Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from US13/491,076 external-priority patent/US9654785B2/en
Application filed by Qualcomm Inc filed Critical Qualcomm Inc
Publication of AU2012267737A1 publication Critical patent/AU2012267737A1/en
Application granted granted Critical
Publication of AU2012267737B2 publication Critical patent/AU2012267737B2/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Description

ENHANCED INTRA-PREDICTION MODE SIGNALING FOR VIDEO CODING USING NEIGHBORING MODE
[0001] This application relates to and claims priority to U.S. Provisional Application No. 61/495,332, filed 9 June 2011; U.S. Provisional Application No. 61/503,712, filed 1 July 2011; U.S. Provisional Application No. 61/504,664, filed 5 July 2011; and U.S.
Provisional Application No. 61/533,118, filed 9 September 2011, the entire contents each of which are hereby incorporated by reference.
TECHNICAL FIELD
[0002] This disclosure relates to video coding, and more particularly, to signaling of coding characteristics for coded video data.
BACKGROUND
[0003] Digital video capabilities can be incorporated into a wide range of devices, including digital televisions, digital direct broadcast systems, wireless broadcast systems, personal digital assistants (PDAs), laptop or desktop computers, digital cameras, digital recording devices, digital media players, video gaming devices, video game consoles, cellular or satellite radio telephones, video teleconferencing devices, and the like. Digital video devices implement video compression techniques, such as those described in the standards defined by MPEG-2, MPEG-4, ITU-T H.263 or ITU-T H.264/MPEG-4, Part 10, Advanced Video Coding (AVC), and extensions of such standards, to transmit and receive digital video information more efficiently.
[0004] Video compression techniques perform spatial (intra-picture) prediction and/or temporal (inter-picture) prediction to reduce or remove redundancy inherent in video sequences. For block-based video coding, a video frame, picture, or slice may be partitioned into video blocks. Each video block can be further partitioned. Video blocks in an intra- coded (I) frame or slice are encoded using spatial prediction with respect to neighboring video blocks in the same frame, picture, or slice. Video blocks in an inter-coded (P or B) frame or slice may use spatial prediction with respect to neighboring macroblocks in the same frame or slice or temporal prediction with respect to other reference frames. As used herein, the terms "pictures" may be referred to as frames, and "reference pictures" may be referred to a reference frames. [0005] Spatial or temporal prediction results in a predictive block for a block to be coded. Residual data represents pixel differences between the original block to be coded and the predictive block. An inter-coded block is encoded according to a motion vector that points to a block of reference samples forming the predictive block, and the residual data indicating the difference between the coded block and the predictive block. An intra-coded block is encoded according to an intra-coding mode and the residual data. For further compression, the residual data may be transformed from the pixel domain to a transform domain, resulting in residual transform coefficients, which then may be quantized. The quantized transform coefficients, initially arranged in a two-dimensional array, may be scanned in order to produce a one-dimensional vector of transform coefficients, and entropy coding may be applied to achieve even more compression.
SUMMARY
[0006] In general, this disclosure describes techniques for signaling intra-prediction modes for video coding. The techniques of this disclosure may improve efficiency for signaling of an intra-prediction encoding mode used to intra-mode encode a block of video data. Video data includes a sequence of frames (or pictures) played in rapid succession to simulate motion. Each of the frames may be divided into blocks. Techniques of this disclosure include fixing a number of most probable intra-prediction mode candidates to greater than or equal to two for each block within a frame. In this manner, there may be a relative improvement in efficiency for parsing in the decoding processing and a reduction in memory usage when using the techniques of this disclosure.
[0007] In one example, a method for coding video data, the method comprising determining, for a block of video data, a set of most probable intra-prediction modes such that the set of most probable intra-prediction modes has a size that is equal to a predetermined number that is greater than or equal to two. The method also comprises coding a value representative of an actual intra-prediction mode for the block based at least in part on the set of most probable intra-prediction modes and coding the block using the actual intra-prediction mode.
[0008] In another aspect, a device for encoding data comprises a video coder configured to determine, for a block of video data, a set of most probable intra-prediction modes such that the set of most probable intra-prediction modes has a size that is equal to a predetermined number that is greater than or equal to two. The video coder is also configured to code a value representative of an actual intra-prediction mode for the block based at least in part on the set of most probable intra-prediction modes. The video coder is further configured to and code the block using the actual intra-prediction mode.
[0009] In another aspect, a computer-readable medium comprises computer-readable storage medium having stored thereon instructions that, when executed, cause a processor of a video coding device to determine, for a block of video data, a set of most probable intra-prediction modes such that the set of most probable intra-prediction modes has a size that is equal to a predetermined number that is greater than or equal to two. The instructions further cause the processor to code a value representative of an actual intra-prediction mode for the block based at least in part on the set of most probable intra-prediction modes and code the block using the actual intra-prediction mode.
[0010] In another aspect, a device is provided that comprises means for determining, for a block of video data, a set of most probable intra-prediction modes such that the set of most probable intra-prediction modes has a size that is equal to a predetermined number that is greater than or equal to two. The apparatus also comprises means for coding a value representative of an actual intra-prediction mode for the block based at least in part on the set of most probable intra-prediction modes and means for coding the block using the actual intra-prediction mode.
[0011] The techniques described in this disclosure may be implemented in hardware, software, firmware, or any combination thereof. If implemented in software, the software may be executed in a processor, which may refer to one or more processors, such as a microprocessor, application specific integrated circuit (ASIC), field programmable gate array (FPGA), or digital signal processor (DSP), or other equivalent integrated or discrete logic circuitry. Software comprising instructions to execute the techniques may be initially stored in a computer-readable medium and loaded and executed by a processor.
[0012] Accordingly, this disclosure also contemplates computer-readable media comprising instructions to cause a processor to perform any of a variety of techniques as described in this disclosure. In some cases, the computer-readable medium may form part of a computer program product, which may be sold to manufacturers and/or used in a device. The computer program product may include the computer-readable medium, and in some cases, may also include packaging materials.
[0013] This disclosure may also apply to electromagnetic signals carrying information. For example, an electromagnetic signal may comprise information relating to the full pixel support used to interpolate a value for a sub-integer pixel of a reference sample. In some examples, a signal may be generated from or transmitted by a device implementing the techniques described herein. In other examples, this disclosure may apply to signals that may be received at a device implementing the techniques described herein.
[0014] The details of one or more aspects of the disclosure are set forth in the accompanying drawings and the description below. Other features, objects, and advantages of the techniques described in this disclosure will be apparent from the description and drawings, and from the claims.
BRIEF DESCRIPTION OF DRAWINGS
[0015] FIG. 1 represents an example of three blocks, including a current block to be coded and two neighboring blocks.
[0016] FIG. 2 is a block diagram illustrating an example video encoding and decoding system that may utilize techniques for coding syntax data representative of intra-prediction modes for blocks of video data.
[0017] FIG. 3 is a block diagram illustrating an example of a video encoder that may implement techniques for coding information indicative of an intra-prediction mode.
[0018] FIG. 4 is a block diagram illustrating an example of a video decoder, which decodes an encoded video sequence.
[0019] FIG. 5 is a diagram illustrating one example of 35 intra-prediction modes and their corresponding prediction directions.
[0020] FIG. 6 is a diagram illustrating another example of 35 intra-prediction modes and their corresponding prediction directions.
[0021] FIG. 7 is a flowchart illustrating one example of a method for intra-prediction mode signaling for video encoding.
[0022] FIG. 8 is a flowchart illustrating one example of a method for determining most probable intra-prediction mode candidates when a set of most probable intra-prediction modes is equal to three.
DETAILED DESCRIPTION
[0023] In general, this disclosure describes techniques for signaling intra-prediction modes for video coding. The techniques of this disclosure may improve efficiency for signaling of an intra-prediction encoding mode used to intra-encode a block of video data. A video encoder, for example, may include a set of two or more candidate intra-prediction modes for a current block that includes two (or more) most probable intra-prediction modes based on the intra-prediction modes of blocks neighboring the current block. The candidate set may include indexes for the two or more most probable intra-prediction modes. As used herein, "modes" may be used generally to refer to "intra-prediction modes."
[0024] In some examples, techniques of this disclosure provide different candidate sets of intra-prediction modes based on the type of video data being predicted. For example, under certain conditions, certain intra-prediction modes may be included as a probable intra- prediction mode when the set of most probable intra-prediction modes includes 3 or more modes, such as a planar or DC mode.
[0025] Video data includes a sequence of frames (or pictures) played in rapid succession to simulate motion. Each of the frames may be divided into blocks. As used herein, the terms "frame" and "picture" may be used interchangeably.
[0026] Video encoders encode video data by utilizing spatial and temporal redundancy. For example, a video encoder may take advantage of spatial redundancy by predicting a block relative to neighboring, previously coded blocks. Likewise, a video encoder may take advantage of temporal redundancy by predicting a block relative to data of previously coded frames. In particular, the video encoder predicts a current block from data of a spatial neighbor or from data of one or more previously coded frames. The video encoder then calculates a residual value for the block as a difference between the actual value for the block and the predicted value for the block. The video encoder uses prediction units (PUs) to represent prediction data for a coding unit (CU) and transform units (TUs) to represent residual data. The residual data for a block includes pixel-by-pixel difference values in the pixel (or spatial) domain. The video encoder may further transform the residual data, representing the data in the transform domain.
[0027] A video decoder may receive coded data for a coded block. The coded data may include a representation of the prediction mode used to encode the block, as well as an indication of partitioning of PUs for the block. In this manner, the video decoder may use the same partitioning of PUs and apply the same prediction mode to decode the block. To reduce the amount of bits consumed in signaling the prediction mode, video coding devices may determine likelihoods of coding prediction modes for a current block based on coding modes of neighboring blocks. FIG. 1 represents an example of three video blocks: A (4), B (6), and C (8). Block C (8) represents a current block being coded, block A (4) represents a left- neighboring, previously coded block relative to block C (8), and block B (6) represents a top- neighboring, previously coded block relative to block C (8).
[0028] For purposes of the example of FIG. 1, blocks A (4), B (6), and C (8) are blocks of an intra-predicted picture, frame, or slice. A video coding device, such as a video encoder or a video decoder, may determine two or more likely intra-prediction modes for block C (8) based on the intra-prediction modes of blocks A (4) and B (6). In general, block C is more likely to be predicted using a mode of either block A (4) or block B (6). Typically, when blocks A (4) and B (6) have the same intra-prediction mode, the most likely intra-prediction mode for block C (8) will be the intra-prediction mode of blocks A (4) and B (6). On the other hand, when blocks A (4) and B (6) have different intra-prediction modes, a video coding device must determine whether the prediction mode for block C (8) is more likely to be the intra-prediction mode of block A (4) or the intra-prediction mode of block B (6).
[0029] More particularly, in conventional High Efficiency Video Coding (HEVC), a mapping table may be used to map intra-prediction modes to codeword indices. The codeword indices may be mapped by another table to variable length codes (for CAVLC) or binarized values (for CABAC). In addition, for each block, a number of most probable modes may be determined, where the most probable modes may be assigned the smallest indices, where the smallest indices are most probable and thus, coded using fewer bits. In conventional HEVC, the number of most probable modes may vary based on whether blocks A (4) and B (6) have the same or different intra-prediction modes.
[0030] This disclosure provides various techniques for improving signaling of intra- prediction modes for video coding. In one example, rather than allowing a number of most probable modes to vary for each block, as discussed above, there may always be a fixed number of most probable modes, which is at least two. While the number of most probable modes may be larger than two, in these techniques, the number of most probable modes is fixed for all blocks in a picture. In other words, a video coding device may be configured to use a predetermined number of most probable modes for all blocks, and the predetermined number may be greater than or equal to two.
[0031] In this example, if the intra-prediction modes of blocks A (4) and B (6) are different, and the predetermined number of most probable modes for block C (8) is two, then the two most probable intra-prediction modes for block C (8) may correspond to the intra-prediction modes of blocks A (4) and B (6). However, if the intra-prediction modes of blocks A (4) and B (6) are the same, the video coding device may add a second most probable mode to the set of most probable modes.
[0032] In some examples, if the intra-prediction modes of blocks A (4) and B (6) are the same and the mode is a mode other than planar mode, then the second most probable mode for block C (8) is selected as planar mode. On the other hand, if the intra-prediction modes of blocks A (4) and B (6) are the same and the mode is planar mode, then the second most probable mode for block C (8) is selected as DC mode. In some examples, planar mode may always be mapped to index value 0.
[0033] For examples where there are more than two most probable modes in the
predetermined number of most probable modes, these modes may correspond to intra- prediction modes that are similar in direction to the directions of the intra-prediction directions for blocks A (4) and B (6).
[0034] The examples discussed above have referred to intra-prediction modes for luminance data. For chrominance data, this disclosure proposes fixing the available number of intra- prediction modes such that certain intra-prediction modes are always candidate intra- prediction modes, in some examples. Conventionally, six modes are available for
chrominance blocks: vertical mode, horizontal mode, DC mode, planar mode, luma signal based prediction mode, and inheritance of luma prediction mode. Inheritance of luma prediction mode allows the chrominance mode to inherit the mode of the corresponding luminance block. Because of this, two symbols, or index values, may be assigned to the same mode, e.g., when the luminance block is predicted using vertical, horizontal, DC, or planar mode. Effectively, this means that the chrominance block may have only five possible modes, rather than six. Thus, there is a redundant signal for at least one mode in such situations.
[0035] This disclosure proposes adding another intra-prediction mode for chrominance blocks when a redundant signal is available, in some examples. Assuming that the luminance block is predicted using one of horizontal, vertical, DC, or planar mode, the mode
corresponding to the index value that would otherwise indicate the inheritance of the luma intra-prediction mode may be mapped to a different mode than the mode used for the corresponding luminance block. This additional mode may correspond to a mode having a similar directionality to the mode of the corresponding luminance block that is not otherwise available for the chrominance block. [0036] According to techniques of the present disclosure, an example derivation process for luma intra-prediction modes may include the following inputs: a luma location ( xB, yB ) specifying a top-left luma sample of a current block relative to a top-left luma sample of a current picture of the current block; a variable, log2TrafoSize, specifying the size of the current prediction unit; and, if available, variable arrays, IntraPredMode, that are derived for adjacent coding units previously decoded in decoding order. The output of this derivation process may be denoted with the variable IntraPredMode[ xB ][ yB ].
[0037] Table 1 specifies an example of a number of luma intra-prediction modes, intraPredModeNum, depending on log2TrafoSize, the size of a current prediction block.
Table 1 - Specification of intraPredModeNum
[0038] The variable candModeList[ x ] defines the intra-prediction modes that are available. The variable NumMPMCand defines the number of most probable mode (MPM) candidates. According to techniques described herein, the number of MPM candidates is fixed for all blocks in a picture or frame. A video encoder may be configured to signal a value representative of the number of MPM candidates in, e.g., a sequence parameter set (SPS) for a sequence of pictures, a picture parameter set (PPS) for an individual picture, or other data structure. Likewise, a video decoder may determine the number of MPM candidates by interpreting such signaled values.
[0039] The candModeList[ x ] and NumMPMCand can be derived based on the presence and values of candlntraPredModeN. If both candlntraPredModeN are not available, then the index value 2 is assigned to candModeList[0] and NumMPMCand is set equal to 1.
Otherwise, if only one candlntraPredModeN is available, then this candlntraPredModeN is assigned to candModeList[0] and NumMPMCand is set equal to 1. Likewise, if both candlntraPredModeN are the same, one of the candlntraPredModeN is assigned to candModeList[0] and NumMPMCand is set equal to 1. If both candlntraPredModeN are different, NumMPMCand is set equal to 2 and both candlntraPredModeN are assigned to the candidate modes list, with the smaller of the two candidates at candModeList[ 0 ] and the larger at candModeList[ 1 ]. Table 2 summarizes how candModeList[ x ] and
NumMPMCand may be derived. Table 2 - Specification of intraPredModeNum
[0040] IntraPredMode[ xB ][ yB ] can be derived by applying the following procedure. If prev_intra_pred_flag[ xB ][ yB ] is true, IntraPredMode[ xB ][ yB ] is set equal to
candModeList[mpm_idx[ xB ][ yB ]]. Otherwise, IntraPredMode[ xB ][ yB ] is derived by applying the following equations:
IntraPredMode[ xB ][ yB ] = rem_intra_luma_pred_mode (1) for (cldx = 0; cldx < NumMPMCand; cldx++)
if (IntraPredMode[ xB ] [ yB ] > candModeList[cIdx]), then (2)
IntraPredMode[ xB ][ yB ]++
In these examples, the variable rem_intra_pred_mode is signaled by fixed length binarization with one context. The variable cldx specifies the chroma component of the current block.
[0041] For chroma intra-prediction mode signaling, the current HEVC allows six modes including: vertical, horizontal, DC, planar, luma signal based chroma prediction, and inheritance of luma prediction mode. Among all of these modes, the inheritance of luma prediction mode means that the chroma prediction direction is the same as the luma prediction direction. Because of this, some redundant symbols are removed if the luma mode is vertical, horizontal, DC, or planar. As a result, the code tables have different sizes for different luma prediction mode.
[0042] This process may require extra decoding process in parsing and extra memory. First, in order to parse intra_pred_mode, the decoder has to decode intra_pred_mode of the neighboring blocks A and B in order to determine candlntraPredModeA and
candlntraPredModeB. Furthermore, the decoder has to determine candModeList and
NumMPMC. The extra memory is required because six bits are needed in a decoder line buffer for every 4x4 block in order to store intra_pred_mode. Further, the coding of rem_intra_pred_mode is not efficient due to fixed length binarization and its context modeling. Moreover, having different sizes of code tables for the chroma prediction mode requires having prior knowledge of luma prediction mode before the parsing of the chroma prediction mode.
[0043] FIG. 2 is a block diagram illustrating an example video encoding and decoding system 10 that may be used to implement the various techniques described herein. As shown in FIG. 2, system 10 includes a source device 12 that transmits encoded video data to a destination device 14 via a communication channel 16. Source device 12 and destination device 14 may comprise any of a wide range of devices. In some cases, source device 12 and destination device 14 may comprise wireless communication devices, such as wireless handsets, so- called cellular or satellite radiotelephones, or any wireless devices that can communicate video information over a communication channel 16, in which case communication channel 16 is wireless.
[0044] The techniques of this disclosure, however, are not necessarily limited to wireless applications or settings. For example, these techniques may apply to over-the-air television broadcasts, cable television transmissions, satellite television transmissions, Internet video transmissions, encoded digital video that is encoded onto a storage medium, or other scenarios. Accordingly, communication channel 16 may comprise any combination of wireless or wired media suitable for transmission of encoded video data. Moreover, communication channel 16 is intended to represent just one of many ways in which a video encoding device might transmit data to a video decoding device. For example, in other configurations of system 10, source device 12 might generate encoded video for decoding by destination device 14 and store the encoded video on a storage medium or a file server, such that the encoded video may be accessed by destination device 14 as desired.
[0045] In the example of FIG. 2, source device 12 includes a video source 18, video encoder 20, a modulator/demodulator (modem) 22, and a transmitter 24. Destination device 14 includes a receiver 26, a modem 28, a video decoder 30, and a display device 32. In accordance with this disclosure, video encoder 20 of source device 12 may be configured to apply the techniques for coding syntax data representative of intra-prediction modes for blocks of video data. In other examples, a source device and a destination device may include other components or arrangements. For example, source device 12 may receive video data from an external video source 18, such as an external camera. Likewise, destination device 14 may interface with an external display device, rather than including an integrated display device. [0046] The illustrated system 10 of FIG. 2 is merely one example. Techniques for coding syntax data representative of intra-prediction modes for blocks of video data may be performed by any digital video encoding and/or decoding device. Although generally the techniques of this disclosure are performed by a video encoding device, the techniques may also be performed by a video encoder/decoder, typically referred to as a "CODEC."
Moreover, the techniques of this disclosure may also be performed by a video preprocessor. Source device 12 and destination device 14 are merely examples of such coding devices in which source device 12 generates coded video data for transmission to destination device 14. In some examples, devices 12 and 14 may operate in a substantially symmetrical manner such that each of devices 12 and 14 include video encoding and decoding components.
Hence, system 10 may support one-way or two-way video transmission between video devices 12, 14, e.g., for video streaming, video playback, video broadcasting, or video telephony.
[0047] Video source 18 of source device 12 may include a video capture device, such as a video camera, a video archive containing previously captured video, and/or a video feed from a video content provider. As a further alternative, video source 18 may generate computer graphics-based data as the source video, or a combination of live video, archived video, and computer-generated video. In some cases, if video source 18 is a video camera, source device 12 and destination device 14 may form so-called camera phones or video phones. As mentioned above, however, the techniques described in this disclosure may be applicable to video coding in general, and may be applied to wireless and/or wired applications. In each case, the captured, pre-captured, or computer-generated video may be encoded by video encoder 20. The encoded video information may then be modulated by modem 22 according to a communication standard, and transmitted to destination device 14 via transmitter 24. Modem 22 may include various mixers, filters, amplifiers or other components designed for signal modulation. Transmitter 24 may include circuits designed for transmitting data, including amplifiers, filters, and one or more antennas.
[0048] Receiver 26 of destination device 14 receives information over channel 16, and modem 28 demodulates the information. Again, the video encoding process may implement one or more of the techniques described herein to coding syntax data representative of intra- prediction modes for blocks of video data. The information communicated over channel 16 may include syntax information defined by video encoder 20, which is also used by video decoder 30, that includes syntax elements that describe characteristics and/or processing of macrob locks and other coded units, e.g., GOPs. Display device 32 displays the decoded video data to a user, and may comprise any of a variety of display devices such as a cathode ray tube (CRT), a liquid crystal display (LCD), a plasma display, an organic light emitting diode (OLED) display, or another type of display device.
[0049] In the example of FIG. 1, communication channel 16 may comprise any wireless or wired communication medium, such as a radio frequency (RF) spectrum or one or more physical transmission lines, or any combination of wireless and wired media.
Communication channel 16 may form part of a packet-based network, such as a local area network, a wide-area network, or a global network such as the Internet. Communication channel 16 generally represents any suitable communication medium, or collection of different communication media, for transmitting video data from source device 12 to destination device 14, including any suitable combination of wired or wireless media.
Communication channel 16 may include routers, switches, base stations, or any other equipment that may be useful to facilitate communication from source device 12 to destination device 14.
[0050] Video encoder 20 and video decoder 30 may operate according to a video
compression standard, such as the ITU-T H.264 standard, alternatively referred to as MPEG-4, Part 10, Advanced Video Coding (AVC). The techniques of this disclosure, however, are not limited to any particular coding standard. Other examples include MPEG-2 and ITU-T H.263. Although not shown in FIG. 1, in some aspects, video encoder 20 and video decoder 30 may each be integrated with an audio encoder and decoder, and may include appropriate MUX-DEMUX units, or other hardware and software, to handle encoding of both audio and video in a common data stream or separate data streams. If applicable, MUX-DEMUX units may conform to the ITU H.223 multiplexer protocol, or other protocols such as the user datagram protocol (UDP).
[0051] The ITU-T H.264/MPEG-4 (AVC) standard was formulated by the ITU-T Video Coding Experts Group (VCEG) together with the ISO/IEC Moving Picture Experts Group (MPEG) as the product of a collective partnership known as the Joint Video Team (JVT). In some aspects, the techniques described in this disclosure may be applied to devices that generally conform to the H.264 standard. The H.264 standard is described in ITU-T
Recommendation H.264, Advanced Video Coding for generic audiovisual services, by the ITU-T Study Group, and dated March, 2005, which may be referred to herein as the H.264 standard or H.264 specification, or the H.264/AVC standard or specification. The Joint Video Team (JVT) continues to work on extensions to H.264/MPEG-4 AVC.
[0052] Video encoder 20 and video decoder 30 each may be implemented as any of a variety of suitable encoder circuitry, such as one or more microprocessors, digital signal processors (DSPs), application specific integrated circuits (ASICs), field programmable gate arrays (FPGAs), discrete logic, software, hardware, firmware or any combinations thereof. Each of video encoder 20 and video decoder 30 may be included in one or more encoders or decoders, either of which may be integrated as part of a combined encoder/decoder (CODEC) in a respective camera, computer, mobile device, subscriber device, broadcast device, set-top box, server, or the like.
[0053] A video sequence typically includes a series of video frames. A group of pictures (GOP) generally comprises a series of one or more video frames. A GOP may include syntax data in a header of the GOP, a header of one or more frames of the GOP, or elsewhere, that describes a number of frames included in the GOP. Each frame may include frame syntax data that describes an encoding mode for the respective frame. Video encoder 20, for example, may include a fixed set of most probable candidate intra-prediction modes for each block in a frame, or each block within each frame within each GOP. The fixed set of MPM candidates may include two (or more) most probable intra-prediction modes based on the intra-prediction modes of blocks neighboring a current block. Video encoder 20 typically operates on video blocks within individual video frames in order to encode the video data. A video block may correspond to a block, a CU, a PU, or a TU. The video blocks may have fixed or varying sizes, and may differ in size according to a specified coding standard. Each video frame may include a plurality of slices. Each slice may include a plurality of macrob locks, which may be arranged into partitions, also referred to as sub-blocks.
[0054] As an example, the ITU-T H.264 standard supports intra-prediction in various block sizes, such as 16 by 16, 8 by 8, or 4 by 4 for luma components, and 8x8 for chroma components, as well as inter prediction in various block sizes, such as 16x16, 16x8, 8x16, 8x8, 8x4, 4x8 and 4x4 for luma components and corresponding scaled sizes for chroma components. In this disclosure, "NxN" and "N by N" may be used interchangeably to refer to the pixel dimensions of the block in terms of vertical and horizontal dimensions, e.g., 16x16 pixels or 16 by 16 pixels. In general, a 16x16 block will have 16 pixels in a vertical direction (y = 16) and 16 pixels in a horizontal direction (x = 16). Likewise, an NxN block generally has N pixels in a vertical direction and N pixels in a horizontal direction, where N represents a nonnegative integer value. The pixels in a block may be arranged in rows and columns. Moreover, blocks need not necessarily have the same number of pixels in the horizontal direction as in the vertical direction. For example, blocks may comprise NxM pixels, where M is not necessarily equal to N.
[0055] Block sizes that are less than 16 by 16 may be referred to as partitions of a 16 by 16 macroblock. Video blocks may comprise blocks of pixel data in the pixel domain, or blocks of transform coefficients in the transform domain, e.g., following application of a transform such as a discrete cosine transform (DCT), an integer transform, a wavelet transform, or a conceptually similar transform to the residual video block data representing pixel differences between coded video blocks and predictive video blocks. In some cases, a video block may comprise blocks of quantized transform coefficients in the transform domain.
[0056] Smaller video blocks can provide better resolution, and may be used for locations of a video frame that include high levels of detail. In general, macroblocks and the various partitions, sometimes referred to as sub-blocks, may be considered video blocks. In addition, a slice may be considered to be a plurality of video blocks, such as macroblocks and/or sub- blocks. Each slice may be an independently decodable unit of a video frame. Alternatively, frames themselves may be decodable units, or other portions of a frame may be defined as decodable units. The term "coded unit" may refer to any independently decodable unit of a video frame such as an entire frame, a slice of a frame, a group of pictures (GOP) also referred to as a sequence, or another independently decodable unit defined according to applicable coding techniques.
[0057] Efforts are currently in progress to develop a new video coding standard, currently referred to as High Efficiency Video Coding (HEVC). The emerging HEVC standard may also be referred to as H.265. The standardization efforts are based on a model of a video coding device referred to as the HEVC Test Model (HM). The HM presumes several capabilities of video coding devices over devices according to, e.g., ITU-T H.264/AVC. For example, whereas H.264 provides nine intra-prediction encoding modes, HM provides as many as thirty-three intra-prediction encoding modes, e.g., based on the size of a block being intra-prediction coded. [0058] HM refers to a block of video data as a coding unit (CU). Syntax data within a bitstream may define a largest coding unit (LCU), which is a largest coding unit in terms of the number of pixels. In general, a CU has a similar purpose to a macroblock of H.264, except that a CU does not have a size distinction. Thus, a CU may be split into sub-CUs. In general, references in this disclosure to a CU may refer to a largest coding unit of a picture or a sub-CU of an LCU. An LCU may be split into sub-CUs, and each sub-CU may be split into sub-CUs. Syntax data for a bitstream may define a maximum number of times an LCU may be split, referred to as CU depth. Accordingly, a bitstream may also define a smallest coding unit (SCU). This disclosure also uses the term "block" to refer to any of a CU, a prediction unit (PU), or a transform unit (TU).
[0059] An LCU may be associated with a quadtree data structure. In general, a quadtree data structure includes one node per CU, where a root node corresponds to the LCU. If a CU is split into four sub-CUs, the node corresponding to the CU includes four leaf nodes, each of which corresponds to one of the sub-CUs. Each node of the quadtree data structure may provide syntax data for the corresponding CU. For example, a node in the quadtree may include a split flag, indicating whether the CU corresponding to the node is split into sub- CUs. Syntax elements for a CU may be defined recursively, and may depend on whether the CU is split into sub-CUs.
[0060] A CU that is not split may include one or more prediction units (PUs). In general, a PU represents all or a portion of the corresponding CU, and includes data for retrieving a reference sample for the PU. For example, when the PU is intra-mode encoded, the PU may include data describing an intra-prediction mode for the PU. For example, in accordance with the techniques of this disclosure, a fixed set of most probable candidate intra-prediction modes for each PU in a CU. The fixed set of MPM candidates may include two or more candidate intra-prediction modes based on the intra-prediction modes of blocks neighboring a current block. As another example, when the PU is inter-mode encoded, the PU may include data defining a motion vector for the PU. The data defining the motion vector may describe, for example, a horizontal component of the motion vector, a vertical component of the motion vector, a resolution for the motion vector (e.g., one-quarter pixel precision or one- eighth pixel precision), a reference frame to which the motion vector points, and/or a reference list (e.g., list 0 or list 1) for the motion vector. Data for the CU defining the PU(s) may also describe, for example, partitioning of the CU into one or more PUs. Partitioning modes may differ between whether the CU is uncoded, intra-prediction mode encoded, or inter-prediction mode encoded.
[0061] A CU having one or more PUs may also include one or more transform units (TUs). Following prediction using a PU, a video encoder may calculate a residual value for the portion of the CU corresponding to the PU. A set of residual values may be transformed, scanned, and quantized to define a set of transform coefficients. The TU defines a data structure that includes the transform coefficients. A TU is not necessarily limited to the size of a PU. Thus, TUs may be larger or smaller than corresponding PUs for the same CU. In some examples, the maximum size of a TU may correspond to the size of the corresponding CU.
[0062] In accordance with the techniques of this disclosure, video encoder 20 may encode certain blocks of video data using intra-prediction mode encoding, and provide information indicating a selected intra-prediction mode used to encode the block. Video encoder 20 may intra-prediction encode blocks of any type of frame or slice using an intra-prediction mode, e.g., I-frames or I-slices, in addition to P-frames or P-slices and B-frames or B-slices. When video encoder 20 determines that a block should be intra-prediction mode encoded, video encoder 20 may perform a rate-distortion analysis to select a most appropriate intra- prediction encoding mode. For example, video encoder 20 may calculate rate-distortion values for one or more intra-prediction encoding modes, and select one of the modes having acceptable rate-distortion characteristics.
[0063] Video encoder 20 may also be configured to determine an encoding context for the block. The context may include various characteristics of the block such as, for example, a size of the block, which may be determined in terms of pixel dimensions, prediction unit (PU) type such as, in the example of HEVC, 2Nx2N, Nx2N, 2NxN, NxN, short-distance intra-prediction (SDIP) types such as 2NxN/2, N/2x2N, 2Nxl, lx2N, a macroblock type in the example of H.264, a coding unit (CU) depth for the block, or other measurements of size for a block of video data. In some examples, the context may correspond to how any or all of intra-prediction modes for an above-neighboring block, a left-neighboring block, an above- left neighboring block, an above -right neighboring block, or other neighboring blocks. In some examples, the context may include both intra-prediction modes for one or more blocks as well as size information for the current block being encoded. [0064] In any case, video encoder 20 may include configuration data that maps the context for the block to various coding characteristics for the current block. For example, based on the context for the block, the configuration data may indicate one or more most probable intra-prediction modes. In accordance with the techniques of this disclosure, video encoder 20 may determine one or more most probable encoding modes for a block, based on an encoding context for the block, as well as an intra-mode index table and a codeword table based on the encoding context for the block. The codeword table may comprise a variable length code (VLC) table for CAVCL or a binarization table for context-adaptive binary arithmetic coding (CABAC). In CABAC, video encoder 20 may further binary arithmetic code a binarized value selected from the table. After selecting the intra-prediction mode to use to encode the block, video encoder 20 may determine whether the selected intra- prediction mode is the most probable intra-prediction mode for the block. If the selected mode is the most probable mode, video encoder 20 may signal the intra-prediction mode using a single bit codeword (e.g., '0' or ' 1 '). Assuming without loss of generality that the single bit codeword has a value of Ό,' and that the codeword table is a VLC table, other codewords in the VLC table may begin with Ί,' to avoid violating the prefix requirements of VLC (that is, that no codeword in the table is a prefix of another codeword in the table). In examples where the selected intra-prediction mode is not one of the most probable modes, video encoder 20 may signal the actual intra-prediction mode. In some examples, a flag may be set indicating that the actual intra-prediction mode is not included in the candidate list of most probable intra-prediction modes.
[0065] Video encoder 20 may, in some examples, be configured to begin analysis for selection of an intra-prediction encoding mode with the most probable encoding mode, based on the context. When the most probable encoding mode achieves suitable rate-distortion characteristics, in some examples, video encoder 20 may select the most probable encoding mode. In other examples, video encoder 20 need not begin the selection process with the most probable encoding mode.
[0066] Following intra-predictive or inter-predictive coding to produce predictive data and residual data, and following any transforms (such as the 4x4 or 8x8 integer transform used in H.264/AVC or a discrete cosine transform DCT) to produce transform coefficients, quantization of transform coefficients may be performed. Quantization generally refers to a process in which transform coefficients are quantized to possibly reduce the amount of data used to represent the coefficients. The quantization process may reduce the bit depth associated with some or all of the coefficients. For example, an n-bit value may be rounded down to an m-bit value during quantization, where n is greater than m.
[0067] Following quantization, entropy coding of the quantized data may be performed, e.g., according to content adaptive variable length coding (CAVLC), context adaptive binary arithmetic coding (CABAC), or another entropy coding methodology. A processing unit configured for entropy coding, or another processing unit, may perform other processing functions, such as zero run length coding of quantized coefficients and/or generation of syntax information such as coded block pattern (CBP) values, macroblock type, coding mode, maximum macroblock size for a coded unit (such as a frame, slice, macroblock, or sequence), or the like.
[0068] Video decoder 30 may ultimately receive encoded video data, e.g., from modem 28 and receiver 26. In accordance with the techniques of this disclosure, video decoder 30 may receive a codeword representative of an intra-prediction mode used to encode a block of video data. Video decoder 30 may be configured to determine a coding context for the block in a manner substantially similar to video encoder 20. Moreover, video decoder 30 may include similar configuration data to video encoder 20, e.g., indications of a most probable encoding mode, an intra-prediction mode index table, and a VLC table for each coding context.
[0069] When using one most probable intra-prediction mode, if the codeword comprises a single-bit codeword, video decoder 30 may determine that the intra-prediction mode used to encode the coded block was the most probable intra-prediction mode. Of course, as discussed above, the single-bit codeword should not be a prefix of the codewords of the VLC table. Accordingly, if the received codeword is not the single-bit codeword, video decoder 30 may determine the intra-prediction mode used to encode the block of video data in a manner generally reciprocal to that of video encoder 20.
[0070] Video encoder 20 and video decoder 30 each may be implemented as any of a variety of suitable encoder or decoder circuitry, as applicable, such as one or more microprocessors, digital signal processors (DSPs), application specific integrated circuits (ASICs), field programmable gate arrays (FPGAs), discrete logic circuitry, software, hardware, firmware or any combinations thereof. Each of video encoder 20 and video decoder 30 may be included in one or more encoders or decoders, either of which may be integrated as part of a combined video encoder/decoder (CODEC). An apparatus including video encoder 20 and/or video decoder 30 may comprise an integrated circuit, a microprocessor, and/or a wireless communication device, such as a cellular telephone.
[0071] FIG. 3 is a block diagram illustrating an example of video encoder 20 that may implement techniques for coding information indicative of an intra-prediction mode, and which may be used to implement the various techniques described above. Video encoder 20 may perform intra- and inter-coding of blocks within video frames, including macrob locks, or partitions or sub-partitions of macrob locks. Intra-coding relies on spatial prediction to reduce or remove spatial redundancy in video within a given video frame. Inter-coding relies on temporal prediction to reduce or remove temporal redundancy in video within adjacent frames of a video sequence. Intra-mode (I-mode) may refer to any of several spatial based compression modes and inter-modes such as uni-directional prediction (P-mode) or bidirectional prediction (B-mode) may refer to any of several temporal-based compression modes. Although components for inter-mode encoding are depicted in FIG. 3, it should be understood that video encoder 20 may further include components for intra-mode encoding. However, such components are not illustrated for the sake of brevity and clarity.
[0072] As shown in FIG. 3, video encoder 20 receives a current video block within a video frame to be encoded. In the example of FIG. 2, video encoder 20 includes motion
compensation unit 44, motion estimation unit 42, memory 64, summer 50, transform processing unit 52, quantization unit 54, and entropy coding unit 56. For video block reconstruction, video encoder 20 also includes inverse quantization unit 58, inverse transform unit 60, and summer 62. A deblocking filter may also be included to filter block boundaries to remove blockiness artifacts from reconstructed video. If desired, the deblocking filter would typically filter the output of summer 62.
[0073] During the encoding process, video encoder 20 receives a video frame or slice to be coded. The frame or slice may be divided into multiple video blocks. Motion estimation unit 42 and motion compensation unit 44 perform inter-predictive coding of the received video block relative to one or more blocks in one or more reference frames to provide temporal compression. Intra-prediction unit 46 may perform intra-predictive coding of the received video block relative to one or more neighboring blocks in the same frame or slice as the block to be coded to provide spatial compression. [0074] Mode select unit 40 may select one of the coding modes, intra or inter, e.g., based on error results and based on a frame or slice type for the frame or slice including a current block being coded, and provides the resulting intra- or inter-coded block to summer 50 to generate residual block data and to summer 62 to reconstruct the encoded block for use in a reference frame or reference slice. In general, intra-prediction involves predicting a current block relative to neighboring, previously coded blocks, while inter-prediction involves motion estimation and motion compensation to temporally predict the current block.
[0075] Motion estimation unit 42 and motion compensation unit 44 represent the inter- prediction elements of video encoder 20. Motion estimation unit 42 and motion
compensation unit 44 may be highly integrated, but are illustrated separately for conceptual purposes. Motion estimation is the process of generating motion vectors, which estimate motion for video blocks. A motion vector, for example, may indicate the displacement of a predictive block within a predictive reference frame (or other coded unit) relative to the current block being coded within the current frame (or other coded unit). A predictive block is a block that is found to closely match the block to be coded, in terms of pixel difference, which may be determined by sum of absolute difference (SAD), sum of square difference (SSD), or other difference metrics. A motion vector may also indicate displacement of a partition of a macroblock. Motion compensation may involve fetching or generating the predictive block based on the motion vector determined by motion estimation. Again, motion estimation unit 42 and motion compensation unit 44 may be functionally integrated, in some examples.
[0076] Motion estimation unit 42 calculates a motion vector for the video block of an inter- coded frame by comparing the video block to video blocks of a reference frame in reference frame store 64. Motion compensation unit 44 may also interpolate sub-integer pixels of the reference frame, e.g., an I-frame or a P-frame. The ITU H.264 standard, as an example, describes two lists: list 0, which includes reference frames having a display order earlier than a current frame being encoded, and list 1 , which includes reference frames having a display order later than the current frame being encoded. Therefore, data stored in reference frame store 64 may be organized according to these lists.
[0077] Motion estimation unit 42 compares blocks of one or more reference frames from reference frame store 64 to a block to be encoded of a current frame, e.g., a P-frame or a B- frame. When the reference frames in reference frame store 64 include values for sub-integer pixels, a motion vector calculated by motion estimation unit 42 may refer to a sub-integer pixel location of a reference frame. Motion estimation unit 42 and/or motion compensation unit 44 may also be configured to calculate values for sub-integer pixel positions of reference frames stored in reference frame store 64 if no values for sub-integer pixel positions are stored in reference frame store 64. Motion estimation unit 42 sends the calculated motion vector to entropy coding unit 56 and motion compensation unit 44. The reference frame block identified by a motion vector may be referred to as a predictive block. Motion compensation unit 44 may calculate prediction data based on the inter-predictive block.
[0078] Intra-prediction unit 46 may intra-predict a current block, as an alternative to the inter- prediction performed by motion estimation unit 42 and motion compensation unit 44, as described above. In particular, intra-prediction unit 46 may determine an intra-prediction mode to use to encode a current block. In some examples, intra-prediction unit 46 may encode a current block using various intra-prediction modes, e.g., during separate encoding passes, and intra-prediction unit 46 (or mode select unit 40, in some examples) may select an appropriate intra-prediction mode to use from the tested modes. For example, intra- prediction unit 46 may calculate rate-distortion values using a rate-distortion analysis for the various tested intra-prediction modes, and select the intra-prediction mode having the best rate-distortion characteristics among the tested modes. Rate-distortion analysis generally determines an amount of distortion (or error) between an encoded block and an original, unencoded block that was encoded to produce the encoded block, as well as a bit rate (that is, a number of bits) used to produce the encoded block. Intra-prediction unit 46 may calculate ratios from the distortions and rates for the various encoded blocks to determine which intra- prediction mode exhibits the best rate-distortion value for the block.
[0079] In any case, after selecting an intra-prediction mode for a block, intra-prediction unit 46 may provide information indicative of the selected intra-prediction mode for the block to entropy coding unit 56. Entropy coding unit 56 may encode the information indicating the selected intra-prediction mode in accordance with the techniques of this disclosure. As illustrated in FIG. 3, video encoder 20 may include configuration data 66, which may include a plurality of intra-prediction mode index tables and a plurality of codeword index tables (also referred to as codeword mapping tables), definitions of encoding contexts for various blocks, and indications of a most probable intra-prediction mode, an intra-prediction mode index table, and a codeword index table to use for each of the contexts. [0080] In examples where the number of intra-prediction modes varies based on block size, configuration data 66 may include different tables for different sizes of blocks. Accordingly, a context for encoding an indication of an intra-prediction mode used to encode a block may include a size of the block, as well as coding modes used to encode neighboring blocks. Entropy coding unit 56 may select the mode index table and codeword mapping table used to select a codeword representative of the selected intra-prediction mode used to encode the block based on the context for the block. Moreover, the mode index tables for blocks of a particular size may have numbers of entries equal to the number of intra-prediction modes for blocks of that size. Thus, mode index tables for blocks of size 4x4 may have 17 entries, mode index tables for blocks of size 8x8, 16x16, and 32x32 may have 34 entries, and mode index tables for blocks of size 64x64 may have 5 entries. Other sizes of blocks, e.g., 128x128, may also have a determined number of intra-prediction modes available as well.
[0081] The intra-prediction modes available for blocks of size 8x8, 16x16, and 32x32 may be the same, and therefore, the same mode index tables may be used for blocks of sizes 8x8, 16x16, and 32x32. Although the same modes may be possible for blocks of these sizes, the probability of using a particular mode to encode a block may vary based on the size of the block. Accordingly, entropy coding unit 56 may determine a codeword mapping table for a particular mode index table based on the size of the block for which an intra-prediction mode is to be signaled, in some examples.
[0082] For example, video encoder 20 determines the set of most probable modes. Intra- prediction unit 46 may determine an actual intra-prediction mode of neighboring blocks of the current block. Video encoder 20 may also be configured to determine a first intra- prediction mode for a left-neighboring block of the block, determine a second intra-prediction mode for an above-neighboring block of the block, and when the first intra-prediction mode is different than the second intra-prediction mode, include both the first intra-prediction mode and the second intra-prediction mode in the set of most probable intra-prediction modes. For example, referring to FIG. 1, intra-prediction unit 46 may determine actual intra-prediction modes used for neighboring blocks A (4) and B (6) with respect to current block C (8).
Based on the intra-prediction modes used for neighboring blocks A (4) and B (6), intra- prediction unit 46 determines the most probable modes for block C (8). Intra-prediction unit 46 may compare the actual intra-prediction mode used for neighboring block A (4) to the actual intra-prediction mode used for neighboring block B (6). Based on this comparison, a particular intra-prediction mode, such as planar mode, may be included in the set of most probable modes for block C (8). Intra-prediction unit 46 may also determine an actual mode to use to intra-predict current block C (8).
[0083] When the first intra-prediction mode is the same as the second intra-prediction mode, and when the first and second intra-prediction modes comprise a mode other than a planar mode, intra-prediction unit 46 includes the planar mode in the set of most probable intra- prediction modes. In another example, when the first intra-prediction mode is the same as the second intra-prediction mode, and when the first and second intra-prediction modes comprise a planar mode, intra-prediction unit 46 includes the planar mode and a DC mode in the set of most probable intra-prediction modes.
[0084] In another example, when the current block comprises a luminance block, video encoder 20 determines, for a chrominance block corresponding to the luminance block, a mapping of a set of values to a set of intra-prediction modes, the set of intra-prediction modes comprising horizontal mode, vertical mode, planar mode, DC mode, and luma signal prediction mode when the actual intra-prediction mode for the luminance block comprises a mode other than horizontal mode, vertical mode, planar mode, and DC mode, the set of intra- prediction modes further comprises a reuse of luma intra-prediction mode mapped from a first value of the set of values. When the actual intra-prediction mode for the luminance block comprises one of horizontal mode, vertical mode, planar mode, and DC mode, the set of intra-prediction modes further comprises a mode other than horizontal mode, vertical mode, planar mode, and DC mode mapped from the first value of the set of values, video encoder 20 encodes a value representative of an actual intra-prediction mode for the chrominance block based on the mapping of the set of values to the set of modes.
[0085] In another example, intra-prediction unit 46 determines a prediction direction of the actual intra-prediction mode and includes at least one intra-prediction mode having a prediction direction closest to the prediction direction of the actual intra-prediction mode in the set of most probable intra-prediction modes.
[0086] In yet another example, when the size of the set of most probable intra-prediction modes is equal to three, intra-prediction unit 46 determine a prediction direction of a first intra-prediction mode and compares the prediction direction of the first intra-prediction mode to prediction directions of one or more other available intra-prediction modes. Intra- prediction unit 46 includes the first intra-prediction mode in the set of most probable intra- prediction modes. Further, based on the comparison, intra-prediction unit 46 includes a second and third intra-prediction mode of the one or more available intra-prediction modes in the set of most probable intra-prediction modes, wherein the second and third intra-prediction modes have prediction directions determined to be closest to the prediction direction of the first intra-prediction mode.
[0087] After predicting a current block, e.g., using intra-prediction or inter-prediction, video encoder 20 may form a residual video block by subtracting the prediction data calculated by motion compensation unit 44 or intra-prediction unit 46 from the original video block being coded. Summer 50 represents the component or components that perform this subtraction operation. Transform processing unit 52 applies a transform, such as a discrete cosine transform (DCT) or a conceptually similar transform, to the residual block, producing a video block comprising residual transform coefficient values. Transform processing unit 52 may perform other transforms, such as those defined by the H.264 standard, which are
conceptually similar to DCT. Wavelet transforms, integer transforms, sub-band transforms or other types of transforms could also be used. In any case, transform processing unit 52 applies the transform to the residual block, producing a block of residual transform
coefficients. The transform may convert the residual information from a pixel value domain to a transform domain, such as a frequency domain. Quantization unit 54 quantizes the residual transform coefficients to further reduce bit rate. The quantization process may reduce the bit depth associated with some or all of the coefficients. The degree of quantization may be modified by adjusting a quantization parameter.
[0088] Following quantization, entropy coding unit 56 entropy codes the quantized transform coefficients. For example, entropy coding unit 56 may perform content adaptive variable length coding (CAVLC), context adaptive binary arithmetic coding (CABAC), or another entropy coding technique. Following the entropy coding by entropy coding unit 56, the encoded video may be transmitted to another device or archived for later transmission or retrieval. In the case of context adaptive binary arithmetic coding, context may be based on neighboring blocks and/or block sizes.
[0089] In some cases, entropy coding unit 56 or another unit of video encoder 20 may be configured to perform other coding functions, in addition to entropy coding and coding of the intra-prediction mode as described above. For example, entropy coding unit 56 may be configured to determine coded block pattern (CBP) values for the blocks and partitions. Also, in some cases, entropy coding unit 56 may perform run length coding of the coefficients in a macroblock or partition thereof. In particular, entropy coding unit 56 may apply a zig-zag scan or other scan pattern to scan the transform coefficients in a macroblock or partition and encode runs of zeros for further compression. Entropy coding unit 56 also may construct header information with appropriate syntax elements for transmission in the encoded video bitstream.
[0090] Inverse quantization unit 58 and inverse transform unit 60 apply inverse quantization and inverse transformation, respectively, to reconstruct the residual block in the pixel domain, e.g., for later use as a reference block. Motion compensation unit 44 may calculate a reference block by adding the residual block to a predictive block of one of the frames of reference frame store 64. Motion compensation unit 44 may also apply one or more interpolation filters to the reconstructed residual block to calculate sub-integer pixel values for use in motion estimation. Summer 62 adds the reconstructed residual block to the motion compensated prediction block produced by motion compensation unit 44 to produce a reconstructed video block for storage in reference frame store 64. The reconstructed video block may be used by motion estimation unit 42 and motion compensation unit 44 as a reference block to inter-code a block in a subsequent video frame.
[0091] In this manner, video encoder 20 represents an example of a video encoder configured to determine one or more most probable intra-prediction encoding modes for a current block of video data based on an encoding context for the current block, select a table of codewords based on the context for the current block, wherein the table of codewords comprises a plurality of variable length codewords corresponding to codeword indexes that correspond to intra-prediction modes other than the most probable intra-prediction mode(s) based on the context, encode the current block using one of the intra-prediction modes other than the most probable intra-prediction encoding mode, determine one of the codeword indexes that corresponds to the one of the intra-prediction modes using the table of codewords, and output a codeword from the selected table of codewords, wherein the codeword corresponds to the one of the codeword indexes.
[0092] FIG. 4 is a block diagram illustrating an example of video decoder 30, which decodes an encoded video sequence, and which may be used to implement the various techniques described herein. In the example of FIG. 3, video decoder 30 includes an entropy decoding unit 70, motion compensation unit 72, intra-prediction unit 74, inverse quantization unit 76, inverse transformation unit 78, memory 82 and summer 80. Video decoder 30 may, in some examples, perform a decoding pass generally reciprocal to the encoding pass described with respect to video encoder 20 (FIG. 3). Motion compensation unit 72 may generate prediction data based on motion vectors received from entropy decoding unit 70.
[0093] Motion compensation unit 72 may use motion vectors received in the bitstream to identify a prediction block in reference frames in reference frame store 82. Intra-prediction unit 74 may use intra-prediction modes received in the bitstream to form a prediction block from spatially adjacent blocks. In particular, video decoder 30, in the example of FIG. 4, includes configuration data 84. Configuration data 84 is substantially similar to configuration data 66 of FIG. 3, in that configuration data 84 includes information describing contexts for intra-predicted blocks, as well as one of a plurality of intra-prediction index mapping tables to use for each context, one of a plurality of codeword index (or codeword mapping) tables to use for each context, and a most probable intra-prediction mode for each context.
[0094] Entropy decoding unit 70 may receive a codeword representative of an intra- prediction mode to use to decode an encoded block of video data. In some examples, the codeword may be a VLC codeword or an entropy coded binarized value that is first entropy decoded using CAB AC. Entropy decoding unit 70 may determine a context for the encoded block, e.g., based on intra-prediction modes for a left-neighboring and top-neighboring block to the encoded block and/or a size for the encoded block. That is, the context may
correspond to the two or more most probable modes. The codewords provide an indication of the actual intra-prediction mode for the current block. For example, the codeword indicates whether the actual intra-prediction mode is one of the most probable modes, and if not, intra- prediction unit 74 provides an indication of the actual intra-prediction mode. Based on the context, entropy decoding unit 70 may determine one or more most probable intra-prediction modes to use to decode the block, as well as an intra-prediction index table and a codeword index table to use to determine the actual intra-prediction mode to use to decode the block.
[0095] Intra-prediction unit 74 may use the intra-prediction mode, corresponding to the indication, to intra-predict the encoded block, e.g., using pixels of neighboring, previously decoded blocks. For examples in which the block is inter-prediction mode encoded, motion compensation unit 72 may receive information defining a motion vector, in order to retrieve motion compensated prediction data for the encoded block. In any case, motion compensation unit 72 or intra-prediction unit 74 may provide information defining a prediction block to summer 80.
[0096] Inverse quantization unit 76 inverse quantizes, i.e., de-quantizes, the quantized block coefficients provided in the bitstream and decoded by entropy decoding unit 70. The inverse quantization process may include a conventional process, e.g., as defined by the H.264 decoding standard or as performed by the HEVC Test Model. The inverse quantization process may also include use of a quantization parameter QPY calculated by encoder 50 for each macroblock to determine a degree of quantization and, likewise, a degree of inverse quantization that should be applied.
[0097] Inverse transform unit 58 applies an inverse transform, e.g., an inverse DCT, an inverse integer transform, or a conceptually similar inverse transform process, to the transform coefficients in order to produce residual blocks in the pixel domain. Motion compensation unit 72 produces motion compensated blocks, possibly performing
interpolation based on interpolation filters. Identifiers for interpolation filters to be used for motion estimation with sub-pixel precision may be included in the syntax elements. Motion compensation unit 72 may use interpolation filters as used by video encoder 20 during encoding of the video block to calculate interpolated values for sub-integer pixels of a reference block. Motion compensation unit 72 may determine the interpolation filters used by video encoder 20 according to received syntax information and use the interpolation filters to produce predictive blocks.
[0098] Motion compensation unit 72 uses some of the syntax information to determine sizes of blocks used to encode frame(s) of the encoded video sequence, partition information that describes how each block of a frame or slice of the encoded video sequence is partitioned, modes indicating how each partition is encoded, one or more reference frames (and reference frame lists) for each inter-encoded block or partition, and other information to decode the encoded video sequence.
[0099] Summer 80 sums the residual blocks with the corresponding prediction blocks generated by motion compensation unit 72 or intra-prediction unit 74 to form decoded blocks. If desired, a deblocking filter may also be applied to filter the decoded blocks in order to remove blockiness artifacts. The decoded video blocks are then stored in reference frame store 82, which provides reference blocks for subsequent motion compensation and also produces decoded video for presentation on a display device (such as display device 32 of FIG. 2).
[0100] In this manner, video decoder 30 of FIG. 4 represents an example of a video decoder configured to determine one or more most probable intra-prediction modes for a coded block of video data based on a context for the current block, select a table of codewords based on the context for the current block, wherein the table of codewords comprises a plurality of variable length codewords corresponding to codeword indexes that correspond to intra- prediction modes other than the most probable intra-prediction mode(s) based on the context, determine one of the codeword indexes that corresponds to a received codeword using the table of codewords, select an intra-prediction mode other than the most probable intra- prediction mode to use to decode the coded block, wherein the selected intra-prediction mode corresponds to the determined one of the codeword indexes; and decode the current block using the selected intra-prediction mode.
[0101] According to techniques described herein, video decoder 30 determines the set of most probable modes for a current video block. Intra-prediction unit 74 may determine an actual intra-prediction mode of neighboring blocks of the current block. Video decoder 30 may also be configured to determine a first intra-prediction mode for a left-neighboring block of the block, determine a second intra-prediction mode for an above-neighboring block of the block, and when the first intra-prediction mode is different than the second intra-prediction mode, include both the first intra-prediction mode and the second intra-prediction mode in the set of most probable intra-prediction modes. For example, referring to FIG. 1, intra- prediction unit 74 may determine actual intra-prediction modes used for neighboring blocks A (4) and B (6) with respect to current block C (8). Based on the intra-prediction modes used for neighboring blocks A (4) and B (6), intra-prediction unit 74 determines the most probable modes for block C (8). Intra-prediction unit 74 may compare the actual intra-prediction mode used for neighboring block A (4) to the actual intra-prediction mode used for neighboring block B (6). Based on this comparison, a particular intra-prediction mode, such as planar mode, may be included in the set of most probable modes for block C (8). Intra- prediction unit 74 may also determine an actual mode to use to intra-predict current block C (8).
[0102] When the first intra-prediction mode is the same as the second intra-prediction mode, and when the first and second intra-prediction modes comprise a mode other than a planar mode, intra-prediction unit 74 includes the planar mode in the set of most probable intra- prediction modes. In another example, when the first intra-prediction mode is the same as the second intra-prediction mode, and when the first and second intra-prediction modes comprise a planar mode, intra-prediction unit 74 includes the planar mode and a DC mode in the set of most probable intra-prediction modes.
[0103] In another example, when the current block comprises a luminance block, video decoder 30 determines, for a chrominance block corresponding to the luminance block, a mapping of a set of values to a set of intra-prediction modes, the set of intra-prediction modes comprising horizontal mode, vertical mode, planar mode, DC mode, and luma signal prediction mode when the actual intra-prediction mode for the luminance block comprises a mode other than horizontal mode, vertical mode, planar mode, and DC mode, the set of intra- prediction modes further comprises a reuse of luma intra-prediction mode mapped from a first value of the set of values. When the actual intra-prediction mode for the luminance block comprises one of horizontal mode, vertical mode, planar mode, and DC mode, the set of intra-prediction modes further comprises a mode other than horizontal mode, vertical mode, planar mode, and DC mode mapped from the first value of the set of values, video decoder 30 decodes a value representative of an actual intra-prediction mode for the chrominance block based on the mapping of the set of values to the set of modes.
[0104] In another example, intra-prediction unit 74 determines a prediction direction of the actual intra-prediction mode of the current block and includes at least one intra-prediction mode having a prediction direction closest to the prediction direction of the actual intra- prediction mode in the set of most probable intra-prediction modes.
[0105] In yet another example, when the size of the set of most probable intra-prediction modes is equal to three, intra-prediction unit 74 determines a prediction direction of a first intra-prediction mode and compares the prediction direction of the first intra-prediction mode to prediction directions of one or more other available intra-prediction modes. Intra- prediction unit 74 includes the first intra-prediction mode in the set of most probable intra- prediction modes. Further, based on the comparison, intra-prediction unit 74 includes a second and third intra-prediction mode of the one or more available intra-prediction modes in the set of most probable intra-prediction modes, wherein the second and third intra-prediction modes have prediction directions determined to be closest to the prediction direction of the first intra-prediction mode. [0106] FIG. 5 is a diagram illustrating one example of 35 intra-prediction modes and their corresponding prediction directions. As defined in this example, each of 35 index values are uniquely assigned to different intra-prediction modes. In this example, index value 2 is mapped to the DC intra-prediction mode, index value 34 is mapped to the planar intra- prediction mode, and index value 35 is mapped to the from luma intra-prediction mode. The rest of the index values are assigned to the available set of different intra-prediction modes, each having a prediction direction. For example, intra-prediction unit 46 of video encoder 20 may provide one of five values for a syntax element that indicates the actual intra-prediction mode used to encode a luma block. Similarly, intra-prediction unit 46 of video encoder 20 may provide one of six values for a syntax element that indicates the actual intra-prediction mode used to encode a chroma block. The six values may be one of the five values used for the luma block, plus a value indicating an imitation of the intra-prediction mode that was used to code the corresponding luma block.
[0107] For example, the intra-prediction mode mapped to index value 0 has an upward prediction direction with respect to the current block being coded. That is, the pixels used to predict a current block come from above the current block when the mode mapped to index value 0 is selected. For examples where the intra-prediction mode number is 34, the intra- prediction modes having prediction directions closest to the intra-prediction mode mapped to index value 0 are the intra-prediction modes mapped to index values 21 and 22. For examples where the intra-prediction mode number is 17, the intra-prediction modes having prediction directions closest to the intra-prediction mode mapped to index value 0 are the intra-prediction modes mapped to index values 11 and 12, because the index values 21 and 22 are not available for the set of 17 intra-prediction modes.
[0108] In an alternate numbering scheme, intra_planar mode may correspond to mode 0, in which case the mode number of all others modes would be increased by 1. Some of the tables used throughout this disclosure generally correspond to this alternate numbering scheme. It should be clear, however, to one of ordinary skill in the art that the techniques of this disclosure are not limited to one particular numbering scheme.
[0109] FIG. 6 is a diagram illustrating another example of 35 intra-prediction modes and their corresponding prediction directions. As defined in the example of FIG. 6, each of 35 index values are uniquely assigned to different intra-prediction modes. In this example, index value 0 is mapped to the planar intra-prediction mode, index value 1 is mapped to DC intra-prediction mode, and index value 35 is mapped to the from luma intra-prediction mode. The rest of the index values are assigned to the available set of different intra-prediction modes, each having a prediction direction.
[0110] The diagram of FIG. 6 shows IntraPredMode[ xB ][ yB ] labeled 0, 1, 2, .., 35 represents directions of predictions according to Table 3.1. Table 3.1 specifies the value for the intra prediction mode and the associated names. Mode 34, for example, is an intra- angular mode that points to an upper-right direction of the current block to be coded. In some examples, mode 34 is the upper-right direction intra-prediction mode.
Table 3.1 -Specification of intra prediction mode and associated names
[0111] Inputs to an example derivation process for luma intra prediction modes includes a luma location ( xB, yB ) specifying the top-left luma sample of the current block relative to the top-left luma sample of the current picture, a variable log2PUSize specifying the size of the current prediction unit, and variable arrays IntraPredMode (If available) that are previously (in decoding order) derived for adjacent coding units. Output of the example process derivation process for luma intra prediction modes is the variable
IntraPredMode [ xB ][ yB ].
[0112] IntraPredMode[ xB ][ yB ] can be derived as the following ordered steps. First, the neighbouring locations ( xBA, yBA ) and ( xBB, yBB ) are set equal to ( xB-1, yB ) and ( xB, yB-1 ), respectively. Second, the minimum coding block addresses cbAddrA and cbAddrB of the coding treeblocks covering the locations ( xBA, yBA ) and ( xBB, yBB ) respectively where are derived as follows:
cbAddrA
=MinCbAddrZS[ xBA « Log2MinCbSize ][ yBA « Log2MinCbSize ] cbAddrB
=MinCbAddrZS[ xBB « Log2MinCbSize ][ yBB « Log2MinCbSize ]
[0113] Third, an availability process for a minimum coding block address specified is invoked once with the minimum coding block address cbAddrA as the input and the output assigned to availableA and once with the minimum coding block address cbAddrB as the input and the output assigned to availableB.
[0114] Fourth, for N being either replaced A or B, the variables intraPredModeN are derived as follows: If availableN is equal to FALSE, intraPredModeN is set equal to Intra DC.
Otherwise, if the coding unit covering ( xBN, yBN ) is not coded as intra mode,
intraPredModeN is set equal to Intra DC, otherwise, if yB-1 is less than yCtb,
intraPredModeA is set equal to IntraPredMode[ xBA ][ yBA ] and intraPredModeB is set equal to Intra DC. Otherwise, intraPredModeN is set equal to
IntraPredMode[ xBN ][ yBN ], where IntraPredMode is the variable array assigned to the coding unit covering the luma location ( xBN, yBN ).
[0115] Fifth, the candModeList[ x ] with x=0..2 is derived as follows: If
candlntraPredModeB is equal to candlntraPredModeA, the following applies: If
candlntraPredModeA is less than 2 (either Intra Planar or Intra DC), candModeList[ x ] with x=0..2 is derived as:
candModeList[0] = Intra Planar
candModeList[l] = Intra DC
candModeList[2] = Intra Angular (26)
Otherwise, candModeList[ x ] with x=0..2 is derived as:
candModeList[0] = candlntraPredModeA
candModeList[l] = 2 + ( ( candlntraPredModeA - 2 - 1 ) % 32
candModeList[2] = 2 + ( ( candlntraPredModeA - 2 + 1 ) % 32
Otherwise (candlntraPredModeB is not equal to candlntraPredModeA), the following applies: candModeList[0] and candModeList[l] are derived as follows:
candModeList[0] = candlntraPredModeA
candModeList[l] = candlntraPredModeB
If none of candModeList[0] and candModeList[l] is equal to Intra Planar, candModeList[2] is set equal to Intra Planar. Otherwise, if none of candModeList[0] and candModeList[l] is equal to Intra DC, candModeList[2] is set equal to Intra DC. Otherwise, candModeList[2] is set equal to Intra Angular (26).
[0116] Sixth, IntraPredMode[ xB ][ yB ] is derived by applying the following procedure. If prev_intra_pred_flag[ xB ][ yB ] is equal to TRUE, the IntraPredMode [ xB ][ yB ] is set equal to candModeList[ mpm idx ]. Otherwise IntraPredMode [ xB ][ yB ] is derived by applying the following ordered steps: First, array candModeList[x], x=0..2 is modified in the following way: If candModeList[0] is greater than candModeList[l], swap two values; if candModeList[0] is greater than candModeList[2], swap two values; and if candModeList[l] is greater than candModeList[2], swap two values. Second, IntraPredMode[xB][yB] is derived as the following ordered steps: First, IntraPredMode[ xB ][ yB ] =
rem_intra_luma_pred_mode. When IntraPredMode[ xB ][ yB ] is greater than or equal to candModeList[ 0 ], the value of IntraPredMode[ xB ][ yB ] is increased by one. When IntraPredMode[ xB ][ yB ] is greater than or equal to candModeList[ 1 ], the value of IntraPredMode[ xB ][ yB ] is increased by one. When IntraPredMode[ xB ][ yB ] is greater than or equal to candModeList[ 2 ], the value of IntraPredMode[ xB ][ yB ] is increased by one.
[0117] An example derivation process for chroma intra prediction mode is defined as follows. An input to this process is a luma location ( xB, yB ) specifying the top-left luma sample of the current block relative to the top-left luma sample of the current picture. An output of this process is the variable IntraPredModeC. The chroma intra prediction mode IntraPredModeC is derived as specified in Tables 3.2 or 3.3 with intra_chroma_pred_mode, IntraPredMode[ xB ][ yB ] and chroma_pred_from_luma_enabled_flag as inputs.
Table 3.2 - Specification of IntraPredModeC according to the values of intra chroma pred mode and IntraPredMode[ xB ] [ yB ] when chroma pred from luma enabled flag is equal to 1
Table 3.3 - Specification of IntraPredModeC according to the values of
intra chroma pred mode and IntraPredMode[ xB ] [ yB ] when chroma pred from luma enabled flag is equal to 0
[0118] Further details regarding coding processes for coding units coded in intra-prediction mode can be found at High efficiency video coding (HEVC) text specification draft 6, JCT- VC of ITU-T SG16 WP3 and ISO/IEC JTC1/SC29/WG11, 7th Meeting, Geneva, 21-30 November, 2011, the entire contents of which are incorporated by reference. Further details regarding coding processes for coding units coded in intra-prediction mode in accordance with HEVC can be found in HEVC text specification draft 7, document HCTVC-I1003, Brass et al., "High Efficiency Video Coding (HEVC) Text Specification Draft 7," Joint Collaborative Team on Video Coding (JCT-VC) of ITU-T SGI 6 WP3 and ISO/IEC
JTC1/SC29/WG11, 9th Meeting: Geneva, Switzerland, April 27, 2012 to May 7, 2012, which, as of June 6, 2012, is downloadable from http://phenix.it- sudparis .eu/j ct/ doc_end_user/ documents/9_Geneva/wg 11 /JCT VC-11003 -v3.zip .
[0119] FIG. 7 is a flowchart illustrating one example of a method 100 for intra-prediction mode signaling for video encoding. Method 100 may be performed by any one of system 10 of FIG. 1, video encoder 20 of FIG. 3, video decoder 30 of FIG. 4, or any other suitable device.
[0120] Method 100 includes determining, for a block of video data, a set of most probable intra-prediction modes such that the set of most probable intra-prediction modes has a size that is equal to a predetermined number that is greater than or equal to two (102). Method 100 may also include coding a value representative of an actual intra-prediction mode for the block based at least in part on the set of most probable intra-prediction modes (104). Further, method 100 includes coding the block using the actual intra-prediction mode (106).
[0121] Method 100 may include setting NumMPMC to a fixed number for a frame or picture, which is greater or equal to 2. For example, if NumMPMC = 3, three candidate modes are selected under all circumstances for a given picture. Regarding a block in the picture, if both candlntraPredModeN are the same, the prediction direction for the candlntraPredModeN is determined. Of the available prediction modes for the block, the two prediction modes that have the closest prediction directions as the prediction direction of candlntraPredModeN are assigned to be the additional two candidate modes, bringing the total of most probable modes to the set fixed three modes. If the values for candlntraPredModeN are different, the additional candidate mode may be chosen to be DC, vertical, or horizontal modes.
[0122] In another example where NumMPMC = 3, three candidate modes are selected under all circumstances for a given picture, wherein the set of three most probable intra-prediction modes includes DC mode, vertical mode, and planar mode.
[0123] FIG. 8 is a flowchart illustrating one example of a method 200 for determining most probable intra-prediction mode candidates when a set of most probable intra-prediction modes is equal to three. Method 200 may be performed by a video encoder, such as video encoder 20 of FIGS. 2 and 3. In other examples, method 200 may be performed by a video decoder, such as video decoder 30 of FIGS. 2 and 4.
[0124] The details of an example derivation of method 200 is as follows. First, NumMPMC is set equal to three most probable modes (202). In some examples, video encoder 20 or video decoder 30 set NumMPMC equal to three for a current block. In other examples, video encoder 20 or video decoder 30 determine NumMPMC from a previously coded block with respect to the current block, wherein the previously coded block is from the same frame as the current block.
[0125] Video encoder 20 or video decoder 30 determines whether both candlntraPredModeN are available in a set of available intra-prediction modes (204). The set of available intra- prediction modes may be based on intraPredModeNum, and may be, for example, equal to 17 or 34. If both candlntraPredModeN are not available, then the value 2 is assigned to candModeList[ 0 ], the value 0 is assigned to candModeList[ 1], and the value 1 is assigned to candModeList[ 2 ] (206). For example, if both candlntraPredModeN are not available candModeList[ 0 ] is assigned to DC mode, candModeList[ 1] is assigned to Planar mode, and candModeList[ 2 ] is assigned to vertical mode. For example, if both
candlntraPredModeN are not available, then candModeList may be chosen to be DC, vertical, or horizontal. Otherwise, if both candlntraPredModeN are available, video encoder 20 or video decoder 30 determines whether both candlntraPredModeN have the same value, that is, point to the same intra-prediction mode (208).
[0126] If both candlntraPredModeN are the same, then this candlntraPredModeN is assigned to candModeList[ 0 ] (210). CandModeList[ 1 ] and candModeList[ 2 ] are then derived, by intra-prediction unit 46 or 74, respectively, by applying the following procedure:
preModeMinusl_M[candModeList[ 0 ]] is assigned to candModeList[ 1] and
PreModePlusl_M[candModeList[ 0 ]] is assigned to candModeList[ 2], where M represents intraPredModeNum (212). Tables 3.3, 4.3, and 5.3, provided below, can be used in determining these values. For example, using FIG. 5, if intraPredModeNum is equal to 34, and candModeList[ 0 ] = 0 (meaning that candlntraPredModeN = 0), then candModeList[ 1] = preModeMinusl_M[candModeList[ 0 ]] = 21 and candModeList[ 2] =
PreModePlusl_M[candModeList[ 0 ]] = 22.
[0127] Turning back to FIG. 8, if both candlntraPredModeN are the same (208), then both candlntraPredModeN are assigned to the candidate modes list (214). For example, the smaller of the two candidates is assigned to candModeList[ 0 ] and the larger candidate is assigned to candModeList[ 1 ].
[0128] The remaining third candidate to be included in the set of most probable modes, CandModeList[ 2 ], is derived by applying the following procedure: Video encoder 20 or video decoder 30 determines whether either candlntraPredModeN is equal to the value 2 (216). If neither candlntraPredModeN is equal to the value 2, then the value 2 is assigned to candModeList[ 2 ] (218). This ensures that the value 2 is not repeated in the candidate mode list. If at least one of the candlntraPredModeN is equal to the value 2, then video encoder 20 or video decoder 30 determines whether either candlntraPredModeN is equal to the value 0 (220). If neither candlntraPredModeN is equal to the value 0, then the value 0 is assigned to candModeList[ 2 ] (222). Otherwise, the value 1 is assigned to candModeList[ 2 ] (224). [0129] Table 4 provides an example candidate mode mapping with the variable intraPredModeNum is set to three. In one example, a video encoder, such as video encoder 20 of FIGS. 2 and 3, is configured with data corresponding to Table 4.3. Likewise, a video decoder, such as video decoder 30 of FIGS. 2 and 4, is configured with data corresponding to Table 4.3. Table 4.3 provides a mapping between a candidate (or actual) intra-prediction mode and the two closest intra-prediction modes to the intra-prediction mode when intraPredModeNum equals three. In some examples, the closest intra-prediction modes to the intra-prediction mode may be the closest in terms of prediction direction. The video coder may use the candidate mode mapping of Table 4.3 to determine which intra-prediction modes are included in a most probable modes candidate list for a current block when
intraPredModeNum is equal to three.
Table 4.3 - Candidate mode mapping when intraPredModeNum is equal to 3
[0130] Table 5.3 provides an example candidate mode mapping with the variable
intraPredModeNum is set to seventeen. In one example, a video encoder, such as video encoder 20 of FIGS. 2 and 3, is configured with data corresponding to Table 5.3. Likewise, a video decoder, such as video decoder 30 of FIGS. 2 and 4, is configured with data corresponding to Table 5.3. Table 5.3 provides a mapping between a candidate (or actual) intra-prediction mode and the two closest intra-prediction modes to the intra-prediction mode when intraPredModeNum equals seventeen. In some examples, the closest intra-prediction modes to the intra-prediction mode may be the closest in terms of prediction direction. The video coder may use the candidate mode mapping of Table 5.3 to determine which intra- prediction modes are included in a most probable modes candidate list for a current block when intraPredModeNum is equal to seventeen.
Table 5.3 - Candidate mode mapping when intraPredModeNum is equal to 17 candModeList[ 0 ] 0 1 2 3 4 5 6 7 8 9 10 11
PreModeMinusl 17 11 16 0 14 10 12 13 15 9 6 3 4
PreModePlusl 17 12 15 1 10 11 13 9 14 16 8 4 0 candModeList[ 0 ] 12 13 14 15 16
PreModeMinusl 17 0 5 7 1 8
PreModePlusl 17 5 6 3 7 1
[0131] Table 6.3 provides an example candidate mode mapping with the variable
intraPredModeNum is set to thirty-four. In one example, a video encoder, such as video encoder 20 of FIGS. 2 and 3, is configured with data corresponding to Table 6.3. Likewise, a video decoder, such as video decoder 30 of FIGS. 2 and 4, is configured with data corresponding to Table 6.3. Table 6.3 provides a mapping between a candidate (or actual) intra-prediction mode and the two closest intra-prediction modes to the intra-prediction mode when intraPredModeNum equals thirty-four. In some examples, the closest intra-prediction modes to the intra-prediction mode may be the closest in terms of prediction direction. The video coder may use the candidate mode mapping of Table 6.3 to determine which intra- prediction modes are included in a most probable modes candidate list for a current block when intraPredModeNum is equal to thirty-four.
Table 6.3 - Candidate mode mapping when intraPredModeNum is equal to 34
[0132] In some examples, where the NumMPMC is greater than or equal to two, one of the most probable candidate modes is the planar mode. For example, if NumMPMC is equal to four, three candidate modes may be determined as described above, while a fourth mode is set to planar mode. If one of the three candidate modes is already equal to planar mode, the fourth mode may be set equal to DC mode.
[0133] Another parameter, remaining intra-prediction mode, rem_intra_pred_mode, may also be defined. According to techniques of the present disclosure, rem_intra_pred_mode may have multiple contexts. The most probable mode can be used to predict the remaining intra- prediction mode. Each bin is coded with a context to better represent the statistic, resulting in improved most probable mode selection. [0134] According to other techniques, codeword grouping may be provided. For example, all codewords for the intra-prediction modes may be divided into multiple groups. A fixed or variable length binarization may be used to signal the index of the group. Then, a fixed or variable length binarization may be used to signal the codeword index inside the group.
[0135] For example, three groups of codes are formed for intraPredModeNum is equal to 17 or 34. All groups but one have 2N bin strings, as shown in Table 7. In one example, a video encoder, such as video encoder 20 of FIGS. 2 and 3, is configured with data corresponding to Table 7. Likewise, a video decoder, such as video decoder 30 of FIGS. 2 and 4, is configured with data corresponding to Table 7.
Table 7 - Number of bins for intraModeTable[rem_intra_luma_pred_mode]
[0136] One exception to Table 7 is when the mapped rem_intra_luma_pred_mode is greater than 23 and the binarization is shown in Table 8. A unary binarization is used to indicate the group index of mapped rem_intra_luma_pred_mode. In one example, a video encoder, such as video encoder 20 of FIGS. 2 and 3, is configured with data corresponding to Table 8. Likewise, a video decoder, such as video decoder 30 of FIGS. 2 and 4, is configured with data corresponding to Table 8.
Table 8 - Binarization table when intraModeTable[rem_intra_luma_pred_mode] > 24
Value of
Bin string
intraModeTable[rem intra luma pred mode]
24 00
25 010
26 011
28 100
29 101
30 110
31 111 [0137] A codeword index is derived from an intra-prediction mode, regardless of whether the video coder is using VLC or CABAC. The codeword index may map to a binarized value, such as is shown in Table 8. A binarized value is a sequence of bits, which may be referred to as bins. Each bin may be coded sequentially. Thus, two tables are provided such that for each different scenario, the codewords are already provided in a table and do not have to be determined for each scenario. A single binarization table is provided regardless of which most probable intra-prediction modes are included in the candidate list.
[0138] Techniques described herein also provide fixed codeword and code table size for a chroma prediction mode under different luma prediction modes. Because of the inheritance mode, the existing approach removes any redundant codewords from the code tables. A fixed size code table can be beneficial for the parsing process because the decoding of the luma mode no longer needs to be done beforehand.
[0139] Two different approaches can be done to achieve a fixed size code table. First, one of the intra-prediction modes is disabled when there is not a redundant codeword, so a redundant codeword is created artificially. Second, a different mode is enabled to replace the redundant mode in order to eliminate the redundant codeword. Furthermore, a mapping of the codeword and the intra-prediction mode could be different for different luma prediction modes.
[0140] In another example, the mapping of the planar mode may be changed from the previous HEVC. For example, the planar mode may be mapped to index value 0.
Subsequently, the index value associated with all the other intra-prediction modes may be shifted up by 1. This change will increase the probability of getting a smaller
rem_intra_luma_pred_mode, since the planar mode is chosen more frequently.
[0141] Techniques of the disclosure fix the number of available chroma intra-prediction modes. The variable Intra Pred ModeC is a chroma intra-prediction mode. For example, six available chroma intra-prediction modes (IntraPredModeC) can be signaled. Two modes, luma signal prediction and reuse of the luma intra-prediction mode, remain unchanged. For the other four modes, two mode choices are added, which include the adjacent intra- prediction modes and the perpendicular adjacent intra-prediction modes. Table 9 provides an example index mapping for the adjacent intra-prediction modes. Table 9 provides an example index mapping for the perpendicular adjacent intra-prediction modes. Table 9 - Perpendicular mode mapping when intraPredModeNum is equal to 18
Table 9 - Perpendicular mode mapping when intraPredModeNum is equal to 35
[0142] The other four modes are derived as follow: If intra_pred_mode is equal to 2, 0 is assigned to intra_chroma_pred_mode[ 0 ], 1 is assigned to intra_chroma_pred_mode[ 1 ], 6 is assigned to intra_chroma_pred_mode[ 2 ], and 35 is assigned to intra_chroma_pred_mode[ 3 ]. If intra_pred_mode is equal to 35, for example, 0 is assigned to intra_chroma_pred_mode[ 0 ], 1 is assigned to intra_chroma_pred_mode[ 1 ], 2 is assigned to intra_chroma_pred_mode[ 2 ], and 6 is assigned to intra_chroma_pred_mode[ 3 ].
[0143] If, for example, intraPredModeNum is equal to 18 or 35, intra_chroma_pred_mode [ 0 ], intra_chroma_pred_mode [ 1 ], and intra_chroma_pred_mode [ 2 ] are derived by applying the following procedure, using some of the tables, such as Tables 8 and 9.
PredModeMinusl_M[intra_pred_mode] is assigned to intra_chroma_pred_mode[0],
PredModePlusl_M[intra_pred_mode] is assigned to intra_chroma_pred_mode[l],
PredMode_P_M[intra_pred_mode] is assigned to intra_chroma_pred_mode[2], and 35 is assigned to intra_chroma_pred_mode[3], where M represents intraPredModeNum.
Otherwise, 0 is assigned to intra_chroma_pred_mode[0], 1 is assigned to
intra_chroma_pred_mode[l], 2 is assigned to intra_chroma_pred_mode[2], and 35 is assigned to intra_chroma_pred_mode[3].
[0144] In another example where the number of available chroma intra-prediction modes is fixed, any redundant intra_pred_mode in the list of candidate intra-prediction modes may be replaced with a predefined intra-prediction mode.
[0145] In another example, NumMPMC may be set to four. That is, four candidate modes are selected under all circumstances for a given video frame (i.e., NumMPMC = 4). If both candlntraPredModeN are the same, the two available prediction modes that are closest to candlntraPredModeN in the prediction direction are assigned to be two additional two candidate modes. If candlntraPredModeN are different, the additional candidate mode may be chosen to be the DC, the vertical, or the horizontal mode.
[0146] An example derivation for the candidate mode lists are as follows for when
NumMPMC = 4: If both candlntraPredModeN are not available, then the value 3 is assigned to candModeList[ 0 ], the value 0 is assigned to candModeList[ 1], the value 1 is assigned to candModeList[ 2], and the value 2 is assigned to candModeList[ 3 ]. Otherwise, if both candlntraPredModeN are the same, then this candlntraPredModeN is assigned to
candModeList[ 0 ]. CandModeList[ 1 ] and candModeList[ 2 ] are derived by applying the following procedure, using Tables 3.4, 4.4, and 5.4.
[0147] As can be seen in Tables 3.4, 4.4, and 5.4, If candModeList[ 0] is not equal to, the value 0 is assigned to candModeList[ 1]. Otherwise, the value 2 is assigned to
candModeList[ 1]. PreModeMinusl_M[candModeList[ 0 ]] is assigned to candModeList[ 2] and PreModePlusl_M[candModeList[ 0 ]] is assigned to candModeList[ 3], where M represents intraPredModeNum.
[0148] Otherwise, both candlntraPredModeN are assigned to the candidate modes list with the smaller of the two candidates at candModeList[ 0 ] and the larger at candModeList[ 1 ]. The variables candModeList[ 2 ], candModeList[ 3], and candModeList[ 4] are derived by applying the following procedure: If candIntraPredMode[ 0 ] = 0, then candModeList[ 2 ] = PreModeMinusl_M[candModeList[ 1 ]] and candModeList[ 3] =
PreModePlusl_M[candModeList[ 1 ]]. Otherwise, if candlntraPredModel =0, then candModeList[ 2 ] = PreModeMinusl_M[candModeList[ 0 ]] and candModeList[ 3] = PreModePlusl_M[candModeList[ 0 ]]. Otherwise, candModeList[ 2 ] = 0, and the variables candModeList[ 3] and candModeList[ 4] are picked first two available members from the following set:
/-PreModeMinusl_M[candIntraPredModeO] A
PreModeMinusl_M[candIntraPredModel],
< PreModePlusl_M[candIntraPredModeO],
PreModePlusl_M[candIntraPredModel],
3 J
A mode may be defined as available when the mode has not previously existed in the candModeList.
[0149] Tables 3.4, 4.4, and 5.4 are provided below, and are analogous to Tables 3.3, 4.3, and 5.3, provided above. Tables 3.3, 4.3, and 5.3 apply to examples where intraPredModeNum is equal to 3. In contrast, Tables 3.4, 4.4, and 5.4 apply to examples where intraPredModeNum is equal to 4. Specifically, Table 4.4 provides an example candidate mode mapping when intraPredModeNum is equal to 4.
Table 4.4 Candidate mode mapping when intraPredModeNum is equal to 4
[0150] Table 5.4 provides an example candidate mode mapping when intraPredModeNum is equal to 18.
Table 5.4 Candidate mode mapping when intraPredModeNum is equal to 18
[0151] Table 6.4 provides an example candidate mode mapping when intraPredModeNum is equal to 35.
Table 6.4 Candidate mode mapping when intraPredModeNum is equal to 35
Last MP 16 3 27 19 22 23 22 23 3 3 19 27 30 31 30 31 3 3
M 35
[0152] According to another example, NumMPMC may be equal to 5. That is, five candidate modes are selected under all circumstances (i.e., NumMPMC = 5), except intraPredModeNum = 4, where NumMPMC = 4. If NumMPMC = 4, the derivation of candModeList[ 4 ] is skipped. In this example of NumMPMC = 5, planar mode is assumed to be set to the value 0. If both candlntraPredModeN are the same, that is, for example, if the intra prediction modes of the left-neighboring and above-neighboring blocks are the same, the two available prediction modes that are closest to candlntraPredModeN in the prediction direction may be assigned to be the additional two candidate modes. If candlntraPredModeN are different, the additional candidate mode may be chosen to be the DC, the vertical, or the horizontal mode.
[0153] The details of an example derivation are as follows: If both candlntraPredModeN are not available, then the value 3 is assigned to candModeList[ 0 ], the value 0 is assigned to candModeList[ 1], the value 1 is assigned to candModeList[ 2], the value 2 is assigned to candModeList[ 3 ], and the value 9 is assigned to candModeList[ 4 ]. For example, candlntraPredModeO may correspond to the left neighboring block (block 6 in FIG. 1) and candlntraPredModel may correspond to the above-neighboring block (block 4 in FIG. 1). Otherwise, if both candlntraPredModeN are available and are the same, then the value of the same candlntraPredModeN is assigned to candModeList[ 0 ].
[0154] The values for candModeList[ 1 ] and candModeList[ 2 ] are derived by applying the following procedure, using Tables 2.4, 3.4, and 4.4. If candModeList[ 0] is not equal to 0 or 2, the value 0 is assigned to candModeList[ 1]. Otherwise, the value 2 is assigned to candModeList[ 1]. PreModeMinusl_M[candModeList[ 0 ]] is assigned to candModeList[ 2], PreModePlusl_M[candModeList[ 0 ]] is assigned to candModeList[ 3], and
Last_MPM[candModeList[ 0 ]] is assigned to candModeList[ 4], where M represents intraPredModeNum.
[0155] Otherwise, both candlntraPredModeN are assigned to the candidate modes list with the smaller of the two candidates at candModeList[ 0 ] and the larger at candModeList[ 1 ]. The variables candModeList[ 2 ], candModeList[ 3] and candModeList[ 4] are derived by applying the following procedure. If candlntraPredModeO = 0, then candModeList[ 2 ] = PreModeMinusl_M[candModeList[ 1 ]], candModeList[ 3] =
PreModePlusl_M[candModeList[ 1 ]], and candModeList[ 4] = LastMPM_M[candModeList[ 1 ]]. Otherwise, if candlntraPredModel =0, then candModeList[ 2 ] = PreModeMinusl_M[candModeList[ 0 ]], candModeList[ 3] =
PreModePlusl_M[candModeList[ 0 ]], and candModeList[ 4] =
LastMPM_M[candModeList[ 0 ]]. Otherwise, candModeList[ 2 ] = 0, and candModeList[ 3] and candModeList[ 4] are picked from the first two available members from the following set:
-PreModeMinusl_M[candIntraPredModeO]A
PreModeMinusl_M[candIntraPredModel],
PreModePlusl_M[candIntraPredModeO],
< PreModePlusl_M[candIntraPredModel], ►
3,
Last_MPM_M [candlntraPredModeO], and
Last_MPM _M [candlntraPredModel]
A mode may be defined as available when the mode has not previously existed in the candModeList.
[0156] Regarding chroma intra-prediction mode signaling, the current HEVC allows 6 modes, planar, vertical, horizontal, DC, Luma signal based chroma prediction, and inheritance of Luma prediction mode. An index assignment for these modes may be as follows: planar(O), vertical(l), horizontal(2), DC(3), and Luma signal based chroma prediction(35). However, in other examples, other index assignments are used. Among all, the inheritance of Luma prediction mode means the chroma prediction direction is the same as luma prediction direction.
[0157] For example, 0 is assigned to intra_chroma_pred_mode[0], 1 is assigned to intra_chroma_pred_mode[l], 2 is assigned to intra_chroma_pred_mode[2], and 3 is assigned to intra_chroma_pred_mode[3]. If intra_pred_mode is equal to 0, 1, 2, or 3 (that is, planar, vertical, horizontal, or DC mode), 7 is assigned to
intra_chroma_pred_mode[intra_pred_mode]. FIG. 6 illustrates another example having a different mapping of index values to intra-prediction modes for luma components. For example, in FIG. 6, if intra_pred_mode is equal to 0, 10, 26, or 1 (planar, vertical, horizontal, or DC mode, respectively), then 34 (upper-right) is assigned to
intra_chroma_pred_mode[intra_pred_mode]. That is, if intra_pred_mode is equal to planar, vertical, horizontal, or DC mode, then intra_chroma_pred_mode[intra_pred_mode] is equal to the upper-right directional mode.
[0158] Last MPM design may be the same for intraPredModeNum = 18 and the first 18 modes when intraPredModeNum = 35 to have the same table size. Also, when intraPredModeNum = 35, the last 17 modes can be symmetrically designed with respect to mode 1, 2, and 4 to further save the table size.
[0159] In another example, the number of available chroma intra-prediction modes may be fixed. For example, six available chroma intra-prediction modes (IntraPredModeC) can be signaled. Two modes, luma signal prediction and reuse of the luma intra-prediction mode, remain unchanged. For the other four modes, two choices are added, which are the adjacent intra-prediction modes (Table 4.4 and Table 5.4) and the perpendicular adjacent intra- prediction modes (Table 8 and Table 9).
[0160] The other four modes are derived as follow. 0 is assigned to
intra_chroma_pred_mode[0], 1 is assigned to intra_chroma_pred_mode[l], 2 is assigned to intra_chroma_pred_mode[2] and 3 is assigned to intra_chroma_pred_mode[3]. If
intra_pred_mode is equal to 0 or 3, 7 is assigned to
intra_chroma_pred_mode[intra_pred_mode] . Otherwise,
PredModeMinusl_M[intra_pred_mode] is assigned to intra_chroma_pred_mode[0],
PredModePlusl_M[intra_pred_mode] is assigned to intra_chroma_pred_mode[l],
PredMode_P_M[intra_pred_mode] is assigned to intra_chroma_pred_mode[2].
Table 9 - Perpendicu ar mode mapping when intraPredModeNum is equal to 35 intraPredMode 0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17
17 16 15 14 13 12
35
intraPred 2 22 23 24 25 26 27 28 29 30 31 32 33 34 Mode 0
PredMod 3 31 30 29 28 27 26 25 24 23 22 21 20 1 e P 35 2 9
[0161] In one or more examples, the functions described may be implemented in hardware, software, firmware, or any combination thereof. If implemented in software, the functions may be stored on or transmitted over as one or more instructions or code on a computer- readable medium and executed by a hardware-based processing unit. Computer-readable media may include computer-readable storage media, which corresponds to a tangible medium such as data storage media, or communication media including any medium that facilitates transfer of a computer program from one place to another, e.g., according to a communication protocol. In this manner, computer-readable media generally may correspond to (1) tangible computer-readable storage media which is non-transitory or (2) a communication medium such as a signal or carrier wave. Data storage media may be any available media that can be accessed by one or more computers or one or more processors to retrieve instructions, code and/or data structures for implementation of the techniques described in this disclosure. A computer program product may include a computer-readable medium.
[0162] By way of example, and not limitation, such computer-readable storage media can comprise RAM, ROM, EEPROM, CD-ROM or other optical disk storage, magnetic disk storage, or other magnetic storage devices, flash memory, or any other medium that can be used to store desired program code in the form of instructions or data structures and that can be accessed by a computer. Also, any connection is properly termed a computer-readable medium. For example, if instructions are transmitted from a website, server, or other remote source using a coaxial cable, fiber optic cable, twisted pair, digital subscriber line (DSL), or wireless technologies such as infrared, radio, and microwave, then the coaxial cable, fiber optic cable, twisted pair, DSL, or wireless technologies such as infrared, radio, and microwave are included in the definition of medium. It should be understood, however, that computer-readable storage media and data storage media do not include connections, carrier waves, signals, or other transitory media, but are instead directed to non-transitory, tangible storage media. Disk and disc, as used herein, includes compact disc (CD), laser disc, optical disc, digital versatile disc (DVD), floppy disk and blu-ray disc where disks usually reproduce data magnetically, while discs reproduce data optically with lasers. Combinations of the above should also be included within the scope of computer-readable media.
[0163] Instructions may be executed by one or more processors, such as one or more digital signal processors (DSPs), general purpose microprocessors, application specific integrated circuits (ASICs), field programmable logic arrays (FPGAs), or other equivalent integrated or discrete logic circuitry. Accordingly, the term "processor," as used herein may refer to any of the foregoing structure or any other structure suitable for implementation of the techniques described herein. In addition, in some aspects, the functionality described herein may be provided within dedicated hardware and/or software modules configured for encoding and decoding, or incorporated in a combined codec. Also, the techniques could be fully implemented in one or more circuits or logic elements.
[0164] The techniques of this disclosure may be implemented in a wide variety of devices or apparatuses, including a wireless handset, an integrated circuit (IC) or a set of ICs (e.g., a chip set). Various components, modules, or units are described in this disclosure to emphasize functional aspects of devices configured to perform the disclosed techniques, but do not necessarily require realization by different hardware units. Rather, as described above, various units may be combined in a codec hardware unit or provided by a collection of interoperative hardware units, including one or more processors as described above, in conjunction with suitable software and/or firmware.
[0165] Various examples have been described. These and other examples are within the scope of the following claims.

Claims (49)

CLAIMS:
1. A method of coding video data, the method comprising:
determining, for a block of video data, a set of most probable intra-prediction modes for predicting the block of video data, wherein the set of most probable intra-prediction modes has a size that is equal to a predetermined number that is greater than or equal to two; coding a value representative of an actual intra-prediction mode for the block based at least in part on the set of most probable intra-prediction modes; and
coding the block using the actual intra-prediction mode.
2. The method of claim 1, wherein determining the set of most probable intra-prediction modes comprises:
determining a first intra-prediction mode for a left-neighboring block of the block; determining a second intra-prediction mode for an above-neighboring block of the block; and
when the first intra-prediction mode is different than the second intra-prediction mode, including both the first intra-prediction mode and the second intra-prediction mode in the set of most probable intra-prediction modes.
3. The method of claim 2, further comprising:
when the first intra-prediction mode is the same as the second intra-prediction mode, and when the first and second intra-prediction modes comprise a mode other than a planar mode, including the first intra-prediction mode and the planar mode in the set of most probable intra-prediction modes.
4. The method of claim 2, further comprising:
when the first intra-prediction mode is the same as the second intra-prediction mode, and when the first and second intra-prediction modes comprise a planar mode, including the planar mode and a DC mode in the set of most probable intra-prediction modes.
5. The method of claim 1, wherein the block comprises a luminance block, the method further comprising:
determining, for a chrominance block corresponding to the luminance block, a mapping of a set of values to a set of intra-prediction modes, the set of intra-prediction modes comprising horizontal mode, vertical mode, planar mode, DC mode, and luma signal prediction mode, wherein when the actual intra-prediction mode for the luminance block comprises a mode other than horizontal mode, vertical mode, planar mode, and DC mode, the set of intra-prediction modes further comprises a reuse of luma intra-prediction mode mapped from a first value of the set of values, and wherein when the actual intra-prediction mode for the luminance block comprises one of horizontal mode, vertical mode, planar mode, and DC mode, the set of intra-prediction modes further comprises a mode other than horizontal mode, vertical mode, planar mode, and DC mode mapped from the first value of the set of values; coding a value representative of an actual intra-prediction mode for the chrominance block based on the mapping of the set of values to the set of modes; and
coding the chrominance block using the actual intra-prediction mode for the chrominance block.
6. The method of claim 1, further comprising:
determining a prediction direction of the actual intra-prediction mode; and
including at least one intra-prediction mode having a prediction direction closest to the prediction direction of the actual intra-prediction mode in the set of most probable intra- prediction modes.
7. The method of claim 1, wherein the size of the set of most probable intra-prediction modes is equal to three.
8. The method of claim 7, further comprising:
determining a prediction direction of a first intra-prediction mode;
comparing the prediction direction of the first intra-prediction mode to prediction directions of one or more other available intra-prediction modes; and
including the first intra-prediction mode, a second intra-prediction mode of the one or more available intra-prediction modes, and a third intra-prediction mode of the one or more available intra-prediction modes in the set of most probable intra-prediction modes, wherein the second and third intra-prediction modes have prediction directions determined to be closest to the prediction direction of the first intra-prediction mode based on the comparison.
9. The method of claim 7, wherein the set of three most probable intra-prediction modes includes DC mode, vertical mode, and planar mode.
10. The method of claim 1, wherein:
the size of the set of most probable intra-prediction modes is equal to four, when two of the most probable intra-prediction modes are the same, the set of four most probable intra-prediction modes comprises two available intra-prediction modes having prediction directions that are closest to a prediction direction of the same most probable intra- prediction mode, otherwise the most probable intra-prediction modes comprise at least one of the DC intra-prediction mode, the vertical intra-prediction mode, or the horizontal intra- prediction mode.
11. The method of claim 1 , further comprising:
selecting the actual intra-prediction mode, and
wherein coding the block further comprises encoding the block based on the actual intra-prediction mode.
12. The method of claim 1, wherein:
coding the block further comprises decoding the block using the actual intra- prediction mode, and
coding the value representative of the actual intra-prediction mode comprises determining the actual intra-prediction mode from the value.
13. The method of claim 1, wherein when the actual intra-prediction mode is the planar, vertical, horizontal, or DC mode, a chroma intra-prediction mode is an upper-right direction intra-prediction mode.
14. A device for coding video data, the device comprising a video coder configured to determine, for a block of video data, a set of most probable intra-prediction modes for predicting the block of video data, wherein the set of most probable intra-prediction modes has a size that is equal to a predetermined number that is greater than or equal to two, code a value representative of an actual intra-prediction mode for the block based at least in part on the set of most probable intra-prediction modes, and code the block using the actual intra- prediction mode.
15. The device of claim 14, wherein determine the set of most probable intra-prediction modes further comprises that the video encoder is configured to determine a first intra- prediction mode for a left-neighboring block of the block, determine a second intra-prediction mode for an above-neighboring block of the block, and when the first intra-prediction mode is different than the second intra-prediction mode, include both the first intra-prediction mode and the second intra-prediction mode in the set of most probable intra-prediction modes.
16. The method of claim 15, wherein the video coder is further configured to, when the first intra-prediction mode is the same as the second intra-prediction mode, and when the first and second intra-prediction modes comprise a mode other than a planar mode, include the first intra-prediction mode and the planar mode in the set of most probable intra-prediction modes.
17. The device of claim 15, wherein the video coder is further configured to, when the first intra-prediction mode is the same as the second intra-prediction mode, and when the first and second intra-prediction modes comprise a planar mode, include the planar mode and a DC mode in the set of most probable intra-prediction modes.
18. The device of claim 14, wherein the block comprises a luminance block, and wherein the video coder is further configured to determine, for a chrominance block corresponding to the luminance block, a mapping of a set of values to a set of intra-prediction modes, the set of intra-prediction modes comprising horizontal mode, vertical mode, planar mode, DC mode, and luma signal prediction mode, wherein when the actual intra-prediction mode for the luminance block comprises a mode other than horizontal mode, vertical mode, planar mode, and DC mode, the set of intra-prediction modes further comprises a reuse of luma intra- prediction mode mapped from a first value of the set of values, and wherein when the actual intra-prediction mode for the luminance block comprises one of horizontal mode, vertical mode, planar mode, and DC mode, the set of intra-prediction modes further comprises a mode other than horizontal mode, vertical mode, planar mode, and DC mode mapped from the first value of the set of values, code a value representative of an actual intra-prediction mode for the chrominance block based on the mapping of the set of values to the set of modes, and code the chrominance block using the actual intra-prediction mode for the chrominance block.
19. The device of claim 14, wherein the video coder is further configured to determine a prediction direction of the actual intra-prediction mode, and include at least one intra- prediction mode having a prediction direction closest to the prediction direction of the actual intra-prediction mode in the set of most probable intra-prediction modes.
20. The device of claim 14, wherein the size of the set of most probable intra-prediction modes is equal to three.
21. The device of claim 20, wherein the video coder is further configured to determine a prediction direction of a first intra-prediction mode, compare the prediction direction of the first intra-prediction mode to prediction directions of one or more other available intra- prediction modes, and include the first intra-prediction mode, a second intra-prediction mode of the one or more available intra-prediction modes, and a third intra-prediction mode of the one or more available intra-prediction modes in the set of most probable intra-prediction modes, wherein the second and third intra-prediction modes have prediction directions determined to be closest to the prediction direction of the first intra-prediction mode based on the comparison.
22. The device of claim 20, wherein the set of three most probable intra-prediction modes includes DC mode, vertical mode, and planar mode.
23. The device of claim 21 , wherein:
the size of the set of most probable intra-prediction modes is equal to four, when two of the most probable intra-prediction modes are the same, the set of four most probable intra-prediction modes comprises two available intra-prediction modes having prediction directions that are closest to a prediction direction of the same most probable intra- prediction mode, otherwise the most probable intra-prediction modes comprise at least one of the DC intra-prediction mode, the vertical intra-prediction mode, or the horizontal intra- prediction mode.
24. The device of claim 14, wherein when the actual intra-prediction mode is the planar, vertical, horizontal, or DC mode, a chroma intra-prediction mode is an upper-right direction intra-prediction mode.
25. The device of claim 14, wherein the video coder comprises a video encoder.
26. The device of claim 14, wherein the video coder comprises a video decoder.
27. A computer program product comprising a computer-readable storage medium having stored thereon instructions that, when executed, cause a processor of a video coding device to:
determine, for a block of video data, a set of most probable intra-prediction modes for predicting the block of video data, wherein the set of most probable intra-prediction modes has a size that is equal to a predetermined number that is greater than or equal to two;
code a value representative of an actual intra-prediction mode for the block based at least in part on the set of most probable intra-prediction modes; and
code the block using the actual intra-prediction mode.
28. The computer program product of claim 25, wherein the instructions further comprise: determine a first intra-prediction mode for a left-neighboring block of the block;
determine a second intra-prediction mode for an above-neighboring block of the block; and
when the first intra-prediction mode is different than the second intra-prediction mode, include both the first intra-prediction mode and the second intra-prediction mode in the set of most probable intra-prediction modes.
29. The computer program product of claim 28, wherein the instructions further comprise: when the first intra-prediction mode is the same as the second intra-prediction mode, and the first and second intra-prediction modes comprise a mode other than a planar mode, include the first intra-prediction mode and the planar mode in the set of most probable intra- prediction modes.
30. The computer program product of claim 28, wherein the instructions further comprise: when the first intra-prediction mode is the same as the second intra-prediction mode, and when the first and second intra-prediction modes comprise a planar mode, include the planar mode and a DC mode in the set of most probable intra-prediction modes.
31. The computer program product of claim 27, wherein the block comprises a luminance block, wherein the instructions further comprise:
determine, for a chrominance block corresponding to the luminance block, a mapping of a set of values to a set of intra-prediction modes, the set of intra-prediction modes comprising horizontal mode, vertical mode, planar mode, DC mode, and luma signal prediction mode, wherein when the actual intra-prediction mode for the luminance block comprises a mode other than horizontal mode, vertical mode, planar mode, and DC mode, the set of intra-prediction modes further comprises a reuse of luma intra-prediction mode mapped from a first value of the set of values, and wherein when the actual intra-prediction mode for the luminance block comprises one of horizontal mode, vertical mode, planar mode, and DC mode, the set of intra-prediction modes further comprises a mode other than horizontal mode, vertical mode, planar mode, and DC mode mapped from the first value of the set of values; code a value representative of an actual intra-prediction mode for the chrominance block based on the mapping of the set of values to the set of modes; and
code the chrominance block using the actual intra-prediction mode for the
chrominance block.
32. The computer program product of claim 27, wherein the instructions further comprise: determine a prediction direction of the actual intra-prediction mode; and
include at least one intra-prediction mode having a prediction direction closest to the prediction direction of the actual intra-prediction mode in the set of most probable intra- prediction modes.
33. The computer program product of claim 27, wherein the size of the set of most probable intra-prediction modes is equal to three.
34. The computer program product of claim 33, wherein the instructions further comprise:
determine a prediction direction of a first intra-prediction mode;
compare the prediction direction of the first intra-prediction mode to prediction directions of one or more other available intra-prediction modes;
include the first intra-prediction mode, a second intra-prediction mode of the one or more available intra-prediction modes, and a third intra-prediction mode of the one or more available intra-prediction modes in the set of most probable intra-prediction modes, wherein the second and third intra-prediction modes have prediction directions determined to be closest to the prediction direction of the first intra-prediction mode based on the comparison.
35. The computer program product of claim 33, wherein the set of three most probable intra-prediction modes includes DC mode, vertical mode, and planar mode.
36. The computer program product of claim 27, wherein:
the size of the set of most probable intra-prediction modes is equal to four, and when two of the most probable intra-prediction modes are the same, the set of four most probable intra-prediction modes comprises two available intra-prediction modes having prediction directions that are closest to a prediction direction of the same most probable intra- prediction mode, otherwise the most probable intra-prediction modes comprise at least one of the DC intra-prediction mode, the vertical intra-prediction mode, or the horizontal intra- prediction mode.
37. The computer program product of claim 27, wherein the instructions that cause the processor to code the block comprise instructions that cause the processor to encode the block, further comprising instructions that cause the processor to select the actual intra- prediction mode.
38. The computer program product of claim 27, wherein the instructions that cause the processor to code the block comprise instructions that cause the processor to decode the block, wherein the instructions that cause the processor to code the value representative of the actual intra-prediction mode comprise instructions that cause the processor to determine the actual intra-prediction mode.
39. A device for video coding, comprising:
means for determining, for a block of video data a set of most probable intra- prediction modes for predicting the block of video data, wherein the set of most probable intra-prediction modes has a size that is equal to a predetermined number that is greater than or equal to two;
means for coding a value representative of an actual intra-prediction mode for the block based at least in part on the set of most probable intra-prediction modes; and
means for coding the block using the actual intra-prediction mode.
40. The device of claim 39, further comprising:
means for determining a first intra-prediction mode for a left-neighboring block of the block;
means for determining a second intra-prediction mode for an above-neighboring block of the block; and
when the first intra-prediction mode is different than the second intra-prediction mode, means for including both the first intra-prediction mode and the second intra- prediction mode in the set of most probable intra-prediction modes.
41. The device of claim 40, further comprising:
when the first intra-prediction mode is the same as the second intra-prediction mode, and when the first and second intra-prediction modes comprise a mode other than a planar mode, means for including the first intra-prediction mode and the planar mode in the set of most probable intra-prediction modes.
42. The device of claim 40, further comprising:
when the first intra-prediction mode is the same as the second intra-prediction mode, and when the first and second intra-prediction modes comprise a planar mode, means for including the planar mode and a DC mode in the set of most probable intra-prediction modes.
43. The device of claim 39, wherein the block comprises a luminance block, the apparatus further comprising:
means for determining, for a chrominance block corresponding to the luminance block, a mapping of a set of values to a set of intra-prediction modes, the set of intra- prediction modes comprising horizontal mode, vertical mode, planar mode, DC mode, and luma signal prediction mode, wherein when the actual intra-prediction mode for the luminance block comprises a mode other than horizontal mode, vertical mode, planar mode, and DC mode, the set of intra-prediction modes further comprises a reuse of luma intra- prediction mode mapped from a first value of the set of values, and wherein when the actual intra-prediction mode for the luminance block comprises one of horizontal mode, vertical mode, planar mode, and DC mode, the set of intra-prediction modes further comprises a mode other than horizontal mode, vertical mode, planar mode, and DC mode mapped from the first value of the set of values;
means for coding a value representative of an actual intra-prediction mode for the chrominance block based on the mapping of the set of values to the set of modes; and
means for coding the chrominance block using the actual intra-prediction mode for the chrominance block.
44. The device of claim 39, further comprising:
means for determining a prediction direction of the actual intra-prediction mode; and including at least one intra-prediction mode having a prediction direction closest to the prediction direction of the actual intra-prediction mode in the set of most probable intra- prediction modes.
45. The device of claim 39, wherein the size of the set of most probable intra-prediction modes is equal to three.
46. The device of claim 45, the device further comprising:
determining a prediction direction of a first intra-prediction mode;
comparing the prediction direction of the first intra-prediction mode to prediction directions of one or more other available intra-prediction modes;
including the first intra-prediction mode, a second intra-prediction mode of the one or more available intra-prediction modes, and a third intra-prediction mode of the one or more available intra-prediction modes in the set of most probable intra-prediction modes, wherein the second and third intra-prediction modes have prediction directions determined to be closest to the prediction direction of the first intra-prediction mode based on the comparison.
47. The device of claim 39, wherein:
the size of the set of most probable intra-prediction modes is equal to four, and when two of the most probable intra-prediction modes are the same, the set of four most probable intra-prediction modes comprises two available intra-prediction modes having prediction directions that are closest to a prediction direction of the same most probable intra- prediction mode, otherwise the most probable intra-prediction modes comprise at least one of the DC intra-prediction mode, the vertical intra-prediction mode, or the horizontal intra- prediction mode.
48. The device of claim 39, wherein the apparatus comprises a video encoder.
49. The device of claim 39, wherein the apparatus comprises a video decoder.
AU2012267737A 2011-06-09 2012-06-08 Enhanced intra-prediction mode signaling for video coding using neighboring mode Active AU2012267737B2 (en)

Applications Claiming Priority (11)

Application Number Priority Date Filing Date Title
US201161495332P 2011-06-09 2011-06-09
US61/495,332 2011-06-09
US201161503712P 2011-07-01 2011-07-01
US61/503,712 2011-07-01
US201161504664P 2011-07-05 2011-07-05
US61/504,664 2011-07-05
US201161533118P 2011-09-09 2011-09-09
US61/533,118 2011-09-09
US13/491,076 2012-06-07
US13/491,076 US9654785B2 (en) 2011-06-09 2012-06-07 Enhanced intra-prediction mode signaling for video coding using neighboring mode
PCT/US2012/041545 WO2012170812A1 (en) 2011-06-09 2012-06-08 Enhanced intra-prediction mode signaling for video coding using neighboring mode

Publications (2)

Publication Number Publication Date
AU2012267737A1 true AU2012267737A1 (en) 2013-12-12
AU2012267737B2 AU2012267737B2 (en) 2015-12-03

Family

ID=47293185

Family Applications (1)

Application Number Title Priority Date Filing Date
AU2012267737A Active AU2012267737B2 (en) 2011-06-09 2012-06-08 Enhanced intra-prediction mode signaling for video coding using neighboring mode

Country Status (21)

Country Link
US (2) US9654785B2 (en)
EP (2) EP2719180B1 (en)
JP (2) JP5805861B2 (en)
KR (2) KR101600720B1 (en)
CN (1) CN103597832B (en)
AU (1) AU2012267737B2 (en)
BR (1) BR112013031197B1 (en)
CA (1) CA2837952C (en)
DK (1) DK2719180T3 (en)
ES (1) ES2657546T3 (en)
HU (1) HUE035456T2 (en)
IL (1) IL229415A (en)
MX (1) MX336905B (en)
PL (1) PL2719180T3 (en)
PT (1) PT2719180T (en)
RU (1) RU2601843C2 (en)
SG (1) SG194971A1 (en)
SI (1) SI2719180T1 (en)
UA (1) UA110649C2 (en)
WO (1) WO2012170812A1 (en)
ZA (1) ZA201400151B (en)

Families Citing this family (121)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8867854B2 (en) * 2008-10-01 2014-10-21 Electronics And Telecommunications Research Institute Image encoder and decoder using undirectional prediction
KR101356448B1 (en) * 2008-10-01 2014-02-06 한국전자통신연구원 Image decoder using unidirectional prediction
EP2452499A1 (en) * 2009-07-06 2012-05-16 Thomson Licensing Methods and apparatus for spatially varying residue coding
US11284072B2 (en) 2010-08-17 2022-03-22 M&K Holdings Inc. Apparatus for decoding an image
US10123010B2 (en) * 2010-08-17 2018-11-06 M&K Holding Inc. Apparatus for encoding an image
AU2011354441B2 (en) * 2011-01-07 2014-07-17 Hfi Innovation Inc. Method and apparatus of improved intra luma prediction mode coding
KR101824241B1 (en) * 2011-01-11 2018-03-14 에스케이 텔레콤주식회사 Intra Additional Information Encoding/Decoding Apparatus and Method
SI3703368T1 (en) 2011-03-06 2023-01-31 Lg Electronics Inc. Intra prediction method for chrominance blocks
US9654785B2 (en) * 2011-06-09 2017-05-16 Qualcomm Incorporated Enhanced intra-prediction mode signaling for video coding using neighboring mode
CA2838214C (en) 2011-06-13 2019-02-12 Panasonic Corporation Image decoding method, image coding method, image decoding apparatus, image coding apparatus, and image coding and decoding apparatus
CN105245892B (en) * 2011-06-17 2017-03-29 Jvc建伍株式会社 Picture decoding apparatus, picture decoding method and reception device, method of reseptance
KR101702025B1 (en) * 2011-06-17 2017-02-02 에이치에프아이 이노베이션 인크. Method and apparatus for coding of intra prediction mode
EP3313076B1 (en) 2011-06-28 2019-04-24 Samsung Electronics Co., Ltd. Method and apparatus for coding video with intra prediction
US9769472B2 (en) * 2011-08-17 2017-09-19 Mediatek Singapore Pte. Ltd. Method and apparatus for Intra prediction using non-square blocks
GB2494468B (en) 2011-09-12 2014-01-15 Canon Kk Method and device for encoding or decoding information representing prediction modes
US9363511B2 (en) * 2011-09-13 2016-06-07 Mediatek Singapore Pte. Ltd. Method and apparatus for Intra mode coding in HEVC
KR101974952B1 (en) * 2011-10-06 2019-05-07 인텔렉추얼디스커버리 주식회사 Methods of coding intra prediction mode using two candidate intra prediction modes and apparatuses using the same
CN107181956B (en) * 2011-10-07 2020-02-21 英迪股份有限公司 Method for decoding video signal
KR20240014614A (en) * 2011-10-18 2024-02-01 엘지전자 주식회사 Method for intra prediction and device therefor
HUE051695T2 (en) * 2011-10-24 2021-03-29 Innotive Ltd Image decoding apparatus
HUE056519T2 (en) * 2011-10-24 2022-02-28 Innotive Ltd Method and apparatus for decoding intra prediction mode
US9961343B2 (en) * 2011-10-24 2018-05-01 Infobridge Pte. Ltd. Method and apparatus for generating reconstructed block
EP3783898A1 (en) * 2011-10-24 2021-02-24 Innotive Ltd Methods for image encoding and decoding using intra prediction
DK3402201T3 (en) * 2011-10-24 2022-10-31 Gensquare Llc PROCEDURE FOR DECODING AN IMAGE
KR20130049526A (en) * 2011-11-04 2013-05-14 오수미 Method for generating reconstructed block
KR20130049523A (en) 2011-11-04 2013-05-14 오수미 Apparatus for generating intra prediction block
US10390016B2 (en) 2011-11-04 2019-08-20 Infobridge Pte. Ltd. Apparatus of encoding an image
KR20130049522A (en) 2011-11-04 2013-05-14 오수미 Method for generating intra prediction block
US9154796B2 (en) 2011-11-04 2015-10-06 Qualcomm Incorporated Intra-mode video coding
KR20130049525A (en) 2011-11-04 2013-05-14 오수미 Method for inverse transform for reconstructing residual block
KR20130049524A (en) * 2011-11-04 2013-05-14 오수미 Method for generating intra prediction block
KR20130058524A (en) 2011-11-25 2013-06-04 오수미 Method for generating chroma intra prediction block
CN108184121A (en) * 2011-12-05 2018-06-19 Lg 电子株式会社 The method and apparatus of intra prediction
AU2012200319B2 (en) 2012-01-19 2015-11-26 Canon Kabushiki Kaisha Method, apparatus and system for encoding and decoding the significance map for residual coefficients of a transform unit
CN103220506B (en) * 2012-01-19 2015-11-25 华为技术有限公司 A kind of decoding method and equipment
US9210438B2 (en) 2012-01-20 2015-12-08 Sony Corporation Logical intra mode naming in HEVC video coding
AU2012200345B2 (en) * 2012-01-20 2014-05-01 Canon Kabushiki Kaisha Method, apparatus and system for encoding and decoding the significance map residual coefficients of a transform unit
HUE050473T2 (en) * 2012-01-20 2020-12-28 Dolby Laboratories Licensing Corp Intra prediction mode mapping method
US9264710B2 (en) * 2012-07-06 2016-02-16 Texas Instruments Incorporated Method and system for video picture intra-prediction estimation
EP2942955A4 (en) * 2013-01-07 2016-07-20 Lg Electronics Inc Video signal processing method and device
US9516306B2 (en) 2013-03-27 2016-12-06 Qualcomm Incorporated Depth coding modes signaling of depth data for 3D-HEVC
US9369708B2 (en) 2013-03-27 2016-06-14 Qualcomm Incorporated Depth coding modes signaling of depth data for 3D-HEVC
MX361490B (en) * 2013-04-07 2018-12-07 Dolby Int Ab Signaling change in output layer sets.
EP2984824A4 (en) * 2013-04-12 2016-11-09 Intel Corp Coding unit size dependent simplified depth coding for 3d video coding
WO2015006169A1 (en) 2013-07-08 2015-01-15 Sony Corporation Improvement for palette coding mode
US20150271491A1 (en) * 2014-03-24 2015-09-24 Ati Technologies Ulc Enhanced intra prediction mode selection for use in video transcoding
US9654806B2 (en) * 2014-03-26 2017-05-16 Qualcomm Incorporated Determining palette size, palette entries and filtering of palette coded blocks in video coding
WO2015192800A1 (en) * 2014-06-20 2015-12-23 Mediatek Inc. Method of palette predictor signaling for video coding
JP5983715B2 (en) * 2014-11-28 2016-09-06 株式会社Jvcケンウッド Image decoding apparatus, image decoding method, and image decoding program
EP3243330B1 (en) * 2015-02-13 2021-10-27 MediaTek Inc. Method for palette syntax coding in video and image compression
US9756401B2 (en) * 2015-04-07 2017-09-05 Sony Corporation Processing and providing an image in which a plurality of symbols are encoded
CN107925759B (en) * 2015-06-05 2022-06-03 杜比实验室特许公司 Method and apparatus for encoding and decoding intra prediction
US11463689B2 (en) 2015-06-18 2022-10-04 Qualcomm Incorporated Intra prediction and intra mode coding
US10142627B2 (en) 2015-06-18 2018-11-27 Qualcomm Incorporated Intra prediction and intra mode coding
US10841593B2 (en) 2015-06-18 2020-11-17 Qualcomm Incorporated Intra prediction and intra mode coding
KR20180075518A (en) * 2015-11-24 2018-07-04 삼성전자주식회사 Video encoding method and apparatus, video decoding method and apparatus
CN108605130B (en) * 2015-11-27 2021-05-11 联发科技股份有限公司 Method and device for entropy coding and decoding of symbols related to blocks
US11259047B2 (en) * 2016-04-06 2022-02-22 Kt Corporation Method and apparatus for processing video signal
US10547854B2 (en) * 2016-05-13 2020-01-28 Qualcomm Incorporated Neighbor based signaling of intra prediction modes
CN116708774A (en) 2016-07-18 2023-09-05 韩国电子通信研究院 Image encoding/decoding method and apparatus, and recording medium storing bit stream
EP3301915A1 (en) * 2016-09-30 2018-04-04 Thomson Licensing Method and apparatus for omnidirectional video coding with adaptive intra most probable modes
US10812796B2 (en) 2016-09-30 2020-10-20 Lg Electronics Inc. Image decoding method and apparatus in image coding system
US10506228B2 (en) 2016-10-04 2019-12-10 Qualcomm Incorporated Variable number of intra modes for video coding
KR102410424B1 (en) * 2016-10-04 2022-06-17 한국전자통신연구원 Method and apparatus for encoding/decoding image and recording medium for storing bitstream
KR20180046876A (en) 2016-10-28 2018-05-09 한국전자통신연구원 Method and apparatus for encoding/decoding image and recording medium for storing bitstream
FI3552393T3 (en) * 2016-12-23 2023-05-19 Huawei Tech Co Ltd An encoding apparatus for signaling an extension directional intra-prediction mode within a set of directional intra-prediction modes
CN110115036B (en) 2016-12-23 2021-09-03 华为技术有限公司 Intra-prediction device for removing directional intra-prediction modes from a set of predetermined directional intra-prediction modes
KR102287594B1 (en) 2016-12-23 2021-08-10 후아웨이 테크놀러지 컴퍼니 리미티드 Intra prediction apparatus for extending a set of predetermined directional intra prediction modes
JP6917719B2 (en) * 2017-01-27 2021-08-11 日本放送協会 Intra Predictor, Image Coding Device, Image Decoding Device and Program
US11496747B2 (en) * 2017-03-22 2022-11-08 Qualcomm Incorporated Intra-prediction mode propagation
WO2018181252A1 (en) * 2017-03-28 2018-10-04 Panasonic Intellectual Property Corporation Of America Encoding apparatus, decoding apparatus, encoding method, and decoding method
EP3399754A1 (en) 2017-05-04 2018-11-07 Thomson Licensing Method and apparatus for most probable mode (mpm) reordering for intra prediction
US10742975B2 (en) * 2017-05-09 2020-08-11 Futurewei Technologies, Inc. Intra-prediction with multiple reference lines
US10630978B2 (en) * 2017-05-12 2020-04-21 Blackberry Limited Methods and devices for intra-coding in video compression
EP3422716A1 (en) * 2017-06-26 2019-01-02 Thomson Licensing Method and apparatus for most probable mode (mpm) sorting and signaling in video encoding and decoding
WO2019001710A1 (en) * 2017-06-29 2019-01-03 Huawei Technologies Co., Ltd. Apparatuses and methods for encoding and decoding a video coding block of a multiview video signal
WO2019026807A1 (en) 2017-08-03 2019-02-07 Sharp Kabushiki Kaisha Systems and methods for partitioning video blocks in an inter prediction slice of video data
US11212553B2 (en) * 2017-11-28 2021-12-28 Electronics And Telecommunications Research Institute Bidirectional intra prediction method and apparatus
EP3732883A4 (en) * 2017-12-29 2021-06-16 FG Innovation Company Limited Device and method for coding video data based on mode list including different mode groups
KR102617359B1 (en) * 2018-05-10 2023-12-21 삼성전자주식회사 Method and apparatus for video encoding, and method and apparatus for video decoding
JP7373509B2 (en) 2018-06-25 2023-11-02 オッポ広東移動通信有限公司 Intraframe prediction method and device
US11277644B2 (en) 2018-07-02 2022-03-15 Qualcomm Incorporated Combining mode dependent intra smoothing (MDIS) with intra interpolation filter switching
US10638161B2 (en) 2018-07-13 2020-04-28 Tencent America LLC Methods and apparatus for most probable mode derivation
WO2020050697A1 (en) * 2018-09-06 2020-03-12 엘지전자 주식회사 Intra-prediction mode-based image processing method and device therefor
US11394965B2 (en) 2018-09-11 2022-07-19 Lg Electronics Inc. Method for processing image on basis of intra prediction mode, and device therefor
KR20240007716A (en) * 2018-09-13 2024-01-16 프라운호퍼 게젤샤프트 쭈르 푀르데룽 데어 안겐반텐 포르슝 에. 베. Affine linear weighted intra predictions
WO2020055290A1 (en) 2018-09-13 2020-03-19 Huawei Technologies Co., Ltd. Method and apparatus for intra prediction
EP3709644A1 (en) * 2019-03-12 2020-09-16 Ateme Method for image processing and apparatus for implementing the same
EP3629579A1 (en) 2018-09-27 2020-04-01 Ateme Method for image processing and apparatus for implementing the same
US11303885B2 (en) 2018-10-25 2022-04-12 Qualcomm Incorporated Wide-angle intra prediction smoothing and interpolation
CN113039791B (en) 2018-11-06 2024-02-23 北京字节跳动网络技术有限公司 Complexity reduction in parameter derivation for intra prediction
US10848763B2 (en) * 2018-11-14 2020-11-24 Tencent America LLC Method and apparatus for improved context design for prediction mode and coded block flag (CBF)
US11652984B2 (en) * 2018-11-16 2023-05-16 Qualcomm Incorporated Position-dependent intra-inter prediction combination in video coding
CN113170122B (en) 2018-12-01 2023-06-27 北京字节跳动网络技术有限公司 Parameter derivation for intra prediction
GB2579824B (en) 2018-12-14 2022-05-18 British Broadcasting Corp Video encoding and video decoding
JP7311263B2 (en) 2018-12-17 2023-07-19 ナブテスコ株式会社 Door lock device, door lock system, and door control device
BR112021011929A2 (en) 2018-12-20 2021-09-08 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. NON-TRANSITORY STORAGE UNIT, DECODER FOR DECODING AND ENCODER FOR ENCODING A FIGURE FROM A CONTINUOUS FLOW OF DATA AND DECODING AND ENCODING METHOD
GB2580326A (en) 2018-12-28 2020-07-22 British Broadcasting Corp Video encoding and video decoding
US11595662B2 (en) * 2019-02-06 2023-02-28 Tencent America LLC Method and apparatus for neighboring block availability in video coding
EP3912358A4 (en) * 2019-02-07 2022-03-30 Huawei Technologies Co., Ltd. Method and apparatus of intra prediction mode signaling
CN115967810A (en) 2019-02-24 2023-04-14 抖音视界有限公司 Method, apparatus and computer readable medium for encoding and decoding video data
JP2022068379A (en) * 2019-03-08 2022-05-10 シャープ株式会社 Image decoding device
GB2582023A (en) * 2019-03-08 2020-09-09 British Broadcasting Corp Method of signalling in a video codec
GB2596394B (en) * 2019-03-08 2022-08-17 British Broadcasting Corp Method of signalling in a video codec
US11405638B2 (en) * 2019-03-17 2022-08-02 Tencent America LLC Method and apparatus for video coding by determining intra prediction direction based on coded information of neighboring blocks
CN113597761A (en) * 2019-03-21 2021-11-02 华为技术有限公司 Intra-frame prediction method and device
EP3888361B1 (en) 2019-03-24 2024-04-24 Huawei Technologies Co., Ltd. Method and apparatus for chroma intra prediction in video coding
CN114128269A (en) * 2019-06-14 2022-03-01 弗劳恩霍夫应用研究促进协会 Coding of intra prediction modes
EP3970365A4 (en) * 2019-06-21 2022-08-10 Huawei Technologies Co., Ltd. Matrix-based intra prediction for still picture and video coding
WO2020256599A1 (en) * 2019-06-21 2020-12-24 Huawei Technologies Co., Ltd. Method and apparatus of quantizing coefficients for matrix-based intra prediction technique
US11330298B2 (en) * 2019-06-25 2022-05-10 Qualcomm Incorporated Simplified intra chroma mode coding in video coding
AU2020322553A1 (en) * 2019-08-01 2022-02-24 Huawei Technologies Co., Ltd. An encoder, a decoder and corresponding methods of chroma intra mode derivation
CA3152728A1 (en) * 2019-10-03 2021-04-08 Han GAO Coding process for geometric partition mode
GB2588406B (en) * 2019-10-22 2022-12-07 British Broadcasting Corp Video encoding and video decoding
CN114830652A (en) * 2019-12-16 2022-07-29 华为技术有限公司 Method and apparatus for reference sample interpolation filtering for directional intra prediction
EP4059220A4 (en) * 2019-12-19 2023-04-19 Huawei Technologies Co., Ltd. Method and apparatus of position dependent prediction combination
WO2021045655A2 (en) * 2019-12-31 2021-03-11 Huawei Technologies Co., Ltd. Method and apparatus for intra prediction
US20220345692A1 (en) * 2021-04-26 2022-10-27 Tencent America LLC Template matching based intra prediction
EP4349016A1 (en) * 2021-06-03 2024-04-10 Innopeak Technology, Inc. Quantization level binarization in video coding
US11917136B2 (en) * 2021-07-15 2024-02-27 Tencent America LLC Intra mode coding
US20230069984A1 (en) * 2021-08-24 2023-03-09 Tencent America LLC Hardware friendly design for intra mode coding

Family Cites Families (76)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8374237B2 (en) 2001-03-02 2013-02-12 Dolby Laboratories Licensing Corporation High precision encoding and decoding of video images
CN1297148C (en) 2001-08-28 2007-01-24 株式会社Ntt都科摩 Moving picture encoding/transmission system, moving picture encoding/transmission method, and encoding apparatus, decoding apparatus, encoding method decoding method and program usable for the same
US6983079B2 (en) 2001-09-20 2006-01-03 Seiko Epson Corporation Reducing blocking and ringing artifacts in low-bit-rate coding
US6980596B2 (en) 2001-11-27 2005-12-27 General Instrument Corporation Macroblock level adaptive frame/field coding for digital video content
KR20030073120A (en) 2002-03-08 2003-09-19 주식회사 엘지이아이 Implementation method for intra prediction mode of movie in embedded system
US7170937B2 (en) 2002-05-01 2007-01-30 Texas Instruments Incorporated Complexity-scalable intra-frame prediction technique
US7386048B2 (en) * 2002-05-28 2008-06-10 Sharp Laboratories Of America, Inc. Methods and systems for image intra-prediction mode organization
EP1553782A3 (en) 2002-05-28 2005-07-27 Sharp Kabushiki Kaisha Methods and systems for image intra-prediction mode estimation, communication, and organization
US7289674B2 (en) * 2002-06-11 2007-10-30 Nokia Corporation Spatial prediction based intra coding
CA2488266C (en) 2002-06-11 2013-08-13 Nokia Corporation Spatial prediction based intra coding
AU2004217221B2 (en) 2003-03-03 2009-09-03 Agency For Science, Technology And Research Fast mode decision algorithm for intra prediction for advanced video coding
US7369707B2 (en) 2003-10-28 2008-05-06 Matsushita Electric Industrial Co., Ltd. Intra-picture prediction coding method
AU2004310915B2 (en) 2003-12-01 2008-05-22 Samsung Electronics Co., Ltd. Method and apparatus for scalable video encoding and decoding
EP1558039A1 (en) * 2004-01-21 2005-07-27 Deutsche Thomson-Brandt Gmbh Method and apparatus for generating/evaluating prediction information in picture signal encoding/decoding
EP1605706A2 (en) 2004-06-09 2005-12-14 Broadcom Corporation Advanced video coding (AVC) intra prediction scheme
KR100627329B1 (en) * 2004-08-19 2006-09-25 전자부품연구원 Apparatus and method for adaptive motion estimation and mode decision in h.264 video codec
JP4501631B2 (en) 2004-10-26 2010-07-14 日本電気株式会社 Image coding apparatus and method, computer program for image coding apparatus, and portable terminal
TWI256258B (en) 2004-12-16 2006-06-01 Ind Tech Res Inst Method to speed up the mode decision of video coding
US20060153299A1 (en) 2005-01-07 2006-07-13 Kabushiki Kaisha Toshiba Coded video sequence conversion apparatus, method and program product for coded video sequence conversion
US7830960B2 (en) * 2005-01-13 2010-11-09 Qualcomm Incorporated Mode selection techniques for intra-prediction video encoding
US7751478B2 (en) 2005-01-21 2010-07-06 Seiko Epson Corporation Prediction intra-mode selection in an encoder
US7706442B2 (en) * 2005-02-15 2010-04-27 Industrial Technology Research Institute Method for coding mode selection of intra prediction in video compression
KR100678911B1 (en) 2005-07-21 2007-02-05 삼성전자주식회사 Method and apparatus for video signal encoding and decoding with extending directional intra prediction
US7840078B2 (en) 2006-07-10 2010-11-23 Sharp Laboratories Of America, Inc. Methods and systems for image processing control based on adjacent block characteristics
US8976870B1 (en) * 2006-08-30 2015-03-10 Geo Semiconductor Inc. Block and mode reordering to facilitate parallel intra prediction and motion vector prediction
FR2908007A1 (en) 2006-10-31 2008-05-02 Thomson Licensing Sas Image sequence i.e. video, encoding method for video compression field, involves pre-selecting intra-encoding modes of macro-block with directions that correspond to gradient activities with minimal value to determine encoding mode
CN101222641B (en) 2007-01-11 2011-08-24 华为技术有限公司 Infra-frame prediction encoding and decoding method and device
FR2916931A1 (en) 2007-05-29 2008-12-05 Thomson Licensing Sas METHOD OF SELECTING ENCODING DATA AND ENCODING DEVICE IMPLEMENTING SAID METHOD
JP4650461B2 (en) 2007-07-13 2011-03-16 ソニー株式会社 Encoding device, encoding method, program, and recording medium
KR100924048B1 (en) 2007-07-30 2009-10-27 한국과학기술원 A fast mode decision method of intra block prediction in video coding
TW200910971A (en) 2007-08-22 2009-03-01 Univ Nat Cheng Kung Direction detection algorithms for H.264 intra prediction
JP2009111691A (en) 2007-10-30 2009-05-21 Hitachi Ltd Image-encoding device and encoding method, and image-decoding device and decoding method
US8467451B2 (en) 2007-11-07 2013-06-18 Industrial Technology Research Institute Methods for selecting a prediction mode
US8670488B2 (en) 2007-12-21 2014-03-11 Telefonaktiebolaget Lm Ericsson (Publ) Adaptive intra mode selection
JP4962400B2 (en) * 2008-04-30 2012-06-27 ソニー株式会社 Arithmetic decoding device
US8761253B2 (en) * 2008-05-28 2014-06-24 Nvidia Corporation Intra prediction mode search scheme
JP2010016454A (en) * 2008-07-01 2010-01-21 Sony Corp Image encoding apparatus and method, image decoding apparatus and method, and program
KR101306834B1 (en) 2008-09-22 2013-09-10 에스케이텔레콤 주식회사 Video Encoding/Decoding Apparatus and Method by Using Prediction Possibility of Intra Prediction Mode
WO2010036772A2 (en) 2008-09-26 2010-04-01 Dolby Laboratories Licensing Corporation Complexity allocation for video and image coding applications
JP5225388B2 (en) 2008-10-22 2013-07-03 日本電信電話株式会社 Scalable video encoding method, scalable video encoding device, scalable video encoding program, and computer-readable recording medium recording the program
WO2010090749A1 (en) 2009-02-06 2010-08-12 Thomson Licensing Methods and apparatus for implicit and semi-implicit intra mode signaling for video encoders and decoders
CN101854540B (en) 2009-04-01 2014-07-02 辉达公司 Intra prediction method and device for employing H.264 video coding standard
JP5169978B2 (en) 2009-04-24 2013-03-27 ソニー株式会社 Image processing apparatus and method
KR101702553B1 (en) 2009-07-04 2017-02-03 에스케이 텔레콤주식회사 Video Coding Method and Apparatus
US20110002386A1 (en) 2009-07-06 2011-01-06 Mediatek Singapore Pte. Ltd. Video encoder and method for performing intra-prediction and video data compression
KR101507344B1 (en) 2009-08-21 2015-03-31 에스케이 텔레콤주식회사 Apparatus and Method for intra prediction mode coding using variable length code, and Recording Medium therefor
KR101735137B1 (en) 2009-09-14 2017-05-12 톰슨 라이센싱 Methods and apparatus for efficient video encoding and decoding of intra prediction mode
KR20110047310A (en) 2009-10-30 2011-05-09 삼성전자주식회사 Video encoding apparatus and method thereof
US8724692B2 (en) * 2010-01-08 2014-05-13 Nokia Corporation Apparatus, a method and a computer program for video coding
EP2536151A4 (en) 2010-02-10 2014-03-19 Lg Electronics Inc Method and apparatus for processing a video signal
CN105472387B (en) 2010-04-09 2018-11-02 Lg电子株式会社 The method and apparatus for handling video data
KR20110113561A (en) * 2010-04-09 2011-10-17 한국전자통신연구원 Method and apparatus for intra prediction encoding and decoding using adaptive filter
MX2012013263A (en) * 2010-05-14 2013-01-24 Thomson Licensing Methods and apparatus for intra coding a block having pixels assigned to groups.
EP2574056A4 (en) * 2010-05-19 2016-03-30 Sk Telecom Co Ltd Image encoding/decoding device and method
US8902978B2 (en) 2010-05-30 2014-12-02 Lg Electronics Inc. Enhanced intra prediction mode signaling
CN101877792B (en) 2010-06-17 2012-08-08 无锡中星微电子有限公司 Intra mode prediction method and device and coder
US8855188B2 (en) * 2010-07-15 2014-10-07 Sharp Laboratories Of America, Inc. Method of parallel video coding based on mapping
CA2806511C (en) 2010-09-30 2018-09-04 Panasonic Corporation Decoding and encoding according to a prediction mode determined from multiple estimated prediction modes
EP4319166A3 (en) 2010-11-25 2024-02-28 LG Electronics Inc. Method offor signaling image information, and method offor decoding image information using same
KR20120070479A (en) 2010-12-21 2012-06-29 한국전자통신연구원 Method and apparatus for encoding and decoding of intra prediction mode information
BR122021004600B1 (en) 2010-12-23 2022-08-16 Samsung Electronics Co., Ltd METHOD OF DECODING AN IMAGE, AND METHOD OF ENCODING AN IMAGE
CN103314588B (en) * 2011-01-07 2016-05-11 联发科技(新加坡)私人有限公司 Coding method and device and coding/decoding method and device
AU2011354441B2 (en) 2011-01-07 2014-07-17 Hfi Innovation Inc. Method and apparatus of improved intra luma prediction mode coding
JP5781313B2 (en) 2011-01-12 2015-09-16 株式会社Nttドコモ Image prediction coding method, image prediction coding device, image prediction coding program, image prediction decoding method, image prediction decoding device, and image prediction decoding program
JP2012147332A (en) 2011-01-13 2012-08-02 Sony Corp Encoding device, encoding method, decoding device, and decoding method
CN102595121A (en) 2011-01-15 2012-07-18 华为技术有限公司 Intra-frame prediction mode binarization method, device and system as well as decoding method
CN102685474B (en) 2011-03-10 2014-11-05 华为技术有限公司 Encoding and decoding method of prediction modes, encoding and decoding device and network system
AU2011201336B2 (en) 2011-03-23 2013-09-05 Canon Kabushiki Kaisha Modulo embedding of video parameters
WO2012134246A2 (en) 2011-04-01 2012-10-04 엘지전자 주식회사 Entropy decoding method, and decoding apparatus using same
PL2882190T3 (en) 2011-04-21 2019-04-30 Hfi Innovation Inc Method and apparatus for improved in-loop filtering
KR101383775B1 (en) 2011-05-20 2014-04-14 주식회사 케이티 Method And Apparatus For Intra Prediction
US10123053B2 (en) * 2011-05-23 2018-11-06 Texas Instruments Incorporated Acceleration of bypass binary symbol processing in video coding
WO2012164902A1 (en) 2011-05-30 2012-12-06 株式会社Jvcケンウッド Image encoding device, image encoding method and image encoding program, as well as image decoding device, image decoding method and image decoding program
US9654785B2 (en) * 2011-06-09 2017-05-16 Qualcomm Incorporated Enhanced intra-prediction mode signaling for video coding using neighboring mode
CN107465916A (en) * 2011-06-28 2017-12-12 寰发股份有限公司 The method and device of coding/decoding intra prediction mode
JP2013058939A (en) 2011-09-08 2013-03-28 Sharp Corp Image decoding device and image encoding device

Similar Documents

Publication Publication Date Title
US10264280B2 (en) Enhanced intra-prediction mode signaling for video coding using neighboring mode
CA2867764C (en) Grouping bypass coded syntax elements in video coding
AU2012267737A1 (en) Enhanced intra-prediction mode signaling for video coding using neighboring mode
CA2840728C (en) Video coding using adaptive motion vector resolution
CA2812307C (en) Intra smoothing filter for video coding
US9699457B2 (en) Most probable transform for intra prediction coding
EP2781094B1 (en) Reference mode selection in intra mode coding
EP2628300A1 (en) Adaptive motion vector resolution signaling for video coding