WO2013109359A1 - Logical intra mode naming in hevc video coding - Google Patents

Logical intra mode naming in hevc video coding Download PDF

Info

Publication number
WO2013109359A1
WO2013109359A1 PCT/US2012/069023 US2012069023W WO2013109359A1 WO 2013109359 A1 WO2013109359 A1 WO 2013109359A1 US 2012069023 W US2012069023 W US 2012069023W WO 2013109359 A1 WO2013109359 A1 WO 2013109359A1
Authority
WO
WIPO (PCT)
Prior art keywords
mode
modes
transform
prediction
intra
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/US2012/069023
Other languages
English (en)
French (fr)
Inventor
Ehsan Maani
Ali Tabatabai
Jun Xu
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Sony Corp
Original Assignee
Sony Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Family has litigation
First worldwide family litigation filed litigation Critical https://patents.darts-ip.com/?family=47630157&utm_source=google_patent&utm_medium=platform_link&utm_campaign=public_patent_search&patent=WO2013109359(A1) "Global patent litigation dataset” by Darts-ip is licensed under a Creative Commons Attribution 4.0 International License.
Application filed by Sony Corp filed Critical Sony Corp
Publication of WO2013109359A1 publication Critical patent/WO2013109359A1/en
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/103Selection of coding mode or of prediction mode
    • H04N19/11Selection of coding mode or of prediction mode among a plurality of spatial predictive coding modes
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/60Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding
    • H04N19/61Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding in combination with predictive coding
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • H04N19/593Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving spatial prediction techniques
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/103Selection of coding mode or of prediction mode
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/12Selection from among a plurality of transforms or standards, e.g. selection between discrete cosine transform [DCT] and sub-band transform or selection between H.263 and H.264
    • H04N19/122Selection of transform size, e.g. 8x8 or 2x4x8 DCT; Selection of sub-band transforms of varying structure or type
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/169Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
    • H04N19/17Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object
    • H04N19/176Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a block, e.g. a macroblock
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/46Embedding additional information in the video signal during the compression process
    • H04N19/463Embedding additional information in the video signal during the compression process by compressing encoding parameters before transmission
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/60Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding
    • H04N19/625Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding using discrete cosine transform [DCT]
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/70Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by syntax aspects related to video coding, e.g. related to compression standards

Definitions

  • This invention pertains generally to video coding, and more
  • HEVC High Efficiency Video Coding
  • HM5.0 High Efficiency Video Coding
  • bit stream mode numbers are more meaningful and are directly used in the prediction module to produce the intra prediction.
  • the logical bit numbers span across vertical directions VER-8, VER-4, VER, VER+4, VER+8, into the horizontal HOR-4, HOR, HOR +4, which are numbered, with up to 34 prediction directions.
  • Bit stream mode numbers are used to signal the mode to the decoder, and in some implementations, such as HM5.0, may require many look-up tables (e.g., Mode Dependent (MD) coefficient scan, intra smoothing, intra prediction and Mode Dependent (MD) transform) in the programming of the video coding device.
  • Bit stream mode numbers were utilized with advanced video coding (AVC) coding and considered to be sorted in their frequency of occurrences. However, statistics collected on High Efficiency Video Coding (HEVC), do not indicate any bias towards any of the angular directions (not including Planar and DC), while bypass coding is utilized for the remaining modes.
  • AVC advanced video coding
  • HEVC High Efficiency Video Coding
  • Logical intra mode naming in High Efficiency Video Coding (HEVC) of the present invention utilizes logical mode names and numbering for all mode uses and thus replaces the use of bit stream mode numbers.
  • the logical modes have meaningful numbering (naming) for intra modes.
  • a coding unit (CU) may have variable block sizes depending on video content, and may be split into smaller blocks for prediction as Prediction Units (PU) or transform as Transform Units (TU).
  • Prediction units (PU) can be thought of similarly to partitions described in other video coding standards, such as the H.264 standard.
  • a prediction block is formed based on previously encoded and reconstructed blocks adjacent to the current block, the prediction block is configured for being subtracted from the current block prior to encoding.
  • prediction modes for these blocks which define a method of generating a signal from previously encoded blocks, for example including prediction types and directions.
  • Encoders and decoders implemented with high efficiency video coding utilize both logical mode numbers and bit stream mode numbers.
  • intra prediction is performed from samples already decoded in adjacent PUs.
  • Different modes can exist for these PUs, including DC (average), up to 33 angular directions and planar mode.
  • the coding decisions can be simplified by utilizing the same set of logical mode numbers for both prediction and coding for communication to a decoder.
  • the simplification is also applicable when the decisions are made using other software mechanisms, such as conditional
  • MPMs Most Probable Modes
  • MPMs are a mechanism for optimizing the coding process. More particularly, probabilities are estimated for optimal intra direction as the most probable mode (MPM) of its neighboring blocks, because current blocks have a strong correlation with patterns found in neighboring blocks.
  • MPMs including the third MPM, are derived using logical numbering without additional look up tables.
  • the method of determining multiple most probable modes (MPMs) is shared by both encoder and decoder. [0013] Logical mode numbers according to the invention are utilized for both performing prediction and coding in the bit stream.
  • logical mode numbers are numbered, named or sorted based on angle according to the invention. For the sake of simplicity of discussion, the following will describe these as being mode numbers, although one of ordinary skill in the art will appreciate that naming and sorting can be similarly utilized.
  • the logical mode numbering is performed with respect to an arbitrary reference, and these are more beneficially meaningful as they result in an improved design with the removal of several otherwise necessary look-up tables. In addition to many simplifications that result from this type of numbering, simulations indicate a small coding efficiency benefit. Furthermore, by using this type of naming, adding an additional MPM is very efficient since no additional tables are required.
  • fast intra mode decision algorithms can be simplified. Since modes provide a clear link (association) between numbers (names) and angular directions it is easier to apply various Fast Mode Decision (FMD) algorithms, such as utilizing a hierarchical approach.
  • FMD Fast Mode Decision
  • the method can facilitate or simplify other algorithms, for example deriving neighboring and perpendicular modes to simplify algorithms, such as three MPM algorithms.
  • utilizing an association between logical intra mode names and angular directions allows simplifying decision logic and look-up tables, or elimination of certain look-up tables altogether.
  • the inventive apparatus and method is applicable to video coding devices implemented according to the HEVC standard and similar video systems which would be enhanced by the intra mode naming taught herein.
  • FIG. 1 is a schematic of a video encoder using logical intra mode naming according to an embodiment of the present invention.
  • FIG. 2 is a schematic of a video decoder using logical intra mode naming according to an embodiment of the present invention.
  • FIG. 3 is a map of logical intra mode naming according to an
  • FIG. 4A and 4B are pseudo code instructions of using logical intra mode naming according to an embodiment of the present invention.
  • FIG. 5 is a flow diagram of an encoding tree for intra mode operation according to an embodiment of the present invention.
  • FIG. 6 is a flow diagram of a decoding tree for intra mode operation according to an embodiment of the present invention.
  • FIG. 7A and 7B is a flow diagram of determining three MPMs
  • the present invention utilizes a form of logical mode numbers, which are enough to describe the directions and which also can be directly coded into the bit stream instead of using bit stream mode numbers.
  • inventive logical mode numbers throughout the coding system provides multiple advantages, including the following.
  • intra smoothing, mode dependent coefficient scan, and mode dependant transform do not require large tables to determine smoothing filters, scan index, or transform type (DCT / DST).
  • Simple mode range checking is utilized according to at least one embodiment for determining the criteria for which different smoothing filters, scans, or transforms can be applied.
  • adjacent directions In considering these inventive embodiments, such as those involving more than two MPMs, directions are utilized which are adjacent to the neighboring intra mode. Coding system implementations according to these embodiments can be greatly simplified since the adjacent directions are computed with simple arithmetic means, such as just by incrementing or decrementing the neighbouring mode number (depending on PU size). The invention also applies in cases having the same numbers of increments and decrements.
  • FIG. 1 illustrates an example embodiment of a coding apparatus comprising an encoder 10 according to the invention for utilizing logical intra mode naming (LIMN).
  • the invention is implemented in both the entropy encoding block 34 and intra prediction block 26, shown containing generalized logical intra mode naming (LIMN), but otherwise can rely on conventional video coding which maximizes compatibility with coding systems. It should be appreciated that other blocks of the encoder may be optimized in response to the inventive teachings.
  • the encoder 10 is shown with encoding elements 12 executed by one or more processors 44.
  • video frame input 14 is shown along with reference frames 16 and frame output 18.
  • Inter-prediction 20 is depicted with motion estimation (ME) 22 and motion compensation (MC) 24.
  • Intra prediction 26 is shown which operates with the logical intra mode naming (LIMN) of the invention and switching is depicted between inter prediction and intra prediction.
  • a sum junction 28 is shown with output to a forward transform 30, operating with Discrete Cosine Transforms (DCT) and / or Discrete Sine Transforms (DST) which are performed based on the predictions to generate transform coefficients of residual data.
  • DCT Discrete Cosine Transforms
  • DST Discrete Sine Transforms
  • Quantization of the transform coefficients is performed at quantization stage 32, which is followed by entropy encoding 34, which also utilizes logical intra mode naming (LIMN).
  • Inverse quantization 36 and inverse transform 38 operations are shown coupled to a summing junction 40 followed by a filter 42, such as a deblocking and / or loop filter and / or sample adaptive offset.
  • the encoder is shown implemented with a processing means 44, such as comprising at least one processing device (e.g., CPU) 46 and at least one memory 48 for executing programming associated with the encoding.
  • a processing means 44 such as comprising at least one processing device (e.g., CPU) 46 and at least one memory 48 for executing programming associated with the encoding.
  • elements of the present invention can be implemented as programming stored on a media, which can be accessed for execution by a CPU for the encoder 10 and / or decoder 50.
  • FIG. 2 illustrates an example embodiment 50 of a decoder, shown with process blocks 52 and an associated processing means 76.
  • the decoder is substantially a subset of the elements contained in encoder 10 of FIG. 1 , operating on reference frames 54, encoded video signal 56 and outputting video 74.
  • Decoder 50 utilizes logical intra mode naming (LIMN) during entropy decoding and intra prediction, although the information can also be utilized in other decoding process steps toward increased efficiency.
  • the decoder blocks receive an encoded video signal 56 which is processed through entropy decoder 58 which utilizes the inventive logical intra mode naming (LIMN).
  • LIMN inventive logical intra mode naming
  • inter prediction also utilizes the logical intra mode naming (LIMN).
  • LIMN logical intra mode naming
  • Output from summing junction 64 is received by filter 72, which can be configured as a loop filter, a deblocking filter, sample adaptive offset, or any combination thereof.
  • the decoder can be implemented with a processing means 76 which comprises at least one processing device 78 and at least one memory 80 for executing programming associated with the decoding.
  • elements of the present invention can be implemented as programming stored on a media, wherein said media can be accessed for execution by processing device (CPU) 78.
  • elements of the present invention 10 and 50 are implemented for execution by a processing means 44 and 76, such as in response to programming resident in memory 48 and 80 which is executable on computer processor (CPU) 46 and 78.
  • elements of the present invention can be implemented as programming stored on a media, wherein said media can be accessed for execution by CPU 46 and 78.
  • the programming is executable from the memory which is a tangible (physical) computer readable media that is non- transitory in that it does not merely constitute a transitory propagating signal, but is actually capable of retaining programming, such as within any desired form and number of static or dynamic memory devices. These memory devices need not be implemented to maintain data under all conditions (e.g., power fail) to be considered herein as non-transitory media.
  • FIG. 3 illustrates an example embodiment of intra mode numbering utilized according to an embodiment of the present invention, showing a simple monotonic sequence, exemplified with sequential numbering from 2 through 34, whose angles pass through various horizontal, up-right diagonal scan (shown as up-right scan for brevity) and vertical scans.
  • Direction 0 represents Planar, and 1 represents DC, which are not shown in the figure.
  • a function based on a subset of real numbers with real values is called monotonic, if all x and y with x ⁇ y has f (x) ⁇ f (y) for monotonically increasing, or with x > y for f (x) > f (y) for monotonically decreasing, thereby preserving the order.
  • Embodiments of the present invention can be implemented with any desired alternative number sequences, in particular monotonic number sequences, without departing from the teachings of the present invention.
  • the index of the scan can be easily derived by calculating the distance of the mode from vertical and horizontal directions. Therefore, the look-up table g_auclntraDirToScanldx
  • intra mode smoothing is performed in response to the amount of angular difference found between logical intra mode names (which represent angular offsets from horizontal and/or vertical). For example, with the minimum of these numerical displacements compared against a pre-determined value stored in a much smaller look-up table, such as of size 5 rather than 5 x 36 array in current test model of HEVC (HM5.0). If the minimum numerical displacement (angular difference) is larger than the value of the table for the
  • a value of 10 is sufficiently large to prevent smoothing from being applied to any intra mode for that block size.
  • the modes for which smoothing is applied are exactly the same as HEVC test model HM 5.0, yet the table size is reduced.
  • mode dependent transforms In coding systems in which mode dependent transforms are based on intra modes, the tables for mode dependent transforms (e.g., Discrete Sine Transforms and Discrete Cosine Transforms (DST and DCT)), can also be removed in a similar fashion, in view of using the logical mode numbers.
  • DST and DCT Discrete Sine Transforms and Discrete Cosine Transforms
  • the vertical DST is applied to the planar mode and to modes 1 1 through 34 for vertical transform.
  • the remainder of the modes use vertical DCT transform.
  • Horizontal DST is, on the other hand, applied to planar mode and to modes 2 through 25 for horizontal transform.
  • the present invention can be extended to any desired number of Most Probable Modes (MPMs), the following example describing extension to three MPMs.
  • MPMs Most Probable Modes
  • the rationale is to have the number of modes as a structure with 3 MPMs + x, where x is the number of remaining modes.
  • the present invention thus provides a full symmetric approach with no gain in which x is a power of two. So in a 4x4 the value of x is 16, while in others x is equal to 32.
  • the 3 MPMs are derived using simple operations without any look-up tables as seen in Table 1 in which the value of ⁇ is 2 for 4x4 PUs and 1 for the rest of the PU sizes in HM 5.0 and the value can vary in general.
  • Table 1 the value of ⁇ is 2 for 4x4 PUs and 1 for the rest of the PU sizes in HM 5.0 and the value can vary in general.
  • ⁇ and the look up tables can be
  • the table basically indicates how to set MPMs from neighboring blocks, as seen in more detail in FIG. 4A and FIG. 4B, described in a later section.
  • FIG. 4A and FIG. 4B illustrate MPM derivation according to the
  • FIG. 4A the decisions are shown for the condition if iLeftlntraDir is equal to iAbovelntraDir, while in FIG. 4B decisions are otherwise shown for when iLeftlntraDir is not equal to AbovelntraDir.
  • FIG. 5 illustrates an intra mode encoding tree for the intra prediction mode 90 of the invention.
  • a determination 92 is made if the intra prediction is equal to one of MPMs. If not equal to any of MPMs then a zero is encoded 94, after which encoding is performed 96 with fixed-length codes for the remaining modes. Otherwise, for MPMs the first bit is encoded 100 as a one.
  • a determination is then made 102 if the mode is MPM0. If it is MPM0 then a zero is encoded 104. If not MPM0 then a 1 is encoded 106, and a determination is made 108 if the mode is MPM1 .
  • programming executable on said processor encodes a first bit in a first state indicating that the intra mode is not equal to any of the MPMs, wherein all encoding is according to fixed-length codes for the remaining modes.
  • the first bit is encoded in a second state, inverse to said first state, to indicate that the intra mode is equal to one of the MPMs, whereby subsequent bits after the first bit indicate if MPM0, MPM1 or MPM2 is selected.
  • FIG. 6 illustrates an intra mode decoding tree for the invention with a bit stream 130.
  • the first bit is decoded 132, and if it is zero, then fixed length codes are to be decoded for the remaining modes at block 134, and decoded fixed-length code is mapped to intra mode 136, and intra prediction mode is determined 138. If the first decoded bit is a one, then at block 140 the next bit is decoded, and if it is zero MPM0 142 is selected, if one, then block 144 decodes the next bit. If this third bit is a zero, then MPM1 146 is selected, and if a one, then MPM2 148 is selected, all of which continue with determining intra prediction mode 138.
  • FIG. 7A and FIG. 7B illustrates an example embodiment of
  • the value iLeftlntraDir is set to the intra prediction mode of left neighboring PU in block 152 if left neighboring PU is intra coded (mode), otherwise iLeftlntraDir is set to DC in block 154.
  • decision 150 the value iLeftlntraDir is set to the intra prediction mode of left neighboring PU in block 152 if left neighboring PU is intra coded (mode), otherwise iLeftlntraDir is set to DC in block 154.
  • the value iLeftlntraDir is set to the intra prediction mode of left neighboring PU in block 152 if left neighboring PU is intra coded (mode), otherwise iLeftlntraDir is set to DC in block 154.
  • iAbovelntraDir is set to the intra prediction mode of above neighboring PU in block 158 if above neighboring PU is intra coded, otherwise
  • iAbovelntraDir is set to DC in block 160. Using iLeftlntraDir and
  • iAbovelntraDir 162 if these are not equal in block 164, then in block 166 a check is made to see if any one is planar. If not planar then MPMO is set to iLeftlntraDir mode, MPM1 set to iAbovelntraDir mode, and MPM2 set to Planar mode in block 168. If any are planar, then block 170 determines if the other is DC. If it is not DC, then in block 172 MPMO is set to
  • MPM1 is set to iAbovelntraDir
  • MPM2 is set to DC. If the other is DC, then at block 174 MPMO is set to iLeftlntraDir, MPM1 is set to iAbovelntraDir, and MPM2 is set to Vertical.
  • block 176 checks if iLeftlntraDir is angular.
  • MPMO is set to Planar
  • MPM1 is set to DC
  • MPM2 is set to Vertical
  • MPMO is set to iLeftlntraDir
  • MPM1 is set to iLeftlntraDir- ⁇
  • MPM2 is set to iLeftlntraDir+ ⁇ , where the value of ⁇ is 2 for 4x4 PUs and 1 for the rest of the PU sizes in HM5.0.
  • each block or step of a flowchart, and combinations of blocks (and / or steps) in a flowchart, algorithm, formula, or computational depiction can be implemented by various means, such as hardware, firmware, and/or software including one or more computer program instructions embodied in computer-readable program code logic.
  • any such computer program instructions may be loaded onto a computer, including without limitation a general purpose computer or special purpose computer, or other programmable processing apparatus to produce a machine, such that the computer program instructions which execute on the computer or other programmable processing apparatus create means for implementing the functions specified in the block(s) of the flowchart(s).
  • computational depictions support combinations of means for performing the specified functions, combinations of steps for performing the specified functions, and computer program instructions, such as embodied in computer-readable program code logic means, for performing the specified functions. It will also be understood that each block of the flowchart illustrations, algorithms, formulae, or computational depictions and combinations thereof described herein, can be implemented by special purpose hardware-based computer systems which perform the specified functions or steps, or combinations of special purpose hardware and computer-readable program code logic means.
  • embodied in computer-readable program code logic may also be stored in a computer-readable memory that can direct a computer or other programmable processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the block(s) of the flowchart(s).
  • the computer program instructions may also be loaded onto a computer or other programmable processing apparatus to cause a series of operational steps to be performed on the computer or other programmable processing apparatus to produce a computer-implemented process such that the instructions which execute on the computer or other programmable processing apparatus provide steps for implementing the functions specified in the block(s) of the flowchart(s), algorithm(s), formula(e), or computational depiction(s).
  • a video encoder having a computer processor
  • programming executable on said video encoder computer processor for:(i) selecting intra prediction types and modes in a prediction unit and encoding with logical intra mode naming each said mode having a mode number, wherein each mode number in said logical intra mode naming is associated with an angular direction as a monotonic sequence including
  • plurality of directions represent directions spanning through horizontal scans, up-right diagonal scans and vertical scans.
  • An apparatus for video encoding comprising: (a) a video
  • encoder having a computer processor; and (b) programming executable on said computer processor for: (i) selecting intra prediction types and modes of a prediction unit (PU); (ii) encoding said prediction types and modes of the prediction units using logical intra mode naming in which each mode has a mode number that is associated with an angular direction as a monotonic sequence including representations for DC mode, planar mode, and a plurality of directions, and (iii) outputting said logical intra mode naming for use by a decoder in determining prediction types and modes based on said logical intra mode naming
  • said video encoder is a high efficiency video coding (HEVC) encoder, utilizing coding units (CUs) having variable block sizes depending on video content, which are split into smaller blocks for prediction as Prediction Units (PUs) or transform as Transform Units (TUs).
  • HEVC high efficiency video coding
  • plurality of directions represent directions spanning through horizontal scans, up-right diagonal scans and vertical scans.
  • programming executable on said computer processor is configured to utilize an association between logical intra mode names and angular directions to simplify decision logic and look-up tables.
  • lookup tables are selected from the group of tables consisting of intra
  • the apparatus of any preceding embodiment further comprising programming executable on said computer processor for encoding most probable modes (MPMs) of intra mode directions.
  • MPMs most probable modes
  • 1 1 The apparatus of any preceding embodiment, further comprising programming executable on said computer processor for encoding a first bit in a first state indicating that intra prediction mode is not equal to any MPMs, wherein all encoding is according to fixed-length code for remaining modes; and encoding said first bit in a second state, inverse to said first state, indicating that intra prediction mode is equal to one of MPMs, with subsequent bits after said first bit indicating if MPMO, MPM1 or MPM2 is selected.
  • a two dimensional 4x4 transform as a one dimensional vertical transform followed by a one dimensional horizontal transform; wherein directional modes have values of 2 through 34; wherein a vertical discrete sine transform (DST) is applied to the planar mode and to modes 1 1 through 34 for vertical transform, with remaining modes using vertical discrete cosine transform (DCT); and wherein a horizontal DST is applied to planar mode and to modes 2 through 25 for horizontal transform.
  • DST vertical discrete sine transform
  • DCT vertical discrete cosine transform
  • An apparatus for decoding video signals comprising: (a) a
  • decoder having a computer processor configured for decoding video frames; and (b) programming executable on said computer processor for: (i) receiving intra prediction types and modes and most probable modes (MPMs) for prediction units (PUs) utilizing logical intra mode naming (LIMN) from an encoder; (ii) wherein each logical mode number is associated with an angular direction as a monotonic sequence whose numbers include representations for DC mode, planar mode, and a plurality of directions; and (iii) making entropy decoding and intra prediction decisions based on received values encoded with logical intra mode naming (LIMN).
  • MCMs intra prediction types and modes and most probable modes
  • LIMN logical intra mode naming
  • video decoder is a high efficiency video coding (HEVC) encoder, utilizing coding units (CUs) having variable block sizes depending on video content which are split into smaller blocks for prediction as Prediction Units (PUs) or transform as Transform Units (TUs.
  • HEVC high efficiency video coding

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Physics & Mathematics (AREA)
  • Discrete Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Compression Or Coding Systems Of Tv Signals (AREA)
PCT/US2012/069023 2012-01-20 2012-12-11 Logical intra mode naming in hevc video coding Ceased WO2013109359A1 (en)

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
US201261589221P 2012-01-20 2012-01-20
US61/589,221 2012-01-20
US13/674,646 US9210438B2 (en) 2012-01-20 2012-11-12 Logical intra mode naming in HEVC video coding
US13/674,646 2012-11-12

Publications (1)

Publication Number Publication Date
WO2013109359A1 true WO2013109359A1 (en) 2013-07-25

Family

ID=47630157

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2012/069023 Ceased WO2013109359A1 (en) 2012-01-20 2012-12-11 Logical intra mode naming in hevc video coding

Country Status (6)

Country Link
US (6) US9210438B2 (https=)
EP (3) EP3188484A1 (https=)
JP (10) JP5585946B2 (https=)
KR (8) KR101502674B1 (https=)
CN (6) CN105791872B (https=)
WO (1) WO2013109359A1 (https=)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9210438B2 (en) 2012-01-20 2015-12-08 Sony Corporation Logical intra mode naming in HEVC video coding
WO2020192625A1 (en) * 2019-03-23 2020-10-01 Huawei Technologies Co., Ltd. An encoder, a decoder and corresponding methods for intra prediction

Families Citing this family (38)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR101495724B1 (ko) * 2010-02-02 2015-02-25 삼성전자주식회사 계층적 데이터 단위의 스캔 순서에 기반한 비디오 부호화 방법과 그 장치, 및 비디오 복호화 방법과 그 장치
PT3136729T (pt) * 2011-06-28 2018-01-25 Samsung Electronics Co Ltd Aparelho para descodificar vídeo com intra previsão
HUE050473T2 (hu) 2012-01-20 2020-12-28 Dolby Laboratories Licensing Corp Eljárás belsõ predikciós mód leképezésére
KR101620619B1 (ko) * 2012-01-30 2016-05-12 한국전자통신연구원 인트라 예측 모드 부호화/복호화 방법 및 장치
WO2013115568A1 (ko) * 2012-01-30 2013-08-08 한국전자통신연구원 인트라 예측 모드 부호화/복호화 방법 및 장치
US10542286B2 (en) 2012-12-19 2020-01-21 ARRIS Enterprise LLC Multi-layer video encoder/decoder with base layer intra mode used for enhancement layer intra mode prediction
US20140286413A1 (en) * 2013-03-25 2014-09-25 Qualcomm Incorporated Disabling sign data hiding in video coding
KR102257269B1 (ko) 2013-10-14 2021-05-26 마이크로소프트 테크놀로지 라이센싱, 엘엘씨 비디오 및 이미지 코딩 및 디코딩을 위한 인트라 블록 카피 예측 모드의 피쳐
EP3058736B1 (en) 2013-10-14 2019-02-27 Microsoft Technology Licensing, LLC Encoder-side options for intra block copy prediction mode for video and image coding
CA2925183C (en) 2013-10-14 2020-03-10 Microsoft Technology Licensing, Llc Features of base color index map mode for video and image coding and decoding
AU2014376061B8 (en) 2014-01-03 2019-05-30 Microsoft Technology Licensing, Llc Block vector prediction in video and image coding/decoding
US10390034B2 (en) 2014-01-03 2019-08-20 Microsoft Technology Licensing, Llc Innovations in block vector prediction and estimation of reconstructed sample values within an overlap area
US11284103B2 (en) 2014-01-17 2022-03-22 Microsoft Technology Licensing, Llc Intra block copy prediction with asymmetric partitions and encoder-side search patterns, search ranges and approaches to partitioning
US10542274B2 (en) 2014-02-21 2020-01-21 Microsoft Technology Licensing, Llc Dictionary encoding and decoding of screen content
WO2015131323A1 (en) 2014-03-04 2015-09-11 Microsoft Technology Licensing, Llc Block flipping and skip mode in intra block copy prediction
US10785486B2 (en) 2014-06-19 2020-09-22 Microsoft Technology Licensing, Llc Unified intra block copy and inter prediction modes
RU2562414C1 (ru) * 2014-09-24 2015-09-10 Закрытое акционерное общество "Элекард наноДевайсез" Способ быстрого выбора режима пространственного предсказания в системе кодирования hevc
CA3171803A1 (en) 2014-09-30 2016-04-07 Microsoft Technology Licensing, Llc Rules for intra-picture prediction modes when wavefront parallel processing is enabled
US9591325B2 (en) 2015-01-27 2017-03-07 Microsoft Technology Licensing, Llc Special case handling for merged chroma blocks in intra block copy prediction mode
US9994717B2 (en) * 2015-04-13 2018-06-12 Kennametal Inc. CVD-coated article and CVD process of making the same
CN106664405B (zh) 2015-06-09 2020-06-09 微软技术许可有限责任公司 用调色板模式对经逸出编码的像素的稳健编码/解码
CN105898309A (zh) * 2015-12-25 2016-08-24 乐视云计算有限公司 转码的方法和装置
CN117221597A (zh) 2016-06-22 2023-12-12 Lx 半导体科技有限公司 图像编码/解码方法以及图像数据的传输方法
US20190215521A1 (en) * 2016-09-22 2019-07-11 Mediatek Inc. Method and apparatus for video coding using decoder side intra prediction derivation
WO2018080135A1 (ko) * 2016-10-28 2018-05-03 한국전자통신연구원 영상 부호화/복호화 방법, 장치 및 비트스트림을 저장한 기록 매체
KR20190076918A (ko) * 2017-12-22 2019-07-02 주식회사 윌러스표준기술연구소 비디오 신호 처리 방법 및 장치
US10986349B2 (en) 2017-12-29 2021-04-20 Microsoft Technology Licensing, Llc Constraints on locations of reference blocks for intra block copy prediction
US10652534B2 (en) * 2018-03-08 2020-05-12 Tencent America LLC Methods and apparatus for directional intra prediction in video compression
US10771781B2 (en) * 2018-03-12 2020-09-08 Electronics And Telecommunications Research Institute Method and apparatus for deriving intra prediction mode
KR20240042127A (ko) * 2018-09-03 2024-04-01 후아웨이 테크놀러지 컴퍼니 리미티드 인트라 예측을 위한 방법 및 장치
WO2020050678A1 (ko) * 2018-09-06 2020-03-12 엘지전자 주식회사 Mpm 리스트를 사용하는 인트라 예측 기반 영상 코딩 방법 및 그 장치
WO2020091502A1 (ko) * 2018-11-01 2020-05-07 엘지전자 주식회사 인트라 예측 모드 기반 영상 처리 방법 및 이를 위한 장치
WO2020139182A1 (en) * 2018-12-28 2020-07-02 Telefonaktiebolaget Lm Ericsson (Publ) Method and apparatus for selecting transform selection in an encoder and decoder
WO2020133380A1 (zh) * 2018-12-29 2020-07-02 富士通株式会社 一种图像的块内编码或解码方法、数据处理装置和电子设备
US11102490B2 (en) * 2018-12-31 2021-08-24 Tencent America LLC Coefficient scanning methods on adaptive angle mode
KR20250025047A (ko) 2019-01-09 2025-02-20 엘지전자 주식회사 Mpm 리스트를 사용하는 인트라 예측 기반 영상 코딩 방법 및 장치
EP3985978A4 (en) * 2019-06-24 2023-02-15 Hyundai Motor Company METHOD AND DEVICE FOR INTRA PREDICTION CODING OF VIDEO DATA
JP7415812B2 (ja) 2020-06-15 2024-01-17 コベルコ建機株式会社 クレーン

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20050135484A1 (en) * 2003-12-18 2005-06-23 Daeyang Foundation (Sejong University) Method of encoding mode determination, method of motion estimation and encoding apparatus
US20090161757A1 (en) * 2007-12-21 2009-06-25 General Instrument Corporation Method and Apparatus for Selecting a Coding Mode for a Block
US20110158315A1 (en) * 2008-09-03 2011-06-30 Sk Telecom Co., Ltd. Device and method for image encoding/decoding using prediction direction conversion and selective encoding
US20110164677A1 (en) * 2008-09-26 2011-07-07 Dolby Laboratories Licensing Corporation Complexity Allocation for Video and Image Coding Applications

Family Cites Families (46)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPS6087767A (ja) 1983-10-19 1985-05-17 Yamasa Kamaboko Kk カニ肉様練製品の製造方法
US7369707B2 (en) * 2003-10-28 2008-05-06 Matsushita Electric Industrial Co., Ltd. Intra-picture prediction coding method
KR100679031B1 (ko) 2004-12-03 2007-02-05 삼성전자주식회사 다 계층 기반의 비디오 인코딩 방법, 디코딩 방법 및 상기방법을 이용한 장치
KR100703748B1 (ko) * 2005-01-25 2007-04-05 삼성전자주식회사 다 계층 기반의 비디오 프레임을 효율적으로 예측하는 방법및 그 방법을 이용한 비디오 코딩 방법 및 장치
CN100348051C (zh) * 2005-03-31 2007-11-07 华中科技大学 一种增强型帧内预测模式编码方法
EP1965589A1 (en) * 2005-11-30 2008-09-03 Kabushiki Kaisha Toshiba Image encoding/image decoding method and image encoding/image decoding apparatus
KR100750145B1 (ko) * 2005-12-12 2007-08-21 삼성전자주식회사 영상의 인트라 예측 부호화, 복호화 방법 및 장치
CN101087427B (zh) * 2006-06-06 2011-04-06 北京大学深圳研究生院 一种h.264标准的帧内预测模式选择方法
US20090003443A1 (en) 2007-06-26 2009-01-01 Nokia Corporation Priority-based template matching intra prediction video and image coding
JP2009027541A (ja) 2007-07-20 2009-02-05 Ntt Docomo Inc 画像符号化装置、方法及びプログラム、並びに、画像復号装置、方法及びプログラム
CN101605255B (zh) * 2008-06-12 2011-05-04 华为技术有限公司 一种视频编解码的方法及装置
CN101309421B (zh) * 2008-06-23 2010-09-29 北京工业大学 帧内预测模式选择方法
JP2010028221A (ja) * 2008-07-15 2010-02-04 Sony Corp 動きベクトル検出装置、動きベクトル検出方法、画像符号化装置及びプログラム
CN101340581B (zh) * 2008-08-15 2010-06-02 上海富瀚微电子有限公司 一种基于m算法的帧内预测模式选择方法及其实现装置
KR101369161B1 (ko) 2008-09-05 2014-03-05 에스케이 텔레콤주식회사 예측 방향 전환 장치 및 방법과 그를 이용한 영상 부호화/복호화 장치 및 방법
WO2010035731A1 (ja) * 2008-09-24 2010-04-01 ソニー株式会社 画像処理装置および方法
BRPI1007204A2 (pt) 2009-01-09 2016-02-23 Dsm Ip Assets Bv primer para revestimento de fios enrolados
BRPI1008081A2 (pt) * 2009-02-06 2017-10-17 Thomson Licensing metodos e aparelho para sinalizacao intra-modal implicita e semi-implicita para codificadores e desodificadores de video
WO2011083573A1 (ja) 2010-01-07 2011-07-14 株式会社 東芝 動画像符号化装置及び動画像復号化装置
US8588303B2 (en) * 2010-03-31 2013-11-19 Futurewei Technologies, Inc. Multiple predictor sets for intra-frame coding
KR101503269B1 (ko) * 2010-04-05 2015-03-17 삼성전자주식회사 영상 부호화 단위에 대한 인트라 예측 모드 결정 방법 및 장치, 및 영상 복호화 단위에 대한 인트라 예측 모드 결정 방법 및 장치
US8619857B2 (en) 2010-04-09 2013-12-31 Sharp Laboratories Of America, Inc. Methods and systems for intra prediction
KR20110113561A (ko) 2010-04-09 2011-10-17 한국전자통신연구원 적응적인 필터를 이용한 인트라 예측 부호화/복호화 방법 및 그 장치
US8902978B2 (en) * 2010-05-30 2014-12-02 Lg Electronics Inc. Enhanced intra prediction mode signaling
JP2011259361A (ja) * 2010-06-11 2011-12-22 Sony Corp 画像処理装置および方法
WO2011158867A1 (ja) * 2010-06-17 2011-12-22 シャープ株式会社 画像復号装置、及び画像符号化装置
CN101877792B (zh) * 2010-06-17 2012-08-08 无锡中星微电子有限公司 帧内模式预测方法与装置、编码器
US9172968B2 (en) * 2010-07-09 2015-10-27 Qualcomm Incorporated Video coding using directional transforms
JP5798556B2 (ja) 2010-07-15 2015-10-21 シャープ株式会社 復号装置、符号化装置
CN107277527B (zh) * 2010-07-15 2020-02-18 威勒斯媒体国际有限公司 解码装置、解码方法、编码装置以及编码方法
ES2670327T3 (es) * 2010-08-17 2018-05-30 M&K Holdings Inc. Procedimiento de restablecimiento de un modo de intra predicción
CN102176750B (zh) * 2011-03-10 2012-12-26 西安电子科技大学 高性能自适应二进制算术编码器
EP2523145A1 (en) 2011-05-11 2012-11-14 Alcatel Lucent Method for dynamically adapting video image parameters for facilitating subsequent applications
WO2012166389A1 (en) 2011-05-31 2012-12-06 Theravance, Inc. Neprilysin inhibitors
US9654785B2 (en) * 2011-06-09 2017-05-16 Qualcomm Incorporated Enhanced intra-prediction mode signaling for video coding using neighboring mode
WO2012172791A1 (ja) * 2011-06-13 2012-12-20 パナソニック株式会社 画像復号方法、画像符号化方法、画像復号装置、画像符号化装置および画像符号化復号装置
PT3136729T (pt) * 2011-06-28 2018-01-25 Samsung Electronics Co Ltd Aparelho para descodificar vídeo com intra previsão
US20130054558A1 (en) 2011-08-29 2013-02-28 Microsoft Corporation Updated information provisioning
GB2494468B (en) * 2011-09-12 2014-01-15 Canon Kk Method and device for encoding or decoding information representing prediction modes
CN107197310B (zh) * 2011-10-07 2020-02-21 英迪股份有限公司 对视频信号进行解码的方法
ES2816567T3 (es) * 2011-10-24 2021-04-05 Innotive Ltd Método y aparato para decodificar modo de intra-predicción
SI2942954T1 (sl) 2011-10-24 2020-10-30 Innotive Ltd Naprava za dekodiranje slik
JP2013098715A (ja) * 2011-10-31 2013-05-20 Mitsubishi Electric Corp 動画像符号化装置、動画像復号装置、動画像符号化方法及び動画像復号方法
KR20130049526A (ko) * 2011-11-04 2013-05-14 오수미 복원 블록 생성 방법
US9210438B2 (en) 2012-01-20 2015-12-08 Sony Corporation Logical intra mode naming in HEVC video coding
HUE050473T2 (hu) * 2012-01-20 2020-12-28 Dolby Laboratories Licensing Corp Eljárás belsõ predikciós mód leképezésére

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20050135484A1 (en) * 2003-12-18 2005-06-23 Daeyang Foundation (Sejong University) Method of encoding mode determination, method of motion estimation and encoding apparatus
US20090161757A1 (en) * 2007-12-21 2009-06-25 General Instrument Corporation Method and Apparatus for Selecting a Coding Mode for a Block
US20110158315A1 (en) * 2008-09-03 2011-06-30 Sk Telecom Co., Ltd. Device and method for image encoding/decoding using prediction direction conversion and selective encoding
US20110164677A1 (en) * 2008-09-26 2011-07-07 Dolby Laboratories Licensing Corporation Complexity Allocation for Video and Image Coding Applications

Cited By (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9210438B2 (en) 2012-01-20 2015-12-08 Sony Corporation Logical intra mode naming in HEVC video coding
US10623772B2 (en) 2012-01-20 2020-04-14 Sony Corporation Logical intra mode naming in HEVC video coding
US11012712B2 (en) 2012-01-20 2021-05-18 Sony Corporation Logical intra mode naming in HEVC video coding
US11412255B2 (en) 2012-01-20 2022-08-09 Sony Corporation Logical intra mode naming in HEVC video coding
WO2020192625A1 (en) * 2019-03-23 2020-10-01 Huawei Technologies Co., Ltd. An encoder, a decoder and corresponding methods for intra prediction
US10986336B2 (en) 2019-03-23 2021-04-20 Huawei Technologies Co., Ltd. Encoder, a decoder and corresponding methods for intra prediction
US11070799B2 (en) 2019-03-23 2021-07-20 Huawei Technologies Co., Ltd. Encoder, decoder and corresponding methods for intra prediction
US11405610B2 (en) 2019-03-23 2022-08-02 Huawei Technologies Co., Ltd. Encoder, a decoder and corresponding methods for intra prediction
US12149684B2 (en) 2019-03-23 2024-11-19 Huawei Technologies Co., Ltd. Encoder, a decoder and corresponding methods for intra prediction
US12200201B2 (en) 2019-03-23 2025-01-14 Huawei Technologies Co., Ltd. Encoder, decoder and corresponding methods for intra prediction

Also Published As

Publication number Publication date
JP5811512B2 (ja) 2015-11-11
KR101952473B1 (ko) 2019-02-26
JP2018026870A (ja) 2018-02-15
JP2019071652A (ja) 2019-05-09
KR20180136922A (ko) 2018-12-26
JP2013150329A (ja) 2013-08-01
CN103220511A (zh) 2013-07-24
JP5861993B2 (ja) 2016-02-16
CN105791872A (zh) 2016-07-20
EP2618575A3 (en) 2013-09-18
JP5585946B2 (ja) 2014-09-10
CN105791872B (zh) 2019-11-26
JP2017011765A (ja) 2017-01-12
JP6702406B2 (ja) 2020-06-03
CN103220511B (zh) 2016-08-31
US20160127743A1 (en) 2016-05-05
EP3518546A1 (en) 2019-07-31
CN105721878B (zh) 2019-04-09
US10148980B2 (en) 2018-12-04
KR101502674B1 (ko) 2015-03-13
CN106101728B (zh) 2019-06-21
KR102204800B1 (ko) 2021-01-18
KR102252161B1 (ko) 2021-05-17
JP6841361B2 (ja) 2021-03-10
JP2020102870A (ja) 2020-07-02
JP2021078149A (ja) 2021-05-20
US20130188695A1 (en) 2013-07-25
JP7024897B2 (ja) 2022-02-24
CN106101729B (zh) 2019-06-18
CN106210748A (zh) 2016-12-07
US11012712B2 (en) 2021-05-18
KR20140135682A (ko) 2014-11-26
KR20140136406A (ko) 2014-11-28
JP2014099911A (ja) 2014-05-29
KR20140136405A (ko) 2014-11-28
US11412255B2 (en) 2022-08-09
US20200145693A1 (en) 2020-05-07
JP2014099913A (ja) 2014-05-29
KR20130085967A (ko) 2013-07-30
CN106210748B (zh) 2019-11-08
US10623772B2 (en) 2020-04-14
CN105721878A (zh) 2016-06-29
CN106101728A (zh) 2016-11-09
US20160127744A1 (en) 2016-05-05
CN106101729A (zh) 2016-11-09
US20190052903A1 (en) 2019-02-14
KR101940347B1 (ko) 2019-01-18
US20210195237A1 (en) 2021-06-24
EP2618575A2 (en) 2013-07-24
EP3188484A1 (en) 2017-07-05
JP5811511B2 (ja) 2015-11-11
JP2014099912A (ja) 2014-05-29
KR20200135923A (ko) 2020-12-04
JP6256564B2 (ja) 2018-01-10
JP2016027765A (ja) 2016-02-18
KR20200112781A (ko) 2020-10-05
JP6036964B2 (ja) 2016-11-30
KR20190106962A (ko) 2019-09-18
US9210438B2 (en) 2015-12-08
US10567795B2 (en) 2020-02-18

Similar Documents

Publication Publication Date Title
US11412255B2 (en) Logical intra mode naming in HEVC video coding

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 12865840

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 12865840

Country of ref document: EP

Kind code of ref document: A1