US8929460B1 - Method and encoding/decoding of video using common merging candidate set of asymmetric partitions - Google Patents

Method and encoding/decoding of video using common merging candidate set of asymmetric partitions Download PDF

Info

Publication number
US8929460B1
US8929460B1 US14/478,747 US201414478747A US8929460B1 US 8929460 B1 US8929460 B1 US 8929460B1 US 201414478747 A US201414478747 A US 201414478747A US 8929460 B1 US8929460 B1 US 8929460B1
Authority
US
United States
Prior art keywords
prediction unit
block
merging candidate
blocks
unit
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
US14/478,747
Other versions
US20150023426A1 (en
Inventor
Chung Ku Yie
Yong Jae Lee
Hui Kim
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Humax Co Ltd
Original Assignee
Humax Holdings Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from KR1020120016616A external-priority patent/KR101205017B1/en
Application filed by Humax Holdings Co Ltd filed Critical Humax Holdings Co Ltd
Priority to US14/478,747 priority Critical patent/US8929460B1/en
Assigned to HUMAX HOLDINGS CO., LTD. reassignment HUMAX HOLDINGS CO., LTD. ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: KIM, HUI, LEE, YONG JAE, YIE, CHUNG KU
Application granted granted Critical
Publication of US8929460B1 publication Critical patent/US8929460B1/en
Publication of US20150023426A1 publication Critical patent/US20150023426A1/en
Assigned to HUMAX CO., LTD. reassignment HUMAX CO., LTD. ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: HUMAX HOLDINGS CO., LTD.
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • H04N19/00696
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • H04N19/503Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal prediction
    • H04N19/51Motion estimation or motion compensation
    • H04N19/00278
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/119Adaptive subdivision aspects, e.g. subdivision of a picture into rectangular or non-rectangular coding blocks
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/134Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
    • H04N19/136Incoming video signal characteristics or properties
    • H04N19/137Motion inside a coding unit, e.g. average field, frame or block difference
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/134Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
    • H04N19/136Incoming video signal characteristics or properties
    • H04N19/137Motion inside a coding unit, e.g. average field, frame or block difference
    • H04N19/139Analysis of motion vectors, e.g. their magnitude, direction, variance or reliability
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/169Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
    • H04N19/17Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object
    • H04N19/176Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a block, e.g. a macroblock
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/42Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by implementation details or hardware specially adapted for video compression or decompression, e.g. dedicated software implementation
    • H04N19/436Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by implementation details or hardware specially adapted for video compression or decompression, e.g. dedicated software implementation using parallelised computational arrangements
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • H04N19/503Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal prediction
    • H04N19/51Motion estimation or motion compensation
    • H04N19/513Processing of motion vectors
    • H04N19/517Processing of motion vectors by encoding
    • H04N19/52Processing of motion vectors by encoding by predictive encoding
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/60Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding
    • H04N19/61Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding in combination with predictive coding
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/46Embedding additional information in the video signal during the compression process
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • H04N19/503Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal prediction
    • H04N19/51Motion estimation or motion compensation
    • H04N19/513Processing of motion vectors
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • H04N19/503Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal prediction
    • H04N19/51Motion estimation or motion compensation
    • H04N19/56Motion estimation with initialisation of the vector search, e.g. estimating a good candidate to initiate a search
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/90Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using coding techniques not provided for in groups H04N19/10-H04N19/85, e.g. fractals
    • H04N19/96Tree coding, e.g. quad-tree coding

Definitions

  • the present invention relates to encoding and decoding of video and more specifically, video encoding methods, video encoding apparatuses, video decoding methods, and video decoding apparatuses by using block merging.
  • Video encoding algorithms based on intra prediction compress a video by removing temporal redundancy between pictures, where motion compensated inter-frame prediction is a typical technique for this purpose.
  • Motion compensated inter-frame prediction technique generates a motion vector by searching at least one reference picture located before and/or after a current encoding picture for a region similar to a current encoding block. It applies DCT (Discrete Cosine Transform) to residues between the current block and a prediction block obtained from motion compensation by using the generated motion vector. The result of DCT is transmitted after quantization and entropy encoding.
  • DCT Discrete Cosine Transform
  • motion vector is generated by dividing a picture into a plurality of blocks having a predetermined size and motion compensation is performed by using the generated motion vector.
  • Individual motion parameters for the respective prediction blocks obtained from motion compensation are transmitted to a decoder.
  • Example embodiments of the present invention provides video encoding methods and video encoding apparatuses using block merging which can be applied for high resolution videos of more than HD (High Definition) resolution.
  • Example embodiments of the present invention also provides video decoding methods and video decoding apparatuses using block merging which can be applied for high resolution videos of more than HD resolution.
  • an encoding method includes constructing a list of common merging candidate blocks including a predetermined number of common merging candidate blocks selected from among adjacent blocks of a current coding unit asymmetrically partitioned into a first and a second prediction unit; and selecting at least one candidate block from among the list of common merging candidate blocks for each of the first and the second prediction unit and sending information of the selected candidate block to a decoder for each of the first and the second prediction unit.
  • the list of common merging candidate blocks may include commonly used merging candidate blocks in case block merging is performed for the first and the second prediction unit. The block merging can be performed only when the size of the current coding unit is 8-by-8.
  • the largest coding unit may be divided into a plurality of non-overlapping motion estimation regions. Motion estimation may be performed sequentially on the motion estimation regions within the largest coding unit. The motion estimation can be performed in a parallel fashion for all prediction units belonging to a motion estimation region within the largest coding unit (LCU). According to the size of the motion estimation region, whether to allow parallel merging for prediction units within the motion estimation region by using the common merging candidate blocks can be determined. The parallel merging for all the prediction units within the motion estimation region may be allowed only when the size of the motion estimation region is larger than a predetermined size.
  • a predetermined value according to the size of the motion estimation region may be transmitted in a PPS (Picture Parameter Set) from an encoder to the decoder.
  • PPS Picture Parameter Set
  • the corresponding adjacent prediction unit is denoted as non-available
  • the corresponding adjacent prediction unit is denoted as available.
  • the list of common merging candidate blocks may include a spatial merging candidate block and a temporal merging candidate block.
  • the first and the second prediction unit within the current coding unit utilize a reference picture index of a block, at a predetermined particular position, from among spatial common merging candidate blocks as a reference picture index for temporal motion vector prediction (MVP) of the temporal merging candidate block.
  • the block, at the predetermined particular position can be rendered executable through parallel processing by using previously encoded adjacent block which can be constructed even before reconstructing a motion parameter of a first PU0 and a second prediction unit PU1 from among blocks included in the list of common merging candidate blocks.
  • the common merging candidate blocks can be predetermined beforehand according to a rule between the encoder and the decoder.
  • an encoding apparatus includes an inter prediction unit configured to construct a list of common merging candidate blocks including a predetermined number of common merging candidate blocks selected from blocks adjacent to a current coding unit, which have been asymmetrically partitioned into a first and a second prediction unit; and configured to select at least one candidate block from the list of common merging candidate blocks for each of the first and the second prediction unit.
  • a decoding method includes constructing a list of common merging candidate blocks including a predetermined number of common merging candidate blocks selected from among adjacent blocks of a current coding unit asymmetrically partitioned into a first and a second prediction unit; generating a motion vector on a block basis by reconstructing a motion parameter of a block-merged block by using at least one candidate block selected from the list of common merging candidate blocks for each of the first and the second prediction unit; and performing motion compensation by using the generated motion vector and a reference picture.
  • the common merging candidate blocks of the second prediction unit consist only of adjacent blocks which can be constructed before a motion parameter of the first prediction unit is reconstructed.
  • the block merging can be performed only when the size of the current coding unit is 8-by-8.
  • the largest coding unit (LCU) may be divided into a plurality of non-overlapping motion estimation regions. Motion estimation may be performed sequentially on the motion estimation regions within the largest coding unit. The motion estimation can be performed in a parallel fashion for all prediction units belonging to a estimation region within the largest coding unit (LCU). According to the size of the motion estimation region, whether to allow a parallel merging for prediction units within the motion estimation region by using the common merging candidate blocks can be determined. The parallel merging for all the prediction units within the motion estimation region is allowed only when the size of the motion estimation region is larger than a predetermined size.
  • FIG. 1 illustrates symmetric partitioning
  • FIG. 2 illustrates asymmetric partitioning
  • FIG. 3 illustrates block merging of partitioned blocks in case a prediction unit (PU) having size of 2N ⁇ 2N is partitioned into two N ⁇ 2N blocks in a vertical direction;
  • PU prediction unit
  • FIGS. 5 to 7 illustrate common merging candidate blocks enabling parallel processing of prediction units PU0, PU1 partitioned asymmetrically according to example embodiments of the present invention
  • FIG. 9 is a block diagram of a video encoding apparatus using block merging according to one example embodiment of the present invention.
  • FIG. 10 is a flow diagram illustrating a video encoding method using block merging according to one example embodiment of the present invention.
  • first, second, and so on can be used for describing various components but the components should not be limited by the terms. The terms are introduced only for the purpose of distinguishing one component from the others. For example, a first component may be called a second component without departing from the scope of the present invention and vice versa.
  • the term of and/or indicates a combination of a plurality of related items described or any one of a plurality of related items described.
  • a component is said to be “linked” or “connected” to a different component, the component may be directly linked or connected to the different component but a third component may exist to connect the two components even though the two components may be connected directly.
  • a component is said to be “linked directly” or “connected directly” to another component, it should be interpreted that there is no further component between the two components.
  • each coding unit (CU) is square-shaped and each coding unit (CU) has a variable size of 2N ⁇ 2N (where the size unit is pixel).
  • Inter prediction, intra prediction, transform, quantization, and entropy encoding may be performed on a CU basis.
  • the coding unit (CU) has a recursive tree structure.
  • a recursive structure may be represented by using a series of flags. For example, in case the flag value of a coding unit (CUk) is 0 and layer level or layer depth of the coding unit is k, coding for the coding unit (CUk) is performed on a current layer level or depth. In case the flag value is 1, the coding unit (CUk) whose current layer level or depth is k is partitioned into four independent coding units (CUk+1).
  • the terminal coding unit is now partitioned to carry out inter prediction or intra prediction.
  • partitioning is performed on a prediction unit.
  • a prediction unit represents the base unit for inter prediction or intra prediction.
  • a prediction unit is obtained as a terminal node of a coding unit hierarchy tree after the hierarchical splitting process is completed; in other words, size of the prediction unit can take one of 64 ⁇ 64, 32 ⁇ 32, 16 ⁇ 16, and 8 ⁇ 8.
  • FIG. 1 illustrates symmetric partitioning.
  • FIG. 1 assumes that size of a coding unit (CU) is 2N ⁇ 2N (where N is a natural number and represented by pixel units).
  • FIG. 2 illustrates asymmetric partitioning.
  • FIG. 2 assumes that size of a coding unit (CU) 2N ⁇ 2N (where N is a natural number and represented by pixel units).
  • CU coding unit
  • a 2N ⁇ 2N coding unit is asymmetrically partitioned in horizontal direction to perform the inter prediction, being partitioned into a partition PU0 (P11a) having size of 2N ⁇ nU (where nU is 2N ⁇ 1 ⁇ 4) and a partition PU1 (P12a) having size of 2N ⁇ nU (where nU is 2N ⁇ 3 ⁇ 4).
  • the 2N ⁇ 2N coding unit can be asymmetrically partitioned in vertical direction, being partitioned into a partition PU0 (P13a) having size of nL ⁇ 2N (where nL is 2N ⁇ 1 ⁇ 4) and a partition PU1 (P23a) having size of nR ⁇ 2N (where nR is 2N ⁇ 3 ⁇ 4); or a partition PU0 (P14a) having size of nL ⁇ 2N (where nL is 2N ⁇ 3 ⁇ 4) and a partition PU1 (P24a) having size of NR ⁇ 2N (where nR is 2N ⁇ 1 ⁇ 4).
  • All the information including motion parameters (a motion vector, a difference value of a motion vector, a reference picture index, a reference picture list, and so on) related to inter prediction is transmitted to a prediction unit, which is a base unit for inter prediction, or a decoder for each of the partitioned prediction units.
  • a prediction unit which is a base unit for inter prediction, or a decoder for each of the partitioned prediction units.
  • inter-frame encoding may be performed by using block merging.
  • Block merging is a technique intended for improving coding efficiency.
  • the adjacent blocks having the same motion parameter as that of the current block X are merged with the current block. Since the same motion parameter of the merged blocks is transmitted to a decoder, the amount of motion parameters to be transmitted to the decoder may be reduced without separately transmitting the motion parameter of the current block, and thus coding efficiency may be improved.
  • FIG. 3 illustrates block merging of partitioned blocks in case a prediction unit (PU) having size of 2N ⁇ 2N is partitioned into two N ⁇ 2N blocks in a vertical direction.
  • FIG. 4 illustrates a process where block merging of the two partitioned blocks of FIG. 3 and an encoding (or decoding) operation are performed.
  • PU prediction unit
  • a 2N ⁇ 2N coding unit is partitioned into a partition block PU0 having size of 2N ⁇ N and a partition block PU1 having size of 2N ⁇ N.
  • adjacent blocks bordering the left-side boundary of a partition block are called left-side adjacent blocks.
  • A1 belongs to the left-side adjacent blocks while in the right-hand side of FIG. 3 , in case of a second prediction unit PU1 filled with oblique lines, A1 belongs to the left-side adjacent blocks.
  • A1 belongs to the left-side adjacent blocks.
  • A0 is a block bordering a bottom-side boundary of an adjacent block A1, which is called a bottom-side extension adjacent block while, for the second prediction unit PU1 oblique-lined in the right-hand side of FIG. 3 , A0 is a block bordering a bottom-side boundary of an adjacent block A1, which is called a bottom-side extension adjacent block.
  • B0 is called a right-hand side extension adjacent block bordering the right-hand side boundary of a top-side adjacent block B1; meanwhile, with respect to the oblique lined, second prediction unit PU1 in the right-hand side of FIG. 3 , B0 is called a right-hand side extension adjacent block bordering the right-hand side boundary of a top-side adjacent block B1.
  • first prediction unit PU0, B2 borders on the left top-side edge of the first prediction unit PU0 and B2 is called a left top-side adjacent block.
  • first prediction unit PU0 in the left-hand side of FIG. 3 five adjacent blocks B2, B1, B0, A1, and A0 shown in the left-hand side of FIG. 3 are used as candidate adjacent blocks for block merging
  • second prediction unit PU1 in the right-hand side of FIG. 3 five adjacent blocks B2, B1, B0, A1, and A0 shown in the right-hand side of FIG. 3 are used as candidate adjacent blocks for block merging.
  • a process of constructing a list of merging candidate blocks for block merging of the first prediction unit PU0 is first performed and encoding (or decoding) of the first prediction unit is performed and a process of constructing a list of merging candidate blocks for block merging of the second prediction unit PU1 and subsequently encoding (or decoding) of the second prediction unit PU1 is performed.
  • a 2N ⁇ 2N coding unit is split into partitions consisting of a partition block PU0 (prediction unit) having size of nL ⁇ 2N (where nL is 2N ⁇ 1 ⁇ 4) and a partition block PU1 (prediction unit) having size of nR x 2N (where nR is 2N ⁇ 3 ⁇ 4).
  • PU0 of FIGS. 5 to 7 is called a first prediction unit while PU1 is called a second prediction unit.
  • size of a coding unit (CU) is 2N ⁇ 2N (where N is a positive integer) and N can be one of 2, 4, 8, 16, and 32.
  • a technique of utilizing common merging candidate blocks to enable parallel processing of asymmetrically partitioned prediction units PU0 and PU1 can be applied to all of coding units where N can take a value from among 2, 4, 8, 16, and 32 or can be applied to the coding units where N can assume only one particular value—for example, one from among 2, 4, 8, 15, and 32.
  • the largest coding unit can be split into a plurality of non-overlapping motion estimation regions (or merge estimation regions); motion estimation can be made to be performed sequentially among motion estimation regions within the largest coding unit (LCU) whereas all the prediction units (PUs) belonging to one motion estimation region within the largest coding unit (LCU) can be made to perform motion estimation in a parallel fashion.
  • size of the motion estimation region is smaller than that of the LCU and the motion estimation region can have a square shape.
  • PUs prediction units
  • LCU largest coding unit
  • a predetermined value can be included in a PPS (Picture Parameter Set) and transmitted from an encoder to a decoder to indicate possibility of the parallel merging depending on the size of the motion estimation region.
  • the predetermined value can take one of 0, 1, 2, 3, and 4, for example; size of the motion estimation region for each of the predetermined values 0, 1, 2, 3, and 4 can be 4 ⁇ 4, 8 ⁇ 8, 16 ⁇ 16, 32 ⁇ 32, and 64 ⁇ 64, respectively.
  • a current prediction unit (PU) and an adjacent prediction unit (PU) belong to the same motion estimation region (in other words, within the same motion estimation region)
  • the corresponding adjacent prediction unit is marked as non-available whereas the current prediction unit and the adjacent prediction unit belong to motion estimation regions different from each other, the corresponding adjacent prediction unit is marked as available; thus, availability of the list of common merging candidate blocks for motion vector estimation can be determined.
  • the merging operation described above can be performed by using adjacent common merging candidate blocks available.
  • first PU0 and the second prediction unit PU1 shown in FIGS. 5 to 7 block merging and an encoding (or decoding) operation are processed in a parallel fashion for the first PU0 and the second prediction unit PU1 by using common merging candidate blocks.
  • the common merging candidate blocks for the first PU0 530 and the second prediction unit PU1 550 may include LT, LB1, LB0, RT1, RT0, CT1, and CT2 block.
  • the list of merging candidate blocks for the first prediction unit PU0 530 includes LT, LB1, LB0, RT1, RT0, CT1, and CT2 block while the list of merging candidate blocks of the second prediction unit PU1 550 includes LT, LB1, LB0, RT1, RT0, CT1, and CT2 block.
  • the LT1 block is a left-top side adjacent block of the first prediction unit PU0 530 ; the LB1 block is the bottom-most, left-hand side block located at the lowest position of left-hand side blocks of the first prediction unit PU0; the LB0 block is a lower-side extension adjacent block bordering on the lower-side boundary of the bottom-most, left-hand side adjacent block LB1 of the first prediction unit.
  • the RT1 block is the rightmost, upper-side adjacent block located at the rightmost position of lower-side adjacent blocks (CT2, . . .
  • RT1 of the second prediction unit PU1 550 ;
  • RT0 block is a right-hand side extension adjacent block bordering on the right-side boundary of the rightmost, upper-side adjacent block RT1.
  • the CT1 and the CT2 block are upper-side, central adjacent blocks located in the left-hand and right-hand side of an extension of a central line formed when un-partitioned prediction unit PU is split into halves in vertical direction.
  • the CT1 block which is an upper-side adjacent block and bordering on the central line between the first prediction unit PU0 and the second prediction unit PU1 in the left-hand side is defined as a first upper-side central adjacent block
  • the CT2 block which is an upper-side adjacent block and bordering on the central line between the first prediction unit PU0 and the second prediction unit PU1 in the right-hand side is defined as a second upper-side central adjacent block.
  • the list of merging candidate blocks of the first prediction unit PU0 530 includes seven blocks: LT, LB1, LB0, RT1, RT0, CT1, and CT2.
  • the list of merging candidate blocks of the second prediction unit PU1 550 includes the same seven blocks: LT, LB1, LB0, RT1, RT0, CT1, and CT2.
  • the LT, LB1, LB0, RT1, RT0, CT1, and CT2 block included in the list of merging candidate blocks of the second prediction unit PU1 550 includes only adjacent blocks which can be constructed even before reconstructing motion parameters of the first prediction unit PU0.
  • LT, LB1, LB0, CT1, and CT2 block among common merging candidate blocks coincide with the candidate merging blocks of the first prediction unit PU0 of FIG. 3 , the same performance can be actually secured compared with a case where block merging of the first prediction unit PU0 is applied.
  • a first process constructing a list of merging candidate blocks (LT, LB1, LB0, RT1, RT0, CT1, and CT2 block) for block merging of the first prediction unit PU0 and a second process constructing a list of merging candidate blocks (LT, LB1, LB0, RT1, RT0, CT1, and CT2 block) for block merging of the second prediction unit PU1 are not performed separately but can be performed as a single process 810 constructing a single common merging candidate block; and an encoding (or decoding) process 830 for the second prediction unit PU1 can be performed in parallel with the encoding (or decoding) process 820 for the first prediction unit PU1, thereby reducing encoding time considerably.
  • the common merging candidate blocks can be predetermined beforehand according to a rule between an encoder and a decoder; in this case, information about the common merging candidate blocks doesn't have to be transmitted from the encoder to the decoder.
  • FIG. 6 illustrates common merging candidate blocks enabling parallel processing of prediction units PU0, PU1 partitioned asymmetrically according to another example embodiment of the present invention.
  • the list of common merging candidate blocks include seven blocks of LT 601 , LB1 611 , LB0 613 , RT1 607 , RT0 609 , ET1 603 , ET2 605 .
  • the first upper-side central adjacent block CT1 and the second upper-side central adjacent block CT2 are in the list; instead ET1 and ET2 are newly included in the list, which is different from the example embodiment of FIG. 5 .
  • the ET1 and ET2 block are upper-side central adjacent blocks located in the left-hand and right-hand side of an extension of a boundary line (which corresponds to a line dividing a non-partitioned prediction unit (PU) into a quarter in vertical direction) between the first PU0 and the second prediction unit PU1.
  • a boundary line which corresponds to a line dividing a non-partitioned prediction unit (PU) into a quarter in vertical direction
  • the ET1 block which is an upper-side adjacent block and bordering on the boundary line between the first PU0 and the second prediction unit PU1 in the left-hand side is defined as a first upper-side edge-adjacent block
  • the ET2 block which is an upper-side adjacent block and bordering on the boundary line between the first PU0 and the second prediction unit PU1 in the right-hand side is defined as a second upper-side edge-adjacent block.
  • the ET1 block is the rightmost, upper-side adjacent block located at the rightmost position among upper-side adjacent blocks (LT, . . . , ET1) of the first prediction unit PU0
  • the ET2 block is the leftmost, upper-side adjacent block located at the leftmost position among upper-side adjacent blocks (ET2, . . . , RT1) of the second prediction unit PU1.
  • the common merging candidate blocks for the first PU0 730 and the second prediction unit PU1 750 may include LT, LB1, LB0, RT1, RT0, ET1, and ET2 block.
  • the list of merging candidate blocks of the first prediction unit PU0 730 includes LT, LB1, LB0, RT1, RT0, ET1, and ET2 block while the list of merging candidate blocks of the second prediction unit PU1 750 includes LT, LB1, LB0, RT1, RT0, ET1, and ET2 block.
  • the LT1 block is a left-top side adjacent block of the first prediction unit PU0 530 ; the LB1 block is the bottom-most, left-hand side block located at the lowest position of left-hand side blocks of the first prediction unit PU0; the LB0 block is a lower-side extension adjacent block bordering on the lower-side boundary of the bottom-most, left-hand side adjacent block LB1 of the first prediction unit.
  • the RT1 block is the rightmost, upper-side adjacent block located at the rightmost position of lower-side adjacent blocks (ET2, . . .
  • the RT0 block is a right-hand side extension adjacent block bordering on the right-side boundary of the rightmost, upper-side adjacent block RT1.
  • the ET1 and ET2 block are upper-side central adjacent blocks located in the left and right-hand side of an extension of a boundary line (which corresponds to a line dividing a non-partitioned prediction unit (PU) into three fourths in vertical direction) between the first PU0 and the second prediction unit PU1 among upper-side adjacent blocks of the first PU0 and the second prediction unit PU1.
  • the ET1 block which is an upper-side adjacent block bordering on the boundary line between the first PU0 and the second prediction unit PU1 in the left-hand side
  • the ET2 block which is an upper-side adjacent block bordering on the boundary line between the first PU0 and the second prediction unit PU1 in the right-hand side
  • the ET1 block is the rightmost, upper-side adjacent block located in the rightmost position among upper-side adjacent blocks (LT, . . . , ET1) of the first prediction unit PU0
  • the ET2 block is the leftmost, upper-side adjacent block located at the leftmost position among upper-side adjacent blocks (ET2, . . . , RT1) of the second prediction unit PU1.
  • the list of merging candidate blocks of the first prediction unit PU0 730 includes seven blocks: LT, LB1, LB0, RT1, RT0, ET1, and ET2.
  • the list of merging candidate blocks of the second prediction unit PU1 750 includes the same seven blocks: LT, LB1, LB0, RT1, RT0, ET1, and ET2.
  • the LT, LB1, LB0, RT1, RT0, ET1, and ET2 block included in the list of merging candidate blocks of the second prediction unit PU1 750 includes only adjacent blocks which can be constructed even before reconstructing motion parameters of the first prediction unit PU0.
  • a first process constructing a list of merging candidate blocks (LT, LB1, LB0, RT1, RT0, ET1, and ET2 block) for block merging of the first prediction unit PU0 and a second process constructing a list of merging candidate blocks (LT, LB1, LB0, RT1, RT0, ET1, and ET2 block) for block merging of the second prediction unit PU0 are not performed separately but can be performed as a process 810 constructing a first common merging candidate block; and an encoding (or decoding) process 830 for the second prediction unit PU1 can be performed in parallel with the encoding (or decoding) process 820 for the first prediction unit PU1, thereby reducing encoding time considerably.
  • particular candidate blocks (at least one from among LB0, ET1, ET2, RT0 and RT1) may be omitted from among the seven common merging candidate blocks.
  • the list of common merging candidate blocks in FIGS. 5 to 7 contains seven blocks, the number of blocks included in the list of common merging candidate blocks is not limited to the above example and the list can be constructed only with six, five, or four candidate blocks.
  • a block having motion parameter similar to that of a current block is selected from among the merging candidate blocks and the selected merging candidate block and the current block are merged into one. Selection of a block having motion parameter similar to that of the current block (prediction unit) is performed if the difference between the motion parameter of the current block (prediction unit) and that of each of merging candidate blocks from the set of merging candidate blocks is smaller than a predetermined threshold value.
  • the same motion parameter is applied to the current block and the selected merging candidate block and the same motion parameter is transmitted to a decoder.
  • the decoder can decode the current block by using the information of the merged block and the motion parameter of already-decoded merged block.
  • the first PU0 and the second prediction unit PU1 can include common spatial merging candidate blocks for all the possible partition types irrespective of a partition type and indices of a coding unit having a predetermined size.
  • temporal merging candidate block may be further incorporated into the list of common merging candidate blocks.
  • the first PU0 and the second prediction unit PU1 include temporal merging candidate block as common merging candidate block
  • the first PU0 and the second prediction unit PU1 of a coding unit (CU) may use a reference picture index of a block, at a predetermined particular position, among the spatial common merging candidate blocks as a reference picture index for temporal motion vector prediction (MVP) of temporal merging candidate block.
  • MVP temporal motion vector prediction
  • a motion vector and a reference picture index are transmitted to the decoder.
  • the block at the predetermined particular position can be rendered executable through parallel processing by using previously encoded adjacent blocks which can be constructed even before reconstructing motion parameters of a first PU0 and a second prediction unit PU1 from among blocks included in the list of common merging candidate blocks.
  • the temporal merging candidate block may further be included co-located block, which is included in the previous picture of a current picture and corresponds to a current prediction unit (PU), in the list of common merging candidate list.
  • PU current prediction unit
  • FIG. 9 is a block diagram of a video encoding apparatus using block merging according to one example embodiment of the present invention.
  • a video encoding apparatus includes a encoder 530 and the encoder 530 includes an inter prediction unit 532 , an intra prediction unit 535 , a subtractor 537 , a transform unit 539 , a quantization unit 541 , an entropy encoding unit 543 , an inverse quantization unit 545 , an inverse transform unit 547 , an adder 549 , and a frame buffer 551 .
  • the inter prediction unit 532 includes a motion prediction unit 531 and a motion compensation unit 533 .
  • the encoder 530 performs encoding of an input video.
  • the input video can be used on a prediction unit (PU) basis for inter prediction in the inter prediction unit 532 or intra prediction in the intra prediction unit 535 .
  • PU prediction unit
  • the encoder 530 performs encoding for prediction units.
  • the inter prediction unit 532 splits a currently provided prediction unit to be encoded into partitions by using a partitioning method and generates a motion vector by estimating the motion on a partitioned block basis.
  • the motion prediction unit 531 splits a currently provided prediction unit to be encoded into partitions by using a partitioning method and for each partitioned block, a motion vector is generated on a block basis by searching at least one reference picture (which is stored in a frame buffer after encoding is completed) located before and/or after a current encoding picture for a region similar to a current encoding partitioned block.
  • size of a block used for the motion estimation can be varied.
  • the motion compensation unit 533 generates a prediction block (or predicted prediction unit) obtained by executing motion compensation by using a motion vector generated from the motion prediction unit 531 and the reference picture.
  • the inter prediction unit 532 obtains motion parameters for each merged block by carrying out the block merging described above.
  • the inter prediction unit 532 constructs a list of common merging candidate blocks including a predetermined number of common merging candidate blocks selected from among blocks adjacent to a current coding unit asymmetrically partitioned into a first and a second prediction unit as described above; and selects at least one candidate block from the list of common merging candidate blocks for each of the first and the second prediction unit.
  • the inter prediction unit 532 obtains motion parameters of blocks merged with the current coding unit by using the at least one common merging candidate block selected. Motion parameters for each block merged by carrying out the block merging above are transmitted to the decoder.
  • the intra prediction unit 535 performs intra prediction encoding by using pixel correlation between blocks.
  • the intra prediction unit 535 performs intra prediction which obtains a prediction block of a current prediction unit by predicting pixel values from pre-encoded pixel values of a block within a current frame (or picture).
  • the subtractor 537 generates residues from a prediction block (or predicted prediction unit) provided by the motion compensation unit 533 by subtracting the current block (or current prediction unit); the transform unit 539 and the quantization unit 541 apply DCT (Discrete Cosine Transform) to the residues and quantize the transformed residues.
  • DCT Discrete Cosine Transform
  • the transform unit 539 can carry out transformation based on information about size of a prediction unit; for example, the transform unit 539 can carry out transformation by using a maximum of 32 ⁇ 32 or 64 ⁇ 64 pixel block.
  • the transform unit 539 can perform transformation on a particular transform unit (TU) basis independent of the prediction unit size information provided from the prediction unit determination unit 510 .
  • TU transform unit
  • the transform unit (TU) may take a minimum of 4 ⁇ 4 pixel block to a maximum of 32 ⁇ 32 pixel block. Also, the maximum size of the transform unit (TU) may exceed a 32 ⁇ 32 pixel block—for example, a 64 ⁇ 64 pixel block.
  • the transform unit size information may be included in information about a transform unit and thus transmitted to the decoder.
  • the entropy encoding unit 543 generates a bit stream by applying entropy encoding to header information including quantized DCT coefficients, motion vector, determined prediction unit information, partition information, transform unit information, and so on.
  • FIG. 10 is a flow diagram illustrating a video encoding method using block merging according to one example embodiment of the present invention.
  • Step 610 coding units of the input video are split into partitions by using a partitioning method; for each partitioned block, a motion vector is generated on a block basis by searching at least one reference picture (which is stored in the frame buffer 551 after encoding is completed) located before and/or after a current encoding picture for a region similar to a current encoding partitioned block; prediction blocks (or predicted prediction units) are generated by carrying out motion compensation by using the generated motion vector and the reference picture (Step 620 ).
  • the encoding apparatus obtains a difference between a current prediction unit and the predicted prediction unit and generates residues (Step 640 ).
  • a video encoding apparatus and a video encoding method by using block merging transmits motion parameter only once for the whole blocks merged by block merging rather than transmit respective motion parameter for each of asymmetrically partitioned blocks (prediction units). In this way, since the amount of transmission for motion parameters is reduced, encoding efficiency of video having resolution more than HD or UHD (Ultra High Definition) resolution can be improved.
  • a video decoding apparatus and a video decoding method by using block merging reconstructs a motion vector of a block-merged block by using motion parameter of the block-merged block transmitted from the encoding apparatus described above; a motion prediction unit generates a motion vector on a block basis and the motion compensation unit performs motion compensation by using the motion vector generated by the motion prediction unit and a reference picture.
  • the largest coding unit can be split into a plurality of non-overlapping motion estimation regions (or merge estimation regions); motion estimation can be made to be performed sequentially among motion estimation regions within the largest coding unit (LCU) whereas all the prediction units (PUs) belonging to one motion estimation region within the largest coding unit (LCU) can be made to perform motion estimation in a parallel fashion.
  • size of the motion estimation region may be smaller than that of the LCU and the motion estimation region can have a square shape.
  • a motion estimation region it is determined whether to allow parallel processing of prediction units (PUs) within the motion estimation region by using common merging candidate blocks. For example, suppose size of the smallest prediction unit is 4 ⁇ 4. If size of the motion estimation region is 4 ⁇ 4, a sequential merging operation is applied to all the prediction units within the largest coding unit (LCU). Meanwhile, it can be made such that parallel merging—a technique using common merging candidate blocks to enable parallel processing—is allowed for all the prediction units (PUs) within the motion estimation region only when the size of the motion estimation region is 8 ⁇ 8 or more.
  • a current prediction unit (PU) and an adjacent prediction unit (PU) belong to the same motion estimation region (in other words, within the same motion estimation region)
  • the corresponding adjacent prediction unit is marked as non-available whereas the current prediction unit and the adjacent prediction unit belong to motion estimation regions different from each other, the corresponding adjacent prediction unit is marked as available; thus, availability of the list of common merging candidate blocks for motion vector estimation can be determined.
  • the merging operation described above can be performed by using adjacent common merging candidate blocks available.
  • the first PU0 and the second prediction unit PU1 can include common spatial merging candidate blocks for all the possible partition types irrespective of a partition type and indices of a coding unit having a predetermined size.
  • the list of common merging candidate blocks includes spatial merging candidate blocks comprised of adjacent blocks of the first PU0 and the second prediction unit PU1.
  • temporal merging candidate block may be further incorporated into the list of common merging candidate blocks.
  • the first PU0 and the second prediction unit PU1 include temporal merging candidate block as common merging candidate blocks
  • the first PU0 and the second prediction unit PU1 of a coding unit (CU) may use a reference picture index of a block, at a predetermined particular position, among the spatial common merging candidate blocks as a reference picture index for temporal motion vector prediction (MVP) of temporal merging candidate blocks.
  • MVP temporal motion vector prediction
  • the block at the predetermined particular position can be rendered executable through parallel processing by using previously encoded adjacent blocks which can be constructed even before reconstructing motion parameters of a first PU0 and a second prediction unit PU1 from among blocks included in the list of common merging candidate blocks.
  • a first process constructing a list of merging candidate blocks for block merging of a first prediction unit PU0 generated from asymmetric partition and a second process constructing a list of merging candidate blocks for block merging of a second prediction unit PU1 are not performed separately but can be performed in the form of a single process constituting the common merging candidate block. Since an encoding (or decoding) process for the second prediction unit PU1 can be performed in parallel with an encoding (or decoding) process for the first prediction unit PU0, encoding time can be reduced considerably.

Abstract

The present invention provides video encoding and decoding methods using block merging, which can be applied to a high resolution video of more than HD (High Definition) resolution. A video encoding method includes partitioning a current block into a first and a second prediction unit by using asymmetric partitioning, constructing a list of common merging candidate blocks including a predetermined number of common merging candidate blocks selected from adjacent blocks of the current block, selecting at least one candidate block from among the list of common merging candidate blocks and sending information of the selected candidate block to a decoder for each of the first and the second prediction unit.

Description

CROSS REFERENCE TO RELATED APPLICATION
The present application is a continuation of U.S. patent application Ser. No. 14/308,638, filed on Jun. 18, 2014, and U.S. patent application Ser. No. 13/683,771, filed on Nov. 21, 2012. Further, this application claims the priorities of Korean Patent Application No. 10-2011-0123209, filed on Nov. 23, 2011; and No. 10-2012-0016616, filed on Feb. 17, 2012 in the KIPO (Korean Intellectual Property Office), the disclosure of which are incorporated herein in their entirety by reference.
BACKGROUND
1. Technical Field
The present invention relates to encoding and decoding of video and more specifically, video encoding methods, video encoding apparatuses, video decoding methods, and video decoding apparatuses by using block merging.
2. Description of the Related Art
Conventional video compression uses inter prediction and intra prediction techniques designed to remove redundancy between pictures for improving compression efficiency.
Video encoding algorithms based on intra prediction compress a video by removing temporal redundancy between pictures, where motion compensated inter-frame prediction is a typical technique for this purpose.
Motion compensated inter-frame prediction technique generates a motion vector by searching at least one reference picture located before and/or after a current encoding picture for a region similar to a current encoding block. It applies DCT (Discrete Cosine Transform) to residues between the current block and a prediction block obtained from motion compensation by using the generated motion vector. The result of DCT is transmitted after quantization and entropy encoding.
In case of motion compensated inter prediction, motion vector is generated by dividing a picture into a plurality of blocks having a predetermined size and motion compensation is performed by using the generated motion vector. Individual motion parameters for the respective prediction blocks obtained from motion compensation are transmitted to a decoder.
SUMMARY
Since the number of blocks per picture increases in case of high resolution video of more than HD (High Definition) resolution, it is not desirable in the respect of coding efficiency to transmit motion parameters to a decoder for each prediction block as the amount of motion parameters transmitted becomes considerably large.
Example embodiments of the present invention provides video encoding methods and video encoding apparatuses using block merging which can be applied for high resolution videos of more than HD (High Definition) resolution.
Example embodiments of the present invention also provides video decoding methods and video decoding apparatuses using block merging which can be applied for high resolution videos of more than HD resolution.
In some example embodiments, an encoding method according to one example embodiment of the present invention includes constructing a list of common merging candidate blocks including a predetermined number of common merging candidate blocks selected from among adjacent blocks of a current coding unit asymmetrically partitioned into a first and a second prediction unit; and selecting at least one candidate block from among the list of common merging candidate blocks for each of the first and the second prediction unit and sending information of the selected candidate block to a decoder for each of the first and the second prediction unit. The list of common merging candidate blocks may include commonly used merging candidate blocks in case block merging is performed for the first and the second prediction unit. The block merging can be performed only when the size of the current coding unit is 8-by-8. The largest coding unit (LCU) may be divided into a plurality of non-overlapping motion estimation regions. Motion estimation may be performed sequentially on the motion estimation regions within the largest coding unit. The motion estimation can be performed in a parallel fashion for all prediction units belonging to a motion estimation region within the largest coding unit (LCU). According to the size of the motion estimation region, whether to allow parallel merging for prediction units within the motion estimation region by using the common merging candidate blocks can be determined. The parallel merging for all the prediction units within the motion estimation region may be allowed only when the size of the motion estimation region is larger than a predetermined size. To indicate possibility of processing of the parallel merging according to the size of the motion estimation region, a predetermined value according to the size of the motion estimation region may be transmitted in a PPS (Picture Parameter Set) from an encoder to the decoder. In case the current prediction unit and a prediction unit adjacent to the current prediction unit belong to the same motion estimation region, the corresponding adjacent prediction unit is denoted as non-available, whereas in case the current prediction unit and the prediction unit adjacent to the current prediction unit belong to motion estimation regions different from each other, the corresponding adjacent prediction unit is denoted as available. The list of common merging candidate blocks may include a spatial merging candidate block and a temporal merging candidate block. The first and the second prediction unit within the current coding unit utilize a reference picture index of a block, at a predetermined particular position, from among spatial common merging candidate blocks as a reference picture index for temporal motion vector prediction (MVP) of the temporal merging candidate block. The block, at the predetermined particular position, can be rendered executable through parallel processing by using previously encoded adjacent block which can be constructed even before reconstructing a motion parameter of a first PU0 and a second prediction unit PU1 from among blocks included in the list of common merging candidate blocks. The common merging candidate blocks can be predetermined beforehand according to a rule between the encoder and the decoder.
In other example embodiments, an encoding apparatus includes an inter prediction unit configured to construct a list of common merging candidate blocks including a predetermined number of common merging candidate blocks selected from blocks adjacent to a current coding unit, which have been asymmetrically partitioned into a first and a second prediction unit; and configured to select at least one candidate block from the list of common merging candidate blocks for each of the first and the second prediction unit.
In still other example embodiments, a decoding method according to one example embodiment of the present invention includes constructing a list of common merging candidate blocks including a predetermined number of common merging candidate blocks selected from among adjacent blocks of a current coding unit asymmetrically partitioned into a first and a second prediction unit; generating a motion vector on a block basis by reconstructing a motion parameter of a block-merged block by using at least one candidate block selected from the list of common merging candidate blocks for each of the first and the second prediction unit; and performing motion compensation by using the generated motion vector and a reference picture. The common merging candidate blocks of the second prediction unit consist only of adjacent blocks which can be constructed before a motion parameter of the first prediction unit is reconstructed. The block merging can be performed only when the size of the current coding unit is 8-by-8. The largest coding unit (LCU) may be divided into a plurality of non-overlapping motion estimation regions. Motion estimation may be performed sequentially on the motion estimation regions within the largest coding unit. The motion estimation can be performed in a parallel fashion for all prediction units belonging to a estimation region within the largest coding unit (LCU). According to the size of the motion estimation region, whether to allow a parallel merging for prediction units within the motion estimation region by using the common merging candidate blocks can be determined. The parallel merging for all the prediction units within the motion estimation region is allowed only when the size of the motion estimation region is larger than a predetermined size. In case the current prediction unit and a prediction unit adjacent to the current prediction unit belong to the same motion estimation region, the corresponding adjacent prediction unit is denoted as non-available, whereas in case the current prediction unit and the prediction unit adjacent to the current prediction unit belong to motion estimation regions different from each other, the corresponding adjacent prediction unit is denoted as available. The list of common merging candidate blocks may include a spatial merging candidate block and a temporal merging candidate block. The first and the second prediction unit within the current coding unit utilize a reference picture index of a block, at a predetermined particular position, from among spatial common merging candidate blocks as a reference picture index for temporal motion vector prediction (MVP) of the temporal merging candidate block. The block, at the predetermined particular position, can be rendered executable through parallel processing by using previously encoded adjacent blocks which can be constructed even before reconstructing a motion parameter of a first PU0 and a second prediction unit PU1 from among blocks included in the list of common merging candidate blocks.
In still other example embodiments, includes an inter prediction unit configured to construct a list of common merging candidate blocks including a predetermined number of common merging candidate blocks selected from blocks adjacent to a current coding unit asymmetrically partitioned into a first and a second prediction unit; configured to generate a motion vector on a block basis by reconstructing a motion parameter of a block-merged block by using at least one candidate block selected from the list of common merging candidate blocks for each of the first and the second prediction unit; and configured to perform motion compensation by using the generated motion vector and a reference picture.
BRIEF DESCRIPTION OF THE DRAWINGS
Example embodiments of the present invention will become more apparent by describing in detail example embodiments of the present invention with reference to the accompanying drawings, in which:
FIG. 1 illustrates symmetric partitioning;
FIG. 2 illustrates asymmetric partitioning;
FIG. 3 illustrates block merging of partitioned blocks in case a prediction unit (PU) having size of 2N×2N is partitioned into two N×2N blocks in a vertical direction;
FIG. 4 illustrates a process where block merging of the two partitioned blocks of FIG. 3 and an encoding (or decoding) operation are performed;
FIGS. 5 to 7 illustrate common merging candidate blocks enabling parallel processing of prediction units PU0, PU1 partitioned asymmetrically according to example embodiments of the present invention;
FIG. 8 illustrates a process where block merging of two partitioned blocks in a parallel fashion and an encoding (or decoding) operation are performed;
FIG. 9 is a block diagram of a video encoding apparatus using block merging according to one example embodiment of the present invention; and
FIG. 10 is a flow diagram illustrating a video encoding method using block merging according to one example embodiment of the present invention.
DESCRIPTION OF EXAMPLE EMBODIMENTS OF THE PRESENT INVENTION
Example embodiments of the present invention can be modified in various ways and various example embodiments of the present invention can be realized; thus, this document illustrates particular example embodiments in the appended drawings and detailed description of the example embodiment will be provided.
However, that is not meant for limiting the present invention to the particular example embodiments; rather, it should be understood to include every possible modification, equivalent, or substitute of the present invention which belongs to the technical principles and scope of the present invention.
Terms such as first, second, and so on can be used for describing various components but the components should not be limited by the terms. The terms are introduced only for the purpose of distinguishing one component from the others. For example, a first component may be called a second component without departing from the scope of the present invention and vice versa. The term of and/or indicates a combination of a plurality of related items described or any one of a plurality of related items described.
If a component is said to be “linked” or “connected” to a different component, the component may be directly linked or connected to the different component but a third component may exist to connect the two components even though the two components may be connected directly. On the other hand, if a component is said to be “linked directly” or “connected directly” to another component, it should be interpreted that there is no further component between the two components.
Terms used in this document have been introduced only to describe particular example embodiment, not intended to limit the scope of the present invention. Singular expression should be interpreted to include plural expressions unless otherwise stated explicitly. Terms such as “include” or “have” are meant to signify existence of embodied characteristics, numbers, steps, behavior, components, modules, and combinations thereof, which should be understood that possibility of existence or addition of one or more characteristics, numbers, steps, behavior, components, modules, and combinations thereof are not precluded beforehand.
Unless otherwise defined, all the terms used in this document, whether they are technical or scientific, possess the same meaning as understood by those skilled in the art to which the present invention belongs. The terms such as those defined in a dictionary for general use should be interpreted to carry the same contextual meaning in the related technology and they should not be interpreted to possess an ideal or excessively formal meaning.
It should also be noted that in some alternative implementations, the functions/acts noted in the blocks may occur out of the order noted in the flowcharts. For example, two blocks shown in succession may in fact be executed substantially concurrently or the blocks may sometimes be executed in the reverse order, depending upon the functionality/acts involved.
In what follows, with reference to appended drawings, preferred embodiments of the present invention will be described in more detail. For the purpose of overall understanding of the present invention, the same components of the drawings use the same reference symbols and repeated descriptions for the same components will be omitted.
In one example embodiment of the present invention, encoding and decoding are performed by using recursive coding unit structure to accommodate videos of more than HD (High Definition) resolution.
First, to describe the recursive coding unit structure, it is assumed that each coding unit (CU) is square-shaped and each coding unit (CU) has a variable size of 2N×2N (where the size unit is pixel). Inter prediction, intra prediction, transform, quantization, and entropy encoding may be performed on a CU basis.
The size of a coding unit (LCU) can be represented by powers of two, ranging from 8×8 to 64×64. The coding unit (CU) includes the largest coding unit (LCU) and the smallest coding unit (SCU); for example, the LCU has the size of 64×64 whereas the SCU has the size of 8×8.
The coding unit (CU) has a recursive tree structure. For example, the size 2N0 of one side of the largest coding unit CU0 may be 64 (N0=32) and the largest layer level or layer depth may be 4. A recursive structure may be represented by using a series of flags. For example, in case the flag value of a coding unit (CUk) is 0 and layer level or layer depth of the coding unit is k, coding for the coding unit (CUk) is performed on a current layer level or depth. In case the flag value is 1, the coding unit (CUk) whose current layer level or depth is k is partitioned into four independent coding units (CUk+1). The layer level or depth of the partitioned coding unit (CUk+1) becomes k+1 and the size of the coding unit (CUk+1) becomes (Nk+1)×(Nk+1). In this case the coding unit (CUk+1) can be represented as a sub-coding unit of the coding unit CUk. The coding unit (CUk+1) is processed recursively until the layer level or depth of the coding unit (CUk+1) reaches the maximum allowable layer level or depth. If layer level or depth of the coding unit (CUk+1) is the same as the maximum allowable layer level or depth, further partitioning is not allowed.
If the hierarchical splitting process as described above is completed, inter prediction or intra prediction is performed for terminal nodes of the coding unit hierarchy tree without further splitting, where the terminal coding unit is used as a prediction unit (PU), which is a base unit for inter prediction or intra prediction.
The terminal coding unit is now partitioned to carry out inter prediction or intra prediction. In other words, partitioning is performed on a prediction unit. Here, a prediction unit (PU) represents the base unit for inter prediction or intra prediction. In other words, a prediction unit is obtained as a terminal node of a coding unit hierarchy tree after the hierarchical splitting process is completed; in other words, size of the prediction unit can take one of 64×64, 32×32, 16×16, and 8×8.
One coding unit (CU), to carry out inter prediction or intra prediction, can be partitioned into prediction units. More specifically, a 2N×2N coding unit can be symmetrically partitioned along horizontal or vertical direction.
FIG. 1 illustrates symmetric partitioning. FIG. 1 assumes that size of a coding unit (CU) is 2N×2N (where N is a natural number and represented by pixel units).
With reference to FIG. 1, in case the prediction mode is inter prediction, a 2N×2N coding unit P01 is symmetrically partitioned in horizontal direction to perform the inter prediction, being partitioned into a partition PU0 (P02b) having size of 2N×N and a partition PU1 (P02a) having size of 2N×N; or a partition PU0 (P03a) of N×2N and a partition PU1 (P03b) of N×2N; or N×N partition PU0 (P04a), PU1, PU2, and PU3.
FIG. 2 illustrates asymmetric partitioning. FIG. 2 assumes that size of a coding unit (CU) 2N×2N (where N is a natural number and represented by pixel units).
With reference to FIG. 2, in case the prediction mode is inter prediction, a 2N×2N coding unit is asymmetrically partitioned in horizontal direction to perform the inter prediction, being partitioned into a partition PU0 (P11a) having size of 2N×nU (where nU is 2N×¼) and a partition PU1 (P12a) having size of 2N×nU (where nU is 2N×¾). Similarly, the 2N×2N coding unit can be asymmetrically partitioned in vertical direction, being partitioned into a partition PU0 (P13a) having size of nL×2N (where nL is 2N×¼) and a partition PU1 (P23a) having size of nR×2N (where nR is 2N×¾); or a partition PU0 (P14a) having size of nL×2N (where nL is 2N×¾) and a partition PU1 (P24a) having size of NR×2N (where nR is 2N×¼).
All the information including motion parameters (a motion vector, a difference value of a motion vector, a reference picture index, a reference picture list, and so on) related to inter prediction is transmitted to a prediction unit, which is a base unit for inter prediction, or a decoder for each of the partitioned prediction units.
In case of a video having more than HD (High Definition) resolution, the number of prediction blocks per picture (prediction unit partitioned or not partitioned) increases; therefore, if motion parameters are transmitted to a decoder for each of prediction blocks (prediction blocks partitioned or not partitioned), the amount of motion parameters to be transmitted gets significantly large, which is not desirable with respect to coding efficiency and therefore a method for improving the coding efficiency is needed.
To solve the problem described above, inter-frame encoding may be performed by using block merging. Block merging is a technique intended for improving coding efficiency. In case blocks adjacent to a current block (or prediction unit) encoded prior to the current block have the same motion parameter (a motion vector, a difference value of the motion vector, a reference picture index, a reference picture list, and so on) as that of the current block X, the adjacent blocks having the same motion parameter as that of the current block X are merged with the current block. Since the same motion parameter of the merged blocks is transmitted to a decoder, the amount of motion parameters to be transmitted to the decoder may be reduced without separately transmitting the motion parameter of the current block, and thus coding efficiency may be improved.
For example, in case a picture is split down to a terminal coding unit in the hierarchy, namely, the smallest coding unit (SCU) and a current block (prediction unit) X, which is the SCU, has the same motion vector as a left-side adjacent block A0 and an upper-side adjacent block B0 encoded previously, block A0, B0, and X are merged and transmitted to a decoder as having the same motion parameters. Here, the motion parameters include a motion vector, a difference value of the motion vector, a reference picture index, a reference picture list, and so on. In this case, a merging flag indicating whether block merging has been applied or not can be transmitted to the decoder.
FIG. 3 illustrates block merging of partitioned blocks in case a prediction unit (PU) having size of 2N×2N is partitioned into two N×2N blocks in a vertical direction. FIG. 4 illustrates a process where block merging of the two partitioned blocks of FIG. 3 and an encoding (or decoding) operation are performed.
With reference to FIG. 3, a 2N×2N coding unit (CU) is partitioned into a partition block PU0 having size of 2N×N and a partition block PU1 having size of 2N×N.
In what follows, a partitioned block denotes a partitioned prediction unit, functioning as a prediction unit. In the following, PU0 of FIG. 3 is called a first prediction unit while PU1 of FIG. 3 is called a second prediction unit.
In the following, adjacent blocks bordering the left-side boundary of a partition block (prediction unit) are called left-side adjacent blocks. In the left-hand side of FIG. 3, in case of a first prediction unit PU0 filled with oblique lines, A1 belongs to the left-side adjacent blocks while in the right-hand side of FIG. 3, in case of a second prediction unit PU1 filled with oblique lines, A1 belongs to the left-side adjacent blocks. For the first prediction unit PU0 oblique-lined in the left-hand side of FIG. 3, A0 is a block bordering a bottom-side boundary of an adjacent block A1, which is called a bottom-side extension adjacent block while, for the second prediction unit PU1 oblique-lined in the right-hand side of FIG. 3, A0 is a block bordering a bottom-side boundary of an adjacent block A1, which is called a bottom-side extension adjacent block.
Adjacent blocks bordering a top-side boundary of a partition block (prediction unit) are called top-side adjacent blocks. For the oblique lined, first prediction unit PU0 in the left-hand side of FIG. 3, B1 belongs to the top-side adjacent blocks while, for the oblique lined, second prediction unit PU1 in the right-hand side of FIG. 3, B1 belongs to the top-side adjacent blocks. With respect to the oblique lined, first prediction unit PU0 in the left-hand side of FIG. 3, B0 is called a right-hand side extension adjacent block bordering the right-hand side boundary of a top-side adjacent block B1; meanwhile, with respect to the oblique lined, second prediction unit PU1 in the right-hand side of FIG. 3, B0 is called a right-hand side extension adjacent block bordering the right-hand side boundary of a top-side adjacent block B1.
In the left-hand side of FIG. 3, in case of the oblique lined, first prediction unit PU0, B2 borders on the left top-side edge of the first prediction unit PU0 and B2 is called a left top-side adjacent block.
With reference to FIG. 3 again, for the oblique lined, first prediction unit PU0 in the left-hand side of FIG. 3, five adjacent blocks B2, B1, B0, A1, and A0 shown in the left-hand side of FIG. 3 are used as candidate adjacent blocks for block merging, while, for the oblique lined, second prediction unit PU1 in the right-hand side of FIG. 3, five adjacent blocks B2, B1, B0, A1, and A0 shown in the right-hand side of FIG. 3 are used as candidate adjacent blocks for block merging.
As shown in the right-hand side of FIG. 3, in case the five adjacent blocks B2, B1, B0, A1, and A0 are used as candidate adjacent blocks for block merging with respect to the second prediction unit PU1, the motion parameters of the left-hand side adjacent block A1 cannot be obtained until the motion parameters of the first prediction unit PU0 are reconstructed.
Therefore, as shown in FIG. 3, a process of constructing a list of merging candidate blocks for block merging of the first prediction unit PU0 is first performed and encoding (or decoding) of the first prediction unit is performed and a process of constructing a list of merging candidate blocks for block merging of the second prediction unit PU1 and subsequently encoding (or decoding) of the second prediction unit PU1 is performed.
As a result, it is impossible to carry out parallel processing of the process of constructing a list of merging candidate blocks for block merging of the first prediction unit PU0 and the process of constructing a list of merging candidate blocks for block merging of the second prediction unit PU1.
In what follows, described will be a method for carrying out parallel processing of block merging and an encoding (or decoding) operation for asymmetrically partitioned prediction units according to the example embodiments of the present invention.
FIGS. 5 to 7 illustrate common merging candidate blocks enabling parallel processing of prediction units PU0, PU1 partitioned asymmetrically according to example embodiments of the present invention. FIG. 8 illustrates a process where block merging of two partitioned blocks in a parallel fashion and an encoding (or decoding) operation are performed.
First, with reference to FIGS. 5 and 7, a 2N×2N coding unit (CU) is split into partitions consisting of a partition block PU0 (prediction unit) having size of nL×2N (where nL is 2N×¼) and a partition block PU1 (prediction unit) having size of nR x 2N (where nR is 2N×¾). In what follows, PU0 of FIGS. 5 to 7 is called a first prediction unit while PU1 is called a second prediction unit. Here, size of a coding unit (CU) is 2N×2N (where N is a positive integer) and N can be one of 2, 4, 8, 16, and 32. A technique of utilizing common merging candidate blocks to enable parallel processing of asymmetrically partitioned prediction units PU0 and PU1 can be applied to all of coding units where N can take a value from among 2, 4, 8, 16, and 32 or can be applied to the coding units where N can assume only one particular value—for example, one from among 2, 4, 8, 15, and 32. In case the largest coding unit (LCU) is 64×64, the smaller the size of the coding unit (CU), the larger becomes the number of constructing a list of common merging blocks including common merging candidate blocks for the entire 64×64 block; in this case, if the common merging candidate list is applied for the case where size of the coding unit (CU) is small rather than the case where size of the coding unit (CU) is large, the number of constructing the common merging candidate list can be significantly reduced, thereby reducing complexity. Meanwhile, if parallel processing is performed by applying much more of the common merging list, performance loss becomes large. Therefore, by taking account both of performance loss and complexity, if the minimum size of a prediction unit (PU) is 4×4, for example, complexity can be reduced a lot without sacrificing performance significantly by employing the common merging candidate blocks only for the case where size of the coding unit (CU) is 8×8 (the smallest number 4 excluding 2 is selected from the N values of 2, 4, 8, 16, and 32).
Meanwhile, the largest coding unit can be split into a plurality of non-overlapping motion estimation regions (or merge estimation regions); motion estimation can be made to be performed sequentially among motion estimation regions within the largest coding unit (LCU) whereas all the prediction units (PUs) belonging to one motion estimation region within the largest coding unit (LCU) can be made to perform motion estimation in a parallel fashion. Here, size of the motion estimation region is smaller than that of the LCU and the motion estimation region can have a square shape.
Depending on size of a motion estimation region, it can be determined whether to allow parallel processing of prediction units (PUs) within the motion estimation region by using common merging candidate blocks. For example, suppose size of the smallest prediction unit is 4×4. If size of the motion estimation region is 4×4, a sequential merging operation is applied to all the prediction units within the largest coding unit (LCU). Meanwhile, it can be made such that parallel merging—a technique using common merging candidate blocks to enable parallel processing—is allowed for all the prediction units (PUs) within the motion estimation region only when the size of the motion estimation region is 8×8 or more.
Depending on size of the motion estimation region as described above, a predetermined value can be included in a PPS (Picture Parameter Set) and transmitted from an encoder to a decoder to indicate possibility of the parallel merging depending on the size of the motion estimation region. The predetermined value can take one of 0, 1, 2, 3, and 4, for example; size of the motion estimation region for each of the predetermined values 0, 1, 2, 3, and 4 can be 4×4, 8×8, 16×16, 32×32, and 64×64, respectively.
If a current prediction unit (PU) and an adjacent prediction unit (PU) belong to the same motion estimation region (in other words, within the same motion estimation region), the corresponding adjacent prediction unit is marked as non-available whereas the current prediction unit and the adjacent prediction unit belong to motion estimation regions different from each other, the corresponding adjacent prediction unit is marked as available; thus, availability of the list of common merging candidate blocks for motion vector estimation can be determined. In case part of common merging candidate blocks adjacent to a current coding unit (CU) having size of 8×8 (adjacent prediction units) is not available, the merging operation described above can be performed by using adjacent common merging candidate blocks available.
For the asymmetrically partitioned, first PU0 and the second prediction unit PU1 shown in FIGS. 5 to 7 according to example embodiments of the present invention, block merging and an encoding (or decoding) operation are processed in a parallel fashion for the first PU0 and the second prediction unit PU1 by using common merging candidate blocks.
Referring to FIG. 5, the common merging candidate blocks for the first PU0 530 and the second prediction unit PU1 550 may include LT, LB1, LB0, RT1, RT0, CT1, and CT2 block. In other words, the list of merging candidate blocks for the first prediction unit PU0 530 includes LT, LB1, LB0, RT1, RT0, CT1, and CT2 block while the list of merging candidate blocks of the second prediction unit PU1 550 includes LT, LB1, LB0, RT1, RT0, CT1, and CT2 block.
The LT1 block is a left-top side adjacent block of the first prediction unit PU0 530; the LB1 block is the bottom-most, left-hand side block located at the lowest position of left-hand side blocks of the first prediction unit PU0; the LB0 block is a lower-side extension adjacent block bordering on the lower-side boundary of the bottom-most, left-hand side adjacent block LB1 of the first prediction unit. The RT1 block is the rightmost, upper-side adjacent block located at the rightmost position of lower-side adjacent blocks (CT2, . . . , RT1) of the second prediction unit PU1 550; RT0 block is a right-hand side extension adjacent block bordering on the right-side boundary of the rightmost, upper-side adjacent block RT1. Among upper-side adjacent blocks of the first PU0 and the second prediction unit PU1, the CT1 and the CT2 block are upper-side, central adjacent blocks located in the left-hand and right-hand side of an extension of a central line formed when un-partitioned prediction unit PU is split into halves in vertical direction. Here, the CT1 block which is an upper-side adjacent block and bordering on the central line between the first prediction unit PU0 and the second prediction unit PU1 in the left-hand side is defined as a first upper-side central adjacent block while the CT2 block which is an upper-side adjacent block and bordering on the central line between the first prediction unit PU0 and the second prediction unit PU1 in the right-hand side is defined as a second upper-side central adjacent block.
The list of merging candidate blocks of the first prediction unit PU0 530 includes seven blocks: LT, LB1, LB0, RT1, RT0, CT1, and CT2. The list of merging candidate blocks of the second prediction unit PU1 550 includes the same seven blocks: LT, LB1, LB0, RT1, RT0, CT1, and CT2. Also, the LT, LB1, LB0, RT1, RT0, CT1, and CT2 block included in the list of merging candidate blocks of the second prediction unit PU1 550 includes only adjacent blocks which can be constructed even before reconstructing motion parameters of the first prediction unit PU0.
Also, since LT, LB1, LB0, CT1, and CT2 block among common merging candidate blocks coincide with the candidate merging blocks of the first prediction unit PU0 of FIG. 3, the same performance can be actually secured compared with a case where block merging of the first prediction unit PU0 is applied.
Therefore, as shown in FIG. 8, a first process constructing a list of merging candidate blocks (LT, LB1, LB0, RT1, RT0, CT1, and CT2 block) for block merging of the first prediction unit PU0 and a second process constructing a list of merging candidate blocks (LT, LB1, LB0, RT1, RT0, CT1, and CT2 block) for block merging of the second prediction unit PU1 are not performed separately but can be performed as a single process 810 constructing a single common merging candidate block; and an encoding (or decoding) process 830 for the second prediction unit PU1 can be performed in parallel with the encoding (or decoding) process 820 for the first prediction unit PU1, thereby reducing encoding time considerably.
The common merging candidate blocks can be predetermined beforehand according to a rule between an encoder and a decoder; in this case, information about the common merging candidate blocks doesn't have to be transmitted from the encoder to the decoder.
FIG. 6 illustrates common merging candidate blocks enabling parallel processing of prediction units PU0, PU1 partitioned asymmetrically according to another example embodiment of the present invention.
As shown in FIG. 6, the list of common merging candidate blocks include seven blocks of LT 601, LB1 611, LB0 613, RT1 607, RT0 609, ET1 603, ET2 605. Different from FIG. 4, the first upper-side central adjacent block CT1 and the second upper-side central adjacent block CT2 are in the list; instead ET1 and ET2 are newly included in the list, which is different from the example embodiment of FIG. 5.
Since the remaining LT, LB1, LB0, RT1, and RT0 block are the same as FIG. 5, detailed descriptions will be omitted.
Among upper-side adjacent blocks of the first PU0 and the second prediction unit PU1, the ET1 and ET2 block are upper-side central adjacent blocks located in the left-hand and right-hand side of an extension of a boundary line (which corresponds to a line dividing a non-partitioned prediction unit (PU) into a quarter in vertical direction) between the first PU0 and the second prediction unit PU1. Here, The ET1 block, which is an upper-side adjacent block and bordering on the boundary line between the first PU0 and the second prediction unit PU1 in the left-hand side is defined as a first upper-side edge-adjacent block while the ET2 block, which is an upper-side adjacent block and bordering on the boundary line between the first PU0 and the second prediction unit PU1 in the right-hand side is defined as a second upper-side edge-adjacent block. In other words, the ET1 block is the rightmost, upper-side adjacent block located at the rightmost position among upper-side adjacent blocks (LT, . . . , ET1) of the first prediction unit PU0 while the ET2 block is the leftmost, upper-side adjacent block located at the leftmost position among upper-side adjacent blocks (ET2, . . . , RT1) of the second prediction unit PU1.
Also, in a yet another example embodiment of the present invention, in case a 2N×2N coding unit (CU) is partitioned in vertical direction into a partition block PU0 (prediction unit) having size of nL×2N (where nL is 2N×¾) and a partition block PU1 (prediction unit) having size of nR×2N (where nR is 2N×¼), common merging candidate blocks can be constructed as shown in FIG. 7.
Referring to FIG. 7, the common merging candidate blocks for the first PU0 730 and the second prediction unit PU1 750 may include LT, LB1, LB0, RT1, RT0, ET1, and ET2 block. In other words, the list of merging candidate blocks of the first prediction unit PU0 730 includes LT, LB1, LB0, RT1, RT0, ET1, and ET2 block while the list of merging candidate blocks of the second prediction unit PU1 750 includes LT, LB1, LB0, RT1, RT0, ET1, and ET2 block.
The LT1 block is a left-top side adjacent block of the first prediction unit PU0 530; the LB1 block is the bottom-most, left-hand side block located at the lowest position of left-hand side blocks of the first prediction unit PU0; the LB0 block is a lower-side extension adjacent block bordering on the lower-side boundary of the bottom-most, left-hand side adjacent block LB1 of the first prediction unit. The RT1 block is the rightmost, upper-side adjacent block located at the rightmost position of lower-side adjacent blocks (ET2, . . . , RT1) of the second prediction unit PU1 750; The RT0 block is a right-hand side extension adjacent block bordering on the right-side boundary of the rightmost, upper-side adjacent block RT1. The ET1 and ET2 block are upper-side central adjacent blocks located in the left and right-hand side of an extension of a boundary line (which corresponds to a line dividing a non-partitioned prediction unit (PU) into three fourths in vertical direction) between the first PU0 and the second prediction unit PU1 among upper-side adjacent blocks of the first PU0 and the second prediction unit PU1. Here, the ET1 block, which is an upper-side adjacent block bordering on the boundary line between the first PU0 and the second prediction unit PU1 in the left-hand side, is defined as a first upper-side edge-adjacent block while the ET2 block, which is an upper-side adjacent block bordering on the boundary line between the first PU0 and the second prediction unit PU1 in the right-hand side, is defined as a second upper-side edge-adjacent block. In other words, the ET1 block is the rightmost, upper-side adjacent block located in the rightmost position among upper-side adjacent blocks (LT, . . . , ET1) of the first prediction unit PU0 while the ET2 block is the leftmost, upper-side adjacent block located at the leftmost position among upper-side adjacent blocks (ET2, . . . , RT1) of the second prediction unit PU1.
The list of merging candidate blocks of the first prediction unit PU0 730 includes seven blocks: LT, LB1, LB0, RT1, RT0, ET1, and ET2. The list of merging candidate blocks of the second prediction unit PU1 750 includes the same seven blocks: LT, LB1, LB0, RT1, RT0, ET1, and ET2. Also, the LT, LB1, LB0, RT1, RT0, ET1, and ET2 block included in the list of merging candidate blocks of the second prediction unit PU1 750 includes only adjacent blocks which can be constructed even before reconstructing motion parameters of the first prediction unit PU0.
Therefore, as shown in FIG. 8, a first process constructing a list of merging candidate blocks (LT, LB1, LB0, RT1, RT0, ET1, and ET2 block) for block merging of the first prediction unit PU0 and a second process constructing a list of merging candidate blocks (LT, LB1, LB0, RT1, RT0, ET1, and ET2 block) for block merging of the second prediction unit PU0 are not performed separately but can be performed as a process 810 constructing a first common merging candidate block; and an encoding (or decoding) process 830 for the second prediction unit PU1 can be performed in parallel with the encoding (or decoding) process 820 for the first prediction unit PU1, thereby reducing encoding time considerably.
Although not shown in the figure, in case of asymmetric partitioning into the first PU0 and the second prediction unit PU1 along vertical direction, particular candidate blocks (at least one from among LB0, ET1, ET2, RT0 and RT1) may be omitted from among the seven common merging candidate blocks.
Although the list of common merging candidate blocks in FIGS. 5 to 7 contains seven blocks, the number of blocks included in the list of common merging candidate blocks is not limited to the above example and the list can be constructed only with six, five, or four candidate blocks.
As described above, in case a set of common merging candidate blocks is constructed, a block having motion parameter similar to that of a current block (prediction unit) is selected from among the merging candidate blocks and the selected merging candidate block and the current block are merged into one. Selection of a block having motion parameter similar to that of the current block (prediction unit) is performed if the difference between the motion parameter of the current block (prediction unit) and that of each of merging candidate blocks from the set of merging candidate blocks is smaller than a predetermined threshold value.
The same motion parameter is applied to the current block and the selected merging candidate block and the same motion parameter is transmitted to a decoder.
In case the current block is merged with the selected merging candidate block, information of the merged block is transmitted to the decoder without transmitting motion parameter of the current block to the decoder and the decoder can decode the current block by using the information of the merged block and the motion parameter of already-decoded merged block.
As described in the example embodiment above, in case the first PU0 and the second prediction unit PU1 include adjacent blocks of the first PU0 and the second prediction unit PU1 as spatial merging candidate blocks, the first PU0 and the second prediction unit PU1 can include common spatial merging candidate blocks for all the possible partition types irrespective of a partition type and indices of a coding unit having a predetermined size.
In the previous example embodiment, described was an example where the list of common merging candidate blocks includes spatial merging candidate blocks comprised of adjacent blocks of the first PU0 and the second prediction unit PU1; in another example embodiment of the present invention, temporal merging candidate block may be further incorporated into the list of common merging candidate blocks.
In case the first PU0 and the second prediction unit PU1 include temporal merging candidate block as common merging candidate block, the first PU0 and the second prediction unit PU1 of a coding unit (CU) may use a reference picture index of a block, at a predetermined particular position, among the spatial common merging candidate blocks as a reference picture index for temporal motion vector prediction (MVP) of temporal merging candidate block. Here, in case of temporal motion vector prediction, a motion vector and a reference picture index are transmitted to the decoder. Here, the block at the predetermined particular position can be rendered executable through parallel processing by using previously encoded adjacent blocks which can be constructed even before reconstructing motion parameters of a first PU0 and a second prediction unit PU1 from among blocks included in the list of common merging candidate blocks.
Also, the temporal merging candidate block may further be included co-located block, which is included in the previous picture of a current picture and corresponds to a current prediction unit (PU), in the list of common merging candidate list.
FIG. 9 is a block diagram of a video encoding apparatus using block merging according to one example embodiment of the present invention.
With reference to FIG. 9, a video encoding apparatus includes a encoder 530 and the encoder 530 includes an inter prediction unit 532, an intra prediction unit 535, a subtractor 537, a transform unit 539, a quantization unit 541, an entropy encoding unit 543, an inverse quantization unit 545, an inverse transform unit 547, an adder 549, and a frame buffer 551. The inter prediction unit 532 includes a motion prediction unit 531 and a motion compensation unit 533.
The encoder 530 performs encoding of an input video. The input video can be used on a prediction unit (PU) basis for inter prediction in the inter prediction unit 532 or intra prediction in the intra prediction unit 535.
The encoder 530 performs encoding for prediction units.
The inter prediction unit 532 splits a currently provided prediction unit to be encoded into partitions by using a partitioning method and generates a motion vector by estimating the motion on a partitioned block basis.
The motion prediction unit 531 splits a currently provided prediction unit to be encoded into partitions by using a partitioning method and for each partitioned block, a motion vector is generated on a block basis by searching at least one reference picture (which is stored in a frame buffer after encoding is completed) located before and/or after a current encoding picture for a region similar to a current encoding partitioned block. Here, size of a block used for the motion estimation can be varied.
The motion compensation unit 533 generates a prediction block (or predicted prediction unit) obtained by executing motion compensation by using a motion vector generated from the motion prediction unit 531 and the reference picture.
The inter prediction unit 532 obtains motion parameters for each merged block by carrying out the block merging described above.
In other words, the inter prediction unit 532 constructs a list of common merging candidate blocks including a predetermined number of common merging candidate blocks selected from among blocks adjacent to a current coding unit asymmetrically partitioned into a first and a second prediction unit as described above; and selects at least one candidate block from the list of common merging candidate blocks for each of the first and the second prediction unit.
The inter prediction unit 532 obtains motion parameters of blocks merged with the current coding unit by using the at least one common merging candidate block selected. Motion parameters for each block merged by carrying out the block merging above are transmitted to the decoder.
The intra prediction unit 535 performs intra prediction encoding by using pixel correlation between blocks. The intra prediction unit 535 performs intra prediction which obtains a prediction block of a current prediction unit by predicting pixel values from pre-encoded pixel values of a block within a current frame (or picture).
The subtractor 537 generates residues from a prediction block (or predicted prediction unit) provided by the motion compensation unit 533 by subtracting the current block (or current prediction unit); the transform unit 539 and the quantization unit 541 apply DCT (Discrete Cosine Transform) to the residues and quantize the transformed residues. Here, the transform unit 539 can carry out transformation based on information about size of a prediction unit; for example, the transform unit 539 can carry out transformation by using a maximum of 32×32 or 64×64 pixel block. Also, the transform unit 539 can perform transformation on a particular transform unit (TU) basis independent of the prediction unit size information provided from the prediction unit determination unit 510. For example, the transform unit (TU) may take a minimum of 4×4 pixel block to a maximum of 32×32 pixel block. Also, the maximum size of the transform unit (TU) may exceed a 32×32 pixel block—for example, a 64×64 pixel block. The transform unit size information may be included in information about a transform unit and thus transmitted to the decoder.
The entropy encoding unit 543 generates a bit stream by applying entropy encoding to header information including quantized DCT coefficients, motion vector, determined prediction unit information, partition information, transform unit information, and so on.
The inverse quantization unit 545 inversely quantizes the data quantized through the quantization unit 541 and the inverse transform unit 547 inversely transforms the inversely quantized data. The adder 549 reconstructs a video by adding the inversely transformed data and a predicted prediction unit provided by the motion compensation unit 533 and provides the reconstructed video to the frame buffer 551; the frame buffer 551 stores the reconstructed video.
FIG. 10 is a flow diagram illustrating a video encoding method using block merging according to one example embodiment of the present invention.
With reference to FIG. 10, first, if a input video is provided to an encoding apparatus (Step 610), coding units of the input video are split into partitions by using a partitioning method; for each partitioned block, a motion vector is generated on a block basis by searching at least one reference picture (which is stored in the frame buffer 551 after encoding is completed) located before and/or after a current encoding picture for a region similar to a current encoding partitioned block; prediction blocks (or predicted prediction units) are generated by carrying out motion compensation by using the generated motion vector and the reference picture (Step 620).
Next, the encoding apparatus generates motion parameters for each of merged blocks by carrying out block merging described above for the partitioned prediction units (PUs) (Step 630). Motion parameters for the respective blocks merged by carrying out the block merging described above are transmitted to the decoder.
The encoding apparatus obtains a difference between a current prediction unit and the predicted prediction unit and generates residues (Step 640).
Next, the encoding apparatus transforms the generated residues and quantizes the transformed residues (Step 650); a bit stream is generated by applying entropy encoding to the header information including quantized DCT coefficients, motion parameters, and so on. (Step 660).
A video encoding apparatus and a video encoding method by using block merging according to example embodiments of the present invention transmits motion parameter only once for the whole blocks merged by block merging rather than transmit respective motion parameter for each of asymmetrically partitioned blocks (prediction units). In this way, since the amount of transmission for motion parameters is reduced, encoding efficiency of video having resolution more than HD or UHD (Ultra High Definition) resolution can be improved.
A video decoding apparatus and a video decoding method by using block merging according to example embodiments of the present invention reconstructs a motion vector of a block-merged block by using motion parameter of the block-merged block transmitted from the encoding apparatus described above; a motion prediction unit generates a motion vector on a block basis and the motion compensation unit performs motion compensation by using the motion vector generated by the motion prediction unit and a reference picture.
The video decoding apparatus includes a decoder and the decoder includes an inter prediction unit and an intra prediction unit. The remaining components of the decoder are well-known to the public; therefore, detailed description thereof will be omitted. The inter prediction unit includes a motion prediction unit and a motion compensation unit.
In the same way as the encoding apparatus, the inter prediction unit constructs a list of common merging candidate blocks including a predetermined number of common merging candidate blocks selected from blocks adjacent to a current coding unit, which have been asymmetrically partitioned into a first and a second prediction unit, the inter prediction unit generates a motion vector on a block basis by reconstructing motion parameters of a block-merged block by using at least one candidate block selected from the list of common merging candidate blocks for each of the first and the second prediction unit, and the inter prediction unit performs motion compensation by using the generated motion vector and a reference picture.
In case of a video decoding apparatus and a video decoding method which uses the block merging, size of a coding unit (CU) is 2N×2N (where N is a positive integer) and N can be one of 2, 4, 8, 16, and 32. A technique of utilizing common merging candidate blocks to enable parallel processing of asymmetrically partitioned prediction units PU0 and PU1 can be applied to all of coding units where N can take a value from among 2, 4, 8, 16, and 32 or can be applied to the coding units where N can assume only one particular value—for example, one from among 2, 4, 8, 15, and 32. In case the largest coding unit (LCU) is 64×64, the smaller the size of the coding unit (CU), the larger becomes the number of constructing a list of common merging blocks including common merging candidate blocks for the entire 64×64 block; in this case, if the common merging candidate list is applied for the case where size of the coding unit (CU) is small rather than the case where size of the coding unit (CU) is large, the number of constructing the common merging candidate list can be significantly reduced, thereby reducing complexity. Meanwhile, if parallel processing is performed by applying much more of the common merging list, performance loss becomes large. Therefore, by taking account both of performance loss and complexity, if the minimum size of a prediction unit (PU) is 4×4, for example, complexity can be reduced a lot without sacrificing performance significantly by employing the common merging candidate blocks only for the case where size of the coding unit (CU) is 8×8 (the smallest number 4 excluding 2 is selected from the N values of 2, 4, 8, 16, and 32).
Meanwhile, the largest coding unit (LCU) can be split into a plurality of non-overlapping motion estimation regions (or merge estimation regions); motion estimation can be made to be performed sequentially among motion estimation regions within the largest coding unit (LCU) whereas all the prediction units (PUs) belonging to one motion estimation region within the largest coding unit (LCU) can be made to perform motion estimation in a parallel fashion. For example, size of the motion estimation region may be smaller than that of the LCU and the motion estimation region can have a square shape.
Depending on size of a motion estimation region, it is determined whether to allow parallel processing of prediction units (PUs) within the motion estimation region by using common merging candidate blocks. For example, suppose size of the smallest prediction unit is 4×4. If size of the motion estimation region is 4×4, a sequential merging operation is applied to all the prediction units within the largest coding unit (LCU). Meanwhile, it can be made such that parallel merging—a technique using common merging candidate blocks to enable parallel processing—is allowed for all the prediction units (PUs) within the motion estimation region only when the size of the motion estimation region is 8×8 or more.
If a current prediction unit (PU) and an adjacent prediction unit (PU) belong to the same motion estimation region (in other words, within the same motion estimation region), the corresponding adjacent prediction unit is marked as non-available whereas the current prediction unit and the adjacent prediction unit belong to motion estimation regions different from each other, the corresponding adjacent prediction unit is marked as available; thus, availability of the list of common merging candidate blocks for motion vector estimation can be determined. In case part of common merging candidate blocks adjacent to a current coding unit (CU) having size of 8×8 (adjacent prediction units) is not available, the merging operation described above can be performed by using adjacent common merging candidate blocks available.
As described in the encoding apparatus above, in case the first PU0 and the second prediction unit PU1 include adjacent blocks of the first PU0 and the second prediction unit PU1 as spatial merging candidate blocks, the first PU0 and the second prediction unit PU1 can include common spatial merging candidate blocks for all the possible partition types irrespective of a partition type and indices of a coding unit having a predetermined size.
In the same way as the encoding apparatus, the list of common merging candidate blocks includes spatial merging candidate blocks comprised of adjacent blocks of the first PU0 and the second prediction unit PU1. in addition, temporal merging candidate block may be further incorporated into the list of common merging candidate blocks.
In case the first PU0 and the second prediction unit PU1 include temporal merging candidate block as common merging candidate blocks, the first PU0 and the second prediction unit PU1 of a coding unit (CU) may use a reference picture index of a block, at a predetermined particular position, among the spatial common merging candidate blocks as a reference picture index for temporal motion vector prediction (MVP) of temporal merging candidate blocks. Here, the block at the predetermined particular position can be rendered executable through parallel processing by using previously encoded adjacent blocks which can be constructed even before reconstructing motion parameters of a first PU0 and a second prediction unit PU1 from among blocks included in the list of common merging candidate blocks.
According to methods for encoding/decoding of a video by using block merging as described above, a current block is asymmetrically partitioned to generate a first and a second prediction unit. For each of the first and the second prediction unit, motion parameter(s) are not transmitted but a list of common merging candidate blocks including a predetermined number of common merging candidate blocks selected from blocks adjacent to the current block is constructed. At least one common merging candidate block selected from among common merging candidate blocks belonging to the list of common merging candidate blocks transmits motion parameter(s) only once for the current block and the whole blocks merged. In this way, since the amount of transmission of side information such as the motion parameter is reduced, encoding efficiency of a video of more than HD or UHD (Ultra High Definition) resolution can be improved.
A first process constructing a list of merging candidate blocks for block merging of a first prediction unit PU0 generated from asymmetric partition and a second process constructing a list of merging candidate blocks for block merging of a second prediction unit PU1 are not performed separately but can be performed in the form of a single process constituting the common merging candidate block. Since an encoding (or decoding) process for the second prediction unit PU1 can be performed in parallel with an encoding (or decoding) process for the first prediction unit PU0, encoding time can be reduced considerably.

Claims (7)

What is claimed is:
1. A video decoding method, comprising:
constructing a list of common merging candidate blocks by including a predetermined number of the common merging candidate blocks selected from among adjacent blocks of a current coding unit, the current coding unit partitioned into a first prediction unit and a second prediction unit;
generating a motion vector by reconstructing a motion parameter of a block-merged block by using at least one common merge candidate block selected from the list of common merging candidate blocks for each of the first and the second prediction unit; and
performing motion compensation by using the generated motion vector and a reference picture, wherein the constructing of the list of common merging candidate blocks is performed only when a size of the current coding unit is 8-by-8, wherein a coding unit has a recursive tree structure.
2. The video decoding method of claim 1, wherein the selected at least one common merging candidate blocks for the second prediction unit comprise adjacent blocks which are constructed even before reconstructing a motion parameter of the first prediction unit.
3. The video decoding method of claim 1, wherein a parallel merging for the first prediction unit and the second prediction unit within a motion estimation region is allowed only when a size of the motion estimation region is larger than a predetermined size.
4. The video decoding method of claim 1, wherein a largest coding unit (LCU) is divided into a plurality of non-overlapping motion estimation regions, motion estimation is performed sequentially on the motion estimation regions within the largest coding unit (LCU), and the motion estimation is performed in a parallel fashion for the first prediction unit and the second prediction unit belonging to a motion estimation region within the largest coding unit (LCU).
5. The video decoding method of claim 4, wherein in case both the current prediction unit and another prediction unit adjacent to the current prediction unit belong to the same motion estimation region, said another prediction unit is denoted as non-available, and in case the current prediction unit and said another prediction unit adjacent to the current prediction unit belong to motion estimation regions different from each other, said another prediction unit is denoted as available.
6. The video decoding method of claim 1, wherein the first prediction unit and the second prediction unit within the current coding unit utilize a reference picture index of a block, at a predetermined particular position, from among spatial common merging candidate blocks as a reference picture index for temporal motion vector prediction (MVP) of a temporal merging candidate block.
7. The video decoding method of claim 6, wherein the block, at the predetermined particular position, uses a previously encoded adjacent block which is constructed before reconstructing a motion parameter of the first prediction unit and the second prediction unit from among blocks included in the list of common merging candidate blocks.
US14/478,747 2011-11-23 2014-09-05 Method and encoding/decoding of video using common merging candidate set of asymmetric partitions Active US8929460B1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
US14/478,747 US8929460B1 (en) 2011-11-23 2014-09-05 Method and encoding/decoding of video using common merging candidate set of asymmetric partitions

Applications Claiming Priority (7)

Application Number Priority Date Filing Date Title
KR20110123209 2011-11-23
KR10-2011-0123209 2011-11-23
KR10-2012-0016616 2012-02-17
KR1020120016616A KR101205017B1 (en) 2011-11-23 2012-02-17 Methods for encoding/decoding of video using common merging candidate set of asymmetric partitions
US13/683,771 US8861616B2 (en) 2011-11-23 2012-11-21 Methods for encoding/decoding of video using common merging candidate set of asymmetric partitions
US14/308,638 US9154790B2 (en) 2011-11-23 2014-06-18 Methods for encoding/decoding of video using common merging candidate set of asymmetric partitions
US14/478,747 US8929460B1 (en) 2011-11-23 2014-09-05 Method and encoding/decoding of video using common merging candidate set of asymmetric partitions

Related Parent Applications (1)

Application Number Title Priority Date Filing Date
US14/308,638 Continuation US9154790B2 (en) 2011-11-23 2014-06-18 Methods for encoding/decoding of video using common merging candidate set of asymmetric partitions

Publications (2)

Publication Number Publication Date
US8929460B1 true US8929460B1 (en) 2015-01-06
US20150023426A1 US20150023426A1 (en) 2015-01-22

Family

ID=47500892

Family Applications (5)

Application Number Title Priority Date Filing Date
US13/683,771 Active US8861616B2 (en) 2011-11-23 2012-11-21 Methods for encoding/decoding of video using common merging candidate set of asymmetric partitions
US14/308,638 Active US9154790B2 (en) 2011-11-23 2014-06-18 Methods for encoding/decoding of video using common merging candidate set of asymmetric partitions
US14/479,023 Active US9167250B2 (en) 2011-11-23 2014-09-05 Method and encoding/decoding of video using common merging candidate set of asymmetric partitions
US14/478,715 Active US9172959B2 (en) 2011-11-23 2014-09-05 Method and encoding/decoding of video using common merging candidate set of asymmetric partitions
US14/478,747 Active US8929460B1 (en) 2011-11-23 2014-09-05 Method and encoding/decoding of video using common merging candidate set of asymmetric partitions

Family Applications Before (4)

Application Number Title Priority Date Filing Date
US13/683,771 Active US8861616B2 (en) 2011-11-23 2012-11-21 Methods for encoding/decoding of video using common merging candidate set of asymmetric partitions
US14/308,638 Active US9154790B2 (en) 2011-11-23 2014-06-18 Methods for encoding/decoding of video using common merging candidate set of asymmetric partitions
US14/479,023 Active US9167250B2 (en) 2011-11-23 2014-09-05 Method and encoding/decoding of video using common merging candidate set of asymmetric partitions
US14/478,715 Active US9172959B2 (en) 2011-11-23 2014-09-05 Method and encoding/decoding of video using common merging candidate set of asymmetric partitions

Country Status (3)

Country Link
US (5) US8861616B2 (en)
EP (2) EP2597872A3 (en)
CN (6) CN104918045B (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10623746B2 (en) * 2017-12-07 2020-04-14 Tencent America LLC Method and apparatus for video coding

Families Citing this family (39)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR101474756B1 (en) * 2009-08-13 2014-12-19 삼성전자주식회사 Method and apparatus for encoding and decoding image using large transform unit
EP4009641B1 (en) * 2011-09-09 2023-08-09 LG Electronics Inc. Picture decoding method, picture encoding method, method for transmitting data for picture information and computer-readable storage medium storing bitstream including encoded picture information
EP2597872A3 (en) * 2011-11-23 2013-12-25 Humax Co., Ltd. Methods for encoding/decoding of video using common merging candidate set of asymmetric partitions
KR102088383B1 (en) * 2013-03-15 2020-03-12 삼성전자주식회사 Method and apparatus for encoding and decoding video
US9832478B2 (en) * 2013-05-14 2017-11-28 Mediatek Inc. Video encoding method and apparatus for determining size of parallel motion estimation region based on encoding related information and related video decoding method and apparatus
US10313682B2 (en) * 2013-08-26 2019-06-04 Qualcomm Incorporated Determining regions when performing intra block copying
US9432685B2 (en) * 2013-12-06 2016-08-30 Qualcomm Incorporated Scalable implementation for parallel motion estimation regions
US20150271512A1 (en) * 2014-03-18 2015-09-24 Texas Instruments Incorporated Dynamic frame padding in a video hardware engine
US10721467B2 (en) 2015-05-05 2020-07-21 Lg Electronics Inc. Method and device for processing coding unit in image coding system
CN105306942B (en) * 2015-10-19 2019-02-01 上海增容数据科技有限公司 A kind of coding method of video encoder, apparatus and system
US10306258B2 (en) 2016-01-29 2019-05-28 Google Llc Last frame motion vector partitioning
US10469841B2 (en) 2016-01-29 2019-11-05 Google Llc Motion vector prediction using prior frame residual
CN116708784A (en) * 2016-07-12 2023-09-05 韩国电子通信研究院 Image encoding/decoding method and recording medium therefor
US10721489B2 (en) * 2016-09-06 2020-07-21 Qualcomm Incorporated Geometry-based priority for the construction of candidate lists
JP6895247B2 (en) * 2016-10-06 2021-06-30 日本放送協会 Coding device, decoding device and program
CN106899757A (en) * 2017-02-06 2017-06-27 青岛海信电器股份有限公司 The control method for playing back of audio-video document, device and terminal device
CN117255198A (en) * 2017-03-22 2023-12-19 韩国电子通信研究院 Prediction method and device based on block form
CN116866573A (en) 2017-10-20 2023-10-10 株式会社Kt Video signal processing method and device
EP3701721A1 (en) * 2017-10-27 2020-09-02 Huawei Technologies Co., Ltd. Apparatus and method for picture coding with asymmetric partitioning
KR20210008105A (en) 2018-05-30 2021-01-20 디지털인사이트 주식회사 Video encoding/decoding method and apparatus
EP3811611A4 (en) 2018-06-22 2022-06-15 OP Solutions, LLC Block level geometric partitioning
EP3834422A4 (en) 2018-08-10 2021-09-15 Huawei Technologies Co., Ltd. Coding method, device and system with merge mode
EP3831062A4 (en) * 2018-08-17 2022-07-06 HFI Innovation Inc. Method and apparatus of simplified sub-mode for video coding
WO2020048366A1 (en) * 2018-09-03 2020-03-12 Huawei Technologies Co., Ltd. Coding method, device, system with merge mode
CN110650344B (en) * 2018-09-14 2022-01-21 北京达佳互联信息技术有限公司 Method and device for generating merging candidate list, electronic equipment and storage medium
CN110958452B (en) * 2018-09-27 2023-11-03 华为技术有限公司 Video decoding method and video decoder
EP3861737A4 (en) * 2018-10-05 2022-07-13 OP Solutions, LLC Methods and systems for constructing merge candidate list including adding a non- adjacent diagonal spatial merge candidate
US11818383B2 (en) 2018-10-10 2023-11-14 Hfi Innovation Inc. Methods and apparatuses of combining multiple predictors for block prediction in video coding systems
CN113507603B (en) 2018-11-08 2023-06-23 Oppo广东移动通信有限公司 Image signal encoding/decoding method and apparatus therefor
CN112970250B (en) * 2018-11-12 2022-08-23 寰发股份有限公司 Multiple hypothesis method and apparatus for video coding
WO2020108574A1 (en) * 2018-11-28 2020-06-04 Beijing Bytedance Network Technology Co., Ltd. Improving method for transform or quantization bypass mode
WO2020125798A1 (en) 2018-12-22 2020-06-25 Beijing Bytedance Network Technology Co., Ltd. Intra block copy mode with dual tree partition
US11172214B2 (en) * 2018-12-21 2021-11-09 Qualcomm Incorporated Derivation of processing area for parallel processing in video coding
CN112584173B (en) 2018-12-28 2022-05-31 杭州海康威视数字技术股份有限公司 Coding and decoding method and equipment thereof
CN113647104A (en) 2019-01-28 2021-11-12 Op方案有限责任公司 Inter prediction in geometric partitioning with adaptive region number
AR118250A1 (en) * 2019-03-08 2021-09-22 Jvckenwood Corp MOTION PICTURE CODING AND DECODING DEVICES, METHODS AND PROGRAMS
CN114208197A (en) 2019-08-15 2022-03-18 阿里巴巴集团控股有限公司 Block dividing method for video coding and decoding
EP4022906A4 (en) * 2019-08-30 2022-11-09 Huawei Technologies Co., Ltd. Method and apparatus of high-level signaling for non-rectangular partitioning modes
CA3167878A1 (en) * 2020-01-14 2021-03-11 Huawei Technologies Co., Ltd. Method and apparatus of signaling the number of candidates for merge mode

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH0984052A (en) 1995-09-01 1997-03-28 Internatl Business Mach Corp <Ibm> Method of encoding digital picture and system
WO2009051719A2 (en) 2007-10-16 2009-04-23 Thomson Licensing Methods and apparatus for video encoding and decoding geometically partitioned super blocks
KR20100114220A (en) 2009-04-15 2010-10-25 최지명 A pillow
WO2011128366A1 (en) 2010-04-13 2011-10-20 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. Sample region merging
KR20110135471A (en) 2010-06-11 2011-12-19 (주)휴맥스 Apparatuses and methods for encoding/decoding of video using block merging
US20120257678A1 (en) 2011-04-11 2012-10-11 Minhua Zhou Parallel Motion Estimation in Video Coding
WO2012174990A1 (en) 2011-06-24 2012-12-27 Mediatek Inc. Method and apparatus for removing redundancy in motion vector predictors
WO2013067938A1 (en) 2011-11-07 2013-05-16 LI, Yingjin Method of constructing merge list

Family Cites Families (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP2160900A1 (en) * 2007-06-12 2010-03-10 Thomson Licensing Methods and apparatus supporting multi-pass video syntax structure for slice data
CN104702951B (en) * 2009-12-01 2018-10-19 数码士有限公司 Method and apparatus for coding/decoding high-definition picture
WO2011127963A1 (en) * 2010-04-13 2011-10-20 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. Sample region merging
HUE061303T2 (en) * 2010-05-04 2023-06-28 Lg Electronics Inc Method and apparatus for encoding and decoding a video signal
JP2013545342A (en) * 2010-10-08 2013-12-19 フラウンホッファー−ゲゼルシャフト ツァ フェルダールング デァ アンゲヴァンテン フォアシュンク エー.ファオ Image coding to support block partitioning and block integration
KR101033243B1 (en) 2010-11-17 2011-05-06 엘아이지넥스원 주식회사 Object tracking method and apparatus
JP5893570B2 (en) * 2011-01-28 2016-03-23 パナソニック インテレクチュアル プロパティ コーポレーション オブアメリカPanasonic Intellectual Property Corporation of America Image encoding method and image decoding method
EP2597872A3 (en) * 2011-11-23 2013-12-25 Humax Co., Ltd. Methods for encoding/decoding of video using common merging candidate set of asymmetric partitions

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH0984052A (en) 1995-09-01 1997-03-28 Internatl Business Mach Corp <Ibm> Method of encoding digital picture and system
WO2009051719A2 (en) 2007-10-16 2009-04-23 Thomson Licensing Methods and apparatus for video encoding and decoding geometically partitioned super blocks
KR20100114220A (en) 2009-04-15 2010-10-25 최지명 A pillow
WO2011128366A1 (en) 2010-04-13 2011-10-20 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. Sample region merging
KR20110135471A (en) 2010-06-11 2011-12-19 (주)휴맥스 Apparatuses and methods for encoding/decoding of video using block merging
US20120257678A1 (en) 2011-04-11 2012-10-11 Minhua Zhou Parallel Motion Estimation in Video Coding
WO2012174990A1 (en) 2011-06-24 2012-12-27 Mediatek Inc. Method and apparatus for removing redundancy in motion vector predictors
WO2013067938A1 (en) 2011-11-07 2013-05-16 LI, Yingjin Method of constructing merge list

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
Korean Notice of Allowance of KR Application No. 10-2012-0016616 dated Nov. 16, 2012.
Korean Office Action of KR Application No. 10-2012-0016616 dated Jul. 30, 2012.

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10623746B2 (en) * 2017-12-07 2020-04-14 Tencent America LLC Method and apparatus for video coding

Also Published As

Publication number Publication date
US9167250B2 (en) 2015-10-20
CN104837025B (en) 2018-04-17
CN103139564A (en) 2013-06-05
US20150010084A1 (en) 2015-01-08
US20140301470A1 (en) 2014-10-09
US9154790B2 (en) 2015-10-06
EP2597872A2 (en) 2013-05-29
CN104918045A (en) 2015-09-16
CN106101721B (en) 2017-11-10
EP2942961A1 (en) 2015-11-11
US9172959B2 (en) 2015-10-27
CN104837025A (en) 2015-08-12
CN106101721A (en) 2016-11-09
US8861616B2 (en) 2014-10-14
CN106101720A (en) 2016-11-09
US20150023426A1 (en) 2015-01-22
CN104918045B (en) 2016-08-31
US20150023427A1 (en) 2015-01-22
CN107071457A (en) 2017-08-18
CN106101720B (en) 2018-04-13
US20130128978A1 (en) 2013-05-23
CN107071457B (en) 2018-04-10
EP2597872A3 (en) 2013-12-25

Similar Documents

Publication Publication Date Title
US8929460B1 (en) Method and encoding/decoding of video using common merging candidate set of asymmetric partitions
EP3619914B1 (en) Devices and methods for video processing
CN111757106B (en) Method and apparatus for coding a current block in a video stream using multi-level compound prediction
JP6518274B2 (en) Video decoding method and video coding method
JP2019198101A (en) Inter-prediction method and device thereof
US8218640B2 (en) Picture decoding using same-picture reference for pixel reconstruction
US9628825B2 (en) Video decoder, video encoder, video decoding method, and video encoding method
US20150085933A1 (en) Method and apparatus for encoding multi-view images, and method and apparatus for decoding multi-view images
CN110832869B (en) Motion information acquisition method and device for video coding or decoding
CN113709458B (en) Displacement vector prediction method, device and equipment in video coding and decoding
KR101205017B1 (en) Methods for encoding/decoding of video using common merging candidate set of asymmetric partitions
JP6962193B2 (en) A recording medium that stores a moving image coding device, a moving image coding method, and a moving image coding program.
KR101354086B1 (en) Methods for encoding/decoding of video using common merging candidate set
JP2014150467A (en) Motion estimation apparatus and motion estimation program
KR20140031974A (en) Image coding method, image decoding method, image coding device, image decoding device, image coding program, and image decoding program
KR20130122566A (en) 3d video encoding methods for motion vector prediction using depth information and apparatus, and decoding method and apparatus
KR20150057801A (en) Video coding method for fast intra prediction and apparatus thereof
US10951900B2 (en) Speeding up small block intra-prediction in video coding
KR20170085382A (en) Complexity reduction method for an HEVC merge mode encoder
US10972751B2 (en) Video encoding apparatus and method, and video decoding apparatus and method
Jin et al. A multiple hexagon search algorithm for motion and disparity estimation in multiview video coding
Senthamizharasi et al. A hardware-efficient H. 264/AVC motion estimation using adaptive computation aware algorithm

Legal Events

Date Code Title Description
AS Assignment

Owner name: HUMAX HOLDINGS CO., LTD., KOREA, REPUBLIC OF

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:YIE, CHUNG KU;LEE, YONG JAE;KIM, HUI;REEL/FRAME:033681/0396

Effective date: 20140616

STCF Information on status: patent grant

Free format text: PATENTED CASE

AS Assignment

Owner name: HUMAX CO., LTD., KOREA, REPUBLIC OF

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:HUMAX HOLDINGS CO., LTD.;REEL/FRAME:037931/0526

Effective date: 20160205

MAFP Maintenance fee payment

Free format text: PAYMENT OF MAINTENANCE FEE, 4TH YEAR, LARGE ENTITY (ORIGINAL EVENT CODE: M1551)

Year of fee payment: 4

MAFP Maintenance fee payment

Free format text: PAYMENT OF MAINTENANCE FEE, 8TH YEAR, LARGE ENTITY (ORIGINAL EVENT CODE: M1552); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

Year of fee payment: 8