WO2020175970A1 - 크로마 성분을 예측하는 비디오 부호화 및 복호화 방법, 및 크로마 성분을 예측하는 비디오 부호화 및 복호화 장치 - Google Patents

크로마 성분을 예측하는 비디오 부호화 및 복호화 방법, 및 크로마 성분을 예측하는 비디오 부호화 및 복호화 장치 Download PDF

Info

Publication number
WO2020175970A1
WO2020175970A1 PCT/KR2020/002929 KR2020002929W WO2020175970A1 WO 2020175970 A1 WO2020175970 A1 WO 2020175970A1 KR 2020002929 W KR2020002929 W KR 2020002929W WO 2020175970 A1 WO2020175970 A1 WO 2020175970A1
Authority
WO
WIPO (PCT)
Prior art keywords
component
coding unit
residual sample
information
weight
Prior art date
Application number
PCT/KR2020/002929
Other languages
English (en)
French (fr)
Inventor
표인지
템즈아니쉬
박민수
박민우
정승수
최기호
최나래
최웅일
Original Assignee
삼성전자 주식회사
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 삼성전자 주식회사 filed Critical 삼성전자 주식회사
Priority to KR1020217016261A priority Critical patent/KR102464910B1/ko
Priority to CN202080017377.1A priority patent/CN113545059A/zh
Priority to US17/434,684 priority patent/US12022060B2/en
Priority to BR112021016917A priority patent/BR112021016917A2/pt
Priority to JP2021549642A priority patent/JP7425080B2/ja
Priority to EP20762119.4A priority patent/EP3934251A4/en
Priority to KR1020227038487A priority patent/KR20220151233A/ko
Publication of WO2020175970A1 publication Critical patent/WO2020175970A1/ko
Priority to JP2024006377A priority patent/JP2024026864A/ja
Priority to US18/674,107 priority patent/US20240314294A1/en

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/103—Selection of coding mode or of prediction mode
    • H04N19/105—Selection of the reference unit for prediction within a chosen coding or prediction mode, e.g. adaptive choice of position and number of pixels used for prediction
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/132—Sampling, masking or truncation of coding units, e.g. adaptive resampling, frame skipping, frame interpolation or high-frequency transform coefficient masking
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/103—Selection of coding mode or of prediction mode
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/119—Adaptive subdivision aspects, e.g. subdivision of a picture into rectangular or non-rectangular coding blocks
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
    • H04N19/136—Incoming video signal characteristics or properties
    • H04N19/137—Motion inside a coding unit, e.g. average field, frame or block difference
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
    • H04N19/157—Assigned coding mode, i.e. the coding mode being predefined or preselected to be further used for selection of another element or parameter
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
    • H04N19/157—Assigned coding mode, i.e. the coding mode being predefined or preselected to be further used for selection of another element or parameter
    • H04N19/159—Prediction type, e.g. intra-frame, inter-frame or bidirectional frame prediction
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
    • H04N19/17—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object
    • H04N19/176—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a block, e.g. a macroblock
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
    • H04N19/186—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being a colour or a chrominance component
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/189—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the adaptation method, adaptation tool or adaptation type used for the adaptive coding
    • H04N19/196—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the adaptation method, adaptation tool or adaptation type used for the adaptive coding being specially adapted for the computation of encoding parameters, e.g. by averaging previously computed encoding parameters
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding

Definitions

  • Video encoding and decoding method for predicting chroma components and video encoding and decoding apparatus for predicting chroma components
  • This disclosure relates to the field of video encoding and decoding. More specifically, this disclosure relates to a method and apparatus for encoding and decoding a video predicting a chroma component.
  • High-quality video requires a large amount of data when encoding.
  • the bandwidth allowed to transmit video data is limited, which may limit the data rate applied when transmitting video data. Therefore, efficient video data
  • a method of encoding and decoding video data that increases the compression rate while minimizing the deterioration of the picture quality is required.
  • Video data can be compressed by removing spatial and temporal redundancy between pixels. Since it is common to have common characteristics between adjacent pixels, the data unit consisting of pixels is used to remove redundancy between adjacent pixels. Encoding information is transmitted.
  • the method necessary to obtain is transmitted.
  • the prediction method for predicting the pixel value similar to the original value is determined for each data unit, and encoding information for the prediction method is transmitted from the encoder to the decoder.
  • the predicted value is completely the same as the original value. Therefore, residual data about the difference between the original value and the predicted value is transmitted from the encoder to the decoder.
  • the size of the residual data is increased, but the size of the residual data is reduced. Therefore, the prediction method is determined taking into account the size of the encoding information and the residual data.
  • the data unit divided from the picture has various sizes, but the size of the data unit is The larger it is, the more likely it is that the accuracy of the prediction will decrease, but the encoding information decreases. Therefore, the size of the block is determined according to the characteristics of the picture.
  • prediction methods include intra prediction and inter prediction.
  • Intra prediction is a method of predicting pixels of a block from surrounding pixels of a block.
  • Inter prediction refers to pixels of other pictures referenced by the picture containing the block. Therefore, spatial redundancy is removed by intra prediction and temporal redundancy is removed by inter prediction.
  • the encoding information applied to a block is also 2020/175970 1»(:1 ⁇ 1 ⁇ 2020/002929 It is possible to reduce the size of encoding information by predicting it.
  • a video decoding method includes: acquiring information indicating a prediction type of a coding unit including a current block from a bitstream; From the bitstream, acquiring information for & component of the current block and information for 3 ⁇ 4 component; based on the prediction type of the coding unit, information for the & component, and information for the component , Determining a weight value of the residual sample of the & component and a weight value of the residual sample of the 05 component; obtaining a chroma joint residual sample of the current block from the bitstream; a chroma joint of the current block
  • the residual sample of the & component is restored by using the weight value of the residual sample and the residual sample of the & component, and the weight value of the chroma-joint residual sample of the current block and the ( 3 ⁇ 4 component residual sample) is used. It may include the step of restoring the residual sample of the 05 components.
  • a video encoding method, a decoding method, an encoding apparatus, and a decoding apparatus for predicting a chroma component are a method of effectively encoding and decoding a chroma component using the similarity between the 3 ⁇ 4 component and & Provides.
  • the effects that can be achieved by the video encoding method, the decoding method, the encoding device, and the decoding device for predicting the chroma component according to an embodiment are not limited to those mentioned above, and other effects not mentioned are as follows. From the description of this disclosure, it can be clearly understood by those of ordinary skill in the field of technology to which this disclosure is accelerating.
  • FIG. 1 is a schematic block diagram of an image decoding apparatus according to an embodiment.
  • FIG. 2 shows a flow diagram of an image decoding method according to an embodiment.
  • FIG. 4 is a diagram illustrating a process of determining at least one coding unit by dividing a coding unit in a non-square shape by an image decoding apparatus according to an embodiment.
  • FIG. 5 illustrates a process of dividing a coding unit based on at least one of block type information and division type mode information by an image decoding apparatus according to an embodiment.
  • Figure 6 shows that the image decoding apparatus is among odd number of coding units according to an embodiment.
  • a method for determining a predetermined coding unit is shown.
  • FIG. 7 shows an order in which a plurality of coding units are processed when the image decoding apparatus divides a current coding unit to determine a plurality of coding units according to an embodiment.
  • FIG. 8 illustrates a process of determining that the current coding unit is divided into odd number of coding units when the video decoding apparatus cannot process the coding units in a predetermined order according to an embodiment.
  • FIG. 9 shows that according to an embodiment, an image decoding apparatus divides a first coding unit
  • the form in which the second coding unit can be divided is limited. Shows that.
  • Fig. 11 shows the division mode information in the form of four squares according to an embodiment.
  • FIG. 12 illustrates that the processing order between a plurality of coding units may vary according to the process of dividing the coding units according to an embodiment.
  • FIG. 13 shows a plurality of coding units recursively divided according to an embodiment.
  • FIG. 14 illustrates a depth and index range for classification of coding units, which can be determined according to the shape and size of coding units according to an embodiment, hereinafter ⁇ .
  • FIG. 15 illustrates that a plurality of coding units are determined according to a plurality of predetermined data units included in a picture according to an embodiment.
  • 16 is a diagram showing a block diagram of an image encoding and decoding system.
  • FIG. 17 is a block diagram of a video decoding apparatus according to an embodiment.
  • FIG. 18 is a flowchart illustrating a video decoding method according to an embodiment.
  • 19 is a block diagram of a video encoding apparatus according to an embodiment.
  • 20 is a flowchart illustrating a video encoding method according to an embodiment.
  • 21 is a graph of the relationship between the (3 ⁇ 4 component, & component, and chroma-encoding component) according to an embodiment.
  • Figure 22 shows (between the 3 ⁇ 4 component, & component, and the chroma-coding component) according to an embodiment.
  • FIG. 23 shows a transform unit syntax according to an embodiment.
  • Figure 24 shows a Cb cbf value, a Cb component, a Cr component, and a combination of Cr cbf ⁇ l according to an embodiment.
  • determining the weight value of the residual sample of the Cr component and the weight value of the residual sample of the Cb component may include: a prediction type of the coding unit, cbf information for the Cr component, and the Cb Based on the cbf information for the component, to obtain chroma joint information indicating whether one chroma sample is coded to represent the residual sample of the Cb component and the corresponding residual sample of the Cr component in the current block.
  • the weight of the residual sample of the Cr component may be -1/2, and the weight of the residual sample of the Cb component may be 1.
  • the weight of the residual sample of the Cr component may be -1, and the weight of the residual sample of the Cb component may be 1.
  • the weight of the residual sample of the Cr component may be 1, and the weight of the residual sample of the Cb component may be -1/2.
  • the determining of the weight value of the residual sample of the Cr component and the weight value of the residual sample of the Cb component may include determining whether the prediction type of the coding unit is an intra prediction mode or an inter prediction mode. Accordingly, a step of differently setting the number of joint modes corresponding to a combination of the weight value of the residual sample of the Cr component and the weight value of the residual sample of the Cb component are different.
  • the determining of the weight value of the residual sample of the & component and the weight value of the residual sample of the component comprises: a prediction type of the coding unit
  • the step of determining the weight value of the residual sample of & component and the weight value of the residual sample of 3 ⁇ 4 component is one joint allowed when the prediction type of the coding unit is inter prediction mode.
  • the weight of the residual sample of the & component and the It may include determining the weight of the residual sample of the component.
  • an acquisition unit that obtains a chroma-joint residual sample of the current block; And a prediction type of the coding unit
  • the weight of the sample and the weight of the residual sample of the ( 3 ⁇ 4 component) are determined, and the residual sample of the & component is restored using the weight of the chroma-joint residual sample of the current block and the residual sample of the & component.
  • a decoding unit for restoring the residual sample of the 05 component using a weight value of the chroma-joint residual sample of the current block and the residual sample of the 05 component may be included.
  • one chroma to represent the residual sample of the 05 components and the corresponding residual sample of the & component in the current block Obtain chroma joint information indicating whether or not the sample is encoded
  • the decoding unit When the chroma joint information indicates that one chroma sample is coded, the decoding unit, based on the predicted type of the coding unit, the information for the & component, and the register information for the & component, Determine the weight value of the dual sample and the weight value of the residual sample of the five components, and according to whether the prediction type of the coding unit is an intra prediction mode or an inter prediction mode, the & component 2020/175970 1»(:1 ⁇ 1 ⁇ 2020/00292929
  • the number of joint modes corresponding to the combination of the weight value of the residual sample and the weight value of the residual sample of the 05 components can be set differently.
  • the decoder according to an embodiment, according to one joint mode allowed when the prediction type of the coding unit is the inter prediction mode, the weight of the residual sample of the & component and the weight of the residual sample of the 05 component Can be determined.
  • determining the weight value of the residual sample of the & component and the weight value of the residual sample of the 3 ⁇ 4 component comprising the step of generating a chroma joint residual sample of the current block, The current The residual sample of the & component is restored using the chroma-joint residual sample of the block and the weight value of the residual sample of the & component, and the weight of the chroma-joint residual sample of the current block and the residual sample of the 05 component By using the residual sample of the 05 components can be restored.
  • the video encoding method includes indicating whether one chroma sample is coded to indicate the residual sample of the ( 3 ⁇ 4 component and the corresponding residual sample of the & component in the current block)
  • the method further includes generating chroma joint information, and when one chroma sample is encoded in the current block, based on a prediction type of the coding unit, information for the & component, and information for the five component, The weight of the residual sample of the & component and the weight of the residual sample of the component are determined, and the weight of the residual sample of the & component is determined according to whether the prediction type of the coding unit is an intra prediction mode or an inter prediction mode. And the number of joint modes corresponding to the combination of the weights of the 3 ⁇ 4 component residual samples may be differently set.
  • the weight and the weight of the residual sample of & The step of determining the weight value of the residual sample of the component, when the prediction type of the coding unit is an intra prediction mode, selects one of a plurality of joint modes based on the information for the & component and the information for the component, and , Determining the weight of the residual sample of the & component and the weight of the residual sample of the 3 ⁇ 4 component according to the selected joint mode; And one joint mode allowed when the prediction type of the coding unit is an inter prediction mode Depending on the weight of the residual sample of the above & ingredients and the above It may include determining the weight of the residual sample of the component.
  • a computer-readable recording medium on which a program for implementing a video decoding method according to an embodiment of the present disclosure is recorded with a computer is disclosed.
  • one component is “connected” to another component.
  • the one component When referred to as "connected” or the like, the one component may be directly connected to the other component or may be directly connected, but unless there is a particularly contrary device, it is connected through another component in the middle. Or it should be understood that it can be accessed.
  • the components expressed as' ⁇ sub (unit)','module', etc. are two or more components combined into one component, or one component is divided into more subdivided functions.
  • each of the components to be described below may additionally perform some or all of the functions that other components are responsible for, in addition to the main functions that are in charge of them, and each component is responsible for each component.
  • some of the main functions may be dedicated and performed by other components.
  • sample' is the data assigned to the sampling position of the image
  • the data to be processed can be processed.
  • the pixel value in the image in the spatial domain, and the conversion coefficients in the transform domain can be samples.
  • the unit including at least one sample can be defined as a block.
  • It can mean a block of the largest coding unit, coding unit, prediction unit, or transformation unit of the current image to be encoded or decoded.
  • a motion vector in the direction of list 1 means that it is a motion vector used to point to the block in the reference picture included in list 1.
  • list 0 or 2020/175970 1»(:1 ⁇ 1 ⁇ 2020/002929 It can mean that it is a motion vector used to point to a block in the reference picture included in list 1, and that a motion vector is bidirectional means that the motion vector is in list 0 direction. It can mean that it contains a motion vector of and a motion vector in the direction of list 1.
  • FIGS. 1 to 16 an image of an image according to an exemplary embodiment.
  • FIGS. 3 to 16 an image of an image according to an exemplary embodiment.
  • a method of determining the data unit will be described, and a video encoding/decoding method using tiles and tile groups according to an embodiment will be described below with reference to FIGS. 17 to 28.
  • FIG. 1 is a schematic block diagram of an image decoding apparatus according to an embodiment.
  • the image decoding apparatus 100 may include a receiving unit 110 and a decoding unit 120.
  • the receiving unit 110 and the decoding unit 120 may include at least one processor.
  • the receiving unit 0 and the decoding unit 120 may include a memory for storing instructions to be executed by at least one processor.
  • the receiving unit 0 may receive a bitstream.
  • the bitstream includes information obtained by encoding an image by an image encoding apparatus 2200, which will be described later.
  • the bitstream may be transmitted from the image encoding apparatus 2200.
  • the image encoding device 2200 and the image decoding device 100 can be connected by wire or wireless, and the receiver 110 can receive the bitstream through wired or wireless.
  • the receiver (0) is an optical media, hard disk, and Bitstreams can be received from storage media such as.
  • the decoding unit 120 may restore an image based on information acquired from the received bitstream.
  • the decoding unit 120 may acquire a syntax element for restoring the image from the bitstream.
  • the decoding unit 120 The image can be restored based on the syntax element.
  • FIG. 2 is a flowchart illustrating a method of decoding an image according to an exemplary embodiment.
  • the receiving unit 0 receives a bitstream.
  • the video decoding apparatus 100 performs a step 210 of acquiring a bin string corresponding to a division mode mode of a coding unit from a bitstream.
  • the video decoding apparatus 100 determines a division rule for a coding unit.
  • the video decoding apparatus 100 performs a step 230 of dividing a coding unit into a plurality of coding units based on at least one of the bin string corresponding to the split mode and the split rule.
  • the image decoding apparatus 100 may determine an allowable first range of the size of the coding unit according to the ratio of the width and height of the coding unit to determine the segmentation rule.
  • the image decoding apparatus 100 In order to determine the division rule, the second allowable range of the size of the coding unit according to the division mode mode of the coding unit is determined. 2020/175970 1»(:1 ⁇ 1 ⁇ 2020/002929 can be decided.
  • a picture can be divided into one or more slices or more than one tile.
  • a slice or tile can be a sequence of one or more Coding Tree Units (CTU).
  • CTU Coding Tree Unit
  • CTB coding tree block
  • the maximum coding block is an NxN block containing NxN samples.
  • Each color component can be divided into one or more maximum coding blocks.
  • the maximum coding unit is the maximum coding block of the luma sample and the two maximum coding blocks of the corresponding chroma samples.
  • the maximum coding unit includes the maximum coding block of the monochromatic sample and the syntax structures used to encode the monochrome samples.
  • the maximum coding unit is a unit including syntax structures used to code the picture and its samples.
  • One maximum coding block can be divided into MxN coding blocks including MxN samples (M and N are integers).
  • Unit; CU is a unit including a coding block of a luma sample, two coding blocks of chroma samples corresponding thereto, and syntax structures used to encode a luma sample and chroma samples.
  • the coding unit is a unit.
  • the coding unit is the coding unit of the picture and the samples of the picture. It is a unit that contains the syntax structures used to do so.
  • the maximum coding block and the maximum coding unit are
  • the encoding block and the encoding unit are distinct concepts, i.e., the (maximum) encoding unit means a data structure including the (maximum) encoding block containing the sample and the syntax structure corresponding to it.
  • the person skilled in the art refers to the (maximum) coding unit or the (maximum) coding block designating a block of a predetermined size containing a predetermined number of samples, so in the following specification, the maximum coding block and the maximum coding unit, or the coding block and coding unit Unless there are special circumstances, it is mentioned without distinction.
  • An image can be divided into a maximum coding unit (CTU). 2020/175970 1»(:1 ⁇ 1 ⁇ 2020/002929
  • the size of the coding unit can be determined based on information obtained from the bitstream.
  • the shape of the maximum coding unit can have the same size square. However, this is limited to this. It is not.
  • information on the maximum size of a luma coded block can be obtained from a bitstream.
  • the maximum size of a luma coded block indicated by information about the maximum size of a luma coded block is 4x4, 8x8, It can be one of 16x16, 32x32, 64x64, 128x128, 256x256.
  • Information on the difference in size and luma block size can be obtained.
  • Information on the difference in luma block size can indicate the size difference between the maximum luma coding unit and the maximum luma coded block that can be divided into two. Therefore, obtained from the bitstream
  • the size of the maximum luma encoding unit can be determined.
  • the size of the chroma maximum coding unit can also be determined. For example, if the Y:Cb:Cr ratio is 4:2:0 according to the color format, the size of the chroma block is It can be half the size, and likewise, the size of the chroma maximum coding unit can be half the size of the luma maximum coding unit.
  • the maximum size of a luma coded block capable of binary splitting may be determined variably. Unlike this, the maximum size of a luma coded block that can be ternary split can be fixed. For example, the maximum size of a luma coded block that can be ternary split in an I picture is 32x32, and a P picture or B picture The maximum size of a luma-coded block that can be ternary partitioned in can be 64x64.
  • the maximum coding unit can be hierarchically divided into coding units based on the split type mode information obtained from the bitstream.
  • At least one of the information indicating s, segment direction information, and segment type information may be obtained from the bitstream.
  • information indicating whether or not the coding unit is quad split can indicate whether the current coding unit is to be quad split (QUAD_SPLIT) or not quad split.
  • the information indicating whether or not the current coding unit is divided is whether the current coding unit is no longer divided (NO_SPLIT) or
  • the division direction information indicates that the current coding unit is divided into either the horizontal direction or the vertical direction.
  • the division type information indicates that the current coding unit is divided into binary division) or ternary division. 2020/175970 1»(:1/10 ⁇ 020/002929 Depending on the division direction information and division type information, the division mode of the current coding unit can be determined.
  • the division mode is Binary horizontal division (SPLIT_BT_H0R), ternary horizontal division (SPLIT_TT_H0R) when ternary division in the horizontal direction, and division mode when binary division in the vertical direction are binary vertical division (SPLIT_BT_VER) and ternary division in the vertical direction
  • the division mode of is ternary vertical division
  • the video decoding apparatus 100 can obtain the split mode mode information from the bitstream from one bin string.
  • the video decoding apparatus 100 receives
  • the format of the bitstream can include fixed length binary code, unary code, truncated unary code, predetermined binary record, etc.
  • An empty string is a binary sequence of information.
  • An empty string can consist of at least one bit.
  • the video decoding apparatus 100 may obtain information on the division mode mode corresponding to the bin string based on the division rule.
  • the video decoding apparatus 100 may determine whether to quad-divide the coding unit based on one bin string. You can decide whether not to divide or to decide the direction and type of the division.
  • the coding unit may be less than or equal to the largest coding unit; for example, the largest coding unit is also one of the coding units since it is a coding unit having the largest size.
  • the coding unit determined in the maximum coding unit has the same size as the maximum coding unit.
  • the maximum Coding units can be divided into coding units.
  • the division type mode information for the coding unit indicates division, the coding units can be divided into coding units of smaller size.
  • the maximum coding unit and the coding unit may not be distinguished. The division of the coding unit will be described in more detail in FIGS. 3 to 16.
  • one or more prediction blocks for prediction can be determined from the coding unit.
  • the prediction block may be less than or equal to the coding unit.
  • one or more transform blocks for transformation may be determined from the coding unit.
  • the transform block may be equal to or less than the coding unit.
  • the shape and size of the transform block and prediction block may not be related to each other.
  • a coding unit is used as a prediction block.
  • Prediction can be performed. Further, transformation can be performed using a coding unit as a transform block in which the coding unit is used.
  • the current block and the neighboring block of the present disclosure may represent one of a maximum coding unit, a coding unit, a prediction block, and a transform block.
  • the current block or The current coding unit is 2020/175970 1»(:1 ⁇ 1 ⁇ 2020/002929 Blocks in which decoding or encoding is currently in progress, or blocks in which partitioning is currently in progress.
  • the neighboring block may be a block restored before the current block.
  • the neighboring block is the current block. It can be spatially or temporally adjacent from the current block.
  • the surrounding block can be located in one of the lower left, left, upper left, upper, upper right, lower right, and lower right of the current block.
  • FIG. 3 illustrates a process of determining at least one coding unit by dividing the current coding unit by the image decoding apparatus according to an embodiment.
  • the block type may include 4Nx4N, 4Nx2N, 2Nx4N, 4NxN, Nx4N, 32NxN, Nx32N, 16NxN, Nxl6N, 8NxN or Nx8N, where N may be a positive integer.
  • the block type information is information indicating at least one of the shape of the coding unit, the ratio or size of the room 3 ⁇ 4 width and height.
  • the shape of the coding unit may include square and non-square. If the width and height of the coding unit are the same (ie, the block type of the coding unit is 4NX4N) , The image decoding device W0 may determine the block type information of the coding unit as a square. The image decoding device 100 may determine the shape of the coding unit as a non-square.
  • the video decoding device 100 can determine the block type information of the coding unit in a non-square format.
  • the video decoding apparatus 100 adjusts the ratio of the width and height of the block type information of the coding unit to 1:2, 2: 1, 1 :4, 4: 1, 1 :8, 8: At least one of 1, 1: 16, 16: 1, 1:32, 32: 1 can be determined.
  • the video decoding apparatus 100 determines whether it is a horizontal direction or a vertical direction. Further, based on at least one of the width, height, or width of the coding unit, the image decoding apparatus 100 may determine the size of the coding unit.
  • the video decoding apparatus 100 may determine the shape of a coding unit using block type information, and determine in what type the coding unit is divided using the division type mode information. That is, the method of dividing the coding unit indicated by the division type mode information may be determined according to which block type the block type information used by the video decoding apparatus 100 indicates.
  • the video decoding apparatus 100 can obtain the split mode mode information from the bitstream. However, it is not limited thereto, and the video decoding apparatus W0 and the video encoding apparatus 2200 are based on block shape information.
  • the video decoding apparatus 100 can determine the predetermined division mode information for the largest coding unit or the smallest coding unit. For example, the video decoding apparatus 100 Can be determined by quad splitting the division type mode information for the maximum coding unit.
  • the video decoding apparatus 100 has the minimum 2020/175970 1»(:1 ⁇ 1 ⁇ 2020/002929 For the coding unit, the split mode information can be determined as “no split”. Specifically, the video decoding apparatus 100 determines the size of the maximum coding unit.
  • the video decoding device 100 can determine the pre-appointed split mode information by quad splitting Quad split is a split mode in which both the width and height of the coding unit are divided into two. 100) can obtain a 128x128 coding unit from a 256x256 maximum coding unit based on the split mode information. In addition, the video decoding apparatus 100 can determine the minimum coding unit size as 4x4. (100) can obtain the division type mode information indicating "no division" for the minimum coding unit.
  • the image decoding device 00) is a current coding unit is a square
  • Block shape information indicating that it is a shape can be used.
  • the video decoding device 100 may not divide a square coding unit, divide it vertically, divide it horizontally, or divide four coding units according to the division type mode information. 3, if the block type information of the current coding unit 300 indicates a square shape, the decoding unit 120 is divided according to the division type mode information indicating that it is not divided.
  • a coding unit that has the same size as the current coding unit (300) (a coding unit that does not divide the character 0 or is divided based on the division mode information indicating a predetermined division method (31A5, 310 310(1, 310 31)) Oh, etc.) can be determined.
  • the image decoding device 100 is divided form mode information to coding units of the divided one or two the current coding unit 300 in the vertical direction based on indicating that the division in the vertical direction according to neunil embodiment (self 5
  • the video decoding apparatus 100 can determine two coding units (ruler 0) by dividing the current coding unit 300 in the horizontal direction based on the division mode information indicating that the video is divided in the horizontal direction.
  • the decoding device 100 is able to determine four coding units (character 0(1)) which divided the current coding unit 300 in the vertical and horizontal directions based on the division mode information indicating that they are divided in the vertical and horizontal directions. is.
  • the video decoding apparatus 100 can determine three coding units (quarters of characters) by dividing the current coding unit 300 in the horizontal direction based on the split mode information indicating that the ternary division in the horizontal direction is performed.
  • the division type in which the coding unit of a square can be divided should not be interpreted only as described above, but may include various types in which the division type mode information can appear.
  • Figure 4 is an image decoding apparatus according to an embodiment is non-coded in the form of a square 2020/175970 1»(:1 ⁇ 1 ⁇ 2020/002929 The process of determining at least one coding unit by dividing the unit is shown.
  • the video decoding apparatus 00) may use block shape information indicating that the current coding unit is a non-square type.
  • the video decoding apparatus 100 may use the non-square current coding according to the division mode information. It is possible to decide whether to divide the unit or not by a predetermined method. Referring to Fig. 4, when the block shape information of the current coding unit (400 or 450) shows a non-square shape, the video decoding device (100) Determines the coding unit (410 or 460) having the same size as the current coding unit (400 or 450) according to the split mode information indicating that no division is made, or based on the division type mode information indicating a predetermined division method.
  • the divided coding units (420 42(3 ⁇ 4, 430 43(3 ⁇ 4, 4300, 470 47(3 ⁇ 4, 480 ⁇ 48)5, 480) can be determined.
  • the predetermined division method in which non-square coding units are divided is as follows. It will be described in detail through various embodiments.
  • the video decoding apparatus 100 may determine a form in which a coding unit is divided using the split mode information, and in this case, the split mode mode information is at least one encoding generated by dividing the coding unit. The number of units can be indicated. Referring to Fig. 4, when the split mode information indicates that the current coding unit (400 or 450) is divided into two coding units, the video decoding device 100 is used to display the split mode information. Based on the current coding unit (400 or 450), it is possible to determine the ratio of two coding units (420 42 (3 ⁇ 4, or 470 470) to be included in the current coding unit.
  • the video decoding device ( ⁇ 0) divides the current coding unit (400 or 450) of the non-square shape based on the division mode information
  • the video decoding device 100 is non-
  • the current coding unit can be divided by taking into account the position of the long side of the current coding unit (400 or 450) of the square.
  • the video decoding device (100) considers the shape of the current coding unit (400 or 450), and the current coding unit (400 or 450) is considered.
  • Multiple coding units can be determined by dividing the current coding unit (400 or 450) in the direction of dividing the long side of the unit (400 or 450).
  • the video decoding apparatus 100 when the division mode information indicates that the coding unit is divided into odd-numbered blocks (ternary division), the video decoding apparatus 100 is included in the current coding unit (400 or 450). An odd number of coding units can be determined. For example, if the segmentation mode information indicates that the current coding unit (400 or 450) is divided into three coding units, the video decoding device (100) uses the current coding unit (400 or 450) into three coding units ( It can be divided into 430 43 (3 ⁇ 4, 4300, 480 48 (3 ⁇ 4, 480).
  • the ratio of the width and height of the current coding unit may be 4:1 or 1:4.
  • the ratio of the width and height is 4:1, the length of the width is Since it is longer than the length of the height, the block type information may be in the horizontal direction. If the ratio of the width and the height is 1:4, the block type information is vertical because the length of the width is shorter than the length 2020/175970 1» (: may be 1 ⁇ 1 ⁇ 2020/002929 direction.)
  • the video decoding apparatus 100 may determine to divide the current coding unit into odd-numbered blocks based on the division mode information.
  • video decoding The device 100 may determine the dividing direction of the current coding unit (400 or 450) based on the block type information of the current coding unit (400 or 450). For example, when the current coding unit 400 is in the vertical direction. , The video decoding device 100 can determine the coding unit 430 43 (3 ⁇ 4, 430) by dividing the current coding unit 400 in the horizontal direction. In addition, when the current coding unit 450 is in the horizontal direction, the video decoding device (100) can determine the coding unit (480 48 (3 ⁇ 4, 480) by dividing the current coding unit 450 in the vertical direction.
  • the image decoding apparatus 100 may determine an odd number of coding units included in the current coding unit (400 or 450), and not all of the determined coding units may have the same size. For example, ,The determined odd number of coding units (430 43(3 ⁇ 4, 4300, 480 48(3 ⁇ 4, 480) double predefined coding units (43(3 ⁇ 4 or 48(3 ⁇ 4)) are different from other coding units (430 4300, 480 480)). In other words, the coding unit that can be determined by dividing the current coding unit (400 or 450) can have multiple types of sizes, and in some cases, an odd number of coding units (430 43 (3 ⁇ 4, 4300, 480 48 (3 ⁇ 4, 480 may each have different sizes.
  • the image decoding apparatus 100 determines the odd number of coding units included in the current coding unit (400 or 450). Furthermore, the image decoding apparatus 100 may place a predetermined limit on at least one coding unit among the odd number of coding units generated by dividing. Referring to FIG. 4, the image decoding apparatus 100 is currently a coding unit. (400 or 450) is divided into three coding units (430 43 (3 ⁇ 4, 4300, 480 48 (3 ⁇ 4, 480)), the encoding unit located in the center (the decoding process for the 43 (3 ⁇ 4, 480 ratio) is different The unit (430 43 (, 480 480 can be different.
  • the video decoding apparatus 100 is a coding unit located at the center (for the 43 (3 ⁇ 4, 480 ratio), different coding units (430 4300, 480 480) You can limit the division so that it is no longer divided, or you can limit the division to a predetermined number of times.
  • FIG. 5 is a diagram illustrating a process of dividing a coding unit based on at least one of block type information and division type mode information by an image decoding apparatus according to an embodiment.
  • the image decoding apparatus 100 determines that the first coding unit 500 of the square shape is divided into coding units or not divided based on at least one of the block type information and the division type mode information. According to an embodiment, when the division mode information indicates that the first coding unit 500 is divided in the horizontal direction, the video decoding apparatus 100 divides the first coding unit 500 in the horizontal direction to Two coding units (0) can be determined. According to one embodiment 2020/175970 1»(:1 ⁇ 1 ⁇ 2020/002929 The first coding unit, the second coding unit, and the third coding unit are terms used to understand the relationship before and after the division between coding units.
  • the second coding unit can be determined, and when the second coding unit is divided, the third coding unit can be determined.
  • the first coding unit, the second coding unit, and the third coding unit to be used can be determined.
  • the relationship can be understood as following the characteristics described above.
  • the image decoding apparatus 100 may determine that the determined second coding unit 510 is divided into coding units or not divided into coding units based on the division mode information. Referring to FIG.
  • the video decoding apparatus 100 divides the first coding unit 500 based on the split mode information to determine at least one third coding unit 510 in a non-square shape determined by dividing the first coding unit 500. It can be divided into 3 ⁇ 4, 52 ( ⁇ 520 (1st)) or the second coding unit (0) can not be divided.
  • the video decoding device 100 can acquire the division mode information, and the video decoding device 100 can obtain the acquired data.
  • the first coding unit (500) can be divided to divide a plurality of second coding units (e.g., 510) of various types, and the second coding unit (0) is the division type mode information.
  • the first coding unit 500 may be divided according to the divided method. According to one embodiment, the first coding unit 500 is divided based on the division type mode information for the first coding unit 500.
  • the second coding unit (510) is also based on the split mode mode information for the second coding unit (0), and the third coding unit (e.g., 520&, 52(3 ⁇ 4, It can be divided into 520 0 , 520 (1st, etc.), that is, the coding unit can be divided recursively based on the division type mode information related to each coding unit, and thus from the non-square coding unit to the square coding unit May be determined, and the coding unit of the square shape may be recursively divided to determine the coding unit of the non-square shape.
  • the third coding unit e.g., 520&, 52(3 ⁇ 4, It can be divided into 520 0 , 520 (1st, etc.
  • the determined odd number of third coding units (out of 52 (3 ⁇ 4, 5200, 520(1)) defined coding units (e.g., the center coding unit or the square coding unit) can be divided recursively.
  • the third coding unit (520 ratio is divided in the horizontal direction, which is one of 52 (3 ⁇ 4, 5200, 520(1)) of the odd number of third coding units (52 (3 ⁇ 4, 5200, 520(1)) can be divided into a plurality of fourth coding units.
  • One of the plurality of fourth coding units (530 53 (3 ⁇ 4, 5300, 530(1)), a non-square fourth coding unit (53 (3 ⁇ 4 or 530(1)) may be divided into a plurality of coding units again.
  • the fourth coding unit (53 (3 ⁇ 4 or 530(1)) in a non-square shape may be subdivided into an odd number of coding units.
  • Various examples of methods that can be used for recursive division of coding units are described. It will be described later.
  • the image decoding apparatus ( ⁇ 0) can divide each of the third coding units (520 52 (3 ⁇ 4, 5200, 520 (1, etc.)) into coding units based on the split mode information. 2020/175970 1»(:1 ⁇ 1 ⁇ 2020/002929.
  • the video decoding apparatus 100 can decide not to divide the second coding unit (0) based on the division mode information.
  • the second coding unit 5 in a non-square shape may be divided into an odd number of third coding units 52 (3 ⁇ 4, 520 0 , 520 (1).
  • the image decoding apparatus 100 May impose a certain limit on the third coding unit of an odd number of third coding units (52(3 ⁇ 4, 520 0 , 520(1)).
  • the image decoding apparatus 100 may have an odd number of third coding units. (Coding units located in the middle of 52(3 ⁇ 4, 520 0 , 520(1)) (For 520, it can be limited to those that are no longer divided, or those that must be divided by a settable number of times.
  • the image decoding device 00 is among the odd number of third coding units (52(3 ⁇ 4, 520 0 , 520(1)) included in the second coding unit 510 of a non-square shape.
  • Coding units located at (520 is no longer divided, or divided into a predetermined division (e.g., divided into only four coding units or divided into a form corresponding to the divided form of the second coding unit (5)). It may be limited or limited to division only by a predetermined number of times (for example, division by only II times, 11>0)
  • the above-described embodiment since the above limitation on the encoding unit (520) located in the center is only examples. It should not be interpreted as being limited to these, but should be interpreted as including various restrictions that can be decoded differently from the other coding units (52(3 ⁇ 4, 520(1)), where the encoding unit located in the center (520).
  • the image decoding apparatus 100 may obtain information on a division mode mode used to divide a current coding unit at a predetermined location in the current coding unit.
  • FIG. 6 shows that the image decoding apparatus is among odd number of coding units according to an embodiment.
  • a method for determining a predetermined coding unit is shown.
  • the division mode information of the current coding unit (600, 650) is a sample at a predetermined position among a plurality of samples included in the current coding unit (600, 650) (for example, a center position
  • the predetermined position within the current coding unit 600 where at least one of these division type mode information can be obtained is limited to the center position shown in Fig. 6 and should not be interpreted.
  • the predetermined position should be interpreted as being capable of including various positions (e.g., top, bottom, left, right, top left, bottom left, top right, bottom right, etc.) that can be included in the current coding unit 600.
  • the image decoding apparatus 100 may determine whether to divide or not divide the current coding unit into coding units of various shapes and sizes by acquiring the division type mode information obtained from a predetermined location.
  • the video decoding apparatus 00 may select one of the coding units.
  • the method for selecting one of the plurality of coding units can be varied, 2020/175970 1» (: 1 ⁇ 1 ⁇ 2020/002929) The description of these methods will be described later through various examples below.
  • the video decoding apparatus 00 may divide a current coding unit into a plurality of coding units and determine a coding unit at a predetermined location.
  • the image decoding apparatus 100 includes an odd number of coding units.
  • the image decoding apparatus 100 is configured to be in the current coding unit 600 or the current coding unit ( 650) can be divided to determine odd number of coding units (620 62 (3 ⁇ 4, 620 0) or odd number of coding units (660 66 (3 ⁇ 4, 660).)
  • the image decoding apparatus 100 includes odd number of coding units ( Using information on the position of 620 62 (3 ⁇ 4, 620 0) or odd number of coding units (660 66 (3 ⁇ 4, 660), it is possible to determine the center coding unit (620 ratio or the center coding unit (660 ratio), for example
  • the image decoding apparatus 100 determines the location of the coding units 620 62 (3 ⁇ 4, 620) based on information indicating the location of a predetermined sample included in the coding units 62( ⁇ , 62(3 ⁇ 4, 620).
  • the coding unit (620 ratio) can be determined.
  • the video decoding apparatus 100 contains information indicating the position of the coding units (620 62 (3 ⁇ 4, 620) in the upper left of the sample (630 63 (3 ⁇ 4, 630)).
  • the coding unit (620 ratio) located in the center can be determined.
  • coding units left side included in 620 62 (3 ⁇ 4, 620 respectively)
  • the information indicating the position of the upper sample (630 63 (3 ⁇ 4, 63 ( ⁇ ) may include information about the position or coordinates in the picture of the coding units (620 62 (3 ⁇ 4, 620).
  • the coding unit) (Information indicating the location of the upper left sample included in 62( ⁇ , 62(3 ⁇ 4, 620)
  • 630 63(3 ⁇ 4, 63( ⁇ ) is the coding units included in the current coding unit 600)
  • 620 62( Information indicating a width or height of 3 ⁇ 4, 620 may be included, and this width or height may correspond to information indicating a difference between coordinates within a picture of 620 62 (3 ⁇ 4, 620), i.e., a video decoding device ( 100) is the coding unit (620, 62, 5 , 620), which is located in the middle by using information about the position or coordinates in the picture or using information about the width or height of the coding unit corresponding to the difference between coordinates. Coding unit (620 ratio can be determined.
  • the upper coding unit (the sample of the upper left of the 620 ⁇ (information indicating the position of 630 ⁇ can represent the ⁇ coordinates), the center coding unit (the sample of the upper left of the 620 ratio (530 ratio)
  • the information indicating the location of can indicate the ( ⁇ , ⁇ ) coordinates, and the lower coding unit (a sample of the upper left of the 620 (63 (information indicating the location of the ⁇ is ⁇ )) coordinates.
  • Video decoding device (100) Is the coding units (the sample in the upper left corner included in 620 62 (3 ⁇ 4, 620, respectively), and the center coding unit (620 ratio can be determined using the coordinates of 630 63 (3 ⁇ 4, 63 ( ⁇ , for example, on the left).
  • the sample at the top (630 63(3 ⁇ 4, 630's coordinates in ascending or descending order) 2020/175970 1 » (:1 ⁇ 1 ⁇ 2020/002929)
  • the coding unit containing the sample (( ⁇ , ⁇ ), which is a coordinate of 630 ratio) (620 ratio is divided by the current coding unit (600)) It can be determined by the coding unit located in the middle of the coding units (620 62(3 ⁇ 4, 620 0)) that are determined to be assigned, but the coordinates indicating the position of the sample (63( ⁇ , 63(3 ⁇ 4, 630) in the upper left corner) are within the picture.
  • the top coding unit (the sample at the top left of the 620 (based on the position of 630, the center coding unit (the sample at the top left of the 620 ratio) (which represents the relative position of the 630 ratio) Information, (1) coordinates, lower coding unit (((1x(:, (1)0 coordinates, information indicating the relative position of 620) can be used as the sample at the upper left of the 620.
  • the method of determining the coding unit of a predetermined position by using the coordinates of the sample to be used as information indicating the position of the sample to be obtained should not be interpreted limited to the above-described method, but must be interpreted in various arithmetic methods that can use the coordinates of the sample.
  • the image decoding apparatus 100 can divide the current coding unit 600 into a plurality of coding units 620 62 (3 ⁇ 4, 620, and coding units 620 62 (3 ⁇ 4, 6200).
  • a coding unit may be selected according to a medium or small defined criterion.
  • the video decoding apparatus 100 may select a coding unit (620 ratio) having different sizes among the coding units 620 62015, 62 ( ⁇ .
  • the image decoding apparatus 100 includes information indicating the position of the upper coding unit (620 ⁇ of the upper left sample 630 (coordinates, center coding unit (620 ratio of the upper left sample 630 Coding units (620 62 (3 ⁇ 4) using the ( ⁇ ,) coordinates, which are information indicating the location of the rain, the ( ⁇ , ⁇ ) coordinates, the lower coding unit (the sample at the top left of the 620 , 620 0) Each width or height can be determined.
  • the image decoding apparatus 100 includes encoding units 620 62 characters 5 ,
  • each of the coding units (620 62(3 ⁇ 4, 620 0) can be determined using ( ) ), (, ) ), (X*:, ) 0, which are the coordinates representing the position of 620(:).
  • the image decoding apparatus 100 may determine the width of the upper coding unit (620) as the width of the current coding unit (600).
  • the image decoding apparatus 100 has a height of the upper coding unit (620 ⁇ )
  • the image decoding apparatus 100 may determine a center coding unit (a width of 620 ratio can be determined as a width of the current coding unit 600).
  • the image decoding apparatus 100 is a middle coding unit 620.
  • the height of the ratio can be determined as -.
  • the width or height of the lower coding unit (0) is the width or height of the current coding unit and the upper coding unit (620 ⁇ and the center coding unit (620). It can be determined by using the width and height of the ratio.
  • the video decoding apparatus 100 may determine a coding unit having a size different from other coding units based on the determined coding units (620 62 (3 ⁇ 4, 620 width and height). Referring to Fig. 6, the image decoding apparatus 100 includes an upper coding unit (620 and a lower coding unit (620) having a size different from that of the middle coding unit (620)). 2020/175970 1»(:1 ⁇ 1 ⁇ 2020/002929 Can be determined in the coding unit of a predetermined position.
  • the process of determining the coding unit having a size different from the other coding units by the device 100 is only in one embodiment in which the coding unit at a predetermined location is determined using the size of the coding unit determined based on the sample coordinates.
  • Various processes can be used to determine the coding unit at a predetermined location by comparing the size of the coding unit determined according to the sample coordinate of.
  • the image decoding apparatus 100 includes a left encoding unit (a sample of the upper left corner of 660 ⁇ ), the central coding unit (a sample of the upper left corner of 660 ⁇ , information indicating the position of 670 ⁇ ).
  • the width of each of the coding units (660 66 (3 ⁇ 4, 660 0)) using the ⁇ coordinate, the information representing the right coding unit (the sample at the top left of the 660 (67 (the information indicating the location of the ⁇ , ⁇ , ) ) Alternatively, the height can be determined.
  • the image decoding apparatus 100 uses the coding units (660 66 (3 ⁇ 4, ⁇ (1),, £ ), which are coordinates representing the position of 660 teeth), and ⁇ to use the coding units (660 660). ⁇ 660 0) Each size can be determined.
  • the image decoding apparatus 100 may determine the width of the left encoding unit (660 ⁇ ).
  • the image decoding apparatus 100 may determine the height of the left encoding unit (660 ⁇ ) as the current coding unit ( 650).
  • the image decoding apparatus 100 has a central coding unit (a width of 660 ratio). I can decide.
  • the image decoding apparatus 100 may determine the height of the center coding unit (660 ratio) as the height of the current coding unit 600.
  • the image decoding apparatus 100 may have a width or height of the right coding unit 660. It can be determined using the width or height of the current coding unit (650) and the left coding unit (660 and the width and height of the center coding unit (660 ratio).
  • the image decoding apparatus 100 has the determined coding units (660 66 (3 ⁇ 4). , Based on the width and height of 660, it is possible to determine a coding unit having a size different from other coding units. Referring to FIG. 6, the image decoding apparatus 100 includes a left coding unit 660 and a right coding unit 660. The central coding unit having a size different from that of (660 ratio can be determined as the coding unit at a predetermined location. However, the process of determining the coding unit having a size different from the other coding units in the video decoding apparatus 100 described above is in the sample coordinates.
  • the coding unit of a predetermined location is determined by using the size of the coding unit determined based on the predetermined coordinates
  • various types of determining the coding unit of the predetermined location by comparing the size of the coding unit determined according to the predetermined sample coordinates. The process can be used.
  • the position of the sample to be considered for determining the position of the coding unit should not be interpreted limited to the upper left corner described above, but it can be interpreted that information on the position of any sample included in the coding unit can be used. .
  • the image decoding apparatus 00 is the current coding unit
  • the video decoding device 00 can determine the coding unit of a predetermined position according to the horizontal direction. That is, the video decoding device (100) ) Can determine one of the coding units that vary in position in the horizontal direction to place a limit on the corresponding coding unit. If the current coding unit is a non-square type whose height is longer than the width, the image decoding apparatus 100 is in the vertical direction. Depending on the coding unit, the coding unit of a predetermined position can be determined. That is, the video decoding apparatus 100 can determine one of the coding units that vary in position in the vertical direction and place a limit on the coding unit.
  • the image decoding apparatus 100 may use information indicating the position of each of the even number of coding units in order to determine a coding unit of a predetermined position among even number of coding units.
  • 100 can determine the even number of coding units by dividing the current coding unit (binary division), and using the information on the positions of the even number of coding units to determine the coding unit at a predetermined location.
  • the detailed process for this is shown in Fig. 6 It may be a process that corresponds to the process of determining the coding unit of a predetermined position (for example, the center position) among the odd number of coding units described above, so it will be omitted.
  • the image decoding apparatus 100 may use the current coding unit included in the center coding unit during the dividing process to determine the coding unit located in the middle of the coding units divided into a plurality of coding units. At least one of block type information and split type mode information stored in the sample can be used.
  • the video decoding apparatus 100 can divide the current coding unit 600 into a plurality of coding units (620 62 (3 ⁇ 4, 620), based on the split mode information, and a plurality of coding units).
  • the encoding unit (620 ratio ) located in the middle of the fields (620 62 (3 ⁇ 4, 620 0) can be determined.
  • the image decoding device 100 considers the location where the split mode information is acquired, and the encoding located in the center
  • the unit (620 ratio can be determined; that is, the division type mode information of the current coding unit 600 can be obtained from the sample 640 located in the middle of the current coding unit 600, based on the division type mode information).
  • the coding unit including the sample 640 (620 ratio can be determined as a coding unit located in the center.
  • the information used to determine the coding unit located in the center should not be interpreted as limited to the division type mode information, and can be used in the process of determining the coding unit located in the center of various types of information.
  • predetermined information for identifying a coding unit at a predetermined location may be obtained from a predetermined sample included in a coding unit to be determined.
  • 2020/175970 1»(:1 ⁇ 1 ⁇ Refer to 2020/002929 the video decoding device 100 is a fixed position among a plurality of coding units (620 62(3 ⁇ 4, 6200)) determined by dividing the current coding unit (600).
  • a sample at a predetermined position within the current coding unit (600) e.g., in the middle of the current coding unit (600) to determine the coding unit (e.g., a coding unit located in the middle of the coding units divided into plural).
  • the video decoding apparatus 100 can determine the sample at the predetermined location in consideration of the block shape of the current coding unit 600, and video decoding can be used.
  • the device 100 includes a sample from which predetermined information (e.g., division type mode information) can be obtained among a plurality of coding units (620 62 (3 ⁇ 4, 6200)) determined by dividing the current coding unit 600.
  • predetermined information e.g., division type mode information
  • the included encoding unit (620 ratio can be determined to place a predetermined limit.
  • the image decoding apparatus 100 is a sample through which predetermined information can be obtained, and the current encoding unit 600) It is possible to determine a sample 640 located in the middle of the image decoding apparatus 100, and the encoding unit (620 ratio) in which the sample 640 is included can be set to a predetermined limit in the decoding process.
  • predetermined information is provided.
  • the position of the sample that can be obtained is limited to the above-described position and should not be interpreted, but may be interpreted as samples of any position included in the coding unit (620 ratio) to be determined to impose limitations.
  • the position of the sample from which predetermined information can be obtained may be determined according to the shape of the current coding unit 600.
  • the block type information is determined whether the shape of the current coding unit is square. Alternatively, it is possible to determine whether it is a non-square or not, and the position of the sample from which predetermined information can be obtained depending on the shape.
  • the video decoding device 100 can determine the information on the width and height of the current coding unit. Using at least one of the information about the current coding unit, it is possible to determine a sample located on the boundary of at least one of the width and height of the current coding unit as the sample from which the predetermined information can be obtained.
  • one of the samples including a boundary dividing the long side of the current coding unit in half is a sample from which predetermined information can be obtained. I can decide.
  • the image decoding apparatus 00) is configured to use a plurality of coding units.
  • the split mode mode information may be used to determine a coding unit at a predetermined position among a plurality of coding units.
  • the video decoding apparatus 100 may use the split mode mode information into the coding unit.
  • the image decoding apparatus 100 is a division mode in which a plurality of coding units generated by dividing the current coding unit is obtained from a sample at a predetermined position included in each of the plurality of coding units.
  • Information can be used to divide, that is, the coding unit can be divided recursively using the division mode information obtained from a sample at a predetermined position included in each of the coding units.
  • the recursive division process of the coding unit has been described above with reference to FIG. 2020/175970 1»(:1 ⁇ 1 ⁇ 2020/002929 Detailed explanation will be omitted.
  • the image decoding apparatus 100 divides the current coding unit
  • At least one coding unit can be determined, and the order in which at least one coding unit is decoded can be determined according to a predetermined block (for example, the current coding unit).
  • FIG. 7 is a diagram illustrating a procedure in which a plurality of coding units are processed when a video decoding apparatus determines a plurality of coding units by dividing a current coding unit according to an embodiment.
  • the video decoding apparatus 100 divides the first coding unit 700 in the vertical direction according to the split mode information to determine the second coding unit (groups 0a, TLOb) or to determine the first coding unit.
  • the second coding unit (730a, 730b) is determined by dividing the unit (700) in the horizontal direction, or the second coding unit (750a, 750b, 750c, 750d) by dividing the first coding unit (700) in the vertical and horizontal directions. ) Can be determined.
  • the image decoding apparatus 100 vertically uses the first coding unit 700.
  • the order can be determined so that the second coding units (group 0a, TL0b) determined by dividing in the direction are processed in the horizontal direction (base Oc).
  • the image decoding apparatus 100 divides the first coding unit 700 in the horizontal direction and The processing order of the determined second coding units 730a and 730b may be determined in the vertical direction 730c.
  • the image decoding apparatus 100 divides the first coding unit 700 in the vertical direction and the horizontal direction to determine the second encoding.
  • a predetermined order in which the coding units located in the next row are processed after the coding units in the unit (750a, 750b, 750c, 750d) are processed e.g., raster scan order
  • it can be determined according to the z scan order (750e).
  • the image decoding apparatus 100 recursively converts the coding units.
  • the image decoding apparatus 100 includes a first encoding
  • a plurality of coding units (groups 0a, 710b, 730a, 730b, 750a,
  • 750b, 750c, 750d can be determined, and each of the determined plurality of coding units (groups 0a, 710b, 730a, 730b, 750a, 750b, 750c, 750d) can be divided recursively.
  • a plurality of coding units C710a , 710b, 730a, 730b, 750a, 750b, 750c, 750d) may be a method corresponding to the method of dividing the first coding unit 700. Accordingly, a plurality of coding units (group 0a, 710b, 730a, 730b, 750a, 750b, 750c, 750d) can be independently divided into a plurality of coding units.
  • the image decoding apparatus 100 uses the first coding unit 700 in the vertical direction.
  • the second coding unit (group 0a, TLOb) can be determined, and furthermore, each of the second coding units (group 0a, 710b) can be determined to be divided or not divided.
  • the image decoding apparatus 100 may divide the second coding unit (group 0a) on the left side in a horizontal direction and divide it into third coding units (720a, 720b), and the second coding unit on the right side
  • the unit (group 0b) may not be divided.
  • the processing order of the coding units may be determined based on the process of dividing the coding units.
  • the processing order of the divided coding units is determined based on the processing order of the coding units immediately before division.
  • the video decoding apparatus 100 determines the order in which the second coding unit on the left (the third coding unit (720 72015) determined by dividing the period 0) is processed, independently of the second coding unit on the right (the 0 ratio). Since the second coding unit on the left (base 0 is divided in the horizontal direction of the mantissa and the third coding unit (720 72ah5) has been determined, the third coding unit (720 72ah5) can be processed in the vertical direction (720).
  • the second coding unit on the left corresponds to the horizontal direction (zero), so the second coding unit on the left (the system included in the zero)
  • the right coding unit zero ratio can be processed.
  • the above is a process in which the order of processing of coding units is determined according to the coding unit before division) Since it is for explanation, it should not be interpreted limited to the above-described embodiment, but it should be interpreted as being used in various ways in which the coding units determined by being divided into various forms can be independently processed according to a predetermined order.
  • the image decoding apparatus has coding units in a predetermined order.
  • the image decoding apparatus 100 uses the acquired split mode information.
  • the current coding unit is divided into an odd number of coding units.
  • the first coding unit (800) in the form of a square is the second coding unit in the non-square form (810 81A5). It can be divided, and the second coding unit (810 81 (3 ⁇ 4) can be independently divided into the third coding unit (820 82 (3 ⁇ 4, 8200, 820 (1, 820)).
  • the image decoding apparatus 00 ) Is the left coding unit (0 is divided in the horizontal direction to determine a plurality of third coding units (820 82ah5), and the right coding unit (A5) is an odd number of third coding units (820). It can be divided into 820 (1, 820 ⁇ ).
  • the image decoding apparatus 100 determines whether the third coding units 820 82 (3 ⁇ 4, 8200, 820 (1, 820) can be processed in a predetermined order, and the coding units divided into odd numbers. 8, the image decoding apparatus 100 recursively divides the first coding unit 800 to determine whether the third coding unit (820 82 (3 ⁇ 4, 8200, 820 (1, 820 ⁇ )) is present.
  • the video decoding apparatus 100 can determine the first coding unit 800, the second coding unit 810 81 (3 ⁇ 4) or the third coding unit ( It is possible to determine whether or not 820 82 (3 ⁇ 4, 8200, 820 (1, 820) is divided into odd number of coding units.
  • the second coding unit (0 810 ⁇ ) It can be divided into odd number of third coding units (820 820 (1, 820 ⁇ ). 2020/175970 1»(:1 ⁇ 1 ⁇ 2020/00292929
  • the order in which multiple coding units included in the first coding unit (800) are processed is in a predetermined order (e.g., z-scan order).
  • the image decoding apparatus 100 includes a third coding unit (820c, 820d, 820e) determined by dividing the right second coding unit 810b into odd numbers and being processed according to the predetermined order. It can be judged whether the condition is satisfied.
  • the image decoding apparatus 100 satisfies the condition that the third coding units 820a, 820b, 820c, 820d, 820e included in the first coding unit 800 can be processed according to a predetermined order. It can be determined whether or not, the condition is whether or not at least one of the width and height of the second coding unit (810a, 810b) is divided in half according to the boundary of the third coding unit (820a, 820b, 820c, 820d, 820e). It is related, for example
  • the third coding unit (820a, 820b) determined by dividing the height of the left second coding unit (8 Wa) in a non-square shape in half can satisfy the condition. Since the boundary of the third coding units (820c, 820d, 820e) determined by dividing into coding units cannot divide the width or height of the right second coding unit (810b) in half, the third coding unit (820c, 820d, 820e) ) May be determined as not satisfying the condition. In the case of dissatisfaction with this condition, the image decoding apparatus 100 determines that the scan order is disconnected, and based on the result of the determination, the second coding unit (8Wb) is an odd number. It can be determined by dividing into two coding units.
  • the video decoding apparatus 100 when the video decoding apparatus 100 is divided into an odd number of coding units, it is possible to place a certain limit on the coding unit at a predetermined location among the divided coding units. Since it has been described above through examples, detailed explanations will be omitted.
  • FIG. 9 shows an image decoding apparatus according to an embodiment by dividing a first coding unit
  • the image decoding apparatus 100 may divide the first coding unit 900 based on the division type mode information obtained through the receiving unit 110.
  • the first coding unit in a square shape ( 900) can be divided into four coding units having a square shape or a plurality of coding units having a non-square shape.
  • the image decoding apparatus 100 may include a plurality of first coding units 900. It can be divided into non-square coding units. Specifically, when the division mode information indicates that the first coding unit 900 is divided in the horizontal direction or the vertical direction to determine an odd number of coding units, the video decoding device (100) is the first code of the square shape
  • the unit 900 may be divided into odd-numbered coding units and divided into second coding units 910a, 910b, and 910c determined by dividing in the vertical direction or second coding units 920a, 920b, and 920c determined by dividing in the horizontal direction.
  • the image decoding apparatus 100 is included in the first coding unit 900 2020/175970 1»(:1 ⁇ 1 ⁇ 2020/002929 It is possible to determine whether the 2nd coding unit (910 91(3 ⁇ 4, 9100, 920 92(3 ⁇ 4, 920)) satisfies the conditions that can be processed in a predetermined order, The above condition relates to whether or not at least one of the width and height of the first coding unit 900 is divided in half according to the boundary of the second coding unit 910 91 (3 ⁇ 4, 9100, 920 92 (3 ⁇ 4, 920).
  • the second coding unit determined by dividing the first coding unit 900 in a square shape in the vertical direction does not divide the width of the first coding unit 900 in half. Therefore, it may be determined that the first coding unit 900 does not satisfy the conditions that can be processed in a predetermined order.
  • the second coding unit 900 which is determined by dividing the square-shaped first coding unit 900 in the horizontal direction, may be determined. It is decided that the first coding unit (900) does not satisfy the conditions that can be processed in a predetermined order because the boundary of the unit (920 92 (3 ⁇ 4, 920) cannot divide the width of the first coding unit (900) in half.
  • the video decoding apparatus 100 judges that the scan order is interrupted ((1 01111 ⁇ 2 (line 011), and based on the determination result, the first coding unit 900) is divided into odd number of coding units.
  • a predetermined limit may be imposed on the coding unit at a predetermined position among the divided coding units. Since the predetermined positions and the like have been described above through various embodiments, detailed descriptions will be omitted.
  • the image decoding apparatus 100 divides the first coding unit
  • Various types of coding units can be determined.
  • the image decoding device (0) is a square-shaped first coding
  • the unit (900) and the non-square type first coding unit (930 or 950) can be divided into various types of coding units.
  • the form in which the second coding unit can be divided is limited. Shows that.
  • the image decoding apparatus 100 uses a first coding unit 1000 in a square shape based on the division mode information obtained through the receiving unit 110.
  • the second coding unit (1010 101(3 ⁇ 4, 1020 102(3 ⁇ 4)) is
  • the video decoding apparatus 100 can determine whether to divide or not divide into a plurality of coding units based on the division type mode information related to each of the second coding units (1010 101015, 1020 102015).
  • the image decoding apparatus 100 is a non-square type left second coding unit determined by dividing the first coding unit 1000 in the vertical direction (1 0 ⁇ is divided in the horizontal direction to obtain a third coding unit. (It is possible to determine the ratio of 1012 to 1012.
  • the video decoding apparatus 100 is the left second coding unit (when 1010 is divided in the horizontal direction, 2020/175970 1»(:1 ⁇ 1 ⁇ 2020/002929
  • the second coding unit on the right (101A5) can be restricted so that the second coding unit on the left (1010 is not divided in the horizontal direction in the same direction as the divided direction).
  • the second coding unit on the right (1010 ratio is divided in the same direction, and the third coding unit (1014 to 1014 ratio is determined
  • the second coding unit on the left (1010 ⁇ and the second coding unit on the right (101A5) are each independently in the horizontal direction).
  • the third coding unit (1012, 1215, 1014 & , ⁇ 1415) can be determined.
  • the first coding unit (1000) is divided into four squares. This is the same result as the second coding unit (1030 103(3 ⁇ 4, 10300, 1030(1)), which may be inefficient in terms of video decoding.
  • the image decoding apparatus 100 performs a first encoding in the horizontal direction.
  • the second coding unit (102 or 1020) of the non-square shape determined by dividing the unit (1000) can be divided in the vertical direction to determine the third coding unit (1022 1022 ⁇ ⁇ 024a, 1024 ratio).
  • the video decoding device (100) is one of the second coding units (for example, if the upper second coding unit (1020 ⁇ ) is divided in the vertical direction, the second coding unit is different according to the above-mentioned reason (for example, the lower coding unit (102015)) May be limited so that the upper second coding unit (1020 ⁇ cannot be divided vertically in the same direction as the divided direction).
  • 11 shows the division mode information in the form of four squares according to an embodiment.
  • the image decoding device ( ⁇ 0) divides the first coding unit (1100) based on the segmentation mode information to determine the second coding unit (1110 111a5, 1120 112a5, etc.).
  • the division type mode information may include information on various types in which the coding unit can be divided, but the information on various types may not include information for dividing into four coding units in a square shape.
  • the video decoding device 100 divides the first coding unit (00) in a square shape into four second coding units (1130 113 (3 ⁇ 4, 11300, 1130 (1)) in a square shape. Based on the split mode information, the video decoding device (100) can determine the second coding unit (111 ( ⁇ , 111 (3 ⁇ 4, 1120&, 112, 5, etc.)) of the non-square form.
  • the image decoding apparatus 00) can independently divide the second coding units (1110 111015, n20a, 112ah5, etc.) in a non-square shape.
  • each of the second coding units (1110 111ah5, 1120 11201?, etc.) can be divided in a predetermined order. This is based on the division mode information, and this is how the first coding unit (00) is divided. It may be a corresponding split method.
  • the image decoding device (100) is the second coding unit on the left (1110 ⁇ is horizontal).
  • the third coding unit in the square shape (1112 1112 ratio can be determined, and the second coding unit on the right (1110 ratio is divided in the horizontal direction) 2020/175970 1 » (:1 ⁇ 1 ⁇ 2020/002929 3rd coding unit (1114 1114 ratio can be determined. Further video decoding
  • the device 100 can also determine a third coding unit (1116 111 solution, 11160, 1116(1) in a square shape by dividing both of the left second coding unit 1110 and the right second coding unit 1110 in the horizontal direction.
  • the coding unit can be determined in the same form as the first coding unit (00) divided into four square-shaped second coding units (1130 113 (3 ⁇ 4, 11300, 1130(1)).
  • the image decoding device 100 has the upper second coding unit (1120 yen).
  • the third coding unit in the form of a square (1122 to 1122 ratio can be determined, and the lower second coding unit (1120 ratio is divided in the vertical direction to determine the third coding unit in the square form (1124 to 1124 ratio)).
  • the image decoding apparatus 100 may determine the ratio of the third coding unit (1126 112 years, 1126a 1126) in a square shape by dividing both the upper second coding unit (1120 and the lower second coding unit (112015) in the vertical direction).
  • the coding unit can be determined in the same form as the first coding unit (1100) divided into four square-shaped second coding units (1130 113 (3 ⁇ 4, 11300, 1130(1)).
  • FIG. 12 illustrates that the processing order between a plurality of coding units may vary according to a process of dividing the coding units according to an embodiment.
  • the image decoding apparatus may divide the first coding unit 1200 based on the partition mode information.
  • the block type is a square
  • the partition mode information is the first coding unit.
  • the image decoding apparatus 100 divides the first coding unit 1200 and divides the second coding unit (for example, 1210 121 (3 ⁇ 4, 1220, 122, 5, etc.) Referring to Fig. 12, the first coding unit 1200) is divided only in the horizontal or vertical direction, and the second coding unit in the non-square shape (1 ( ⁇ , 1, 5, etc.) 122( ⁇ , 122(3 ⁇ 4) can be independently divided based on the division type mode information for each.
  • the image decoding apparatus 100 is a system generated by dividing the first coding unit 1200 in the vertical direction. By dividing the two coding units (1 0 1 A5) in the horizontal direction, the third coding unit (1216 121 years, 12160, 1216(1) can be determined, and the first coding unit (1200) is divided in the horizontal direction). By dividing the generated second coding unit (1220 1220 ratio in the horizontal direction, respectively, the third coding unit (1226 1226 ⁇ 12260, 1226(1)) can be determined.
  • Such a second coding unit (1210 121(3 ⁇ 4, 1220 122()) The dividing process of 3 ⁇ 4) has been described above with respect to FIG. 11, so a detailed description will be omitted.
  • the image decoding apparatus 00) may process the coding units according to a predetermined order.
  • the characteristics of the processing of the coding units according to a predetermined order have been described above with reference to FIG. 7, so detailed descriptions are omitted.
  • the image decoding apparatus 100 divides the first coding unit 1200 in a square shape to
  • the 3rd coding unit in the form of 4 squares (1216 1216 ⁇ 1216 ⁇ , 1216(1, 1226)
  • Video decoding according to an embodiment 2020/175970 1 » (:1 ⁇ 1 ⁇ 2020/002929 Device (100) is the third coding unit (1216 12161), 12160, 1216 (1, 1226 12261), depending on the form in which the first coding unit (1200) is divided, It is possible to determine the processing order of 12260, 1226 (3 ⁇ 4.
  • the image decoding apparatus ( ⁇ 0) divides the second coding units (1 0 1 Ah 5) generated by being divided in the vertical direction, respectively, in the horizontal direction to perform the third coding.
  • the unit (1216 121 year, 12160, 1216 (1) can be determined, and the video decoding device 100 processes the second coding unit on the left (the third coding unit included in 1210 (1216 1216) in the vertical direction first, and then, The third coding unit (1216, 1216 ⁇ 12160, 1216(1)) in accordance with the order of processing the third coding unit (121 years, 1216(1) in the vertical direction (1217) included in the right second coding unit (1A5) ) Can be processed.
  • the image decoding apparatus ( ⁇ 0) divides the generated second coding units (1220 122 Ah 5) in the horizontal direction and performs the third encoding by dividing each in the vertical direction.
  • the unit (1226 122 year, 12260, 1226 (1) can be determined, and the video decoding device 100 is the second coding unit at the top (the third coding unit included in the 1220 ⁇ ) (1226 1226 ratio is first processed in the horizontal direction. After that, in accordance with the order of processing the third coding unit (122 ⁇ , 1226(1) in the horizontal direction (1227) included in the lower second coding unit (122015)), the third coding unit (1226 1226 ⁇ 12260, 1226(1) ) Can be processed.
  • the second coding unit (1210 121(3 ⁇ 4, 1220 122(3 ⁇ 4)) is
  • the third coding unit (1216 1216 ⁇ 12160, 1216 ( 1, 1226 122 year, 12260, 1226(1)) can be determined by dividing it; the second coding unit (1210 121015) determined by dividing in the vertical direction and the horizontal
  • the second coding unit (1220 122015) determined by dividing in the direction is divided into different forms, but the third coding unit (1216 12161), 12160, 1216 (1, 1226 12261), 12260, 1226 (3 ⁇ 4
  • the first coding unit 1200 is divided into coding units of the same type. Accordingly, the video decoding apparatus 100 recursively divides the coding unit through different processes based on the division mode information. Accordingly, even if coding units of the same type are determined as a result, a plurality of coding units determined in the same type can be processed in different orders.
  • FIG. 13 shows a plurality of coding units being divided recursively according to an embodiment.
  • the image decoding apparatus 100 defines a depth of a coding unit.
  • the predetermined criterion can be the length of the long side of the coding unit.
  • the video decoding device 00) is 211 conscious that the length of the long side of the current coding unit is less than the length of the long side of the coding unit before division.
  • the depth of the current coding unit can be determined to be that the depth is increased by II from the depth of the coding unit before division.
  • the coding unit with increased depth is expressed as a coding unit of the lower depth. . 2020/175970 1»(:1 ⁇ 1 ⁇ 2020/002929
  • the image decoding apparatus 100 can determine the second coding unit (1302), the third coding unit (1304), etc. of the lower depth by dividing the first coding unit (1300) in a square shape. If the size of the square-shaped first coding unit (1300) is 2Nx2N, the second coding unit (1302) determined by dividing the width and height of the first coding unit (1300) by 1/2 may have a size of NxN. Furthermore, the third coding unit (1304) determined by dividing the width and height of the second coding unit (1302) into 1/2 size may have a size of N/2xN/2.
  • the width and height correspond to times the first coding unit (1300). If the depth of the first coding unit (1300): 0, the second coding unit is half the width and height of the first coding unit (1300).
  • the depth of (1302) may be 0+1, and the depth of the third coding unit (1304), which is 1/4 times the width and height of the first coding unit (1300), may be 0+2.
  • block shape information indicating a non-square shape for example, block shape information is '1 : NS_VER' indicating that the height is a non-square longer than the width, or '1 : NS_VER' indicating that the width is a non-square longer than the height.
  • the image decoding device 00 divides the first coding unit (1310 or 1320), which is a non-square type, to the second coding unit (1312 or 1322) of the lower depth, and the third The coding unit (1314 or 1324) can be determined.
  • the video decoding apparatus 100 can determine the second coding unit (eg, 1302, 1312, 1322, etc.) by dividing at least one of the width and height of the first coding unit 1310 of size Nx2N. That is, the image decoding apparatus 100 can determine the second coding unit 1302 of size NxN or the second coding unit 1322 of size NxN/2 by dividing the first coding unit 1310 in the horizontal direction, It is also possible to determine the second coding unit 1312 of size N/2xN by dividing it in the horizontal and vertical directions.
  • the second coding unit eg, 1302, 1312, 1322, etc.
  • the image decoding apparatus 100 has a first encoding of a size of 2NxN.
  • the second coding unit e.g., 1302, 1312, 1322, etc.
  • the image decoding apparatus 100 is the first coding unit 1320 Divide in the vertical direction to code the second NxN size
  • the image decoding apparatus 100 divides at least one of the width and height of the second coding unit 1302 of NxN size to divide the third coding unit (for example, 1304, 1314, 1324, etc.).
  • the video decoding apparatus 100 divides the second coding unit 1302 in the vertical and horizontal directions to determine the third coding unit 1304 of size N/2xN/2, or 4x ⁇ 2
  • the image decoding apparatus 100 has a second encoding of N/2xN size.
  • a third coding unit (e.g., 1304, 1314, 1324, etc.) by dividing at least one of the width and height of the unit 1312, i.e., the video decoding apparatus 100 is the second coding unit 1312 Split in the horizontal direction to determine the third coding unit of size N/2xN/2 (1304) or the third coding unit of size ⁇ 2x ⁇ 4 (1324), or divide it in the vertical and horizontal directions to determine the size of ⁇ 4x ⁇ 2
  • the third coding unit of the agenda (1314) can be determined.
  • the image decoding apparatus 100 has a second encoding of NxN/2
  • a third coding unit (e.g., 1304, 1314, 1324, etc.) by dividing at least one of the width and height of the unit 1322, i.e., the video decoding apparatus 100 is the second coding unit 1322 Divide in the vertical direction to determine the third coding unit of size N/2xN/2 (1304) or the third coding unit of size ⁇ 4x ⁇ 2 (1314), or divide it in the vertical and horizontal directions to determine N/2xN/4
  • the third coding unit of size (1324) can be determined.
  • the image decoding apparatus 00) may divide a square-shaped coding unit (for example, 1300, 1302, 1304) in a horizontal direction or a vertical direction.
  • a square-shaped coding unit for example, 1300, 1302, 1304
  • the coding unit 1300 may be divided in the vertical direction to determine the first coding unit 1310 having a size of Nx2N, or the coding unit 1300 may be divided in the horizontal direction to determine the first coding unit 1320 having the size of 2NxN.
  • the depth of the coding unit determined by dividing the first coding unit (1300) of size 2Nx2N horizontally or vertically is the same as the depth of the first coding unit (1300). can do.
  • the width and height of the third coding unit may correspond to 1/4 times the first coding unit (1310 or 1320).
  • FIG. 14 shows an index calculation for classifying a depth and a coding unit, which can be determined according to the shape and size of coding units according to an embodiment, hereinafter ⁇ .
  • the image decoding apparatus (0) is a first coding of a square shape.
  • the video decoding apparatus 100 divides the first coding unit 1400 in at least one of the vertical and horizontal directions according to the split mode information to divide the second coding unit 1402 14021 and 1404 14041. ), 1406 14061), 14060, 1406 (3 ⁇ 4 can be determined. That is, the video decoding apparatus 100 can determine the second coding unit (1402 14021), 1404 based on the information of the division mode for the first coding unit 1400. 14041), 1406 14061), 14060, 1406(1) can be determined. 2020/175970 1»(:1 ⁇ 1 ⁇ 2020/00292929
  • the second coding unit (1402 1402 ⁇ 1404 1404 ⁇ 1406 ⁇ 140 Sea, 14060, 1406(1)) is determined according to the division mode mode information for the square-shaped first coding unit (1400).
  • the depth can be determined based on the length of the long side, for example, the length of one side of the first coding unit of the square shape (1400) and the length of the long side of the non-square shape of the second coding unit (1402 1402 ⁇ 1404 1404 ratio)
  • the image decoding device 100 uses the first coding unit (1400) as the second of four squares based on the split mode information.
  • the length of one side of the second coding unit in a square shape (1406 1406 ⁇ 14060, 1406(1) is 1/ of the length of one side of the first coding unit (1400)) Since it is twice, the depth of the second coding unit (1406 1406 ⁇ 14060, 1406(1) is 0+1, which is lower than the depth of the first coding unit (1400), I).
  • the image decoding apparatus 100 divides a first coding unit 1410 having a height longer than a width in a horizontal direction according to the split mode information to obtain a plurality of second coding units 1412 1413 ⁇ 4. , 1414, 141, and 1414.
  • the video decoding apparatus ( ⁇ 0) divides the first coding unit 1420 having a width longer than the height in the vertical direction according to the division mode information. It can be divided into a plurality of second coding units (1422 1422 ⁇ 1424 1424 ⁇ 1424).
  • the second coding unit (1412 1413 ⁇ 4, 1414 14141), 14140. 1422 14221), which is determined according to the split mode mode information for the first coding unit (1410 or 1420) in a non-square shape, according to an embodiment.
  • 1424 can determine the depth based on the length of the long side, for example, the length of one side of the second coding unit of the square shape (1412 1413 ⁇ 4) is longer than the width of the height-the first coding unit of the non-square shape ( Since it is 1/2 the length of one side of 1410), the second coding unit of the square shape (1412 1412 non-depth is 0+, which is the depth of the lower depth than the first coding unit of the non-square shape (1410) depth I). It is 1.
  • the image decoding apparatus 00) can divide the first coding unit 1410 of the non-square shape into odd number of second coding units (1414 1414 ⁇ 1414) based on the division mode information.
  • Coding units (1414 141415, 1414 may include a non-square type second coding unit (1414 14140) and a square type second coding unit (1414 ratio).
  • the non-square type second coding unit (1414 1414) The length of the long side of the side and the second sign of the square shape
  • the image decoding apparatus 100 is a method corresponding to the above method of determining the depth of the coding units related to the first coding unit 1410, and has a non-square shape with a width longer than the height.
  • the coding units The index can be determined based on the size ratio of the liver.
  • the coding unit located in the middle of the coding units divided into odd numbers (1414 1414 ⁇ 14140) (1414 ratio is the other coding units (1414 1414). Coding units of the same width but different heights (1414 1414 can be twice the height of this, i.e., in this case, the center coding unit (1414 ratio can contain two of the other coding units (1414 1414)).
  • the image decoding apparatus 100 may determine whether the coding units divided into odd numbers are not the same size based on the existence of discontinuities in the index for distinguishing between the divided coding units.
  • the image decoding apparatus 100 may determine whether the image decoding apparatus 100 is divided into a specific division type based on an index value for dividing a plurality of coding units determined to be divided from a current coding unit. Referring to, the image decoding device 00) can determine an even number of coding units (1412 1412 ratio) or an odd number of coding units (1414 1414 ⁇ 1414) by dividing the first coding unit (1410) in a rectangular shape longer than the width.
  • the image decoding apparatus 100 may use an index (1 ⁇ 10) indicating each coding unit to classify each of a plurality of coding units.
  • ⁇ is a sample at a predetermined position of each coding unit. (For example, it can be obtained from the top left sample).
  • the image decoding apparatus 100 is used for classification of coding units.
  • the video decoding apparatus 100 uses the first coding unit 1410.
  • the video decoding device 100 can allocate an index for each of the 3 coding units (1414 1414 ⁇ 14140).
  • the video decoding device 100 can be divided into odd numbers.
  • the index for each coding unit can be compared to determine the middle coding unit among the coding units.
  • the video decoding apparatus 100 is based on the indexes of the coding units and has a coding unit having an index corresponding to the value in the middle of the indexes ( The 1414 ratio may be determined as a coding unit at the center of the determined coding units by dividing the first coding unit 1410.
  • the image decoding apparatus 100 determines an index for classifying the divided coding units.
  • the coding units are the same 2020/175970 1»(:1 ⁇ 1 ⁇ 2020/002929 If it is not the size, the index can be determined based on the size ratio between coding units. Referring to FIG. 14, the first coding unit 1410 is divided, The generated coding unit (1414 ratio can be twice the height of other coding units (1414 1414 and 1414 1414) but with the same width but different height (1414 1414). In this case, the coding unit located in the center (an index of 1414 ratio (1 If ⁇ 10) is 1, the coding unit located in the next order (1414 can be 3 as the index increases by 2. As in this case, if the index increases uniformly and then the increase width varies, video decoding)
  • the device 100 may be determined to be divided into a plurality of coding units including coding units having a different size from other coding units, according to an embodiment, when it indicates that the division type mode information is divided into odd number of coding units.
  • the video decoding device 100 can divide the current coding unit into a form in which the coding unit at a predetermined position (for example, the center coding unit) of the odd number of coding units is different from the other coding units. In this case, the video decoding device 100 ) Can be used in the index for the coding unit to determine the coding unit among the different sizes.
  • the size or position of the coding unit at a predetermined position to be determined is specific to illustrate an embodiment. It should not be interpreted as being limited thereto, and it should be interpreted that various indexes, positions and sizes of coding units can be used.
  • the image decoding apparatus 100 may use a predetermined data unit in which recursive division of the coding unit is started.
  • FIG. 15 illustrates that a plurality of coding units are determined according to a plurality of predetermined data units included in a picture according to an embodiment.
  • the predetermined data unit may be defined as a data unit in which the coding unit starts to be recursively divided using the division mode information. That is, a plurality of coding units dividing the current picture are determined. It may correspond to the coding unit of the highest depth used in the process of becoming.
  • a predetermined data unit will be referred to as a reference data unit.
  • the reference data unit may represent a predetermined size and shape.
  • the reference coding unit may contain samples of MxN.
  • M and N may be the same as each other, and may be an integer expressed as a power of 2. That is, the reference data unit is a square or non-square. It can represent a shape, and can then be divided into an integer number of coding units.
  • the image decoding apparatus 00 may divide the current picture into a plurality of reference data units.
  • the image decoding apparatus 100 may divide a plurality of reference data units that divide the current picture. It can be divided by using the division type mode information for each reference data unit. It is possible to respond to the division process using the division structure of such reference data units.
  • [192] Deluxe device 00) is the reference data included in the current picture. 2020/175970 1»(:1 ⁇ 1 ⁇ 2020/002929 The minimum size that a unit can have can be determined in advance. Accordingly, the video decoding device (W0) can determine the reference data units of various sizes with a size larger than the minimum size. And, based on the determined reference data unit, at least one coding unit can be determined using the division type mode information.
  • the image decoding apparatus 100 is a standard coding of a square shape.
  • Unit (1500) can be used, or non-square type standard coding
  • the shape and size of the reference coding unit is various data units (e.g., sequence, picture, slice) that can contain at least one reference coding unit. (slice), slice segment (slice segment), tile (tile), tile group (tile group), maximum coding unit, etc.).
  • the receiving unit 110 of the image decoding apparatus 100 acquires at least one of information on the shape of the reference coding unit and the size of the reference coding unit from the bitstream for each of the various data units.
  • the process of determining at least one coding unit included in the standard coding unit (1500) of the square shape has been described above through the process of dividing the current coding unit (300) in Fig. 3, and the standard coding of the non-square form.
  • the process of determining at least one coding unit included in the unit 1502 has been described above through the process of dividing the current coding unit (400 or 450) in FIG. 4, so a detailed description will be omitted.
  • the image decoding apparatus 100 is provided in advance based on a predetermined condition.
  • an index for identifying the size and shape of the reference coding unit can be used, i.e., the receiver (no) from the bitstream to the various data units.
  • the receiver for example, sequence, picture, slice, slice segment, tile, tile group,
  • the size and shape of the standard coding unit Only the index for consciousness can be acquired.
  • the video decoding device 100 can acquire the index.
  • the size and shape of the reference data unit can be determined for each data unit that satisfies the predetermined conditions.
  • Information on the shape of the reference coding unit and information on the size of the reference coding unit are provided for each data unit of relatively small size.
  • the efficiency of using the bitstream may not be good, so instead of directly acquiring information on the shape of the reference coding unit and the size of the reference coding unit, only the above index can be obtained and used.
  • At least one of the size and shape of the reference coding unit corresponding to the index indicating the size and shape of the reference coding unit may be determined in advance. That is, the image decoding apparatus 100 may have at least one of the predetermined size and shape of the reference coding unit. By selecting one according to the index, the index 2020/175970 1»(:1 ⁇ 1 ⁇ 2020/002929 At least one of the size and shape of the standard coding unit included in the data unit to be acquired can be determined.
  • the image decoding apparatus W0 is in one maximum coding unit.
  • At least one reference coding unit can be used, i.e., at least one reference coding unit can be included in the maximum coding unit for dividing an image, and the coding unit is determined through a recursive division process of each standard coding unit.
  • at least one of the width and height of the maximum coding unit may correspond to at least one integer multiple of the width and height of the reference coding unit.
  • the size of the reference coding unit is the maximum coding unit. May be a size divided n times according to the quadtree structure, that is, the video decoding apparatus 100
  • the reference coding unit can be determined by dividing the maximum coding unit n times according to the quadtree structure, and according to various embodiments, the reference coding unit can be divided based on at least one of block type information and split type mode information.
  • the image decoding apparatus W0 has a current coding unit type.
  • the block type information indicated or the division type mode information indicating the method of dividing the current coding unit can be obtained from the bitstream and used.
  • the division type mode information can be included in the bitstream related to various data units.
  • the decoding apparatus 100 includes a sequence parameter set, a picture parameter set, a video parameter set, a slice header, a slice segment header, and a tile.
  • the segmentation mode information included in the header (tile header) and tile group header can be used.
  • the video decoding apparatus 100 blocks from the bitstream for each maximum coding unit, reference coding unit, and processing block.
  • the syntax element corresponding to the shape information or the split shape mode information can be obtained from the bitstream and used.
  • the video decoding apparatus W0 may determine a video segmentation rule.
  • the segmentation rule may be previously determined between the video decoding apparatus W0 and the video encoding apparatus 2200.
  • the image decoding apparatus 100 may determine an image segmentation rule based on the information obtained from the bitstream.
  • the image decoding apparatus 100 may determine a sequence parameter.
  • the segmentation rule can be determined based on information obtained from at least one of the headers (tile group header).
  • the video decoding apparatus 100 determines the segmentation rule as a frame, slice, tile, temporal layer, and maximum coding unit. Or it can be determined differently depending on the coding unit. 2020/175970 1»(:1 ⁇ 1 ⁇ 2020/002929
  • the video decoding apparatus (W0) can determine the division rule based on the block type of the coding unit.
  • the block type can include the size, shape, width and height ratio, and direction of the coding unit.
  • Video decoding apparatus (100) may determine in advance to determine the partitioning rule based on the block type of the coding unit, but is not limited thereto.
  • the image decoding apparatus 100 is based on the information obtained from the received bitstream, and partitioned. You can decide the rules.
  • the shape of the coding unit may include a square and a non-square. If the width and height of the coding unit are the same, the image decoding apparatus 100 determines the shape of the coding unit. In addition, if the width and height of the coding unit are not the same, the image decoding apparatus 100 may determine the shape of the coding unit as a non-square.
  • the size of the coding unit can include various sizes of 4x4, 8x4, 4x8, 8x8, 16x4, 16x8, ..., 256x256.
  • the size of the coding unit is the length of the long side, the length or the width of the short side of the coding unit.
  • the video decoding apparatus 100 may apply the same division rule to the coding units classified into the same group. For example, the video decoding apparatus 100 may have the same size of coding units having the same long side length. In addition, the video decoding apparatus 100 can apply the same division rule for coding units having the same long side length.
  • the ratio of the width and height of the coding unit is 1 :2, 2: 1, 1 :4, 4: 1, 1 :8, 8: 1, 1: 16, 16: 1, 32: 1 or 1: 32, etc.
  • the direction of the coding unit may include the horizontal direction and the vertical direction.
  • the horizontal direction may indicate the case where the length of the width of the coding unit is longer than the length of the height.
  • the vertical direction is the case of the coding unit. It can be indicated that the length of the width of is shorter than the length of the height.
  • the video decoding device (W0) establishes a division rule based on the size of the coding unit.
  • the video decoding apparatus 100 can determine the allowable division mode differently based on the size of the coding unit. For example, the video decoding apparatus 100 can determine the size of the coding unit. It is possible to determine whether or not segmentation is allowed. The image decoding apparatus 100 may determine the direction of division according to the size of the coding unit. The image decoding apparatus 100 may determine an allowable segmentation type according to the size of the coding unit. have.
  • It may be a division rule predetermined between the apparatuses 100. Also, the video decoding apparatus 100 may determine a division rule based on information obtained from the bitstream.
  • the video decoding device (W0) establishes a division rule based on the position of the coding unit.
  • the video decoding apparatus 100 can adaptively determine a division rule based on the position occupied by the coding unit in the video.
  • the image decoding apparatus 100 includes coding units generated by different division paths. 2020/175970 1»(:1 ⁇ 1 ⁇ 2020/002929 The partitioning rule can be determined so that they do not have the same block shape. However, the coding units generated by different partition paths may have the same block shape, but are not limited to this. .Coding units generated by different division paths may have different decoding processing procedures. Details of the decoding processing procedures have been described with reference to Fig. 12, so a detailed explanation is omitted.
  • 16 is a diagram showing a block diagram of an image encoding and decoding system.
  • the bitstream is transmitted, and the decoding end 1650 receives the bitstream.
  • the restored image is output by decoding.
  • the decoding stage 1650 may have a configuration similar to that of the image decoding apparatus 100.
  • the prediction encoding unit 1615 outputs a reference image through inter prediction and intra prediction, and the transformation and quantization unit 1616 quantizes residual data between the reference image and the current input image.
  • Entropy encoding unit 1625 encodes and transforms the quantized transformation coefficient and outputs it as a bitstream.
  • the quantized transformation coefficient passes through the inverse quantization and inverse transformation units 1630 and outputs data in the spatial domain. Data in the restored spatial area is deblocked
  • the restored image is output through the filtering unit 1635 and the loop filtering unit 1640.
  • the restored image may be used as a reference image of the next input image through the prediction encoding unit 1615.
  • the encoded image data of the bitstream received by the decoding stage 1650 is restored to residual data in the spatial domain through an entropy decoding unit 1655 and an inverse quantization and inverse transformation unit 1660.
  • Predictive decoding unit The reference image and residual data output from (1675) are combined to form the image data of the spatial domain, and deblocking
  • the filtering unit 1665 and the loop filtering unit 1670 may perform filtering on the image data in the spatial domain and output a restored image for the current original image.
  • the restored image can be output to the next original image by the predictive decoding unit 1675. It can be used as a reference image for
  • the loop filtering unit 1640 of the encoding end 1610 is
  • Loop filtering is performed using the filter information input accordingly.
  • Filter information used by the filtering unit 1640 is output to the entropy encoding unit 1610 and transmitted to the decoding unit 1650 together with the coded image data.
  • the loop filtering unit 1670 of the decoding stage 1650 may perform loop filtering based on filter information input from the decoding stage 1650.
  • FIG. 17 is a block diagram of a video decoding apparatus according to an embodiment.
  • a video decoding apparatus 1700 may include an acquisition unit (1 unit 0) and a decoding unit 1720. 2020/175970 1»(:1 ⁇ 1 ⁇ 2020/002929
  • the video decoding apparatus 1700 includes an acquisition unit (1 unit 0) and
  • the acquisition unit (1st phase 0) and the decryption unit 1720 are operated by their own processor (not shown), and the processor ( (Not shown), the video decoding device 1700 may be fully operated as they are mutually organically operated. Or, under the control of an external processor (not shown) of the video decoding device 1700, the acquisition unit (1 unit 0) And the decryption unit 1720 may be controlled.
  • the video decoding apparatus 1700 input and output of the acquisition unit (1 unit 0) and the decoding unit 1720
  • the video decoding apparatus 1700 may contain one or more data stores (not shown) in which data is stored.
  • the video decoding apparatus 1700 may also include a memory control unit (not shown) that controls data input/output from a data storage unit (not shown).
  • the video decoding apparatus 1700 can perform video decoding operations including prediction by operating in conjunction with an internal video decoding processor or an external video decoding processor in order to restore an image through video decoding.
  • the internal video decoding processor of the video decoding apparatus 1700 may implement a basic video decoding operation by including a video decoding processing module as well as a separate processor, a central computing device or a graphics computing device.
  • the video decoding apparatus 1700 may be included in the video decoding apparatus 100 described above.
  • the acquisition unit (1st unit 0) may be included in the bitstream acquisition unit (no) of the image decoding apparatus 100 shown in FIG. 1, and the decoding unit 1720 is the decoding of the image decoding apparatus 100 It may be included in part 120.
  • This video decoding apparatus 1700 stores the bitstream generated as a result of encoding an image.
  • the information about the prediction type can represent one of the intra prediction type and the inter prediction type.
  • the unit can correspond to a block generated by being divided according to a tree structure from an image.
  • the acquisition unit (1/710) includes a sequence parameter set, a picture parameter set, a video parameter set, a slice header, and a slice segment header. segment header), the current block can be determined based on the block type information included in at least one of the segment headers and/or the information on the division type mode. Further, the block position determining unit (1 unit 0) is the maximum coding unit, the reference coding unit, and For each processing block, a syntax element corresponding to the block type information or information on the division type mode is generated from the bit stream.
  • the acquisition unit (1st 0) may acquire cbf information for the Cr component and cbf information for the Cb component of the current block from the bitstream.
  • the current block is generated from a coding unit. As a block, it can be a unit of transformation for inverse quantization and inverse transformation. 2020/175970 1»(:1 ⁇ 1 ⁇ 2020/002929
  • Information for & component can indicate whether the current block contains & component whose transform coefficient level is not 0. For example, (3 ⁇ 4 ⁇ information) If is 0, it indicates that the current block does not contain the & component whose transformation coefficient level is not 0, and if the & ⁇ information is 1, it can indicate that the current block contains the & component whose transformation coefficient level is not 0.
  • the ( ⁇ information (hereinafter referred to as'(3 ⁇ 4 information')) for a component can indicate whether the current block contains 5 components whose transformation coefficient level is not 0. For example, ( ⁇ information is 0) If it is, it indicates that the current block does not contain the 5 component whose transformation coefficient level is not 0, and
  • the current block contains 5 components whose transformation factor level is not 0.
  • the decoding unit 1720 may restore residual samples of the luma component using the acquired conversion coefficient levels.
  • the video decoding apparatus 1700 individually bites the conversion coefficient levels of 05 components and the conversion coefficient levels of & components in order to restore the residual sample of the component and the residual sample of the & component. Either from the stream, or only one kind of chroma conversion coefficient levels can be obtained from the bitstream.
  • the acquisition unit (1 unit 0) may acquire a chroma joint residual sample of the current block from the bitstream.
  • the chroma joint residual sample of the current block is ( 3 ⁇ 4 component It can be a sample value determined by using the residual sample value of & component and the residual sample value of & component. Therefore, one chroma to represent the residual sample value of ( 3 ⁇ 4 component and the corresponding residual sample value of & component)
  • the current block size is a luma 8x8 block and a chroma block 4x4, a total of 16 chromajoint residual samples can be obtained from the bitstream.
  • the decryption unit 1720 according to an embodiment,
  • the decoding unit 1720 is the chroma-joint residual sample of the current block and the & component.
  • the residual sample of & component can be restored by using the weight of the residual sample.
  • the decoder 1720 uses the weight of the chroma-joint residual sample of the current block and the residual sample of 05 component. The residual samples of can be restored.
  • the acquisition unit (1 unit 0) is a bitstream Ingredient
  • the acquisition unit (1 unit 0) takes one chroma sample value from the bitstream.
  • the decoding unit 1720 may restore the residual sample value of the 05 component and the residual sample value of the & component corresponding thereto by using the acquired one chroma sample value. In this case,
  • the decoding unit 1720 can determine the weight of the residual sample of the & component and the weight of the residual sample of the & component based on the predicted type of the coding unit, the information for the & component, and the information for the 3 ⁇ 4 component. Specifically, the decoding unit 1720 according to an embodiment, when the chroma joint information indicates that one chroma sample is encoded, based on the prediction type of the coding unit, & information, and 5 information, the & component register. Weight of dual sample You can determine the weight of the component's residual sample.
  • the decoding unit 1720 selects one of a plurality of joint modes based on "" information and "4" information, and according to the selected joint mode, a weight value of "residual samples" You can determine the weight of the residual sample of the component.
  • the decoding unit 1720 is a weight value of residual samples of & components included in one allowed joint mode. You can determine the weight of the residual sample of the component.
  • the decoding unit 1720 restores the residual sample of the & component by using the weight of the chroma-joint residual sample of the current block and the residual sample of the & component, and restores the residual sample of the & component.
  • Chroma joint The residual sample of 05 components can be restored by using the weight of the residual sample of the component.
  • the acquisition unit (1st phase 0) can obtain the (3/4-component conversion coefficient levels and the & component conversion coefficient levels individually from the bitstream.
  • the part (1st phase 0) acquires the transform coefficient levels for the (3 ⁇ 4 component transform block) from the bitstream, and the decoder 1720 may restore the residual samples of the component by using the obtained transform coefficient levels.
  • the acquisition unit (1st phase 0) acquires the conversion coefficient levels for the & component conversion block from the bitstream, and the decoding unit 1720 can restore the residual samples of & component using the obtained conversion coefficient levels. .
  • the prediction type of the coding unit is an intra prediction mode or an inter prediction mode
  • a combination of the weight value of the residual sample of & component and the weight value of the residual sample of 3 ⁇ 4 component The number of joint modes can be set differently.
  • the & component is Information for ingredients 2020/175970 1»(:1 ⁇ 1 ⁇ 2020/002929 Select one of the multiple joint modes based on the selected joint mode, and according to the selected joint mode, the weight value of the residual sample of & component and ( The weight can be determined.
  • the decoder 1720 according to one joint mode allowed when the prediction type of the coding unit is the inter prediction mode, the weight value of the residual sample of & component You can determine the weight of the residual sample of the component.
  • the decoding unit 1720 based on the chroma joint information, the information for the & component, and the information for the & component, the weight value of the residual sample of the & component and the register of the component It is possible to determine the joint mode with dual samples, and determine the quantization parameters for the current block based on the joint mode.
  • the decoding unit 1720 determines a reference block in a reference picture using the motion vector of the current block, and determines prediction samples corresponding to the current block from the reference samples included in the reference block. can do.
  • the video decoding apparatus 1700 can obtain residual samples by performing inverse quantization and inverse transformation on the transformation coefficients of the current block acquired from the bitstream.
  • the decoding unit 1720 may determine reconstructed samples of the current block by combining the residual samples of the current block with the prediction samples of the current block.
  • FIG. 18 is a flowchart of a video decoding method according to an embodiment.
  • the acquisition unit (1st stage 0) may acquire information indicating the prediction type of the coding unit including the current block from the bitstream.
  • the acquisition unit (1st phase 0) can acquire "" information and "5" information of the current block from the bitstream.
  • the decoding unit 1720 determines the weight of the residual sample of the & component and the weight of the residual sample of the & component based on the predicted type of the coding unit, & ⁇ information, and (3 ⁇ 4 information). can do.
  • the acquisition unit (1st phase 0) is configured to determine whether one chroma sample is coded to represent a residual sample of (3 ⁇ 4 component and a corresponding & component) in the current block from the bitstream.
  • the decoding unit 1720 is based on the prediction type of the coding unit, & ⁇ information, and 3 ⁇ 4 information.
  • the weight of the residual sample of & component and the weight of the residual sample of 3 ⁇ 4 component can be determined.
  • the decoding unit (1720) selects one of multiple joint modes based on & ⁇ information and (3 ⁇ 4 ⁇ information), and according to the selected joint mode, & It is possible to determine the weight value of the residual sample of the component and the weight of the residual sample of the component.
  • the prediction type of the coding unit is the inter prediction mode
  • the decoder 1720 is the "" corresponding to one allowed joint mode. You can determine the weight of the residual sample of the component and the weight of the residual sample of the 3 ⁇ 4 component.
  • the weight of the residual sample of & component may be 1. According to another embodiment, the weight of the residual sample of the & component is -1, The weight of the residual sample of the component may be 1. According to another embodiment, the weight of the residual sample of & The weight of the residual sample of the component can be -1/2.
  • the combination of the weights of the residual samples of the component can be different, for example, for each of the three joint modes, the weight of the residual sample of & component and the weight of the residual sample of 3 ⁇ 4 component are 3 combinations of ⁇ -1 It can be set to /2, 1 ⁇ , ⁇ -1, 1 ⁇ , ⁇ 1, -1/2 ⁇ .
  • the weight of the residual sample of & component and the weight of the residual sample of component may be determined according to one of the three joint modes.
  • step 1840 the acquisition unit (1 unit 0) is the current block from the bitstream.
  • the decryption unit 1720 is the chromajoint residual sample of the current block and
  • the residual sample of & component can be restored by using the weight of the residual sample of & component.
  • the decoding unit 1720 uses the weight of the chroma-joint residual sample of the current block and the residual sample ( 3 ⁇ 4 component of residual gland can be restored.
  • the result of the weighted sum obtained by applying the weight of the residual samples of & component to the chroma-joint residual sample of the current block can be determined as the residual sample of & component.
  • the chroma-joint residual sample of the current block can be determined.
  • the decoding unit 1720 may restore the current block by using the motion vector of the current block.
  • the decoding unit 1720 may determine the reference block in the reference picture using the motion vector of the current block. And determine the predicted samples corresponding to the current block from the reference samples included in the reference block.
  • the decoding unit 1720 includes predicted samples of the current block and residuals of the current block in the prediction mode excluding the skip mode. Samples can be added to determine the restoration samples of the current block. If there are no residual samples, such as in skip mode, the restoration samples of the current block can be determined only from the prediction samples of the current block. By restoring the current block, the current block is included. The current picture to be played can be restored. 2020/175970 1»(:1 ⁇ 1 ⁇ 2020/00292929
  • the decoding unit 1720 uses the weight value of the residual sample of the & component and the weight value of the residual sample of the & component based on the chroma joint information, & information and (quarter information)
  • the mode can be determined, and the quantization parameters for the current block can be determined based on the determined joint mode, for example, when a specific joint mode is determined, the quantization parameters for the chroma components can be determined individually.
  • 1720) may perform inverse quantization of the transform coefficients of the chroma-joint residual samples of the current block by using the quantization parameter for the chroma components.
  • the decoder 1720 may perform inverse quantization and inverse transform on the transform coefficient.
  • the residual samples of & component and 05 component are applied. Residual samples can be restored.
  • 19 is a block diagram of a video encoding apparatus according to an embodiment.
  • the video encoding apparatus 1900 includes a prediction unit 1910 and a residual
  • the video encoding apparatus 1900 performs inter prediction and stores the determined motion information.
  • It can be encoded and output in the form of a bitstream.
  • the video encoding apparatus 1900 may include a central processor (not shown) that controls the block position determining unit 1910 and the inter prediction performing unit 1920.
  • a prediction unit ( 1910) and the residual encoding unit 1920 are operated by their own processors (not shown), and the video encoding apparatus 1900 may be operated as a whole as the processors (not shown) operate in an organic manner.
  • the prediction unit 1910 and the residual encoding unit 1920 may be controlled.
  • the video encoding device 1900 includes the prediction unit 1910 and the residual encoding unit 1920.
  • the video encoding apparatus 1900 may include a memory control unit (not shown) that controls data input/output of the data storage unit (not shown). have.
  • This video encoding device (1900) is, for video encoding
  • the internal video encoding processor of the video encoding device 1900 includes not only a separate processor, but also a central processing unit or a graphics processing unit, which is an image encoding processing module. It is also possible to implement basic image encoding operations by including.
  • the prediction unit 1910 may determine a prediction type of a coding unit including the current block. 2020/175970 1»(:1 ⁇ 1 ⁇ 2020/002929
  • the prediction unit 1910 may determine the samples of the reference block indicated by the motion vector of the current block as the predicted samples of the current block.
  • the residual encoding unit 1920 may determine the original sample and the prediction samples of the current block. Differences in residual samples can be determined.
  • the residual encoding unit 1920 can encode the generated transform coefficients by performing transform and quantization on the residual sample of the current block.
  • the residual sample of the sample and the & component can be determined and coded differently from the actual residual sample, which is the difference between the original sample and the predicted samples.
  • one chroma-joint residual sample can be encoded.
  • the residual encoding unit 1920 may determine & ⁇ information and (3 ⁇ 4 information) of the current block.
  • the residual encoding unit 1920 according to an embodiment includes a prediction type of a coding unit, Based on & information and ⁇ 5 information, the weight of the residual sample of & You can determine the weight of the residual sample of the component.
  • the residual encoding unit 1920 is a chroma joint of the current block.
  • the video encoding apparatus 1900 knows the residual sample of the real component and the residual sample of the & component, but can determine the chroma-joint residual sample to be coded for encoding efficiency.
  • the residual sample of & component is restored by using the weight of the chroma-joint residual sample of the current block and the residual sample of & component, and the chroma-joint residual sample of the current block and the residual sample of 05 component are restored.
  • the residual encoding unit 1920 uses the actual values of the residual samples of the (3 ⁇ 4 component) and the residual samples of the & components.
  • the chroma joint residual sample can be determined.
  • the residual encoding unit 1920 includes the prediction type of the coding unit, (3 ⁇ 4 (based on information and information, and the weight value of the residual sample of & component and the residual of 5 components). You can determine the weight of the dual sample.
  • the residual encoding unit 1920 has a prediction type of a coding unit
  • the number of joint modes corresponding to the combination of the weight value of the residual sample of & component and the weight value of the residual sample of 05 component can be set differently.
  • the residual encoding unit 1920 selects one of a plurality of joint modes based on the information for the & component and the information for the 5 component, Depending on the selected joint mode, the weight value of the residual sample of & component and the weight value of the residual sample of 05 component can be determined.
  • the prediction type of the coding unit is inter prediction mode, the residual of & component is allowed according to one joint mode. The weight of the sample and the (3/4 component residual sample) 2020/175970 1»(:1 ⁇ 1 ⁇ 2020/002929 Weight can be determined.
  • the video encoding device 1900 in the current block In order to represent the residual samples of the components and the corresponding "residual samples of the " component, chroma joint information indicating whether or not one chroma sample is coded can be generated.
  • 20 is a flow diagram illustrating a video encoding method according to an embodiment.
  • the prediction unit 1910 may determine the prediction type of the coding unit including the current block.
  • the video encoding apparatus 1900 may determine that the prediction type of the coding unit including the current block is an inter prediction mode.
  • prediction type information indicating whether or not the intra prediction mode is in the intra prediction mode can be encoded.
  • the residual encoding unit 1920 can determine the & information and ⁇ 5 information of the current block. For example, whether the current block contains the & component whose transformation coefficient level is not zero. To indicate, the residual encoding unit 1920 can encode the & ⁇ information. For example, if the current block does not contain the & component whose conversion factor level is not 0, the residual encoding unit 1920 can code & ⁇ Information can be coded to represent 0. If the current block contains the & component whose transformation coefficient level is not 0, the residual encoding unit 1920 can code the & ⁇ information to represent 1. Similarly, the current block In order to indicate whether the block contains the 5 components whose conversion factor level is not 0, the residual encoding unit 1920 can encode the (3 ⁇ 4 ⁇ ) information.
  • the current block has a conversion factor level of 0. If the non- ( 3 ⁇ 4 component is not included, the residual encoding unit 1920 can encode the (3 ⁇ 4 information to represent 0. If the current block contains 5 components whose transformation coefficient level is not 0, the residual encoding unit ( 1920) can be coded so that 0) information represents 1.
  • the residual encoding unit 1920 is based on the prediction type, "" information and (3 ⁇ 4 ⁇ information) of the coding unit, the weight value of the residual sample of & component and the (4/4 component residual sample). Weight can be determined.
  • the weight of the residual sample of & component may be 1. According to another embodiment, the weight of the residual sample of the & component is -1, The weight of the residual sample of the component may be 1. According to another embodiment, the weight of the residual sample of & The weight of the residual sample of the component can be -1/2.
  • the residual encoding unit 1920 selects one of a plurality of joint modes based on the information for the & component and the information for the 5 component, Depending on the selected joint mode, the weight value of the residual sample of & component and the weight value of the residual sample of 05 component can be determined.
  • the prediction type of the coding unit is inter prediction mode, the residual of & component is allowed according to one joint mode. The weight of the sample and the (3/4 component residual sample) 2020/175970 1»(:1 ⁇ 1 ⁇ 2020/002929 Weight can be determined.
  • the weight of the residual sample of & Multiple combinations of the weights of the residual samples of the components are provided, and one of the combinations of weights for each of the multiple joint modes can be selected.
  • the weight of the residual sample of & component and ( One of the combinations of weights ⁇ -1/2, 1 ⁇ , ⁇ -1, 1 ⁇ , ⁇ 1, -1/2 ⁇ can be selected for each joint mode In one mode selected from the three joint modes Accordingly, the weight of the residual sample of & component and the weight of the residual sample of 3 ⁇ 4 component may be determined.
  • the residual coding unit 1920 selects one of a plurality of joint modes based on the "" information and the "" information, and the selected Weight of residual samples of & components according to joint mode
  • the prediction type of the coding unit is in the inter prediction mode
  • the residual encoder 1920 weights the residual samples of & components according to one allowed joint mode. You can determine the weight of the residual sample of the component.
  • the residual encoding unit 1920 is the chroma joint of the current block.
  • the residual encoding unit 1920 replaces the actual value of the residual sample of the major component and the actual value of the residual sample of & component, one chroma-joint residual. Samples can be encoded. If the current block size is 8x8 luma blocks and 4x4 chroma blocks, a total of 16 chroma joint residual samples can be obtained from the bitstream.
  • the residual sample of & component is restored using the weight of the chroma-joint residual sample of the current block and the residual sample of & component, and the chroma-joint residual sample of the current block and the above by using the weight of the residual saemneul 05 components above (considering that the residual saemneul of 3 ⁇ 4 component to be restored, the residual encoding unit (1920) of the residual sample of the actual value of the residual sample of the component and the & elements The actual value can be used to determine the chromajoint residual sample.
  • Video encoding device 1900 in the current block A residual sample of the component
  • chroma joint information indicating whether or not one chroma sample is coded.
  • the (3 ⁇ 4 component residual sample and the corresponding & component residual sample are generated). If one chroma sample is coded to represent, steps 2030 and 2040 may be performed.
  • the residual encoding unit 1920 includes the weight value of the residual sample of & component and the weight value of the residual sample of & component based on chroma joint information, & ⁇ information, and (3 ⁇ 4) information You can determine the joint mode to use and determine the quantization parameters for the current block based on the determined joint mode. 2020/175970 1»(:1 ⁇ 1 ⁇ 2020/002929 For example, when a specific joint mode is determined, the quantization parameters for chroma components can be individually determined. The residual encoding unit 1920 uses the quantization parameters. Thus, quantization can be performed on the transform coefficients of the chroma-joint residual samples. The quantized transform coefficient can be coded with a syntax element called the transform coefficient level.
  • 21 shows a graph of the relationship between the (3 ⁇ 4 component, & component, and chroma-encoding component) according to an embodiment.
  • Graph 2100 shows the residual sample of & component in the video encoding device (1900).
  • the relationship between the actual value 2120 and the actual value 2110 of the residual sample of the 3 ⁇ 4 component and the chromajoint residual sample 2140 is shown.
  • the video encoding apparatus 1900 according to an embodiment is The average value between the actual value of the dual sample (2120) multiplied by -1 (2130) and the actual value of the (3 ⁇ 4 component residual sample (2110)) can be determined as the chromajoint residual sample (2140).
  • Graph 2200 shows the residual sample of &component in the video decoding device 1700.
  • the residual sample weight of the component can be determined as -1.
  • the decoding unit 1720 uses the same value as the chroma-joint residual sample 2140 as the residual sample of the component (2160). ), and a value generated by multiplying the chromajoint residual sample 2140 by -1 can be determined as the restored value of the residual sample 2170 of & component.
  • Figure 22 shows (between the 3 ⁇ 4 component, & component and the chroma-coding component
  • weighted polymerization applied can be determined by the restoration value Cr of the residual sample of the Cr component.
  • weightTable(corrldx) A table containing multiple weights, and one weight determined according to the index corrldx among the multiple weights can be determined as the residual sample weight of the Cr component. In this case, the residual sample weight of the Cb component is fixed at 1 It can be seen as being.
  • weightTable is ⁇ -1, 1, -2, -1/2 ,
  • the residual sample weight of the Cb component is fixed to 1, and the residual sample weight of the Cr component is ⁇ -1, 1, -2, -1/2, It can be determined as one of -4, 1/4 ... ⁇ .
  • the joint mode for Cb, Cr residual samples is ⁇ (1,
  • FIG. 23 illustrates a transform unit syntax according to an embodiment.
  • the video decoding apparatus 1700 may acquire syntax elements tu_cbf_cb, tu_cbf_cr, and tu j oint_cbcr_re sidual_flag from the transform unit syntax 2300.
  • tu_cbf_cb is a syntax element corresponding to Cb cbf information, and can indicate whether the current transform block contains a Cb component whose transform coefficient level is not zero.
  • tu_cbf_cr is a syntax element corresponding to Cr cbf information, and the current transform block has a transform coefficient level.
  • tuJoint_cbcr_residual_flag is a syntax element corresponding to chroma joint information, and can indicate whether one chroma sample is coded to indicate the residual sample of the Cb component and the residual sample of the corresponding Cr component in the current transformation block.
  • spsJoint_cbcr_enabled_flag may be obtained from a sequence parameter set.
  • spsJoint_cbcr_enabled_flag represents 1, it means that a chromajoint method in which one chroma sample is coded is allowed to represent the residual sample of the Cb component and the residual sample of the corresponding Cr component in the block included in the current sequence.
  • tu_cbf_cr[xC] [yC]) only, tu j oint_cbcr_residual_flag, that is, chroma joint information 2020/175970 1»(:1 ⁇ 1 ⁇ 2020/002929 can be obtained.
  • the prediction type of the coding unit is the intra prediction type, and the &
  • the prediction type of the coding unit is the inter prediction type, and the current block has a transformation coefficient with a & component level of 1 and a transformation coefficient with a component level of 1. In this case, it can be determined whether or not one chroma sample is coded to represent a residual sample of 05 components and a corresponding residual sample of & components through the chroma joint information, where the obtained chroma joint information represents zero.
  • the restoration value (8&) of the residual sample of & component can be determined by the chromajoint residual sample (0 multiplied by ⁇ 1/2).
  • the weight of the component is 1, the weight of the & component is ⁇ 1/2, and the joint mode index is 1.
  • Sample clothing Is determined by, and the restoration value (8&) of the residual sample of & component can be determined by the chromajoint residual sample (0 multiplied by ⁇ 1).
  • the weight of 1, & component is ⁇ 1, and the joint mode index is 2.
  • the joint mode index is 1,
  • the prediction type of the coding unit is the intra prediction mode.
  • the prediction type of the coding unit is the inter prediction mode
  • the joint mode index is 2, i.e., ⁇ _ ⁇ is 1 and Chroma joint method is allowed only when is 1
  • the component weight can be determined as 1, and the & component weight can be determined as ⁇ 1.
  • one chroma-joint residual sample is encoded, and the video decoding device 1700 acquires one chroma-joint residual sample from the bitstream, and one chroma-joint residual. From the sample, a method for determining the restoration value of the residual sample of (3 ⁇ 4 component) and the residual sample of & component is proposed.
  • the real value of the residual sample of the majority component and the real value of the residual sample of the & component are combined according to some relation to determine the chroma-joint residual sample, or Using a joint residual sample in the video decoding device (1700) Depending on whether the residual sample of the component and the residual sample of the &component are restored, the encoding efficiency can be higher.
  • the chroma joint sample value is encoded, and the video decoding device 1700
  • chroma joint information can be acquired from the bitstream according to the [3 ⁇ 4 ⁇ information and & information].
  • first luma information and large (information is
  • the joint information is 0, the & (information can be obtained. In this case,
  • chroma joint information can be decoded into a binary display consisting of two bins and a binary display consisting of 2/3 bins of & ⁇ information.
  • the joint chroma information in order to reduce the number of times the joint chroma information is encoded, it is possible to decode the joint chroma information prior to the (3 ⁇ 4 information. Specifically, luma) 2020/175970 1»(:1 ⁇ 1 ⁇ 2020/002929 The chroma joint information is acquired, and the chroma joint information can determine the information value to 0. Joint Information can be obtained from each bitstream. In this case, the chroma joint information is decoded into a binary display consisting of one bin, and the large information is decoded into a binary display consisting of 1/2 bins, and the & ⁇ information is decoded into a half bin. It can be decrypted as a binary string.
  • the context index can be determined in order to decrypt the chroma joint information.
  • the context index for decoding the chroma joint information may be determined based on whether the prediction type of the coding unit including the block is an intra prediction mode or an inter prediction mode.
  • the context index for decoding chroma joint information can be determined based on the size of the block. As a specific example, when the width of the block is the height of the block, 1 2 ⁇ is 1 2 The value to which is applied, 1 211 can be the value applied to 1 to 2.
  • the context index is and In another example, the context index can be determined based on the greater of 1 2 ⁇ and 1 211. In another example, the context index can be determined based on the average value of 1 2 ⁇ and 1 211. As another example, the context index can be determined based on the sum of 1 2 and 1 211.
  • the context index for decoding chroma joint information can be determined based on the ratio of the height and width of the block.
  • the context index for decoding the chroma joint information may be determined based on whether the inter prediction direction of the block is a one-way prediction type or a two-way prediction type.
  • [32 is another example, the context for decoding the chroma joint information of the current block
  • the index can be determined based on the chroma joint information of the neighboring block.
  • the index can be determined based on the encoding information of the neighboring block.
  • the context index for decoding the chroma joint information of the current block can be determined based on the information of the neighboring block.
  • the prediction of the neighboring block can be determined.
  • the context index for decoding the chroma joint information of the current block can be determined based on whether the type is an intra prediction mode or an inter prediction mode.
  • the chroma joint information of the current block can be determined.
  • the context index for decryption can be determined.
  • the index can be determined based on the transformation type of the current block, e.g. the current 2020/175970 1»(:1 ⁇ 1 ⁇ 2020/002929 Based on whether the conversion type of the block is a conversion skip type, a subblock conversion type, a quadratic conversion type, or a conversion type according to the block type, the context index is Can be determined.
  • the context index for decoding the chroma joint information of the current block can be determined based on a predetermined encoding mode.
  • the encoding mode of the current block is MHintra mode, Trianglelntra mode, Affine mode, IB C (Intra BC) mode, SMVD (Symmetric motion vector difference) mode, MMVD (Merge with motion vector difference) mode, DMVR (Decoder-side Motion Vector Refinement) mode, CCLM (Cross-component Linear Model) mode, PDPC ( Position dependent (intra) prediction combination) mode, MultiReflntra (Multi
  • the context index can be determined based on which one of Reference Line intra prediction) mode, intraSubPartition mode, inloop reshaper mode, OBMC (Overlapped Block Motion Compensation) mode, transformSkip mode, and SBT (Sub-block transform) mode is used. .
  • a context index for decoding chroma joint information of the current block may be determined based on the MTS (multiple transform selection) index of the current block.
  • the context index for decrypting the chroma joint information of the current block can be determined based on a combination of two or more of the various conditions proposed earlier.
  • the video decoding apparatus 1700 has a prediction type of a coding unit.
  • whether or not the chroma joint method is applied can be determined without any limitation on the block size.
  • the chroma joint method can be determined whether or not the chroma joint method is applied based on the size of the block.
  • log2W is the value of applying log2 to W.
  • log2H may be a value obtained by applying log2 to H.
  • Whether the chroma joint method is to be applied can be determined based on the smaller of log2W and log2H.
  • whether or not the chromajoint method will be applied can be determined based on the larger of log2W and log2H.
  • Other examples are log2W and log2H. It can be determined whether the chromajoint method is to be applied based on the average value of. As another example, whether or not the chromajoint method is to be applied can be determined based on the sum of log2W and log2H.
  • the prediction direction is the one-way prediction type. 2020/175970 1»(:1 ⁇ 1 ⁇ 2020/002929 Whether or not the chroma joint method is applied can be determined based on whether it is a bidirectional prediction type or not.
  • the chroma joint method can be determined whether or not the chroma joint method is applied based on the transformation type of the current block. For example, whether the transformation type of the current block is a transformation skip type, a sub-block transformation type, or a secondary Based on whether it is a transform type or a transform type according to a block shape, it can be determined whether or not the chroma joint method is applied.
  • the number of conversion factors of the Cb component or the number of conversion factors of the Cr component is the number of conversion factors of the Cb component or the number of conversion factors of the Cr component
  • the coding mode of the current block is MHintra mode, Trianglelntm mode, Affine mode, IBC (Intra BC) mode, SMVD (Symmetric motion vector difference) mode, MMVD (Merge with motion vector difference) mode.
  • MHintra mode Trianglelntm mode
  • Affine mode IBC (Intra BC) mode
  • SMVD Symmetric motion vector difference
  • MMVD Merge with motion vector difference
  • DM VR Decoder-side Motion Vector Refinement
  • CCLM Cross-component Linear Model
  • PDPC Portion dependent (intra) prediction combination
  • MultiReflntra Multi Reference Line intra prediction
  • intraSubPartition mode intraSubPartition mode
  • inloop reshaper mode OBMC (Overlapped Block Motion Compensation) mode
  • transformSkip mode SBT (Sub-block transform) mode based on whether or not to apply the chroma joint method can be determined based on which mode is used.
  • the chroma joint method it can be determined whether or not the chroma joint method is applied at the slice level. Depending on the flag acquired from the slice header, the application of the chroma joint method may be allowed in blocks included in the current slice.
  • the video encoding apparatus 1900 uses the actual value of the residual sample of the Cb component (resCb) and the actual value of the residual sample of the Cr component (resCr) as follows, using a chroma-joint residual sample. (resJoint) can be determined.
  • the video encoding device (1900) has a low RD cost among the above two resJoints.
  • Values can be encoded as chromajoint residual samples.
  • the video decoding apparatus 1700 may determine a method of restoring the residual sample of the Cr component based on the restored value of the sample of the luma component or the sample of the Cb component.
  • the video decoding apparatus 1700 can determine a method for restoring the residual sample of the Cr component based on the restored value of the residual sample of the luma component or the residual sample of the Cb component. .
  • the video decoding apparatus 1700 includes detail information of luma components or Cb
  • the detail information is the magnitude, mean, variance, gradient, high-frequency component, and low-frequency component of the luma component or Cb component.
  • the video decoding apparatus 1700 may determine a method of restoring the residual samples of & components, for each subblock of the current block, based on the content characteristics of each subblock.
  • the content of each subblock may be a luma component of the subblock, a restoration value of a sample of 05 components, or a restoration value of a residual sample of luma component or 05 component.
  • the characteristic of the content of each subblock is, It can contain at least one of the magnitude, mean, variance, gradient, high frequency component, and low frequency component.
  • the video encoding device 1900 can code the difference between the chroma joint residual sample and the chroma joint residual sample.
  • the difference between the chroma joint residual sample and the residual sample of & component is the chroma joint residual sample and the residual sample of & component. The difference between the values is indicated.
  • the video encoding apparatus 1900 has a residual sample of & component
  • the video decoding apparatus 1700 obtains the flag from the bitstream, and if it is determined that the residual sample of & component is not coded, the video decoding device 1700 The difference between the dual sample ()0 (3 ⁇ 4) and the chroma-joint residual sample ( ( 1 ⁇ )0 ⁇ (3 ⁇ 4_&) can be obtained from the bitstream.
  • the video decoding device 1700 is the restoration value of the residual sample of the (3 ⁇ 4 component).
  • video encoding Encode the average value between the residual sample of the component and the residual sample of the & component, It is possible to encode a value of 1/2 of the difference between the sample and the residual sample of the & component.
  • the video encoding apparatus 1900 can encode a flag indicating whether the residual sample of the & component is encoded. In this case, the video The decoding device 1700 acquires the flag from the bitstream, and if it is determined that the residual sample of & component is not encoded through the flag, the average value The half of the difference between and (3 ⁇ 4&) can be obtained from the bitstream.
  • video encoding A chroma-joint residual sample having the same value as the residual sample of the component can be encoded.
  • the video encoding device 1900 can encode the chroma-joint weight index.
  • the video decoding device 1700 can code from the bitstream. Acquiring a chroma-joint residual sample, a residual of 05 components with the same value as the chroma-joint residual sample 2020/175970 1»(:1 ⁇ 1 ⁇ 2020/002929 Samples can be restored.
  • the video decoding device 1700 obtains a chroma joint weight index from the bitstream, and the chroma joint weight pointed to by the weight index in the weight table.
  • the video decoding device 1700 can determine the value generated by multiplying the chroma joint weight and the chroma joint residual sample as the restored value of the residual sample of & component.
  • the weight table is ⁇ -1
  • Each chroma joint weight index which includes 1, -2, -1/2, -4, 1/4, and increases from 0, can point to each weight in the weight table, i.e. the chroma joint weight obtained from the bitstream. If the index is 0, the value generated by multiplying the chroma joint residual sample by -1 can be determined as the restored value of the residual sample of & component.
  • the video encoding device 1900 may encode a chroma-joint residual sample having the same value as the residual sample of & component.
  • the video encoding device 1900 may encode a chroma-joint weight index.
  • the video decoding apparatus 1700 obtains a chroma-joint residual sample from the bitstream and restores the residual sample of & component having the same value as the chroma-joint residual sample.
  • the video decoding apparatus 1700 can decode the video.
  • the device 1700 acquires a chroma joint weight index from the bitstream, and acquires a chroma joint weight pointed to by the weight index in the weight table.
  • the video decoding device 1700 is generated by multiplying the chroma joint weight value and the chroma joint residual sample. The resulting value can be determined as the restored value of the residual sample of the component.
  • the weight table contains ⁇ -1, 1, -2, -4, and each chroma joint weight index increasing from 0 is each of the weight table. You can point to the weights, i.e.
  • the generated chroma joint residual sample is multiplied by -1. It can be determined by the restoration value of the residual sample of the component. In general, since the sample of & component is less than the sample of 3 ⁇ 4 component, the absolute value of the chroma joint weight included in the weight table can be greater than or equal to 1.
  • the video decoding apparatus 1700 may determine the restored values of the (3/4 component transformation coefficients) by decoding the (3/4 component transformation coefficients obtained from the bitstream.
  • the apparatus 1700 can restore the conversion coefficient of & component by using the low frequency component of the conversion factor of the component.
  • a value obtained by multiplying the conversion factor of the ( 3 ⁇ 4 component by a predetermined weight) is the restored value of the conversion factor of the & component Can be determined by 2020/175970 1»(:1 ⁇ 1 ⁇ 2020/002929
  • the video encoding apparatus 1900 may encode the conversion factor of the component and the residual component of the 3 ⁇ 4 component, and may not encode the conversion factor of the & component, the residual component, and the & information.
  • the video decoding apparatus 1700 can determine the restoration values of the conversion coefficients of the 05 component by decoding the conversion coefficients of the 05 components acquired from the bitstream.
  • the video decoding apparatus 1700 can determine the restoration values of the conversion coefficients of the ( 3 ⁇ 4 component). You can restore the transformation coefficient of & component by using, as another example, the value obtained by multiplying the transformation factor of the 3 ⁇ 4 component by a predetermined weight can be determined as the restoration value of the transformation coefficient of the & component.
  • the chroma joint quantization parameter (3 ⁇ 0 ⁇ ) can be determined from the chroma joint quantization parameter (31 ⁇ ) for the component, for example, when the joint mode index is 1, video decoding device (1900) Is the chroma joint quantization parameter ( ⁇ ) Inverse quantization can be performed on the transformation factor of the component and the transformation factor of & component.
  • an acid for chroma components! 5 can be obtained through the transform block syntax.
  • the video decoding apparatus 1900 can obtain (1() for the chroma component for each conversion unit, and determine ( ⁇ ! 5) of the 5 component and the & component included in the current conversion unit.
  • an acid for chroma components! 5 can be obtained through predictive block syntax.
  • the video decoding apparatus 1900 can obtain (1() for the chroma component for each prediction unit, and determine ( ⁇ ! 5) of the 5 component and the & component included in the current prediction unit.
  • acid for chroma component! 5 can be obtained through the coding block syntax.
  • the video decoding apparatus 1900 can obtain (1() for the chroma component for each coding unit, and determine (1() of the (3 ⁇ 4 component and & component) included in the current coding unit.
  • an acid for chroma components! 5 can be obtained through the maximum coding block syntax. Therefore, the video decoding device 1900 obtains for the chroma component for each maximum coding unit, and is included in the current maximum coding unit.
  • the component ( « 5 can be determined.
  • an acid for chroma components! 5 can be obtained through the slice header syntax. Therefore, the video decoding device 1900 obtains (1( for the chroma component for each slice, and can determine the (3 ⁇ 4 component and ( « of the & component) included in the current slice). have.
  • the video decoding apparatus 1900 can determine the dQP of the Cb component and Cr component included in the current temporal layer.
  • the dQP for the chroma component may be a difference value between the QP for the Cb component and the QP for the luma component.
  • the QP for the chroma component is the QP for the chroma component and the default QP. It may be the difference between them.
  • the video decoding apparatus 1700 encodes dQP for chroma components.
  • the dQP for the chroma component is determined to be 2
  • the dQP for the chroma component Can be determined as 1.
  • the video decoding device 1700 blocks dQP for chroma components.
  • the dQP for the chroma component can be determined as 1, and if the block size is less than 16x16, the dQP for the chroma component can be determined as 2. .
  • the video decoding apparatus 1700 can determine the dQP for the chroma component based on the predetermined encoding mode of the block.
  • the encoding mode of the current block is MHintra mode, Trianglelntra mode, Affine mode.
  • IBC Intra BC
  • SMVD Symmetric motion vector difference
  • MMVD Merge with motion vector difference
  • DM VR Decoder-side Motion Vector Refinement
  • CCLM Cross-component Linear Model
  • PDPC Pisition dependent (intra) prediction combination) mode
  • MultiReflntra Multi Reference Line intra prediction
  • intmSubPartition mode inloop reshaper mode
  • OBMC Overlapped Block Motion Compensation
  • transformSkip mode SBT (Sub-block transform) mode
  • the index of the sub-decoding mode of the current block is 1, the dQP for the chroma component can be determined as 1, and if the index is not 1, the dQP for the chroma component can be determined as 2. .
  • the video decoding apparatus 1700 may determine the dQP for the chroma component based on the identification information of the current temporal layer. For example, the identification information of the temporal layer including the current block is determined. If it is greater than 2, the dQP for the chroma component can be determined as 0, and if the identification information is less than or equal to 2, the dQP for the chroma component can be determined as 2. As another example, the identification of the temporal layer containing the current block is determined as 0. If the information is 0, the dQP for the chroma component can be determined as 2, and if the identification information is not 0 and less than 3, the dQP for the chroma component can be determined as 1. If the identification information is greater than or equal to 3, the dQP for the chroma component is determined. dQP can be determined to be zero
  • the video decoding apparatus 1700 may determine the dQP for the chroma component of the current block based on the quantization parameter or the quantization parameter difference value of the neighboring block.
  • the video encoding device 1900 According to the chroma joint mode, the video encoding device 1900
  • the second chroma-joint residual sample 02 can be determined to be the average value of the negative value of the real value of the residual sample of the major component and the real value of the residual sample of the & component.
  • the video decoding apparatus 1700 two chroma joint modes may be possible.
  • the (3 ⁇ 4 component residual sample can be restored to the sum of the first chroma-joint residual sample and the second chroma-joint residual sample, and the residual sample of & component is the first chroma-joint residual sample.
  • the prediction type of the coding unit is the intra prediction mode
  • the video decoding apparatus 1700 uses the second mode without a mode index. The dual sample and the residual sample of & component can be restored.
  • three chroma-joint modes may be possible in the video decoding apparatus 1700.
  • the residual sample of 05 components can be restored to the same value as the chroma-joint residual sample, and the residual sample of & component is the chroma-joint residual sample.
  • the video decoding device ( 1700) can restore the (3 ⁇ 4 component residual sample and & component residual sample) according to the first mode without having to acquire the mode index.
  • the prediction type of the coding unit is the intra prediction mode, and the intra prediction direction is the directional mode.
  • the video decoding apparatus 1700 acquires a chroma joint mode index from the bitstream, and according to the method indicated by the mode index of the first mode and the third mode, the (3 ⁇ 4 component residual sample and the & component register Dual samples can be restored
  • the prediction type of the coding unit is the inter prediction mode
  • the device 1700 can restore a (four-component residual sample and a &-component residual sample) according to the second mode without having to acquire a mode index.
  • the video encoding apparatus 1900 encodes a chroma joint residual sample (: or a first chroma joint residual sample according to the first, second, and third modes)
  • the code 0 and 2 chroma-joint residual sample 02 can be coded in the same manner in this embodiment.
  • the chroma-joint residual sample in the three chroma-joint modes, the chroma-joint residual sample (:, The method of restoring the residual sample of the component and the residual sample of the & component by using at least one of the 1 chroma joint residual sample and the second chroma joint residual sample 02 is applied in the same manner in this embodiment.
  • the device 1700 obtains a chroma joint mode index from the bitstream, and according to the method indicated by the mode index of the first mode and the second mode, It is possible to restore the binary sample and the residual sample of & component.
  • the prediction type of the coding unit is the inter prediction mode
  • the video decoding apparatus 1700 acquires the chroma joint mode index from the bitstream, and According to the method indicated by the mode index of the third mode, The residual sample of the sample and & component can be restored.
  • the video encoding apparatus 1900 encodes a chroma joint residual sample (: or a first chroma joint residual sample according to the first, second, and third modes).
  • the code 0 and 2 chroma-joint residual sample 02 can be coded in the same manner in this embodiment.
  • the chroma-joint residual sample (:, 1 Chroma joint residual majoint residual sample 02 Using at least one of To restore the residual sample of the sample and & The 2020/175970 1» (:1 ⁇ 1 ⁇ 2020/002929 scheme is also applied in this embodiment).
  • the prediction type in the coding unit is an intra prediction mode
  • the intra prediction direction is a plana mode or IX:
  • the prediction type of the coding unit is the intra prediction mode, and the intra prediction mode.
  • the video decoding apparatus 1700 can restore the (3 ⁇ 4 component residual sample and the & component residual sample) according to the second mode without having to acquire a mode index.
  • the prediction type is the inter prediction mode
  • the video decoding apparatus 1700 is in the third mode without having to acquire a mode index.
  • the residual sample of the component can be restored.
  • This ⁇ 3 : 3 ⁇ 41+ ⁇ 4 : It transforms the weights ⁇ ,1, ⁇ 2, ⁇ 3, ⁇ 4 like 3 ⁇ 42, and various relational expressions can be used.
  • one mode may be determined from among a plurality of joint modes.
  • one of a number of joint modes can be determined.
  • the width of the block is the height of the block, 1 2 ⁇ is equal to 1 2
  • the value to which is applied 1 211 may be the value to which 1 2 is applied.
  • one of a number of joint modes can be determined.
  • one of a number of joint modes can be determined.
  • one of the multiple joint modes can be determined.
  • one of a number of joint modes can be determined.
  • one of the multiple joint modes can be determined.
  • the inter prediction direction of the block is one-way prediction type or two-way prediction
  • one of a number of joint modes can be determined.
  • one of the multiple joint modes for the current block can be determined. 2020/175970 1»(:1 ⁇ 1 ⁇ 2020/002929
  • One of the joint modes can be determined.
  • one of the multiple joint modes can be determined for the current block based on the cbf information of the neighboring block.
  • the prediction type of the neighboring block can be determined. Based on whether it is an intra prediction mode or an inter prediction mode, one mode for the current block among multiple joint modes can be determined; for another example, based on the transformation type of the neighboring block, among multiple joint modes, the current block One mode for the current block can be determined.
  • one of a number of joint modes can be determined. For example, whether the conversion type of the current block is a conversion skip type. , Based on whether it is a sub-block transformation type, a quadratic transformation type, or a transformation type according to a block shape, one of the plurality of joint modes can be determined.
  • the encoding mode of the current block is MHintra mode, Trianglelntra mode, Affine mode, IBC (Intra BC) mode, SMVD (Symmetric motion vector difference) mode, MMVD (Merge with motion vector difference) mode,
  • DM VR Decoder-side Motion Vector Refinement
  • CCLM Cross-component Linear Model
  • PDPC Portion dependent (intra) prediction combination
  • MultiReflntra Multi Reference Line intra prediction
  • intraS ubPartition mode inloop reshaper Based on which mode is used among the mode
  • OBMC Overlapped Block Motion Compensation
  • transformSkip mode transformSkip mode
  • SBT Sub-block transform
  • one mode for the current block may be determined from among multiple joint modes.
  • one mode to be used in blocks included in the current slice can be determined among multiple joint modes per slice.
  • one mode to be used in blocks included in the current temporal layer among a plurality of joint modes at the temporal layer level may be determined.
  • one of the multiple joint modes can be determined.
  • the prediction direction is the one-way prediction type.
  • One of a number of joint modes can be determined based on whether it is a bidirectional prediction type.
  • one of a plurality of joint modes may be determined based on the Cb cbf information and the Cr cbf information of the current block. 2020/175970 1»(:1 ⁇ 1 ⁇ 2020/002929
  • one of the multiple joint modes can be determined based on a combination of two or more of the various conditions proposed above.
  • the above-described embodiments of the present disclosure can be written as a program that can be executed on a computer, and the created program can be stored on a medium.
  • the medium continues to store, execute, or execute programs executable by a computer.
  • the medium may be a variety of recording means or storage means in the form of a single or a combination of several pieces of hardware, not limited to media directly connected to any computer system, but distributed over the network.
  • Examples of media include magnetic media such as hard disks, floppy disks and magnetic tapes, optical recording media such as CD-ROMs and DVDs, and magnetic-optical media such as floptical disks.
  • -optical medium may be configured to store program instructions, including ROM, RAM, flash memory, etc.
  • a site that supplies or distributes an app store or other various software that distributes applications. , Recording media and storage media managed by servers, etc.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Computing Systems (AREA)
  • Theoretical Computer Science (AREA)
  • Compression Or Coding Systems Of Tv Signals (AREA)
  • Color Television Systems (AREA)

Abstract

부호화 단위의 예측 타입, Cr 성분을 위한 cbf 정보 및 Cb 성분을 위한 cbf 정보에 기초하여, Cr 성분의 레지듀얼 샘플의 가중치 및 Cb 성분의 레지듀얼 샘플의 가중치를 결정하고, 비트스트림으로부터, 현재 블록의 크로마 조인트 레지듀얼 샘플을 획득하고, 현재 블록의 크로마 조인트 레지듀얼 샘플 및 Cr 성분의 레지듀얼 샘플의 가중치를 이용하여 Cr 성분의 레지듀얼 샘플을 복원하고, 현재 블록의 크로마 조인트 레지듀얼 샘플 및 Cb 성분의 레지듀얼 샘플의 가중치를 이용하여 Cb 성분의 레지듀얼 샘플을 복원하기 위한 비디오 복호화 방법이 제안된다.

Description

2020/175970 1»（：1/10公020/002929 명세서
발명의명칭 :크로마성분을예측하는비디오부호화및복호화 방법，및크로마성분을예측하는비디오부호화및복호화장치 기술분야
[1] 본개시는영상의부호화및복호화분야에관한것이다.보다구체적으로,본 개시는크로마성분을예측하는비디오를부호화및복호화하는방법및장치에 관한것이다.
배경기술
[2] 높은화질의비디오는부호화시많은양의데이터가요구된다.그러나비디오 데이터를전달하기위하여허용되는대역폭은한정되어있어,비디오데이터 전송시적용되는데이터레이트가제한될수있다.그러므로효율적인비디오 데이터의전송을위하여,화질의열화를최소화하면서압축률을증가시킨 비디오데이터의부호화및복호화방법이필요하다.
[3] 비디오데이터는픽셀들간의공간적중복성및시간적중복성을제거함으로써 압축될수있다.인접한픽셀들간에공통된특징을가지는것이일반적이기 때문에,인접한픽셀들간의중복성을제거하기위하여픽셀들로이루어진 데이터단위로부호화정보가전송된다.
[4] 데이터단위에포함된픽셀들의픽셀값은직접전송되지않고,픽셀값을
획득하기위해필요한방법이전송된다.픽셀값을원본값과유사하게예측하는 예측방법이데이터단위마다결정되며 ,예측방법에대한부호화정보가 부호화기에서복호화기로전송된다.또한예측값이원본값과완전히동일하지 않으므로,원본값과예측값의차이에대한레지듀얼데이터가부호화기에서 복호화기로전송된다.
[5] 예측이정확해질수록예측방법을특정하는데필요한부호화정보가
증가되지만,레지듀얼데이터의크기가감소하게된다.따라서부호화정보와 레지듀얼데이터의크기를고려하여예측방법이결정된다.특히，픽처에서 분할된데이터단위는다양한크기를가지는데,데이터단위의크기가클수록 예측의정확도가감소할가능성이높은대신,부호화정보가감소하게된다. 따라서픽처의특성에맞게블록의크기가결정된다.
[6] 또한예측방법에는인트라예측과인터 예측이있다.인트라예측은블록의 주변픽셀들로부터블록의픽셀들을예측하는방법이다.인터예측은블록이 포함된픽처가참조하는다른픽처의픽셀을참조하여픽셀들을예측하는 방법이다.따라서인트라예측에의하여공간적중복성이제거되고,인터 예측에 의하여시간적중복성이제거된다.
[刀 예측방법의수가증가할수록예측방법을나타내기위한부호화정보의양은 증가한다.따라서블록에적용되는부호화정보역시다른블록으로부터 2020/175970 1»（：1^1{2020/002929 예측하여부호화정보의크기를줄일수있다.
[8] 인간의시각이인지하지못하는한도에서비디오데이터의손실이허용되는 바,레지듀얼데이터를변환및양자화과정에따라손실압축 (1088
001111^6881011)하여레지듀얼데이터의양을감소시킬수있다.
발명의상세한설명
기술적과제
[9] 일실시예에따른픽쳐의크로마성분,즉 &성분및 (¾성분을효율적으로 부호화및복호화하는것을기술적과제로한다.
과제해결수단
[1이 본개시의일실시예에따른비디오복호화방법은,비트스트림으로부터현재 블록을포함하는부호화단위의예측타입을나타내는정보를획득하는단계; 상기비트스트림으로부터 ,상기현재블록의 &성분을위한此 정보및 (¾ 성분을위한 정보를획득하는단계 ;상기부호화단위의 예측타입 ,상기 & 성분을위한 정보및상기 성분을위한此 정보에기초하여 ,상기 & 성분의레지듀얼샘플의가중치및상기 05성분의레지듀얼샘플의가중치를 결정하는단계;상기비트스트림으로부터,상기현재블록의크로마조인트 레지듀얼샘플을획득하는단계;상기현재블록의크로마조인트레지듀얼샘플 및상기 &성분의레지듀얼샘플의가중치를이용하여상기 &성분의레지듀얼 샘플을복원하고,상기현재블록의크로마조인트레지듀얼샘플및상기 (¾ 성분의레지듀얼샘플의가중치를이용하여상기 05성분의레지듀얼샘플을 복원하는단계를포함할수있다.
발명의효과
[11] 일실시예에따른크로마성분을예측하는비디오부호화방법,복호화방법, 부호화장치및복호화장치는크로마성분을예측하는 (¾성분및 &성분간의 유사성을이용하여효과적으로크로마성분을부복호화하는방법을제공한다.
[12] 다만,일실시예에따른크로마성분을예측하는비디오부호화방법,복호화 방법,부호화장치및복호화장치가달성할수있는효과는이상에서언급한 것들로제한되지않으며,언급하지않은또다른효과들은아래의기재로부터본 개시가속하는기술분야에서통상의지식을가진자에게명확하게이해될수 있을것이다.
도면의간단한설명
[13] 본명세서에서인용되는도면을보다충분히이해하기위하여각도면의
간단한설명이제공된다.
[14] 도 1은일실시예에따라영상복호화장치의개략적인블록도를도시한다.
[15] 도 2는일실시예에따라영상복호화방법의흐름도를도시한다.
[16] 도 3은일실시예에따라영상복호화장치가현재부호화단위를분할하여 적어도하나의부호화단위를결정하는과정을도시한다. 2020/175970 1»（：1^1{2020/002929
[17] 도 4는일실시예에 따라영상복호화장치가비 -정사각형의 형태인부호화 단위를분할하여 적어도하나의부호화단위를결정하는과정을도시한다.
[18] 도 5는일실시예에 따라영상복호화장치가블록형태정보및분할형태모드 정보중적어도하나에기초하여부호화단위를분할하는과정을도시한다.
[19] 도 6은일실시예에 따라영상복호화장치가홀수개의부호화단위들중
소정의부호화단위를결정하기위한방법을도시한다.
[2이 도 7은일실시예에 따라영상복호화장치가현재부호화단위를분할하여 복수개의부호화단위들을결정하는경우,복수개의부호화단위들이 처리되는 순서를도시한다.
[21] 도 8은일실시예에 따라영상복호화장치가소정의순서로부호화단위가 처리될수없는경우,현재부호화단위가홀수개의부호화단위로분할되는 것임을결정하는과정을도시한다.
[22] 도 9는일실시예에 따라영상복호화장치가제 1부호화단위를분할하여
적어도하나의부호화단위를결정하는과정을도시한다.
[23] 도 은일실시예에 따라영상복호화장치가제 1부호화단위가분할되어 결정된비-정사각형 형태의 제 2부호화단위가소정의조건을만족하는경우제 2 부호화단위가분할될수있는형태가제한되는것을도시한다.
[24] 도 11은일실시예에 따라분할형태모드정보가 4개의 정사각형 형태의
부호화단위로분할하는것을나타낼수없는경우,영상복호화장치가 정사각형 형태의부호화단위를분할하는과정을도시한다.
[25] 도 12는일실시예에 따라복수개의부호화단위들간의처리순서가부호화 단위의분할과정에 따라달라질수있음을도시한것이다.
[26] 도 13은일실시예에 따라부호화단위가재귀적으로분할되어복수개의
부호화단위가결정되는경우,부호화단위의 형태및크기가변함에 따라 부호화단위의심도가결정되는과정을도시한다.
[27] 도 14은일실시예에 따라부호화단위들의 형태 및크기에 따라결정될수있는 심도및부호화단위구분을위한인덱스여 산 ,이하 ^이를도시한다.
[28] 도 15는일실시예에 따라픽쳐에포함되는복수개의소정의 데이터 단위에 따라복수개의부호화단위들이결정된것을도시한다.
[29] 도 16은영상부호화및복호화시스템의블록도를나타낸도면이다.
[3이 도 17은일실시예에 따른비디오복호화장치의블록도를도시한다.
[31] 도 18은일실시예에 따른비디오복호화방법의흐름도를도시한다.
[32] 도 19는일실시예에 따른비디오부호화장치의블록도를도시한다.
[33] 도 20은일실시예에 따른비디오부호화방법의흐름도를도시한다.
[34] 도 21은일실시예에 따른 (¾성분, &성분및크로마부호화성분간의 관계에 대한그래프를도시한다.
[35] 도 22은일실시예에 따른 (¾성분, &성분및크로마부호화성분간의
관계식을나타낸다. 2020/175970 1»（：1/10公020/002929
[36] 도 23은일실시예에따른 transform unit syntax를도시한다.
[37] 도 24은일실시예에따른 Cb cbf값, Cr cbf^l조합에 Cb성분, Cr성분및
크로마부호화성분간의관계식을나타낸다.
발명의실시를위한최선의형태
[38] 본개시에서제공되는일실시예에따른움직임정보의복호화방법은,
비트스트림으로부터현재블록을포함하는부호화단위의예측타입을 나타내는정보를획득하는단계;상기비트스트림으로부터,상기현재블록의 Cr 성분을위한 cbf정보및 Cb성분을위한 cbf정보를획득하는단계 ;상기부호화 단위의 예측타입 ,상기 Cr성분을위한 cbf정보및상기 Cb성분을위한 cbf 정보에기초하여,상기 Cr성분의레지듀얼샘플의가중치및상기 Cb성분의 레지듀얼샘플의가중치를결정하는단계;상기비트스트림으로부터,상기현재 블록의크로마조인트레지듀얼샘플을획득하는단계;상기현재블록의크로마 조인트레지듀얼샘플및상기 Cr성분의레지듀얼샘플의가중치를이용하여 상기 Cr성분의레지듀얼샘플을복원하고,상기현재블록의크로마조인트 레지듀얼샘플및상기 Cb성분의레지듀얼샘플의가중치를이용하여상기 Cb 성분의레지듀얼샘플을복원하는단계를포함할수있다.
[39] 일실시예에따라상기 Cr성분의레지듀얼샘플의가중치및상기 Cb성분의 레지듀얼샘플의가중치를결정하는단계는,상기부호화단위의 예측타입, 상기 Cr성분을위한 cbf정보및상기 Cb성분을위한 cbf정보에기초하여 ,상기 현재블록에서상기 Cb성분의레지듀얼샘플및대응하는상기 Cr성분의 레지듀얼샘플을나타내기위해하나의크로마샘플이부호화되는지여부를 나타내는크로마조인트정보를획득하는단계;및상기크로마조인트정보가 상기현재블록에서하나의크로마샘플이부호화됨을나타낼때,상기부호화 단위의 예측타입 ,상기 Cr성분을위한 cbf정보및상기 Cb성분을위한 cbf 정보에기초하여상기 Cr성분의레지듀얼샘플의가중치및상기 Cb성분의 레지듀얼샘플의가중치를결정하는단계를포함할수있다.
[4이 일실시예에따라상기 Cr성분의레지듀얼샘플의가중치는 - 1/2이고,상기 Cb 성분의레지듀얼샘플의가중치는 1일수있다.
[41] 일실시예에따라상기 Cr성분의레지듀얼샘플의가중치는 -1이고,상기 Cb 성분의레지듀얼샘플의가중치는 1일수있다.
[42] 일실시예에따라상기 Cr성분의레지듀얼샘플의가중치는 1이고,상기 Cb 성분의레지듀얼샘플의가중치는 - 1/2일수있다.
[43] 일실시예에따라상기 Cr성분의레지듀얼샘플의가중치및상기 Cb성분의 레지듀얼샘플의가중치를결정하는단계는,상기부호화단위의 예측타입이 인트라예측모드또는인터 예측모드인지여부에따라,상기 Cr성분의 레지듀얼샘플의가중치및상기 Cb성분의레지듀얼샘플의가중치의조합에 대응하는조인트모드의개수를다르게설정하는단계를포함할수있다. 2020/175970 1»（：1^1{2020/002929
[44] 일실시예에따라,상기 &성분의레지듀얼샘플의가중치및상기 성분의 레지듀얼샘플의가중치를결정하는단계는,상기부호화단위의 예측타입이
Figure imgf000006_0001
정보에기초하여다수의조인트모드중하나를선택하고,상기선택된하나의 조인트모드에따라상기 &성분의레지듀얼샘플의가중치
Figure imgf000006_0002
성분의 레지듀얼샘플의가중치를결정하는단계를포함할수있다.
[45] 일실시예에따른상기 &성분의레지듀얼샘플의가중치및상기 (¾성분의 레지듀얼샘플의가중치를결정하는단계는,상기부호화단위의 예측타입이 인터 예측모드일때허용되는하나의조인트모드에따라상기 &성분의 레지듀얼샘플의가중치및상기
Figure imgf000006_0003
성분의레지듀얼샘플의가중치를결정하는 단계를포함할수있다.
[46] 일실시예에따른상기비디오복호화방법은,상기크로마조인트정보,상기 &성분을위한 정보및상기幻5성분을위한 정보에기초하여 ,상기 & 성분의레지듀얼샘플의가중치및상기 05성분의레지듀얼샘플의가중치를 포함하는조인트모드를결정하는단계;및상기조인트모드에기초하여,상기 현재블록을위한양자화파라미터를결정하는단계를포함할수있다.
[47] 본개시에서제안하는일실시예에따른비디오복호화장치는,
비트스트림으로부터현재블록을포함하는부호화단위의예측타입을
나타내는정보를획득하고,상기비트스트림으로부터,상기현재블록의 & 성분을위한 정보및 성분을위한 정보를획득하고,상기
비트스트림으로부터,상기현재블록의크로마조인트레지듀얼샘플을 획득하는획득부;및상기부호화단위의예측타입
정보및상기幻5성분을위한 정보에기초하여 ,
Figure imgf000006_0004
샘늘의가중치및상기 (¾성분의레지듀얼샘늘의가중치를결정하고,상기 현재블록의크로마조인트레지듀얼샘플및상기 &성분의레지듀얼샘플의 가중치를이용하여상기 &성분의레지듀얼샘플을복원하고,상기현재블록의 크로마조인트레지듀얼샘플및상기 05성분의레지듀얼샘플의가중치를 이용하여상기 05성분의레지듀얼샘플을복원하는복호화부를포함할수있다.
[48] 일실시예에따른상기획득부는,상기비트스트림으로부터，상기부호화
단위의 예측타입 ,상기 &성분을위한此 정보및상기 성분을위한 정보에기초하여,상기현재블록에서상기 05성분의레지듀얼샘플및 대응하는상기 &성분의레지듀얼샘플을나타내기위해하나의크로마샘플이 부호화되는지여부를나타내는크로마조인트정보를획득하고,상기
복호화부는,상기크로마조인트정보가하나의크로마샘플이부호화됨을 나타낼때 ,상기부호화단위의예측타입 ,상기 &성분을위한此 정보및상기 (¾성분을위한此 정보에기초하여,상기 &성분의레지듀얼샘플의가중치및 상기幻5성분의레지듀얼샘플의가중치를결정하고,상기부호화단위의예측 타입이인트라예측모드또는인터예측모드인지여부에따라,상기 &성분의 2020/175970 1»（：1^1{2020/002929 레지듀얼샘플의가중치 및상기 05성분의 레지듀얼샘플의가중치의조합에 대응하는조인트모드의 개수를다르게설정될수있다.
[49] 일실시예에 따른상기복호화부는,상기부호화단위의 예측타입이 인터 예측 모드일때허용되는하나의조인트모드에따라상기 &성분의 레지듀얼샘플의 가중치 및상기 05성분의 레지듀얼샘플의가중치를결정할수있다.
[5이 본개시에서 제안하는일실시예에따른비디오부호화방법은,현재블록을 포함하는부호화단위의 예측타입을결정하는단계;상기 현재블록의 & 성분을위한 정보및 (¾성분을위한 정보를결정하는단계 ;상기부호화
Figure imgf000007_0001
정보에 기초하여,상기 &성분의 레지듀얼샘플의가중치 및상기 (¾성분의 레지듀얼샘플의가중치를결정하는단계;및상기 현재블록의크로마조인트 레지듀얼샘플을생성하는단계를포함하고,상기 현재블록의크로마조인트 레지듀얼샘플및상기 &성분의 레지듀얼샘플의가중치를이용하여상기 & 성분의 레지듀얼샘플이복원되고,상기 현재블록의크로마조인트레지듀얼 샘플및상기 05성분의 레지듀얼샘플의가중치를이용하여상기 05성분의 레지듀얼샘플이복원될수있다.
[51] 일실시예에 따른상기 비디오부호화방법은,상기 현재블록에서상기 (¾ 성분의 레지듀얼샘플및대응하는상기 &성분의 레지듀얼샘플을나타내기 위해하나의크로마샘플이부호화되는지 여부를나타내는크로마조인트 정보를생성하는단계를더포함하고,상기 현재블록에서하나의크로마샘플이 부호화될때 ,상기부호화단위의 예측타입 ,상기 &성분을위한此 정보및 상기幻5성분을위한 정보에기초하여 ,상기 &성분의 레지듀얼샘플의 가중치 및상기 성분의 레지듀얼샘플의가중치가결정되고,상기부호화 단위의 예측타입이 인트라예측모드또는인터 예측모드인지 여부에 따라, 상기 &성분의 레지듀얼샘플의 가중치 및상기 (¾성분의 레지듀얼샘플의 가중치의조합에 대응하는조인트모드의 개수를다르게설정될수있다.
[52] 일실시예에 따라상기 &성분의 레지듀얼샘플의 가중치 및상기
Figure imgf000007_0002
성분의 레지듀얼샘플의가중치를결정하는단계는,상기부호화단위의 예측타입이 인트라예측모드일때 ,상기 &성분을위한此 정보및상기 성분을위한 정보에 기초하여다수의조인트모드중하나를선택하고,상기선택된조인트 모드에 따라상기 &성분의 레지듀얼샘플의 가중치 및상기 (¾성분의 레지듀얼샘플의가중치를결정하는단계;및상기부호화단위의 예측타입이 인터 예측모드일때허용되는하나의조인트모드에따라상기 &성분의 레지듀얼샘플의가중치 및상기
Figure imgf000007_0003
성분의 레지듀얼샘플의가중치를결정하는 단계를포함할수있다.
[53] 본개시의 일실시예에 따른비디오복호화방법을컴퓨터로구현하기 위한 프로그램이 기록된컴퓨터로판독가능한기록매체가개시된다.
[54] 본개시의 일실시예에 따른비디오부호화방법을컴퓨터로구현하기 위한 2020/175970 1»（：1^1{2020/002929 프로그램이 기록된컴퓨터로판독가능한기록매체가개시된다.
발명의실시를위한형태
[55] 본개시는다양한변경을가할수있고여러 가지실시예를가질수있는바, 특정실시예들을도면에 예시하고,이를상세한설명을통해상세히설명하고자 한다.그러나,이는본개시의실시 형태에 대해한정하려는것이아니며,본 개시는여러실시예들의사상및기술범위에포함되는모든변경,균등물내지 대체물을포함하는것으로이해되어야한다.
[56] 실시예를설명함에 있어서,관련된공지 기술에 대한구체적인설명이본
개시의요지를불필요하게흐릴수있다고판단되는경우그상세한설명을 생략한다.또한,명세서의 설명과정에서 이용되는숫자（예를들어,제 1,제 2 등）는하나의구성요소를다른구성요소와구분하기위한식별기호에불과하다.
[57] 또한,본명세서에서 ,일구성요소가다른구성요소와”연결된다”거나
"접속된다”등으로언급된때에는,상기 일구성요소가상기다른구성요소와 직접 연결되거나또는직접접속될수도있지만,특별히 반대되는기재가 존재하지 않는이상,중간에또다른구성요소를매개하여 연결되거나또는 접속될수도있다고이해되어야할것이다.
[58] 또한,본명세서에서’〜부（유닛）’,’모듈’등으로표현되는구성요소는 2개 이상의 구성요소가하나의구성요소로합쳐지거나또는하나의구성요소가보다 세분화된기능별로 2개 이상으로분화될수도있다.또한,이하에서 설명할 구성요소각각은자신이 담당하는주기능이외에도다른구성요소가담당하는 기능중일부또는전부의 기능을추가적으로수행할수도있으며,구성요소 각각이 담당하는주기능중일부기능이다른구성요소에의해 전담되어수행될 수도있음은물론이
[59] 또한,본명세서에
Figure imgf000008_0001
비디오의정지영상이거나
동영상,즉비디오그자체를나타낼수있다.
[6이 또한,본명세서에서’샘플’은,영상의 샘플링 위치에할당된데이터로서
프로세싱 대상이되는데이터를의미한다.예를들어 ,공간영역의 영상에서 화소값,변환영역상의 변환계수들이 샘플들일수있다.이러한적어도하나의 샘플들을포함하는단위를블록이라고정의할수있다.
[61] 또한,
Figure imgf000008_0002
부호화또는복호화하고자 하는현재 영상의 최대부호화단위,부호화단위,예측단위또는변환단위의 블록을의미할수있다.
[62] 또한,본명세서에서,어느움직임 벡터가리스트 0방향이라는것은,리스트
0에포함된참조픽처내블록을가리키기 위해 이용되는움직임 벡터라는것을 의미할수있고,어느움직임 벡터가리스트 1방향이라는것은,리스트 1에 포함된참조픽처 내블록을가리키기위해 이용되는움직임 벡터라는것을 의미할수있다.또한,어느움직임 벡터가단방향이라는것은리스트 0또는 2020/175970 1»（：1^1{2020/002929 리스트 1에포함된참조픽처내블록을가리키기위해이용되는움직임 벡터라는것을의미할수있고,어느움직임벡터가양방향이라는것은움직임 벡터가리스트 0방향의움직임벡터와리스트 1방향의움직임벡터를 포함한다는것을의미할수있다.
[63] 이하도 1내지도 16를참조하여일실시예에따라영상부호화장치및영상 복호화장치,영상부호화방법및영상복호화방법이상술된다.도 3내지도 16을참조하여일실시예에따라영상의데이터단위를결정하는방법이 설명되고,도 17내지도 28을참조하여일실시예에따른타일및타일그룹을 이용하는비디오부호화/복호화방법이후술된다.
[64] 이하도 1및도 2를참조하여본개시의일실시예에따라다양한형태의
부호화단위에기초하여적응적으로선택하기위한방법및장치가상술된다.
[65] 도 1은일실시예에따라영상복호화장치의개략적인블록도를도시한다.
[66] 영상복호화장치 (100)는수신부 (110)및복호화부 (120)를포함할수있다. 수신부 (110)및복호화부 (120)는적어도하나의프로세서를포함할수있다.또한 수신부 ( 0)및복호화부 (120)는적어도하나의프로세서가수행할명령어들을 저장하는메모리를포함할수있다.
[67] 수신부 ( 0)는비트스트림을수신할수있다.비트스트림은후술되는영상 부호화장치 (2200)가영상을부호화한정보를포함한다.또한비트스트림은영상 부호화장치 (2200)로부터송신될수있다.영상부호화장치 (2200)및영상 복호화장치 (100)는유선또는무선으로연결될수있으며,수신부 (110)는유선 또는무선을통하여비트스트림을수신할수있다.수신부 ( 0)는광학미디어, 하드디스크등과같은저장매체로부터비트스트림을수신할수있다.
복호화부 (120)는수신된비트스트림으로부터획득된정보에기초하여영상을 복원할수있다.복호화부 (120)는영상을복원하기위한신택스엘리먼트를 비트스트림으로부터획득할수있다.복호화부 (120)는신택스엘리먼트에 기초하여영상을복원할수있다.
[68] 영상복호화장치 ( 0)의동작에대해서는도 2와함께보다자세히설명한다.
[69] 도 2는일실시예에따라영상복호화방법의흐름도를도시한다.
이 본개시의일실시예에따르면수신부 ( 0)는비트스트림을수신한다.
1] 영상복호화장치 (100)는비트스트림으로부터부호화단위의분할형태모드에 대응하는빈스트링을획득하는단계 (210)를수행한다.영상복호화장치 (100)는 부호화단위의분할규칙을결정하는단계 (220)를수행한다.또한영상복호화 장치 (100)는분할형태모드에대응하는빈스트링및상기분할규칙중적어도 하나에기초하여,부호화단위를복수의부호화단위들로분할하는단계 (230)를 수행한다.영상복호화장치 (100)는분할규칙을결정하기위하여,부호화단위의 너비및높이의비율에따른,상기부호화단위의크기의허용가능한제 1범위를 결정할수있다.영상복호화장치 (100)는분할규칙을결정하기위하여,부호화 단위의분할형태모드에따른,부호화단위의크기의허용가능한제 2범위를 2020/175970 1»（：1^1{2020/002929 결정할수있다.
2] 이하에서는본개시의 일실시예에따라부호화단위의분할에 대하여자세히 설명한다.
[73] 먼저하나의픽처 (Picture)는하나이상의슬라이스혹은하나이상의타일로 분할될수있다.하나의슬라이스혹은하나의타일은하나이상의 최대부호화 단위 (Coding Tree Unit; CTU)의시퀀스일수있다.최대부호화단위 (CTU)와 대비되는개념으로최대부호화블록 (Coding Tree Block; CTB)이 있다.
4] 최대부호화블록 (CTB)은 NxN개의 샘플들을포함하는 NxN블록을
의미한다어은정수).각컬러성분은하나이상의 최대부호화블록으로분할될 수있다.
[75] 픽처가 3개의 샘플어레이 (Y, Cr, Cb성분별샘플어레이 )를가지는경우에 최대부호화단위 (CTU)란,루마샘플의최대부호화블록및그에 대응되는 크로마샘플들의 2개의 최대부호화블록과,루마샘플,크로마샘플들을 부호화하는데 이용되는신택스구조들을포함하는단위이다.픽처가모노크롬 픽처인경우에최대부호화단위란,모노크롬샘플의최대부호화블록과 모노크롬샘플들을부호화하는데 이용되는신택스구조들을포함하는 단위이다.픽처가컬러성분별로분리되는컬러플레인으로부호화되는픽처인 경우에 최대부호화단위란,해당픽처와픽처의 샘플들을부호화하는데 이용되는신택스구조들을포함하는단위이다.
6] 하나의최대부호화블록 (CTB)은 MxN개의 샘플들을포함하는 MxN부호화 블록 (coding block)으로분할될수있다 (M, N은정수).
R7] 픽처가 Y, Cr, Cb성분별샘플어레이를가지는경우에부호화단위 (Coding
Unit; CU)란,루마샘플의부호화블록및그에 대응되는크로마샘플들의 2개의 부호화블록과,루마샘플,크로마샘플들을부호화하는데 이용되는신택스 구조들을포함하는단위이다.픽처가모노크롬픽처인경우에부호화단위란, 모노크롬샘플의부호화블록과모노크롬샘플들을부호화하는데 이용되는 신택스구조들을포함하는단위이다.픽처가컬러성분별로분리되는컬러 플레인으로부호화되는픽처인경우에부호화단위란,해당픽처와픽처의 샘플들을부호화하는데이용되는신택스구조들을포함하는단위이다.
8] 위에서설명한바와같이,최대부호화블록과최대부호화단위는서로
구별되는개념이며 ,부호화블록과부호화단위는서로구별되는개념이다.즉, (최대)부호화단위는해당샘플을포함하는 (최대)부호화블록과그에 대응하는 신택스구조를포함하는데이터구조를의미한다.하지만당업자가 (최대 ) 부호화단위또는 (최대)부호화블록가소정 개수의 샘플들을포함하는소정 크기의블록을지칭한다는것을이해할수있으므로,이하명세서에서는최대 부호화블록과최대부호화단위,또는부호화블록과부호화단위를특별한 사정이 없는한구별하지 않고언급한다.
[79] 영상은최대부호화단위 (Coding Tree Unit; CTU)로분할될수있다.최대 2020/175970 1»（：1^1{2020/002929 부호화단위의크기는비트스트림으로부터 획득된정보에기초하여 결정될수 있다.최대부호화단위의모양은동일크기의정사각형을가질수있다.하지만 이에 한정되는것은아니다.
[8이 예를들어,비트스트림으로부터루마부호화블록의최대크기에 대한정보가 획득될수있다.예를들어,루마부호화블록의최대크기에 대한정보가 나타내는루마부호화블록의최대크기는 4x4, 8x8, 16x16, 32x32, 64x64, 128x128, 256x256중하나일수있다.
[81] 예를들어,비트스트림으로부터 2분할이가능한루마부호화블록의최대
크기와루마블록크기차이에 대한정보가획득될수있다.루마블록크기 차이에 대한정보는루마최대부호화단위와 2분할이가능한최대루마부호화 블록간의크기차이를나타낼수있다.따라서,비트스트림으로부터 획득된
2분할이 가능한루마부호화블록의 최대크기에 대한정보와루마블록크기 차이에 대한정보를결합하면,루마최대부호화단위의크기가결정될수있다. 루마최대부호화단위의크기를이용하면크로마최대부호화단위의크기도 결정될수있다.예를들어,컬러포맷에 따라 Y: Cb : Cr비율이 4:2:0이라면, 크로마블록의크기는루마블록의크기의절반일수있고,마찬가지로크로마 최대부호화단위의크기는루마최대부호화단위의크기의 절반일수있다.
[82] 일실시예에 따르면,바이너리분할 (binary split)이가능한루마부호화블록의 최대크기에 대한정보는비트스트림으로부터 획득하므로,바이너리분할이 가능한루마부호화블록의최대크기는가변적으로결정될수있다.이와달리, 터너리분할 (ternary split)이가능한루마부호화블록의최대크기는고정될수 있다.예를들어, I픽처에서 터너리분할이 가능한루마부호화블록의 최대 크기는 32x32이고, P픽처또는 B픽처에서터너리분할이가능한루마부호화 블록의 최대크기는 64x64일수있다.
[83] 또한최대부호화단위는비트스트림으로부터 획득된분할형태모드정보에 기초하여부호화단위로계층적으로분할될수있다.분할형태모드정보로서, 쿼드분할 (quad split)여부를나타내는정보,다분할여부를나타내는정보,분할 방향정보및분할타입 정보중적어도하나가비트스트림으로부터 획득될수 있다.
[84] 예를들어 ,쿼드분할 (quad split)여부를나타내는정보는현재부호화단위가 쿼드분할 (QUAD_SPLIT)될지또는쿼드분할되지 않을지를나타낼수있다.
[85] 현재부호화단위가쿼드분할지되 않으면,다분할여부를나타내는정보는 현재부호화단위가더 이상분할되지 않을지 (NO_SPLIT)아니면
바이너리/터너리분할될지 여부를나타낼수있다.
[86] 현재부호화단위가바이너리분할되거나터너리분할되면,분할방향정보는 현재부호화단위가수평방향또는수직 방향중하나로분할됨을나타낸다.
[87] 현재부호화단위가수평또는수직 방향으로분할되면분할타입 정보는현재 부호화단위를바이너리분할)또는터너리분할로분할함을나타낸다. 2020/175970 1»（：1/10公020/002929 분할방향정보및분할타입 정보에따라,현재부호화단위의분할모드가 결정될수있다.현재부호화단위가수평방향으로바이너리분할되는경우의 분할모드는바이너리수평분할 (SPLIT_BT_H0R),수평방향으로터너리 분할되는경우의터너리수평분할 (SPLIT_TT_H0R),수직 방향으로바이너리 분할되는경우의분할모드는바이너리수직분할 (SPLIT_BT_VER)및수직 방향으로터너리분할되는경우의분할모드는터너리수직분할
(SPLIT_BT_VER)로결정될수있다.
89] 영상복호화장치 (100)는비트스트림으로부터분할형태모드정보를하나의 빈스트링으로부터 획득할수있다.영상복호화장치 (100)가수신한
비트스트림의 형태는 Fixed length binary code, Unary code, Truncated unary code, 미리 결정된바이너리코드등을포함할수있다.빈스트링은정보를 2진수의 나열로나타낸것이다.빈스트링은적어도하나의 비트로구성될수있다.영상 복호화장치 (100)는분할규칙에 기초하여빈스트링에 대응하는분할형태모드 정보를획득할수있다.영상복호화장치 ( 100)는하나의빈스트링에 기초하여 , 부호화단위를쿼드분할할지 여부,분할하지 않을지또는분할방향및분할 타입을결정할수있다.
부호화단위는최대부호화단위보다작거나같을수있다.예를들어 최대 부호화단위도최대크기를가지는부호화단위이므로부호화단위의하나이다. 최대부호화단위에 대한분할형태모드정보가분할되지 않음을나타내는 경우,최대부호화단위에서 결정되는부호화단위는최대부호화단위와같은 크기를가진다.최대부호화단위에 대한분할형태모드정보가분할됨을 나타내는경우최대부호화단위는부호화단위들로분할될수있다.또한 부호화단위에 대한분할형태모드정보가분할을나타내는경우부호화 단위들은더작은크기의부호화단위들로분할될수있다.다만,영상의분할은 이에 한정되는것은아니며최대부호화단위 및부호화단위는구별되지 않을 수있다.부호화단위의분할에 대해서는도 3내지도 16에서보다자세히 설명한다.
또한부호화단위로부터 예측을위한하나이상의 예측블록이결정될수있다. 예측블록은부호화단위와같거나작을수있다.또한부호화단위로부터 변환을위한하나이상의 변환블록이결정될수있다.변환블록은부호화 단위와같거나작을수있다.
변환블록과예측블록의모양및크기는서로관련없을수있다.
[93] 다른실시예로,부호화단위가예측블록으로서부호화단위를이용하여
예측이수행될수있다.또한부호화단위가변환블록으로서부호화단위를 이용하여 변환이수행될수있다.
부호화단위의분할에 대해서는도 3내지도 16에서보다자세히설명한다.본 개시의 현재블록및주변블록은최대부호화단위,부호화단위,예측블록및 변환블록중하나를나타낼수있다.또한,현재블록또는현재부호화단위는 2020/175970 1»（：1^1{2020/002929 현재복호화또는부호화가진행되는블록또는현재분할이 진행되고있는 블록이다.주변블록은현재블록이전에복원된블록일수있다.주변블록은 현재블록으로부터공간적또는시간적으로인접할수있다.주변블록은현재 블록의좌하측,좌측,좌상측,상측,우상측,우측,우하측중하나에위치할수 있다.
[95] 도 3은일실시예에 따라영상복호화장치가현재부호화단위를분할하여 적어도하나의부호화단위를결정하는과정을도시한다.
[96] 블록형태는 4Nx4N, 4Nx2N, 2Nx4N, 4NxN, Nx4N, 32NxN, Nx32N, 16NxN, Nxl6N, 8NxN또는 Nx8N을포함할수있다.여기서 N은양의 정수일수있다. 블록형태정보는부호화단위의모양,방 ¾너비 및높이의비율또는크기중 적어도하나를나타내는정보이다.
[97] 부호화단위의모양은정사각형 (square)및비-정사각형 (non-square)을포함할 수있다.부호화단위의 너비 및높이의길이가같은경우 (즉,부호화단위의블록 형태가 4NX4N인경우),영상복호화장치 ( W0)는부호화단위의블록형태 정보를정사각형으로결정할수있다.영상복호화장치 (100)는부호화단위의 모양을비-정사각형으로결정할수있다.
[98] 부호화단위의 너비 및높이의길이가다른경우 (즉,부호화단위의블록
형태가 4NX2N, 2NX4N, 4NXN, NX4N, 32NXN, NX32N, 16NXN, NX16N, 8NXN또는 Nx8N인경우),영상복호화장치 (100)는부호화단위의블록형태정보를 비-정사각형으로결정할수있다.부호화단위의모양이비-정사각형인경우, 영상복호화장치 (100)는부호화단위의블록형태정보중너비 및높이의 비율을 1 :2, 2: 1, 1 :4, 4: 1, 1 :8, 8: 1, 1 : 16, 16: 1, 1 :32, 32: 1중적어도하나로결정할수 있다.또한,부호화단위의너비의 길이 및높이의길이에 기초하여,영상복호화 장치 (100)는부호화단위가수평 방향인지수직 방향인지결정할수있다.또한, 부호화단위의너비의 길이,높이의길이또는넓이중적어도하나에기초하여, 영상복호화장치 (100)는부호화단위의크기를결정할수있다.
[99] 일실시예에 따라영상복호화장치 (100)는블록형태정보를이용하여부호화 단위의 형태를결정할수있고,분할형태모드정보를이용하여부호화단위가 어떤형태로분할되는지를결정할수있다.즉,영상복호화장치 (100)가 이용하는블록형태정보가어떤블록형태를나타내는지에따라분할형태모드 정보가나타내는부호화단위의분할방법이결정될수있다.
[100] 영상복호화장치 (100)는비트스트림으로부터분할형태모드정보를획득할 수있다.하지만이에 한정되는것은아니며 ,영상복호화장치 ( W0)및영상 부호화장치 (2200)는블록형태정보에기초하여 미리 약속된분할형태모드 정보를결정할수있다.영상복호화장치 (100)는최대부호화단위또는최소 부호화단위에 대하여 미리 약속된분할형태모드정보를결정할수있다.예를 들어 영상복호화장치 (100)는최대부호화단위에 대하여분할형태모드정보를 쿼드분할 (quad split)로결정할수있다.또한,영상복호화장치 (100)는최소 2020/175970 1»（：1^1{2020/002929 부호화단위에대하여분할형태모드정보를 "분할하지않음”으로결정할수 있다.구체적으로영상복호화장치 (100)는최대부호화단위의크기를
256x256으로결정할수있다.영상복호화장치 (100)는미리약속된분할형태 모드정보를쿼드분할로결정할수있다.쿼드분할은부호화단위의너비및 높이를모두이등분하는분할형태모드이다.영상복호화장치 (100)는분할형태 모드정보에기초하여 256x256크기의최대부호화단위로부터 128x128크기의 부호화단위를획득할수있다.또한영상복호화장치 (100)는최소부호화 단위의크기를 4x4로결정할수있다.영상복호화장치 (100)는최소부호화 단위에대하여 "분할하지않음”을나타내는분할형태모드정보를획득할수 있다.
[101] 일실시예에따라,영상복호화장치 00)는현재부호화단위가정사각형
형태임을나타내는블록형태정보를이용할수있다.예를들어영상복호화 장치 (100)는분할형태모드정보에따라정사각형의부호화단위를분할하지 않을지 ,수직으로분할할지 ,수평으로분할할지 , 4개의부호화단위로분할할지 등을결정할수있다.도 3을참조하면,현재부호화단위 (300)의블록형태 정보가정사각형의형태를나타내는경우,복호화부 (120)는분할되지않음을 나타내는분할형태모드정보에따라현재부호화단위 (300)와동일한크기를 가지는부호화단위 (자0 를분할하지않거나,소정의분할방법을나타내는분할 형태모드정보에기초하여분할된부호화단위 (31아5, 310 310(1, 310 31아 등)를결정할수있다.
[102] 도 3을참조하면영상복호화장치 (100)는일실시예에따라수직방향으로 분할됨을나타내는분할형태모드정보에기초하여현재부호화단위 (300)를 수직방향으로분할한두개의부호화단위 (자아5)를결정할수있다.영상복호화 장치 (100)는수평방향으로분할됨을나타내는분할형태모드정보에기초하여 현재부호화단위 (300)를수평방향으로분할한두개의부호화단위 (자0이를 결정할수있다.영상복호화장치 (100)는수직방향및수평방향으로분할됨을 나타내는분할형태모드정보에기초하여현재부호화단위 (300)를수직방향및 수평방향으로분할한네개의부호화단위 (자0(1)를결정할수있다.영상복호화 장치 (100)는일실시예에따라수직방향으로터너리如1113 )분할됨을나타내는 분할형태모드정보에기초하여현재부호화단위 (300)를수직방향으로분할한 세개의부호화단위 (자0句를결정할수있다.영상복호화장치 (100)는 수평방향으로터너리분할됨을나타내는분할형태모드정보에기초하여현재 부호화단위 (300)를수평방향으로분할한세개의부호화단위 (자¾)를결정할수 있다.다만정사각형의부호화단위가분할될수있는분할형태는상술한 형태로한정하여해석되어서는안되고,분할형태모드정보가나타낼수있는 다양한형태가포함될수있다.정사각형의부호화단위가분할되는소정의분할 형태들은이하에서다양한실시예를통해구체적으로설명하도록한다.
[103] 도 4는일실시예에따라영상복호화장치가비 -정사각형의형태인부호화 2020/175970 1»（：1^1{2020/002929 단위를분할하여적어도하나의부호화단위를결정하는과정을도시한다.
[104] 일실시예에따라영상복호화장치 00）는현재부호화단위가비-정사각형 형태임을나타내는블록형태정보를이용할수있다.영상복호화장치（100）는 분할형태모드정보에따라비-정사각형의현재부호화단위를분할하지않을지 소정의방법으로분할할지여부를결정할수있다.도 4를참조하면,현재부호화 단위（400또는 450）의블록형태정보가비 -정사각형의형태를나타내는경우, 영상복호화장치（100）는분할되지않음을나타내는분할형태모드정보에따라 현재부호화단위（400또는 450）와동일한크기를가지는부호화단위（410또는 460）를결정하거나,소정의분할방법을나타내는분할형태모드정보에따라 기초하여분할된부호화단위（420 42（¾, 430 43（¾, 4300, 470 47（¾, 480山 48아5, 480이를결정할수있다.비-정사각형의부호화단위가분할되는소정의 분할방법은이하에서다양한실시예를통해구체적으로설명하도록한다.
[105] 일실시예에따라영상복호화장치（100）는분할형태모드정보를이용하여 부호화단위가분할되는형태를결정할수있고,이경우분할형태모드정보는 부호화단위가분할되어생성되는적어도하나의부호화단위의개수를나타낼 수있다.도 4를참조하면분할형태모드정보가두개의부호화단위로현재 부호화단위（400또는 450）가분할되는것을나타내는경우,영상복호화 장치（100）는분할형태모드정보에기초하여현재부호화단위（400또는 450）를 분할하여현재부호화단위에포함되는두개의부호화단위（420 42（¾,또는 470 470비를결정할수있다.
[106] 일실시예에따라영상복호화장치（ ^0）가분할형태모드정보에기초하여 비-정사각형의형태의현재부호화단위（400또는 450）를분할하는경우,영상 복호화장치（100）는비-정사각형의현재부호화단위（400또는 450）의긴변의 위치를고려하여현재부호화단위를분할할수있다.예를들면,영상복호화 장치（100）는현재부호화단위（400또는 450）의형태를고려하여현재부호화 단위（400또는 450）의긴변을분할하는방향으로현재부호화단위（400또는 450）를분할하여복수개의부호화단위를결정할수있다.
[107] 일실시예에따라,분할형태모드정보가홀수개의블록으로부호화단위를 분할（터너리분할）하는것을나타내는경우,영상복호화장치（100）는현재 부호화단위（400또는 450）에포함되는홀수개의부호화단위를결정할수있다. 예를들면,분할형태모드정보가 3개의부호화단위로현재부호화단위（400 또는 450）를분할하는것을나타내는경우,영상복호화장치（100）는현재부호화 단위（400또는 450）를 3개의부호화단위（430 43（¾, 4300, 480 48（¾, 480 로 분할할수있다.
[108] 일실시예에따라,현재부호화단위（400또는 450）의너비및높이의비율이 4:1 또는 1:4일수있다.너비및높이의비율이 4:1인경우,너비의길이가높이의 길이보다길므로블록형태정보는수평방향일수있다.너비및높이의비율이 1:4인경우,너비의길이가높이의길이보다짧으므로블록형태정보는수직 2020/175970 1»（：1^1{2020/002929 방향일수있다.영상복호화장치 (100)는분할형태모드정보에기초하여현재 부호화단위를홀수개의블록으로분할할것을결정할수있다.또한영상 복호화장치 (100)는현재부호화단위 (400또는 450)의블록형태정보에 기초하여현재부호화단위 (400또는 450)의분할방향을결정할수있다.예를 들어현재부호화단위 (400)가수직방향인경우,영상복호화장치 (100)는현재 부호화단위 (400)를수평방향으로분할하여부호화단위 (430 43(¾, 430 를 결정할수있다.또한현재부호화단위 (450)가수평방향인경우,영상복호화 장치 (100)는현재부호화단위 (450)를수직방향으로분할하여부호화 단위 (480 48(¾, 480 를결정할수있다.
[109] 일실시예에따라영상복호화장치 (100)는현재부호화단위 (400또는 450)에 포함되는홀수개의부호화단위를결정할수있으며,결정된부호화단위들의 크기모두가동일하지는않을수있다.예를들면,결정된홀수개의부호화 단위 (430 43(¾, 4300, 480 48(¾, 480이중소정의부호화단위 (43(¾또는 48(¾)의크기는다른부호화단위 (430 4300, 480 480이들과는다른크기를 가질수도있다.즉,현재부호화단위 (400또는 450)가분할되어결정될수있는 부호화단위는복수의종류의크기를가질수있고,경우에따라서는홀수개의 부호화단위 (430 43(¾, 4300, 480 48(¾, 480이가각각서로다른크기를가질 수도있다.
[110] 일실시예에따라분할형태모드정보가홀수개의블록으로부호화단위가 분할되는것을나타내는경우,영상복호화장치 (100)는현재부호화단위 (400 또는 450)에포함되는홀수개의부호화단위를결정할수있고,나아가영상 복호화장치 (100)는분할하여생성되는홀수개의부호화단위들중적어도 하나의부호화단위에대하여소정의제한을둘수있다.도 4을참조하면영상 복호화장치 (100)는현재부호화단위 (400또는 450)가분할되어생성된 3개의 부호화단위 (430 43(¾, 4300, 480 48(¾, 480 들중중앙에위치하는부호화 단위 (43(¾, 480비에대한복호화과정을다른부호화단위 (430 43(、 480 480이와다르게할수있다.예를들면,영상복호화장치 (100)는중앙에위치하는 부호화단위 (43(¾, 480비에대하여는다른부호화단위 (430 4300, 480 480 와 달리더이상분할되지않도록제한하거나,소정의횟수만큼만분할되도록 제한할수있다.
[111] 도 5는일실시예에따라영상복호화장치가블록형태정보및분할형태모드 정보중적어도하나에기초하여부호화단위를분할하는과정을도시한다.
[112] 일실시예에따라영상복호화장치 (100)는블록형태정보및분할형태모드 정보중적어도하나에기초하여정사각형형태의제 1부호화단위 (500)를 부호화단위들로분할하거나분할하지않는것으로결정할수있다.일실시예에 따라분할형태모드정보가수평방향으로제 1부호화단위 (500)를분할하는 것을나타내는경우,영상복호화장치 (100)는제 1부호화단위 (500)를수평 방향으로분할하여제 2부호화단위 ( 0)를결정할수있다.일실시예에따라 2020/175970 1»（：1^1{2020/002929 이용되는제 1부호화단위 ,제 2부호화단위 ,제 3부호화단위는부호화단위 간의분할전후관계를이해하기위해이용된용어이다.예를들면,제 1부호화 단위를분할하면제 2부호화단위가결정될수있고,제 2부호화단위가 분할되면제 3부호화단위가결정될수있다.이하에서는이용되는제 1부호화 단위,제 2부호화단위및제 3부호화단위의관계는상술한특징에따르는 것으로이해될수있다.
[113] 일실시예에따라영상복호화장치 (100)는결정된제 2부호화단위 (510)를 분할형태모드정보에기초하여부호화단위들로분할하거나분할하지않는 것으로결정할수있다.도 5를참조하면영상복호화장치 (100)는분할형태모드 정보에기초하여제 1부호화단위 (500)를분할하여결정된비-정사각형의 형태의제 2부호화단위 (510)를적어도하나의제 3부호화단위 (520 52(¾, 52(、 520(1등)로분할하거나제 2부호화단위 ( 0)를분할하지않을수있다.영상 복호화장치 (100)는분할형태모드정보를획득할수있고영상복호화 장치 (100)는획득한분할형태모드정보에기초하여제 1부호화단위 (500)를 분할하여다양한형태의복수개의제 2부호화단위 (예를들면, 510)를분할할수 있으며 ,제 2부호화단위 ( 0)는분할형태모드정보에기초하여제 1부호화 단위 (500)가분할된방식에따라분할될수있다.일실시예에따라,제 1부호화 단위 (500)가제 1부호화단위 (500)에대한분할형태모드정보에기초하여제 2 부호화단위 (510)로분할된경우,제 2부호화단위 (510)역시제 2부호화 단위 ( 0)에대한분할형태모드정보에기초하여제 3부호화단위 (예를들면, 520&, 52(¾, 5200, 520(1등)으로분할될수있다.즉,부호화단위는부호화단위 각각에관련된분할형태모드정보에기초하여재귀적으로분할될수있다. 따라서비-정사각형형태의부호화단위에서정사각형의부호화단위가결정될 수있고,이러한정사각형형태의부호화단위가재귀적으로분할되어 비-정사각형형태의부호화단위가결정될수도있다.
[114] 도 5를참조하면,비-정사각형형태의제 2부호화단위 (5 )가분할되어
결정되는홀수개의제 3부호화단위 (52(¾, 5200, 520(1)중소정의부호화 단위 (예를들면,가운데에위치하는부호화단위또는정사각형형태의부호화 단위)는재귀적으로분할될수있다.일실시예에따라홀수개의제 3부호화 단위 (52(¾, 5200, 520(1)중하나인정사각형형태의제 3부호화단위 (520비는수평 방향으로분할되어복수개의제 4부호화단위로분할될수있다.복수개의제 4 부호화단위 (530 53(¾, 5300, 530(1)중하나인비-정사각형형태의제 4부호화 단위 (53(¾또는 530(1)는다시복수개의부호화단위들로분할될수있다.예를 들면,비-정사각형형태의제 4부호화단위 (53(¾또는 530(1)는홀수개의부호화 단위로다시분할될수도있다.부호화단위의재귀적분할에이용될수있는 방법에대하여는다양한실시예를통해후술하도록한다.
[115] 일실시예에따라영상복호화장치 ( ^0)는분할형태모드정보에기초하여 제 3부호화단위 (520 52(¾, 5200, 520(1등)각각을부호화단위들로분할할수 2020/175970 1»（：1^1{2020/002929 있다.또한영상복호화장치 (100)는분할형태모드정보에 기초하여제 2부호화 단위 ( 0)를분할하지 않는것으로결정할수있다.영상복호화장치 (100)는일 실시예에 따라비-정사각형 형태의제 2부호화단위 (5 )를홀수개의제 3부호화 단위 (52(¾, 5200, 520(1)로분할할수있다.영상복호화장치 (100)는홀수개의제 3 부호화단위 (52(¾, 5200, 520(1)중소정의 제 3부호화단위에 대하여소정의 제한을둘수있다.예를들면영상복호화장치 (100)는홀수개의제 3부호화 단위 (52(¾, 5200, 520(1)중가운데에위치하는부호화단위 (520 에 대하여는더 이상분할되지 않는것으로제한하거나또는설정 가능한횟수로분할되어야 하는것으로제한할수있다.
[116] 도 5를참조하면,영상복호화장치 00)는비-정사각형 형태의제 2부호화 단위 (510)에포함되는홀수개의제 3부호화단위 (52(¾, 5200, 520(1)들중 가운데에 위치하는부호화단위 (520 는더 이상분할되지 않거나,소정의분할 형태로분할 (예를들면 4개의부호화단위로만분할하거나제 2부호화 단위 (5 )가분할된형태에 대응하는형태로분할)되는것으로제한하거나, 소정의 횟수로만분할 (예를들면 II회만분할, 11>0)하는것으로제한할수있다. 다만가운데에위치한부호화단위 (520이에 대한상기제한은단순한실시예들에 불과하므로상술한실시예들로제한되어해석되어서는안되고,가운데에 위치한부호화단위 (520 가다른부호화단위 (52(¾, 520(1)와다르게복호화될 수있는다양한제한들을포함하는것으로해석되어야한다.
[117] 일실시예에 따라영상복호화장치 (100)는현재부호화단위를분할하기위해 이용되는분할형태모드정보를현재부호화단위내의소정의위치에서 획득할 수있다.
[118] 도 6은일실시예에 따라영상복호화장치가홀수개의부호화단위들중
소정의부호화단위를결정하기위한방법을도시한다.
[119] 도 6을참조하면,현재부호화단위 (600, 650)의분할형태모드정보는현재 부호화단위 (600, 650)에포함되는복수개의 샘플중소정위치의 샘플 (예를 들면,가운데에 위치하는샘플 (640, 690))에서 획득될수있다.다만이러한분할 형태모드정보중적어도하나가획득될수있는현재부호화단위 (600)내의 소정 위치가도 6에서도시하는가운데위치로한정하여해석되어서는안되고, 소정 위치에는현재부호화단위 (600)내에포함될수있는다양한위치 (예를 들면,최상단,최하단,좌측,우측,좌측상단,좌측하단,우측상단또는우측하단 등)가포함될수있는것으로해석되어야한다.영상복호화장치 (100)는소정 위치로부터 획득되는분할형태모드정보를획득하여 현재부호화단위를 다양한형태및크기의부호화단위들로분할하거나분할하지 않는것으로 결정할수있다.
[12이 일실시예에 따라영상복호화장치 00)는현재부호화단위가소정의 개수의 부호화단위들로분할된경우그중하나의부호화단위를선택할수있다. 복수개의부호화단위들중하나를선택하기위한방법은다양할수있으며, 2020/175970 1»（：1^1{2020/002929 이러한방법들에대한설명은이하의다양한실시예를통해후술하도록한다.
[121] 일실시예에따라영상복호화장치 00)는현재부호화단위를복수개의 부호화단위들로분할하고,소정위치의부호화단위를결정할수있다.
[122] 일실시예에따라영상복호화장치 (100)는홀수개의부호화단위들중
가운데에위치하는부호화단위를결정하기위하여홀수개의부호화단위들 각각의위치를나타내는정보를이용할수있다.도 6을참조하면,영상복호화 장치 (100)는현재부호화단위 (600)또는현재부호화단위 (650)를분할하여 홀수개의부호화단위들 (620 62(¾, 6200)또는홀수개의부호화단위들 (660 66(¾, 660이을결정할수있다.영상복호화장치 (100)는홀수개의부호화 단위들 (620 62(¾, 6200)또는홀수개의부호화단위들 (660 66(¾, 660 의 위치에대한정보를이용하여가운데부호화단위 (620비또는가운데부호화 단위 (660비를결정할수있다.예를들면영상복호화장치 (100)는부호화 단위들 (62(切, 62(¾, 620 에포함되는소정의샘플의위치를나타내는정보에 기초하여부호화단위들 (620 62(¾, 620 의위치를결정함으로써가운데에 위치하는부호화단위 (620비를결정할수있다.구체적으로,영상복호화 장치 (100)는부호화단위들 (620 62(¾, 620이의좌측상단의샘플 (630 63(¾, 630이의위치를나타내는정보에기초하여부호화단위들 (62(切, 62(¾, 620이의 위치를결정함으로써가운데에위치하는부호화단위 (620비를결정할수있다.
[123] 일실시예에따라부호화단위들 (620 62(¾, 620 에각각포함되는좌측
상단의샘플 (630 63(¾, 63(切의위치를나타내는정보는부호화단위들 (620 62(¾, 620이의픽쳐내에서의위치또는좌표에대한정보를포함할수있다.일 실시예에따라부호화단위들 (62(切, 62(¾, 620 에각각포함되는좌측상단의 샘플 (630 63(¾, 63(切의위치를나타내는정보는현재부호화단위 (600)에 포함되는부호화단위들 (620 62(¾, 620 의너비또는높이를나타내는정보를 포함할수있고,이러한너비또는높이는부호화단위들 (620 62(¾, 620 의 픽쳐내에서의좌표간의차이를나타내는정보에해당할수있다.즉,영상 복호화장치 (100)는부호화단위들 (620 62아5, 620 의픽쳐내에서의위치또는 좌표에대한정보를직접이용하거나좌표간의차이값에대응하는부호화 단위의너비또는높이에대한정보를이용함으로써가운데에위치하는부호화 단위 (620비를결정할수있다.
[124] 일실시예에따라,상단부호화단위 (620幻의좌측상단의샘플 (630幻의위치를 나타내는정보는江 좌표를나타낼수있고,가운데부호화단위 (620비의 좌측상단의샘플 (530비의위치를나타내는정보는 (此,外)좌표를나타낼수 있고,하단부호화단위 (620 의좌측상단의샘플 (63(切의위치를나타내는 정보는江 )좌표를나타낼수있다.영상복호화장치 (100)는부호화 단위들 (620 62(¾, 620 에각각포함되는좌측상단의샘플 (630 63(¾, 63(切의 좌표를이용하여가운데부호화단위 (620비를결정할수있다.예를들면,좌측 상단의샘플 (630 63(¾, 630이의좌표를오름차순또는내림차순으로 2020/175970 1»（：1^1{2020/002929 정렬하였을때,가운데에위치하는샘플 (630비의좌표인 (此,外)를포함하는 부호화단위 (620비를현재부호화단위 (600)가분할되어 결정된부호화 단위들 (620 62(¾, 6200)중가운데에위치하는부호화단위로결정할수있다. 다만좌측상단의 샘플 (63(切, 63(¾, 630이의 위치를나타내는좌표는픽쳐 내에서의 절대적인위치를나타내는좌표를나타낼수있고,나아가상단부호화 단위 (620 의좌측상단의 샘플 (630 의위치를기준으로,가운데부호화 단위 (620비의좌측상단의 샘플 (630비의상대적위치를나타내는정보인付 , (1外)좌표,하단부호화단위 (620 의좌측상단의 샘플 (630이의상대적위치를 나타내는정보인 ((1x(：, (1)0좌표를이용할수도있다.또한부호화단위에 포함되는샘플의위치를나타내는정보로서 해당샘플의좌표를이용함으로써 소정 위치의부호화단위를결정하는방법이상술한방법으로한정하여 해석되어서는안되고,샘플의좌표를이용할수있는다양한산술적방법으로 해석되어야한다.
[125] 일실시예에 따라영상복호화장치 (100)는현재부호화단위 (600)를복수개의 부호화단위들 (620 62(¾, 620 로분할할수있고,부호화단위들 (620 62(¾, 6200)중소정의 기준에따라부호화단위를선택할수있다.예를들면,영상 복호화장치 (100)는부호화단위들 (620 62015, 62(切중크기가다른부호화 단위 (620비를선택할수있다.
[126] 일실시예에 따라영상복호화장치 (100)는상단부호화단위 (620幻의좌측 상단의 샘플 (630 의 위치를나타내는정보인 ( 좌표,가운데부호화 단위 (620비의좌측상단의 샘플 (630비의 위치를나타내는정보인 (此,外)좌표, 하단부호화단위 (620이의좌측상단의 샘플 (63(切의위치를나타내는정보인 (^, )좌표를이용하여부호화단위들 (620 62(¾, 6200)각각의너비또는 높이를결정할수있다.영상복호화장치 (100)는부호화단위들 (620 62아5,
620(：)의 위치를나타내는좌표인 ( ) ), ( , ) ), (X*:, )0를이용하여부호화 단위들 (620 62(¾, 6200)각각의크기를결정할수있다.일실시예에따라,영상 복호화장치 (100)는상단부호화단위 (620 의너비를현재부호화단위 (600)의 너비로결정할수있다.영상복호화장치 (100)는상단부호화단위 (620幻의 높이를 로결정할수있다.일실시예에따라영상복호화장치 (100)는 가운데부호화단위 (620비의너비를현재부호화단위 (600)의너비로결정할수 있다.영상복호화장치 (100)는가운데부호화단위 (620비의높이를 -外로 결정할수있다.일실시예에따라영상복호화장치 ( 0)는하단부호화단위의 너비또는높이는현재부호화단위의너비또는높이와상단부호화단위 (620幻 및가운데부호화단위 (620비의 너비 및높이를이용하여 결정할수있다.영상 복호화장치 (100)는결정된부호화단위들 (620 62(¾, 620이의 너비 및높이에 기초하여다른부호화단위와다른크기를갖는부호화단위를결정할수있다. 도 6을참조하면,영상복호화장치 (100)는상단부호화단위 (620 및하단 부호화단위 (620이의크기와다른크기를가지는가운데부호화단위 (620비를 2020/175970 1»（：1^1{2020/002929 소정위치의부호화단위로결정할수있다.다만상술한영상복호화
장치 (100)가다른부호화단위와다른크기를갖는부호화단위를결정하는 과정은샘플좌표에기초하여결정되는부호화단위의크기를이용하여소정 위치의부호화단위를결정하는일실시예에불과하므로,소정의샘플좌표에 따라결정되는부호화단위의크기를비교하여소정위치의부호화단위를 결정하는다양한과정이이용될수있다.
[127] 영상복호화장치 (100)는좌측부호화단위 (660幻의좌측상단의샘플 (670幻의 위치를나타내는정보인江 幻좌표,가운데부호화단위 (660비의좌측상단의 샘플 (670비의위치를나타내는정보인江 이좌표,우측부호화단위 (660 의 좌측상단의샘플 (67(切의위치를나타내는정보인江, )좌표를이용하여 부호화단위들 (660 66(¾, 6600)각각의너비또는높이를결정할수있다.영상 복호화장치 (100)는부호화단위들 (660 66(¾, 660이의위치를나타내는좌표인 江山 (1), , £), , 幻를이용하여부호화단위들 (660 660江 6600)각각의 크기를결정할수있다.
[128] 일실시예에따라,영상복호화장치 (100)는좌측부호화단위 (660幻의너비를 로결정할수있다.영상복호화장치 (100)는좌측부호화단위 (660幻의 높이를현재부호화단위 (650)의높이로결정할수있다.일실시예에따라영상 복호화장치 (100)는가운데부호화단위 (660비의너비를
Figure imgf000021_0001
결정할수있다. 영상복호화장치 (100)는가운데부호화단위 (660비의높이를현재부호화 단위 (600)의높이로결정할수있다.일실시예에따라영상복호화장치 (100)는 우측부호화단위 (660 의너비또는높이는현재부호화단위 (650)의너비또는 높이와좌측부호화단위 (660 및가운데부호화단위 (660비의너비및높이를 이용하여결정할수있다.영상복호화장치 (100)는결정된부호화단위들 (660 66(¾, 660이의너비및높이에기초하여다른부호화단위와다른크기를갖는 부호화단위를결정할수있다.도 6을참조하면,영상복호화장치 (100)는좌측 부호화단위 (660 및우측부호화단위 (660이의크기와다른크기를가지는 가운데부호화단위 (660비를소정위치의부호화단위로결정할수있다.다만 상술한영상복호화장치 (100)가다른부호화단위와다른크기를갖는부호화 단위를결정하는과정은샘플좌표에기초하여결정되는부호화단위의크기를 이용하여소정위치의부호화단위를결정하는일실시예에불과하므로,소정의 샘플좌표에따라결정되는부호화단위의크기를비교하여소정위치의부호화 단위를결정하는다양한과정이이용될수있다.
[129] 다만부호화단위의위치를결정하기위하여고려하는샘플의위치는상술한 좌측상단으로한정하여해석되어서는안되고부호화단위에포함되는임의의 샘플의위치에대한정보가이용될수있는것으로해석될수있다.
[13이 일실시예에따라영상복호화장치 00)는현재부호화단위의형태를
고려하여,현재부호화단위가분할되어결정되는홀수개의부호화단위들중 소정위치의부호화단위를선택할수있다.예를들면,현재부호화단위가 2020/175970 1»（：1^1{2020/002929 너비가높이보다긴비 -정사각형형태라면영상복호화장치 00)는수평방향에 따라소정위치의부호화단위를결정할수있다.즉,영상복호화장치 (100)는 수평방향으로위치를달리하는부호화단위들중하나를결정하여해당부호화 단위에대한제한을둘수있다.현재부호화단위가높이가너비보다긴 비-정사각형형태라면영상복호화장치 (100)는수직방향에따라소정위치의 부호화단위를결정할수있다.즉,영상복호화장치 (100)는수직방향으로 위치를달리하는부호화단위들중하나를결정하여해당부호화단위에대한 제한을둘수있다.
[131] 일실시예에따라영상복호화장치 (100)는짝수개의부호화단위들중소정 위치의부호화단위를결정하기위하여짝수개의부호화단위들각각의위치를 나타내는정보를이용할수있다.영상복호화장치 (100)는현재부호화단위를 분할 (바이너리분할)하여짝수개의부호화단위들을결정할수있고짝수개의 부호화단위들의위치에대한정보를이용하여소정위치의부호화단위를 결정할수있다.이에대한구체적인과정은도 6에서상술한홀수개의부호화 단위들중소정위치 (예를들면,가운데위치)의부호화단위를결정하는과정에 대응하는과정일수있으므로생략하도록한다.
[132] 일실시예에따라,비-정사각형형태의현재부호화단위를복수개의부호화 단위로분할한경우,복수개의부호화단위들중소정위치의부호화단위를 결정하기위하여분할과정에서소정위치의부호화단위에대한소정의정보를 이용할수있다.예를들면영상복호화장치 (100)는현재부호화단위가 복수개로분할된부호화단위들중가운데에위치하는부호화단위를결정하기 위하여분할과정에서가운데부호화단위에포함된샘플에저장된블록형태 정보및분할형태모드정보중적어도하나를이용할수있다.
[133] 도 6을참조하면영상복호화장치 (100)는분할형태모드정보에기초하여 현재부호화단위 (600)를복수개의부호화단위들 (620 62(¾, 620 로분할할수 있으며,복수개의부호화단위들 (620 62(¾, 6200)중가운데에위치하는부호화 단위 (620비를결정할수있다.나아가영상복호화장치 (100)는분할형태모드 정보가획득되는위치를고려하여 ,가운데에위치하는부호화단위 (620비를 결정할수있다.즉,현재부호화단위 (600)의분할형태모드정보는현재부호화 단위 (600)의가운데에위치하는샘플 (640)에서획득될수있으며,상기분할형태 모드정보에기초하여현재부호화단위 (600)가복수개의부호화단위들 (62(切, 620江 620이로분할된경우상기샘플 (640)을포함하는부호화단위 (620비를 가운데에위치하는부호화단위로결정할수있다.다만가운데에위치하는 부호화단위로결정하기위해이용되는정보가분할형태모드정보로한정하여 해석되어서는안되고,다양한종류의정보가가운데에위치하는부호화단위를 결정하는과정에서이용될수있다.
[134] 일실시예에따라소정위치의부호화단위를식별하기위한소정의정보는, 결정하려는부호화단위에포함되는소정의샘플에서획득될수있다.도 6을 2020/175970 1»（：1^1{2020/002929 참조하면,영상복호화장치 (100)는현재부호화단위 (600)가분할되어결정된 복수개의부호화단위들 (620 62(¾, 6200)중소정위치의부호화단위 (예를 들면,복수개로분할된부호화단위중가운데에위치하는부호화단위)를 결정하기위하여현재부호화단위 (600)내의소정위치의샘플 (예를들면,현재 부호화단위 (600)의가운데에위치하는샘플)에서획득되는분할형태모드 정보를이용할수있다.즉,영상복호화장치 (100)는현재부호화단위 (600)의 블록형태를고려하여상기소정위치의샘플을결정할수있고,영상복호화 장치 (100)는현재부호화단위 (600)가분할되어결정되는복수개의부호화 단위들 (620 62(¾, 6200)중,소정의정보 (예를들면,분할형태모드정보)가 획득될수있는샘플이포함된부호화단위 (620비를결정하여소정의제한을둘 수있다.도 6을참조하면일실시예에따라영상복호화장치 (100)는소정의 정보가획득될수있는샘늘로서현재부호화단위 (600)의가운데에위치하는 샘플 (640)을결정할수있고,영상복호화장치 (100)는이러한샘플 (640)이 포함되는부호화단위 (620비를복호화과정에서의소정의제한을둘수있다. 다만소정의정보가획득될수있는샘플의위치는상술한위치로한정하여 해석되어서는안되고,제한을두기위해결정하려는부호화단위 (620비에 포함되는임의의위치의샘플들로해석될수있다.
[135] 일실시예에따라소정의정보가획득될수있는샘플의위치는현재부호화 단위 (600)의형태에따라결정될수있다.일실시예에따라블록형태정보는 현재부호화단위의형태가정사각형인지또는비-정사각형인지여부를결정할 수있고,형태에따라소정의정보가획득될수있는샘플의위치를결정할수 있다.예를들면,영상복호화장치 (100)는현재부호화단위의너비에대한정보 및높이에대한정보중적어도하나를이용하여현재부호화단위의너비및 높이중적어도하나를반으로분할하는경계상에위치하는샘플을소정의 정보가획득될수있는샘플로결정할수있다.또다른예를들면,영상복호화 장치 (100)는현재부호화단위에관련된블록형태정보가비-정사각형형태임을 나타내는경우,현재부호화단위의긴변을반으로분할하는경계를포함하는 샘플중하나를소정의정보가획득될수있는샘플로결정할수있다.
[136] 일실시예에따라영상복호화장치 00)는현재부호화단위를복수개의
부호화단위로분할한경우,복수개의부호화단위들중소정위치의부호화 단위를결정하기위하여，분할형태모드정보를이용할수있다.일실시예에 따라영상복호화장치 (100)는분할형태모드정보를부호화단위에포함된소정 위치의샘플에서획득할수있고,영상복호화장치 (100)는현재부호화단위가 분할되어생성된복수개의부호화단위들을복수개의부호화단위각각에 포함된소정위치의샘플로부터획득되는분할형태모드정보를이용하여 분할할수있다.즉,부호화단위는부호화단위각각에포함된소정위치의 샘플에서획득되는분할형태모드정보를이용하여재귀적으로분할될수있다. 부호화단위의재귀적분할과정에대하여는도 5를통해상술하였으므로 2020/175970 1»（：1^1{2020/002929 자세한설명은생략하도록한다.
[137] 일실시예에 따라영상복호화장치 (100)는현재부호화단위를분할하여
적어도하나의부호화단위를결정할수있고,이러한적어도하나의부호화 단위가복호화되는순서를소정의블록 (예를들면,현재부호화단위)에 따라 결정할수있다.
[138] 도 7는일실시예에 따라영상복호화장치가현재부호화단위를분할하여 복수개의부호화단위들을결정하는경우,복수개의부호화단위들이 처리되는 순서를도시한다.
[139] 일실시예에 따라영상복호화장치 (100)는분할형태모드정보에따라제 1 부호화단위 (700)를수직방향으로분할하여제 2부호화단위 (기 0a, TLOb)를 결정하거나제 1부호화단위 (700)를수평방향으로분할하여제 2부호화 단위 (730a, 730b)를결정하거나제 1부호화단위 (700)를수직 방향및수평 방향으로분할하여제 2부호화단위 (750a, 750b, 750c, 750d)를결정할수있다.
[140] 도 7를참조하면,영상복호화장치 (100)는제 1부호화단위 (700)를수직
방향으로분할하여결정된제 2부호화단위 (기 0a, TL0b)를수평방향 (기 Oc)으로 처리되도록순서를결정할수있다.영상복호화장치 (100)는제 1부호화 단위 (700)를수평 방향으로분할하여 결정된제 2부호화단위 (730a, 730b)의 처리 순서를수직방향 (730c)으로결정할수있다.영상복호화장치 (100)는제 1 부호화단위 (700)를수직방향및수평 방향으로분할하여 결정된제 2부호화 단위 (750a, 750b, 750c, 750d)를하나의 행에위치하는부호화단위들이 처리된후 다음행에위치하는부호화단위들이 처리되는소정의순서 (예를들면,래스터 스캔순서 ((raster scan order)또는 z스캔순서 (z scan order)(750e)등)에 따라 결정할수있다.
[141] 일실시예에 따라영상복호화장치 (100)는부호화단위들을재귀적으로
분할할수있다.도 7를참조하면,영상복호화장치 (100)는제 1부호화
단위 (700)를분할하여복수개의부호화단위들 (기 0a, 710b, 730a, 730b, 750a,
750b, 750c, 750d)을결정할수있고,결정된복수개의부호화단위들 (기 0a, 710b, 730a, 730b, 750a, 750b, 750c, 750d)각각을재귀적으로분할할수있다.복수개의 부호화단위들 C710a, 710b, 730a, 730b, 750a, 750b, 750c, 750d)을분할하는방법은 제 1부호화단위 (700)를분할하는방법에 대응하는방법이될수있다.이에 따라 복수개의부호화단위들 (기 0a, 710b, 730a, 730b, 750a, 750b, 750c, 750d)은각각 독립적으로복수개의부호화단위들로분할될수있다.도 7를참조하면영상 복호화장치 (100)는제 1부호화단위 (700)를수직 방향으로분할하여 제 2부호화 단위 (기 0a, TLOb)를결정할수있고,나아가제 2부호화단위 (기 0a, 710b)각각을 독립적으로분할하거나분할하지 않는것으로결정할수있다.
[142] 일실시예에 따라영상복호화장치 (100)는좌측의 제 2부호화단위 (기 0a)를 수평 방향으로분할하여 제 3부호화단위 (720a, 720b)로분할할수있고,우측의 제 2부호화단위 (기 0b)는분할하지 않을수있다. 2020/175970 1»（：1^1{2020/002929
[143] 일실시예에따라부호화단위들의처리순서는부호화단위의분할과정에 기초하여결정될수있다.다시말해,분할된부호화단위들의처리순서는 분할되기직전의부호화단위들의처리순서에기초하여결정될수있다.영상 복호화장치 (100)는좌측의제 2부호화단위 (기 0 가분할되어결정된제 3 부호화단위 (720 72015)가처리되는순서를우측의제 2부호화단위 (기 0비와 독립적으로결정할수있다.좌측의제 2부호화단위 (기 0 가수평방향으로 분할되어제 3부호화단위 (720 72아5)가결정되었으므로제 3부호화단위 (720 72아5)는수직방향 (720 으로처리될수있다.또한좌측의제 2부호화단위 (기 0幻 및우측의제 2부호화단위 (기 0비가처리되는순서는수평방향 (기 0이에 해당하므로,좌측의제 2부호화단위 (기 0幻에포함되는제 3부호화단위 (720 72아5)가수직방향 (720 으로처리된후에우측부호화단위 (기 0비가처리될수 있다.상술한내용은부호화단위들이각각분할전의부호화단위에따라처리 순서가결정되는과정을설명하기위한것이므로,상술한실시예에한정하여 해석되어서는안되고,다양한형태로분할되어결정되는부호화단위들이 소정의순서에따라독립적으로처리될수있는다양한방법으로이용되는 것으로해석되어야한다.
[144] 도 8는일실시예에따라영상복호화장치가소정의순서로부호화단위가
처리될수없는경우,현재부호화단위가홀수개의부호화단위로분할되는 것임을결정하는과정을도시한다.
[145] 일실시예에따라영상복호화장치 (100)는획득된분할형태모드정보에
기초하여현재부호화단위가홀수개의부호화단위들로분할되는것을결정할 수있다.도 8를참조하면정사각형형태의제 1부호화단위 (800)가비-정사각형 형태의제 2부호화단위 (810 81아5)로분할될수있고,제 2부호화단위 (810 81(¾)는각각독립적으로제 3부호화단위 (820 82(¾, 8200, 820(1, 820이로분할될 수있다.일실시예에따라영상복호화장치 00)는제 2부호화단위중좌측 부호화단위 ( 0 는수평방향으로분할하여복수개의제 3부호화단위 (820 82아5)를결정할수있고,우측부호화단위 ( 아5)는홀수개의제 3부호화 단위 (820 820(1, 820句로분할할수있다.
[146] 일실시예에따라영상복호화장치 (100)는제 3부호화단위들 (820 82(¾, 8200, 820(1, 820이이소정의순서로처리될수있는지여부를판단하여홀수개로 분할된부호화단위가존재하는지를결정할수있다.도 8를참조하면,영상 복호화장치 (100)는제 1부호화단위 (800)를재귀적으로분할하여제 3부호화 단위 (820 82(¾, 8200, 820(1, 820句를결정할수있다.영상복호화장치 (100)는 블록형태정보및분할형태모드정보중적어도하나에기초하여,제 1부호화 단위 (800),제 2부호화단위 (810 81(¾)또는제 3부호화단위 (820 82(¾, 8200, 820(1, 820이가분할되는형태중홀수개의부호화단위로분할되는지여부를 결정할수있다.예를들면,제 2부호화단위 ( 0 810^중우측에위치하는 부호화단위가홀수개의제 3부호화단위 (820 820(1, 820句로분할될수있다. 2020/175970 1»（：1^1{2020/002929 제 1부호화단위 (800)에포함되는복수개의부호화단위들이처리되는순서는 소정의순서 (예를들면, Z-스캔순서 (z-scan order)(830))가될수있고,영상복호화 장치 (100)는우측제 2부호화단위 (810b)가홀수개로분할되어결정된제 3 부호화단위 (820c, 820d, 820e)가상기소정의순서에따라처리될수있는조건을 만족하는지를판단할수있다.
[147] 일실시예에 따라영상복호화장치 (100)는제 1부호화단위 (800)에포함되는 제 3부호화단위 (820a, 820b, 820c, 820d, 820e)가소정의순서에 따라처리될수 있는조건을만족하는지를결정할수있으며,상기조건은제 3부호화단위 (820a, 820b, 820c, 820d, 820e)의 경계에따라제 2부호화단위 (810a, 810b)의 너비 및 높이중적어도하나를반으로분할되는지 여부와관련된다.예를들면
비-정사각형 형태의좌측제 2부호화단위 (8 Wa)의높이를반으로분할하여 결정되는제 3부호화단위 (820a, 820b)는조건을만족할수있다.우측제 2부호화 단위 (810b)를 3개의부호화단위로분할하여결정되는제 3부호화단위 (820c, 820d, 820e)들의 경계가우측제 2부호화단위 (810b)의너비또는높이를반으로 분할하지못하므로제 3부호화단위 (820c, 820d, 820e)는조건을만족하지못하는 것으로결정될수있다.영상복호화장치 (100)는이러한조건불만족의경우 스캔순서의단절 (disconnection)로판단하고,판단결과에 기초하여우즉제 2 부호화단위 (8Wb)는홀수개의부호화단위로분할되는것으로결정할수있다. 일실시예에따라영상복호화장치 (100)는홀수개의부호화단위로분할되는 경우분할된부호화단위들중소정위치의부호화단위에 대하여소정의 제한을 둘수있으며,이러한제한내용또는소정 위치등에 대하여는다양한실시예를 통해상술하였으므로자세한설명은생략하도록한다.
[148] 도 9은일실시예에 따라영상복호화장치가제 1부호화단위를분할하여
적어도하나의부호화단위를결정하는과정을도시한다.
[149] 일실시예에 따라영상복호화장치 (100)는수신부 (110)를통해획득한분할 형태모드정보에 기초하여제 1부호화단위 (900)를분할할수있다.정사각형 형태의 제 1부호화단위 (900)는 4개의정사각형 형태를가지는부호화단위로 분할되거나또는비-정사각형 형태의복수개의부호화단위로분할할수있다. 예를들면도 9을참조하면,제 1부호화단위 (900)는정사각형이고분할형태 모드정보가비 -정사각형의부호화단위로분할됨을나타내는경우영상복호화 장치 (100)는제 1부호화단위 (900)를복수개의비-정사각형의부호화단위들로 분할할수있다.구체적으로,분할형태모드정보가제 1부호화단위 (900)를수평 방향또는수직 방향으로분할하여홀수개의부호화단위를결정하는것을 나타내는경우,영상복호화장치 (100)는정사각형 형태의 제 1부호화
단위 (900)를홀수개의부호화단위들로서수직방향으로분할되어결정된제 2 부호화단위 (910a, 910b, 910c)또는수평 방향으로분할되어 결정된제 2부호화 단위 (920a, 920b, 920c)로분할할수있다.
[15이 일실시예에 따라영상복호화장치 (100)는제 1부호화단위 (900)에포함되는 2020/175970 1»（：1^1{2020/002929 제 2부호화단위 (910 91(¾, 9100, 920 92(¾, 920이가소정의순서에따라처리될 수있는조건을만족하는지를결정할수있으며,상기조건은제 2부호화 단위 (910 91(¾, 9100, 920 92(¾, 920이의경계에따라제 1부호화단위 (900)의 너비및높이중적어도하나를반으로분할되는지여부와관련된다.도 9를 참조하면정사각형형태의제 1부호화단위 (900)를수직방향으로분할하여 결정되는제 2부호화단위 (910 91(¾, 910 들의경계가제 1부호화단위 (900)의 너비를반으로분할하지못하므로제 1부호화단위 (900)는소정의순서에따라 처리될수있는조건을만족하지못하는것으로결정될수있다.또한정사각형 형태의제 1부호화단위 (900)를수평방향으로분할하여결정되는제 2부호화 단위 (920 92(¾, 920 들의경계가제 1부호화단위 (900)의너비를반으로 분할하지못하므로제 1부호화단위 (900)는소정의순서에따라처리될수있는 조건을만족하지못하는것으로결정될수있다.영상복호화장치 (100)는이러한 조건불만족의경우스캔순서의단절 ((1 0111½(선011)로판단하고,판단결과에 기초하여제 1부호화단위 (900)는홀수개의부호화단위로분할되는것으로 결정할수있다.일실시예에따라영상복호화장치 (100)는홀수개의부호화 단위로분할되는경우분할된부호화단위들중소정위치의부호화단위에 대하여소정의제한을둘수있으며,이러한제한내용또는소정위치등에 대하여는다양한실시예를통해상술하였으므로자세한설명은생략하도록 한다.
[151] 일실시예에따라,영상복호화장치 (100)는제 1부호화단위를분할하여
다양한형태의부호화단위들을결정할수있다.
[152] 도 9을참조하면,영상복호화장치 ( 0)는정사각형형태의제 1부호화
단위 (900),비-정사각형형태의제 1부호화단위 (930또는 950)를다양한형태의 부호화단위들로분할할수있다.
[153] 도 은일실시예에따라영상복호화장치가제 1부호화단위가분할되어 결정된비-정사각형형태의제 2부호화단위가소정의조건을만족하는경우제 2 부호화단위가분할될수있는형태가제한되는것을도시한다.
[154] 일실시예에따라영상복호화장치 (100)는수신부 (110)를통해획득한분할 형태모드정보에기초하여정사각형형태의제 1부호화단위 (1000)를
비-정사각형형태의제 2부호화단위 (1010 101(¾, 1020 102(¾)로분할하는 것으로결정할수있다.제 2부호화단위 (1010 101(¾, 1020 102(¾)는
독립적으로분할될수있다.이에따라영상복호화장치 (100)는제 2부호화 단위 (1010 101015, 1020 102015)각각에관련된분할형태모드정보에기초하여 복수개의부호화단위로분할하거나분할하지않는것을결정할수있다.일 실시예에따라영상복호화장치 (100)는수직방향으로제 1부호화단위 (1000)가 분할되어결정된비-정사각형형태의좌측제 2부호화단위 (1이0幻를수평 방향으로분할하여제 3부호화단위 (1012 1012비를결정할수있다.다만영상 복호화장치 (100)는좌측제 2부호화단위 (1010 를수평방향으로분할한경우, 2020/175970 1»（：1^1{2020/002929 우측제 2부호화단위（101아5）는좌측제 2부호화단위（1010 가분할된방향과 동일하게수평방향으로분할될수없도록제한할수있다.만일우측제 2부호화 단위（1010비가동일한방향으로분할되어제 3부호화단위（1014 1014비가 결정된경우,좌측제 2부호화단위（1010幻및우측제 2부호화단위（101아5）가 수평방향으로각각독립적으로분할됨으로써제 3부호화단위（1012 1215, 1014&, ^1415）가결정될수있다.하지만이는영상복호화장치（100）가분할형태 모드정보에기초하여제 1부호화단위（1000）를 4개의정사각형형태의제 2 부호화단위（1030 103（¾, 10300, 1030（1）로분할한것과동일한결과이며이는 영상복호화측면에서비효율적일수있다.
[155] 일실시예에따라영상복호화장치（100）는수평방향으로제 1부호화
단위（1000）가분할되어결정된비-정사각형형태의제 2부호화단위（102 또는 1020비를수직방향으로분할하여제 3부호화단위（1022 1022江 \024a, 1024비를 결정할수있다.다만영상복호화장치（100）는제 2부호화단위중하나（예를 들면상단제 2부호화단위（1020幻）를수직방향으로분할한경우,상술한이유에 따라다른제 2부호화단위（예를들면하단부호화단위（102015））는상단제 2 부호화단위（1020幻가분할된방향과동일하게수직방향으로분할될수없도록 제한할수있다.
[156] 도 11은일실시예에따라분할형태모드정보가 4개의정사각형형태의
부호화단위로분할하는것을나타낼수없는경우,영상복호화장치가 정사각형형태의부호화단위를분할하는과정을도시한다.
[157] 일실시예에따라영상복호화장치（ ^0）는분할형태모드정보에기초하여 제 1부호화단위（1100）를분할하여제 2부호화단위（1110 111아5, 1120 112아5 등）를결정할수있다.분할형태모드정보에는부호화단위가분할될수있는 다양한형태에대한정보가포함될수있으나,다양한형태에대한정보에는 정사각형형태의 4개의부호화단위로분할하기위한정보가포함될수없는 경우가있다.이러한분할형태모드정보에따르면,영상복호화장치（100）는 정사각형형태의제 1부호화단위（ 00）를 4개의정사각형형태의제 2부호화 단위（1130 113（¾, 11300, 1130（1）로분할하지못한다.분할형태모드정보에 기초하여영상복호화장치（100）는비-정사각형형태의제 2부호화단위（111（切, 111（¾, 1120&, 112아5등）를결정할수있다.
[158] 일실시예에따라영상복호화장치 00）는비-정사각형형태의제 2부호화 단위（1110 111015, n20a, 112아5등）를각각독립적으로분할할수있다.
재귀적인방법을통해제 2부호화단위（1110 111아5, 1120 11201?등）각각이 소정의순서대로분할될수있으며 ,이는분할형태모드정보에기초하여제 1 부호화단위（ 00）가분할되는방법에대응하는분할방법일수있다.
[159] 예를들면영상복호화장치（100）는좌측제 2부호화단위（1110幻가수평
방향으로분할되어정사각형형태의제 3부호화단위（1112 1112비를결정할수 있고,우측제 2부호화단위（1110비가수평방향으로분할되어정사각형형태의 2020/175970 1»（：1^1{2020/002929 제 3부호화단위 (1114 1114비를결정할수있다.나아가영상복호화
장치 (100)는좌측제 2부호화단위 (1110 및우측제 2부호화단위 (1110비모두 수평 방향으로분할되어 정사각형 형태의 제 3부호화단위 (1116 111해, 11160, 1116(1)를결정할수도있다.이러한경우제 1부호화단위 ( 00)가 4개의 정사각형 형태의제 2부호화단위 (1130 113(¾, 11300, 1130(1)로분할된것과 동일한형태로부호화단위가결정될수있다.
[160] 또다른예를들면영상복호화장치 (100)는상단제 2부호화단위 (1120幻가
수직 방향으로분할되어 정사각형 형태의 제 3부호화단위 (1122 1122비를 결정할수있고,하단제 2부호화단위 (1120비가수직방향으로분할되어 정사각형 형태의제 3부호화단위 (1124 1124비를결정할수있다.나아가영상 복호화장치 (100)는상단제 2부호화단위 (1120 및하단제 2부호화단위 (112015) 모두수직방향으로분할되어정사각형 형태의제 3부호화단위 (1126 112해, 1126a 1126비를결정할수도있다.이러한경우제 1부호화단위 (1100)가 4개의 정사각형 형태의제 2부호화단위 (1130 113(¾, 11300, 1130(1)로분할된것과 동일한형태로부호화단위가결정될수있다.
[161] 도 12는일실시예에 따라복수개의부호화단위들간의처리순서가부호화 단위의분할과정에 따라달라질수있음을도시한것이다.
[162] 일실시예에 따라영상복호화장치 ( ^0)는분할형태모드정보에기초하여 제 1부호화단위 (1200)를분할할수있다.블록형태가정사각형이고,분할형태 모드정보가제 1부호화단위 (1200)가수평 방향및수직방향중적어도하나의 방향으로분할됨을나타내는경우,영상복호화장치 (100)는제 1부호화 단위 (1200)를분할하여 제 2부호화단위 (예를들면, 1210 121(¾, 1220 122아5 등)를결정할수있다.도 12를참조하면제 1부호화단위 1200)가수평 방향또는 수직 방향만으로분할되어 결정된비-정사각형 형태의제 2부호화단위 (1 (切, 1 아5, 122(切, 122(¾)는각각에 대한분할형태모드정보에 기초하여독립적으로 분할될수있다.예를들면영상복호화장치 (100)는제 1부호화단위 (1200)가 수직 방향으로분할되어 생성된제 2부호화단위 (1 0 1 아5)를수평 방향으로 각각분할하여제 3부호화단위 (1216 121해, 12160, 1216(1)를결정할수있고, 제 1부호화단위 (1200)가수평 방향으로분할되어 생성된제 2부호화단위 (1220 1220비를수평방향으로각각분할하여 제 3부호화단위 (1226 1226江 12260, 1226(1)를결정할수있다.이러한제 2부호화단위 (1210 121(¾, 1220 122(¾)의 분할과정은도 11과관련하여상술하였으므로자세한설명은생략하도록한다.
[163] 일실시예에 따라영상복호화장치 00)는소정의순서에따라부호화단위를 처리할수있다.소정의순서에따른부호화단위의 처리에 대한특징은도 7와 관련하여상술하였으므로자세한설명은생략하도록한다.도 12를참조하면 영상복호화장치 (100)는정사각형 형태의제 1부호화단위 (1200)를분할하여
4개의 정사각형 형태의 제 3부호화단위 (1216 1216江 1216。, 1216(1, 1226
122해, 12260, 1226(1)를결정할수있다.일실시예에 따라영상복호화 2020/175970 1»（：1^1{2020/002929 장치 (100)는제 1부호화단위 (1200)가분할되는형태에 따라제 3부호화 단위 (1216 12161), 12160, 1216(1, 1226 12261), 12260, 1226(¾의 처리순서를 결정할수있다.
[164] 일실시예에 따라영상복호화장치 ( ^0)는수직 방향으로분할되어 생성된제 2 부호화단위 (1 0 1 아5)를수평방향으로각각분할하여 제 3부호화
단위 (1216 121해, 12160, 1216(1)를결정할수있고,영상복호화장치 (100)는 좌측제 2부호화단위 (1210 에포함되는제 3부호화단위 (1216 1216 를수직 방향으로먼저처리한후,우측제 2부호화단위 (1 아5)에포함되는제 3부호화 단위 (121해, 1216(1)를수직 방향으로처리하는순서 (1217)에따라제 3부호화 단위 (1216 1216江 12160, 1216(1)를처리할수있다.
[165] 일실시예에 따라영상복호화장치 ( ^0)는수평 방향으로분할되어 생성된제 2 부호화단위 (1220 122아5)를수직방향으로각각분할하여 제 3부호화
단위 (1226 122해, 12260, 1226(1)를결정할수있고,영상복호화장치 (100)는 상단제 2부호화단위 (1220幻에포함되는제 3부호화단위 (1226 1226비를수평 방향으로먼저처리한후,하단제 2부호화단위 (122015)에포함되는제 3부호화 단위 (122此, 1226(1)를수평 방향으로처리하는순서 (1227)에따라제 3부호화 단위 (1226 1226江 12260, 1226(1)를처리할수있다.
[166] 도 12를참조하면,제 2부호화단위 (1210 121(¾, 1220 122(¾)가각각
분할되어 정사각형 형태의 제 3부호화단위 (1216 1216江 12160, 1216(1, 1226 122해, 12260, 1226(1)가결정될수있다.수직방향으로분할되어결정된제 2 부호화단위 (1210 121015)및수평 방향으로분할되어 결정된제 2부호화 단위 (1220 122015)는서로다른형태로분할된것이지만,이후에 결정되는제 3 부호화단위 (1216 12161), 12160, 1216(1, 1226 12261), 12260, 1226(¾에따르면 결국동일한형태의부호화단위들로제 1부호화단위 (1200)가분할된결과가 된다.이에 따라영상복호화장치 (100)는분할형태모드정보에기초하여 상이한과정을통해 재귀적으로부호화단위를분할함으로써 결과적으로 동일한형태의부호화단위들을결정하더라도,동일한형태로결정된복수개의 부호화단위들을서로다른순서로처리할수있다.
[167] 도 13은일실시예에 따라부호화단위가재귀적으로분할되어복수개의
부호화단위가결정되는경우,부호화단위의 형태및크기가변함에 따라 부호화단위의심도가결정되는과정을도시한다.
[168] 일실시예에 따라영상복호화장치 (100)는부호화단위의심도를소정의
기준에 따라결정할수있다.예를들면소정의 기준은부호화단위의 긴변의 길이가될수있다.영상복호화장치 00)는현재부호화단위의 긴변의길이가 분할되기 전의부호화단위의 긴변의길이보다 211知＞0)배로분할된경우,현재 부호화단위의심도는분할되기 전의부호화단위의심도보다 II만큼심도가 증가된것으로결정할수있다.이하에서는심도가증가된부호화단위를하위 심도의부호화단위로표현하도록한다. 2020/175970 1»（：1^1{2020/002929
[169] 도 13을참조하면,일실시예에따라정사각형형태임을나타내는블록형태 정보 (예를
Figure imgf000031_0001
나타낼수있음)에기초하여 영상복호화장치 (100)는정사각형형태인제 1부호화단위 (1300)를분할하여 하위심도의제 2부호화단위 (1302),제 3부호화단위 (1304)등을결정할수있다. 정사각형형태의제 1부호화단위 (1300)의크기를 2Nx2N이라고한다면,제 1 부호화단위 (1300)의너비및높이를 1/2배로분할하여결정된제 2부호화 단위 (1302)는 NxN의크기를가질수있다.나아가제 2부호화단위 (1302)의너비 및높이를 1/2크기로분할하여결정된제 3부호화단위 (1304)는 N/2xN/2의 크기를가질수있다.이경우제 3부호화단위 (1304)의너비및높이는제 1 부호화단위 (1300)의 배에해당한다.제 1부호화단위 (1300)의심도가： 0인 경우제 1부호화단위 (1300)의너비및높이의 1/2배인제 2부호화단위 (1302)의 심도는 0+1일수있고,제 1부호화단위 (1300)의너비및높이의 1/4배인제 3 부호화단위 (1304)의심도는 0+2일수있다.
[170] 일실시예에따라비-정사각형형태를나타내는블록형태정보 (예를들면블록 형태정보는,높이가너비보다긴비-정사각형임을나타내는 '1: NS_VER '또는 너비가높이보다긴비-정사각형임을나타내는 '2: NS_HOR '를나타낼수 있음)에기초하여,영상복호화장치 00)는비-정사각형형태인제 1부호화 단위 (1310또는 1320)를분할하여하위심도의제 2부호화단위 (1312또는 1322), 제 3부호화단위 (1314또는 1324)등을결정할수있다.
[171] 영상복호화장치 (100)는 Nx2N크기의제 1부호화단위 (1310)의너비및높이 중적어도하나를분할하여제 2부호화단위 (예를들면, 1302, 1312, 1322등)를 결정할수있다.즉,영상복호화장치 (100)는제 1부호화단위 (1310)를수평 방향으로분할하여 NxN크기의제 2부호화단위 (1302)또는 NxN/2크기의제 2 부호화단위 (1322)를결정할수있고,수평방향및수직방향으로분할하여 N/2xN크기의제 2부호화단위 (1312)를결정할수도있다.
[172] 일실시예에따라영상복호화장치 (100)는 2NxN크기의제 1부호화
단위 (1320)의너비및높이중적어도하나를분할하여제 2부호화단위 (예를 들면, 1302, 1312, 1322등)를결정할수도있다.즉,영상복호화장치 (100)는제 1 부호화단위 (1320)를수직방향으로분할하여 NxN크기의제 2부호화
단위 (1302)또는 N/2xN크기의제 2부호화단위 (1312)를결정할수있고,수평 방향및수직방향으로분할하여 NxN/2크기의제 2부호화단위 (1322)를결정할 수도있다.
[173] 일실시예에따라영상복호화장치 (100)는 NxN크기의제 2부호화단위 (1302) 의너비및높이중적어도하나를분할하여제 3부호화단위 (예를들면, 1304, 1314, 1324등)를결정할수도있다.즉,영상복호화장치 (100)는제 2부호화 단위 (1302)를수직방향및수평방향으로분할하여 N/2xN/2크기의제 3부호화 단위 (1304)를결정하거나 4x^2크기의제 3부호화단위 (1314)를결정하거나 ^2x^4크기의제 3부호화단위 (1324)를결정할수있다. 2020/175970 1»（：1^1{2020/002929
[174] 일실시예에따라영상복호화장치 (100)는 N/2xN크기의제 2부호화
단위 (1312)의너비및높이중적어도하나를분할하여제 3부호화단위 (예를 들면, 1304, 1314, 1324등)를결정할수도있다.즉,영상복호화장치 (100)는제 2 부호화단위 (1312)를수평방향으로분할하여 N/2xN/2크기의제 3부호화 단위 (1304)또는 ^2x^4크기의제 3부호화단위 (1324)를결정하거나수직방향 및수평방향으로분할하여 ^4x^2크기의제 3부호화단위 (1314)를결정할수 있다.
[175] 일실시예에따라영상복호화장치 (100)는 NxN/2크기의제 2부호화
단위 (1322)의너비및높이중적어도하나를분할하여제 3부호화단위 (예를 들면, 1304, 1314, 1324등)를결정할수도있다.즉,영상복호화장치 (100)는제 2 부호화단위 (1322)를수직방향으로분할하여 N/2xN/2크기의제 3부호화 단위 (1304)또는 ^4x^2크기의제 3부호화단위 (1314)를결정하거나수직방향 및수평방향으로분할하여 N/2xN/4크기의제 3부호화단위 (1324)를결정할수 있다.
[176] 일실시예에따라영상복호화장치 00)는정사각형형태의부호화단위 (예를 들면, 1300, 1302, 1304)를수평방향또는수직방향으로분할할수있다.예를 들면, 2Nx2N크기의제 1부호화단위 (1300)를수직방향으로분할하여 Nx2N 크기의제 1부호화단위 (1310)를결정하거나수평방향으로분할하여 2NxN 크기의제 1부호화단위 (1320)를결정할수있다.일실시예에따라심도가 부호화단위의가장긴변의길이에기초하여결정되는경우, 2Nx2N크기의제 1 부호화단위 (1300)가수평방향또는수직방향으로분할되어결정되는부호화 단위의심도는제 1부호화단위 (1300)의심도와동일할수있다.
[177] 일실시예에따라제 3부호화단위 (1314또는 1324)의너비및높이는제 1 부호화단위 (1310또는 1320)의 1/4배에해당할수있다.제 1부호화단위 (1310 또는 1320)의심도가 : 0인경우제 1부호화단위 (1310또는 1320)의너비및 높이의 1/2배인제 2부호화단위 (1312또는 1322)의심도는아1일수있고,제 1 부호화단위 (1310또는 1320)의너비및높이의 1/4배인제 3부호화단위 (1314 또는 1324)의심도는 0+2일수있다.
[178] 도 14은일실시예에따라부호화단위들의형태및크기에따라결정될수있는 심도및부호화단위구분을위한인덱스여 산 ,이하 ^이를도시한다.
[179] 일실시예에따라영상복호화장치 ( 0)는정사각형형태의제 1부호화
단위 (1400)를분할하여다양한형태의제 2부호화단위를결정할수있다.도
14를참조하면,영상복호화장치 (100)는분할형태모드정보에따라제 1부호화 단위 (1400)를수직방향및수평방향중적어도하나의방향으로분할하여제 2 부호화단위 (1402 14021), 1404 14041), 1406 14061), 14060, 1406(¾를결정할수 있다.즉,영상복호화장치 (100)는제 1부호화단위 (1400)에대한분할형태모드 정보에기초하여제 2부호화단위 (1402 14021), 1404 14041), 1406 14061), 14060, 1406(1)를결정할수있다. 2020/175970 1»（：1^1{2020/002929
[18이 일실시예에따라정사각형형태의제 1부호화단위 (1400)에대한분할형태 모드정보에따라결정되는제 2부호화단위 (1402 1402江 1404 1404江 1406山 140해, 14060, 1406(1)는긴변의길이에기초하여심도가결정될수있다.예를 들면,정사각형형태의제 1부호화단위 (1400)의한변의길이와비-정사각형 형태의제 2부호화단위 (1402 1402江 1404 1404비의긴변의길이가
동일하므로,제 1부호화단위 (1400)와비-정사각형형태의제 2부호화
단위 (1402 1402江 1404 1404비의심도는 I)로동일하다고볼수있다.이에 반해영상복호화장치 (100)가분할형태모드정보에기초하여제 1부호화 단위 (1400)를 4개의정사각형형태의제 2부호화단위 (1406 1406江 14060, 1406(1)로분할한경우,정사각형형태의제 2부호화단위 (1406 1406江 14060, 1406(1)의한변의길이는제 1부호화단위 (1400)의한변의길이의 1/2배이므로, 제 2부호화단위 (1406 1406江 14060, 1406(1)의심도는제 1부호화단위 (1400)의 심도인 I)보다한심도하위인 0+1의심도일수있다.
[181] 일실시예에따라영상복호화장치 (100)는높이가너비보다긴형태의제 1 부호화단위 (1410)를분할형태모드정보에따라수평방향으로분할하여 복수개의제 2부호화단위 (1412 141¾, 1414 141此, 1414이로분할할수있다. 일실시예에따라영상복호화장치 ( ^0)는너비가높이보다긴형태의제 1 부호화단위 (1420)를분할형태모드정보에따라수직방향으로분할하여 복수개의제 2부호화단위 (1422 1422江 1424 1424江 1424 로분할할수있다.
[182] 일실시예에따라비-정사각형형태의제 1부호화단위 (1410또는 1420)에대한 분할형태모드정보에따라결정되는제 2부호화단위 (1412 141¾, 1414 14141), 14140. 1422 14221), 1424 14241), 1424 는긴변의길이에기초하여 심도가결정될수있다.예를들면,정사각형형태의제 2부호화단위 (1412 141¾)의한변의길이는높이가너비보다긴비-정사각형형태의제 1부호화 단위 (1410)의한변의길이의 1/2배이므로,정사각형형태의제 2부호화 단위 (1412 1412비의심도는비-정사각형형태의제 1부호화단위 (1410)의심도 I)보다한심도하위의심도인 0+1이다.
[183] 나아가영상복호화장치 00)가분할형태모드정보에기초하여비 -정사각형 형태의제 1부호화단위 (1410)를홀수개의제 2부호화단위 (1414 1414江 1414이로분할할수있다.홀수개의제 2부호화단위 (1414 141415, 1414 는 비-정사각형형태의제 2부호화단위 (1414 14140)및정사각형형태의제 2 부호화단위 (1414비를포함할수있다.이경우비-정사각형형태의제 2부호화 단위 (1414 1414 의긴변의길이및정사각형형태의제 2부호화
단위 (1414비의한변의길이는제 1부호화단위 (1410)의한변의길이의 1/2배 이므로,제 2부호화단위 (1414 1414江 1414 의심도는제 1부호화단위 (1410)의 심도인 I)보다한심도하위인 0+1의심도일수있다.영상복호화장치 (100)는 제 1부호화단위 (1410)와관련된부호화단위들의심도를결정하는상기방식에 대응하는방식으로,너비가높이보다긴비-정사각형형태의제 1부호화 2020/175970 1»（：1^1{2020/002929 단위 (1420)와관련된부호화단위들의심도를결정할수있다.
[184] 일실시예에따라영상복호화장치 (100)는분할된부호화단위들의구분을 위한인덱스에1))를결정함에 있어서,홀수개로분할된부호화단위들이서로 동일한크기가아닌경우,부호화단위들간의크기비율에기초하여인덱스를 결정할수있다.도 14를참조하면,홀수개로분할된부호화단위들 (1414 1414江 14140)중가운데에위치하는부호화단위 (1414비는다른부호화단위들 (1414 1414이와너비는동일하지만높이가다른부호화단위들 (1414 1414이의높이의 두배일수있다.즉,이경우가운데에위치하는부호화단위 (1414비는다른 부호화단위들 (1414 1414이의두개를포함할수있다.따라서,스캔순서에 따라가운데에위치하는부호화단위 (1414비의인덱스 )가 1이라면그다음 순서에위치하는부호화단위 (1414이는인덱스가 2가증가한 3일수있다.즉 인덱스의값의불연속성이존재할수있다.일실시예에따라영상복호화 장치 (100)는이러한분할된부호화단위들간의구분을위한인덱스의 불연속성의존재여부에기초하여홀수개로분할된부호화단위들이서로 동일한크기가아닌지여부를결정할수있다.
[185] 일실시예에따라영상복호화장치 (100)는현재부호화단위로부터분할되어 결정된복수개의부호화단위들을구분하기위한인덱스의값에기초하여특정 분할형태로분할된것인지를결정할수있다.도 14를참조하면영상복호화 장치 00)는높이가너비보다긴직사각형형태의제 1부호화단위 (1410)를 분할하여짝수개의부호화단위 (1412 1412비를결정하거나홀수개의부호화 단위 (1414 1414江 1414 를결정할수있다.영상복호화장치 (100)는복수개의 부호화단위각각을구분하기위하여각부호화단위를나타내는인덱스 (1^10)를 이용할수있다.일실시예에따라 。는각각의부호화단위의소정위치의 샘플 (예를들면,좌측상단샘플)에서획득될수있다.
[186] 일실시예에따라영상복호화장치 (100)는부호화단위의구분을위한
인덱스를이용하여분할되어결정된부호화단위들중소정위치의부호화 단위를결정할수있다.일실시예에따라높이가너비보다긴직사각형형태의 제 1부호화단위 (1410)에대한분할형태모드정보가 3개의부호화단위로 분할됨을나타내는경우영상복호화장치 (100)는제 1부호화단위 (1410)를
3개의부호화단위 (1414 1414江 1414 로분할할수있다.영상복호화 장치 (100)는 3개의부호화단위 (1414 1414江 14140)각각에대한인덱스를 할당할수있다.영상복호화장치 (100)는홀수개로분할된부호화단위중 가운데부호화단위를결정하기위하여각부호화단위에대한인덱스를비교할 수있다.영상복호화장치 (100)는부호화단위들의인덱스에기초하여인덱스들 중가운데값에해당하는인덱스를갖는부호화단위 (1414비를,제 1부호화 단위 (1410)가분할되어결정된부호화단위중가운데위치의부호화단위로서 결정할수있다.일실시예에따라영상복호화장치 (100)는분할된부호화 단위들의구분을위한인덱스를결정함에 있어서,부호화단위들이서로동일한 2020/175970 1»（：1^1{2020/002929 크기가아닌경우,부호화단위들간의크기비율에기초하여인덱스를결정할 수있다.도 14를참조하면,제 1부호화단위 (1410)가분할되어생성된부호화 단위 (1414비는다른부호화단위들 (1414 1414이와너비는동일하지만높이가 다른부호화단위들 (1414 1414이의높이의두배일수있다.이경우가운데에 위치하는부호화단위 (1414비의인덱스 (1^10)가 1이라면그다음순서에위치하는 부호화단위 (1414이는인덱스가 2가증가한 3일수있다.이러한경우처럼 균일하게인덱스가증가하다가증가폭이달라지는경우,영상복호화
장치 (100)는다른부호화단위들과다른크기를가지는부호화단위를포함하는 복수개의부호화단위로분할된것으로결정할수있다,일실시예에따라분할 형태모드정보가홀수개의부호화단위로분할됨을나타내는경우,영상복호화 장치 (100)는홀수개의부호화단위중소정위치의부호화단위 (예를들면 가운데부호화단위)가다른부호화단위와크기가다른형태로현재부호화 단위를분할할수있다.이경우영상복호화장치 (100)는부호화단위에대한 인덱스에이를이용하여다른크기를가지는가운데부호화단위를결정할수 있다.다만상술한인덱스,결정하고자하는소정위치의부호화단위의크기 또는위치는일실시예를설명하기위해특정한것이므로이에한정하여 해석되어서는안되며,다양한인덱스,부호화단위의위치및크기가이용될수 있는것으로해석되어야한다.
[187] 일실시예에따라영상복호화장치 (100)는부호화단위의재귀적인분할이 시작되는소정의데이터단위를이용할수있다.
[188] 도 15는일실시예에따라픽쳐에포함되는복수개의소정의데이터단위에 따라복수개의부호화단위들이결정된것을도시한다.
[189] 일실시예에따라소정의데이터단위는부호화단위가분할형태모드정보를 이용하여재귀적으로분할되기시작하는데이터단위로정의될수있다.즉, 현재픽쳐를분할하는복수개의부호화단위들이결정되는과정에서이용되는 최상위심도의부호화단위에해당할수있다.이하에서는설명상편의를위해 이러한소정의데이터단위를기준데이터단위라고지칭하도록한다.
[190] 일실시예에따라기준데이터단위는소정의크기및형태를나타낼수있다. 일실시예에따라,기준부호화단위는 MxN의샘플들을포함할수있다.여기서 M및 N은서로동일할수도있으며, 2의승수로표현되는정수일수있다.즉, 기준데이터단위는정사각형또는비-정사각형의형태를나타낼수있으며, 이후에정수개의부호화단위로분할될수있다.
[191] 일실시예에따라영상복호화장치 00)는현재픽쳐를복수개의기준데이터 단위로분할할수있다.일실시예에따라영상복호화장치 (100)는현재픽쳐를 분할하는복수개의기준데이터단위를각각의기준데이터단위에대한분할 형태모드정보를이용하여분할할수있다.이러한기준데이터단위의분할 구조를이용한분할과정에대응될수있다.
[192]
Figure imgf000035_0001
호화장치 00)는현재픽쳐에포함되는기준데이터 2020/175970 1»（：1^1{2020/002929 단위가가질수있는최소크기를미리결정할수있다.이에따라,영상복호화 장치 (W0)는최소크기이상의크기를갖는다양한크기의기준데이터단위를 결정할수있고,결정된기준데이터단위를기준으로분할형태모드정보를 이용하여적어도하나의부호화단위를결정할수있다.
[193] 도 15를참조하면,영상복호화장치 (100)는정사각형형태의기준부호화
단위 (1500)를이용할수있고,또는비-정사각형형태의기준부호화
단위 (1502)를이용할수도있다.일실시예에따라기준부호화단위의형태및 크기는적어도하나의기준부호화단위를포함할수있는다양한데이터 단위 (예를들면,시퀀스 (sequence),픽쳐 (picture),슬라이스 (slice),슬라이스 세그먼트 (slice segment),타일 (tile),타일그룹 (tile group),최대부호화단위등)에 따라결정될수있다.
[194] 일실시예에따라영상복호화장치 (100)의수신부 (110)는기준부호화단위의 형태에대한정보및기준부호화단위의크기에대한정보중적어도하나를 상기다양한데이터단위마다비트스트림으로부터획득할수있다.정사각형 형태의기준부호화단위 (1500)에포함되는적어도하나의부호화단위가 결정되는과정은도 3의현재부호화단위 (300)가분할되는과정을통해 상술하였고,비-정사각형형태의기준부호화단위 (1502)에포함되는적어도 하나의부호화단위가결정되는과정은도 4의현재부호화단위 (400또는 450)가 분할되는과정을통해상술하였으므로자세한설명은생략하도록한다.
[195] 일실시예에따라영상복호화장치 (100)는소정의조건에기초하여미리
결정되는일부데이터단위에따라기준부호화단위의크기및형태를결정하기 위하여,기준부호화단위의크기및형태를식별하기위한인덱스를이용할수 있다.즉,수신부 (no)는비트스트림으로부터상기다양한데이터단위 (예를 들면,시퀀스,픽쳐,슬라이스,슬라이스세그먼트,타일,타일그룹,
최대부호화단위등)중소정의조건 (예를들면슬라이스이하의크기를갖는 데이터단위)을만족하는데이터단위로서슬라이스,슬라이스세그먼트,타일, 타일그룹,최대부호화단위등마다,기준부호화단위의크기및형태의식별을 위한인덱스만을획득할수있다.영상복호화장치 (100)는인덱스를
이용함으로써상기소정의조건을만족하는데이터단위마다기준데이터 단위의크기및형태를결정할수있다.기준부호화단위의형태에대한정보및 기준부호화단위의크기에대한정보를상대적으로작은크기의데이터 단위마다비트스트림으로부터획득하여이용하는경우,비트스트림의이용 효율이좋지않을수있으므로,기준부호화단위의형태에대한정보및기준 부호화단위의크기에대한정보를직접획득하는대신상기인덱스만을 획득하여이용할수있다.이경우기준부호화단위의크기및형태를나타내는 인덱스에대응하는기준부호화단위의크기및형태중적어도하나는미리 결정되어 있을수있다.즉,영상복호화장치 (100)는미리결정된기준부호화 단위의크기및형태중적어도하나를인덱스에따라선택함으로써,인덱스 2020/175970 1»（：1^1{2020/002929 획득의 기준이되는데이터단위에포함되는기준부호화단위의크기 및형태 중적어도하나를결정할수있다.
[196] 일실시예에 따라영상복호화장치 (W0)는하나의 최대부호화단위에
포함하는적어도하나의 기준부호화단위를이용할수있다.즉,영상을 분할하는최대부호화단위에는적어도하나의기준부호화단위가포함될수 있고,각각의 기준부호화단위의 재귀적인분할과정을통해부호화단위가 결정될수있다.일실시예에따라최대부호화단위의너비 및높이중적어도 하나는기준부호화단위의너비 및높이중적어도하나의정수배에 해당할수 있다.일실시예에따라기준부호화단위의크기는최대부호화단위를쿼드트리 구조에 따라 n번분할한크기일수있다.즉,영상복호화장치 (100)는
최대부호화단위를쿼드트리구조에따라 n번분할하여기준부호화단위를 결정할수있고,다양한실시예들에따라기준부호화단위를블록형태정보및 분할형태모드정보중적어도하나에 기초하여분할할수있다.
[197] 일실시예에 따라영상복호화장치 (W0)는현재부호화단위의 형태를
나타내는블록형태정보또는현재부호화단위를분할하는방법을나타내는 분할형태모드정보를비트스트림으로부터 획득하여 이용할수있다.분할형태 모드정보는다양한데이터단위와관련된비트스트림에포함될수있다.예를 들면,영상복호화장치 (100)는시퀀스파라미터세트 (sequence parameter set), 픽쳐 파라미터세트 (picture parameter set),비디오파라미터세트 (video parameter set),슬라이스헤더 (slice header),슬라이스세그먼트헤더 (slice segment header), 타일헤더 (tile header),타일그룹헤더 (tile group header)에포함된분할형태모드 정보를이용할수있다.나아가,영상복호화장치 (100)는최대부호화단위,기준 부호화단위,프로세싱블록마다비트스트림으로부터블록형태정보또는분할 형태모드정보에 대응하는신택스엘리먼트를비트스트림으로부터 획득하여 이용할수있다.
[198] 이하본개시의 일실시예에따른분할규칙을결정하는방법에 대하여자세히 설명한다.
[199] 영상복호화장치 (W0)는영상의분할규칙을결정할수있다.분할규칙은영상 복호화장치 (W0)및영상부호화장치 (2200)사이에미리 결정되어 있을수있다. 영상복호화장치 (100)는비트스트림으로부터 획득된정보에 기초하여 영상의 분할규칙을결정할수있다.영상복호화장치 (100)는시퀀스파라미터
세트 (sequence parameter set),픽쳐파라미터 세트 (picture parameter set),비디오 파라미터 세트 (video parameter set),슬라이스헤더 (slice header),슬라이스 세그먼트헤더 (slice segment header),타일헤더 (tile header),타일그룹헤더 (tile group header)중적어도하나로부터 획득된정보에기초하여분할규칙을결정할 수있다.영상복호화장치 (100)는분할규칙을프레임,슬라이스,타일,템포럴 레이어 (Temporal layer),최대부호화단위또는부호화단위에 따라다르게 결정할수있다. 2020/175970 1»（：1^1{2020/002929
[200] 영상복호화장치 ( W0)는부호화단위의블록형태에 기초하여분할규칙을 결정할수있다.블록형태는부호화단위의크기,모양,너비 및높이의 비율, 방향을포함할수있다.영상복호화장치 (100)는부호화단위의블록형태에 기초하여분할규칙을결정할것을미리결정할수있다.하지만이에 한정되는 것은아니다.영상복호화장치 (100)는수신된비트스트림으로부터 획득된 정보에 기초하여 ,분할규칙을결정할수있다.
[201] 부호화단위의모양은정사각형 (square)및비 -정사각형 (non-square)을포함할 수있다.부호화단위의 너비 및높이의길이가같은경우,영상복호화 장치 (100)는부호화단위의모양을정사각형으로결정할수있다.또한, .부호화 단위의 너비 및높이의길이가같지 않은경우,영상복호화장치 (100)는부호화 단위의모양을비-정사각형으로결정할수있다.
[202] 부호화단위의크기는 4x4, 8x4, 4x8, 8x8, 16x4, 16x8, ... , 256x256의다양한 크기를포함할수있다.부호화단위의크기는부호화단위의 긴변의 길이,짧은 변의 길이또는넓이에 따라분류될수있다.영상복호화장치 (100)는동일한 그룹으로분류된부호화단위에동일한분할규칙을적용할수있다.예를들어 영상복호화장치 (100)는동일한긴변의길이를가지는부호화단위를동일한 크기로분류할수있다.또한영상복호화장치 (100)는동일한긴변의길이를 가지는부호화단위에 대하여동일한분할규칙을적용할수있다.
[203] 부호화단위의 너비 및높이의비율은 1 :2, 2: 1, 1 :4, 4: 1, 1 :8, 8: 1, 1 : 16, 16: 1, 32: 1 또는 1 :32등을포함할수있다.또한,부호화단위의 방향은수평 방향및수직 방향을포함할수있다.수평방향은부호화단위의 너비의길이가높이의 길이보다긴경우를나타낼수있다.수직방향은부호화단위의 너비의길이가 높이의 길이보다짧은경우를나타낼수있다.
[204] 영상복호화장치 ( W0)는부호화단위의크기에기초하여분할규칙을
적응적으로결정할수있다.영상복호화장치 (100)는부호화단위의크기에 기초하여 허용가능한분할형태모드를다르게결정할수있다.예를들어,영상 복호화장치 (100)는부호화단위의크기에기초하여분할이허용되는지 여부를 결정할수있다.영상복호화장치 (100)는부호화단위의크기에 따라분할 방향을결정할수있다.영상복호화장치 (100)는부호화단위의크기에따라 허용가능한분할타입을결정할수있다.
[205] 부호화단위의크기에기초하여분할규칙을결정하는것은영상복호화
장치 (100)사이에 미리결정된분할규칙일수있다.또한,영상복호화 장치 (100)는비트스트림으로부터 획득된정보에 기초하여,분할규칙을결정할 수있다.
[206] 영상복호화장치 ( W0)는부호화단위의 위치에기초하여분할규칙을
적응적으로결정할수있다.영상복호화장치 (100)는부호화단위가영상에서 차지하는위치에기초하여분할규칙을적응적으로결정할수있다.
[207] 또한,영상복호화장치 (100)는서로다른분할경로로생성된부호화단위가 2020/175970 1»（：1^1{2020/002929 동일한블록형태를가지지 않도록분할규칙을결정할수있다.다만이에 한정되는것은아니며서로다른분할경로로생성된부호화단위는동일한블록 형태를가질수있다.서로다른분할경로로생성된부호화단위들은서로다른 복호화처리순서를가질수있다.복호화처리순서에 대해서는도 12와함께 설명하였으므로자세한설명은생략한다.
[208] 도 16는영상부호화및복호화시스템의블록도를나타낸도면이다.
[209] 영상부호화및복호화시스템 (1600)의부호화단 (1610)은영상의부호화된
비트스트림을전송하고,복호화단 (1650)은비트스트림을수신하여
복호화함으로써복원영상을출력한다.여기서복호화단 (1650)은영상복호화 장치 (100)에유사한구성일수있다.
[210] 부호화단 (1610)에서,예측부호화부 (1615)는인터 예측및 인트라예측을통해 참조영상을출력하고,변환및양자화부 (1616)는참조영상과현재 입력 영상 간의 레지듀얼데이터를양자화된변환계수로양자화하여출력한다.엔트로피 부호화부 (1625)는양자화된변환계수를부호화하여 변환하고비트스트림으로 출력한다.양자화된변환계수는역양자화및 역변환부 (1630)을거쳐공간 영역의 데이터로복원되고,복원된공간영역의 데이터는디블로킹
필터링부 (1635)및루프필터링부 (1640)를거쳐복원영상으로출력된다.복원 영상은예측부호화부 (1615)를거쳐다음입력 영상의참조영상으로사용될수 있다.
[211] 복호화단 (1650)으로수신된비트스트림중부호화된영상데이터는,엔트로피 복호화부 (1655)및 역양자화및 역변환부 (1660)를거쳐 공간영역의 레지듀얼 데이터로복원된다.예측복호화부 (1675)로부터출력된참조영상및레지듀얼 데이터가조합되어공간영역의 영상데이터가구성되고,디블로킹
필터링부 (1665)및루프필터링부 (1670)는공간영역의 영상데이터에 대해 필터링을수행하여 현재원본영상에 대한복원영상을출력할수있다.복원 영상은예측복호화부 (1675)에의해다음원본영상에 대한참조영상으로서 이용될수있다.
[212] 부호화단 (1610)의루프필터링부 (1640)는사용자입력또는시스템설정에
따라입력된필터 정보를이용하여루프필터링을수행한다.루프
필터링부 (1640)에의해사용된필터 정보는엔트로피부호화부 (1610)로 출력되어,부호화된영상데이터와함께복호화단 (1650)으로전송된다.
복호화단 (1650)의루프필터링부 (1670)는복호화단 (1650)으로부터 입력된필터 정보에 기초하여루프필터링을수행할수있다.
[213] 이하도 17내지도 20을참조하여본명세서에서 개시된일실시예에 따라
픽쳐의크로마성분들을부호화또는복호화하기위한방법 및장치가상술된다.
[214] 도 17은일실시예에 따른비디오복호화장치의블록도를도시한다.
[215] 도 17을참조하면,일실시예에 따른비디오복호화장치 (1700)는획득부 (1기 0) 및복호화부 (1720)를포함할수있다. 2020/175970 1»（：1^1{2020/002929
[216] 일실시예에따른비디오복호화장치 (1700)는,획득부 (1기0)및
복호화부 (1720)를제어하는중앙프로세서 (미도시)를포함할수있다.또는, 획득부 (1기0)및복호화부 (1720)가각각의자체프로세서 (미도시)에의해 작동되며,프로세서 (미도시)들이상호유기적으로작동함에따라비디오복호화 장치 (1700)가전체적으로작동될수도있다.또는,비디오복호화장치 (1700)의 외부프로세서 (미도시)의제어에따라,획득부 (1기0)및복호화부 (1720)가 제어될수도있다.
[217] 비디오복호화장치 (1700)는,획득부 (1기0)및복호화부 (1720)의입출력
데이터가저장되는하나이상의데이터저장부 (미도시 )를포함할수있다. 비디오복호화장치 (1700)는,데이터저장부 (미도시)의데이터입출력을 제어하는메모리제어부 (미도시)를포함할수도있다.
[218] 비디오복호화장치 (1700)는,영상복호화를통해영상을복원하기위해, 내부에탑재된비디오디코딩프로세서또는외부의비디오디코딩프로세서와 연계하여작동함으로써 ,예측을포함한영상복호화동작을수행할수있다.일 실시예에따른비디오복호화장치 (1700)의내부비디오디코딩프로세서는, 별개의프로세서뿐만아니라,중앙연산장치또는그래픽연산장치가영상 디코딩프로세싱모듈을포함함으로써기본적인영상복호화동작을구현할 수도있다.
[219] 비디오복호화장치 (1700)는전술한영상복호화장치 (100)에포함될수있다. 예를들어,획득부 (1기0)는도 1에도시된영상복호화장치 (100)의비트스트림 획득부 (no)에포함될수있고,복호화부 (1720)는영상복호화장치 (100)의 복호화부 (120)에포함될수있다.
[22이 비디오복호화장치 (1700)는영상의부호화결과생성된비트스트림을
획득하고,비트스트림에포함된정보에기초하여부호화단위의예측타입에 대한정보를복호화할수있다.예를들어,예측타입에대한정보는인트라예측 타입및인터 예측타입중하나를나타낼수있다.부호화단위는영상으로부터 트리구조에따라분할되어생성되는블록에대응할수있다.
[221] 획득부 (1/710)는시퀀스파라미터세트 (sequence parameter set),픽쳐파라미터 세트 (picture parameter set),비디오파라미터세트 (video parameter set),슬라이스 헤더 (slice header)및슬라이스세그먼트헤더 (slice segment header)중적어도 하나에포함된블록형태정보및/또는분할형태모드에대한정보에기반하여 현재블록을결정할수있다.나아가,블록위치판단부 (1기0)은최대부호화 단위,기준부호화단위,프로세싱블록마다비트스트림으로부터블록형태정보 또는분할형태모드에대한정보에대응하는신택스엘리먼트를
비트스트림으로부터획득하여현재블록을결정하는데이용할수있다.
[222] 일실시예에따른획득부 (1기0)는,비트스트림으로부터,현재블록의 Cr성분을 위한 cbf정보및 Cb성분을위한 cbf정보를획득할수있다.현재블록은부호화 단위로부터생성된블록으로,역양자화및역변환을위한변환단위일수있다. 2020/175970 1»（：1^1{2020/002929
[223] &성분을위한此 정보 (이하,’& 정보’라기재한다)는현재블록이변환 계수레벨이 0이아닌 &성분을포함하는지여부를나타낼수있다.예를들어, (¾此 정보가 0이면,현재블록이변환계수레벨이 0이아닌 &성분을포함하지 않음을나타내고 , &此 정보가 1이면,현재블록이변환계수레벨이 0이아닌 &성분을포함함을나타낼수있다.유사하게 ,
Figure imgf000041_0001
성분을위한 (此정보 (이하,’(¾ 정보’라기재한다)는현재블록이변환계수레벨이 0이아닌幻5성분을 포함하는지여부를나타낼수있다.예를들어, ( 此 정보가 0이면,현재블록이 변환계수레벨이 0이아닌幻5성분을포함하지않음을나타내고, (比此 정보가
1이면,현재블록이변환계수레벨이 0이아닌幻5성분을포함함을나타낼수 있다.
[224] 일반적으로현재변환블록을위한 정보가 1이면변환계수레벨들을
비트스트림으로부터획득하며,복호화부 (1720)는획득된변환계수레벨들을 이용하여루마성분의레지듀얼샘플들을복원할수있다.
[225] 일실시예에따른비디오복호화장치 (1700)는 성분의레지듀얼샘플및 & 성분의레지듀얼샘플을복원하기위해, 05성분의변환계수레벨들및 & 성분의변환계수레벨들을개별적으로비트스트림으로부터획득하거나,한 종류의크로마변환계수레벨들만비트스트림으로부터획득할수있다.
[226] 이하,한종류의크로마변환계수레벨로서크로마조인트레지듀얼샘플이 이용되는실시예가상술된다.
[227] 일실시예에따른획득부 (1기 0)는,비트스트림으로부터,현재블록의크로마 조인트레지듀얼샘플을획득할수있다.현재블록의크로마조인트레지듀얼 샘플은,현재블록의 (¾성분의레지듀얼샘플값과 &성분의레지듀얼샘플값을 이용하여결정된샘플값일수있다.따라서, (¾성분의레지듀얼샘플값과그에 대응하는 &성분의레지듀얼샘플값을나타내기위해하나의크로마
샘플값만이비트스트림으로부터획득될수있다.만약현재블록의크기가루마 8x8블록및크로마블록 4x4이라면,총 16개의크로마조인트레지듀얼샘플들이 비트스트림으로부터획득될수있다.
[228] 일실시예에따른복호화부 (1720)는,부호화
Figure imgf000041_0002
(¾此 정보에기초하여, &성분의레지듀얼샘플의가중치및 (¾성분의 레지듀얼샘플의가중치를결정할수있다.복호화부 (1720)는,현재블록의 크로마조인트레지듀얼샘플및 &성분의레지듀얼샘플의가중치를이용하여 &성분의레지듀얼샘플을복원할수있다.유사하게복호화부 (1720)는,현재 블록의크로마조인트레지듀얼샘플및 05성분의레지듀얼샘플의가중치를 이용하여 05성분의레지듀얼샘플을복원할수있다.
[229] 먼저일실시예에따른획득부 (1기 0)는,비트스트림으로
Figure imgf000041_0003
성분의
레지듀얼샘플값과그에대응하는 &성분의레지듀얼샘플값을나타내기위해 하나의크로마샘플값만이부호화되는지여부를나타내는크로마조인트 정보를획득할수있다. 2020/175970 1»（：1^1{2020/002929
[23이 예를들어,크로마조인트정보가 1을나타내면,현재블록에서하나의크로마 샘플이부호화됨을나타내는것으로해석될수있다.이경우,획득부 (1기 0)가 비트스트림으로부터하나의크로마샘플값을획득하고,복호화부 (1720)는 획득된하나의크로마샘플값을이용하여 05성분의레지듀얼샘플값과그에 대응하는 &성분의레지듀얼샘플값을복원할수있다.이경우,
복호화부 (1720)는부호화단위의예측타입, &성분을위한此 정보및 (¾ 성분을위한 정보에기초하여 &성분의레지듀얼샘플의가중치및 (¾ 성분의레지듀얼샘플의가중치를결정할수있다.구체적으로,일실시예에따른 복호화부 (1720)는,크로마조인트정보가하나의크로마샘플이부호화됨을 나타낼때 ,부호화단위의 예측타입 , & 정보및幻5 정보에기초하여 , & 성분의레지듀얼샘플의가중치
Figure imgf000042_0001
성분의레지듀얼샘플의가중치를결정할 수있다.
[231] 일실시예에따라,부호화단위의 예측타입이인트라예측모드일때,
복호화부 (1720)는, &此 정보및 (¾此 정보에기초하여다수의조인트모드중 하나의조인트모드를선택하고,선택된조인트모드에따라 &성분의레지듀얼 샘플의가중치
Figure imgf000042_0002
성분의레지듀얼샘플의가중치를결정할수있다.
[232] 일실시예에따라,부호화단위의 예측타입이인터예측모드일때
복호화부 (1720)는,허용되는하나의조인트모드에포함되는 &성분의레지듀얼 샘플의가중치
Figure imgf000042_0003
성분의레지듀얼샘플의가중치를결정할수있다.
[233] 이렇게예측타입, & ,및 此에따라결정된 &성분의레지듀얼샘플의 가중치및
Figure imgf000042_0004
성분의레지듀얼샘플의조합에따라,복호화부 (1720)는,현재 블록의크로마조인트레지듀얼샘플및 &성분의레지듀얼샘플의가중치를 이용하여 &성분의레지듀얼샘플을복원하고,현재블록의크로마조인트
Figure imgf000042_0005
성분의레지듀얼샘플의가중치를이용하여 05성분의 레지듀얼샘플을복원할수있다.
[234] 일실시예에따라크로마조인트정보가 0을나타내면,획득부 (1기 0)는 (¾ 성분의변환계수레벨들과 &성분의변환계수레벨들을개별적으로 비트스트림으로부터획득할수있다.획득부 (1기 0)는 (¾성분의변환블록을 위한변환계수레벨들을비트스트림으로부터획득하고,복호화부 (1720)는 획득된변환계수레벨들을이용하여 성분의레지듀얼샘플들을복원할수 있다.마찬가지로,획득부 (1기 0)가 &성분의변환블록을위한변환계수 레벨들을비트스트림으로부터획득하고,복호화부 (1720)는획득된변환계수 레벨들을이용하여 &성분의레지듀얼샘플들을복원할수있다.
[235] 일실시예에따라,부호화단위의 예측타입이인트라예측모드또는인터예측 모드인지여부에따라, &성분의레지듀얼샘플의가중치및 (¾성분의 레지듀얼샘플의가중치의조합에대응하는조인트모드의개수가다르게 설정될수있다.일실시예에따른 부호화단위의예측타입이 인트라예측모드일때, &성분을
Figure imgf000042_0006
성분을위한 정보에 2020/175970 1»（：1^1{2020/002929 기초하여다수의조인트모드중하나를선택하고,선택된하나의조인트모드에 따라 &성분의레지듀얼샘플의가중치및 (¾성분의레지듀얼샘플의가중치를 결정할수있다.일실시예에따른복호화부 (1720)는,부호화단위의예측타입이 인터 예측모드일때허용되는하나의조인트모드에따라 &성분의레지듀얼 샘플의가중치
Figure imgf000043_0001
성분의레지듀얼샘플의가중치를결정할수있다.
[236] 일실시예에따른복호화부 (1720)는,크로마조인트정보, &성분을위한此 정보및 (¾성분을위한 정보에기초하여 , &성분의레지듀얼샘플의가중치 및 (¾성분의레지듀얼샘플을포함하는조인트모드를결정하고,조인트모드에 기초하여현재블록을위한양자화파라미터를결정할수있다.
[237] 일실시예에따른복호화부 (1720)는,현재블록의움직임벡터를이용하여참조 픽처내의참조블록을결정하고,참조블록에포함된참조샘플들로부터현재 블록에대응하는예측샘플들을결정할수있다.
[238] 현재블록의 예측모드가스킵모드가아닌경우,비디오복호화장치 (1700)는 비트스트림으로부터획득된현재블록의변환계수들에대해역양자화및 역변환을수행하여레지듀얼샘플들을획득할수있다.복호화부 (1720)는현재 블록의 예측샘플들에현재블록의레지듀얼샘플들을조합하여현재블록의 복원샘플들을결정할수있다.
[239] 이하,크로마성분의레지듀얼샘플들을복호화하기위한비디오복호화
방법을도 18을참조하여후술한다.
[240] 도 18은일실시예에따른비디오복호화방법의흐름도를도시한다.
[241] 단계 1810에서,획득부 (1기 0)는비트스트림으로부터현재블록을포함하는 부호화단위의예측타입을나타내는정보를획득할수있다.
[242] 단계 1820에서,획득부 (1기 0)는비트스트림으로부터현재블록의 &此 정보 및幻5 (此정보를획득할수있다.
[243] 단계 1830에서,복호화부 (1720)는부호화단위의예측타입, &此 정보및 (¾ 정보에기초하여, &성분의레지듀얼샘플의가중치및 (¾성분의레지듀얼 샘플의가중치를결정할수있다.
[244] 일실시예에따른획득부 (1기 0)는,비트스트림으로부터현재블록에서 (¾ 성분의레지듀얼샘플및대응하는 &성분의레지듀얼샘플을나타내기위해 하나의크로마샘플이부호화되는지여부를나타내는크로마조인트정보를 획득할수있다.크로마조인트정보가현재블록에서하나의크로마샘플이 부호화됨을나타낼때,복호화부 (1720)는부호화단위의예측타입, &此 정보 및 (¾此 정보에기초하여, &성분의레지듀얼샘플의가중치및 (¾성분의 레지듀얼샘플의가중치를결정할수있다.
[245] 예를들어 ,부호화단위의예측타입 , & 정보및幻5 정보에기초하여 , & 성분의레지듀얼샘플의가중치및 05성분의레지듀얼샘플의가중치의조합들 중에서하나가선택될수있다.
[246] 구체적으로,부호화단위의 예측타입이인트라예측모드일때, 2020/175970 1»（：1^1{2020/002929 복호화부 (1720)는 &此 정보및 (¾此 정보에기초하여다수의조인트모드중 하나의조인트모드를선택하고,선택된조인트모드에따라 &성분의레지듀얼 샘플의가중치및 성분의레지듀얼샘플의가중치를결정할수있다.반면에, 부호화단위의예측타입이인터 예측모드일때,복호화부 (1720)는허용되는 하나의조인트모드에대응되는 &성분의레지듀얼샘플의가중치및 (¾성분의 레지듀얼샘플의가중치를결정할수있다.
[247] 일실시예에따른 &성분의레지듀얼샘플의가중치는
Figure imgf000044_0001
성분의 레지듀얼샘플의가중치는 1일수있다.다른실시예에따른 &성분의레지듀얼 샘플의가중치는 -1이고,
Figure imgf000044_0002
성분의레지듀얼샘플의가중치는 1일수있다.또 다른실시예에따른 &성분의레지듀얼샘플의가중치는
Figure imgf000044_0003
성분의 레지듀얼샘플의가중치는 - 1/2일수있다.
[248] 다른예로,조인트모드에따라 &성분의레지듀얼샘플의가중치및 (¾
성분의레지듀얼샘플의가중치의조합이달라질수있다.예를들어, 3가지 조인트모드별로, &성분의레지듀얼샘플의가중치및 (¾성분의레지듀얼 샘플의가중치의 3가지조합이 {-1/2, 1 }, {-1, 1 }, { 1, -1/2}로설정될수있다.
3가지조인트모드중에서선택된하나의모드에따라 &성분의레지듀얼 샘플의가중치및 성분의레지듀얼샘플의가중치가결정될수도있다.
[249] 단계 1840에서,획득부 (1기 0)는비트스트림으로부터현재블록의크로마
조인트레지듀얼샘플을획득할수있다.
[25이 단계 1850에서,복호화부 (1720)는현재블록의크로마조인트레지듀얼샘플및
&성분의레지듀얼샘플의가중치를이용하여 &성분의레지듀얼샘플을 복원할수있다.복호화부 (1720)는현재블록의크로마조인트레지듀얼샘플및 (¾성분의레지듀얼샘늘의가중치를이용하여 (¾성분의레지듀얼샘늘을 복원할수있다.
[251] 구체적으로현재블록의크로마조인트레지듀얼샘플에 &성분의레지듀얼 샘플의가중치를적용한가중합의결과값이 &성분의레지듀얼샘플으로 결정될수있다.유사하게,현재블록의크로마조인트레지듀얼샘플에 (¾ 성분의레지듀얼샘늘의가중치를적용한가중합의
Figure imgf000044_0004
성분의 레지듀얼샘플으로결정될수있다.
[252] 일실시예에따른복호화부 (1720)는현재블록의움직임벡터를이용하여현재 블록을복원할수있다.복호화부 (1720)는,현재블록의움직임벡터를이용하여 참조픽처내의참조블록을결정하고,참조블록에포함된참조샘플들로부터 현재블록에대응하는예측샘플들을결정할수있다.복호화부 (1720)는,스킵 모드를제외한예측모드에서현재블록의예측샘플들과현재블록의레지듀얼 샘플들을더하여현재블록의복원샘플들을결정할수있다.스킵모드와같이 레지듀얼샘플들이없는경우,현재블록의 예측샘플들만으로현재블록의복원 샘플들이결정될수있다.현재블록이복원됨으로써,현재블록을포함하는 현재픽쳐가복원될수있다. 2020/175970 1»（：1^1{2020/002929
[253] 일실시예에따른복호화부 (1720)는크로마조인트정보, & 정보및 (¾ 났 정보에기초하여, &성분의레지듀얼샘플의가중치및 (¾성분의레지듀얼 샘플의가중치를이용하는조인트모드를결정할수있으며,결정된조인트 모드에기초하여현재블록을위한양자화파라미터를결정할수있다.예를 들어,특정조인트모드가결정될때,크로마성분들을위한양자화파라미터가 개별적으로결정될수있다.복호화부 (1720)는크로마성분들을위한양자화 파라미터를이용하여,현재블록의크로마조인트레지듀얼샘플들의변환 계수들에대해역양자화를수행할수있다.복호화부 (1720)는변환계수에 역양자화및역변환을수행하여크로마조인트레지듀얼샘플들을복원하고, 크로마조인트레지듀얼샘플들에대해 &성분의레지듀얼샘플의가중치및 (¾ 성분의레지듀얼샘늘의가중치를적용함으로써, &성분의레지듀얼샘늘들및 05성분의레지듀얼샘플들을복원할수있다.
[254] 이하,픽쳐를타일들로분할하여타일별로부호화를수행하는비디오부호화 장치를도 19을참조하여후술한다.
[255] 도 19는일실시예에따른비디오부호화장치의블록도를도시한다.
[256] 일실시예에따른비디오부호화장치 (1900)는예측부 (1910)및레지듀얼
부호화부 (1920)를포함할수있다.
[257] 비디오부호화장치 (1900)는인터예측을수행하여결정된움직임정보를
부호화하여비트스트림의형태로출력할수있다.
[258] 일실시예에따른비디오부호화장치 (1900)는,블록위치판단부 (1910)및인터 예측수행부 (1920)를제어하는중앙프로세서 (미도시)를포함할수있다.또는, 예측부 (1910)및레지듀얼부호화부 (1920)가각각의자체프로세서 (미도시)에 의해작동되며,프로세서 (미도시)들이상호유기적으로작동함에따라비디오 부호화장치 (1900)가전체적으로작동될수도있다.또는,비디오부호화 장치 (1900)의외부프로세서 (미도시)의제어에따라,예측부 (1910)및레지듀얼 부호화부 (1920)가제어될수도있다.
[259] 비디오부호화장치 (1900)는,예측부 (1910)및레지듀얼부호화부 (1920)의
입출력데이터가저장되는하나이상의데이터저장부 (미도시 )를포함할수 있다.비디오부호화장치 (1900)는,데이터저장부 (미도시 )의데이터입출력을 제어하는메모리제어부 (미도시)를포함할수도있다.
[26이 비디오부호화장치 (1900)는,영상부호화를위해,내부에탑재된비디오
인코딩프로세서또는외부의비디오인코딩프로세서와연계하여
작동함으로써,예측을포함한영상부호화동작을수행할수있다.일실시예에 따른비디오부호화장치 (1900)의내부비디오인코딩프로세서는,별개의 프로세서뿐만아니라,중앙연산장치또는그래픽연산장치가영상인코딩 프로세싱모듈을포함함으로써기본적인영상부호화동작을구현할수도있다.
[261] 일실시예에따른예측부 (1910)는현재블록을포함하는부호화단위의 예측 타입을결정할수있다. 2020/175970 1»（：1^1{2020/002929
[262] 예측부 (1910)는현재블록의움직임벡터가가리키는참조블록의샘플들을 현재블록의예측샘플들로결정할수있다.레지듀얼부호화부 (1920)는현재 블록의원본샘플과예측샘플들간의차이인레지듀얼샘플들을결정할수 있다.레지듀얼부호화부 (1920)는현재블록의레지듀얼샘플에대해변환및 양자화를수행하여생성된변환계수들을부호화할수있다.
[263] 다만,일실시예에따른비디오부호화
Figure imgf000046_0001
성분의레지듀얼
샘플과 &성분의레지듀얼샘플을,원본샘플과예측샘플들간의차이인실제 레지듀얼샘플과다르게결정하여부호화할수있다.레지듀얼
부호화
Figure imgf000046_0002
지듀얼샘플의실제값과 &성분의레지듀얼 샘플의실제값을대신하여,하나의크로마조인트레지듀얼샘플을부호화할수 있다.
[264] 일실시예에따른레지듀얼부호화부 (1920)는현재블록의 &此 정보및 (¾ 정보를결정할수있다.일실시예에따른레지듀얼부호화부 (1920)는부호화 단위의 예측타입 , & 정보및幻5 정보에기초하여 , &성분의레지듀얼 샘플의가중치
Figure imgf000046_0003
성분의레지듀얼샘플의가중치를결정할수있다.
[265] 일실시예에따른레지듀얼부호화부 (1920)는현재블록의크로마조인트
레지듀얼샘플을생성할수있다.비디오부호화장치 (1900)는실제 성분의 레지듀얼샘플과 &성분의레지듀얼샘플을알고있지만,부호화효율을위해 부호화될크로마조인트레지듀얼샘플을결정할수있다.비디오복호화 장치 (1700)에서현재블록의크로마조인트레지듀얼샘플및 &성분의 레지듀얼샘늘의가중치를이용하여 &성분의레지듀얼샘늘이복원되고,현재 블록의크로마조인트레지듀얼샘플및 05성분의레지듀얼샘플의가중치를 이용하여상기 05성분의레지듀얼샘플이복원될것임을고려하여,레지듀얼 부호화부 (1920)는 (¾성분의레지듀얼샘플의실제값과 &성분의레지듀얼 샘플의실제값을이용하여크로마조인트레지듀얼샘플을결정할수있다.
[266] 또한,일실시예에따른레지듀얼부호화부 (1920)는부호화단위의 예측타입, (¾ ( 정보및대此 정보에기초하여, &성분의레지듀얼샘플의가중치및幻5 성분의레지듀얼샘플의가중치를결정할수있다.
[267] 일실시예에따른레지듀얼부호화부 (1920)는,부호화단위의예측타입이
인트라예측모드또는인터 예측모드인지여부에따라, &성분의레지듀얼 샘플의가중치및 05성분의레지듀얼샘플의가중치의조합에대응하는조인트 모드의개수를다르게설정할수있다.
[268] 레지듀얼부호화부 (1920)는,부호화단위의 예측타입이인트라예측모드일 때 , &성분을위한 정보및상기幻5성분을위한 정보에기초하여다수의 조인트모드중하나를선택하고,선택된조인트모드에따라 &성분의 레지듀얼샘플의가중치및 05성분의레지듀얼샘플의가중치를결정할수 있다.부호화단위의예측타입이인터 예측모드일때허용되는하나의조인트 모드에따라 &성분의레지듀얼샘플의가중치및 (¾성분의레지듀얼샘플의 2020/175970 1»（：1^1{2020/002929 가중치를결정할수있다.
[269] 또한,비디오부호화장치 (1900)는,현재블록에서
Figure imgf000047_0001
성분의레지듀얼샘플및 대응하는 &성분의레지듀얼샘플을나타내기위해하나의크로마샘플이 부호화되는지여부를나타내는크로마조인트정보를생성할수있다.
[27이 이하,비디오부호화장치 (1900)가크로마성분의레지듀얼샘플들을포함하는 비디오부호화를수행하는과정을도 20을참조하여후술한다.
[271] 도 20은일실시예에따른비디오부호화방법의흐름도를도시한다.
[272] 단계 2010에서 ,예측부 (1910)는현재블록을포함하는부호화단위의 예측 타입을결정할수있다.비디오부호화장치 (1900)는,현재블록을포함하는 부호화단위의예측타입이인터 예측모드또는인트라예측모드인지여부를 나타내는예측타입정보를부호화할수있다.
[273] 단게 2020에서 ,레지듀얼부호화부 (1920)는현재블록의 & 정보및幻5 정보를결정할수있다.예를들어,현재블록이변환계수레벨이 0이아닌 & 성분을포함하는지여부를나타내기위해레지듀얼부호화부 (1920)는 &此 정보를부호화할수있다.예를들어,현재블록이변환계수레벨이 0이아닌 & 성분을포함하지않으면,레지듀얼부호화부 (1920)는 &此 정보가 0을 나타내도록부호화할수있다.현재블록이변환계수레벨이 0이아닌 &성분을 포함하면,레지듀얼부호화부 (1920)는 &此 정보가 1을나타내도록부호화할수 있다.유사하게,현재블록이변환계수레벨이 0이아닌幻5성분을포함하는지 여부를나타내기위해레지듀얼부호화부 (1920)는 (¾此 정보를부호화할수 있다.예를들어,현재블록이변환계수레벨이 0이아닌 (¾성분을포함하지 않으면,레지듀얼부호화부 (1920)는 (¾ 정보가 0을나타내도록부호화할수 있다.현재블록이변환계수레벨이 0이아닌幻5성분을포함하면레지듀얼 부호화부 (1920)는 0)此 정보가 1을나타내도록부호화할수있다.
[274] 단계 2030에서 ,레지듀얼부호화부 (1920)는부호화단위의 예측타입 , & 났 정보및 (¾此 정보에기초하여, &성분의레지듀얼샘플의가중치및 (¾ 성분의레지듀얼샘플의가중치를결정할수있다.
[275] 일실시예에따른 &성분의레지듀얼샘플의가중치는
Figure imgf000047_0002
성분의 레지듀얼샘플의가중치는 1일수있다.다른실시예에따른 &성분의레지듀얼 샘플의가중치는 -1이고,
Figure imgf000047_0003
성분의레지듀얼샘플의가중치는 1일수있다.또 다른실시예에따른 &성분의레지듀얼샘플의가중치는
Figure imgf000047_0004
성분의 레지듀얼샘플의가중치는 - 1/2일수있다.
[276] 레지듀얼부호화부 (1920)는,부호화단위의 예측타입이인트라예측모드일 때 , &성분을위한 정보및상기幻5성분을위한 정보에기초하여다수의 조인트모드중하나를선택하고,선택된조인트모드에따라 &성분의 레지듀얼샘플의가중치및 05성분의레지듀얼샘플의가중치를결정할수 있다.부호화단위의예측타입이인터 예측모드일때허용되는하나의조인트 모드에따라 &성분의레지듀얼샘플의가중치및 (¾성분의레지듀얼샘플의 2020/175970 1»（：1^1{2020/002929 가중치를결정할수있다.
[277] 다른예로, &성분의레지듀얼샘플의가중치
Figure imgf000048_0001
성분의레지듀얼샘플의 가중치의조합이다수제공되고,다수의조인트모드별로가중치조합중에서 하나의조합이선택될수있다.예를들어, &성분의레지듀얼샘플의가중치및 (¾성분의레지듀얼샘플의가중치의조합이 {-1/2, 1 }, {-1, 1 }, { 1, -1/2}중에서 하나의조합이조인트모드별로선택될수있다. 3개의조인트모드중에서 선택된하나의모드에따라 &성분의레지듀얼샘플의가중치및 (¾성분의 레지듀얼샘플의가중치가결정될수도있다.
[278] 또한구체적인예로,부호화단위의 예측타입이인트라예측모드일때, 레지듀얼부호화부 (1920)는 &此 정보및 此 정보에기초하여다수의 조인트모드중하나의조인트모드를선택하고,선택된조인트모드에따른 & 성분의레지듀얼샘플의가중치
Figure imgf000048_0002
성분의레지듀얼샘플의가중치를결정할 수있다.반면에,부호화단위의 예측타입이인터예측모드일때,레지듀얼 부호화부 (1920)는허용되는하나의조인트모드에따른 &성분의레지듀얼 샘플의가중치
Figure imgf000048_0003
성분의레지듀얼샘플의가중치를결정할수있다.
[279] 단계 2040에서,레지듀얼부호화부 (1920)는현재블록의크로마조인트
레지듀얼샘플을생성할수있다.일실시예에레지듀얼부호화부 (1920)는,대 성분의레지듀얼샘플의실제값과 &성분의레지듀얼샘플의실제값을 대신하여,하나의크로마조인트레지듀얼샘플을부호화할수있다.만약현재 블록의크기가루마 8x8블록및크로마블록 4x4이라면,총 16개의크로마 조인트레지듀얼샘플들이비트스트림으로부터획득될수있다.
[28이 비디오복호화장치 (1700)에서현재블록의크로마조인트레지듀얼샘플및 & 성분의레지듀얼샘늘의가중치를이용하여 &성분의레지듀얼샘늘이 복원되고,현재블록의크로마조인트레지듀얼샘플및상기 05성분의 레지듀얼샘늘의가중치를이용하여상기 (¾성분의레지듀얼샘늘이복원될 것임을고려하여,레지듀얼부호화부 (1920)는 성분의레지듀얼샘플의 실제값과 &성분의레지듀얼샘플의실제값을이용하여크로마조인트 레지듀얼샘플을결정할수있다.
[281] 비디오부호화장치 (1900)는,현재블록에서
Figure imgf000048_0004
성분의레지듀얼샘플및
대응하는 &성분의레지듀얼샘플을나타내기위해하나의크로마샘플이 부호화되는지여부를나타내는크로마조인트정보를생성할수있다.현재 블록에서 (¾성분의레지듀얼샘플및대응하는 &성분의레지듀얼샘플을 나타내기위해하나의크로마샘플이부호화되는경우에,단계 2030및 2040이 수행될수있다.
[282] 일실시예에따른레지듀얼부호화부 (1920)는크로마조인트정보, &此 정보 및 (¾此 정보에기초하여, &성분의레지듀얼샘플의가중치및 (¾성분의 레지듀얼샘플의가중치를이용하는조인트모드를결정할수있으며,결정된 조인트모드에기초하여현재블록을위한양자화파라미터를결정할수있다. 2020/175970 1»（：1^1{2020/002929 예를들어,특정조인트모드가결정될때,크로마성분들을위한양자화 파라미터가개별적으로결정될수있다.레지듀얼부호화부 (1920)는양자화 파라미터를이용하여크로마조인트레지듀얼샘플들의변환계수들에대해 양자화를수행할수있다.양자화된변환계수가변환계수레벨이라는신택스 엘리먼트로부호화될수있다.
[283] 이하,도 21및 22을참조하여
Figure imgf000049_0001
샘플을이용하여크로마조인트레지듀얼샘플을결정하고,크로마조인트 레지듀얼샘플을이용하여 05성분의레지듀얼샘플과 05성분의레지듀얼 샘플을복원하는과정을설명한다.
[284] 도 21은일실시예에따른 (¾성분, &성분및크로마부호화성분간의관계에 대한그래프를도시한다.
[285] 그래프 2100는비디오부호화장치 (1900)에서 &성분의레지듀얼샘플의
실제값 (2120)과 (¾성분의레지듀얼샘플의실제값 (2110)과크로마조인트 레지듀얼샘플 (2140)의관계를도시한다.일실시예에따른비디오부호화 장치 (1900)는 &성분의레지듀얼샘플의실제값 (2120)에 -1을곱한값 (2130)과, (¾성분의레지듀얼샘플의실제값 (2110)간의평균값을크로마조인트 레지듀얼샘플 (2140)로결정할수있다.
[286] 그래프 2200는비디오복호화장치 (1700)에서 &성분의레지듀얼샘플의
실제값 (2120)과 (¾성분의레지듀얼샘플의실제값 (2110)과크로마조인트 레지듀얼샘플 (2140)의관계를도시한다.
[287]
Figure imgf000049_0002
성분의레지듀얼샘플가중치는 1, &
성분의레지듀얼샘플가중치는 - 1로결정할수있다.
[288] 따라서,획득부 (1기 0)가크로마조인트레지듀얼샘플 (2140)를획득하면, 복호화부 (1720)는크로마조인트레지듀얼샘플 (2140)과동일한값을 성분의 레지듀얼샘플 (2160)의복원값으로결정하고,크로마조인트레지듀얼 샘플 (2140)에 -1을곱하여생성된값을 &성분의레지듀얼샘플 (2170)의 복원값으로결정할수있다.
[289] 도 22은일실시예에따른 (¾성분, &성분및크로마부호화성분간의
관계식을나타낸다.
[29이 도 22에도시된관계식에서,
Figure imgf000049_0003
는대성분의레지듀얼샘플의복원값, &은 & 성분의레지듀얼샘플의복원값을나타낸다. (¾는크로마조인트레지듀얼 샘플을나타내고, \¥ 110¾151 0 1(1?0는 &성분의레지듀얼샘플가중치를 나타낸다.
[291] 첫번째관계식에따르면, (¾성분의레지듀얼샘플가중치는 1이므로,크로마 조인트레지듀얼샘플 0 (¾과동일한값이
Figure imgf000049_0004
성분의레지듀얼샘플의복원값 (¾으로결정될수있다.
[292] 두번째관계식에따르면, &성분의레지듀얼샘플가중치는
\¥ 0¾151 0111(1?0이므로,크로마조인트레지듀얼샘늘 0 (그1)에가중치를 2020/175970 1»（：1^1{2020/002929 적용한가중합이 Cr성분의레지듀얼샘플의복원값 Cr으로결정될수있다. weightTable(corrldx)는다수의가중치를포함하는테이블로,다수의가중치 중에서인덱스 corrldx에따라결정된하나의가중치을 Cr성분의레지듀얼샘플 가중치로결정될수있다.이경우 Cb성분의레지듀얼샘플가중치는 1로 고정되어 있는것으로볼수있다.
[293] 도 21및 22에서 예시된가중치는일실시예일뿐,본개시의사상에서가능한 조인트모드는이에한정되지않는다.예를들어, weightTable는 { -1, 1, -2, -1/2,
-4, 1/4 ... }일수있다.이경우 Cb성분의레지듀얼샘플가중치는 1로고정되어 있고, Cr성분의레지듀얼샘플가중치는 { -1, 1, -2, -1/2, -4, 1/4 ... }중하나로 결정될수있다.다른예로, Cb, Cr레지듀얼샘플을위한조인트모드가 {(1,
±1/2), (1, ±1), (±1/2, 1)}으로설정되어 있고,예측타입, Cb cbf및 Cr cbf에따라 조인트모드중하나가결정될수있다.
[294] 도 23은일실시예에따른 transform unit syntax를도시한다.
[295] 비디오복호화장치 (1700)는 transform unit syntax(2300)로부터신택스엘리먼트 tu_cbf_cb, tu_cbf_cr및 tu j oint_cbcr_re sidual_flag을획득할수있다.
[296] tu_cbf_cb는 Cb cbf정보에대응되는신택스엘리먼트로,현재변환블록이변환 계수레벨이 0이아닌 Cb성분을포함하는지여부를나타낼수있다. tu_cbf_cr는 Cr cbf정보에대응되는신택스엘리먼트로,현재변환블록이변환계수레벨이
0이아닌 Cr성분을포함하는지여부를나타낼수있다.
tuJoint_cbcr_residual_flag는크로마조인트정보에대응하는신택스엘리먼트로, 현재변환블록에서 Cb성분의레지듀얼샘플및대응하는 Cr성분의레지듀얼 샘플을나타내기위해하나의크로마샘플이부호화되는지여부를나타낼수 있다.
[297] 비디오복호화장치 (1700)가 transform unit syntax(2300)를복호화하기이전에 시퀀스파라미트세트 (sequence parameter set)에서 spsJoint_cbcr_enabled_flag를 획득할수있다. spsJoint_cbcr_enabled_flag가 1을나타내는경우,현재시퀀스에 포함된블록에서 Cb성분의레지듀얼샘플및대응하는 Cr성분의레지듀얼 샘플을나타내기위해하나의크로마샘플이부호화되는크로마조인트방식이 허용됨을의미한다.
[298] 따라서，비디오복호화장치 (1700)는먼저 sps Joint_cbcr_enabled_flag를통해 , 현재시퀀스에서크로마조인트방식이허용되고 (spsJoint_cbcr_enabled_flag &&),현재변환블록을포함하는부호화단위의 예측타입이인트라예측 타입이고 (( CuPredMode[ chType ][ x0 ][ y0 ] = = MODEJNTRA) &&, Cr cbf 정보또는 Cb cbf정보가 1인경우 ( tu_cbf_cb[xC][yC] I I tu_cbf_cr[xC] [yC] )에 , tuJoint_cbcr_residual_flag즉크로마조인트정보를획득할수있다.또한,현재 변환블록을포함하는부호화단위의 예측타입이인터예측타입인경우에는,
Cr cbf정보및 Cb cbf정보가모두 1인경우 ( tu_cbf_cb[xC][yC] &&
tu_cbf_cr[xC] [yC] )에만, tu j oint_cbcr_residual_flag ,즉크로마조인트정보를 2020/175970 1»（：1^1{2020/002929 획득할수있다.
[299] 따라서,부호화단위의 예측타입이인트라예측타입이고,현재블록에 &
성분의레벨이 1인변환계수가존재하거나 05성분의레벨이 1인변환계수가 존재하는경우에,크로마조인트정보를통해 05성분의레지듀얼샘플및 대응하는 &성분의레지듀얼샘플을나타내기위해하나의크로마샘플이 부호화되는지여부가결정될수있다.부호화단위의예측타입이인터 예측 타입이고,현재블록에 &성분의레벨이 1인변환계수가존재하고 성분의 레벨이 1인변환계수가존재하는경우에,크로마조인트정보를통해 05성분의 레지듀얼샘플및대응하는 &성분의레지듀얼샘플을나타내기위해하나의 크로마샘플이부호화되는지여부가결정될수있다.여기서획득된크로마 조인트정보가 0을나타낸다면,비트스트림으로부터（¾성분의레지듀얼샘플 및대응하는 &성분의레지듀얼샘플이각각획득되어야함을의미한다.반면에 크로마조인트정보가 1을나타낸다면,비트스트림으로부터하나의크로마 샘플을획득하고,이로부터 성분의레지듀얼샘플및대응하는 &성분의 레지듀얼샘플이복원됨을의미한다.
[30이 도 24은일실시예에따른（¾ 값, & 의조합에幻5성분, &성분및
크로마부호화성분간의관계식을나타낸다.
[301] 도 23을참조하여
Figure imgf000051_0001
_ _0·）가획득되면,幻5 정보와 & 정보에따라幻5성분의레지듀얼 샘플의복원값如8（¾）과 &성분의레지듀얼샘플의복원값如8&）을결정하기 위한가중치가결정될수있다.
[302] 샘플의 복
Figure imgf000051_0002
으로 결정되고, &성분의레지듀얼샘플의복원값（ 8&）는크로마조인트레지듀얼 샘플（ 0에 ±1/2를곱한값으로결정될수있다.이경우,
Figure imgf000051_0003
성분의 가중치는 1, &성분의가중치는 ±1/2으로조인트모드인덱스가 1이다.
[303] 샘플의 복
Figure imgf000051_0004
으로 결정되고, &성분의레지듀얼샘플의복원값（ 8&）는크로마조인트레지듀얼 샘플（ 0에 ±1를곱한값으로결정될수있다.이경우,
Figure imgf000051_0005
성분의가중치는
1, &성분의가중치는 ±1으로조인트모드인덱스가 2이다.
[304] 예를들어 ,山_此ᄂ此가 0및位_ 났_0·가 1일때 ,（¾성분의레지듀얼샘플의 복원값 0 （¾）는크로마조인트레지듀얼샘플（ 此加 에 ±1/2를곱한값으로 결정되고, &성분의레지듀얼샘플의복원값（ 8&）는크로마조인트레지듀얼 샘플（ 比 0과동일한값으로결정될수있다.이경우,
Figure imgf000051_0006
성분의가중치는 ±1/2, &성분의가중치는 1로조인트모드인덱스가 3이다.
[305] 부호화단위의 예측타입이인트라예측모드인경우,조인트모드인덱스가 1,
2, 3이모두가능하다.즉,부호화단위의예측타입이인트라예측모드인 2020/175970 1»（：1^1{2020/002929 경우에는조인트모드인덱스에따라 (¾성분의가중치및 &성분의가중치가 각각결정될수있다.
[306] 다만,부호화단위의 예측타입이인터예측모드인경우,조인트모드인덱스가
2만허용된다.따라서,부호화단위의 예측타입이인터예측모드인경우에는 조인트모드인덱스가 2인경우,즉山_此ᄂ此가 1및
Figure imgf000052_0001
가 1일때만크로마 조인트방식이허용되
Figure imgf000052_0002
성분의가중치는 1, &성분의가중치는 ±1으로 결정될수있다.
[307] 이상,비디오부호화
Figure imgf000052_0003
샘플의실제값과 &
성분의레지듀얼샘플의실제값을대신하여,하나의크로마조인트레지듀얼 샘플을부호화하고,비디오복호화장치 (1700)는비트스트림으로부터하나의 크로마조인트레지듀얼샘플을획득하여,하나의크로마조인트레지듀얼 샘플로부터 (¾성분의레지듀얼샘플의복원값과 &성분의레지듀얼샘플의 복원값을결정하는방법이제안되었다.
[308] 성분의레지듀얼샘플및 &성분의레지듀얼샘플이하나의조인트
레지듀얼샘플로부호화됨으로써,개별적으로부호화하는것에비해
비트레이트가절약될수있다.비디오부호화장치 (1900)에서대성분의 레지듀얼샘플의실제값과 &성분의레지듀얼샘플의실제값을어떤관계식에 따라조합하여크로마조인트레지듀얼샘플을결정하는지,또는비디오복호화 장치 (1700)에서조인트레지듀얼샘플을이용하여
Figure imgf000052_0004
성분의레지듀얼샘플및 &성분의레지듀얼샘플을복원하는지에따라부호화효율이더높아질수 있다.
[309] 이하,상기실시예를변형하여,비디오부호화
Figure imgf000052_0005
성분의
레지듀얼샘플의실제값과 &성분의레지듀얼샘플의실제값을대신하여 크로마조인트샘플값을부호화하고,비디오복호화장치 (1700)는
비트스트림으로부터획득된크로마조인트샘플값을이용하여 05성분의 레지듀얼샘플의복원값과 &성분의레지듀얼샘플의복원값을결정하는 다양한방법을제안하고자한다.
[310] 먼저크로마조인트정보가획득되는위치가다양하게변경될수있다.
[311] 도 23에따른실시예에서는루마 정보, 정보와 & ( 정보가
비트스트림으로부터획득된후,〔¾此 정보와 & 정보에따라크로마조인트 정보가비트스트림으로부터획득될수있다.
[312] 다른실시예에따르면,먼저루마 ( 정보및대 ( 정보가
정보가 1이면크로마조인트정보가획득되고,幻5此 정보
조인트정보가 0이면 & ( 정보가획득될수있다.이경우,
Figure imgf000052_0006
빈 ( 11)으로구성된이진열로복호화되고,크로마조인트정보는 2개의빈으로 구성된이진열, &此 정보가 2/3개의빈으로구성된이진열로복호화될수있다.
[313] 다른실시예에따르면,조인트크로마정보의부호화횟수를줄이기위해, (¾ 정보보다먼저조인트크로마정보를복호화할수있다.구체적으로,루마此 2020/175970 1»（：1^1{2020/002929 와크로마조인트정보가획득되고,크로마조인트정보가 정보 값을 0으로결정할수있다.
Figure imgf000053_0001
조인트
Figure imgf000053_0002
정보를각각비트스트림으로부터획득할수 있다.이경우,크로마조인트정보는 1개의빈으로구성된이진열,대此 정보는 1/2개의빈으로구성된이진열로복호화되고, &此 정보가 1/2개의빈으로 구성된이진열로복호화될수있다.
[314] 이하,크로마조인트정보의컨텍스트모델링방식에대해설명한다.
[315] 일실시예에따른크로마조인트정보를획득하기위해,
Figure imgf000053_0003
기초하여엔트로피복호화를수행할수있다.이경우크로마조인트정보를 복호화하기위해컨텍스트인덱스가결정될수있다.
[316] 예를들어,크로마조인트정보를복호화하기위한컨텍스트인덱스는블록을 포함하는부호화단위의 예측타입이인트라예측모드또는인터예측모드인지 여부에기초하여결정될수있다.
[317] 다른예로,크로마조인트정보를복호화하기위한컨텍스트인덱스는블록의 크기에기초하여결정될수있다.구체적인예로블록의너비를 ,블록의 높이를 라고할때 1 2\¥는 에 1 2를적용한값, 1 211는 에 1 2를적용한 값일수있다.컨텍스트인덱스는 및
Figure imgf000053_0004
중작은값에기초하여결정될 수있다.다른예로컨텍스트인덱스는 1 2\¥및 1 211중큰값에기초하여 결정될수있다.다른예로컨텍스트인덱스는 1 2\¥및 1 211의평균값에 기초하여결정될수있다.다른예로,컨텍스트인덱스는 , 1 2 와 1 211를더한 값에기초하여결정될수있다.
[318] 다른예로,크로마조인트정보를복호화하기위한컨텍스트인덱스는블록의 높이와너비의비율에기초하여결정될수있다.
[319] 다른예로,크로마조인트정보를복호화하기위한컨텍스트인덱스는,블록의 인터 예측방향이단방향예측타입또는양방향예측타입인지여부에기초하여 결정될수있다.
[32이 다른예로,현재블록의크로마조인트정보를복호화하기위한컨텍스트
인덱스가이웃블록의크로마조인트정보에기초하여결정될수있다.
[321] 다른예로,현재블록의크로마조인트정보를복호화하기위한컨텍스트
인덱스가이웃블록의부호화정보에기초하여결정될수있다.구체적인예로, 이웃블록의 정보에기초하여현재블록의크로마조인트정보를복호화하기 위한컨텍스트인덱스가결정될수있다.다른예로,이웃블록의예측타입이 인트라예측모드또는인터 예측모드인지여부에기초하여현재블록의크로마 조인트정보를복호화하기위한컨텍스트인덱스가결정될수있다.다른예로, 이웃블록의변환타입에기초하여현재블록의크로마조인트정보를 복호화하기위한컨텍스트인덱스가결정될수있다.
[322] 다른예로,현재블록의크로마조인트정보를복호화하기위한컨텍스트
인덱스가현재블록의변환타입에기초하여결정될수있다.예를들어,현재 2020/175970 1»（：1^1{2020/002929 블록의변환타입이변환스킵타입인지,서브블록변환타입인지,이차변환 타입인지또는블록형태에따른변환타입인지여부에기초하여,컨텍스트 인덱스가결정될수있다.
[323] 다른예로,기정된부호화모드에기초하여현재블록의크로마조인트정보를 복호화하기위한컨텍스트인덱스가결정될수있다.구체적인예로,현재 블록의부호화모드가 MHintra모드, Trianglelntra모드, Affine모드, IB C (Intra BC)모드, SMVD(Symmetric motion vector difference)모드, MMVD (Merge with motion vector difference)모드, DMVR(Decoder-side Motion Vector Refinement) 모드, CCLM(Cross-component Linear Model )모드, PDPC(Position dependent (intra) prediction combination)모드， MultiReflntra (Multi
Reference Line intra prediction)모드, intraSubPartition모드, inloop reshaper모드, OBMC (Overlapped Block Motion Compensation)모드, transformSkip모드, SBT (Sub-block transform )모드중어느모드가사용되는지여부에기초하여 컨텍스트인덱스가결정될수있다.
[324] 다른예로,현재블록의 MTS (multiple transform selection)인덱스에기초하여 현재블록의크로마조인트정보를복호화하기위한컨텍스트인덱스가결정될 수있다.
[325] 다른예로,앞서제안된다양한조건들중둘이상의조건들의조합에기초하여 현재블록의크로마조인트정보를복호화하기위한컨텍스트인덱스가결정될 수있다.
[326] 이하,블록에서 Cb성분의레지듀얼샘플및대응하는 Cr성분의레지듀얼
샘플을나타내기위해하나의크로마샘플이부호화되는크로마조인트방식이 적용될수있는조건에대한다양한실시예에대해설명한다.
[327] 일실시예에따른비디오복호화장치 (1700)는부호화단위의예측타입이
인트라예측모드또는인터 예측모드인경우블록사이즈에대한제한없이, 크로마조인트방식이적용될지여부가결정될수있다.
[328] 다른예로,블록의크기에기초하여크로마조인트방식이적용될지여부가 결정될수있다.구체적인예로블록의너비를 W,블록의높이를 H라고할때 log2W는 W에 log2를적용한값, log2H는 H에 log2를적용한값일수있다. log2W 및 log2H중작은값에기초하여크로마조인트방식이적용될지여부가결정될 수있다.다른예로 log2W및 log2H중큰값에기초하여크로마조인트방식이 적용될지여부가결정될수있다.다른예로 log2W및 log2H의평균값에 기초하여크로마조인트방식이적용될지여부가결정될수있다.다른예로, log2W와 log2H를더한값에기초하여크로마조인트방식이적용될지여부가 결정될수있다.
[329] 다른예로,블록의형태에기초하여크로마조인트방식이적용될지여부가 결정될수있다.
[33이 다른예로,인터 예측모드의블록인경우예측방향이단방향예측타입이 2020/175970 1»（：1^1{2020/002929 양방향예측타입인지여부에기초하여크로마조인트방식이적용될지여부가 결정될수있다.
[331] 다른예로,블록의높이와너비의비율에기초하여크로마조인트방식이
적용될지여부가결정될수있다.
[332] 다른예로,현재블록의변환타입에기초하여크로마조인트방식이적용될지 여부가결정될수있다.예를들어,현재블록의변환타입이변환스킵타입인지, 서브블록변환타입인지 , 2차변환타입인지또는블록형태에따른변환 타입인지여부에기초하여,크로마조인트방식이적용될지여부가결정될수 있다.
[333] 다른예로, Cb성분의변환계수의개수또는 Cr성분의변환계수의개수에
기초하여크로마조인트방식이적용될지여부가결정될수있다.
[334] 다른예로,기정된부호화모드에기초하여크로마조인트방식이적용될지
여부가결정될수있다.구체적인예로,현재블록의부호화모드가 MHintra모드, Trianglelntm모드, Affine모드, IBC (Intra BC)모드, SMVD(Symmetric motion vector difference)모드, MMVD (Merge with motion vector difference)모드,
DM VR(Decoder- side Motion Vector Refinement)모드, CCLM(Cross-component Linear Model )모드, PDPC(Position dependent (intra) prediction combination)모드, MultiReflntra (Multi Reference Line intra prediction)모드, intraSubPartition모드, inloop reshaper모드, OBMC (Overlapped Block Motion Compensation)모드, transformSkip모드, SBT (Sub-block transform )모드중어느모드가사용되는지 여부에기초하여크로마조인트방식이적용될지여부가결정될수있다.
[335] 다른예로,슬라이스레벨에서크로마조인트방식이적용될지여부가결정될 수있다.슬라이스헤더에서획득된플래그에따라현재슬라이스에포함된 블록들에서크로마조인트방식의적용이허용될수있다.
[336] 다른예로,템포럴레이어레벨에서크로마조인트방식이적용될지여부가
결정될수있다.
[337] 다른예로,현재슬라이스가참조가능한슬라이스인지,참조불가능한
슬라이스인지여부에기초하여크로마조인트방식이적용될지여부가결정될 수있다.
[338] 다른예로,현재블록의서브블록별로크로마조인트방식이적용될지여부를 나타내는정보가획득될수있다.따라서 ,변환블록의서브블록마다크로마 조인트방식이적용될지여부가결정될수있다.
[339] 다른예로,상기전술된조건들중둘이상의조건들의조합에기초하여,크로마 조인트방식이적용될지여부가결정될수있다.
[34이 크로마조인트방식이적용될지여부를결정하기위한앞서전술된다양한
조건들을표현하기위한구체적인조건문은다음과같다.
[341] - If intraTU only
[342] - If interTU only II inter—slice only 2020/175970 1»（：1/10公020/002929
[343] - If intraTU && size > threshold II interTU && size > threshold
[344] - If intraTU && size < threshold II interTU && size < threshold
[345] - If tu_width != tu_height
[346] - If tu_width == tu_height
[347] - If ratio(tu_width, tu_height) > threshold
[348] - If interTU && predType==UniPred
[349] - If ! (interTU && predType==BiPred)
[350] - If TU is not transform skip mode
[351] - If TU is transform skip mode
[352] - If no secondary transform is applied
[353] - If no SBT is applied
[354] - If SBT is applied
[355] - If number of coeff. of Cb < threshold
[356] - If number of coeff. of Cb > threshold
[357] - If number of coeff. of Y < threshold
[358] - If number of coeff. of Y > threshold
[359] - If cbf(cb)==0 & cbf(cr)=l II cbf(cb)==l & cbf(cr)==0
[36이 이하,다른실시예에따라비디오부호화장치 (1900)가크로마조인트레지듀얼 샘플을결정하는방법과,비디오복호화장치 (1700)가크로마조인트레지듀얼 샘플을이용하여 Cb성분의레지듀얼샘플과 Cr성분의레지듀얼샘플을 복원하는과정을상술한다.
[361] 다른실시예에따른비디오부호화장치 (1900)는 Cb성분의레지듀얼샘플의 실제값 (resCb)과 Cr성분의레지듀얼샘플의실제값 (resCr)을이용하여아래와 같이크로마조인트레지듀얼샘플 (resJoint)을결정할수있다.
[362] resJoint = (re sCb * 3 -re sCr)/4
[363] resJoint = (re sCb-re sCr * 3 )/4
[364] 비디오부호화장치 (1900)는상기두가지 resJoint중에서 RD코스트가낮은
값을크로마조인트레지듀얼샘플로서부호화할수있다.
[365] 다른실시예에따른비디오복호화장치 (1700)는루마성분의샘플의복원값 또는 Cb성분의샘플의복원값에기초하여, Cr성분의레지듀얼샘플을복원하는 방법을결정할수있다.
[366] 다른예로비디오복호화장치 (1700)는루마성분의레지듀얼샘플의복원값 또는 Cb성분의레지듀얼샘플의복원값에기초하여, Cr성분의레지듀얼샘플을 복원하는방법을결정할수있다.
[367] 다른예로비디오복호화장치 (1700)는루마성분의디테일정보또는 Cb
성분의디테일정보에기초하여, Cr성분의레지듀얼샘플을복원하는방법을 결정할수있다.예를들어,디테일정보는루마성분또는 Cb성분의매그니튜드, 평균,분산,그래디언트,고주파성분및저주파성분중적어도하나를포함할수 2020/175970 1»（：1^1{2020/002929 있다.
[368] 다른예로비디오복호화장치 (1700)는,현재블록의서브블록별로,각서브 블록의컨텐츠특성에기초하여 , &성분의레지듀얼샘플을복원하는방법을 결정할수있다.예를들어,각서브블록의컨텐츠는,해당서브블록의루마 성분또는 05성분의샘플의복원값또는루마성분또는 05성분의레지듀얼 샘플의복원값일수있다.각서브블록의컨텐츠의특성은,해당서브블록의 매그니튜드,평균,분산,그래디언트,고주파성분및저주파성분중적어도 하나를포함할수있다.
[369] 다른예로비디오부호화장치 (1900)는,크로마조인트레지듀얼샘플과크로마 조인트레지듀얼샘플차분을부호화할수있다.크로마조인트레지듀얼샘플 차분은크로마조인트레지듀얼샘플과 &성분의레지듀얼샘플간의차이값을 나타낸다.비디오부호화장치 (1900)는 &성분의레지듀얼샘플이
부호화되었는지여부를나타내는플래그를부호화할수있다.이경우,비디오 복호화장치 (1700)는비트스트림으로부터상기플래그를획득하고,상기 플래그를통해 &성분의레지듀얼샘플이부호화되지않음이결정된다면, 크로마조인트레지듀얼샘플 (]0 (¾)과크로마조인트레지듀얼샘플 차분 ((1班」0加(¾_&)을비트스트림으로부터획득할수있다.비디오복호화 장치 (1700)는 (¾성분의레지듀얼샘플의복원값 ((¾)과 &성분의레지듀얼 샘플의복원값 (&)을다음수식에따라결정할수있다. ((¾ = 2^0111^ + &, & = 0 (£¾ - (1江니0뇨1(:03_0 )
[37이 또다른예로,비디오부호화
Figure imgf000057_0001
성분의레지듀얼샘플과 & 성분의레지듀얼샘플간의평균값을부호화하고,
Figure imgf000057_0002
샘플과 & 성분의레지듀얼샘플간의차분의 1/2값을부호화할수있다.또한,비디오 부호화장치 (1900)는 &성분의레지듀얼샘플이부호화되었는지여부를 나타내는플래그를부호화할수있다.이경우,비디오복호화장치 (1700)는 비트스트림으로부터상기플래그를획득하고,상기플래그를통해 &성분의 레지듀얼샘플이부호화되지않음이결정된다면,상기평균값
Figure imgf000057_0003
과 차분의 1/2값 볘(¾&)을비트스트림으로부터획득할수있다.비디오복호화 장치 (1700)는 (¾성분의레지듀얼샘플의복원값 ((¾)과 &성분의레지듀얼 샘플의복원값 (&)을다음수식에따라결정할수있다. ((¾ =
6_幻)0 볘幻5(¾ & = _幻5&<1볘(¾(¾이경우 _幻5&값은 (¾및
-0 ·과동일할수있으며, 성분의가중치및 &성분의가중치의조합이 (1,
1)(1, -1)로제한되지않는다.
[371] 또다른예로,비디오부호화
Figure imgf000057_0004
성분의레지듀얼샘플과동일한 값의크로마조인트레지듀얼샘플이부호화될수있다.또한,비디오부호화 장치 (1900)는,크로마조인트가중치인덱스를부호화할수있다.이경우,비디오 복호화장치 (1700)는비트스트림으로부터크로마조인트레지듀얼샘플을 획득하여,크로마조인트레지듀얼샘플과동일한값의 05성분의레지듀얼 2020/175970 1»（：1^1{2020/002929 샘플을복원할수있다.또한,비디오복호화장치 (1700)는비트스트림으로부터 크로마조인트가중치인덱스를획득하고,가중치테이블중에서가중치 인덱스가가리키는크로마조인트가중치를획득할수있다.비디오복호화 장치 (1700)는크로마조인트가중치와크로마조인트레지듀얼샘플을곱하여 생성된값을 &성분의레지듀얼샘플의복원값으로결정할수있다.이때, 가중치테이블은 {-1, 1, -2, -1/2, -4, 1/4 을포함하며 , 0부터증가하는각크로마 조인트가중치인덱스는가중치테이블중각가중치를가리킬수있다.즉, 비트스트림으로부터획득한크로마조인트가중치인덱스가 0이면,크로마 조인트레지듀얼샘플에 -1을곱하여생성된값을 &성분의레지듀얼샘플의 복원값으로결정할수있다.
[372] 또다른예로,비디오부호화장치 (1900)는, &성분의레지듀얼샘플과동일한 값의크로마조인트레지듀얼샘플이부호화될수있다.또한,비디오부호화 장치 (1900)는,크로마조인트가중치인덱스를부호화할수있다.이경우,비디오 복호화장치 (1700)는비트스트림으로부터크로마조인트레지듀얼샘플을 획득하여,크로마조인트레지듀얼샘플과동일한값의 &성분의레지듀얼 샘플을복원할수있다.또한,비디오복호화장치 (1700)는비트스트림으로부터 크로마조인트가중치인덱스를획득하고,가중치테이블중에서가중치 인덱스가가리키는크로마조인트가중치를획득할수있다.비디오복호화 장치 (1700)는크로마조인트가중치와크로마조인트레지듀얼샘플을곱하여 생성된값을 성분의레지듀얼샘플의복원값으로결정할수있다.이때, 가중치테이블은 {-1, 1, -2, -4 을포함하며 , 0부터증가하는각크로마조인트 가중치인덱스는가중치테이블중각가중치를가리킬수있다.즉,
비트스트림으로부터획득한크로마조인트가중치인덱스가 0이면,크로마 조인트레지듀얼샘플에 -1을곱하여생성된
Figure imgf000058_0001
성분의레지듀얼샘플의 복원값으로결정할수있다.일반적으로 &성분의샘플이 (¾성분의샘플보다 작으므로,가중치테이블에포함된크로마조인트가중치의절대값은 1보다 크거나같을수있다.
[373] 이상의실시예에서는공간도메인에서의크로마레지듀얼샘플을
부복호화하는방법을전술하였다.이하,변환도메인에서의크로마변환계수를 부복호화하는방법을설명한다. (¾성분의변환계수들중일부를이용하여 & 성분의변환계수들이부복호화될수있다.
[374] 일실시예에따른비디오부호화
Figure imgf000058_0002
성분의변환계수들을
부호화하고, &성분의변환계수들은부호화하지않을수있다.비디오복호화 장치 (1700)는,비트스트림으로부터획득한 (¾성분의변환계수들을복호화하여 (¾성분의변환계수들의복원값들을결정할수있다.비디오복호화
장치 (1700)는 성분의변환계수의저주파성분을이용하여 &성분의변환 계수를복원할수있다.다른예로, (¾성분의변환계수에소정가중치를곱한 값을 &성분의변환계수의복원값으로결정할수있다. 2020/175970 1»（：1^1{2020/002929
[375] 다른실시예에따른비디오부호화장치 (1900)는, 성분의변환계수및 (¾ 성분의레지듀얼성분을부호화하고 , &성분의변환계수,레지듀얼성분및 & 정보는부호화하지않을수있다.비디오복호화장치 (1700)는, 비트스트림으로부터획득한 05성분의변환계수들을복호화하여 05성분의 변환계수들의복원값들을결정할수있다.비디오복호화장치 (1700)는 (¾ 성분의변환계수의저주파성분을이용하여 &성분의변환계수를복원할수 있다.다른예로, (¾성분의변환계수에소정가중치를곱한값을 &성분의변환 계수의복원값으로결정할수있다.
[376] 이하,소정조인트모드의크로마조인트방식이수행가능할때, (¾성분을 위한델타양자화파라미터를이용하여크로마성분을위한양자화파라미터를 결정하기위한다양한실시예들에대해설명한다.
[377] 일실시예에따르면
Figure imgf000059_0001
성분을위한 크로마조인트양자화파라미터 (31\此에서 (노均모를뺀값을크로마조인트 양자화파라미터 (3印0加를결정할수있다.예를들어,조인트모드인덱스가 1일 때,비디오복호화장치 (1900)는크로마조인트양자화파라미터 (^印 를 이용하여
Figure imgf000059_0002
성분의변환계수및 &성분의변환계수에역양자화를수행할수 있다.
[378] 다른예로,크로마성분을위한산 !5는변환블록신택스를통해획득될수
있다.따라서,비디오복호화장치 (1900)는변환단위마다크로마성분을위한 (1( 를획득하여,현재변환단위에포함된幻5성분및 &성분의 (均!5를결정할 수있다.
[379] 다른예로,크로마성분을위한산 !5는예측블록신택스를통해획득될수
있다.따라서,비디오복호화장치 (1900)는예측단위마다크로마성분을위한 (1( 를획득하여,현재예측단위에포함된幻5성분및 &성분의 (均!5를결정할 수있다.
[38이 다른예로,크로마성분을위한산 !5는코딩블록신택스를통해획득될수
있다.따라서,비디오복호화장치 (1900)는부호화단위마다크로마성분을위한 (1( 를획득하여,현재부호화단위에포함된 (¾성분및 &성분의 (1( 를 결정할수있다.
[381] 다른예로,크로마성분을위한산 !5는맥시멈코딩블록신택스를통해획득될 수있다.따라서,비디오복호화장치 (1900)는최대부호화단위마다크로마 성분을위한 를획득하여 ,현재최대부호화단위에포함된
Figure imgf000059_0003
성분의 (« 5를결정할수있다.
[382] 다른예로,크로마성분을위한산 !5는슬라이스헤더신택스를통해획득될수 있다.따라서,비디오복호화장치 (1900)는슬라이스마다크로마성분을위한 (1( 를획득하여,현재슬라이스에포함된 (¾성분및 &성분의 (« 를결정할 수있다.
[383] 다른예로,
Figure imgf000059_0004
어마다획득될수있다. 2020/175970 1»（：1^1{2020/002929 따라서,비디오복호화장치 (1900)는현재템포럴레이어에포함된 Cb성분및 Cr 성분의 dQP를결정할수있다.
[384] 예를들어 ,상기크로마성분을위한 dQP는 Cb성분을위한 QP와루마성분을 위한 QP간의차이값일수있다.다른예로,상기크로마성분을위한 QP는 크로마성분을위한 QP와디폴트 QP간의차이값일수있다.
[385] 다른예로,비디오복호화장치 (1700)는크로마성분을위한 dQP를부호화
단위의 예측타입에기초하여결정할수있다.예를들어,부호화단위의 예측 타입이인트라예측모드인경우에크로마성분을위한 dQP는 2로결정되고, 인트라예측모드가아닌경우에크로마성분을위한 dQP는 1로결정될수있다.
[386] 다른예로,비디오복호화장치 (1700)는크로마성분을위한 dQP를블록
사이즈에기초하여결정할수있다.예를들어,블록사이즈가 16x16보다크거나 같다면크로마성분을위한 dQP는 1로결정되고,블록사이즈가 16x16보다 작다면크로마성분을위한 dQP는 2로결정될수있다.
[387] 다른예로,비디오복호화장치 (1700)는크로마성분을위한 dQP를블록의소정 부호화모드에기초하여결정할수있다.구체적인예로,현재블록의부호화 모드는 MHintra모드, Trianglelntra모드, Affine모드, IBC (Intra BC)모드, SMVD(Symmetric motion vector difference)모드, MMVD (Merge with motion vector difference)모드, DM VR(Decoder- side Motion Vector Refinement)모드, CCLM(Cross-component Linear Model )모드, PDPC(Position dependent (intra) prediction combination)모드, MultiReflntra (Multi Reference Line intra prediction) 모드, intmSubPartition모드, inloop reshaper모드, OBMC (Overlapped Block Motion Compensation)모드, transformSkip모드, SBT (Sub-block transform )모드 중적어도어느하나일수있다.예를들어,현재블록의소정부호화모드의 인덱스가 1인경우에크로마성분을위한 dQP는 1로결정되고,인덱스가 1이 아닌경우에크로마성분을위한 dQP는 2로결정될수있다.
[388] 다른예로,비디오복호화장치 (1700)는크로마성분을위한 dQP를현재템포럴 레이어의식별정보에기초하여결정할수있다.예를들어,현재블록을 포함하는템포럴레이어의식별정보가 2보다크다면크로마성분을위한 dQP는 0로결정되고,식별정보가 2보다작거나같다면크로마성분을위한 dQP는 2로 결정될수있다.다른예로,현재블록을포함하는템포럴레이어의식별정보가 0이라면크로마성분을위한 dQP는 2로결정되고,식별정보가 0이아니고 3보다 작다면크로마성분을위한 dQP는 1로결정될수있다.식별정보가 3보다 크거나같다면크로마성분을위한 dQP는 0로결정될수있다
[389] 다른예로,비디오복호화장치 (1700)는현재블록의크로마성분을위한 dQP를 이웃블록의양자화파라미터또는양자화파라미터차분값에기초하여결정할 수있다.
[39이 이하,크로마조인트방식에서다수의조인트모드가이용되는경우와하나의 조인트모드가이용되는경우를소정조건에따라선택하는방법에대한 2020/175970 1»（：1^1{2020/002929 실시예를상술한다.
[391] 비디오부호화장치 (1900)는크로마조인트모드에따라,크로마조인트
레지듀얼샘플 (:를부호화하거나,제 1크로마조인트레지듀얼샘플 0과제 2 크로마조인트레지듀얼샘플 02를부호화할수있다.제 1모드및제 3모드에서, 크로마조인트레지듀얼샘플 (:가결정되어부호화될수있다.비디오부호화
Figure imgf000061_0001
성분의레지듀얼샘플의실제값에 -1을곱한값을 &성분의 레지듀얼샘플이라고가정하고, 성분의레지듀얼샘플과동일한값을크로마 조인트레지듀얼샘플 (:로결정하여부호화할수있다.제 2모드에서,제 1크로마 조인트레지듀얼샘플 0은 (¾성분의레지듀얼샘플의실제값과 &성분의 레지듀얼샘플의실제값의평균값이되도록결정할수있다 (즉, 01= ( +0)/2). 제 2크로마조인트레지듀얼샘플 02은대성분의레지듀얼샘플의실제값과 & 성분의레지듀얼샘플의실제값의음수값의평균값이되도록결정할수있다
(즉, 02= ( ) - )/2).
[392] 일례로,비디오복호화장치 (1700)에서 2가지크로마조인트모드가가능할수 있다.제 1모드에서
Figure imgf000061_0002
성분의레지듀얼샘플은크로마조인트레지듀얼샘플과 동일한값으로복원될수있고, &성분의레지듀얼샘플은크로마조인트 레지듀얼샘플에 -1을곱한값으로복원될수있다 (此 = 0, 01 = -0).제 2모드에서 (¾성분의레지듀얼샘플은제 1크로마조인트레지듀얼샘플과제 2크로마 조인트레지듀얼샘플을합한값으로복원될수있고, &성분의레지듀얼 샘플은제 1크로마조인트레지듀얼샘플에서제 2크로마조인트레지듀얼 샘플을뺀값으로복원될수있다 (此 = 2, 01 = 01-02).부호화단위의예측 타입이인트라예측모드인경우에,비디오복호화장치 (1700)는
비트스트림으로부터크로마조인트모드인덱스를획득하고,크로마조인트 방식은제 1모드와제 2모드중모드인덱스가가리키는방식에따라,
Figure imgf000061_0003
성분의 레지듀얼샘플과 &성분의레지듀얼샘플을복원할수있다.부호화단위의 예측타입이인터 예측모드인경우에,비디오복호화장치 (1700)는모드인덱스 없이제 2모드에따라 (¾성분의레지듀얼샘플과 &성분의레지듀얼샘플을 복원할수있다.
[393] 다른예로,비디오복호화장치 (1700)에서 3가지크로마조인트모드가가능할 수있다.제 1모드에서幻5성분의레지듀얼샘플은크로마조인트레지듀얼 샘플과동일한값으로복원될수있고, &성분의레지듀얼샘플은크로마 조인트레지듀얼샘플에 -1을곱한값으로복원될수있다 (此 = 0, 0· = ).제 2 모드에서 성분의레지듀얼샘플은제 1크로마조인트레지듀얼샘플과제 2 크로마조인트레지듀얼샘플을합한값으로복원될수있고, &성분의 레지듀얼샘플은제 1크로마조인트레지듀얼샘플에서제 2크로마조인트 레지듀얼샘플을뺀값으로복원될수있다 (此 = 01+02, 0· = 01-02).제 3모드에서 05성분의레지듀얼샘플은크로마조인트레지듀얼샘플과동일한값으로 복원될수있고, &성분의레지듀얼샘플은크로마조인트레지듀얼샘플에 2020/175970 1»（：1^1{2020/002929
-1/2을곱한값으로복원될수있다 (此= 0· = -1/2아부호화단위의예측타입이 인트라예측모드이고인트라예측방향이플라나모드또는 IX：모드인경우에, 비디오복호화장치 (1700)는모드인덱스를획득할필요없이제 1모드에따라 (¾성분의레지듀얼샘플과 &성분의레지듀얼샘플을복원할수있다.부호화 단위의 예측타입이인트라예측모드이고인트라예측방향이방향성모드인 경우에,비디오복호화장치 (1700)는비트스트림으로부터크로마조인트모드 인덱스를획득하고,제 1모드와제 3모드중모드인덱스가가리키는방식에 따라, (¾성분의레지듀얼샘플과 &성분의레지듀얼샘플을복원할수있다. 부호화단위의예측타입이인터 예측모드인경우에,비디오복호화
장치 (1700)는모드인덱스를획득할필요없이제 2모드에따라 (¾성분의 레지듀얼샘플과 &성분의레지듀얼샘플을복원할수있다.
[394] 이하,크로마조인트방식에서소정조건에따라다수의조인트모드가
이용되는경우에대한실시예를상술한다.
[395] 앞선실시예에서비디오부호화장치 (1900)는제 1, 2, 3모드에따라크로마 조인트레지듀얼샘플 (:를부호화하거나,제 1크로마조인트레지듀얼샘플
0과제 2크로마조인트레지듀얼샘플 02를부호화할수있음은,본실시예에서 동일하게적용된다.앞선실시예에서비디오복호화장치 (1700)에서 3가지 크로마조인트모드에서크로마조인트레지듀얼샘플 (:，제 1크로마조인트 레지듀얼샘플이및제 2크로마조인트레지듀얼샘플 02중적어도하나를 이용하여 성분의레지듀얼샘플과 &성분의레지듀얼샘플을복원하는 방식도,본실시예에서동일하게적용된다.
[396] 부호화단위의 예측타입이인트라예측모드인경우에,비디오복호화
장치 (1700)는비트스트림으로부터크로마조인트모드인덱스를획득하고,제 1 모드와제 2모드중모드인덱스가가리키는방식에따라,
Figure imgf000062_0001
지듀얼 샘플과 &성분의레지듀얼샘플을복원할수있다.부호화단위의 예측타입이 인터 예측모드인경우에,비디오복호화장치 (1700)는비트스트림으로부터 크로마조인트모드인덱스를획득하고,제 1모드와제 3모드중모드인덱스가 가리키는방식에따라,
Figure imgf000062_0002
샘플과 &성분의레지듀얼샘플을 복원할수있다.
[397] 이하,크로마조인트방식에서크로마조인트모드인덱스없이소정조건에서 다수의조인트모드가이용되는경우에대한실시예를상술한다.
[398] 앞선실시예에서비디오부호화장치 (1900)는제 1, 2, 3모드에따라크로마 조인트레지듀얼샘플 (:를부호화하거나,제 1크로마조인트레지듀얼샘플
0과제 2크로마조인트레지듀얼샘플 02를부호화할수있음은,본실시예에서 동일하게적용된다.앞선실시예에서비디오복호화장치 (1700)에서 3가지 크로마조인트모드에서크로마조인트레지듀얼샘플 (:，제 1크로마조인트 레지듀얼 마조인트레지듀얼샘플 02중적어도하나를 이용하여
Figure imgf000062_0003
샘플과 &성분의레지듀얼샘플을복원하는 2020/175970 1»（：1^1{2020/002929 방식도,본실시예에서동일하게적용된다.비디오복호화장치 (1700)는부호화 단위의 예측타입이인트라예측모드이고인트라예측방향이플라나모드또는 IX：모드인경우에,모드인덱스를획득할필요없이제 1모드에따라 (¾성분의 레지듀얼샘플과 &성분의레지듀얼샘플을복원할수있다.부호화단위의 예측타입이인트라예측모드이고인트라예측방향이방향성모드인경우에, 비디오복호화장치 (1700)는모드인덱스를획득할필요없이제 2모드에따라, (¾성분의레지듀얼샘플과 &성분의레지듀얼샘플을복원할수있다.부호화 단위의 예측타입이인터예측모드인경우에,비디오복호화장치 (1700)는모드 인덱스를획득할필요없이제 3모드에
Figure imgf000063_0001
성분의레지듀얼샘플을복원할수있다.
[399] 제 1크로마조인트레지듀 로마조인트레지듀얼샘플 02 중적어도하나를이용하여
Figure imgf000063_0002
샘늘과 &성분의레지듀얼 샘플을복원하기위한관계식은앞서설명한실시예들에한정되지않으며, 다양한관계식이적용될수있다.
Figure imgf000063_0003
이=\¥3:¾1+\¥4:¾2과같이가중치 \\，1, \¥2, \¥3, \¥4를변형하며다양한관계식이 이용될수있다.
[400] 또한,앞선실시예에서크로마조인트모드인덱스없이다수의조인트모드 중에서하나의모드만을선택하기위한조건에대해,이하다양한실시예를 후술한다.
[401] 예를들어,블록을포함하는부호화단위의예측타입이인트라예측모드또는 인터 예측모드인지여부에기초하여,다수의조인트모드중에서하나의모드가 결정될수있다.
[402] 다른예로,블록의크기에기초하여,다수의조인트모드중에서하나의모드가 결정될수있다.구체적인예로블록의너비를 ,블록의높이를 라고할때 1 2\¥는 에 1 2를적용한값, 1 211는 에 1 2를적용한값일수있다. 1 2\¥ 및 1 211중작은값에기초하여,다수의조인트모드중에서하나의모드가 결정될수있다.
Figure imgf000063_0004
기초하여,다수의조인트 모드중에서하나의모드가결정될수있다.다른예로 1 2\¥및 1 211의 평균값에기초하여,다수의조인트모드중에서하나의모드가결정될수있다. 다른예로, 1(¾2\¥와 1 211를더한값에기초하여,다수의조인트모드중에서 하나의모드가결정될수있다.
[403] 다른예로,블록의높이와너비의비율에기초하여,다수의조인트모드중에서 하나의모드가결정될수있다.
[404] 다른예로,블록의인터예측방향이단방향예측타입또는양방향예측
타입인지여부에기초하여,다수의조인트모드중에서하나의모드가결정될수 있다.
[405] 다른예로,이웃블록의크로마조인트정보에기초하여,현재블록을위한 다수의조인트모드중에서하나의모드가결정될수있다. 2020/175970 1»（：1^1{2020/002929
[406] 다른예로,이웃블록의부호화정보에기초하여 ,현재블록을위한다수의
조인트모드중에서하나의모드가결정될수있다.구체적인예로,이웃블록의 cbf정보에기초하여다수의조인트모드중에서현재블록을위한하나의 모드가결정될수있다.다른예로,이웃블록의예측타입이인트라예측모드 또는인터예측모드인지여부에기초하여,다수의조인트모드중에서현재 블록을위한하나의모드가결정될수있다.다른예로,이웃블록의변환타입에 기초하여,다수의조인트모드중에서현재블록을위한하나의모드가결정될 수있다.다른예로,현재블록의변환타입에기초하여,다수의조인트모드 중에서하나의모드가결정될수있다.예를들어,현재블록의변환타입이변환 스킵타입인지,서브블록변환타입인지,이차변환타입인지또는블록형태에 따른변환타입인지여부에기초하여,다수의조인트모드중에서하나의모드가 결정될수있다.
[407] 다른예로,기정된부호화모드에기초하여,다수의조인트모드중에서하나의 모드가결정될수있다.구체적인예로,현재블록의부호화모드가 MHintra모드, Trianglelntra모드, Affine모드, IBC (Intra BC)모드, SMVD(Symmetric motion vector difference)모드， MMVD (Merge with motion vector difference)모드,
DM VR(Decoder- side Motion Vector Refinement)모드, CCLM(Cross-component Linear Model )모드, PDPC(Position dependent (intra) prediction combination)모드, MultiReflntra (Multi Reference Line intra prediction)모드, intraS ubPartition모드, inloop reshaper모드, OBMC (Overlapped Block Motion Compensation)모드, transformSkip모드, SBT (Sub-block transform )모드중어느모드가사용되는지 여부에기초하여,다수의조인트모드중에서하나의모드가결정될수있다.
[408] 다른예로,현재블록의 MTS (multiple transform selection)인덱스에기초하여 , 다수의조인트모드중에서현재블록을위한하나의모드가결정될수있다.
[409] 다른예로,슬라이스마다다수의조인트모드중에서현재슬라이스에포함된 블록들에서사용될하나의모드가결정될수있다.
[410] 다른예로,템포럴레이어레벨에서다수의조인트모드중에서현재템포럴 레이어에포함된블록들에서사용될하나의모드가결정될수있다.
[411] 다른예로,현재슬라이스가참조가능한슬라이스인지,참조불가능한
슬라이스인지여부에기초하여다수의조인트모드중에서하나의모드가 결정될수있다.
[412] 다른예로, Cb성분의변환계수의개수또는 Cr성분의변환계수의개수에
기초하여다수의조인트모드중에서하나의모드가결정될수있다.
[413] 다른예로,인터 예측모드의블록인경우예측방향이단방향예측타입이
양방향예측타입인지여부에기초하여다수의조인트모드중에서하나의 모드가결정될수있다.
[414] 다른예로,현재블록의 Cb cbf정보와 Cr cbf정보에기초하여다수의조인트 모드중에서하나의모드가결정될수있다. 2020/175970 1»（：1^1{2020/002929
[415] 다른예로,앞서제안된다양한조건들중둘이상의조건들의조합에기초하여 다수의조인트모드중에서하나의모드가결정될수있다.
[416] 한편,상술한본개시의실시예들은컴퓨터에서실행될수있는프로그램으로 작성가능하고,작성된프로그램은매체에저장될수있다.
[417] 매체는컴퓨터로실행가능한프로그램을계속저장하거나,실행또는
다운로드를위해임시저장하는것일수도있다.또한,매체는단일또는수개 하드웨어가결합된형태의다양한기록수단또는저장수단일수있는데,어떤 컴퓨터시스템에직접접속되는매체에한정되지않고,네트워크상에분산 존재하는것일수도있다.매체의예시로는,하드디스크,플로피디스크및자기 테이프와같은자기매체 , CD-ROM및 DVD와같은광기록매체 ,플롭티컬 디스크 (floptical disk)와같은자기 -광매체 (magneto-optical medium),및 ROM, RAM,플래시메모리등을포함하여프로그램명령어가저장되도록구성된것이 있을수있다.또한,다른매체의예시로,애플리케이션을유통하는앱스토어나 기타다양한소프트웨어를공급내지유통하는사이트,서버등에서관리하는 기록매체내지저장매체도들수있다.
[418] 이상,본개시의기술적사상을바람직한실시예를들어상세하게
설명하였으나,본개시의기술적사상은상기실시예들에한정되지않고，본 개시의기술적사상의범위내에서당분야에서통상의지식을가진자에의하여 여러가지변형및변경이가능하다.

Claims

2020/175970 1»（：1/10公020/002929 청구범위
[청구항 1] 비트스트림으로부터현재블록을포함하는부호화단위의예측타입을 나타내는정보를획득하는단계 ;
상기비트스트림으로부터 ,상기현재블록의 &성분을위한此 정보및 (¾성분을위한此 정보를획득하는
상기부호화단위의 예측타입 ,상기
Figure imgf000066_0001
성분을위한此 정보에기초하여,상기 &성분의레지듀얼샘플의 가중치및상기 성분의레지듀얼샘늘의가중치를결정하는단계; 상기비트스트림으로부터,상기현재블록의크로마조인트레지듀얼 샘플을획득하는단계 ;
상기현재블록의크로마조인트레지듀얼샘플및상기 &성분의 레지듀얼샘늘의가중치를이용하여상기 &성분의레지듀얼샘늘을 복원하고,상기현재블록의크로마조인트레지듀얼샘플및상기 (¾ 성분의레지듀얼샘플의가중치를이용하여상기 05성분의레지듀얼 샘늘을복원하는단계를포함하는것을특징으로하는비디오복호화 방법.
[청구항 2] 제 1항에있어서,상기 &성분의레지듀얼샘플의가중치및상기 (¾ 성분의레지듀얼샘늘의가중치를결정하는단계는,
상기부호화
Figure imgf000066_0002
성분을위한此 정보에기초하여,상기현재블록에서상기 (¾성분의 레지듀얼샘플및대응하는상기 &성분의레지듀얼샘플을나타내기 위해하나의크로마샘들이부호화되는지여부를나타내는크로마 조인트정보를획득하는단계;및
상기크로마조인트정보가상기현재블록에서하나의크로마샘플이 부호화됨을나타낼때,상기부호화단위의 예측타입,상기 &성분을
Figure imgf000066_0003
정보에기초하여상기 & 성분의레지듀얼샘플의가중치및상기 05성분의레지듀얼샘플의 가중치를결정하는단계를포함하는것을특징으로하는비디오복호화 방법.
[청구항 3] 제 1항에있어서,
상기 &성분의레지듀얼샘플의가중치는 - 1/2이고,상기 (¾성분의 레지듀얼샘늘의가중치는 1인것을특징으로하는비디오복호화방법. [청구항 4] 제 1항에있어서,
상기 &성분의레지듀얼샘플의가중치는 -1이고,상기 (¾성분의 레지듀얼샘늘의가중치는 1인것을특징으로하는비디오복호화방법. [청구항 5] 제 1항에있어서,
상기 &성분의레지듀얼샘플의가중치는 1이고,상기 (¾성분의 的
2020/175970 1»（：1^1{2020/002929 레지듀얼샘플의가중치는 - 1/2인것을특징으로하는비디오복호화 방법.
[청구항 6] 제 1항에 있어서,상기 &성분의 레지듀얼샘플의 가중치 및상기 (¾ 성분의 레지듀얼샘늘의 가중치를결정하는단계는,
상기부호화단위의 예측타입이 인트라예측모드또는인터 예측 모드인지 여부에따라,상기 &성분의 레지듀얼샘플의 가중치 및상기 05성분의 레지듀얼샘플의 가중치의조합에 대응하는조인트모드의 개수를다르게설정하는단계를포함하는것을특징으로하는비디오 복호화방법 .
[청구항 7] 제 6항에 있어서,상기 &성분의 레지듀얼샘플의 가중치 및상기 (¾ 성분의 레지듀얼샘늘의 가중치를결정하는단계는,
상기부호화단위의 예측타입이 인트라예측모드일때 ,상기 &성분을 위한此 정보및상기 성분을위한此 정보에기초하여다수의조인트 모드중하나를선택하고,상기선택된하나의조인트모드에따라상기 &성분의 레지듀얼샘플의가중치 및상기 (¾성분의 레지듀얼샘플의 가중치를결정하는단계를포함하는것을특징으로하는비디오복호화 방법.
[청구항 8] 제 6항에 있어서,상기 &성분의 레지듀얼샘플의 가중치 및상기 (¾ 성분의 레지듀얼샘늘의 가중치를결정하는단계는,
상기부호화단위의 예측타입이 인터 예측모드일때허용되는하나의 조인트모드에따라상기 &성분의 레지듀얼샘플의가중치 및상기 (¾ 성분의 레지듀얼샘늘의 가중치를결정하는단계를포함하는것을 특징으로하는비디오복호화방법 .
[청구항 9] 제 6항에 있어서,상기 비디오복호화방법은,
상기크로마조인트정보,상기 &성분을위한此 정보및상기 (¾ 성분을위한此 정보에기초하여,상기 &성분의 레지듀얼샘플의 가중치 및상기
Figure imgf000067_0001
성분의 레지듀얼샘플의가중치를포함하는조인트 모드를결정하는단계 ;
상기조인트모드에 기초하여,상기 현재블록을위한양자화파라미터를 결정하는단계를포함하는것을특징으로하는비디오복호화방법.
[청구항 ] 비디오복호화장치에 있어서,
비트스트림으로부터 현재블록을포함하는부호화단위의 예측타입을 나타내는정보를획득하고,상기 비트스트림으로부터,상기 현재블록의 &성분을위한此 정보및 0성분을위한此 정보를획득하고,상기 비트스트림으로부터,상기 현재블록의크로마조인트레지듀얼샘플을 획득하는획득부;
상기부호화단위의 예측타입 ,상기 &성분을위한此 정보및상기 (¾ 성분을위한此 정보에기초하여,상기 &성분의 레지듀얼샘플의 2020/175970 1»（：1^1{2020/002929 가중치및상기 성분의레지듀얼샘플의가중치를결정하고,상기 현재블록의크로마조인트레지듀얼샘플및상기 &성분의레지듀얼 샘늘의가중치를이용하여상기 &성분의레지듀얼샘늘을복원하고, 상기현재블록의크로마조인트레지듀얼샘플및상기 05성분의 레지듀얼샘플의가중치를이용하여상기 05성분의레지듀얼샘플을 복원하는복호화부를포함하는것을특징으로하는비디오복호화장치. [청구항 11] 제 항에있어서,
상기획득부는,상기비트스트림으로부터,상기부호화단위의예측타입,
Figure imgf000068_0001
기초하여,상기현재블록에서상기 05성분의레지듀얼샘플및 대응하는상기 &성분의레지듀얼샘플을나타내기위해하나의크로마 샘플이부호화되는지여부를나타내는크로마조인트정보를획득하고, 상기복호화부는,상기크로마조인트정보가하나의크로마샘플이 부호화됨을나타낼때,상기부호화단위의예측타입,상기 &성분을
Figure imgf000068_0002
정보에기초하여 ,상기 & 성분의레지듀얼샘플의가중치및상기 05성분의레지듀얼샘플의 가중치를결정하고,
상기부호화단위의예측타입이인트라예측모드또는인터예측 모드인지여부에따라,상기 &성분의레지듀얼샘플의가중치및상기 05성분의레지듀얼샘플의가중치의조합에대응하는조인트모드의 개수를다르게설정되는것을특징으로하는비디오복호화장치 .
[청구항 12] 제 항에있어서,
상기복호화부는,
상기부호화단위 일때 ,상기 &성분을 위한此 정보및
Figure imgf000068_0003
초하여다수의조인트 모드중하나를선택하고,상기선택된조인트모드에따라상기 & 성분의레지듀얼샘플의가중치및상기 05성분의레지듀얼샘플의 가중치를결정하고,
상기복호화부는,
상기부호화단위의예측타입이인터예측모드일때허용되는하나의 조인트모드에따라상기 &성분의레지듀얼샘플의가중치및상기 (¾ 성분의레지듀얼샘플의가중치를결정하는것을특징으로하는비디오 복호화장치 .
[청구항 13] 현재블록을포함하는부호화단위의예측타입을결정하는단계;
상기현재블록의
Figure imgf000068_0004
결정하는단계 ;
상기부호화단위의예측타입 ,상기 &성분을위한此 정보및상기 (¾ 성분을위한此 정보에기초하여,상기 &성분의레지듀얼샘플의 2020/175970 1»（：1^1{2020/002929 가중치및상기 성분의레지듀얼샘플의가중치를결정하는단계;및 상기현재블록의크로마조인트레지듀얼샘플을생성하는단계를 포함하고,
상기현재블록의크로마조인트레지듀얼샘플및상기 &성분의 레지듀얼샘늘의가중치를이용하여상기 &성분의레지듀얼샘늘이 복원되고,상기현재블록의크로마조인트레지듀얼샘플및상기 (¾ 성분의레지듀얼샘플의가중치를이용하여상기 05성분의레지듀얼 샘플이복원되는것을특징으로하는비디오부호화방법.
[청구항 14] 제 13항에있어서 ,상기비디오부호화방법은,
상기현재블록에서상기 05성분의레지듀얼샘플및대응하는상기 & 성분의레지듀얼샘플을나타내기위해하나의크로마샘플이
부호화되는지여부를나타내는크로마조인트정보를생성하는단계를 더포함하고,
상기현재블록에서하나의크로마샘플이부호화될때,상기부호화
Figure imgf000069_0001
성분을위한 此 정보에기초하여,상기 &성분의레지듀얼샘플의가중치및상기 (¾ 성분의레지듀얼샘플의가중치가결정되고,
상기부호화단위의예측타입이인트라예측모드또는인터예측 모드인지여부에따라,상기 &성분의레지듀얼샘플의가중치및상기 05성분의레지듀얼샘플의가중치의조합에대응하는조인트모드의 개수를다르게설정되는것을특징으로하는비디오부호화방법.
[청구항 15] 제 13항에있어서,상기 &성분의레지듀얼샘플의가중치및상기 0)
성분의레지듀얼샘늘의가중치를결정하는단계는,
상기부호화단위 일때 ,상기 &성분을 위한此 정보및
Figure imgf000069_0002
초하여다수의조인트 모드중하나를선택하고,상기선택된조인트모드에따라상기 & 성분의레지듀얼샘플의가중치및상기 05성분의레지듀얼샘플의 가중치를결정하는단계;및
상기부호화단위의예측타입이인터예측모드일때허용되는하나의 조인트모드에따라상기 &성분의레지듀얼샘플의가중치및상기 (¾ 성분의레지듀얼샘늘의가중치를결정하는단계를포함하는것을 특징으로하는비디오부호화방법 .
PCT/KR2020/002929 2019-02-28 2020-02-28 크로마 성분을 예측하는 비디오 부호화 및 복호화 방법, 및 크로마 성분을 예측하는 비디오 부호화 및 복호화 장치 WO2020175970A1 (ko)

Priority Applications (9)

Application Number Priority Date Filing Date Title
KR1020217016261A KR102464910B1 (ko) 2019-02-28 2020-02-28 크로마 성분을 예측하는 비디오 부호화 및 복호화 방법, 및 크로마 성분을 예측하는 비디오 부호화 및 복호화 장치
CN202080017377.1A CN113545059A (zh) 2019-02-28 2020-02-28 一种用于预测色度分量的视频编码和解码的方法及其装置
US17/434,684 US12022060B2 (en) 2019-02-28 2020-02-28 Video encoding and decoding method for predicting chroma component, and video encoding and decoding device for predicting chroma component
BR112021016917A BR112021016917A2 (pt) 2019-02-28 2020-02-28 Método de decodificação de vídeo, dispositivo de decodificação de vídeo, e método de codificação de vídeo
JP2021549642A JP7425080B2 (ja) 2019-02-28 2020-02-28 クロマ成分を予測するビデオ符号化及び復号方法、及びクロマ成分を予測するビデオ符号化及び復号装置
EP20762119.4A EP3934251A4 (en) 2019-02-28 2020-02-28 VIDEO ENCODING AND DECODING METHOD FOR PREDICTING CHROMA COMPONENT AND VIDEO ENCODING AND DECODING DEVICE FOR PREDICTING CHROMA COMPONENT
KR1020227038487A KR20220151233A (ko) 2019-02-28 2020-02-28 크로마 성분을 예측하는 비디오 부호화 및 복호화 방법, 및 크로마 성분을 예측하는 비디오 부호화 및 복호화 장치
JP2024006377A JP2024026864A (ja) 2019-02-28 2024-01-18 クロマ成分を予測するビデオ符号化及び復号方法、及びクロマ成分を予測するビデオ符号化及び復号装置
US18/674,107 US20240314294A1 (en) 2019-02-28 2024-05-24 Video encoding and decoding method for predicting chroma component, and video encoding and decoding device for predicting chroma component

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
US201962811672P 2019-02-28 2019-02-28
US62/811,672 2019-02-28
US201962840003P 2019-04-29 2019-04-29
US62/840,003 2019-04-29

Related Child Applications (2)

Application Number Title Priority Date Filing Date
US17/434,684 A-371-Of-International US12022060B2 (en) 2019-02-28 2020-02-28 Video encoding and decoding method for predicting chroma component, and video encoding and decoding device for predicting chroma component
US18/674,107 Continuation US20240314294A1 (en) 2019-02-28 2024-05-24 Video encoding and decoding method for predicting chroma component, and video encoding and decoding device for predicting chroma component

Publications (1)

Publication Number Publication Date
WO2020175970A1 true WO2020175970A1 (ko) 2020-09-03

Family

ID=72239725

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/KR2020/002929 WO2020175970A1 (ko) 2019-02-28 2020-02-28 크로마 성분을 예측하는 비디오 부호화 및 복호화 방법, 및 크로마 성분을 예측하는 비디오 부호화 및 복호화 장치

Country Status (7)

Country Link
US (2) US12022060B2 (ko)
EP (1) EP3934251A4 (ko)
JP (2) JP7425080B2 (ko)
KR (2) KR20220151233A (ko)
CN (1) CN113545059A (ko)
BR (1) BR112021016917A2 (ko)
WO (1) WO2020175970A1 (ko)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2020195013A (ja) * 2019-05-24 2020-12-03 シャープ株式会社 画像復号装置および画像符号化装置
JP2022524440A (ja) * 2019-03-12 2022-05-02 フラウンホーファー－ゲゼルシャフト・ツール・フェルデルング・デル・アンゲヴァンテン・フォルシュング・アインゲトラーゲネル・フェライン 画像及びビデオコード化のための選択的成分間変換（ｉｃｔ）

Families Citing this family (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP7377878B2 (ja) * 2019-03-05 2023-11-10 フラウンホーファー－ゲゼルシャフト・ツール・フェルデルング・デル・アンゲヴァンテン・フォルシュング・アインゲトラーゲネル・フェライン ハイブリッドビデオ符号化ツールのための使用事例駆動コンテキストモデル選択
EP3997872A4 (en) 2019-08-14 2022-10-26 Beijing Bytedance Network Technology Co., Ltd. WEIGHTING FACTORS FOR FILTERING PREDICTION SAMPLES IN INTRA MODE
CN117376556A (zh) 2019-08-14 2024-01-09 北京字节跳动网络技术有限公司 位置相关帧内预测样点滤波
US11265581B2 (en) 2019-08-23 2022-03-01 Tencent America LLC Method and apparatus for video coding
US11722675B2 (en) * 2020-12-29 2023-08-08 Qualcomm Incorporated Sign prediction for multiple color components in video coding
US20220353547A1 (en) * 2021-04-16 2022-11-03 Tencent America LLC Entropy coding of sign map for transform coefficients
KR102561479B1 (ko) 2022-11-30 2023-07-31 문영철 순환형 작물재배시스템

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR101138392B1 (ko) * 2004-12-30 2012-04-26 삼성전자주식회사 색차 성분의 상관관계를 이용한 컬러 영상의 부호화,복호화 방법 및 그 장치
KR101601840B1 (ko) * 2009-02-23 2016-03-22 에스케이 텔레콤주식회사 채널 상관 관계를 이용한 영상 부호화/복호화 장치 및 방법과 그를 위한 컴퓨터로 읽을 수 있는 기록매체
US20170272759A1 (en) * 2016-03-21 2017-09-21 Qualcomm Incorporated Determining prediction parameters for non-square blocks in video coding
KR20180098159A (ko) * 2017-02-24 2018-09-03 주식회사 케이티 비디오 신호 처리 방법 및 장치
KR20180136555A (ko) * 2016-06-03 2018-12-24 엘지전자 주식회사 영상 코딩 시스템에서 인트라 예측 방법 및 장치

Family Cites Families (16)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1214649C (zh) * 2003-09-18 2005-08-10 中国科学院计算技术研究所 用于视频预测残差系数编码的熵编码方法
US7970219B2 (en) 2004-12-30 2011-06-28 Samsung Electronics Co., Ltd. Color image encoding and decoding method and apparatus using a correlation between chrominance components
WO2012138032A1 (ko) * 2011-04-07 2012-10-11 엘지전자 주식회사 영상 정보 부호화 방법 및 복호화 방법
KR101542586B1 (ko) 2011-10-19 2015-08-06 주식회사 케이티 영상 부호화/복호화 방법 및 그 장치
US9807401B2 (en) 2011-11-01 2017-10-31 Qualcomm Incorporated Transform unit partitioning for chroma components in video coding
WO2013107027A1 (en) * 2012-01-19 2013-07-25 Mediatek Singapore Pte. Ltd. Methods and apparatuses of cbf coding in hevc
US9467701B2 (en) 2012-04-05 2016-10-11 Qualcomm Incorporated Coded block flag coding
KR101591352B1 (ko) 2012-04-16 2016-02-04 한국전자통신연구원 비디오 복호화 장치
CN108712652A (zh) 2012-06-29 2018-10-26 韩国电子通信研究院 视频编码方法和计算机可读介质
WO2017173593A1 (en) 2016-04-06 2017-10-12 Mediatek Singapore Pte. Ltd. Separate coding secondary transform syntax elements for different color components
US10523966B2 (en) * 2017-03-31 2019-12-31 Mediatek Inc. Coding transform blocks
US10638126B2 (en) 2017-05-05 2020-04-28 Qualcomm Incorporated Intra reference filter for video coding
EP3643063A1 (en) * 2017-06-21 2020-04-29 Vid Scale, Inc. Adaptive quantization for 360-degree video coding
KR101997604B1 (ko) * 2019-01-22 2019-07-08 에스케이 텔레콤주식회사 영상 부호화/복호화 방법 및 장치
US11516512B2 (en) * 2019-03-04 2022-11-29 Alibaba Group Holding Limited Method and system for processing video content
JP7508558B2 (ja) * 2019-12-09 2024-07-01 バイトダンス インコーポレイテッド ビデオコーディングにおける量子化グループの使用

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR101138392B1 (ko) * 2004-12-30 2012-04-26 삼성전자주식회사 색차 성분의 상관관계를 이용한 컬러 영상의 부호화,복호화 방법 및 그 장치
KR101601840B1 (ko) * 2009-02-23 2016-03-22 에스케이 텔레콤주식회사 채널 상관 관계를 이용한 영상 부호화/복호화 장치 및 방법과 그를 위한 컴퓨터로 읽을 수 있는 기록매체
US20170272759A1 (en) * 2016-03-21 2017-09-21 Qualcomm Incorporated Determining prediction parameters for non-square blocks in video coding
KR20180136555A (ko) * 2016-06-03 2018-12-24 엘지전자 주식회사 영상 코딩 시스템에서 인트라 예측 방법 및 장치
KR20180098159A (ko) * 2017-02-24 2018-09-03 주식회사 케이티 비디오 신호 처리 방법 및 장치

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See also references of EP3934251A4 *

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2022524440A (ja) * 2019-03-12 2022-05-02 フラウンホーファー－ゲゼルシャフト・ツール・フェルデルング・デル・アンゲヴァンテン・フォルシュング・アインゲトラーゲネル・フェライン 画像及びビデオコード化のための選択的成分間変換（ｉｃｔ）
JP7390395B2 (ja) 2019-03-12 2023-12-01 フラウンホーファー－ゲゼルシャフト・ツール・フェルデルング・デル・アンゲヴァンテン・フォルシュング・アインゲトラーゲネル・フェライン 画像及びビデオコード化のための選択的成分間変換（ｉｃｔ）
JP2020195013A (ja) * 2019-05-24 2020-12-03 シャープ株式会社 画像復号装置および画像符号化装置

Also Published As

Publication number Publication date
US20240314294A1 (en) 2024-09-19
KR102464910B1 (ko) 2022-11-09
US20220046232A1 (en) 2022-02-10
KR20210071081A (ko) 2021-06-15
EP3934251A4 (en) 2022-11-30
KR20220151233A (ko) 2022-11-14
US12022060B2 (en) 2024-06-25
JP2024026864A (ja) 2024-02-28
BR112021016917A2 (pt) 2021-11-03
CN113545059A (zh) 2021-10-22
JP7425080B2 (ja) 2024-01-30
EP3934251A1 (en) 2022-01-05
JP2022523378A (ja) 2022-04-22

Similar Documents

Publication Publication Date Title
KR102688470B1 (ko) 영상 부호화/복호화 방법, 장치 및 비트스트림을 저장한 기록 매체
WO2020175970A1 (ko) 크로마 성분을 예측하는 비디오 부호화 및 복호화 방법, 및 크로마 성분을 예측하는 비디오 부호화 및 복호화 장치
KR102709345B1 (ko) 영상 부호화/복호화 방법, 장치 및 비트스트림을 저장한 기록 매체
US11991353B2 (en) Adaptive loop filter
US12101476B2 (en) Adaptive in-loop filtering method and device
KR102283407B1 (ko) 중첩 구역 내에서의 재구성된 샘플 값의 블록 벡터 예측 및 추정에서의 혁신
KR20230132419A (ko) 영상 부호화/복호화 방법, 장치 및 비트스트림을 저장한 기록 매체
JP2020533822A (ja) 画像復号方法、画像符号化方法、及び、記録媒体
WO2020175913A1 (ko) 영상 신호 부호화/복호화 방법 및 이를 위한 장치
KR102668281B1 (ko) 영상 부호화/복호화 방법, 장치 및 비트스트림을 저장한 기록 매체
US20210344929A1 (en) Encoding method and apparatus therefor, and decoding method and apparatus therefor
KR20240118708A (ko) 영상 부호화/복호화 방법, 장치 및 비트스트림을 저장한 기록 매체
US20190260992A1 (en) Method and device for encoding or decoding luma block and chroma block
KR102654647B1 (ko) 영상 부호화/복호화 방법, 장치 및 비트스트림을 저장한 기록 매체
JP7387925B2 (ja) イントラ予測ベースの映像コーディングにおける変換
GB2582031A (en) An adaptive loop filter
JPWO2012090413A1 (ja) 映像符号化装置、映像復号装置、映像符号化方法、映像復号方法及びプログラム
WO2020175967A1 (ko) 영상의 부호화 및 복호화 장치, 및 이에 의한 영상의 부호화 및 복호화 방법
KR20200004749A (ko) 잔차신호 재배열 방법 및 영상 복호화 장치
KR20190054942A (ko) 양자화 방법 및 장치
KR20180080120A (ko) 비디오 신호 처리 방법 및 장치
KR20240144038A (ko) 영상 부호화/복호화 방법, 장치 및 비트스트림을 저장한 기록 매체
KR20240072956A (ko) 영상 부호화/복호화 방법, 장치 및 비트스트림을 저장하는 기록 매체
WO2012169054A1 (ja) 動画像符号化方法、及び装置、動画像復号方法、及び装置

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 20762119

Country of ref document: EP

Kind code of ref document: A1

ENP Entry into the national phase

Ref document number: 20217016261

Country of ref document: KR

Kind code of ref document: A

ENP Entry into the national phase

Ref document number: 2021549642

Country of ref document: JP

Kind code of ref document: A

NENP Non-entry into the national phase

Ref country code: DE

REG Reference to national code

Ref country code: BR

Ref legal event code: B01A

Ref document number: 112021016917

Country of ref document: BR

ENP Entry into the national phase

Ref document number: 2020762119

Country of ref document: EP

Effective date: 20210928

ENP Entry into the national phase

Ref document number: 112021016917

Country of ref document: BR

Kind code of ref document: A2

Effective date: 20210826