RU2787884C1 - Equipment and method for image coding based on filtering - Google Patents

Abstract

FIELD: images encoding.

SUBSTANCE: invention relates to means for encoding images. Image information including residual information is obtained via a bitstream. Reconstructed luminance signal samples and restored chrominance signal samples are generated based on the residual information. The adaptive loop filtering (ALF) coefficients are extracted for the ALF process of the reconstructed chrominance samples. Filtered reconstructed chrominance signal samples are formed based on the reconstructed chrominance signal samples and ALF filter coefficients. Cross-component filter coefficients are then extracted for cross-component filtering. Modified filtered reconstructed samples of chrominance signals are formed based on the restored samples of luminance signals, filtered restored samples of chrominance signals and coefficients of the cross-component filter. The image information includes a sequence parameter set (SPS) and slice header information. The SPS includes an ALF activation flag related to whether the ALF process is activated or not.

EFFECT: improving encoding efficiency.

17 cl, 17 dwg, 30 tbl

Description

State of the art

The technical field to which the invention belongs

[1] The present disclosure relates to equipment and a method for encoding images based on filtering.

Description of the prior art

[2] Recently, the demand for high-quality high-definition image/video, such as 4K or 8K ultra-high definition (UHD) image/video or higher, is growing in various fields of technology. Since the image/video data has high resolution and high quality, the amount of information or bits to be transmitted increases with respect to the existing image/video data, and therefore, the transmission of image data using a medium such as an existing wired/wireless broadband line or an existing storage medium or storing image/video data using an existing storage medium increases transmission costs and storage costs.

[3] In addition, the interest and demand for immersive media such as virtual reality (VR) and artificial reality (AR) content or holograms is growing recently, and broadcasting for an image/video having characteristics different from reality images , such as game images, is enlarged.

[4] Accordingly, a high-performance image/video compression technology is required to efficiently compress, transmit, store, and reproduce high-quality, high-resolution image/video information having various characteristics as described above.

The essence of the invention

[5] The present disclosure provides a method and equipment for improving image/video coding efficiency.

[6] The present disclosure also provides a method and equipment for effectively applying filtering.

[7] The present disclosure also provides a method and equipment for efficient ALF application.

[8] According to an embodiment of the present disclosure, a filtering process may be performed on the recovered chrominance samples based on the recovered luminance samples.

[9] According to an embodiment of the present disclosure, the filtered reconstructed chrominance samples may be modified based on the reconstructed luma samples.

[10] According to an embodiment of the present disclosure, information regarding whether CCALF is available or not may be signaled in the SPS.

[11] According to an embodiment of the present disclosure, information regarding cross-component filter coefficient values may be extracted from ALF data (normal ALF data or CCALF data).

[12] According to an embodiment of the present disclosure, APS identification information including ALF data for extracting slice cross-component filter coefficients may be signaled.

[13] According to an embodiment of the present disclosure, information regarding the filter bank index for CCALF may be signaled in units of CTUs (blocks).

[14] According to an embodiment of the present document, a video/image decoding method by means of decoding equipment is provided.

[15] According to an embodiment of the present document, decoding equipment is provided to perform video/image decoding.

[16] According to an embodiment of the present document, a video/image encoding method is provided by encoding equipment.

[17] According to an embodiment of the present document, encoding equipment is provided to perform video/image encoding.

[18] According to one embodiment of the present document, a computer-readable digital storage medium is provided on which encoded video/image information generated according to the video/image coding method disclosed in at least one embodiment of the present document is stored.

[19] According to an embodiment of the present document, a computer-readable digital storage medium is provided that stores encoded information or encoded video/image information instructing decoding equipment to perform the video/image decoding method disclosed in at least one embodiment. implementation of this document.

Benefits of the Invention

[20] According to an embodiment of the present document, the overall image/video compression efficiency can be improved.

[21] According to an embodiment of the present document, subjective/objective visual quality can be improved by efficient filtering.

[22] According to an embodiment of the present disclosure, the ALF process can be efficiently performed and filtering performance can be improved.

[23] According to an embodiment of the present disclosure, the reconstructed chrominance samples filtered based on the reconstructed luminance samples may be modified to improve the frame quality and coding fidelity of the chrominance component of a decoded frame.

[24] According to an embodiment of the present disclosure, the CCALF process can be efficiently performed.

[25] According to an embodiment of the present disclosure, ALF related information can be efficiently signaled.

[26] According to an embodiment of the present disclosure, CCALF related information can be efficiently signaled.

[27] According to an embodiment of the present disclosure, ALF and/or CCALF may be adaptively applied in units of frames, slices, and/or coding units.

[28] According to an embodiment of the present document, when CCALF is used in a method and equipment for encoding and decoding for a still picture or video, the filter coefficients for CCALF and the on-off transmission method in a unit of blocks or CTU can be improved, thereby improving coding efficiency.

Brief description of the drawings

[29] FIG. 1 schematically shows an example of a video/image coding system that may be applied to embodiments of the present disclosure.

[30] FIG. 2 is a diagram principally illustrating the configuration of video/image coding equipment that may be applied to embodiments of the present document.

[31] FIG. 3 is a diagram principally illustrating the configuration of video/image decoding equipment that may be applied to the embodiments of the present document.

[32] FIG. 4 roughly shows the hierarchical structure for an encoded picture/video.

[33] FIG. 5 is a flowchart illustrating a method for block recovery based on intra prediction in the encoding equipment.

[34] FIG. 6 is a flowchart illustrating a block recovery method based on intra prediction in decoding equipment.

[35] FIG. 7 is a flowchart illustrating a block recovery method based on inter prediction in coding equipment.

[36] FIG. 8 is a flowchart illustrating a block recovery method based on inter prediction in decoding equipment.

[37] FIG. 9 shows an example of an ALF filter shape.

[38] FIG. 10 is a diagram illustrating a virtual boundary applied to a filtering process according to an embodiment of the present document.

[39] FIG. 11 illustrates an example of an ALF process using a virtual boundary according to an embodiment of the present disclosure.

[40] FIG. 12 is a diagram illustrating a cross-component adaptive loop filtering (CCALF) process according to an embodiment of the present disclosure.

[41] FIG. 13 and 14 schematically show an example of a video/image coding method and related components according to the embodiment(s) of the present disclosure.

[42] FIG. 15 and 16 schematically show an example of a method for decoding images/videos and related components according to embodiment(s) of the present disclosure.

[43] FIG. 17 shows an example of a content streaming system to which the embodiments disclosed in the present disclosure may apply.

Detailed description of embodiments

[44] This document may be modified in various forms, and its specific embodiments are described and shown in the drawings. However, the embodiments are not intended to limit the present document. The terms used in the description below are used to simply describe specific embodiments, but are not intended to limit the present document. The expression of the singular includes the expression of the plural as long as they are clearly treated differently. Terms such as "include" and "have" are intended to indicate that there are features, numbers, steps, operations, elements, components, or combinations of the foregoing used in the description below, and as such should be understood , which does not exclude the possibility of the presence or addition of one or more other features, numbers, steps, operations, elements, components, or combinations of the above.

[45] Meanwhile, each configuration in the drawings described herein is shown independently for convenience of description with respect to various characteristic functions, and does not mean that each configuration is implemented as separate hardware or separate software. For example, two or more components for each component may be combined to form one component, or one component may be split into multiple components. Embodiments in which each component is integrated and/or separated are also included within the scope of this document.

[46] Hereinafter, examples of the present embodiment are described in detail with reference to the accompanying drawings. In addition, like reference numerals are used to refer to like elements throughout the drawings, and like descriptions of like elements are omitted.

[47] This document is related to video/image coding. For example, the method/embodiment disclosed in this disclosure is the Universal Video Coding (VVC) standard (ITU-T Recommendation H.266), the next generation video/image coding standard after VVC, or other video coding-related standards ( for example, it may refer to the High Efficiency Video Coding (HEVC) standard (ITU-T Recommendation H.265), the Fundamental Video Coding (EVC) standard, the AVS2 standard, etc.).

[48] The present disclosure presents various embodiments related to video/image coding, and unless otherwise indicated, the embodiments may be combined with each other.

[49] In the present disclosure, video may mean a set of sequences of images according to the passage of time. A frame generally means a unit representing one image in a particular time period, and a slice/tile is a unit constituting a frame when encoded. A slice/tile may include one or more coding tree units (CTUs). One frame may consist of one or more slices/tiles. One frame can include one or more groups of tiles. One group of tiles may include one or more tiles.

[50] A pixel or pel can mean the smallest unit that makes up one frame (or image). In addition, "sample" can be used as a term corresponding to a pixel. A sample can generally represent a pixel or a pixel value, and can only represent a luminance component pixel/pixel value, or only a chrominance component pixel/pixel value. Alternatively, the sample may mean a pixel value in the spatial domain, and when such a pixel value is converted to the frequency domain, it can mean a transform factor in the frequency domain.

[51] The unit may represent a basic image processing unit. The unit may include at least one of a specific area of the frame and information associated with the area. One unit may include one luminance block and two chrominance blocks (eg, Cb, Cr). The unit can be used interchangeably with terms such as block or zone in some cases. In general, an MxN block may include samples (or arrays of samples) or a set (or array) of transform coefficients of M columns and N rows. Alternatively, the sample may mean a pixel value in the spatial domain, and when such a pixel value is converted to the frequency domain, it can mean a transform factor in the frequency domain.

[52] In the present disclosure, the terms "/" and "," are to be interpreted as indicating "and/or". For example, the expression "A/B" can mean "A and/or B". Additionally, "A, B" may mean "A and/or B". Additionally, "A/B/C" may mean "at least one of A, B and/or C". In addition, "A/B/C" may mean "at least one of A, B and/or C".

[53] Additionally, in the document, the term "or" should be interpreted as indicating "and/or". For example, the expression "A or B" may contain 1) only A, 2) only B, and/or 3) both A and B. In other words, the term "or" in this disclosure is to be interpreted as indicating "in addition or alternatively ".

[54] As used herein, "at least one of A and B" can mean "A only", "B only", or "both A and B". In addition, in this specification, the expression "at least one of A or B" or "at least one of A and/or B" means "at least one". It can be interpreted identically to "at least one of A and B".

[55] In addition, as used herein, "at least one of A, B, and C" means "A only", "B only", "C only" or "A, B and C", " any combination of A, B and C". In addition, "at least one of A, B or C" or "at least one of A, B and/or C" can mean "at least one of A, B and C".

[56] In addition, parentheses used herein may mean "for example". In particular, when "prediction (internal prediction)" is indicated, "internal prediction" may be suggested as an example of "prediction". In other words, "prediction" in the present specification is not limited to "intra prediction", and "intra prediction" can be suggested as an example of "prediction". In addition, even when "prediction (ie, intra prediction)" is indicated, "intra prediction" may be suggested as an example of "prediction".

[57] In this specification, technical features that are separately described within the same drawing may be implemented separately or simultaneously.

[58] FIG. 1 illustrates an example of a video/image coding system to which the present document may apply.

[59] Referring to FIG. 1, a video/image coding system may include a source device and a destination device. The source device may transmit the encoded information or video/image data to the receiving device via a digital storage medium or a network in the form of a file or streaming.

[60] The source device may include a video source, encoding equipment, and a transmitter. The receiver may include a receiver, decoding hardware, and a renderer. The encoding equipment may be referred to as "video/image coding equipment", and the decoding equipment may be referred to as "video/image decoding equipment". The transmitter may be included in the encoding equipment. The receiver may be included in the decoding equipment. The renderer may include a display, and the display may be configured as a separate device or an external component.

[61] A video source may acquire a video/image through a process of capturing, synthesizing, or generating a video/image. The video source may include a video/image capture device and/or a video/image generation device. The video/image capture device may include, for example, one or more cameras, video/image archives including previously captured videos/images, and the like. The video/image generation apparatus may include, for example, computers, tablet computers, and smartphones, and may (electronically) generate video/images. For example, the virtual video/image may be generated via a computer or the like. In this case, the video/image capturing process may be replaced by a linked data generation process.

[62] The encoding equipment may encode the input video/image. The encoding equipment may perform a series of procedures such as prediction, transformation, and quantization for compression and encoding efficiency. Encoded data (encoded video/picture information) may be output in the form of a bit stream.

[63] The transmitter may transmit information or coded image/image data output in the form of a bit stream to the receiver of the receiving device via a digital storage medium or a network in the form of a file or streaming. The digital storage medium may include various storage media such as USB, SD, CD, DVD, Blu-ray, HDD, SSD, and the like. The transmitter may include an element for generating a media file via a predetermined file format and may include an element for transmission via a broadcast/communication network. The receiver may receive/retrieve the bitstream and transmit the received bitstream to the decoding equipment.

[64] The decoding equipment can decode the video/image by performing a sequence of procedures such as dequantization, inverse transformation, and prediction corresponding to the operation of the encoding equipment.

[65] The rendering module may prepare a decoded video/image by rendering. The rendered video/image can be displayed through the display.

[66] FIG. 2 is a diagram principally illustrating the configuration of video/image coding equipment to which this document may apply. Hereinafter in this document, what is referred to as "video encoding equipment" may include image encoding equipment.

[67] Referring to FIG. 2, the encoding equipment 200 includes an image segmentation unit 210, a prediction unit 220, a residual processor 230 and an entropy encoder 240, an adder 250, a filter 260, and a memory 270. The prediction unit 220 may include an inter prediction unit 221 and an intra prediction unit 222. forecasting. Residual processor 230 may include a transformer 232, a quantizer 233, a dequantizer 234, and an inverse transformer 235. Residual processor 230 may further include a subtractor 231. Adder 250 may be referred to as a "rebuilder" or "recovered block generator". Image segmentation module 210, prediction module 220, residual processor 230, entropy encoder 240, adder 250, and filter 260 may be configured by at least one hardware component (e.g., chipset or encoder processor) according to an embodiment. In addition, the memory 270 may include a decoded frame buffer (DPB) or may be configured by a digital storage medium. The hardware component may further include a storage device 270 as an internal/external component.

[68] The image segmentation module 210 may segment an input image (either a frame or a movie frame) input to the encoding equipment 200 into one or more processing units. For example, a processing unit may be referred to as a "coding unit (CU)". In this case, a coding unit may be recursively segmented according to a quadtree, binary tree, and ternary tree (QTBTTT) structure from a coding tree unit (CTU) or a largest coding unit (LCU). For example, one coding unit may be segmented into multiple deeper coding units based on a quadtree structure, a binary tree structure, and/or a ternary structure. In this case, for example, a quadtree structure may be applied first, and a binary tree structure and a ternary structure may subsequently be applied. Alternatively, a binary tree structure may be applied first. The encoding procedure according to the present document may be performed based on a final encoding unit that is no longer segmented. In this case, the largest coding unit may be used as the final coding unit based on the coding efficiency according to the characteristics of the images, or if necessary, the coding unit may be recursively segmented into coding units of greater depth, and the coding unit having the optimal size may be used as the final coding units. Here, the encoding procedure may include a prediction, transformation, and restoration procedure, which is described below. As another example, the processing unit may further include a prediction unit (PU) or a transformation unit (TU). In this case, the prediction unit and the transformation unit may be split or segmented from the above final coding unit. The prediction unit may be a selective prediction unit, and the transform unit may be a unit for extracting a transform coefficient and/or a unit for extracting a residual signal from a transform coefficient.

[69] The unit can be used interchangeably with terms such as block or zone in some cases. In general, an MxN block may represent a set of samples or transform coefficients consisting of M columns and N rows. The sample, in general, may represent a pixel or pixel value, may represent only a pixel/pixel value of the luma component, or represent only a pixel/pixel value of the chroma component. Sampling can be used as a term corresponding to one frame (or image) for a pixel or pel.

[70] The subtractor 231 subtracts the prediction signal (predicted block, predictive samples, or array of predictive samples) output from prediction unit 220 from the input image signal (original block, original samples, or array of original samples) to obtain a remainder. A signal (residual block, residual samples, or an array of residual samples) may be generated, and the generated residual signal is provided to transformer 232. Prediction module 220 may perform prediction with respect to a target processing block (hereinafter referred to as the "current block") and generate a predicted a block that includes the predictive samples for the current block. Prediction module 220 may determine whether intra prediction or inter prediction is applied based on the current block or CU. As described below in the description of each prediction mode, the prediction module may generate various prediction-related information, such as prediction mode information, and pass the generated information to the entropy encoder 240. The prediction information may be encoded in the entropy encoder 240 and output in the form of a stream. bits.

[71] The intra prediction module 222 may predict the current block by referring to the samples in the current frame. The samples for the link may be located in the surroundings of the current block, or may be spaced apart according to the prediction mode. In intra prediction, the prediction modes may include a plurality of non-directional modes and a plurality of directional modes. The non-directional mode may include, for example, a DC mode and a planar mode. The directional mode may include, for example, 33 directional prediction modes or 65 directional prediction modes according to the granularity of the prediction direction. However, this is just an example, more or less directional prediction modes may be used depending on the setting. The intra prediction unit 222 may determine the prediction mode applied to the current block by using the prediction mode applied to the neighboring block.

[72] The inter-prediction unit 221 may derive a predicted block for the current block based on a reference block (reference sample array) indicated by a motion vector for the reference frame. Here, in order to reduce the amount of motion information transmitted in the inter-prediction mode, motion information may be predicted in units of blocks, sub-blocks, or samples based on the correlation of motion information between an adjacent block and a current block. The motion information may include a motion vector and a reference frame index. The motion information may further include inter-prediction direction information (L0 prediction, L1 prediction, bi-prediction, etc.). In the case of inter prediction, an adjacent block may include a spatial adjacent block present in the current frame and a temporal adjacent block present in the reference frame. The reference frame including the reference block and the reference frame including the temporal neighbor block may be the same or different. The temporal neighbor block may be referred to as a "collocated reference block", "collocated CU (colCU)" or the like, and a reference frame including the temporal neighbor block may be referred to as a "collocated frame (colPic)". For example, the inter prediction unit 221 may configure a motion information candidate list based on neighboring blocks, and generate information indicating which candidate is used to derive the motion vector and/or the reference frame index of the current block. Inter prediction may be performed based on various prediction modes. For example, in the case of the skip mode and the join mode, the inter prediction unit 221 may use the neighboring block motion information as the current block motion information. In the skip mode, unlike the merge mode, the residual signal may not be transmitted. In the case of a motion vector prediction (MVP) mode, the motion vector of an adjacent block may be used as a motion vector predictor, and the motion vector of the current block may be indicated by signaling a motion vector difference.

[73] The prediction module 220 may generate a prediction signal based on various prediction methods described below. For example, the prediction module may not only apply intra prediction or inter prediction to predict one block, but also apply both intra prediction and inter prediction at the same time. This may be referred to as "combined mutual and intra prediction (CIIP)". In addition, the prediction module may perform intra-block copy (IBC) to predict the block. The IBC prediction mode may be used for image/video coding of game content and the like, such as screen content coding (SCC). IBC essentially performs prediction in the current frame, but may be performed similar to inter-prediction in which the reference block is retrieved in the current frame. Thus, the IBC may use at least one of the inter-prediction technologies described herein.

[74] The prediction signal generated by the inter prediction unit 221 and/or the intra prediction unit 222 may be used to generate a recovered signal or generate a residual signal. Converter 232 may generate transform coefficients by applying a transform technique to the residual signal. For example, the transform technology may include discrete cosine transform (DCT), discrete sine transform (DST), Karhunen-Loeve transform (KLT), graph-based transform (GBT), or conditionally non-linear transform (CNT). Here, GBT means a transformation obtained from a graph when relationship information between pixels is represented by a graph. CNT means a transform generated based on a predictive signal generated using all previously reconstructed pixels. In addition, the transformation process may be applied to square pixel blocks having the same size, or may be applied to blocks having a variable size rather than square.

[75] The quantizer 233 may quantize the transform coefficients and pass them to the entropy encoder 240, and the entropy encoder 240 may encode the quantized signal (information regarding the quantized transform coefficients) and output a bitstream. The information regarding the quantized transform coefficients may be referred to as "residual information". The quantizer 233 may repackage the block quantized transform coefficients into one-dimensional vector form based on the scan order of the coefficients, and generate information about the quantized transform coefficients based on the quantized transform coefficients in one-dimensional vector form. Information regarding transform coefficients may be generated. Entropy encoder 240 may implement various coding methods such as exponential Golomb coding, context adaptive variable length coding (CAVLC), context adaptive binary arithmetic coding (CABAC), and the like, for example. Entropy encoder 240 may encode information needed for video/image reconstruction other than quantized transform coefficients (eg, syntax element values, etc.) together or separately. Encoded information (eg, encoded video/image information) may be transmitted or stored in NAL (Network Abstraction Layer) units in the form of a bitstream. The video/image information may further include information regarding various parameter sets such as an adaptation parameter set (APS), a frame parameter set (PPS), a sequence parameter set (SPS), or a video parameter set (VPS). In addition, the video/image information may further include general restriction information. Herein, signaling/information to be transmitted and/or syntax elements described later in this disclosure may be encoded through the above encoding process and included in a bitstream. The bit stream may be transmitted over a network or may be stored on a digital storage medium. The network may include a broadcast network and/or a communications network, and the digital storage medium may include various storage media such as USB, SD, CD, DVD, Blu-ray, HDD, SSD, and the like. A transmitter (not shown), transmitting a signal output from the entropy encoder 240, and/or a storage module (not shown) storing the signal may be included as an internal/external member of the encoding equipment 200, and alternatively, a transmitter may be included in the entropy encoder 240 .

[76] The quantized transform coefficients output from quantizer 233 may be used to generate a predictive signal. For example, the residual signal (residual block or residual samples) may be recovered by applying dequantization and inverse transform to the quantized transform coefficients via dequantizer 234 and inverse transform 235. Summer 250 adds the recovered residual signal to the predictive signal output from predictor 220 to generate a reconstructed signal (recovered frame, recovered samples, or array of recovered samples). If there is no remainder for a block to be processed, such as in a case in which the skip mode is applied, the predicted block may be used as the reconstructed block. The generated recovered signal may be used to intra-predict the next block to be processed in the current frame, and may be used to inter-predict the next frame through filtering as described below.

[77] Meanwhile, luma signal scaling (LMCS) transformation may be applied during encoding and/or frame reconstruction.

[78] The filter 260 can improve subjective/objective image quality by applying filtering to the reconstructed signal. For example, filter 260 may generate a modified reconstructed frame by applying various filtering methods to the reconstructed frame and store the modified reconstructed frame in memory 270, namely the DPB of memory 270. Various filtering methods may include, for example, filtering to deblock , sampling based adaptive offset (SAO) filtering, adaptive loop filter, bilateral filter, and the like. The filter 260 may generate various filtering-related information and pass the generated information to the entropy encoder 240 as described below in the description of each filtering method. Filtering related information may be encoded by entropy encoder 240 and output in the form of a bitstream.

[79] The modified reconstructed frame transmitted to the memory 270 may be used as a reference frame in the inter prediction module 221 . When inter prediction is applied by the encoding equipment, prediction mismatch between the encoding equipment 200 and the decoding equipment 300 can be eliminated, and encoding efficiency can be improved.

[80] The DPB of the memory 270 may store the modified reconstructed frame for use as a reference frame in the inter prediction module 221 . The memory 270 may store block motion information from which motion information in the current frame is extracted (or encoded) and/or motion information of blocks in the frame that have already been recovered. The stored motion information may be transmitted to the inter-prediction unit 221 and used as spatial neighbor block motion information or temporal neighbor block motion information. The memory 270 may store the recovered samples of the recovered blocks in the current frame and may pass the recovered samples to the intra prediction module 222 .

[81] FIG. 3 is a circuit diagram illustrating the configuration of video/image decoding equipment to which this document may be applied.

[82] Referring to FIG. 3, the decoding equipment 300 may include an entropy decoder 310, a residual processor 320, a prediction unit 330, an adder 340, a filter 350, a memory 360. The prediction unit 330 may include an inter prediction unit 331 and an intra prediction unit 332. Residual processor 320 may include a dequantizer 321 and an inverse converter 321. Entropy decoder 310, residual processor 320, predictor 330, adder 340, and filter 350 may be configured by a hardware component (eg, a chipset or decoder processor) according to an embodiment. In addition, the storage device 360 may include a decoded frame buffer (DPB) or may be configured with a digital storage medium. The hardware component may further include a storage device 360 as an internal/external component.

[83] When a bitstream including video/image information is input, the decoding equipment 300 can reconstruct an image corresponding to the process in which the video/image information is processed in the encoding equipment of FIG. 2. For example, decoding equipment 300 may extract units/blocks based on block segmentation-related information obtained from the bit stream. The decoding equipment 300 may perform decoding using a processing unit used in the encoding equipment. Thus, the decoding processing unit may, for example, be a coding unit, and the coding unit may be segmented according to a quadtree structure, a binary tree structure, and/or a ternary tree structure from the coding tree unit or the largest coding unit. One or more transformation units may be derived from a coding unit. The reconstructed image signal decoded and output by the decoding equipment 300 can be reproduced by the playback equipment.

[84] The decoding equipment 300 may receive a signal output from the encoding equipment of FIG. 2 in the form of a bitstream, and the received signal may be decoded via entropy decoder 310. For example, entropy decoder 310 may parse the bitstream to extract information (eg, video/image information) needed for image recovery (or frame recovery). The video/image information may further include information regarding various parameter sets such as an adaptation parameter set (APS), a frame parameter set (PPS), a sequence parameter set (SPS), or a video parameter set (VPS). In addition, the video/image information may further include general restriction information. The decoding equipment may further decode the frame based on the parameter set information and/or general constraint information. Signaling/receiving information and/or syntax elements described hereinafter may be decoded, may be decoded by a decoding procedure, and obtained from a bitstream. For example, entropy decoder 310 decodes information in the bitstream based on an encoding method such as Exponential Golomb, CAVLC, or CABAC coding and output syntax elements required for image reconstruction and quantized transform coefficient values for the remainder. More specifically, the CABAC entropy decoding method can receive a bin corresponding to each syntax element in the bit stream, determine a context model using the decoding target syntax element information, the decoding information of the decoding target block, or the symbol/bin information decoded in the previous step, and perform arithmetic decoding on the permission element by predicting the occurrence probability of the permission element according to the determined context model, and generating a character corresponding to the value of each syntax element. In this case, the CABAC entropy decoding method can update the context model by using the decoded symbol/bin information for the context model of the next symbol/bin after the context model is determined. Prediction-related information from the information decoded by the entropy decoder 310 may be provided to the prediction unit 330, and information regarding the residue for which entropy decoding is performed in the entropy decoder 310, i. quantized transform coefficients and associated parameter information may be input to the dequantizer 321. In addition, information regarding filtering from the information decoded by the entropy decoder 310 may be provided to the filter 350. Meanwhile, a receiver (not shown) for receiving a signal output from the equipment encoding equipment may be further configured as an internal/external member of the decoding equipment 300, or the receiver may be a component of the entropy decoder 310. Meanwhile, the decoding equipment according to the present document may be referred to as "video/image/frame decoding equipment", and the decoding equipment may be classified into an information decoder (video/image/frame information decoder) and a sample decoder (video/image/frame sample decoder). The information decoder may include an entropy decoder 310, and the selective decoder may include at least one of a dequantizer 321, an inverse transform 322, a predictor 330, an adder 340, a filter 350, and a memory 360.

[85] The dequantizer 321 may dequantize the quantized transform coefficients and output the transform coefficients. The dequantizer 321 may recompose the quantized transform coefficients into a two-dimensional block form. In this case, the reassembly may be performed based on the coefficient scan order performed in the encoding equipment. The dequantizer 321 may perform dequantization on the quantized transform coefficients by using a quantization parameter (eg, quantization step size information) and obtain the transform coefficients.

[86] The inverse transform 322 inversely transforms the transform coefficients to obtain a residual signal (residual block, array of residual samples).

[87] Prediction module 230 may perform prediction for the current block and may generate a predicted block including prediction samples for the current block. The prediction module may determine whether intra prediction or inter prediction is applied to the current block based on the prediction information output from the entropy decoder 310, and may determine a specific intra/inter prediction mode.

[88] The prediction module may generate a prediction signal based on various prediction methods described below. For example, the prediction module may not only apply intra prediction or inter prediction in order to predict one block, but also apply intra prediction and inter prediction at the same time. This may be referred to as "combined mutual and intra prediction (CIIP)". In addition, the prediction module can perform intra-block copy (IBC). In-block copying can be used for image/video encoding of game content and the like, such as on-screen content coding (SCC). The IBC essentially performs prediction in the current frame, but may be performed similar to inter prediction in which the reference block is retrieved in the current frame. Thus, the IBC may use at least one of the inter-prediction technologies described herein.

[89] The intra prediction module 331 may predict the current block by referring to the samples in the current frame. The samples for the link may be located in the surroundings of the current block, or may be spaced apart according to the prediction mode. In intra prediction, the prediction modes may include a plurality of non-directional modes and a plurality of directional modes. The intra prediction unit 331 may determine the prediction mode applied to the current block by using the prediction mode applied to the neighboring block.

[90] The inter prediction unit 332 may derive a predicted block for the current block based on a reference block (reference sample array) indicated by a motion vector for the reference frame. In this case, in order to reduce the amount of motion information transmitted in the inter-prediction mode, the motion information may be predicted in units of blocks, sub-blocks, or samples based on the correlation of the motion information between the adjacent block and the current block. The motion information may include a motion vector and a reference frame index. The motion information may further include inter-prediction direction information (L0 prediction, L1 prediction, bi-prediction, etc.). In the case of inter prediction, an adjacent block may include a spatial adjacent block present in the current frame and a temporal adjacent block present in the reference frame. For example, inter-prediction unit 332 may configure a motion information candidate list based on adjacent blocks, and derive the current block's motion vector and/or reference frame index based on the received candidate selection information. Inter prediction may be performed based on various prediction modes, and the prediction information may include information indicative of the inter prediction mode for the current block.

[91] The adder 340 may generate a reconstructed signal (recovered frame, reconstructed block, reconstructed sample array) by summing the obtained residual signal with a predictive signal (predicted block, predicted sample array) output from prediction module 330. If there is no remainder for the block to be processed, for example, when the skip mode is applied, the predicted block may be used as the reconstructed block.

[92] The adder 340 may be referred to as a "recovery module" or "recovered block generator". The generated recovered signal may be used for intra prediction of the next block to be processed in the current frame, may be output by filtering as described below, or may be used for inter prediction of the next frame.

[93] Meanwhile, luminance chrominance scaling (LMCS) transform may be applied in the frame decoding process.

[94] The filter 350 can improve subjective/objective image quality by applying filtering to the reconstructed signal. For example, filter 350 may generate a modified reconstructed frame by applying various filtering methods to the reconstructed frame and store the modified reconstructed frame in memory 360, namely the DPB of memory 360. Various filtering methods may include, for example, filtering to deblock , filtering based on a sampled adaptive bias, an adaptive loop filter, a bilateral filter, and the like.

[95] The (modified) reconstructed frame stored in the DPB of the storage device 360 may be used as a reference frame in the inter prediction module 332 . The memory 360 may store block motion information from which motion information in the current frame is extracted (or decoded) and/or motion information of blocks in the frame that have already been recovered. The stored motion information may be transmitted to the inter-prediction unit 260 so that it is used as spatial neighbor block motion information or temporal neighbor block motion information. The memory device 360 may store the reconstructed samples of the reconstructed blocks in the current frame and pass the reconstructed samples to the intra prediction module 331 .

[96] In this detailed description, the embodiments described in the prediction module 330, the dequantizer 321, the inverse transformer 322, and the filter 350 of the decoding equipment 300 are the prediction module 220, the dequantizer 234, the inverse transformer 235, and the filter 260, and may be applied identically or in the appropriate way.

[97] As described above, when encoding video, prediction is performed in order to improve compression efficiency. Through this, it is possible to generate a prediction block including prediction samples for the current block, which is a block to be encoded. Here, the prediction block includes prediction samples in the spatial domain (or pixel domain). The predicted block is extracted equally from the encoder and the decoder, and the encoder decodes information (residual information) about the residual between the original block and the predicted block, rather than the original sample value of the original block itself. By signaling to the device, image encoding efficiency can be improved. The decoding equipment can extract a residual block including the residual samples based on the residual information, and generate a reconstructed block including the reconstructed samples by summing the residual block with the predicted block, and generate a reconstructed frame including the reconstructed blocks.

[98] Residual information may be generated through transformation and quantization processes. For example, the encoding equipment may extract the residual block between the original block and the predicted block, and perform a transform process on the residual samples (array of residual samples) included in the residual block to extract transform coefficients, and thereafter, by performing a quantization process on the transform coefficients, extract quantized transform coefficients to signal the residual associated information to the decoding equipment (via the bitstream). Here, the residual information may include location information, transform technology, transform kernel and quantization parameter, quantized transform coefficient value information, and so on. The decoding equipment may perform a dequantization/inverse transform process based on the residual information and extract residual samples (or residual blocks). The decoding equipment may generate a reconstructed frame based on the predicted block and the residual block. The encoding equipment may also dequantize/inversely transform the quantized transform coefficients for a later frame inter-prediction reference to extract the residual block and generate a reconstructed frame based on it.

[99] Herein, at least one of quantization/dequantization and/or transformation/inverse transformation may be omitted. When quantization/dequantization is omitted, the quantized transform coefficient may be referred to as a "transform coefficient". When the transform/inverse transform is omitted, the transform coefficients may be referred to as "coefficients" or "residual coefficients", or may still be referred to as "transform coefficients" for uniformity of expression.

[100] Herein, the quantized transform coefficient and the transform coefficient may be referred to as "transform coefficient" and "scaled transform coefficient", respectively. In this case, the residual information may include information on the transform coefficient(s), and information on the transform coefficient(s) may be signaled via the residual coding syntax. The transform coefficients may be derived based on the residual information (or information regarding the transform coefficient(s)), and the scaled transform coefficients may be derived via an inverse transform (scaling) of the transform coefficients. Residual samples may be derived based on an inverse transform (transform) of the scaled transform coefficients. This may also apply/express in other parts of this document.

[101] The prediction unit of the encoding equipment/decoding equipment can extract a predictive sample by performing inter prediction in units of blocks. Inter-prediction may be a prediction derived in a manner that depends on data elements (eg, sample values or motion information, etc.) of a frame(s) other than the current frame. When inter prediction is applied to a current block, a predicted block (predictive sample array) for the current block may be derived based on a reference block (reference sample array) indicated by a motion vector in a reference frame indicated by a reference frame index. Here, in order to reduce the amount of motion information transmitted in the inter-prediction mode, the motion information of the current block may be predicted in units of blocks, sub-blocks, or samples based on the correlation of the motion information between the adjacent block and the current block. The motion information may include a motion vector and a reference frame index. The motion information may further include inter-prediction type information (L0 prediction, L1 prediction, bi-prediction, etc.). In the case of inter prediction, an adjacent block may include a spatial adjacent block present in the current frame and a temporal adjacent block present in the reference frame. The reference frame including the reference block and the reference frame including the temporal neighbor block may be the same or different. The temporal neighbor block may be referred to as a "collocated reference block", "collocated CU (colCU)" or the like, and a reference frame including the temporal neighbor block may be referred to as a "collocated frame (colPic)". For example, a list of motion information candidates may be configured based on adjacent blocks of the current block, and flag or index information indicating which candidate is selected (used) may be signaled to derive a motion vector and/or a reference frame index. current block. Inter prediction may be performed based on various prediction modes. For example, in the case of the skip mode and the join mode, the motion information of the current block may be identical to the motion information of the adjacent block. In the skip mode, unlike the combine mode, the residual signal may not be transmitted. In the case of a motion vector prediction (MVP) mode, the motion vector of a selected neighboring block may be used as a motion vector predictor, and the motion vector of the current block may be signaled. In this case, the motion vector of the current block may be extracted using the sum of the motion vector predictor and the motion vector difference.

[102] The motion information may include L0 motion information and/or L1 motion information according to the type of mutual prediction (L0 prediction, L1 prediction, bi-prediction, etc.). The motion vector in the L0 direction may be referred to as the "L0 motion vector" or "MVL0", and the motion vector in the L1 direction may be referred to as the "L1 motion vector" or "MVL1". Prediction based on the L0 motion vector may be referred to as "L0 prediction", prediction based on the L1 motion vector may be referred to as "L1 prediction", and prediction based on both the L0 motion vector and the L1 motion vector may be referred to as "biprediction". ". Here, the L0 motion vector may indicate a motion vector associated with the L0 list of reference frames (L0), and the L1 motion vector may indicate a motion vector associated with the L1 list of reference frames (L1). The reference frame list L0 may include frames that are earlier in the output order than the current frame as reference frames, and the reference frame list L1 may include frames that are later in the output order than the current frame. Previous frames may be referred to as "forward (reference) frames", and subsequent frames may be referred to as "reverse (reference) frames". The reference frame list L0 may further include frames that are later in the output order than the current frame as reference frames. In this case, previous frames may be indexed first in the reference frame list L0, and subsequent frames may be indexed later. The reference frame list L1 may further include previous frames in output order relative to the current frame as reference frames. In this case, subsequent frames may be indexed first in the reference frame list 1, and previous frames may be indexed later. The output order may correspond to the order of the numbers in the sequence of frames (POC).

[103] FIG. 4 roughly shows the hierarchical structure for an encoded picture/video.

[104] Referring to FIG. 4, the encoded image/video is divided into a video coding layer (VCL) that handles the process of decoding the image/video and itself, a subsystem that transmits and stores the encoded information, and a NAL (network abstraction layer) responsible for the function and present between the VCL. and subsystem.

[105] In the VCL, VCL data including compressed image data (slice data) is generated, or a parameter set including a frame parameter set (PSP), a sequence parameter set (SPS), and a video parameter set (VPS) may be generated. ), or a Supplementary Enhancement Information (SEI) message additionally required for the picture decoding process.

[106] In the NAL, a NAL unit may be generated by adding header information (NAL unit header) to a Primary Data Byte Sequence (RBSP) generated in the VCL. In this case, RBSP means slice data, parameter set, SEI message, etc. generated in the VCL. The NAL unit header may include NAL unit type information indicated according to the RBSP data included in the corresponding NAL unit.

[107] As shown in the drawing, a NAL unit can be classified into a VCL NAL unit and a non-VCL NAL unit according to the RBSP generated in the VCL. A VCL NAL unit may mean a NAL unit that includes information about an image (slice data) in an image, and a non-VCL NAL unit may mean a NAL unit that includes information (parameter set or SEI message) required for image decoding.

[108] The above VCL NAL unit and non-VCL NAL unit can be transmitted over the network by attaching header information according to the subsystem data standard. For example, the NAL unit may be converted to a data format of a predetermined standard such as H.266/VVC file format, Real Time Transport Protocol (RTP), Transport Stream (TS), etc., and transmitted through various networks.

[109] As described above, the NAL unit may be indicated with the type of the NAL unit according to the RBSP data structure included in the corresponding NAL unit, and information regarding the type of the NAL unit may be stored and signaled in the header of the NAL unit.

[110] For example, the NAL unit may be classified into a VCL type of NAL unit and a non-VCL NAL unit type according to whether or not the NAL unit includes information (slice data) about an image. The VCL type of the NAL unit may be classified according to the nature and type of frames included in the VCL NAL unit, and the type of the non-VCL NAL unit may be classified according to parameter set types.

[111] The following is an example of a NAL unit type specified according to a parameter set type included in a non-VCL NAL unit type.

[112] - APS (Adaptation Parameter Set) NAL Unit: A type for a NAL unit including an APS

[113] - DPS (Decoding Parameter Set) NAL Unit: A type for a NAL unit including a DPS

[114] - VPS (Video Parameter Set) NAL Unit: A type for a NAL unit including a VPS

[115] - SPS (Sequence Parameter Set) NAL Unit: A type for a NAL unit including an SPS

[116] - PPS (Frame Parameter Set) NAL Unit: A type for a NAL unit including a PPS

[117] - PH (Frame Header) NAL Unit: A type for a NAL unit including a PH

[118] The above NAL unit types may have syntax information for the NAL unit type, and the syntax information may be stored and signaled in the NAL unit header. For example, the syntax information may be nal_unit_type and the types of NAL units may be indicated by the value of nal_unit_type.

[119] Meanwhile, as described above, one frame may include a plurality of slices, and one slice may include a slice header and slice data. In this case, one frame header may additionally be added to a plurality of slices (a slice header and a slice dataset) in one frame. The frame header (frame header syntax) may include information/parameters generally applicable to the frame. In this document, the slice may be mixed or replaced by a group of tiles. In addition, in this document, the slice header may be mixed with or replaced with a tile group header.

[120] The slice header (slice header syntax, slice header information) may include information/parameters that may be applied generically to the slice. APS (APS Syntax) or PPS (PPS Syntax) may include information/parameters that may be applied generically to one or more slices or frames. SPS (SPS Syntax) may include information/parameters that may be applied generically to one or more sequences. VPS (VPS syntax) may include information/parameters that may be applied generically to multiple layers. DPS (DPS Syntax) may include information/parameters that may be applied generically to the full video. The DPS may include information/parameters related to coded video sequence (CVS) concatenation. The High Level Syntax (HLS) herein may include at least one of APS Syntax, PPS Syntax, SPS Syntax, VPS Syntax, DPS Syntax, and Slice Header Syntax.

[121] Here, the image/image information encoded from the encoding equipment and signaled to the decoding equipment in the form of a bit stream includes not only segmentation-related information in a frame, intra/inter prediction information, residual information, in-loop filtering information and the like, but also information included in the slice header, information included in the APS, information included in the PPS, information included in the SPS, and/or information included in the VPS.

[122] Meanwhile, in order to compensate for the difference between the original image and the reconstructed image due to an error occurring in a compression encoding process such as quantization, an in-loop filtering process may be performed on the reconstructed samples or reconstructed frames as described above. As described above, in-loop filtering may be performed by an encoding equipment filter and a decoding equipment filter, and a deblocking filter, SAO, and/or an adaptive loop filter (ALF) may be applied. For example, the ALF process may be executed after the deblocking filtering process and/or the SAO process is completed. However, even in this case, the deblocking filtering process and/or the SAO process may be omitted.

[123] Later in this document, a detailed description of frame recovery and filtering is provided. In image/video coding, a reconstructed block may be generated based on intra-prediction/inter-prediction for each block, and a reconstructed frame including the reconstructed blocks may be generated. When the current frame/slice is an I-frame/slice, blocks included in the current frame/slice can only be reconstructed based on intra prediction. Meanwhile, when the current frame/slice is a P or B frame/slice, blocks included in the current frame/slice may be reconstructed based on intra prediction or inter prediction. In this case, intra prediction may be applied to some blocks in the current frame/slice, and inter prediction may be applied to the remaining blocks.

[124] Intra prediction may mean prediction that generates predictive samples for a current block based on reference samples in a frame to which the current block belongs (hereinafter referred to as "current frame"). When intra prediction is applied to the current block, adjacent reference samples to be used for intra prediction of the current block may be extracted. Adjacent reference samples of the current block may include samples adjacent to the left border relative to the current block having size nWxnH and a total of 2xnH samples bordering the bottom left, samples adjacent to the upper border relative to the current block and a total of 2xnW samples , bordering the top right, and one selection bordering the top left, relative to the current block. Alternatively, the adjacent reference samples of the current block may include a plurality of upper neighbor samples and a plurality of left neighbor samples. In addition, the adjacent reference samples of the current block may include a sum of nH samples adjacent to the right boundary with respect to the current block having size nWxnH, a sum of nW samples adjacent to the lower boundary with respect to the current block, and one sample adjacent to the lower right with respect to current block.

[125] However, some adjacent reference samples of the current block may not yet be decoded or may not be available. In this case, the decoder may configure adjacent reference samples to be used for prediction by substituting available samples for samples that are not available. Alternatively, adjacent reference samples to be used for prediction may be configured through interpolation of the available samples.

[126] When adjacent reference samples are extracted, a predictive sample may be derived based on an average or interpolation of adjacent reference samples of the current block and (ii) prediction from adjacent reference samples of the current block. The predictive sample may be derived based on a reference sample present in a particular direction (prediction) relative to the sample. Case (i) may be referred to as "non-directional mode" or "non-angular mode", and case (ii) may be referred to as "directional mode" or "angular mode". In addition, based on the prediction sample of the current block from the neighboring reference samples, the second neighboring sample located in the opposite direction from the prediction direction of the intra prediction mode of the current block and the first neighboring sample are interpolated. A predictive sample can be formed. The above case may be referred to as "linear interpolation intra prediction (LIP)". In addition, the chrominance signal prediction samples may be generated based on the luminance signal samples using a linear model. This case may be referred to as "LM mode". In addition, the temporal prediction sample of the current block may be derived based on the filtered neighboring reference samples and at least one reference sample derived according to the intra prediction mode from the existing neighboring reference samples, i. e. the unfiltered adjacent reference samples and the temporal prediction sample may be added with weighting to derive the current block prediction sample. The above case may be referred to as "position dependent intra prediction (PDPC)". In addition, a reference sample line having the highest prediction accuracy of the adjacent multiple reference sample lines of the current block may be selected to derive a prediction sample by using a reference sample located in the prediction direction on the corresponding line, and then the reference sample line used herein , may be indicated (signaled) to the decoding equipment, thereby performing intra predictive coding. The above case may be referred to as "multiple reference line (MRL) intra prediction" or "MRL intra prediction". In addition, intra prediction may be performed based on the same intra prediction mode by dividing the current block into vertical or horizontal sub-segments, and adjacent reference samples may be extracted and used in a unit of sub-segments. Thus, in this case, the intra prediction mode for the current block is equally applied to the sub-segments, and the performance of the intra prediction can be improved in some cases by extracting and using neighboring reference samples in a unit of sub-segments. Such a prediction method may be referred to as "intra-sub-segment prediction (ISP) or ISP-based". The above intra prediction methods may be referred to as "intra prediction type" apart from the intra prediction mode. The type of intra prediction may be referred to by various terms such as "intra prediction technology" or "additional intra prediction mode". For example, the intra prediction type (or additional intra prediction mode) may include at least one of the above LIP, PDPC, MRL, and ISP. The general intra prediction method except for a specific type of intra prediction such as LIP, PDPC, MRL, or ISP may be referred to as "normal intra prediction type". The normal intra prediction type can generally be applied when a particular type of intra prediction is not applied, and prediction can be performed based on the intra prediction mode described above. Meanwhile, post-filtering can be performed on the predicted sample, drawn as needed.

[127] Specifically, the intra prediction procedure may include an intra prediction mode/type determination step, an adjacent reference sample extraction step, and a prediction sample extraction step based on the intra prediction mode/type. In addition, the post-filtering step may be performed on the predicted sample, drawn as needed.

[128] FIG. 5 is a flowchart illustrating a method for block recovery based on intra prediction in the encoding equipment. The method according to FIG. 5 may include steps S500, S510, S520, S530, and S540.

[129] S500 may be performed by the encoding equipment intra prediction unit 222, and S510-S530 may be performed by the encoding equipment residual processor 230. Specifically, S510 may be performed by the encoding equipment subtractor 231, S520 may be performed by the encoding equipment converter 232 and quantizer 233, and S530 may be performed by the encoding equipment dequantizer 234 and inverse converter 235. At S500, prediction information may be extracted by intra prediction unit 222 and encoded by entropy encoder 240. Residual information may be extracted at S510 and S520 and encoded by entropy encoder 240. Residual information is information regarding residual samples. The residual information may include information regarding quantized transform coefficients for the residual samples. As described above, the residual samples may be extracted as transform coefficients via the coding equipment transform 232, and the transform coefficients may be extracted as quantized transform coefficients via a quantizer 2330. Information regarding the quantized transform coefficients may be encoded by the entropy encoder 240 via a residual encoding procedure.

[130] The encoding equipment performs intra prediction for the current block (S500). The encoding equipment may extract the intra prediction mode for the current block, extract adjacent reference samples of the current block, and generate prediction samples in the current block based on the intra prediction mode and adjacent reference samples. Here, the procedures for determining the intra prediction mode, extracting the peripheral reference samples, and generating the prediction samples may be performed simultaneously, or one procedure may be performed before the other procedure. For example, the encoder intra prediction module 222 may include a prediction mode/type determination module, a reference sample extraction module, and a prediction sample extraction module, and the prediction mode/type determination module may determine the intra prediction mode/type for the current block, the reference sample extraction module samples may extract adjacent reference samples of the current block, and a predictive sample extractor may extract motion samples of the current block. Meanwhile, although not shown when the above-described prediction sample filtering procedure is performed, the intra prediction module 222 may further include a prediction sample filter (not shown). The encoding equipment may determine the mode applied to the current block from the plurality of intra prediction modes. The encoding equipment can compare the RD costs for the intra prediction modes and determine the optimal intra prediction mode for the current block.

[131] Meanwhile, the encoding equipment may perform a filtering procedure on the predictive samples. Filtering predictive samples may be referred to as "post-filtering". Some or all of the prediction samples may be filtered by a prediction sample filtering procedure. In some cases, the filtering procedure for predictive samples may be omitted.

[132] The encoding equipment extracts residual samples for the current block based on the predictive samples (S510). The encoding equipment may compare the predictive samples in the original samples of the current block on a phase basis and extract the residual samples.

[133] The encoding equipment may transform/quantize the residual samples to extract quantized transform coefficients (S520), and thereafter dequantize/inversely transform the quantized transform coefficients again to extract (modified) residual samples (S530). The reason for performing the dequantization/inverse transformation again after the transformation/quantization is to extract residual samples identical to the residual samples extracted from the decoding equipment as described above.

[134] The encoding equipment may generate a reconstructed block including reconstructed samples for the current block based on the predictive samples and the (modified) residual samples (S540). The reconstructed frame for the current frame may be generated based on the reconstructed block.

[135] The encoding equipment can encode image information including prediction information about intra prediction (for example, prediction mode information indicating a prediction mode) and residual information about intra and residual samples, and output the encoded image information in the form of a bitstream, as described. higher. The residual information may include a residual encoding syntax. The encoding equipment may transform/quantize the residual samples so as to extract the quantized transform coefficients. The residual information may include information regarding the quantized transform coefficients.

[136] FIG. 6 is a flowchart illustrating a block recovery method based on intra prediction in decoding equipment. The method according to FIG. 6 may include steps S600, S610, S620, S630, and S640. The decoding equipment may perform an operation corresponding to the operation performed in the encoding equipment.

[137] S600-S620 may be executed by the intra prediction unit 331 of the decoding equipment, and the prediction information of S600 and the residual information of S630 may be obtained from the bitstream by the entropy decoder 310 of the decoding equipment. The decoding hardware residual processor 320 may derive residual samples for the current block based on the residual information. Specifically, the dequantizer 321 of the residual processor 320 extracts the transform coefficients by performing dequantization based on the quantized transform coefficients derived based on the residual information, and the inverse transform 322 of the residual processor can extract the residual samples for the current block by performing an inverse transform on the transform coefficients. S640 may be performed by adder 340 or decode hardware recovery module.

[138] In particular, the decoding equipment can derive the intra prediction mode for the current block based on the received prediction mode information (S600). The decoding equipment may extract the peripheral reference samples of the current block (S610). The decoding equipment generates prediction samples in the current block based on the intra prediction mode and neighboring reference samples (S620). In this case, the image decoding equipment may perform a prediction sample filtering procedure. Filtering predictive samples may be referred to as "post-filtering". Some or all of the prediction samples may be filtered by a prediction sample filtering procedure. In some cases, the filtering procedure for predictive samples may be omitted.

[139] The decoding equipment generates residual samples for the current block based on the received residual information (S630). The decoding equipment may generate reconstructed samples for the current block based on the predictive samples and the residual samples, and extract a reconstructed block including the reconstructed samples (S640). The reconstructed frame for the current frame may be generated based on the reconstructed block.

[140] Here, the decoding equipment intra prediction unit 331 may include a prediction mode/type determination unit, a reference sample extraction unit, and a prediction sample extraction unit, and the prediction mode/type determination unit may determine the intra prediction mode for the current block based on the information of the prediction mode obtained by the entropy decoder 310 of the decoding equipment, the reference sample extractor may extract the peripheral reference samples of the current block, and the prediction sample extractor may extract the prediction samples of the current block. Meanwhile, although not shown, when the prediction sample filtering procedure described above is executed, the intra prediction unit 331 may further include a prediction sample filter (not shown).

[141] The prediction information may include intra prediction mode information and/or intra prediction type information. The intra prediction mode information may include, for example, flag information (eg, Intra_luma_mpm_flag) indicating whether or not the most likely mode (MPM) is applied to the current block, or the remaining mode is applied, and when the MPM is applied to the current block, the mode information The prediction may further include index information (eg, intra_luma_mpm_idx) indicating one of the possible intra prediction modes (MPM candidates). Intra prediction mode candidates (MPM candidates) may include an MPM candidate list or an MPM list. In addition, when MPM is not applied to the current block, the intra prediction mode information may further include remaining mode information (e.g., Intra_luma_mpm_remainder) indicating one of the remaining intra prediction modes except for intra prediction mode options (MPM options) . The decoding equipment may determine the intra prediction mode of the current block based on the intra prediction mode information. A separate MPM list can be configured for the above MIP.

[142] In addition, the intra-prediction type information may be implemented in various forms. For example, the intra prediction type information may include intra prediction type index information indicating one of the intra prediction types. As another example, the intra prediction type information may include at least one of reference sample line information (e.g., Intra_luma_ref_idx) indicating whether or not an MRL applies to the current block, and if so, which reference sample line. line is used, ISP flag information (for example, Intra_subpartitions_mode_flag) indicating whether or not ISP is applied to the current block, ISP type information (for example, Intra_subpartitions_split_flag) indicating the sub-partition splitting type when ISP is applied, flag information indicating whether or no PDCP, or flag information indicating whether or not LIP is applied. In addition, the intra prediction type information may include a MIP flag indicating whether or not MIP is applied to the current block.

[143] The intra prediction mode information and/or the intra prediction type information may be encoded/decoded via the encoding method described in the present disclosure. For example, the intra prediction mode information and/or the intra prediction type information may be coded/decoded by entropy coding (eg, CABAC, CAVLC) based on a truncated binary code (Rice).

[144] The prediction module of the encoding equipment/decoding equipment can extract predictive samples by performing inter-prediction on a block-by-block basis. Inter-prediction may be a prediction derived in a manner that depends on data elements (eg, sample values or motion information) of a frame(s) other than the current frame. When inter prediction is applied to a current block, a predicted block (predictive sample array) for the current block may be derived based on a reference block (reference sample array) indicated by a motion vector in a reference frame indicated by a reference frame index. In this case, in order to reduce the amount of motion information transmitted in the inter-prediction mode, the motion information of the current block may be predicted in units of blocks, sub-blocks, or samples based on the correlation of the motion information between the neighboring block and the current block. The motion information may include a motion vector and a reference frame index. The motion information may further include inter-prediction type information (L0 prediction, L1 prediction, bi-prediction, etc.). When inter prediction is applied, the neighbor block may include a spatial neighbor block that is present in the current frame and a temporal neighbor block that is present in the reference frame. The reference frame including the reference block and the reference frame including the temporal neighbor block may be identical to each other or different from each other. The temporal neighbor block may be referred to as "collocated reference block", "collocated CU (colCU)", etc., and a reference frame including the temporal neighbor block may be referred to as "collocated frame ( colpic)". For example, a list of motion information candidates may be configured based on neighboring blocks of the current block, and flag or index information indicating which candidate is selected (used) in order to derive the motion vector and/or index of the reference frame of the current block may transmitted in service signals. Inter-prediction may be performed based on different prediction modes and, for example, in the case of the skip mode and the join mode, the motion information of the current block may be identical to the motion information of the adjacent block. In the case of the skip mode, the residual signal may not be transmitted, in contrast to the combine mode. In the case of a motion vector prediction (MVP) mode, the motion vector of the selected neighbor block is used as a motion vector predictor, and the motion vector difference may be signaled. In this case, the motion vector of the current block may be extracted using the sum of the motion vector predictor and the motion vector difference.

[145] FIG. 7 is a flowchart illustrating a block recovery method based on inter prediction in coding equipment. The method according to FIG. 7 may include steps S700, S710, S720, S730, and S740.

[146] S700 may be executed by the encoding equipment mutual prediction unit 221, and S710-S730 may be performed by the encoding equipment residual processor 230. Specifically, S710 may be performed by the encoding equipment subtractor 231, S720 may be performed by the encoding equipment converter 232 and quantizer 233, and S730 may be performed by the encoding equipment dequantizer 234 and inverse converter 235. In S700, prediction information may be extracted by inter-prediction unit 221 and encoded by entropy encoder 240. Residual information may be extracted through S710 and S720 and encoded by entropy encoder 240. Residual information is information regarding residual samples. The residual information may include information regarding quantized transform coefficients for the residual samples. As described above, the residual samples may be extracted as transform coefficients via the coding equipment transform 232, and the transform coefficients may be extracted as quantized transform coefficients via the quantizer 233. Information regarding the quantized transform coefficients may be encoded by the entropy encoder 240 via a residual encoding procedure.

[147] The encoding equipment performs inter prediction for the current block (S700). The encoding equipment may extract the inter-prediction mode and motion information of the current block, and generate prediction samples of the current block. Here, the procedures for determining the inter-prediction mode, extracting motion information, and generating prediction samples may be performed simultaneously, or one procedure may be performed before another procedure. For example, the coding equipment inter-prediction unit 221 may include a prediction mode determination unit, a motion information extraction unit, and a prediction sample extraction unit, and the prediction mode determination unit may determine the prediction mode for the current block, the motion information extraction unit may extract the motion information of the current block. , and the prediction sample extractor may extract motion samples of the current block. For example, the coding equipment inter-prediction unit 221 may search for a block similar to the current block in a predetermined area (search area) of reference frames through motion estimation, and may extract a reference block in which the difference with respect to the current block is the minimum or is a predetermined reference value or less. Based on this, a reference frame index indicating a reference frame in which the reference block is located may be extracted, and a motion vector may be extracted based on a position difference between the reference block and the current block. The encoding equipment may determine the mode applied to the current block from among various prediction modes. The encoding equipment can compare the rate-dependent distortion cost (RD) functions for different prediction modes and determine the optimal prediction mode for the current block.

[148] For example, when the skip mode or merge mode is applied to the current block, the encoding equipment may construct a merge candidate list, which is described below, and extract a reference block in which the difference with respect to the current block is minimal or is a predetermined reference value or less , from the reference blocks indicated by the join candidates included in the join candidate list. In this case, the combining candidate associated with the extracted reference block may be selected, and combining index information indicating the selected combining candidate may be generated and signaled to the decoding equipment. The motion information of the current block may be extracted using the motion information of the selected join candidate.

[149] As another example, when the (A)MVP mode is applied to the current block, the encoding equipment constructs an (A)MVP candidate list, which is described below, and uses the motion vector of the selected MVP candidate from among the predictor candidates motion vectors (MVP) included in the list of possible (A)MVP options as the MVP of the current block. In this case, for example, a motion vector indicating a reference block derived by the motion estimation described above can be used as the motion vector of the current block, and an MVP candidate having a motion vector having the smallest difference relative to the motion vector of the current block, of possible MVPs may be the selected MVP candidate. A motion vector difference (MVD), which is a difference obtained by subtracting the MVP from the motion vector of the current block, can be extracted. In this case, information regarding the MVD may be signaled to the decoding equipment. In addition, when the (A)MVP mode is applied, a reference frame index value may be configured as reference frame index information and separately signaled to the decoding equipment.

[150] The encoding equipment may derive residual samples based on the predictive samples (S710). The encoding equipment can extract residual samples by comparing the original samples of the current block with the predictive samples.

[151] The encoding equipment transforms/quantizes the residual samples to extract quantized transform coefficients (S720), and then dequantizes/inversely transforms the quantized transform coefficients again to extract (modified) residual samples (S730). The reason for performing the dequantization/inverse transformation again after the transformation/quantization is to extract residual samples identical to the residual samples extracted from the decoding equipment as described above.

[152] The encoding equipment may generate a reconstructed block including reconstructed samples for the current block based on the predictive samples and the (modified) residual samples (S740). The reconstructed frame for the current frame may be generated based on the reconstructed block.

[153] Although not shown as described above, the encoding equipment 100 can encode video information including prediction information and residual information. The encoding equipment 100 may output encoded image information in the form of a bit stream. The prediction information may be information related to the prediction procedure and may include prediction mode information (eg, skip flag, merge flag, or mode index) and motion information. The motion information may include candidate selection information (eg, merge index, MVP flag, or MVP index), which is information for extracting a motion vector. In addition, information regarding motion information may include the above MVD information and/or reference frame index information. In addition, the information on the motion information may include information indicating whether or not L0 prediction, L1 prediction, or bi-prediction is applied. The residual information is information about the residual samples. The residual information may include information regarding quantized transform coefficients for the residual samples.

[154] The output bit stream may be stored on a (digital) storage medium and transmitted to the decoding equipment, or may be transmitted to the decoding equipment via a network.

[155] FIG. 8 is a flowchart illustrating a block recovery method based on inter prediction in decoding equipment. The method according to FIG. 8 may include steps S800, S810, S820, S830, and S840. The decoding equipment may perform an operation corresponding to the operation performed by the encoding equipment.

[156] S800-S820 may be performed by the decoding equipment mutual prediction unit 332, and the prediction information of S800 and the residual information of S830 may be obtained from the bit stream by the entropy decoder 310 of the decoding equipment. The decoding hardware residual processor 320 may derive residual samples for the current block based on the residual information. In particular, the dequantizer 321 of the residual processor 320 may extract the transform coefficients by performing dequantization based on the quantized transform coefficients derived based on the residual information, and the dequantizer 322 of the residual processor may extract the residual samples for the current block by performing an inverse transform on the transform coefficients. S840 may be performed by adder 340 or decode hardware recovery module.

[157] In particular, the decoding equipment may determine the prediction mode for the current block based on the received prediction information (S800). The decoding equipment can determine which inter-prediction mode is to be applied to the current block based on the prediction mode information in the prediction information.

[158] For example, it may be determined whether or not the merge mode is applied to the current block, or whether or not the (A)MVP mode is determined based on the merge flag. Alternatively, one of the various possible inter-prediction modes may be selected based on the mode index. Possible options for the inter prediction mode may include skip mode, merge mode, and/or (A)MVP mode, or may include various inter prediction modes, which are described below.

[159] The decoding equipment extracts motion information of the current block based on the determined inter-prediction mode. For example, when the skip mode or merge mode is applied to the current block, the decoding equipment may configure a merge candidate list, which is described below, and select one merge candidate from among the merge candidates included in the merge candidate list. The selection may be performed based on the above selection information (combination index). The motion information of the current block may be extracted using the motion information of the selected join candidate. The motion information of the selected join candidate may be used as the motion information of the current block.

[160] As another example, when the (A)MVP mode is applied to the current block, the decoding equipment may construct the (A)MVP candidate list, which is described below, and use the motion vector of the selected MVP candidate from among the candidates motion vector predictors (MVP) included in the list of possible (A)MVP options as the MVP of the current block. The selection may be performed based on the selection information (MVP flag or MVP index) described above. In this case, the MVD of the current block may be derived based on the information regarding the MVD, and the motion vector of the current block may be derived based on the MVP of the current block and the MVD. In addition, the index of the key frame of the current block may be derived based on the information of the index of the key frame. The frame indicated by the reference frame index in the reference frame list for the current block may be retrieved as the reference frame referenced for inter-prediction of the current block.

[161] Meanwhile, as described below, the motion information of the current block can be retrieved without configuring the candidate list. In this case, the motion information of the current block may be extracted according to the procedure disclosed in the prediction mode, which is described below. In this case, the option list configuration as described above may be omitted.

[162] The decoding equipment may generate prediction samples for the current block based on motion information of the current block (S820). In this case, the reference frame may be derived based on the reference frame index of the current block, and the prediction samples of the current block may be derived using the reference block samples indicated by the motion vector of the current block in the reference frame. In this case, as described below, the prediction sample filtering procedure may further be performed on all or some of the prediction samples of the current block in some cases.

[163] For example, the decoding equipment inter-prediction unit 332 may include a prediction mode determination unit, a motion information extraction unit, and a prediction sample extraction unit, and the prediction mode determination unit may determine the prediction mode for the current block based on the received prediction mode information, the unit the motion information extractor may extract the motion information (motion vector and/or reference frame index, etc.) of the current block based on the received information regarding the motion information, and the prediction sample extractor may extract the prediction samples of the current block.

[164] The decoding equipment generates residual samples for the current block based on the received residual information (S830). The decoding equipment may generate reconstructed samples for the current block based on the predictive samples and the residual samples, and may extract a reconstructed block including the reconstructed samples (S840). The reconstructed frame for the current frame may be generated based on the reconstructed block.

[165] Various inter-prediction modes may be used to predict the current block in a frame. For example, various modes such as merge mode, skip mode, motion vector prediction (MVP) mode, affine mode, sub-block based merge mode, and MVD merge mode (MMVD), and the like, may be used. Decoder side motion vector detail mode (DMVR), adaptive motion vector resolution (AMVR) mode, CU layer weighting biprediction (BCW), bidirectional optical flow (BDOF), and the like. can also be used as additional modes in addition or instead. The affine mode may be referred to as "affine motion prediction mode". The MVP mode may be referred to as "Advanced Motion Vector Prediction (AMVP) mode". In this document, some modes and/or motion information candidates retrieved by some modes may be included as one of the motion information candidates of other modes. For example, an HMVP candidate may be added as a merge candidate in merge/skip mode, or may be added as an MVP candidate in MVP mode.

[166] Prediction mode information indicating the inter-prediction mode of the current block may be signaled from the encoding equipment to the decoding equipment. The prediction mode information may be included in the bitstream and received by the decoding equipment. The prediction mode information may include index information indicating one of the plurality of possible modes. Alternatively, the inter-prediction mode may be indicated via hierarchical signaling of flag information. In this case, the prediction mode information may include one or more flags. For example, a skip flag may be signaled to indicate whether or not the skip mode is applied, and if the skip mode is not applied, a merge flag may be signaled to indicate whether or not the merge mode is applied, and if the merge mode is not applied. applied, the need to apply the MVP mode is indicated, or a flag for additional classification may optionally be signaled. The affine mode may be signaled in an independent mode, or may be signaled in a mode dependent on the combining mode or the MVP mode. For example, an affine mode may include an affine join mode and an affine MVP mode.

[167] Meanwhile, information indicating whether or not the list 0 (L0) prediction, list 1 (L1) prediction, or bi-prediction described above is used in the current block (current coding unit) may be transmitted overhead. signals in the current block. The information may be referred to as "motion prediction direction information", "inter prediction direction information", or "inter prediction indicator information", and may be configured/encoded/transmitted in signaling, for example, in the form of an inter_pred_idc syntax element. Thus, the inter_pred_idc syntax element may indicate whether or not the above list 0 (L0) prediction, list 1 (L1) prediction, or bi-prediction for the current block (current coding unit) is used. In this document, for convenience of description, an inter-prediction type (L0 prediction, L1 prediction, or bi-prediction) indicated by the inter_pred_idc syntax element may be indicated as a motion prediction direction. L0 prediction may be represented as pred_L0, L1 prediction as pred_L1, and pair prediction as pred_BI. For example, the following prediction types may be determined according to the value of the inter_pred_idc syntax element.

[168]

Name of - Name

n.a. - N/A

[169] As described above, one frame may include one or more slices. The slice may have one of the types of slices, including an inner (I) slice, a predictive (P) slice, and a bi-predictive (B) slice. The slice type may be indicated based on the slice type information. For blocks in an I-slice, inter prediction may not be used for prediction, and only intra prediction may be used. Of course, even in this case, the original sample value may be encoded and signaled without prediction. Intra-prediction or inter-prediction may be used for blocks in a P-slice, and only uni-prediction may be used when inter-prediction is used. Meanwhile, intra-prediction or inter-prediction may be used for blocks in a B-slice, and up to bi-prediction may be used when inter prediction is used.

[170] L0 and L1 may include reference frames that are previously encoded/decoded prior to the current frame. For example, L0 may include reference frames before and/or after the current frame in POC order, and L1 may include reference frames after and/or before the current frame in POC order. In this case, L0 may be assigned a smaller key frame index with respect to previous key frames in the POC order than with respect to the current key frames, and L1 may be assigned a smaller key frame index with respect to previous key frames in the POC order than with respect to the current frame. In the case of a B-slice, biprediction may be applied, in which case, unidirectional biprediction may be applied, or bidirectional biprediction may be applied. Bidirectional biprediction may be referred to as "true biprediction".

[171] As described above, the residual block (residual samples) may be derived based on the predicted block (predictive samples) derived through prediction in the coding stage, and the residual samples transformed/quantized by the residual information may be generated. The residual information may include information regarding the quantized transform coefficients. The residual information may be included in the video/image information, and the video/image information may be encoded and transmitted to the decoding equipment in the form of a bitstream. The decoding equipment may obtain residual information from the bitstream and may extract residual samples based on the residual information. In particular, the decoding equipment can extract quantized transform coefficients based on the residual information, and can extract residual blocks (residual samples) through a dequantization/inverse transform process.

[172] Meanwhile, at least one process of (inverse) transformation and/or (de)-quantization may be omitted.

[173] Hereinafter, this document describes the in-loop filtering process performed on the reconstructed frame. The modified reconstructed sample, block, frame (or modified filtered sample, block, frame) may be generated through an in-loop filtering process, and the modified (modified and filtered) reconstructed frame may be output as a decoded frame in the decoding equipment, and may also be stored in a decoded frame buffer. or storage device of the encoding equipment/decoding equipment and used as a reference frame in the inter prediction process during encoding/decoding of the frame subsequently. The in-loop filtering process may include a deblocking filtering process, a sampled adaptive offset (SAO) filtering process, and/or an adaptive loop filtering (ALF) process, as described above. In this case, one or more of the deblocking filtering process, the sampled adaptive offset (SAO) filtering process, the adaptive loop filtering (ALF) process, and the bilateral filtering process may be sequentially applied, or all may be sequentially applied. For example, the SAO process may be performed after the deblocking filtering process is applied to the reconstructed frame. Alternatively, for example, the ALF process may be performed after the deblocking filtering process is applied to the reconstructed frame. This can also be done in the coding equipment.

[174] Deblocking filtering is a filtering technique that removes distortion at boundaries between blocks in a reconstructed frame. The deblocking filtering process, for example, may extract a target boundary from a reconstructed frame, determine a boundary intensity (bS) for the target boundary, and perform deblocking filtering for the target boundary based on bS; bS may be determined based on the prediction mode, motion vector difference, whether or not the reference frame is identical, whether or not a non-zero significant coefficient exists, etc., for two blocks adjacent to the target boundary.

[175] SAO is a method for compensating for an offset difference between a reconstructed frame and an original frame based on samples. For example, SAO may be applied based on the type, such as band offset, edge offset, and the like. According to SAO, samples can be classified into different categories according to each SAO type, and a bias value can be added to each sample based on the category. The filtering information for SAO may include information regarding whether or not SAO is applied, SAO type information, and SAO offset value information. SAO may be applied to the reconstructed frame after deblocking filtering is applied.

[176] An adaptive loop filter (ALF) is a technique for filtering a reconstructed frame based on samples based on filter coefficients according to a filter shape. The encoding equipment may determine whether or not to apply the ALF, the ALF shape and/or the ALF filter coefficient, etc. by comparing the reconstructed frame and the original frame, and may signal to the decoding equipment. Thus, the filtering information for the ALF may include information regarding whether or not ALF is applied, ALF filter shape information, ALF filter coefficient information, and the like. ALF may be applied to the reconstructed frame after deblocking filtering is applied.

[177] FIG. 9 shows an example of an ALF filter shape.

[178] FIG. 9, (a) shows the shape of a 7×7 diamond filter, (b) shows the shape of a 5×5 diamond filter. In FIG. 9, Cn in filter form represents the filter coefficient. When n in Cn is identical, this indicates that identical filter coefficients may be assigned. In the present disclosure, the position and/or unit to which filter coefficients are assigned according to the filter form ALF may be referred to as a "filter tap". In this case, one filter coefficient may be assigned to each filter tap, and the arrangement of the filter taps may correspond to the shape of the filter. The filter tap located in the center of the filter shape may be referred to as the "centre filter tap". Identical filter coefficients may be assigned to two filter taps having the same value of n, existing at positions corresponding to each other relative to the center filter tap. For example, in the case of a 7×7 diamond-shaped filter, 25 filter taps are included, and since the filter coefficients C0-C11 are assigned in a centrally symmetrical form, the filter coefficients can be assigned to 25 filter taps using only 13 filter coefficients. Further, for example, in the case of a 5×5 diamond filter, 13 filter taps are included, and since filter coefficients C0-C5 are assigned in a centrally symmetrical form, filter coefficients are assigned to 13 filter taps using only 7 filter coefficients. For example, in order to reduce the data amount of information regarding signaling filter coefficients, 12 of the 13 filter coefficients for a 7×7 diamond filter may be signaled (explicitly) and 1 filter coefficient may (implicitly) be extracted. In addition, for example, 6 out of 7 filter coefficients for a 5×5 diamond filter may be signaled (explicitly) and 1 filter coefficient may be extracted (implicitly).

[179] According to an embodiment of the present disclosure, an ALF parameter used for an ALF process may be signaled via an adaptation parameter set (APS). The ALF parameter may be derived from filter information or ALF data for ALF.

[180] ALF is a type of in-loop filtering technology that can be applied in video/image coding as described above. ALF can be performed using an adaptive Wiener filter. This may serve to minimize the mean square error (MSE) between the original samples and the decoded samples (or reconstructed samples). The high-level design for the ALF tool may include syntax elements available in the SPS and/or in the slice header (or tile group header).

[181] In the example, before filtering for each block of 4x4 luminance signals, geometric transformations such as rotation or diagonal and vertical flipping may be applied to the filter coefficients f(k, l) depending on the gradient values computed for the block, and the corresponding cut-off values c(k, l) in the filter. This is equivalent to applying these transformations to the samples in the filter media zone. The creation of other blocks to which ALF is applied may be similar to the placement of these blocks according to their orientation.

[182] For example, three transformations, diagonal, vertical flip and rotation, can be performed based on the following equations.

[183] Equation 1

Diagonal: f_D(k, l)=f(l, k), c_D(k, l)=c(l, k)

[184] Equation 2

Vertical flip: f_V(k, l)=f(k, K-l-1), c_V(k, l)=c(k, K-l-1)

[185] Equation 3

Rotation: f_R(k, l)=f(K-l-1, k), c_R(k, l)=c(K-l-1, k)

[186] In Equations 1-3, K may be a filter size. 0≤k and 1≤K-1 may represent coefficient coordinates. For example, (0, 0) may represent a left upper corner coordinate, and/or (K-1, K-1) may represent a lower right corner coordinate. The relationship between transformations and four gradients in four directions can be summarized in the following table.

[187]

Tab. 2 Gradient values transformation g _d2 <g _d1 and g _h <g _v Lack of conversion g _d2 <g _d1 and g _v < g _h Diagonal g _d1 <g _d2 and g _h <g _v Vertical flip g _d1 <g _d2 and g _v <g _h Rotation

[188] The ALF filter parameters may be signaled in the APS and the slice header. In one APS, up to 25 luma filter coefficients and cutoff indexes can be signaled. In one APS, up to 8 chrominance filter coefficients and cutoff indexes can be signaled. To reduce the extra number of bits, the filter coefficients of different classifications for the luminance component may be combined. In the slice header, the APS indices (referenced by the current slice) used for the current slice may be signaled.

[189] The clip value indexes decoded from the APS may allow clip values to be determined using the clip value luma table and the clip value chrominance table. These clipping values may depend on the internal bit depth. More specifically, the luminance signal table of the clipping values and the chrominance signal table of the clipping values can be derived based on the following equations.

[190] Equation 4

AlfClipL={round(2^(B(N-n+1)/N)) for n [1...N]}

[191] Equation 5

AlfClipC={round(2^((B-8)+8((N-n))/(N-1))) for n [1...N]}

[192] In the above equations, B may be the internal bit depth, and N may be the number of allowed clipping values (a predetermined number). For example, N might be 4.

[193] In the slice header, up to 7 APS indices may be signaled to indicate the luminance filter sets used for the current slice. The filtering process can additionally be controlled at the CTB level. For example, a flag indicating whether or not ALF is applied to the CTB of luma signals may be signaled. The luminance CTB can select from 16 fixed filter sets and APS filter sets. The filter bank index may be signaled for the luminance CTB to indicate which filter bank is applied. The 16 fixed filter sets can be predefined and hardcoded in the encoder and decoder.

[194] For the chroma component, an APS index may be signaled in a slice header to indicate the chrominance filter sets used for the current slice. At the CTB level, when there are two or more chrominance filter sets in an APS, a filter index may be signaled for each chrominance CTB.

[195] The filter coefficients may be quantized with 128 as the norm. To limit the complexity of the multiplication, bitstream matching may be applied such that the non-center position coefficient values may range from 0 to 28, and/or the coefficient values of the remaining positions may range from -27 to 27-1. The center position coefficient may not be signaled in the bitstream, and may be predetermined (considered) to be 128.

[196] When ALF is available for the current block, each sample R(i, j) may be filtered, and the filtered result R'(i, j) may be expressed by the following equation.

[197] Equation 6

[198] In the above equation, f(k, l) may be the decoded filter coefficients, K(x, y) may be a clipping function, and c(k, l) may be the decoded clipping parameters. For example, the variables k and/or l may range from -L/2 to L/2. Here, L may represent the length of the filter. The clipping function K(x, y)=min (y, max(-y, x)) can correspond to the Clip3(-y, y, x) function.

[199] In an example, to reduce the linear ALF buffer requirement, modified block classification and filtering may be applied to samples adjacent to horizontal CTU boundaries. To this end, virtual boundaries may be defined.

[200] FIG. 10 is a diagram illustrating a virtual boundary applied to a filtering process according to an embodiment of the present document. Fig. 11 illustrates an example of an ALF process using a virtual boundary according to an embodiment of the present disclosure. In the following, FIG. 11 in combination with FIG. 10.

[201] Referring to FIG. 10, the virtual boundary may be a line defined by shifting the horizontal CTU boundary by N samples. In an example, N may be equal to 4 for the luminance signal component, and/or N may be equal to 2 for the chrominance signal component.

[202] FIG. 10, the modified block classification may be applied to the luma component. For a one-dimensional Laplacian gradient computation of a 4×4 block at a virtual boundary, only samples above the virtual boundary can be used. Likewise, to calculate the one-dimensional Laplace gradient of a 4×4 block below the virtual boundary, only samples below the virtual boundary can be used. The quantization of the activity value A can be scaled accordingly to account for the reduced number of samples used in the one-dimensional Laplace gradient calculation.

[203] For the filtering process, a symmetrical padding operation on virtual boundaries can be used for the luminance and chrominance signal components. Referring to FIG. 10, when the filtered sample is located below the virtual boundary, adjacent samples located above the virtual boundary may be padded. Meanwhile, corresponding samples on the other side can also be symmetrically padded.

[204] The process described in connection with FIG. 11 can also be used for slice, brick and/or tile borders when no filter is available on the borders. To classify ALF blocks, only the samples contained in the identical slice, brick, and/or tile can be used, and the activity value can be scaled accordingly. For ALF filtering, symmetrical padding may be applied for each of the horizontal and/or vertical directions relative to the horizontal and/or vertical boundaries.

[205] FIG. 12 is a diagram illustrating a cross-component adaptive loop filtering (CCALF) process according to an embodiment of the present document. The CCALF process may be referred to as a "cross-component filtering process".

[206] In an aspect, the ALF process may include a general ALF process and a CCALF process. Thus, CCALF-process can mean some processes of ALF-process. In another aspect, the filtering process may include a deblocking process, an SAO process, an ALF process, and/or a CCALF process.

[207] CCALF may detail each component of the chrominance signals using sampled luma values. CCALF is controlled by bitstream information (images) that includes (a) information regarding filter coefficients for each chroma component and (b) information regarding a mask that controls the application of filtering to blocks of samples. The filter coefficients may be signaled at the APS, and the block size and mask may be signaled at the slice layer.

[208] Referring to FIG. 12, CCALF may operate by applying a linear diamond filter ((b) of FIG. 12) to the luma channel for each chroma component. The filter coefficients are passed to APS, scaled by a factor of 210, and rounded up for fixed point representation. The application of the filter may be controlled at a variable block size and signaled by a context encoding flag received for the blocks of each sample. The block size along with the CCALF activation flag may be received at the slice level for each chroma component. The block size (for chrominance samples) may be 16x16, 32x32, 64x64, or 128x128.

[209] In the following embodiments, a method is provided for re-filtering or modifying recovered chrominance samples filtered by ALF based on the recovered luma samples.

[210] An embodiment of the present disclosure relates to filtering on-off transmission and filter coefficient transmission in CCALF. As described above, the information (syntax element) in the syntax table disclosed in the present disclosure may be included in image/video information, may be configured/encoded in an encoder, and transmitted to a decoder in the form of a bit stream. The decoding equipment can parse/decode the information (syntax element) in the corresponding syntax table. The decoding equipment may perform a frame/picture/video decoding process (specifically, for example, a CCALF process) based on the decoded information. This applies later in this document to other embodiments.

[211] The following table shows some syntax of slice header information according to an embodiment of the present disclosure.

[212]

[213] The following table shows exemplary semantics for the syntax elements included in the above table.

[214] Tab. four

[215] Referring to the above two tables, when sps_cross_component_alf_enabled_flag is equal to 1 in the slice header, slice_cross_component_alf_cb_enabled_flag parsing may be performed to determine whether or not Cb CCALF is applied in the slice. When slice_cross_component_alf_cb_enabled_flag is 1, CCALF is applied to the corresponding Cb slice, and when slice_cross_component_alf_cb_reuse_temporal_layer_filter is 1, an identical existing temporal layer filter can be reused. When slice_cross_component_alf_cb_enabled_flag is 0, CCALF may be applied using a filter on the corresponding adaptation parameter set (APS) identifier via parsing slice_cross_component_alf_cb_aps_id. Slice_cross_component_alf_cb_log2_control_size_minus4 can mean that CCALF applies the block unit in the Cb slice.

[216] For example, when the value of slice_cross_component_alf_cb_log2_control_size_minus4 is 0, then whether or not CCALF is applied is determined in units of 16×16. When the value of slice_cross_component_alf_cb_log2_control_size_minus4 is 1, then whether or not CCALF is applied is determined in units of 32x32. When the value of slice_cross_component_alf_cb_log2_control_size_minus4 is 2, then whether or not CCALF is applied is determined in units of 64x64. When the value of slice_cross_component_alf_cb_log2_control_size_minus4 is 3, then whether or not CCALF is applied is determined in units of 128×128. In addition, a structure syntax identical to that described above is used for Cr CCALF.

[217] The following table shows an exemplary syntax for ALF data.

[218] Tab. five

[219] The following table shows exemplary semantics for the syntax elements included in the above table.

[220] Tab. 6

[222] Referring to the above two tables, the CCALF syntax elements do not adhere to the existing (common) ALF syntax structure, but are transmitted independently and configured to be applied independently. Thus, CCALF can be applied even when the ALF tool in the SPS is turned off. A new hardware pipeline design is required as CCALF must be able to operate independently of the existing ALF framework. This results in increased hardware implementation costs and increased hardware latency.

[223] In addition, in ALF, whether or not images based on luminance signals and chrominance signals are applied is determined in units of CTU, and the result of the determination is transmitted to the decoder by signaling. However, whether or not the CCALF variable is applied is specified in units of 16×16-128×128, and this application may cause a collision between the existing ALF structure and CCALF. This causes problems in the hardware implementation and at the same time causes an increase in line buffers for various CCALF application variables.

[224] In the present disclosure, the above problems in the CCALF hardware implementation are resolved by integrally applying the CCALF syntactic structure to the ALF syntactic structure.

[225] According to an embodiment of the present disclosure, to determine whether or not CCALF is used, a sequence parameter set (SPS) may include a CCALF-enable flag (sps_ccalf_enable_flag). The CCALF activation flag may be transmitted independently of the ALF activation flag (sps_alf_enabled_flag) to determine whether ALF is used (applied) or not.

[226] The following table shows a portion of an exemplary SPS syntax according to the present embodiment.

[227] Tab. 7

[228] Referring to the above table, CCALF can only be applied when ALF is always running. Thus, only when the ALF enable flag (sps_alf_enabled_flag) is 1, the CCALF enable flag (sps_ccalf_enabled_flag) can be parsed. CCALF and ALF can be combined according to the table above. The CCALF-activation flag may indicate (and may be associated with) whether or not CCALF is available.

[229] The following table shows part of an exemplary syntax for slice headers.

[230] Tab. 8

[231] Referring to the above table, the parsing of the sps_ccalf_enabled_flag can only be performed when the sps_alf_enabled_flag is equal to 1. The syntax elements included in the table can be described based on Table 4. In the example, image information encoded by an encoding device or obtained (received) by a decoder, may include slice header information (slice_header()). Based on determining that the value of the CCALF activation flag (sps_ccalf_flag) is 1, the slice header information includes a first flag (slice_cross_component_alf_cb_enabeld_flag) related to whether or not CCALF is available for the Cb color component of the filtered reconstructed chrominance samples, and a second a flag (slice_cross_component_alf_cr_enabeld_flag) related to whether or not CCALF is available for the chrominance Cr component of the filtered reconstructed chrominance samples.

[232] In an example, based on determining that the value of the first flag (slice_cross_component_alf_cb_enabeld_flag) is 1, the slice header information may include identification information (slice_cross_component_alf_cb_aps_id) of the first APS to extract cross-component filter coefficients for the Cb color component. Based on determining that the value of the second flag (slice_cross_component_alf_cr_enabeld_flag) is 1, the slice header information may include the identification information (slice_cross_component_alf_cr_aps_id) of the second APS to extract the cross-component filter coefficients for the chrominance Cr component.

[233] The following table shows a portion of the SPS syntax according to another example of the present embodiment.

[234] Tab. nine

[235] The following table roughly shows part of the slice header syntax.

[236] Tab. 10

[237] Referring to Table 9, when ChromaArrayType is not equal to 0 and the ALF activation flag (sps_alf_enabled_flag) is 1, the SPS may include a CCALF activation flag (sps_ccalf_enabled_flag). For example, if ChromaArrayType is not equal to 0, the chrominance format may not be monochrome, and the CCALF activation flag may be transmitted through the SPS based on the case in which the chrominance format is not monochrome.

[238] Referring to Table 9, based on the case in which ChromaArrayType is not equal to 0, information regarding CCALF (slice_cross_component_alf_cb_enabled_flag, slice_cross_component_alf_cb_aps_id, slice_cross_component_alf_cr_enabled_flag, slice_cross_component_alf_cr) may be included in slice header information.

[239] In an example, image information encoded by an encoding device or obtained by a decoding device may include an SPS. The SPS may include a first ALF enable flag (sps_alf_enabled_flag) related to whether ALF is available or not. For example, based on determining that the value of the first ALF activation flag is 1, the SPS may include a CCALF activation flag related to whether cross-component filtering is available or not. In another example, if sps_ccalf_enabled_flag is not used and sps_alf_enabled_flag is 1, CCALF may always be applied (sps_ccalf_enabled_flag==1).

[240] The following table shows a portion of the slice header syntax according to another example of this embodiment.

[241] Tab. eleven

[242] Referring to the above table, parsing of the CCALF activation flag (sps_ccalf_enabled_flag) can only be performed when the ALF activation flag (sps_alf_enabled_flag) is equal to 1.

[243] The following table shows exemplary semantics for the syntax elements included in the above table.

[244] Tab. 12

[245] The slice_ccalf_chroma_idc of the above table may be described by the semantics of the table below.

[246] Tab. 13

[247] The following table shows a portion of the slice header syntax according to another example of this embodiment.

[248] Tab. fourteen

[249] The syntax elements included in the table may be described according to Table 12 or Table 13. In addition, when the chrominance signal format is not monochrome, CCALF related information may be included in a slice header.

[250] The following table shows part of the slice header syntax according to another example of this embodiment.

[251] Tab. 15

[252] The following table shows exemplary semantics for the syntax elements included in the above table.

[253] Tab. sixteen

[254] The following table shows a portion of the slice header syntax according to another example of this embodiment. The syntax elements included in the following table may be described according to table 12 or table 13.

[255] Tab. 17

[256] Referring to the above table, whether or not ALF and CCALF based on slice units are applied can be determined immediately via slice_alf_enabled_flag. After parsing slice_alf_chroma_idc, when the first ALF activation flag (sps_alf_enabled_flag) is 1, slice_ccalf_chroma_idc may be parsed.

[257] Referring to the above table, whether or not sps_ccalf_enabeld_flag is equal to 1 in the slice header information may be determined only when slice_alf_enabled_flag is equal to 1. The slice header information may include a second ALF activation flag (slice_alf_enabled_flag) related to whether ALF is available or not. Based on the determination that the value of the second ALF activation flag (slice_alf_enabled_flag) is 1, CCALF may be enabled for the slice.

[258] The following table roughly shows part of the APS syntax. The adaptation_parameter_set_id syntax element may indicate identifier information (identification information) of the APS.

[259] Tab. eighteen

[260] The following table shows an exemplary syntax for ALF data.

[261] Tab. nineteen

[262] Referring to the above two tables, APS may include ALF data (alf_data). An APS including ALF data may be referred to as "ALF APS" ("ALF-type APS"). Thus, an APS type including ALF data may be an ALF type. The APS type may be defined as information regarding an APS type or a syntax element (aps_params_type). The ALF data may include a Cb filter signaling flag (alf_cross_component_cb_filter_signal_flag or alf_cc_cb_filter_signal_flag) related to whether or not cross-component filters for the Cb color component are signaled. The ALF data may include a Cr signaling signaling flag (alf_cross_component_cr_filter_signal_flag or alf_cc_cr_filter_signal_flag) related to whether or not cross-component filters for the Cr color component are signaled.

[263] In an example, based on the transmit flag in the signaling of the Cr filters, the ALF data may include information (alf_cross_component_cr_coeff_abs) about the absolute values of the cross-component filter coefficients for the Cr color component and information about the signs (alf_cross_component_cr_coeff_sign) about the signs of the cross-component coefficients filter for the color Cr component. Based on information regarding the absolute values of the cross-component filter coefficients for the chrominance Cr component and information regarding the signs of the cross-component filter coefficients for the chrominance Cr component, the cross-component filter coefficients for the chrominance Cr component can be extracted.

[264] In an example, the ALF data may include information (alf_cross_component_cb_coeff_abs) regarding the absolute values of the cross-component filter coefficients for the Cb color component and information (alf_cross_component_cb_coeff_sign) regarding the signs of the cross-component filter coefficients for the Cb color component. Based on information regarding the absolute values of the cross-component filter coefficients for the Cb color component and information regarding the signs of the cross-component filter coefficients for the Cb color component, the cross-component filter coefficients for the Cb color component can be extracted.

[265] The following table shows the syntax associated with ALF data according to another example.

[266] Tab. 20

[267] Referring to the above table, after transmitting alf_cross_component_filter_signal_flag first, when alf_cross_component_filter_signal_flag is equal to 1, a transmission flag in Cb/Cr filter signaling may be transmitted. Thus, alf_cross_component_filter_signal_flag integrates Cb/Cr to determine whether or not the CCALF filter coefficients should be transmitted.

[268] The following table shows the syntax associated with ALF data according to another example.

[269] Tab. 21

[270] The following table shows exemplary semantics for the syntax elements included in the above table.

[271] Tab. 22

[273] The following table shows the syntax associated with ALF data according to another example.

[274] Tab. 23

[275] The following table shows exemplary semantics for the syntax elements included in the above table.

[276] Tab. 24

[278] In the above two tables, the exponential Golomb binarization order for parsing the syntax alf_cross_component_cb_coeff_abs[j] and alf_cross_component_cr_coeff_abs[j] may be specified by one of the values 0-9.

[279] Referring to the above two tables, the ALF data may include a Cb filter signaling signaling flag (alf_cross_component_cb_filter_signal_flag or alf_cc_cb_filter_signal_flag) related to whether or not cross-component filters for the Cb color component are signaled. Based on the Cb signaling signaling transmit flag (alf_cross_component_cb_filter_signal_flag), the ALF data may include information (ccalf_cb_num_alt_filters_minus1) related to the number of cross component filters for the Cb color component. Based on information related to the number of cross-component filters for the Cb color component, the ALF data may include information (alf_cross_component_cb_coeff_abs) about the absolute values of the cross-component filter coefficients for the Cb color component and information (alf_cross_component_cr_coeff_sign) about the signs of the cross-component filter coefficients for the Cb color -component. Based on information regarding the absolute values of the cross-component filter coefficients for the Cb color component and information regarding the signs of the cross-component filter coefficients for the Cb color component, the cross-component filter coefficients for the Cb color component can be extracted.

[280] In an example, the ALF data may include a Cr signaling signaling flag (alf_cross_component_cr_filter_signal_flag or alf_cc_cr_filter_signal_flag) related to whether or not cross-component filters for the Cr color component are signaled. Based on the Cr signaling signaling transmit flag (alf_cross_component_cr_filter_signal_flag), the ALF data may include information (ccalf_cr_num_alt_filters_minus1) related to the number of cross component filters for the Cr color component. Based on information related to the number of cross-component filters for the chrominance Cr component, the ALF data may include information (alf_cross_component_cr_coeff_abs) regarding the absolute values of the cross-component filter coefficients for the chrominance Cr component and information (alf_cross_component_cr_coeff_sign) regarding the signs of the cross-component filter coefficients for the chroma Cr -component. Based on information regarding the absolute values of the cross-component filter coefficients for the chrominance Cr component and information regarding the signs of the cross-component filter coefficients for the chrominance Cr component, the cross-component filter coefficients for the chrominance Cr component can be extracted.

[281] The following table shows the syntax regarding the coding tree unit according to an embodiment of the present disclosure.

[282] Tab. 25

[283] The following table shows exemplary semantics for the syntax elements included in the above table.

[284] Tab. 26

[285] The following table shows the syntax of coding tree units according to another example of this embodiment.

[286] Tab. 27

[287] Referring to the above table, CCALF may be applied in CTU units. In an example, the image information may include information (coding_tree_unit()) regarding a coding tree unit. The information regarding the coding tree unit may include information (ccalf_ctb_flag[0) regarding whether or not a cross-component filter is applied to the current Cb color component block, and/or information (ccalf_ctb_flag[1]) regarding whether or not a cross-component filter is applied to to the current block of the color Cr-component. In addition, information regarding a coding tree unit may include information (ccalf_ctb_filter_alt_idx[0) regarding a filterbank index for a cross-component filter applied to the current Cb chroma component block and/or information (ccalf_ctb_filter_alt_idx[1]) regarding a filterbank index for cross-component filter applied to the current Cr-color block. The syntax may be adaptively transmitted according to the syntax of slice_ccalf_enabled_flag and slice_ccalf_chroma_idc.

[288] The following table shows the syntax of coding tree units according to another example of this embodiment.

[289] Tab. 28

[290] The following table shows exemplary semantics for the syntax elements included in the above table.

[291] Tab. 29

[292] The following table shows the syntax of coding tree units according to another example of this embodiment. The syntax elements included in the table below may be described according to table 29.

[293] Tab. thirty

[294] In an example, the image information may include information regarding a coding tree unit (coding_tree_unit()). Information regarding a coding tree unit may include information regarding whether or not a cross-component filter is applied to the current Cb color component block (ccalf_ctb_flag[0)] and/or information (ccalf_ctb_flag[1]) regarding whether or not a cross-component filter is applied to to the current block of the color Cr-component. In addition, information regarding a coding tree unit may include information (ccalf_ctb_filter_alt_idx[0) regarding a filterbank index for a cross-component filter applied to the current Cb chroma component block and/or information (ccalf_ctb_filter_alt_idx[1]) regarding a filterbank index for cross-component filter applied to the current Cr-color block.

[295] FIG. 13 and 14 schematically show an example of a video/image coding method and related components according to the embodiment(s) of the present disclosure.

[296] The method disclosed in FIG. 13 may be performed by the encoding equipment disclosed in FIG. 2 or fig. 14. In particular, for example, S1300-S1330 of FIG. 13 may be performed by the encoding equipment residual processor 230 of FIG. 14, S1340 of FIG. 13 may be performed by the adder 250 of the encoding equipment of FIG. 14, S1350 of FIG. 13 may be performed by the coding equipment filter 260 of FIG. 14 and S1360 of FIG. 13 may be performed by the entropy encoder 240 of the encoding equipment of FIG. 14. In addition, although not shown in FIG. 13, prediction samples or prediction-related information may be retrieved by the prediction module 220 of the encoding equipment in FIG. 13, and the bit stream may be generated from the residual information or prediction-related information by the entropy encoder 240 of the encoding equipment. The method disclosed in FIG. 13 may include the embodiments described above in the present disclosure.

[297] Referring to FIG. 13, the encoding equipment may extract residual samples (S1300). The encoding equipment may derive residual samples for the current block, and residual samples for the current block may be derived based on the original samples and the predictive samples of the current block. In particular, the encoding equipment may extract the prediction samples of the current block based on the prediction mode. In this case, various prediction methods disclosed in the present disclosure may be applied, such as mutual prediction or intra prediction. Residual samples may be derived from the predictive samples and the original samples.

[298] The encoding equipment may extract transform coefficients (S1310). The encoding equipment may derive transform coefficients based on the transform process for the residual samples. For example, the conversion process may include at least one of DCT, DST, GBT, or CNT.

[299] The encoding equipment may extract quantized transform coefficients (S1320). The encoding equipment may derive quantized transform coefficients based on a quantization process for the transform coefficients. The quantized transform coefficients may be in one-dimensional vector form based on the scan order of the coefficients.

[300] The encoding equipment may generate residual information (S1330). The encoding equipment may generate residual information indicative of the quantized transform coefficients. The residual information may be generated through various coding methods such as exponential Golomb code, CAVLC, CABAC, and the like.

[301] The encoding equipment may generate recovered samples (S1340). The encoding equipment may generate reconstructed samples based on the residual information. The reconstructed samples may be generated by summing the residual samples based on the residual information with the predictive sample. In particular, the encoding equipment may perform prediction (intra prediction or inter prediction) for the current block, and may generate reconstructed samples based on the original samples and the prediction samples generated from the prediction.

[302] The reconstructed samples may include reconstructed luminance samples and reconstructed chrominance samples. In particular, the residual samples may include luma residual samples and chrominance residual samples. The residual luminance samples may be generated based on the original luminance samples and the predicted luminance samples. The residual chrominance samples may be generated based on the original chrominance samples and the predicted chrominance samples. The encoding equipment may extract transform coefficients (luminance transform coefficients) for the residual luminance samples and/or transform coefficients (chrominance transform coefficients) for the residual chrominance samples. The quantized transform coefficients may include quantized luminance transform coefficients and/or quantized chrominance transform coefficients.

[303] The encoding equipment may generate ALF related information and/or CCALF related (CC-ALF) information for the recovered samples (S1350). The coding hardware may generate ALF related information for the recovered samples. The encoding hardware extracts the ALF-related parameter that can be used to filter the reconstructed samples and generates the ALF-related information. For example, ALF related information may include ALF related information described above in this disclosure.

[304] The encoding device may encode video/image information (S1360). The image information may include residual information, ALF-related information, and/or CCALF-related information. The encoded video/image information may be output in the form of a bitstream. The bitstream may be transmitted to the decoder via a network or a storage medium.

[305] In an example, the CCALF-related information may include a CCALF activation flag, a flag related to whether or not CCALF is available for the Cb- (or Cr-) color component, a transmission flag in the Cb- (or Cr -) filters related to whether or not cross-component filters for the Cb (or Cr-) color component are signaled, information related to the number of cross-component filters for the Cb- (or Cr-) color component, information regarding the values of the coefficients of the cross-component filter for the Cb (or Cr) color component, information regarding the absolute values of the cross-component filter coefficients for the Cb (or Cr-) color component, information regarding the signs of the cross-component filter coefficients for the Cb (or Cr-) color component, and/or information regarding whether or not a cross-component filter is applied to the current block of the Cb- (or Cr-) color component in the information (coding tree unit syntax) regarding the tree unit wa coding.

[306] The image/video information may include various types of information according to an embodiment of the present document. For example, the image/video information may include information disclosed in at least one of Tables 1-30 described above.

[307] In an embodiment, the image information may include header information and an adaptation parameter set (APS). The header information may include information associated with the APS identifier, including ALF data. For example, cross-component filter coefficients may be derived from ALF data.

[308] In an embodiment, the image information may include a sequence parameter set (SPS). The SPS may include a CCALF activation flag related to whether cross-component filtering is available or not.

[309] In an embodiment, the SPS may include an ALF activation flag (sps_alf_enabled_flag) related to whether ALF is available or not. Based on determining that the value of the ALF activation flag is 1, the SPS may include a CCALF activation flag related to whether cross-component filtering is available or not.

[310] In an embodiment, the image information may include slice header information. The slice header information may include an ALF enable flag (slice_alf_enabled_flag) related to whether ALF is available or not. Based on the determination that the value of the ALF activation flag is 1, it may be determined whether or not the value of the flag activation flag associated with whether CCALF is available or not is 1. In an example, CCALF may be available for the slice based on determining whether that the value of the ALF activation flag is 1.

[311] In an embodiment, the header information (slice header information) may include a first flag related to whether or not CCALF is available for the Cb color component of the filtered recovered chrominance samples, and a second flag related to whether or not no CCLF for the chrominance Cr component of the filtered reconstructed chrominance samples. In another example, based on determining that the value of the ALF enable flag (slice_alf_enabled_flag) is 1, the header information (slice header information) may include a first flag related to whether or not CCALF is available for the Cb color component of the filtered reconstructed chrominance samples, and a second flag related to whether or not CCLF is available for the chrominance Cr component of the filtered reconstructed chrominance samples.

[312] In an embodiment, the image information may include adaptation parameter sets (APS). In an example, the slice header information may include identification information of the first APS (information associated with the identifier of the second APS) for extracting cross-component filter coefficients for the Cb color component of the filtered reconstructed chrominance samples. The slice header information may include identification information (information associated with the second APS identifier) of the second APS for extracting cross-component filter coefficients for the chrominance Cr component of the filtered reconstructed chrominance samples. In another example, based on determining that the value of the first flag is 1, the slice header information may include identification information of the first APS (information regarding the identifier of the second APS) for extracting cross-component filter coefficients for the Cb color component. Based on determining that the value of the second flag is 1, the slice header information may include identification information of the second APS (second APS ID related information) for extracting cross-component filter coefficients for the Cr color component.

[313] In an embodiment, the first ALF data included in the first APS may include a Cb filter signaling signaling flag related to whether cross-component filters for the Cb color component are signaled. Based on the transmit flag in the Cb filter signaling, the first ALF data may include information related to the number of cross-component filters for the Cb color component. Based on information related to the number of cross-component filters for the Cb color component, the first ALF data may include information on the absolute values of the cross-component filter coefficients for the Cb color component and information on the signs of the cross-component filter coefficients for the Cb color component. Based on information regarding information regarding absolute values of the Cb color component cross-filter coefficients and information regarding the signs of the Cb color component cross-component filter coefficients, the cross-component filter coefficients for the Cb color component can be extracted.

[314] In an embodiment, information related to the number of cross-component filters for the Cb color component may be encoded with a zero-order exponential Golomb code (zero EG).

[315] In an embodiment, the second ALF data included in the second APS may include a Cr signaling signaling flag related to whether or not cross-component filters for the Cr color component are signaled. Based on the transmit flag in the Cr signaling, the second ALF data may include information related to the number of cross filters for the Cr color component. Based on information related to the number of cross-component filters for the chrominance Cr component, the second ALF data may include information regarding the absolute values of the cross-component filter coefficients for the chrominance Cr component and information regarding the signs of the cross-component filter coefficients for the chrominance Cr component. Based on the absolute values of the cross-component filter coefficients for the Cr color component and information regarding the signs of the cross-component filter coefficients for the Cr color component, the cross-component filter coefficients for the Cr color component can be extracted.

[316] In an embodiment, information related to the number of cross-component filters for the chrominance Cr component may be encoded with a zero-order exponential Golomb code (zero EG).

[317] In an embodiment, the image information may include information regarding a coding tree unit. Information regarding a coding tree unit may include information regarding whether or not a cross-component filter is applied to the current Cb chroma component block and/or information regarding whether or not a cross-component filter is applied to the current Cr chroma component.

[318] In an embodiment, information regarding a coding tree unit may include information regarding a filterbank index for a cross-component filter applied to the current block of the Cb color component and/or information regarding a filterbank index for a cross-component filter applied to the current block. color Cr-component.

[319] FIG. 15 and 16 schematically show an example of a method for decoding video/images and related components according to embodiment(s) of the present disclosure.

[320] The method disclosed in FIG. 15 may be performed by the decoding equipment illustrated in FIG. 3 or 16. In particular, for example, the S1500 of FIG. 15 may be performed by the entropy decoder 310 of the decoding equipment, S1510 may be performed by the adder 340 of the decoding equipment, and S1520-S1550 may be performed by the filter 350 of the decoding equipment. The method disclosed in FIG. 15 may include the embodiments described above in the present disclosure.

[321] Referring to FIG. 15, the decoding equipment can receive/acquire video/image information (S1500). The video/image information may include residual information. The decoding equipment can receive/receive image/video information via a bit stream. In an example, the video/image information may further include CCAL related information. For example, in an example, the CCALF related information may include a CCALF activation flag, a flag related to whether or not CCALF is available for the Cb- (or Cr-) color component, a transmit flag in the Cb- (or Cr-) signaling. ) filters related to whether or not cross-component filters for the Cb- (or Cr-) color component are signaled, information related to the number of cross-component filters for the Cb- (or Cr-) color component, information regarding the absolute values of the coefficients of the cross-component filter for the Cb- (or Cr-) color component, information regarding the signs of the cross-component filter coefficients for the Cb- (or Cr-) color component, and/or information regarding whether or not the cross-component filter is applied to the current Cb- (or Cr-) color block. )component in the information (syntax of coding tree units) relative to the coding tree unit.

[322] The image/video information may include various types of information according to an embodiment of the present document. For example, the image/video information may include information disclosed in at least one of Tables 1-30 described above.

[323] The decoding equipment may extract the quantized transform coefficients. The decoding equipment may derive quantized transform coefficients based on the residual information. The quantized transform coefficients may be in one-dimensional vector form based on the scan order of the coefficients. The quantized transform coefficients may include quantized luminance transform coefficients and/or quantized chrominance transform coefficients.

[324] The decoding equipment may extract transform coefficients. The decoding equipment may derive transform coefficients based on a dequantization process for the quantized transform coefficients. The decoding equipment can extract luminance transform coefficients through dequantization based on the quantized luminance transform coefficients. The decoding equipment can extract chrominance transform coefficients through dequantization based on the quantized chrominance transform coefficients.

[325] The decoding equipment may generate/extract residual samples. The decoding equipment may derive residual samples based on an inverse transform process for the transform coefficients. The decoding equipment may extract the residual luma samples through an inverse transform process based on the luminance transform coefficients. The decoding equipment can extract the residual chrominance samples through an inverse transform process based on the chrominance transform coefficients.

[326] The decoding equipment may generate/extract recovered luminance samples and/or recovered chrominance samples (S1510). The decoding equipment may generate reconstructed luma samples and/or reconstructed chrominance samples based on the residual information. The decoding hardware may generate reconstructed samples based on the residual information. The reconstructed samples may include reconstructed luma samples and/or reconstructed chrominance samples. The luma component of the reconstructed samples may correspond to the reconstructed luminance samples, and the chroma component of the reconstructed samples may correspond to the reconstructed chrominance samples. The decoding equipment may generate predicted luminance samples and/or predicted chrominance samples through a prediction process. The decoding equipment may generate reconstructed luma samples based on the predicted luminance samples and the residual luma samples. The decoding equipment may generate reconstructed chrominance samples based on the predicted chrominance samples and the residual chrominance samples.

[327] The decoding equipment may extract the ALF filter coefficients for the recovered chrominance samples ALF process (S1520). In addition, the decoding hardware can extract the ALF filter coefficients for the ALF process of the reconstructed luminance samples. The ALF filter coefficients may be derived based on the ALF parameters included in the ALF data in the APS.

[328] The decoding equipment may generate filtered reconstructed chrominance samples (S1530). The decoding hardware may generate filtered reconstructed samples based on the reconstructed chrominance samples and ALF filter coefficients.

[329] The decoding equipment may extract cross-component filter coefficients for cross-component filtering (S1540). The cross-component filter coefficients may be derived based on the CCALF-related information in the ALF data included in the above APS, and the identification information of the corresponding APS may be included in (may be signaled through) the slice header.

[330] The decoding equipment may generate modified filtered chrominance reconstructed samples (S1550). The decoding equipment may generate modified and filtered chrominance reconstructed samples based on the luminance reconstructed samples, filtered chrominance reconstructed samples, and cross-component filter coefficients. In an example, the decoding hardware may extract the difference between the two samples from the reconstructed luminance samples and multiply the difference by one filter coefficient from the cross-component filter coefficients. Based on the result of the multiplication and the filtered chrominance reconstructed samples, the decoding equipment may generate modified filtered chrominance reconstructed samples. For example, the decoding hardware may generate modified filtered chrominance reconstructed samples based on the sum of the product and one of the filtered chrominance reconstructed samples.

[331] In an embodiment, the image information may include header information and an adaptation parameter set (APS). The header information may include information associated with the APS identifier, including ALF data. For example, cross-component filter coefficients may be derived from ALF data.

[332] In an embodiment, the image information may include a sequence parameter set (SPS). The SPS may include a CCALF activation flag related to whether cross-component filtering is available or not.

[333] In an embodiment, the SPS may include an ALF activation flag (sps_alf_enabled_flag) related to whether ALF is available or not. Based on determining that the value of the ALF activation flag is 1, the SPS may include a CCALF activation flag related to whether cross-component filtering is available or not.

[334] In an embodiment, the image information may include slice header information. The slice header information may include an ALF enable flag (slice_alf_enabled_flag) related to whether ALF is available or not. Based on the determination that the value of the ALF activation flag is 1, it may be determined whether or not the value of the CCALF activation flag is 1. In an example, CCALF may be available for slice based on the determination that the value of the ALF activation flag is 1 .

[335] In an embodiment, the header information (slice header information) may include a first flag related to whether or not CCALF is available for the color Cb component of the filtered recovered chrominance samples, and a second flag related to whether or not no CCLF for the chrominance Cr component of the filtered reconstructed chrominance samples. In another example, based on determining that the value of the ALF enable flag (slice_alf_enabled_flag) is 1, the header information (slice header information) may include a first flag related to whether or not CCALF is available for the Cb color component of the filtered reconstructed chrominance samples, and a second flag related to whether or not CCLF is available for the chrominance Cr component of the filtered reconstructed chrominance samples.

[336] In an embodiment, the image information may include adaptation parameter sets (APS). In an example, the slice header information may include identification information of the first APS (information associated with the identifier of the second APS) for extracting cross-component filter coefficients for the Cb color component of the filtered reconstructed chrominance samples. The slice header information may include identification information (information associated with the second APS identifier) of the second APS for extracting cross-component filter coefficients for the chrominance Cr component of the filtered reconstructed chrominance samples. In another example, based on determining that the value of the first flag is 1, the slice header information may include identification information of the first APS (information regarding the identifier of the second APS) for extracting cross-component filter coefficients for the Cb color component. Based on determining that the value of the second flag is 1, the slice header information may include identification information of the second APS (second APS ID related information) for extracting cross-component filter coefficients for the Cr color component.

[337] In an embodiment, the first ALF data included in the first APS may include a Cb filter signaling signaling flag related to whether cross-component filters for the Cb color component are signaled. Based on the transmit flag in the Cb filter signaling, the first ALF data may include information related to the number of cross-component filters for the Cb color component. Based on information related to the number of cross-component filters for the Cb color component, the first ALF data may include information on the absolute values of the cross-component filter coefficients for the Cb color component and information on the signs of the cross-component filter coefficients for the Cb color component. Based on information regarding information regarding absolute values of the Cb color component cross-filter coefficients and information regarding the signs of the Cb color component cross-component filter coefficients, the cross-component filter coefficients for the Cb color component can be extracted.

[338] In an embodiment, information related to the number of cross-component filters for the Cb color component may be encoded with a zero-order exponential Golomb code (zero EG).

[339] In an embodiment, the second ALF data included in the second APS may include a Cr signaling signaling flag related to whether or not cross-component filters for the Cr color component are signaled. Based on the transmit flag in the Cr signaling, the second ALF data may include information related to the number of cross filters for the Cr color component. Based on information related to the number of cross-component filters for the chrominance Cr component, the second ALF data may include information regarding the absolute values of the cross-component filter coefficients for the chrominance Cr component and information regarding the signs of the cross-component filter coefficients for the chrominance Cr component. Based on the absolute values of the cross-component filter coefficients for the Cr color component and information regarding the signs of the cross-component filter coefficients for the Cr color component, the cross-component filter coefficients for the Cr color component can be extracted.

[340] In an embodiment, information related to the number of cross-component filters for the chrominance Cr component may be encoded with a zero-order exponential Golomb code (zero EG).

[341] In an embodiment, the image information may include information regarding a coding tree unit. Information regarding a coding tree unit may include information regarding whether or not a cross-component filter is applied to the current Cb chroma component block and/or information regarding whether or not a cross-component filter is applied to the current Cr chroma component.

[342] In an embodiment, information regarding a coding tree unit may include information regarding a filterbank index for a cross-component filter applied to the current block of the Cb color component and/or information regarding a filterbank index for a cross-component filter applied to the current block. color Cr-component.

[343] When there is a residual sample for the current block, the decoding equipment may receive information regarding the residual for the current block. The residual information may include transform coefficients for the residual samples. The decoding hardware may derive residual samples (or an array of residual samples) for the current block based on the residual information. In particular, the decoding equipment may derive quantized transform coefficients based on the residual information. The quantized transform coefficients may be in one-dimensional vector form based on the scan order of the coefficients. The decoding equipment may derive transform coefficients based on a dequantization process for the quantized transform coefficients. The decoding hardware may extract residual samples based on the transform coefficients.

[344] The decoding equipment may generate reconstructed samples based on the (mutual) predictive samples and residual samples, and may extract a reconstructed block or a reconstructed frame based on the reconstructed samples. More specifically, the decoding hardware may generate reconstructed samples based on the sum of (inner) predictive samples and residual samples. Thereafter, as described above, the decoding equipment may apply an in-loop filtering process, such as a deblocking filtering process and/or an SAO process, to the reconstructed frame so as to improve the subjective/objective quality of the frames, if necessary.

[345] For example, the decoding equipment can obtain image information including all or part of the above information (or syntax elements) by decoding the bit stream or encoded information. In addition, the bitstream information or encoded information may be stored in a computer-readable storage medium and may cause the above decoding method to be performed.

[346] In the above embodiment, the methods are described based on a flowchart having a sequence of steps or blocks. The present disclosure is not limited to the order of the above steps or blocks. Some steps or blocks may occur simultaneously or in a different order than other steps or blocks, as described above. Additionally, those skilled in the art should understand that the steps shown in the above flowchart are not exhaustive, and other steps may be included, or one or more steps in the flowchart may be removed without affecting the scope of this disclosure.

[347] The method according to the above embodiments of the present document may be implemented in software form, and the encoding equipment and/or decoding equipment according to the present document, for example, may be included in equipment that performs image processing for a TV, computer, smartphone, set-top box, display devices, etc.

[348] When the embodiments herein are implemented in software, the above method may be implemented as a module (process, function, etc.) that performs the above function. The module may be stored in a storage device and executed by a processor. The storage device may be internal or external to the processor and may be connected to the processor through various known means. The processor may include an application specific integrated circuit (ASIC), other chipsets, logic circuits, and/or data processing devices. The storage device may include Read Only Memory (ROM), Random Access Memory (RAM), flash memory, memory cards, storage media, and/or other data storage devices. Thus, the embodiments described herein may be implemented by implementation on a processor, microprocessor, controller, or chip. For example, the functional modules shown in each figure may be implemented and executed on a computer, processor, microprocessor, controller, or chip. In this case, information regarding the instructions or algorithm to be implemented may be stored in the digital storage medium.

[349] In addition, the decoding equipment and encoding equipment to which the present disclosure applies may be included in multimedia broadcast transceiver equipment, a mobile communication terminal, a home theater system video equipment, a digital cinema system video equipment, a surveillance camera, a video chat equipment, real-time communication equipment such as video communication, mobile streaming equipment, storage media, video camera recording, VoD service equipment, video over network (OTT) equipment, Internet streaming service equipment, 3D video equipment, teleconferencing video equipment communications, mobile subscriber unit (i.e. vehicle subscriber unit, aircraft subscriber unit, marine vessel subscriber unit, etc.) and medical video equipment, and can be used to o to process video and data signals. For example, video over network (OTT) equipment may include a game console, Blu-ray player, Internet access TV, home theater system, smartphone, tablet PC, digital video recorder (DVR), and the like.

[350] Additionally, the processing method to which the present document applies may be formed in the form of a program to be executed by a computer, and may be stored in a computer-readable recording medium. Multimedia data having a data structure according to the present disclosure may also be stored on computer-readable recording media. Computer-readable recording media includes all types of data storage devices that store data readable by a computer system. Computer-readable recording media, for example, may include BD, Universal Serial Bus (USB), ROM, PROM, EPROM, EEPROM, RAM, CD-ROM, magnetic tape, floppy disk, and optical storage. In addition, computer-readable recording media includes media implemented in the form of carrier waves (ie, as transmission over the Internet). In addition, the bit stream generated by the encoding method may be stored in a computer-readable recording medium, or may be transmitted over wired/wireless communication networks.

[351] In addition, embodiments of the present document may be implemented with a computer program product according to program codes, and the program codes may be executed on a computer through the embodiments of this document. The program codes may be stored on a medium that can be read by a computer.

[352] FIG. 17 shows an example of a content streaming system to which the embodiments disclosed herein may be applied.

[353] Referring to FIG. 17, the content streaming system to which the embodiment(s) of the present document is applied may mainly include an encoding server, a streaming server, a web server, a media storage, a user device, and a media input device.

[354] The encoding server compresses content input from media input devices such as a smartphone, camera, camcorder, etc. into digital data to generate a bit stream and transmit the bit stream to the stream server. As another example, when media input devices such as smartphones, cameras, camcorders, etc. In order to generate the bitstream directly, the encoding server may be omitted.

[355] The bit stream may be generated by the encoding method or the bit stream generation method to which the embodiment(s) of the present disclosure applies, and the stream server may temporarily store the bit stream in the process of transmitting or receiving the bit stream.

[356] The streaming server transmits media data to the user device based on the user's request through the web server, and the web server serves as a medium for informing the user about the service. When a user requests a desired service from a web server, the web server delivers it to the streaming server, and the streaming server transmits media data to the user. In this case, the content streaming system may include a separate control server. In this case, the control server serves to manage the command/response between devices in the content streaming system.

[357] The streaming server may receive content from a media store and/or an encoding server. For example, when content is received from an encoding server, the content may be received in real time. In this case, in order to provide a smooth streaming service, the streaming server may keep the bitstream for a predetermined time.

[358] Examples of a user device may include a mobile phone, smartphone, laptop computer, digital broadcast terminal, personal digital assistant (PDA), portable media player (PMP), navigation device, stylus tablet PC, tablet PCs, ultrabooks, wearable devices (e.g., smart watches, smart glasses, head-mounted displays), digital TVs, desktop computers, digital signage system, etc. Each server in the content streaming system may operate as a distributed server, in which case the data received from each server may be distributed.

[359] Each server in the content streaming system may operate as a distributed server, in which case the data received from each server may be distributed.

[360] The claims described herein can be combined in various ways. For example, the technical features of the claims for the method of this document may be combined and implemented as an equipment, and the technical features of the claims for the equipment of this document may be combined and implemented as a method. In addition, the technical features of the method claim of this document and the technical features of the equipment claim can be combined to be implemented as equipment, and the technical features of the method claim of this document and the technical features of the equipment claim can be combined and implemented. as a way.

Claims (108)

1. A method for decoding images carried out by means of decoding equipment, the method comprising the steps of: obtaining image information including residual information via the bit stream; generating recovered luminance samples and recovered chrominance samples based on the residual information; extracting adaptive loop filtering (ALF) coefficients for the ALF process of the reconstructed chrominance samples; generating filtered reconstructed chrominance samples based on the reconstructed chrominance samples and ALF filter coefficients; extracting cross-component filter coefficients for cross-component filtering; and generating modified filtered reconstructed chroma samples based on the reconstructed luminance samples, filtered reconstructed chrominance samples, and cross-component filter coefficients, wherein the image information includes a sequence parameter set (SPS) and slice header information, wherein the SPS includes an ALF activation flag related to whether the ALF process is activated or not, wherein, based on determining that the value of the ALF activation flag is 1, the SPS includes a cross-component adaptive loop filtering (CCALF) activation flag related to whether or not cross-component filtering is available, wherein, based on determining that the value of the ALF activation flag in the SPS is 1, the slice header information includes an ALF activation flag related to whether ALF is activated or not, wherein, based on determining that the value of the ALF activation flag included in the slice header information is 1 and the value of the CCALF activation flag included in the SPS is 1, the slice header information includes information as to whether or not CCALF for filtered reconstructed chrominance samples, and wherein, based on the information value of whether or not CCALF for filtered chrominance reconstructed samples is enabled or not, equal to 1, slice header information includes identification information (ID) of an adaptation parameter set (APS) associated with CCALF for filtered chrominance reconstructed samples. . 2. The method of claim 1, wherein the slice header information includes a first flag related to whether or not CCALF is available for the Cb color component of the filtered reconstructed chrominance samples, and a second flag related to whether or not CCALF is available. for the chrominance Cr component of the filtered reconstructed chrominance samples. 3. The method according to p. 2, wherein, based on the value of the first flag equal to 1, the slice header information includes identification information of the first APS for extracting cross-component filter coefficients for the Cb color component of the filtered recovered chrominance samples, and wherein, based on the second flag value of 1, the slice header information includes identification information of the second APS for extracting cross-component filter coefficients for the chrominance Cr component of the filtered reconstructed chrominance samples. 4. The method according to claim 3, in which: the first ALF data included in the first APS includes a Cb filter signaling signaling flag related to whether or not cross-component filters for the Cb color component are signaled, the first ALF data includes information related to the number of cross-component filters for the Cb color component based on the transmission flag in the Cb filter signaling, the first ALF data includes information on the absolute values of the cross-component filter coefficients for the Cb color component and information on the signs of the cross-component filter coefficients for the Cb color component, based on information related to the number of cross-component filters for the Cb color component, and the cross-component filter coefficients for the Cb color component are derived based on information regarding the absolute values of the cross-component filter coefficients for the Cb color component and information regarding the signs of the cross-component filter coefficients for the Cb color component. 5. The method according to claim 3, in which: the second ALF data included in the second APS includes a Cr signaling signaling flag related to whether cross-component filters for the Cr color component are signaled or not, the second ALF data includes information related to the number of cross-component filters for the Cr color component based on the transmission flag in the Cr filter signaling, the second ALF data includes information on the absolute values of the cross-filter coefficients for the chrominance Cr component and information on the signs of the cross-filter coefficients for the chrominance Cr component, based on information related to the number of cross-filter coefficients for the chrominance Cr component, and the cross-component filter coefficients for the chrominance Cr component are derived based on information regarding the absolute values of the cross-component filter coefficients for the chrominance Cr component and information regarding the signs of the cross-component filter coefficients for the chrominance Cr component. 6. The method according to claim 5, in which information regarding the number of cross-component filters for the Cr-color component is encoded with a zero-order exponential Golomb code (zero EG). 7. The method according to claim 1, in which: the image information includes information regarding the unit of the coding tree and information regarding the coding tree unit includes: - information as to whether or not a cross-component filter is applied to the current block of the Cb color component; and - information as to whether or not a cross-component filter is applied to the current Cr-color block. 8. The method according to claim 1, in which: the image information includes information regarding the unit of the coding tree and information regarding the coding tree unit includes: - information regarding the index of the filter bank for the cross-component filter applied to the current block of the Cb color component; and - information regarding the filter bank index for the cross-component filter applied to the current Cr-color block. 9. An image encoding method carried out by encoding equipment, the method comprising the steps of: extracting residual samples for the current block; extracting transform coefficients based on the transform process for the residual samples; extracting quantized transform coefficients based on a quantization process for the transform coefficients; generating residual information indicative of the quantized transform coefficients; form recovered samples based on the residual information; generating adaptive loop filtering (ALF) related information and cross-component ALF (CCALF) related information for the reconstructed samples; and encoding image information including residual information, ALF-related information, and CCALF-related information, wherein the reconstructed samples include reconstructed luminance samples and reconstructed chrominance samples, wherein the image encoding method further comprises the steps of: extracting the coefficients of the ALF filter for the ALF process of the reconstructed chrominance samples; generating filtered reconstructed chrominance samples based on the reconstructed chrominance samples and ALF filter coefficients; extracting cross-component filter coefficients for cross-component filtering; and generating modified filtered reconstructed chroma samples based on the reconstructed luminance samples, filtered reconstructed chrominance samples, and cross-component filter coefficients, wherein the image information includes a sequence parameter set (SPS) and slice header information, wherein the SPS includes an ALF activation flag related to whether the ALF process is activated or not, wherein, based on determining that the value of the ALF activation flag is 1, the SPS includes a cross-component adaptive loop filtering (CCALF) activation flag related to whether or not cross-component filtering is available, wherein, based on determining that the value of the ALF activation flag in the SPS is 1, the slice header information includes an ALF activation flag related to whether ALF is activated or not, wherein, based on determining that the value of the ALF activation flag included in the slice header information is 1 and the value of the CCALF activation flag included in the SPS is 1, the slice header information includes information as to whether or not CCALF for filtered reconstructed chrominance samples, and wherein, based on the information value of whether or not CCALF for filtered chrominance reconstructed samples is enabled or not, equal to 1, slice header information includes identification information (ID) of an adaptation parameter set (APS) associated with CCALF for filtered chrominance reconstructed samples. . 10. The method of claim 9, wherein the slice header information includes a first flag related to whether or not CCALF is available for the Cb color component of the filtered reconstructed chrominance samples, and a second flag related to whether or not CCALF is available. for the chrominance Cr component of the filtered reconstructed chrominance samples. 11. The method of claim 10, wherein, based on a first flag value of 1, the slice header information includes identification information of the first APS for extracting cross-component filter coefficients for the Cb color component of the filtered recovered chrominance samples, and wherein, based on the second flag value of 1, the slice header information includes identification information of the second APS for extracting cross-component filter coefficients for the chrominance Cr component of the filtered reconstructed chrominance samples. 12. The method according to claim 11, in which: the first ALF data included in the first APS includes a Cb filter signaling signaling flag related to whether or not cross-component filters for the Cb color component are signaled, the first ALF data includes information related to the number of cross-component filters for the Cb color component based on the transmission flag in the Cb filter signaling, the first ALF data includes information on the absolute values of the cross-component filter coefficients for the Cb color component and information on the signs of the cross-component filter coefficients for the Cb color component, based on information related to the number of cross-component filters for the Cb color component, and the cross-component filter coefficients for the Cb color component are derived based on information regarding the absolute values of the cross-component filter coefficients for the Cb color component and information regarding the signs of the cross-component filter coefficients for the Cb color component. 13. The method according to claim 12, in which information regarding the number of cross-component filters for the Cr-color component is encoded with a zero-order exponential Golomb code (zero EG). 14. The method according to claim 9, in which: the image information includes information regarding the unit of the coding tree and information regarding the coding tree unit includes: - information as to whether or not a cross-component filter is applied to the current block of the Cb color component; and - information as to whether or not a cross-component filter is applied to the current Cr-color block. 15. The method according to claim 9, in which: the image information includes information regarding the unit of the coding tree and information regarding the coding tree unit includes: - information regarding the index of the filter bank for the cross-component filter applied to the current block of the Cb color component; and - information regarding the filter bank index for the cross-component filter applied to the current Cr-color block. 16. A non-volatile computer-readable storage medium that stores a bit stream for a method generated by an image encoding method, wherein the image encoding method comprises: extracting residual samples for the current block; extracting transform coefficients based on the transform process for the residual samples; extracting quantized transform coefficients based on a quantization process for the transform coefficients; generating residual information indicative of the quantized transform coefficients; formation of restored samples based on residual information; generating adaptive loop filtering (ALF) related information and cross-component ALF (CCALF) related information for the reconstructed samples; and encoding image information to form a bit stream, wherein the image information includes residual information, ALF related information, and CCALF related information, wherein the reconstructed samples include reconstructed luminance samples and reconstructed chrominance samples, wherein the image encoding method further comprises: extracting the coefficients of the ALF filter for the ALF process of the reconstructed chrominance samples; generating filtered reconstructed chrominance samples based on the reconstructed chrominance samples and ALF filter coefficients; extraction of cross-component filter coefficients for cross-component filtering; and generation of modified filtered reconstructed chrominance samples based on reconstructed luma samples, filtered reconstructed chrominance samples, and cross-component filter coefficients, wherein the image information includes a sequence parameter set (SPS) and slice header information, wherein the SPS includes an ALF activation flag related to whether the ALF process is activated or not, wherein, based on determining that the value of the ALF activation flag is 1, the SPS includes a cross-component adaptive loop filtering (CCALF) activation flag related to whether or not cross-component filtering is available, wherein, based on determining that the value of the ALF activation flag in the SPS is 1, the slice header information includes an ALF activation flag related to whether ALF is activated or not, wherein, based on determining that the value of the ALF activation flag included in the slice header information is 1 and the value of the CCALF activation flag included in the SPS is 1, the slice header information includes information as to whether or not CCALF for filtered reconstructed chrominance samples, and wherein, based on the information value of whether or not CCALF for filtered chrominance reconstructed samples is enabled or not, equal to 1, slice header information includes identification information (ID) of an adaptation parameter set (APS) associated with CCALF for filtered chrominance reconstructed samples. . 17. A method for transmitting data for an image, the method comprising the steps of: obtaining a bit stream for the image, wherein the bit stream is generated based on extracting the residual samples for the current block, extracting transform coefficients based on the transform process for the residual samples, extracting quantized transform coefficients based on the quantization process for the transform coefficients, generating residual information indicating the quantized coefficients transforming, generating reconstructed samples based on the residual information, generating information related to adaptive loop filtering (ALF), and generating information related to cross-component ALF (CCALF) for the reconstructed samples, and encoding image information including residual information related to with ALF information and CCALF related information; and transmit data containing a stream of bits, wherein the image information includes a sequence parameter set (SPS) and slice header information, wherein the SPS includes an ALF activation flag related to whether the ALF process is activated or not, wherein, based on determining that the value of the ALF activation flag is 1, the SPS includes a cross-component adaptive loop filtering (CCALF) activation flag related to whether or not cross-component filtering is available, wherein, based on determining that the value of the ALF activation flag in the SPS is 1, the slice header information includes an ALF activation flag related to whether ALF is activated or not, wherein, based on determining that the value of the ALF activation flag included in the slice header information is 1 and the value of the CCALF activation flag included in the SPS is 1, the slice header information includes information as to whether or not CCALF for filtered reconstructed chrominance samples, and wherein, based on the information value of whether or not CCALF for filtered chrominance reconstructed samples is enabled or not, equal to 1, slice header information includes identification information (ID) of an adaptation parameter set (APS) associated with CCALF for filtered chrominance reconstructed samples. .

Images