WO2021128277A1 - Cross component adaptive loop filtering method and apparatus, and video coding and decoding device - Google Patents

Cross component adaptive loop filtering method and apparatus, and video coding and decoding device Download PDF

Info

Publication number
WO2021128277A1
WO2021128277A1 PCT/CN2019/129168 CN2019129168W WO2021128277A1 WO 2021128277 A1 WO2021128277 A1 WO 2021128277A1 CN 2019129168 W CN2019129168 W CN 2019129168W WO 2021128277 A1 WO2021128277 A1 WO 2021128277A1
Authority
WO
WIPO (PCT)
Prior art keywords
adaptive loop
component
cross
loop filtering
chrominance
Prior art date
Application number
PCT/CN2019/129168
Other languages
French (fr)
Chinese (zh)
Inventor
姚杰
朱建清
数井君彦
Original Assignee
富士通株式会社
姚杰
朱建清
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 富士通株式会社, 姚杰, 朱建清 filed Critical 富士通株式会社
Priority to PCT/CN2019/129168 priority Critical patent/WO2021128277A1/en
Publication of WO2021128277A1 publication Critical patent/WO2021128277A1/en

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/103Selection of coding mode or of prediction mode
    • H04N19/105Selection of the reference unit for prediction within a chosen coding or prediction mode, e.g. adaptive choice of position and number of pixels used for prediction
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/117Filters, e.g. for pre-processing or post-processing
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/169Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
    • H04N19/17Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object
    • H04N19/176Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a block, e.g. a macroblock

Definitions

  • the embodiments of the present application relate to the technical field of video coding and decoding.
  • HEVC High Efficiency Video Coding
  • DF Deblocking filtering
  • SAO Sample Adaptive Offset filtering
  • ALF adaptive loop filtering
  • the loop filtering information from DF, SAO, and ALF can be provided to the entropy encoder and encoded into the bit stream. After the information is correctly restored at the decoding end, the quality of the video image can be improved.
  • CC-ALF Cross Component Adaptive Loop Filtering
  • VVC Versatile Video Coding
  • CC-ALF Cross Component Adaptive Loop Filtering
  • embodiments of the present application provide a cross-component adaptive loop filtering method, device, and video encoding and decoding equipment.
  • a cross-component adaptive loop filtering method including:
  • a cross-component adaptive loop filtering device including:
  • the filtering part performs adaptive loop filtering on the luminance component of the current sample, and uses the obtained filter output as the residual correction of the chrominance component of the current sample; wherein the difference between the current sample and the adjacent sample The brightness difference is limited to a preset range;
  • a correction part that corrects the chrominance component of the current sample based on the residual correction to obtain a filtered chrominance component.
  • a video encoding and decoding device including a memory and a processor, the memory stores a computer program, and the processor is configured to execute the computer program to implement the following operations:
  • One of the beneficial effects of the embodiments of the present application is: adaptive loop filtering is performed on the luminance component of the current sample, and the obtained filter output is used as the residual correction of the chrominance component of the current sample;
  • the brightness difference between adjacent samples is limited to a preset range.
  • Figure 1 is a schematic diagram of SAO, ALF and CC-ALF;
  • Figure 2 is an example diagram of CC-ALF using diamond filtering
  • Fig. 3 is a schematic diagram of a cross-component adaptive loop filtering method according to an embodiment of the present application
  • FIG. 4 is a schematic diagram of a cross-component adaptive loop filtering device according to an embodiment of the present application.
  • FIG. 5 is another schematic diagram of a cross-component adaptive loop filtering device according to an embodiment of the present application.
  • Fig. 6 is another schematic diagram of a video coding and decoding device according to an embodiment of the present application.
  • the terms “first”, “second”, etc. are used to distinguish different elements from the terms, but they do not indicate the spatial arrangement or chronological order of these elements. These elements should not be used by these terms. Limited.
  • the term “and/or” includes any and all combinations of one or more of the associated listed terms.
  • the terms “comprising”, “including”, “having” and the like refer to the existence of the stated features, elements, elements or components, but do not exclude the presence or addition of one or more other features, elements, elements or components.
  • FIG 1 is a schematic diagram of SAO, ALF and CC-ALF.
  • the luminance component filtered by SAO (represented by the luminance channel y below) is ALF (represented by ALF luminance in Fig. 1) and output The filtered luminance sample value.
  • the chrominance components filtered by SAO are ALF (indicated by ALF chrominance in Figure 1), and the filtered chrominance sample value I 1 is output And I 2 .
  • the output of the chroma channel can be expressed by the following formula:
  • O(x,y) represents the chroma sample value output by the chroma channel
  • I(x,y) represents the chroma sample value output by the ALF
  • ⁇ I i (x,y) represents the chroma channel output by the CC-ALF
  • the filtered chrominance sample value can be output through loop filtering.
  • CC-ALF uses the luminance component to correct the chrominance component.
  • CC-ALF uses a diamond filter on the luminance sample value, and outputs information from the filter at the same location to generate residual corrections ⁇ I 1 and ⁇ I 2 for the chrominance channel.
  • FIG 2 is a CC-ALF using an example of FIG rhombic filter, shown in Figure 2, e.g., CC-ALF may filter the 3 ⁇ 4 sample values, it may represent chrominance channels i of CC-ALF using the S i range. 2, the S i can comprise 8 sample values, where (x C, y C) denotes the present sample.
  • the residual correction of the chroma channel can be expressed by the following formula:
  • ⁇ I i (x,y) represents the residual correction of chroma channel i
  • S i represents the CC-ALF range of chroma channel i
  • I 0 (x C +x 0 ,y C +y 0 ) represents the sample (x C +x 0 ,y C +y 0 ) brightness value
  • c i (x 0 ,y 0 ) represents the weighting coefficient of CC-ALF for chroma channel i.
  • yCbCr is taken as an example for description, but the present application is not limited to this, for example, it can also be applied to other luminance channels and chrominance channels.
  • CC-ALF takes 3 ⁇ 4 diamond filtering as an example for description, but the application is not limited to this, for example, other filtering methods may also be used.
  • Fig. 3 is a schematic diagram of a cross-component adaptive loop filtering method according to an embodiment of the present application. As shown in Figure 3, the method includes:
  • the luminance component input in 301 may be a sample value after SAO filtering.
  • SAO filtering and ALF on the luminance component and the chrominance component please refer to the related technologies of SAO and ALF for details.
  • CC-ALF for details on how to perform CC-ALF, please refer to Figure 2 and related technologies.
  • Figure 3 above only schematically illustrates part of the relevant content of the embodiments of the present application, but the present application is not limited thereto.
  • the order of execution among various operations can be appropriately adjusted, and some other operations can be added or some operations can be reduced.
  • Those skilled in the art can make appropriate modifications based on the above content, and are not limited to the description of FIG. 3 above.
  • ⁇ I i (x, y) represents the residual correction of chroma channel i
  • (x C , y C ) represents the current sample
  • S i represents the CC-ALF range of chroma channel i
  • I 0 (x C , y C) represents the luminance value of the current sample
  • S i indicates the sample in addition to the current neighboring samples
  • I 0 (x C + x 0, y C + y 0) Represents the luminance value of adjacent samples (x C + x 0 , y C + y 0 );
  • c i (x 0 , y 0 ) represents the weight coefficient of CC-ALF for chrominance channel i.
  • a limiting function may be used to limit the brightness difference between the current sample and the adjacent sample within a preset range, and the filtering performed in this way may be referred to as non-linear CC-ALF.
  • the operation of limiting the brightness difference between the current sample and the adjacent sample in the CC-ALF to a preset range is simply referred to as limiting the CC-ALF.
  • the present application is not limited to the limiting function, and other implementation manners that limit the brightness difference between the current sample and the adjacent sample can be applied to the present application.
  • the limiting function is expressed as follows:
  • K is the limiting function
  • d is the input parameter
  • b is the preset limiting range.
  • this application is not limited to this, and other limiting functions can also be used.
  • the formula (3) can be transformed based on the limiting function. For example, the following formula is used to obtain the residual correction of the chrominance channel:
  • ⁇ I i (x,y) represents the residual correction of the chrominance channel i
  • I 0 (x C ,y C ) represents the brightness value of the current sample (x C ,y C )
  • I 0 (x C + x 0 , y C + y 0 ) represents the luminance value of the adjacent samples (x C + x 0 , y C + y 0 )
  • S i represents the CC-ALF range of the chrominance channel i
  • c i (x 0 , y 0 ) represents the weight coefficient of the CC-ALF of the chrominance channel i
  • K represents the limiting function
  • k(x 0 , y 0 ) represents the preset range.
  • k(x 0 , y 0 ) is a clipping parameter related to position (x 0 , y 0 ).
  • a limiting parameter can be specified for each filter coefficient. Through this adaptive limiting, the difference between the input sample value to be filtered and the adjacent input sample of the filter can be limited.
  • the encoder can perform optimization to find the best k(x 0 , y 0 ) related to the weight of each filter.
  • ALF is performed on the luminance component of the current sample, and the obtained filtered output is used as the residual correction of the chrominance component of the current sample; wherein the luminance difference between the current sample and adjacent samples is limited to the preset range Inside. It can improve the efficiency of CC-ALF and further improve the coding and decoding performance of chrominance components.
  • the above cross-component adaptive loop filtering method can be performed on the encoding end and/or the decoding end.
  • the encoding end can also encode the CC-ALF limiting information into the bit stream, so that the decoding end can perform better decoding based on the information, thereby further improving the encoding and decoding performance.
  • the limit value corresponding to the preset range may be preset. For example, only 4 fixed values may be used, and the limit value includes 1023, 201, 39, and 8. And these limit values can be correlated with the limit index, as shown in Table 1.
  • a diamond filter as an example of 3 ⁇ 4 S i may include eight sample values; thus each chrominance channel may correspond to up to seven limit value.
  • each chroma channel may correspond to more than 7 clipping values, or may also correspond to less than 7 clipping values.
  • indication information indicating whether to limit the CC-ALF may be incorporated into the bitstream.
  • the indication information may be represented by ccalf_cb_clip_flag or ccalf_cr_clip_flag.
  • the default value of ccalf_cb_clip_flag or ccalf_cr_clip_flag is, for example, 0 (false).
  • ccalf_cb_clip_flag is 0, which means that CC-ALF is not clipped
  • ccalf_cb_clip_flag 1, which means that CC-ALF is clipped
  • ccalf_cr_clip_flag is 0, which means that CC-ALF is not clipped
  • ccalf_cr_clip_flag is 1, which means that CC-ALF is clipped.
  • the clip index corresponding to the clip value of the preset range may be encoded into the bitstream.
  • the clip index may be represented by ccalf_cb_clip_idx or ccalf_cr_clip_idx.
  • the default value of ccalf_cb_clip_idx or ccalf_cr_clip_idx is 0, for example.
  • the index "0" (for example, using two-bit 00) can be programmed into the bitstream; if CC-ALF uses 201 for clipping, Then the index "1" (for example, using two bits of 01) can be incorporated into the bit stream; if CC-ALF uses 39 for clipping, then the index "2" (for example, using two bits of 10) can be incorporated into the bit stream. In the stream; if CC-ALF uses 8 for clipping, the index "3" (for example, using two bits of 11) can be encoded into the bit stream.
  • Table 2 exemplarily shows the syntax of the nonlinear CC-ALF of the embodiment of the present application.
  • Table 2 exemplarily describes the embodiments of the present application, but the present application is not limited thereto.
  • the encoding end has been schematically described above.
  • the decoding end can receive the bit stream accordingly and decode it accordingly.
  • the indication information indicating whether to limit the CC-ALF can be decoded from the bitstream.
  • the CC-ALF can be clipped according to the indication information and the index, So as to better perform loop filtering at the decoding end.
  • the index corresponding to the clip value of the preset range may be decoded from the bitstream.
  • the clip index ccalf_cb_clip_idx in the bitstream can be further obtained.
  • the index is "0" (for example, using two-bit 00)
  • CC-ALF is limited by 1023
  • the index is "1” (for example, using two-bit 01)
  • CC-ALF uses 201 for clipping
  • the index is “2” (for example, using two-bit 10)
  • CC-ALF uses 39 for clipping
  • the index is “3” (for example, using two-bit 11 )
  • adaptive loop filtering is performed on the luminance component of the current sample, and the obtained filter output is used as the residual correction of the chrominance component of the current sample; the difference between the current sample and the adjacent sample is The brightness difference is limited within the preset range.
  • the efficiency of CC-ALF can be improved, and the coding and decoding performance of chrominance components can be further improved.
  • FIG. 4 is a schematic diagram of a cross-component adaptive loop filter device according to an embodiment of the present application. As shown in FIG. 4, the cross-component adaptive loop filter device 400 includes:
  • the filtering unit 401 which performs adaptive loop filtering on the luminance component of the current sample, and uses the obtained filter output as the residual correction of the chrominance component of the current sample; wherein the current sample is between the adjacent samples
  • the brightness difference of is limited to a preset range
  • the correction unit 402 corrects the chrominance component of the current sample based on the residual correction to obtain the filtered chrominance component.
  • a limiting function is used to limit the brightness difference between the current sample and the adjacent sample within a preset range.
  • the limiting function is expressed as follows:
  • K is the limiting function
  • d is the input parameter
  • b is the preset limiting range.
  • the following formula is used to obtain the residual correction of the chrominance channel:
  • ⁇ I i (x,y) represents the residual correction of chroma channel i
  • I 0 (x C ,y C ) represents the brightness value of the current sample (x C ,y C )
  • I 0 (x C + x 0 , y C + y 0 ) represents the luminance value of the adjacent samples (x C + x 0 , y C + y 0 )
  • S i represents that the chrominance channel i performs the cross-component adaptive loop
  • the filtering range, c i (x 0 , y 0 ) represents the weight coefficient of the cross-component adaptive loop filtering performed by the chrominance channel i
  • K represents the limiting function
  • k(x 0 , y 0 ) Indicates the preset range.
  • the cross-component adaptive loop filtering device 400 further includes:
  • the encoding unit 403 encodes the instruction information indicating whether to limit the cross-component adaptive loop filtering into the bit stream.
  • the encoding unit 403 also encodes the index corresponding to the clip value of the preset range into the bitstream in the case of clipping the cross-component adaptive loop filtering.
  • FIG. 5 is another schematic diagram of the cross-component adaptive loop filtering device according to an embodiment of the present application.
  • the cross-component adaptive loop filtering device 500 includes: a filtering unit 501 and a correction unit 502; as described above.
  • the cross-component adaptive loop filtering device 500 further includes:
  • the decoding unit 503 decodes the instruction information indicating whether to limit the cross-component adaptive loop filter from the bit stream.
  • the decoding unit 503 also decodes the clip corresponding to the preset range from the bit stream when the indication information indicates that the cross-component adaptive loop filtering is to be clipped.
  • the index of the value is the index of the value.
  • the cross-component adaptive loop filtering uses a diamond filter
  • the chrominance channel includes Cb and Cr channels
  • the luminance channel includes a y channel.
  • each of the chrominance channels corresponds to a maximum of 7 clipping values; the clipping values include 1023, 201, 39, and 8.
  • the cross-component adaptive loop filtering device 400 or 500 may also include other components or modules.
  • FIG. 4 or 5 only exemplarily shows the connection relationship or signal direction between the various components or modules, but it should be clear to those skilled in the art that various related technologies such as bus connection can be used.
  • the above-mentioned various components or modules may be implemented by hardware facilities such as a processor and a memory; the implementation of this application does not limit this.
  • adaptive loop filtering is performed on the luminance component of the current sample, and the obtained filter output is used as the residual correction of the chrominance component of the current sample; the difference between the current sample and the adjacent sample is The brightness difference is limited within the preset range.
  • the efficiency of CC-ALF can be improved, and the coding and decoding performance of chrominance components can be further improved.
  • the embodiments of the present application also provide a video encoding and decoding device, which performs image processing or video processing, and may be an encoder on the encoding end, a decoder on the decoding end, or a device including an encoder and a decoder. equipment.
  • Fig. 6 is a schematic diagram of a video encoding and decoding device according to an embodiment of the present application.
  • a video encoding and decoding device 600 may include: a processor 601 and a memory 602; the memory 602 is coupled to the processor 601.
  • the memory 602 can store various data; in addition, it also stores an information processing program 603, and the program 603 is executed under the control of the processor 601.
  • the functions of the cross-component adaptive loop filtering device 400 or 500 may be integrated into the processor 601.
  • the processor 601 may be configured to implement the cross-component adaptive loop filtering method as described in the embodiment of the first aspect.
  • the processor 601 may be configured to perform the following control: perform adaptive loop filtering on the luminance component of the current sample, and use the obtained filtered output as the residual correction of the chrominance component of the current sample; The luminance difference between the current sample and the adjacent sample is limited within a preset range; and the chrominance component of the current sample is corrected based on the residual correction to obtain a filtered chrominance component.
  • the video codec device 600 may further include: an input/output (I/O) device 604, a display 605, etc.; wherein the functions of the above-mentioned components are similar to those in the prior art, and will not be repeated here. It is worth noting that the video codec device 600 does not necessarily include all the components shown in FIG. 6; in addition, the video codec device 600 may also include components not shown in FIG. 6, such as a camera, Hard Disk Drive (HDD, Hard Disk Driver), etc.; refer to related technologies.
  • HDD Hard Disk Drive
  • the embodiments of the present application provide a computer-readable program, wherein when the program is executed in a video coding/decoding device or an electronic device, the program causes the electronic device to execute the cross-component autonomy described in the embodiment of the first aspect.
  • An embodiment of the present application provides a storage medium storing a computer-readable program, wherein the computer-readable program enables a video codec device or an electronic device to perform the cross-component adaptive loop filtering as described in the embodiment of the first aspect method.
  • the above devices and methods of this application can be implemented by hardware, or can be implemented by hardware combined with software.
  • This application relates to such a computer-readable program, when the program is executed by a logic component, the logic component can realize the above-mentioned device or constituent component, or the logic component can realize the above-mentioned various methods Or steps.
  • This application also relates to storage media used to store the above programs, such as hard disks, magnetic disks, optical disks, DVDs, flash memory, etc.
  • the method/device described in conjunction with the embodiments of the present application may be directly embodied as hardware, a software module executed by a processor, or a combination of the two.
  • one or more of the functional block diagrams and/or one or more combinations of the functional block diagrams shown in the figure may correspond to each software module of the computer program flow or each hardware module.
  • These software modules can respectively correspond to the steps shown in the figure.
  • These hardware modules can be implemented by solidifying these software modules by using a field programmable gate array (FPGA), for example.
  • FPGA field programmable gate array
  • the software module can be located in RAM memory, flash memory, ROM memory, EPROM memory, EEPROM memory, registers, hard disk, removable disk, CD-ROM or any other form of storage medium known in the art.
  • a storage medium may be coupled to the processor, so that the processor can read information from the storage medium and write information to the storage medium; or the storage medium may be a component of the processor.
  • the processor and the storage medium may be located in the ASIC.
  • the software module can be stored in the memory of the mobile terminal, or can be stored in a memory card that can be inserted into the mobile terminal.
  • the software module can be stored in the MEGA-SIM card or a large-capacity flash memory device.
  • One or more of the functional blocks and/or one or more combinations of the functional blocks described in the drawings can be implemented as general-purpose processors, digital signal processors (DSPs) for performing the functions described in this application. ), application specific integrated circuit (ASIC), field programmable gate array (FPGA) or other programmable logic device, discrete gate or transistor logic device, discrete hardware component, or any appropriate combination thereof.
  • DSPs digital signal processors
  • ASIC application specific integrated circuit
  • FPGA field programmable gate array
  • One or more of the functional blocks described in the drawings and/or one or more combinations of the functional blocks can also be implemented as a combination of computing devices, for example, a combination of a DSP and a microprocessor, or multiple micro-processing Processor, one or more microprocessors in communication with the DSP, or any other such configuration.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Compression Or Coding Systems Of Tv Signals (AREA)

Abstract

Provided are a cross component adaptive loop filtering method and apparatus, and a video coding and decoding device. The method comprises: performing adaptive loop filtering on a luminance component of a current sample, and taking an obtained filtered output as a residual correction of a chrominance component of the current sample, wherein a luminance difference value between the current sample and an adjacent sample is limited within a preset range; and correcting the chrominance component of the current sample on the basis of the residual correction to obtain a filtered chrominance component.

Description

交叉分量自适应环路滤波方法、装置以及视频编解码设备Cross-component adaptive loop filtering method, device and video coding and decoding equipment 技术领域Technical field
本申请实施例涉及视频编解码技术领域。The embodiments of the present application relate to the technical field of video coding and decoding.
背景技术Background technique
在高效率视频编码(HEVC,High Efficiency Video Coding)标准中,已经提出了去块滤波(DF,Deblocking Filtering)、样本自适应偏移(SAO,Sample Adaptive Offset)滤波和自适应环路滤波(ALF,Adaptive Loop Filtering)等。在编码端可以将来自DF、SAO和ALF的环路滤波信息提供至熵编码器并编入比特流中,在解码端正确恢复这些信息后,可以提高视频图像的质量。In the High Efficiency Video Coding (HEVC, High Efficiency Video Coding) standard, deblocking filtering (DF, Deblocking Filtering), sample adaptive offset (SAO, Sample Adaptive Offset) filtering, and adaptive loop filtering (ALF) have been proposed. , Adaptive Loop Filtering), etc. At the encoding end, the loop filtering information from DF, SAO, and ALF can be provided to the entropy encoder and encoded into the bit stream. After the information is correctly restored at the decoding end, the quality of the video image can be improved.
在新一代视频编码标准(VVC,Versatile Video Coding)上,提出并研究了交叉分量自适应环路滤波(CC-ALF,Cross Component Adaptive Loop Filtering)。CC-ALF可以利用亮度样本值来校正色度分量。In the new generation of video coding standards (VVC, Versatile Video Coding), cross-component adaptive loop filtering (CC-ALF, Cross Component Adaptive Loop Filtering) is proposed and studied. CC-ALF can use luminance sample values to correct chrominance components.
应该注意,上面对技术背景的介绍只是为了方便对本申请的技术方案进行清楚、完整的说明,并方便本领域技术人员的理解而阐述的。不能仅仅因为这些方案在本申请的背景技术部分进行了阐述而认为上述技术方案为本领域技术人员所公知。It should be noted that the above introduction to the technical background is only for the convenience of a clear and complete description of the technical solutions of the present application, and to facilitate the understanding of those skilled in the art. It should not be considered that the above technical solutions are well-known to those skilled in the art just because these solutions are described in the background art part of this application.
发明内容Summary of the invention
但是,发明人发现,在CC-ALF中如果相邻的样本值之间出现较大的差异,CC-ALF的效率会受到影响,不能够进一步提高色度分量的编解码性能。However, the inventor found that if there are large differences between adjacent sample values in CC-ALF, the efficiency of CC-ALF will be affected, and the coding and decoding performance of chrominance components cannot be further improved.
针对上述问题的至少之一,本申请实施例提供一种交叉分量自适应环路滤波方法、装置以及视频编解码设备。In response to at least one of the foregoing problems, embodiments of the present application provide a cross-component adaptive loop filtering method, device, and video encoding and decoding equipment.
根据本申请实施例的一个方面,提供一种交叉分量自适应环路滤波方法,所述方法包括:According to an aspect of the embodiments of the present application, there is provided a cross-component adaptive loop filtering method, the method including:
对当前样本的亮度分量进行自适应环路滤波,并将所获得的滤波输出作为所述当前样本的色度分量的残差校正;其中所述当前样本与相邻样本之间的亮度差值被限制在预设范围内;Perform adaptive loop filtering on the luminance component of the current sample, and use the obtained filter output as the residual correction of the chrominance component of the current sample; wherein the luminance difference between the current sample and adjacent samples is Restricted within the preset range;
基于所述残差校正对所述当前样本的色度分量进行校正以获得滤波后的色度分量。Correcting the chrominance component of the current sample based on the residual correction to obtain a filtered chrominance component.
根据本申请实施例的另一个方面,提供一种交叉分量自适应环路滤波装置,所述装置包括:According to another aspect of the embodiments of the present application, there is provided a cross-component adaptive loop filtering device, the device including:
滤波部,其对当前样本的亮度分量进行自适应环路滤波,并将所获得的滤波输出作为所述当前样本的色度分量的残差校正;其中所述当前样本与相邻样本之间的亮度差值被限制在预设范围内;以及The filtering part performs adaptive loop filtering on the luminance component of the current sample, and uses the obtained filter output as the residual correction of the chrominance component of the current sample; wherein the difference between the current sample and the adjacent sample The brightness difference is limited to a preset range; and
校正部,其基于所述残差校正对所述当前样本的色度分量进行校正以获得滤波后的色度分量。A correction part that corrects the chrominance component of the current sample based on the residual correction to obtain a filtered chrominance component.
根据本申请实施例的又一个方面,提供一种视频编解码设备,包括存储器和处理器,所述存储器存储有计算机程序,所述处理器被配置为执行所述计算机程序而实现如下操作:According to another aspect of the embodiments of the present application, a video encoding and decoding device is provided, including a memory and a processor, the memory stores a computer program, and the processor is configured to execute the computer program to implement the following operations:
对当前样本的亮度分量进行自适应环路滤波,并将所获得的滤波输出作为所述当前样本的色度分量的残差校正;其中所述当前样本与相邻样本之间的亮度差值被限制在预设范围内;以及Perform adaptive loop filtering on the luminance component of the current sample, and use the obtained filter output as the residual correction of the chrominance component of the current sample; wherein the luminance difference between the current sample and adjacent samples is Restricted within the preset range; and
基于所述残差校正对所述当前样本的色度分量进行校正以获得滤波后的色度分量。Correcting the chrominance component of the current sample based on the residual correction to obtain a filtered chrominance component.
本申请实施例的有益效果之一在于:对当前样本的亮度分量进行自适应环路滤波,并将所获得的滤波输出作为所述当前样本的色度分量的残差校正;其中当前样本与相邻样本之间的亮度差值被限制在预设范围内。由此,能够提高CC-ALF的效率,进一步提高色度分量的编解码性能。One of the beneficial effects of the embodiments of the present application is: adaptive loop filtering is performed on the luminance component of the current sample, and the obtained filter output is used as the residual correction of the chrominance component of the current sample; The brightness difference between adjacent samples is limited to a preset range. As a result, the efficiency of CC-ALF can be improved, and the coding and decoding performance of chrominance components can be further improved.
参照后文的说明和附图,详细公开了本申请的特定实施方式,指明了本申请的原理可以被采用的方式。应该理解,本申请的实施方式在范围上并不因而受到限制。在所附权利要求的精神和条款的范围内,本申请的实施方式包括许多改变、修改和等同。With reference to the following description and drawings, specific implementations of the present application are disclosed in detail, and the ways in which the principles of the present application can be adopted are indicated. It should be understood that the scope of the embodiments of the present application is not limited thereby. Within the spirit and scope of the terms of the appended claims, the implementation of the present application includes many changes, modifications and equivalents.
针对一种实施方式描述和/或示出的特征可以以相同或类似的方式在一个或更多个其它实施方式中使用,与其它实施方式中的特征相组合,或替代其它实施方式中的特征。Features described and/or shown for one embodiment can be used in one or more other embodiments in the same or similar manner, combined with features in other embodiments, or substituted for features in other embodiments .
应该强调,术语“包括/包含”在本文使用时指特征、整件、步骤或组件的存在,但并不排除一个或更多个其它特征、整件、步骤或组件的存在或附加。It should be emphasized that the term "comprising/comprising" when used herein refers to the existence of a feature, a whole, a step or a component, but does not exclude the existence or addition of one or more other features, a whole, a step or a component.
附图说明Description of the drawings
在本申请实施例的一个附图或一种实施方式中描述的元素和特征可以与一个或 更多个其它附图或实施方式中示出的元素和特征相结合。此外,在附图中,类似的标号表示几个附图中对应的部件,并可用于指示多于一种实施方式中使用的对应部件。The elements and features described in one drawing or one embodiment of the embodiment of the present application may be combined with the elements and features shown in one or more other drawings or embodiments. In addition, in the drawings, similar reference numerals indicate corresponding parts in several drawings, and may be used to indicate corresponding parts used in more than one embodiment.
图1是SAO、ALF和CC-ALF的一示意图;Figure 1 is a schematic diagram of SAO, ALF and CC-ALF;
图2是CC-ALF采用菱形滤波的一示例图;Figure 2 is an example diagram of CC-ALF using diamond filtering;
图3是本申请实施例的交叉分量自适应环路滤波方法的一示意图;Fig. 3 is a schematic diagram of a cross-component adaptive loop filtering method according to an embodiment of the present application;
图4是本申请实施例的交叉分量自适应环路滤波装置的一示意图;FIG. 4 is a schematic diagram of a cross-component adaptive loop filtering device according to an embodiment of the present application;
图5是本申请实施例的交叉分量自适应环路滤波装置的另一示意图;FIG. 5 is another schematic diagram of a cross-component adaptive loop filtering device according to an embodiment of the present application;
图6是本申请实施例的视频编解码设备的另一示意图。Fig. 6 is another schematic diagram of a video coding and decoding device according to an embodiment of the present application.
具体实施方式Detailed ways
参照附图,通过下面的说明书,本申请的前述以及其它特征将变得明显。在说明书和附图中,具体公开了本申请的特定实施方式,其表明了其中可以采用本申请的原则的部分实施方式,应了解的是,本申请不限于所描述的实施方式,相反,本申请包括落入所附权利要求的范围内的全部修改、变型以及等同物。With reference to the drawings, the foregoing and other features of this application will become apparent through the following description. In the specification and drawings, specific implementations of the application are specifically disclosed, which indicate some implementations in which the principles of the application can be adopted. It should be understood that the application is not limited to the described implementations. On the contrary, the present application is not limited to the described implementations. The application includes all modifications, variations and equivalents falling within the scope of the appended claims.
在本申请实施例中,术语“第一”、“第二”等用于对不同元素从称谓上进行区分,但并不表示这些元素的空间排列或时间顺序等,这些元素不应被这些术语所限制。术语“和/或”包括相关联列出的术语的一种或多个中的任何一个和所有组合。术语“包含”、“包括”、“具有”等是指所陈述的特征、元素、元件或组件的存在,但并不排除存在或添加一个或多个其他特征、元素、元件或组件。In the embodiments of this application, the terms "first", "second", etc. are used to distinguish different elements from the terms, but they do not indicate the spatial arrangement or chronological order of these elements. These elements should not be used by these terms. Limited. The term "and/or" includes any and all combinations of one or more of the associated listed terms. The terms "comprising", "including", "having" and the like refer to the existence of the stated features, elements, elements or components, but do not exclude the presence or addition of one or more other features, elements, elements or components.
在本申请实施例中,单数形式“一”、“该”等包括复数形式,应广义地理解为“一种”或“一类”而并不是限定为“一个”的含义;此外术语“所述”应理解为既包括单数形式也包括复数形式,除非上下文另外明确指出。此外术语“根据”应理解为“至少部分根据……”,术语“基于”应理解为“至少部分基于……”,除非上下文另外明确指出。In the embodiments of this application, the singular forms "a", "the", etc. include plural forms, which should be broadly understood as "a" or "a type" rather than being limited to the meaning of "a"; in addition, the term "so" "Said" should be understood to include both singular and plural forms, unless the context clearly indicates otherwise. In addition, the term "based on" should be understood as "based at least in part on...", and the term "based on" should be understood as "based at least in part on...", unless the context clearly dictates otherwise.
图1是SAO、ALF和CC-ALF的一示意图,如图1所示,由SAO滤波后的亮度分量(以下以亮度通道y来表示)进行ALF(图1中以ALF亮度表示)后,输出滤波后的亮度样本值。Figure 1 is a schematic diagram of SAO, ALF and CC-ALF. As shown in Figure 1, the luminance component filtered by SAO (represented by the luminance channel y below) is ALF (represented by ALF luminance in Fig. 1) and output The filtered luminance sample value.
如图1所示,由SAO滤波后的色度分量(以下以色度通道Cb和Cr来表示)进行ALF(图1中以ALF色度表示)后,输出滤波后的色度样本值I 1和I 2。色度通道的输出可以采用如下公式表示: As shown in Figure 1, the chrominance components filtered by SAO (indicated by chrominance channels Cb and Cr below) are ALF (indicated by ALF chrominance in Figure 1), and the filtered chrominance sample value I 1 is output And I 2 . The output of the chroma channel can be expressed by the following formula:
O(x,y)=I(x,y)+ΔI i(x,y);  (1) O(x,y)=I(x,y)+ΔI i (x,y); (1)
其中,O(x,y)表示色度通道输出的色度样本值,I(x,y)表示ALF输出的色度样本值,ΔI i(x,y)表示CC-ALF输出的色度通道i的残差校正。 Among them, O(x,y) represents the chroma sample value output by the chroma channel, I(x,y) represents the chroma sample value output by the ALF, and ΔI i (x,y) represents the chroma channel output by the CC-ALF The residual correction of i.
由此,通过环路滤波可以输出滤波后的色度样本值。Thus, the filtered chrominance sample value can be output through loop filtering.
如图1所示,CC-ALF利用亮度分量来对色度分量进行校正。例如,CC-ALF对亮度样本值使用菱形滤波器,并从同一位置的滤波输出信息以生成色度通道的残差校正ΔI 1和ΔI 2As shown in Figure 1, CC-ALF uses the luminance component to correct the chrominance component. For example, CC-ALF uses a diamond filter on the luminance sample value, and outputs information from the filter at the same location to generate residual corrections ΔI 1 and ΔI 2 for the chrominance channel.
图2是CC-ALF采用菱形滤波的一示例图,如图2所示,例如,CC-ALF可以对3×4个样本值进行滤波,可以用S i表示色度通道i进行CC-ALF的范围。如图2所示,该S i可以包括8个样本值,其中(x C,y C)表示当前样本。色度通道的残差校正可以采用如下公式表示: FIG 2 is a CC-ALF using an example of FIG rhombic filter, shown in Figure 2, e.g., CC-ALF may filter the 3 × 4 sample values, it may represent chrominance channels i of CC-ALF using the S i range. 2, the S i can comprise 8 sample values, where (x C, y C) denotes the present sample. The residual correction of the chroma channel can be expressed by the following formula:
Figure PCTCN2019129168-appb-000001
Figure PCTCN2019129168-appb-000001
其中,ΔI i(x,y)表示色度通道i的残差校正,S i表示色度通道i进行CC-ALF的范围,I 0(x C+x 0,y C+y 0)表示样本(x C+x 0,y C+y 0)的亮度值,c i(x 0,y 0)表示色度通道i进行CC-ALF的权重系数。 Among them, ΔI i (x,y) represents the residual correction of chroma channel i, S i represents the CC-ALF range of chroma channel i, and I 0 (x C +x 0 ,y C +y 0 ) represents the sample (x C +x 0 ,y C +y 0 ) brightness value, c i (x 0 ,y 0 ) represents the weighting coefficient of CC-ALF for chroma channel i.
发明人发现:在CC-ALF中如果相邻样本值之间出现较大的差异,则CC-ALF的效率会受到影响,不能够进一步提高色度分量的编解码性能。针对该问题,本申请实施例提出以下技术方案。The inventor found that if there is a large difference between adjacent sample values in CC-ALF, the efficiency of CC-ALF will be affected, and the coding and decoding performance of chrominance components cannot be further improved. In response to this problem, the embodiments of the present application propose the following technical solutions.
在本申请实施例中,以yCbCr为例进行说明,但本申请不限于此,例如还可以适用于其他的亮度通道和色度通道。此外CC-ALF以3×4的菱形滤波为例进行说明,但本申请不限于此,例如还可以采用其他的滤波方式。In the embodiments of the present application, yCbCr is taken as an example for description, but the present application is not limited to this, for example, it can also be applied to other luminance channels and chrominance channels. In addition, CC-ALF takes 3×4 diamond filtering as an example for description, but the application is not limited to this, for example, other filtering methods may also be used.
第一方面的实施例Embodiments of the first aspect
本申请实施例提供一种交叉分量自适应环路滤波方法。图3是本申请实施例的交叉分量自适应环路滤波方法的一示意图。如图3所示,该方法包括:The embodiment of the present application provides a cross-component adaptive loop filtering method. Fig. 3 is a schematic diagram of a cross-component adaptive loop filtering method according to an embodiment of the present application. As shown in Figure 3, the method includes:
301,对当前样本的亮度分量进行自适应环路滤波,并将所获得的滤波输出作为所述当前样本的色度分量的残差校正;其中所述当前样本与相邻样本之间的亮度差值被限制在预设范围内;301. Perform adaptive loop filtering on the luminance component of the current sample, and use the obtained filter output as the residual correction of the chrominance component of the current sample; wherein the luminance difference between the current sample and adjacent samples The value is limited to a preset range;
302,基于所述残差校正对所述当前样本的色度分量进行校正以获得滤波后的色 度分量。302. Correct the chrominance component of the current sample based on the residual correction to obtain a filtered chrominance component.
在本申请实施例中,301中输入的亮度分量,可以是进行SAO滤波后的样本值。关于如何对亮度分量和色度分量进行SAO滤波和ALF,具体可以参考SAO和ALF的相关技术。此外具体如何进行CC-ALF,可以参考图2以及相关技术。In the embodiment of the present application, the luminance component input in 301 may be a sample value after SAO filtering. Regarding how to perform SAO filtering and ALF on the luminance component and the chrominance component, please refer to the related technologies of SAO and ALF for details. In addition, for details on how to perform CC-ALF, please refer to Figure 2 and related technologies.
值得注意的是,以上附图3仅对本申请实施例的部分相关内容进行了示意性说明,但本申请不限于此。例如可以适当地调整各个操作之间的执行顺序,此外还可以增加其他的一些操作或者减少其中的某些操作。本领域的技术人员可以根据上述内容进行适当地变型,而不仅限于上述附图3的记载。It is worth noting that Figure 3 above only schematically illustrates part of the relevant content of the embodiments of the present application, but the present application is not limited thereto. For example, the order of execution among various operations can be appropriately adjusted, and some other operations can be added or some operations can be reduced. Those skilled in the art can make appropriate modifications based on the above content, and are not limited to the description of FIG. 3 above.
在一些实施例中,上述公式(2)可以变型为:In some embodiments, the above formula (2) can be modified as:
Figure PCTCN2019129168-appb-000002
Figure PCTCN2019129168-appb-000002
其中,ΔI i(x,y)表示色度通道i的残差校正,(x C,y C)表示当前样本,S i表示色度通道i进行CC-ALF的范围;I 0(x C,y C)表示当前样本的亮度值;(x C+x 0,y C+y 0)表示S i中除了当前样本的相邻样本,I 0(x C+x 0,y C+y 0)表示相邻样本(x C+x 0,y C+y 0)的亮度值;c i(x 0,y 0)表示色度通道i进行CC-ALF的权重系数。 Among them, ΔI i (x, y) represents the residual correction of chroma channel i, (x C , y C ) represents the current sample, S i represents the CC-ALF range of chroma channel i; I 0 (x C , y C) represents the luminance value of the current sample; (x C + x 0, y C + y 0) S i indicates the sample in addition to the current neighboring samples, I 0 (x C + x 0, y C + y 0) Represents the luminance value of adjacent samples (x C + x 0 , y C + y 0 ); c i (x 0 , y 0 ) represents the weight coefficient of CC-ALF for chrominance channel i.
在一些实施例中,可以使用限幅函数将所述当前样本与相邻样本之间的亮度差值限制在预设范围内,进行了这样操作的滤波可以称为非线性CC-ALF。为简单起见,本文将CC-ALF中当前样本与相邻样本之间的亮度差值被限制在预设范围内的操作简称为对CC-ALF进行限幅。In some embodiments, a limiting function may be used to limit the brightness difference between the current sample and the adjacent sample within a preset range, and the filtering performed in this way may be referred to as non-linear CC-ALF. For the sake of simplicity, in this paper, the operation of limiting the brightness difference between the current sample and the adjacent sample in the CC-ALF to a preset range is simply referred to as limiting the CC-ALF.
值得注意的是,本申请并不限于限幅函数,对于其他的限制当前样本与相邻样本之间的亮度差值的实施方式均可适用于本申请。It is worth noting that the present application is not limited to the limiting function, and other implementation manners that limit the brightness difference between the current sample and the adjacent sample can be applied to the present application.
以限幅函数为例,例如,所述限幅函数表示如下:Taking the limiting function as an example, for example, the limiting function is expressed as follows:
K(d,b)=min(b,max(-b,d));K(d,b)=min(b,max(-b,d));
其中,K为所述限幅函数,d为输入参数,b为预设的限幅范围。但本申请不限于此,还可以使用其他的限幅函数。Where K is the limiting function, d is the input parameter, and b is the preset limiting range. However, this application is not limited to this, and other limiting functions can also be used.
在一些实施例中,可以基于限幅函数对公式(3)进行变换,例如,使用如下公式获得所述色度通道的残差校正:In some embodiments, the formula (3) can be transformed based on the limiting function. For example, the following formula is used to obtain the residual correction of the chrominance channel:
Figure PCTCN2019129168-appb-000003
Figure PCTCN2019129168-appb-000003
其中,ΔI i(x,y)表示色度通道i的残差校正,I 0(x C,y C)表示所述当前样本(x C,y C) 的亮度值,I 0(x C+x 0,y C+y 0)表示所述相邻样本(x C+x 0,y C+y 0)的亮度值,S i表示所述色度通道i进行CC-ALF的范围,c i(x 0,y 0)表示所述色度通道i进行CC-ALF的权重系数,K表示所述限幅函数,k(x 0,y 0)表示所述预设范围。 Among them, ΔI i (x,y) represents the residual correction of the chrominance channel i, I 0 (x C ,y C ) represents the brightness value of the current sample (x C ,y C ), I 0 (x C + x 0 , y C + y 0 ) represents the luminance value of the adjacent samples (x C + x 0 , y C + y 0 ), S i represents the CC-ALF range of the chrominance channel i, c i (x 0 , y 0 ) represents the weight coefficient of the CC-ALF of the chrominance channel i, K represents the limiting function, and k(x 0 , y 0 ) represents the preset range.
在一些实施例中,k(x 0,y 0)是与位置(x 0,y 0)相关的限幅参数。此外,对于每个滤波器系数,可以指定一个限幅参数。通过这种自适应的限幅,可以限制要过滤的输入样本值与滤波器的相邻输入样本之间的差值。此外,编码器可以执行优化,以找到每个滤波器权重相关的最佳k(x 0,y 0)。 In some embodiments, k(x 0 , y 0 ) is a clipping parameter related to position (x 0 , y 0 ). In addition, for each filter coefficient, a limiting parameter can be specified. Through this adaptive limiting, the difference between the input sample value to be filtered and the adjacent input sample of the filter can be limited. In addition, the encoder can perform optimization to find the best k(x 0 , y 0 ) related to the weight of each filter.
由此,对当前样本的亮度分量进行ALF,并将所获得的滤波输出作为当前样本的色度分量的残差校正;其中当前样本与相邻样本之间的亮度差值被限制在预设范围内。能够提高CC-ALF的效率,进一步提高色度分量的编解码性能。As a result, ALF is performed on the luminance component of the current sample, and the obtained filtered output is used as the residual correction of the chrominance component of the current sample; wherein the luminance difference between the current sample and adjacent samples is limited to the preset range Inside. It can improve the efficiency of CC-ALF and further improve the coding and decoding performance of chrominance components.
以上的交叉分量自适应环路滤波方法可以在编码端和/或解码端执行。此外,编码端还可以将CC-ALF进行限幅的信息编入比特流中,使得解码端可以根据该信息更好地进行解码,从而进一步提高编解码性能。The above cross-component adaptive loop filtering method can be performed on the encoding end and/or the decoding end. In addition, the encoding end can also encode the CC-ALF limiting information into the bit stream, so that the decoding end can perform better decoding based on the information, thereby further improving the encoding and decoding performance.
在一些实施例中,可以预先设置对应于所述预设范围的限幅值。例如,可以仅使用4个固定值,所述限幅值包括1023、201、39、8。并且可以将这些限幅值与限幅索引对应起来,如表1所示。In some embodiments, the limit value corresponding to the preset range may be preset. For example, only 4 fixed values may be used, and the limit value includes 1023, 201, 39, and 8. And these limit values can be correlated with the limit index, as shown in Table 1.
表1Table 1
限幅索引Clipping Index 限幅值Limit value
00 10231023
11 201201
22 3939
33 88
值得注意的是,以上仅以4个限幅值为例进行了说明,但本申请不限于此,例如还可以是其他的数值,或者还可以采用多于4个的限幅值,或者也可以采用少于4个的限幅值。It is worth noting that the above description only takes 4 limiter values as an example, but the application is not limited to this, for example, other values can also be used, or more than 4 limiter values can also be used, or Use less than 4 limit values.
在一些实施例中,以3×4的菱形滤波为例,S i可以包括8个样本值;因此每个色度通道可以对应最多7个限幅值。但本申请不限于此,例如每个色度通道可以对应多于7个的限幅值,或者也可以对应少于7个的限幅值。 In some embodiments, a diamond filter as an example of 3 × 4, S i may include eight sample values; thus each chrominance channel may correspond to up to seven limit value. However, the present application is not limited to this. For example, each chroma channel may correspond to more than 7 clipping values, or may also correspond to less than 7 clipping values.
在一些实施例中,可以将指示是否对CC-ALF进行限幅(可以称为非线性CC-ALF)的指示信息编入比特流中。例如,该指示信息可以采用ccalf_cb_clip_flag或者ccalf_cr_clip_flag表示。ccalf_cb_clip_flag或者ccalf_cr_clip_flag的默认值例如为0(false)。In some embodiments, indication information indicating whether to limit the CC-ALF (which may be referred to as non-linear CC-ALF) may be incorporated into the bitstream. For example, the indication information may be represented by ccalf_cb_clip_flag or ccalf_cr_clip_flag. The default value of ccalf_cb_clip_flag or ccalf_cr_clip_flag is, for example, 0 (false).
例如,对于Cb通道而言,ccalf_cb_clip_flag为0,表示不对CC-ALF进行限幅,ccalf_cb_clip_flag为1,表示对CC-ALF进行限幅。对于Cr通道而言,ccalf_cr_clip_flag为0,表示不对CC-ALF进行限幅,ccalf_cr_clip_flag为1,表示对CC-ALF进行限幅。For example, for the Cb channel, ccalf_cb_clip_flag is 0, which means that CC-ALF is not clipped, and ccalf_cb_clip_flag is 1, which means that CC-ALF is clipped. For the Cr channel, ccalf_cr_clip_flag is 0, which means that CC-ALF is not clipped, and ccalf_cr_clip_flag is 1, which means that CC-ALF is clipped.
在一些实施例中,在对CC-ALF进行限幅的情况下,可以将对应于预设范围的限幅值的限幅索引编入比特流中。例如,该限幅索引可以采用ccalf_cb_clip_idx或ccalf_cr_clip_idx表示。ccalf_cb_clip_idx或ccalf_cr_clip_idx的默认值例如为0。In some embodiments, when the CC-ALF is clipped, the clip index corresponding to the clip value of the preset range may be encoded into the bitstream. For example, the clip index may be represented by ccalf_cb_clip_idx or ccalf_cr_clip_idx. The default value of ccalf_cb_clip_idx or ccalf_cr_clip_idx is 0, for example.
例如,对应于表1,如果CC-ALF使用1023进行了限幅,则可以将索引“0”(例如使用两比特的00)编入比特流中;如果CC-ALF使用201进行了限幅,则可以将索引“1”(例如使用两比特的01)编入比特流中;如果CC-ALF使用39进行了限幅,则可以将索引“2”(例如使用两比特的10)编入比特流中;如果CC-ALF使用8进行了限幅,则可以将索引“3”(例如使用两比特的11)编入比特流中。For example, corresponding to Table 1, if CC-ALF uses 1023 for clipping, the index "0" (for example, using two-bit 00) can be programmed into the bitstream; if CC-ALF uses 201 for clipping, Then the index "1" (for example, using two bits of 01) can be incorporated into the bit stream; if CC-ALF uses 39 for clipping, then the index "2" (for example, using two bits of 10) can be incorporated into the bit stream. In the stream; if CC-ALF uses 8 for clipping, the index "3" (for example, using two bits of 11) can be encoded into the bit stream.
表2示例性示出了本申请实施例的非线性CC-ALF的语法。Table 2 exemplarily shows the syntax of the nonlinear CC-ALF of the embodiment of the present application.
表2Table 2
Figure PCTCN2019129168-appb-000004
Figure PCTCN2019129168-appb-000004
Figure PCTCN2019129168-appb-000005
Figure PCTCN2019129168-appb-000005
表2示例性对本申请实施例进行了说明,但本申请不限于此。Table 2 exemplarily describes the embodiments of the present application, but the present application is not limited thereto.
值得注意的是,以上仅对与本申请的相关内容进行了说明,但本申请不限于此。对于图像编码和/或环路滤波等还可以包括其他操作或者过程,例如熵编码、量化、变换等。关于这些操作或者过程的具体内容,可以参考相关技术。It is worth noting that the above only describes the relevant content of the application, but the application is not limited to this. For image coding and/or loop filtering, other operations or processes, such as entropy coding, quantization, and transformation, may also be included. For the specific content of these operations or processes, you can refer to related technologies.
以上对编码端进行了示意性说明。此外,解码端可以相应地接收比特流并且相应地进行解码。The encoding end has been schematically described above. In addition, the decoding end can receive the bit stream accordingly and decode it accordingly.
在一些实施例中,可从比特流中解码指示是否对CC-ALF进行限幅的指示信息。In some embodiments, the indication information indicating whether to limit the CC-ALF can be decoded from the bitstream.
例如,在解码器处,如果接收到比特流中的指示信息(ccalf_cb_clip_flag和/或ccalf_cr_clip_flag)以及索引(ccalf_cb_clip_idx和/或ccalf_cr_clip_idx),则可以根据该指示信息和该索引对CC-ALF进行限幅,从而在解码端更好地进行环路滤波。For example, at the decoder, if the indication information (ccalf_cb_clip_flag and/or ccalf_cr_clip_flag) and the index (ccalf_cb_clip_idx and/or ccalf_cr_clip_idx) in the bitstream are received, the CC-ALF can be clipped according to the indication information and the index, So as to better perform loop filtering at the decoding end.
在一些实施例中,在所述指示信息指示对CC-ALF进行限幅的情况下,可从所述比特流中解码对应于所述预设范围的限幅值的索引。In some embodiments, in a case where the indication information indicates that the CC-ALF is clipped, the index corresponding to the clip value of the preset range may be decoded from the bitstream.
例如,如果比特流中的指示信息ccalf_cb_clip_flag为1,则可以进一步获得比特流中的限幅索引ccalf_cb_clip_idx。对应于表1,如果该索引为“0”(例如使用两比特的00),则对CC-ALF使用1023进行限幅;如果该索引为“1”(例如使用两比特的01),则对CC-ALF使用201进行限幅;如果该索引为“2”(例如使用两比特的10), 则对CC-ALF使用39进行限幅;如果该索引为“3”(例如使用两比特的11),则对CC-ALF使用8进行限幅。For example, if the indication information ccalf_cb_clip_flag in the bitstream is 1, then the clip index ccalf_cb_clip_idx in the bitstream can be further obtained. Corresponding to Table 1, if the index is "0" (for example, using two-bit 00), then CC-ALF is limited by 1023; if the index is "1" (for example, using two-bit 01), then CC-ALF uses 201 for clipping; if the index is “2” (for example, using two-bit 10), then CC-ALF uses 39 for clipping; if the index is “3” (for example, using two-bit 11 ), then use 8 for CC-ALF to limit the amplitude.
值得注意的是,以上仅对与本申请的相关内容进行了说明,但本申请不限于此。对于图像解码和/或环路滤波等还可以包括其他操作或者过程,例如熵解码、逆量化、逆变换等。关于这些操作或者过程的具体内容,可以参考相关技术。It is worth noting that the above only describes the relevant content of the application, but the application is not limited to this. For image decoding and/or loop filtering, other operations or processes, such as entropy decoding, inverse quantization, and inverse transformation, may also be included. For the specific content of these operations or processes, you can refer to related technologies.
以上各个实施例仅对本申请实施例进行了示例性说明,但本申请不限于此,还可以在以上各个实施例的基础上进行适当的变型。例如,可以单独使用上述各个实施例,也可以将以上各个实施例中的一种或多种结合起来。The above embodiments only exemplify the embodiments of the present application, but the present application is not limited thereto, and appropriate modifications may also be made on the basis of the above various embodiments. For example, each of the above embodiments may be used alone, or one or more of the above embodiments may be combined.
由上述实施例可知,对当前样本的亮度分量进行自适应环路滤波,并将所获得的滤波输出作为所述当前样本的色度分量的残差校正;其中当前样本与相邻样本之间的亮度差值被限制在预设范围内。由此,能够提高CC-ALF的效率,进一步提高色度分量的编解码性能。It can be seen from the above-mentioned embodiment that adaptive loop filtering is performed on the luminance component of the current sample, and the obtained filter output is used as the residual correction of the chrominance component of the current sample; the difference between the current sample and the adjacent sample is The brightness difference is limited within the preset range. As a result, the efficiency of CC-ALF can be improved, and the coding and decoding performance of chrominance components can be further improved.
第二方面的实施例Embodiment of the second aspect
本申请实施例还提供一种交叉分量自适应环路滤波装置,与第一方面的实施例中相同的内容不再赘述。图4是本申请实施例的交叉分量自适应环路滤波装置的一示意图,如图4所示,交叉分量自适应环路滤波装置400包括:The embodiment of the present application also provides a cross-component adaptive loop filtering device, and the same content as in the embodiment of the first aspect will not be repeated. FIG. 4 is a schematic diagram of a cross-component adaptive loop filter device according to an embodiment of the present application. As shown in FIG. 4, the cross-component adaptive loop filter device 400 includes:
滤波部401,其对当前样本的亮度分量进行自适应环路滤波,并将所获得的滤波输出作为所述当前样本的色度分量的残差校正;其中所述当前样本与相邻样本之间的亮度差值被限制在预设范围内;以及The filtering unit 401, which performs adaptive loop filtering on the luminance component of the current sample, and uses the obtained filter output as the residual correction of the chrominance component of the current sample; wherein the current sample is between the adjacent samples The brightness difference of is limited to a preset range; and
校正部402,其基于所述残差校正对所述当前样本的色度分量进行校正以获得滤波后的色度分量。The correction unit 402 corrects the chrominance component of the current sample based on the residual correction to obtain the filtered chrominance component.
在一些实施例中,使用限幅函数将所述当前样本与相邻样本之间的亮度差值限制在预设范围内。In some embodiments, a limiting function is used to limit the brightness difference between the current sample and the adjacent sample within a preset range.
在一些实施例中,所述限幅函数表示如下:In some embodiments, the limiting function is expressed as follows:
K(d,b)=min(b,max(-b,d));K(d,b)=min(b,max(-b,d));
其中,K为所述限幅函数,d为输入参数,b为预设的限幅范围。Where K is the limiting function, d is the input parameter, and b is the preset limiting range.
在一些实施例中,使用如下公式获得所述色度通道的残差校正:In some embodiments, the following formula is used to obtain the residual correction of the chrominance channel:
Figure PCTCN2019129168-appb-000006
Figure PCTCN2019129168-appb-000006
其中,ΔI i(x,y)表示色度通道i的残差校正,I 0(x C,y C)表示所述当前样本(x C,y C)的亮度值,I 0(x C+x 0,y C+y 0)表示所述相邻样本(x C+x 0,y C+y 0)的亮度值,S i表示所述色度通道i进行所述交叉分量自适应环路滤波的范围,c i(x 0,y 0)表示所述色度通道i进行所述交叉分量自适应环路滤波的权重系数,K表示所述限幅函数,k(x 0,y 0)表示所述预设范围。 Among them, ΔI i (x,y) represents the residual correction of chroma channel i, I 0 (x C ,y C ) represents the brightness value of the current sample (x C ,y C ), I 0 (x C + x 0 , y C + y 0 ) represents the luminance value of the adjacent samples (x C + x 0 , y C + y 0 ), and S i represents that the chrominance channel i performs the cross-component adaptive loop The filtering range, c i (x 0 , y 0 ) represents the weight coefficient of the cross-component adaptive loop filtering performed by the chrominance channel i, K represents the limiting function, k(x 0 , y 0 ) Indicates the preset range.
在一些实施例中,如图4所示,交叉分量自适应环路滤波装置400还包括:In some embodiments, as shown in FIG. 4, the cross-component adaptive loop filtering device 400 further includes:
编码部403,其将指示是否对所述交叉分量自适应环路滤波进行限幅的指示信息编入比特流中。The encoding unit 403 encodes the instruction information indicating whether to limit the cross-component adaptive loop filtering into the bit stream.
在一些实施例中,编码部403还在对所述交叉分量自适应环路滤波进行限幅的情况下,将对应于所述预设范围的限幅值的索引编入所述比特流中。In some embodiments, the encoding unit 403 also encodes the index corresponding to the clip value of the preset range into the bitstream in the case of clipping the cross-component adaptive loop filtering.
图5是本申请实施例的交叉分量自适应环路滤波装置的另一示意图,如图5所示,交叉分量自适应环路滤波装置500包括:滤波部501以及校正部502;如上所述。FIG. 5 is another schematic diagram of the cross-component adaptive loop filtering device according to an embodiment of the present application. As shown in FIG. 5, the cross-component adaptive loop filtering device 500 includes: a filtering unit 501 and a correction unit 502; as described above.
在一些实施例中,如图5所示,交叉分量自适应环路滤波装置500还包括:In some embodiments, as shown in FIG. 5, the cross-component adaptive loop filtering device 500 further includes:
解码部503,其从比特流中解码指示是否对所述交叉分量自适应环路滤波进行限幅的指示信息。The decoding unit 503 decodes the instruction information indicating whether to limit the cross-component adaptive loop filter from the bit stream.
在一些实施例中,解码部503还在所述指示信息指示对所述交叉分量自适应环路滤波进行限幅的情况下,从所述比特流中解码对应于所述预设范围的限幅值的索引。In some embodiments, the decoding unit 503 also decodes the clip corresponding to the preset range from the bit stream when the indication information indicates that the cross-component adaptive loop filtering is to be clipped. The index of the value.
在一些实施例中,所述交叉分量自适应环路滤波使用菱形滤波器,所述色度通道包括Cb和Cr通道,所述亮度通道包括y通道。In some embodiments, the cross-component adaptive loop filtering uses a diamond filter, the chrominance channel includes Cb and Cr channels, and the luminance channel includes a y channel.
在一些实施例中,每个所述色度通道对应最多7个限幅值;所述限幅值包括1023、201、39、8。In some embodiments, each of the chrominance channels corresponds to a maximum of 7 clipping values; the clipping values include 1023, 201, 39, and 8.
值得注意的是,以上仅对与本申请相关的各部件或模块进行了说明,但本申请不限于此。交叉分量自适应环路滤波装置400或500还可以包括其他部件或者模块,关于这些部件或者模块的具体内容,可以参考相关技术。It is worth noting that the above only describes the components or modules related to the application, but the application is not limited thereto. The cross-component adaptive loop filtering device 400 or 500 may also include other components or modules. For the specific content of these components or modules, reference may be made to related technologies.
此外,为了简单起见,图4或5中仅示例性示出了各个部件或模块之间的连接关系或信号走向,但是本领域技术人员应该清楚的是,可以采用总线连接等各种相关技术。上述各个部件或模块可以通过例如处理器、存储器等硬件设施来实现;本申请实施并不对此进行限制。In addition, for the sake of simplicity, FIG. 4 or 5 only exemplarily shows the connection relationship or signal direction between the various components or modules, but it should be clear to those skilled in the art that various related technologies such as bus connection can be used. The above-mentioned various components or modules may be implemented by hardware facilities such as a processor and a memory; the implementation of this application does not limit this.
以上各实施例仅对本申请实施例进行了示例性说明,但本申请不限于此,还可以 在以上各实施例的基础上进行适当的变型。例如,可以单独使用上述各个实施例,也可以将以上各个实施例中的一种或多种结合起来。The above embodiments only exemplify the embodiments of the present application, but the present application is not limited to this, and appropriate modifications can also be made on the basis of the above embodiments. For example, each of the above embodiments may be used alone, or one or more of the above embodiments may be combined.
由上述实施例可知,对当前样本的亮度分量进行自适应环路滤波,并将所获得的滤波输出作为所述当前样本的色度分量的残差校正;其中当前样本与相邻样本之间的亮度差值被限制在预设范围内。由此,能够提高CC-ALF的效率,进一步提高色度分量的编解码性能。It can be seen from the above-mentioned embodiment that adaptive loop filtering is performed on the luminance component of the current sample, and the obtained filter output is used as the residual correction of the chrominance component of the current sample; the difference between the current sample and the adjacent sample is The brightness difference is limited within the preset range. As a result, the efficiency of CC-ALF can be improved, and the coding and decoding performance of chrominance components can be further improved.
第三方面的实施例Embodiments of the third aspect
本申请实施例还提供一种视频编解码设备,该视频编解码设备进行图像处理或视频处理,可以是编码端的编码器,也可以是解码端的解码器,还可以是包括编码器和解码器的设备。The embodiments of the present application also provide a video encoding and decoding device, which performs image processing or video processing, and may be an encoder on the encoding end, a decoder on the decoding end, or a device including an encoder and a decoder. equipment.
图6是本申请实施例的视频编解码设备的一示意图。如图6所示,视频编解码设备600可以包括:处理器601和存储器602;存储器602耦合到处理器601。其中该存储器602可存储各种数据;此外还存储信息处理的程序603,并且在处理器601的控制下执行该程序603。Fig. 6 is a schematic diagram of a video encoding and decoding device according to an embodiment of the present application. As shown in FIG. 6, a video encoding and decoding device 600 may include: a processor 601 and a memory 602; the memory 602 is coupled to the processor 601. The memory 602 can store various data; in addition, it also stores an information processing program 603, and the program 603 is executed under the control of the processor 601.
在一些实施例中,交叉分量自适应环路滤波装置400或500的功能可以被集成到处理器601中。其中,处理器601可以被配置为实现如第一方面的实施例所述的交叉分量自适应环路滤波方法。In some embodiments, the functions of the cross-component adaptive loop filtering device 400 or 500 may be integrated into the processor 601. The processor 601 may be configured to implement the cross-component adaptive loop filtering method as described in the embodiment of the first aspect.
例如,处理器601可以被配置为进行如下的控制:对当前样本的亮度分量进行自适应环路滤波,并将所获得的滤波输出作为所述当前样本的色度分量的残差校正;其中所述当前样本与相邻样本之间的亮度差值被限制在预设范围内;以及基于所述残差校正对所述当前样本的色度分量进行校正以获得滤波后的色度分量。For example, the processor 601 may be configured to perform the following control: perform adaptive loop filtering on the luminance component of the current sample, and use the obtained filtered output as the residual correction of the chrominance component of the current sample; The luminance difference between the current sample and the adjacent sample is limited within a preset range; and the chrominance component of the current sample is corrected based on the residual correction to obtain a filtered chrominance component.
此外,如图6所示,视频编解码设备600还可以包括:输入输出(I/O)设备604和显示器605等;其中,上述部件的功能与现有技术类似,此处不再赘述。值得注意的是,视频编解码设备600也并不是必须要包括图6中所示的所有部件;此外,视频编解码设备600还可以包括图6中没有示出的部件,例如摄像头(camera)、硬盘驱动器(HDD,Hard Disk Driver)等;可以参考相关技术。In addition, as shown in FIG. 6, the video codec device 600 may further include: an input/output (I/O) device 604, a display 605, etc.; wherein the functions of the above-mentioned components are similar to those in the prior art, and will not be repeated here. It is worth noting that the video codec device 600 does not necessarily include all the components shown in FIG. 6; in addition, the video codec device 600 may also include components not shown in FIG. 6, such as a camera, Hard Disk Drive (HDD, Hard Disk Driver), etc.; refer to related technologies.
本申请实施例提供一种计算机可读程序,其中当在视频编解码设备或者电子设备中执行所述程序时,所述程序使得该电子设备执行如第一方面的实施例所述的交叉分 量自适应环路滤波方法。The embodiments of the present application provide a computer-readable program, wherein when the program is executed in a video coding/decoding device or an electronic device, the program causes the electronic device to execute the cross-component autonomy described in the embodiment of the first aspect. Adapt to loop filtering method.
本申请实施例提供一种存储有计算机可读程序的存储介质,其中所述计算机可读程序使得视频编解码设备或者电子设备执行如第一方面的实施例所述的交叉分量自适应环路滤波方法。An embodiment of the present application provides a storage medium storing a computer-readable program, wherein the computer-readable program enables a video codec device or an electronic device to perform the cross-component adaptive loop filtering as described in the embodiment of the first aspect method.
本申请以上的装置和方法可以由硬件实现,也可以由硬件结合软件实现。本申请涉及这样的计算机可读程序,当该程序被逻辑部件所执行时,能够使该逻辑部件实现上文所述的装置或构成部件,或使该逻辑部件实现上文所述的各种方法或步骤。本申请还涉及用于存储以上程序的存储介质,如硬盘、磁盘、光盘、DVD、flash存储器等。The above devices and methods of this application can be implemented by hardware, or can be implemented by hardware combined with software. This application relates to such a computer-readable program, when the program is executed by a logic component, the logic component can realize the above-mentioned device or constituent component, or the logic component can realize the above-mentioned various methods Or steps. This application also relates to storage media used to store the above programs, such as hard disks, magnetic disks, optical disks, DVDs, flash memory, etc.
结合本申请实施例描述的方法/装置可直接体现为硬件、由处理器执行的软件模块或二者组合。例如,图中所示的功能框图中的一个或多个和/或功能框图的一个或多个组合,既可以对应于计算机程序流程的各个软件模块,亦可以对应于各个硬件模块。这些软件模块,可以分别对应于图中所示的各个步骤。这些硬件模块例如可利用现场可编程门阵列(FPGA)将这些软件模块固化而实现。The method/device described in conjunction with the embodiments of the present application may be directly embodied as hardware, a software module executed by a processor, or a combination of the two. For example, one or more of the functional block diagrams and/or one or more combinations of the functional block diagrams shown in the figure may correspond to each software module of the computer program flow or each hardware module. These software modules can respectively correspond to the steps shown in the figure. These hardware modules can be implemented by solidifying these software modules by using a field programmable gate array (FPGA), for example.
软件模块可以位于RAM存储器、闪存、ROM存储器、EPROM存储器、EEPROM存储器、寄存器、硬盘、移动磁盘、CD-ROM或者本领域已知的任何其它形式的存储介质。可以将一种存储介质耦接至处理器,从而使处理器能够从该存储介质读取信息,且可向该存储介质写入信息;或者该存储介质可以是处理器的组成部分。处理器和存储介质可以位于ASIC中。该软件模块可以存储在移动终端的存储器中,也可以存储在可插入移动终端的存储卡中。例如,若设备(如移动终端)采用的是较大容量的MEGA-SIM卡或者大容量的闪存装置,则该软件模块可存储在该MEGA-SIM卡或者大容量的闪存装置中。The software module can be located in RAM memory, flash memory, ROM memory, EPROM memory, EEPROM memory, registers, hard disk, removable disk, CD-ROM or any other form of storage medium known in the art. A storage medium may be coupled to the processor, so that the processor can read information from the storage medium and write information to the storage medium; or the storage medium may be a component of the processor. The processor and the storage medium may be located in the ASIC. The software module can be stored in the memory of the mobile terminal, or can be stored in a memory card that can be inserted into the mobile terminal. For example, if the device (such as a mobile terminal) uses a larger-capacity MEGA-SIM card or a large-capacity flash memory device, the software module can be stored in the MEGA-SIM card or a large-capacity flash memory device.
针对附图中描述的功能方框中的一个或多个和/或功能方框的一个或多个组合,可以实现为用于执行本申请所描述功能的通用处理器、数字信号处理器(DSP)、专用集成电路(ASIC)、现场可编程门阵列(FPGA)或者其它可编程逻辑器件、分立门或者晶体管逻辑器件、分立硬件组件或者其任意适当组合。针对附图描述的功能方框中的一个或多个和/或功能方框的一个或多个组合,还可以实现为计算设备的组合,例如,DSP和微处理器的组合、多个微处理器、与DSP通信结合的一个或多个微处理器或者任何其它这种配置。One or more of the functional blocks and/or one or more combinations of the functional blocks described in the drawings can be implemented as general-purpose processors, digital signal processors (DSPs) for performing the functions described in this application. ), application specific integrated circuit (ASIC), field programmable gate array (FPGA) or other programmable logic device, discrete gate or transistor logic device, discrete hardware component, or any appropriate combination thereof. One or more of the functional blocks described in the drawings and/or one or more combinations of the functional blocks can also be implemented as a combination of computing devices, for example, a combination of a DSP and a microprocessor, or multiple micro-processing Processor, one or more microprocessors in communication with the DSP, or any other such configuration.
以上结合具体的实施方式对本申请进行了描述,但本领域技术人员应该清楚,这 些描述都是示例性的,并不是对本申请保护范围的限制。本领域技术人员可以根据本申请的精神和原理对本申请做出各种变型和修改,这些变型和修改也在本申请的范围内。The application is described above in conjunction with specific implementations, but it should be clear to those skilled in the art that these descriptions are all exemplary and do not limit the scope of protection of the application. Those skilled in the art can make various variations and modifications to the application according to the spirit and principle of the application, and these variations and modifications are also within the scope of the application.

Claims (20)

  1. 一种交叉分量自适应环路滤波方法,所述方法包括:A cross-component adaptive loop filtering method, the method includes:
    对当前样本的亮度分量进行自适应环路滤波,并将所获得的滤波输出作为所述当前样本的色度分量的残差校正;其中所述当前样本与相邻样本之间的亮度差值被限制在预设范围内;以及Perform adaptive loop filtering on the luminance component of the current sample, and use the obtained filter output as the residual correction of the chrominance component of the current sample; wherein the luminance difference between the current sample and adjacent samples is Restricted within the preset range; and
    基于所述残差校正对所述当前样本的色度分量进行校正以获得滤波后的色度分量。Correcting the chrominance component of the current sample based on the residual correction to obtain a filtered chrominance component.
  2. 根据权利要求1所述的交叉分量自适应环路滤波方法,其中,使用限幅函数将所述当前样本与相邻样本之间的亮度差值限制在预设范围内。The cross-component adaptive loop filtering method according to claim 1, wherein a limiting function is used to limit the brightness difference between the current sample and the adjacent sample within a preset range.
  3. 根据权利要求2所述的交叉分量自适应环路滤波方法,其中,所述限幅函数表示如下:The cross-component adaptive loop filtering method according to claim 2, wherein the limiting function is expressed as follows:
    K(d,b)=min(b,max(-b,d));K(d,b)=min(b,max(-b,d));
    其中,K为所述限幅函数,d为输入参数,b为预设的限幅范围。Where K is the limiting function, d is the input parameter, and b is the preset limiting range.
  4. 根据权利要求2所述的交叉分量自适应环路滤波方法,其中,使用如下公式获得所述色度分量的残差校正:The cross-component adaptive loop filtering method according to claim 2, wherein the residual correction of the chrominance component is obtained using the following formula:
    Figure PCTCN2019129168-appb-100001
    Figure PCTCN2019129168-appb-100001
    其中,ΔI i(x,y)表示色度通道i的残差校正,I 0(x C,y C)表示所述当前样本(x C,y C)的亮度值,I 0(x C+x 0,y C+y 0)表示所述相邻样本(x C+x 0,y C+y 0)的亮度值,S i表示所述色度通道i进行所述交叉分量自适应环路滤波的范围,c i(x 0,y 0)表示所述色度通道i进行所述交叉分量自适应环路滤波的权重系数,K表示所述限幅函数,k(x 0,y 0)表示所述预设范围。 Among them, ΔI i (x,y) represents the residual correction of chroma channel i, I 0 (x C ,y C ) represents the brightness value of the current sample (x C ,y C ), I 0 (x C + x 0 , y C + y 0 ) represents the luminance value of the adjacent samples (x C + x 0 , y C + y 0 ), and S i represents that the chrominance channel i performs the cross-component adaptive loop The filtering range, c i (x 0 , y 0 ) represents the weight coefficient of the cross-component adaptive loop filtering performed by the chrominance channel i, K represents the limiting function, k(x 0 , y 0 ) Indicates the preset range.
  5. 根据权利要求1所述的交叉分量自适应环路滤波方法,其中,所述方法还包括:The cross-component adaptive loop filtering method according to claim 1, wherein the method further comprises:
    将指示是否对所述交叉分量自适应环路滤波进行限幅的指示信息编入比特流中。The instruction information indicating whether to limit the cross-component adaptive loop filtering is encoded into the bitstream.
  6. 根据权利要求5所述的交叉分量自适应环路滤波方法,其中,所述方法还包括:The cross-component adaptive loop filtering method according to claim 5, wherein the method further comprises:
    在对所述交叉分量自适应环路滤波进行限幅的情况下,将对应于所述预设范围的限幅值的索引编入所述比特流中。In the case of clipping the cross-component adaptive loop filtering, the index corresponding to the clipping value of the preset range is incorporated into the bitstream.
  7. 根据权利要求1所述的交叉分量自适应环路滤波方法,其中,所述方法还包 括:The cross-component adaptive loop filtering method according to claim 1, wherein the method further comprises:
    从比特流中解码指示是否对所述交叉分量自适应环路滤波进行限幅的指示信息。Decode the indication information from the bitstream that indicates whether to limit the cross-component adaptive loop filtering.
  8. 根据权利要求7所述的交叉分量自适应环路滤波方法,其中,所述方法还包括:The cross-component adaptive loop filtering method according to claim 7, wherein the method further comprises:
    在所述指示信息指示对所述交叉分量自适应环路滤波进行限幅的情况下,从所述比特流中解码对应于所述预设范围的限幅值的索引。In a case where the indication information indicates that the cross-component adaptive loop filtering is to be clipped, the index corresponding to the clip value of the preset range is decoded from the bit stream.
  9. 根据权利要求1所述的交叉分量自适应环路滤波方法,其中,所述交叉分量自适应环路滤波使用菱形滤波器,所述色度通道包括Cb和Cr,所述亮度通道包括y。The cross-component adaptive loop filtering method according to claim 1, wherein the cross-component adaptive loop filtering uses a diamond filter, the chrominance channel includes Cb and Cr, and the luminance channel includes y.
  10. 根据权利要求9所述的交叉分量自适应环路滤波方法,其中,每个所述色度通道对应最多7个限幅值;所述限幅值包括1023、201、39、8。The cross-component adaptive loop filtering method according to claim 9, wherein each of the chrominance channels corresponds to a maximum of 7 clipping values; the clipping values include 1023, 201, 39, and 8.
  11. 一种交叉分量自适应环路滤波装置,所述装置包括:A cross-component adaptive loop filtering device, the device comprising:
    滤波部,其对当前样本的亮度分量进行自适应环路滤波,并将所获得的滤波输出作为所述当前样本的色度分量的残差校正;其中所述当前样本与相邻样本之间的亮度差值被限制在预设范围内;以及The filtering part performs adaptive loop filtering on the luminance component of the current sample, and uses the obtained filter output as the residual correction of the chrominance component of the current sample; wherein the difference between the current sample and the adjacent sample The brightness difference is limited to a preset range; and
    校正部,其基于所述残差校正对所述当前样本的色度分量进行校正以获得滤波后的色度分量。A correction part that corrects the chrominance component of the current sample based on the residual correction to obtain a filtered chrominance component.
  12. 根据权利要求11所述的交叉分量自适应环路滤波装置,其中,使用限幅函数将所述当前样本与相邻样本之间的亮度差值限制在预设范围内。11. The cross-component adaptive loop filtering device according to claim 11, wherein a limiting function is used to limit the luminance difference between the current sample and the adjacent sample within a preset range.
  13. 根据权利要求12所述的交叉分量自适应环路滤波装置,其中,所述限幅函数表示如下:The cross-component adaptive loop filtering device according to claim 12, wherein the limiting function is expressed as follows:
    K(d,b)=min(b,max(-b,d));K(d,b)=min(b,max(-b,d));
    其中,K为所述限幅函数,d为输入参数,b为预设的限幅范围。Where K is the limiting function, d is the input parameter, and b is the preset limiting range.
  14. 根据权利要求12所述的交叉分量自适应环路滤波装置,其中,使用如下公式获得所述色度分量的残差校正:The cross-component adaptive loop filtering device according to claim 12, wherein the residual correction of the chrominance component is obtained using the following formula:
    Figure PCTCN2019129168-appb-100002
    Figure PCTCN2019129168-appb-100002
    其中,ΔI i(x,y)表示色度通道i的残差校正,I 0(x C,y C)表示所述当前样本(x C,y C)的亮度值,I 0(x C+x 0,y C+y 0)表示所述相邻样本(x C+x 0,y C+y 0)的亮度值,S i表示所述色度通道i进行所述交叉分量自适应环路滤波的范围,c i(x 0,y 0)表示所述色度通道i进行所述交叉分量自适应环路滤波的权重系数,K表示所述限幅函数,k(x 0,y 0) 表示所述预设范围。 Among them, ΔI i (x,y) represents the residual correction of chroma channel i, I 0 (x C ,y C ) represents the brightness value of the current sample (x C ,y C ), I 0 (x C + x 0 , y C + y 0 ) represents the luminance value of the adjacent samples (x C + x 0 , y C + y 0 ), and S i represents that the chrominance channel i performs the cross-component adaptive loop The filtering range, c i (x 0 , y 0 ) represents the weight coefficient of the cross-component adaptive loop filtering performed by the chrominance channel i, K represents the limiting function, k(x 0 , y 0 ) Indicates the preset range.
  15. 根据权利要求11所述的交叉分量自适应环路滤波装置,其中,所述装置还包括:The cross-component adaptive loop filtering device according to claim 11, wherein the device further comprises:
    编码部,其将指示是否对所述交叉分量自适应环路滤波进行限幅的指示信息编入比特流中。The encoding unit encodes the instruction information indicating whether to limit the cross-component adaptive loop filtering into the bit stream.
  16. 根据权利要求15所述的交叉分量自适应环路滤波装置,其中,所述编码部还在对所述交叉分量自适应环路滤波进行限幅的情况下,将对应于所述预设范围的限幅值的索引编入所述比特流中。The cross-component adaptive loop filter device according to claim 15, wherein the encoding unit also performs clipping on the cross-component adaptive loop filter, and cuts the value corresponding to the preset range The index of the clipping value is coded into the bit stream.
  17. 根据权利要求11所述的交叉分量自适应环路滤波装置,其中,所述装置还包括:The cross-component adaptive loop filtering device according to claim 11, wherein the device further comprises:
    解码部,其从比特流中解码指示是否对所述交叉分量自适应环路滤波进行限幅的指示信息。The decoding unit decodes the instruction information indicating whether to limit the cross-component adaptive loop filter from the bit stream.
  18. 根据权利要求17所述的交叉分量自适应环路滤波装置,其中,所述解码部还在所述指示信息指示对所述交叉分量自适应环路滤波进行限幅的情况下,从所述比特流中解码对应于所述预设范围的限幅值的索引。The cross-component adaptive loop filter device according to claim 17, wherein the decoding unit further extracts from the bit when the instruction information indicates that the cross-component adaptive loop filter should be clipped. The decoded index in the stream corresponds to the clip value of the preset range.
  19. 根据权利要求11所述的交叉分量自适应环路滤波装置,其中,所述交叉分量自适应环路滤波使用菱形滤波器,所述色度通道包括Cb和Cr通道,所述亮度通道包括y通道;其中,每个所述色度通道对应最多7个限幅值;所述限幅值包括1023、201、39、8。The cross-component adaptive loop filtering device according to claim 11, wherein the cross-component adaptive loop filtering uses a diamond filter, the chrominance channel includes Cb and Cr channels, and the luminance channel includes a y channel. Wherein, each of the chrominance channels corresponds to a maximum of 7 amplitude limiting values; the limiting amplitude values include 1023, 201, 39, and 8.
  20. 一种视频编解码设备,包括存储器和处理器,所述存储器存储有计算机程序,所述处理器被配置为执行所述计算机程序而实现如下操作:A video encoding and decoding device includes a memory and a processor, the memory stores a computer program, and the processor is configured to execute the computer program to implement the following operations:
    对当前样本的亮度分量进行自适应环路滤波,并将所获得的滤波输出作为所述当前样本的色度分量的残差校正;其中所述当前样本与相邻样本之间的亮度差值被限制在预设范围内;以及Perform adaptive loop filtering on the luminance component of the current sample, and use the obtained filter output as the residual correction of the chrominance component of the current sample; wherein the luminance difference between the current sample and adjacent samples is Restricted within the preset range; and
    基于所述残差校正对所述当前样本的色度分量进行校正以获得滤波后的色度分量。Correcting the chrominance component of the current sample based on the residual correction to obtain a filtered chrominance component.
PCT/CN2019/129168 2019-12-27 2019-12-27 Cross component adaptive loop filtering method and apparatus, and video coding and decoding device WO2021128277A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
PCT/CN2019/129168 WO2021128277A1 (en) 2019-12-27 2019-12-27 Cross component adaptive loop filtering method and apparatus, and video coding and decoding device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2019/129168 WO2021128277A1 (en) 2019-12-27 2019-12-27 Cross component adaptive loop filtering method and apparatus, and video coding and decoding device

Publications (1)

Publication Number Publication Date
WO2021128277A1 true WO2021128277A1 (en) 2021-07-01

Family

ID=76573533

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2019/129168 WO2021128277A1 (en) 2019-12-27 2019-12-27 Cross component adaptive loop filtering method and apparatus, and video coding and decoding device

Country Status (1)

Country Link
WO (1) WO2021128277A1 (en)

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP3297282A1 (en) * 2016-09-15 2018-03-21 Thomson Licensing Method and apparatus for video coding with adaptive clipping
CN109691102A (en) * 2016-08-31 2019-04-26 高通股份有限公司 Across component filters

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109691102A (en) * 2016-08-31 2019-04-26 高通股份有限公司 Across component filters
EP3297282A1 (en) * 2016-09-15 2018-03-21 Thomson Licensing Method and apparatus for video coding with adaptive clipping

Non-Patent Citations (4)

* Cited by examiner, † Cited by third party
Title
C.-Y. CHEN, A. SEGALL: "Description of Core Experiment 5 (CE5): Cross-component adaptive loop filtering", 16. JVET MEETING; 20191001 - 20191011; GENEVA; (THE JOINT VIDEO EXPLORATION TEAM OF ISO/IEC JTC1/SC29/WG11 AND ITU-T SG.16 ), no. JVET-P2025 ; m51522, 12 October 2019 (2019-10-12), XP030218459 *
J. TAQUET (CANON), C. GISQUET (CANON), G. LAROCHE (CANON), P. ONNO (CANON),: "Non-linear Adaptive Loop Filter", 125. MPEG MEETING; 20190114 - 20190118; MARRAKECH; (MOTION PICTURE EXPERT GROUP OR ISO/IEC JTC1/SC29/WG11), no. m45655, 2 January 2019 (2019-01-02), XP030197953 *
J. TAQUET (CANON), P. ONNO (CANON), C. GISQUET (CANON), G. LAROCHE (CANON): "CE5: Results of tests CE5-3.1, CE5-3.2, CE5-3.3 and CE5-3.4 on Non-Linear Adaptive Loop Filter.", 126. MPEG MEETING; 20190325 - 20190329; GENEVA; (MOTION PICTURE EXPERT GROUP OR ISO/IEC JTC1/SC29/WG11), no. m46901, 12 March 2019 (2019-03-12), XP030209876 *
V. SEREGIN (QUALCOMM), C.-Y. CHEN (MEDIATEK),: "CE5: Summary Report on Adaptive Loop Filter", 14. JVET MEETING; 20190319 - 20190327; GENEVA; (THE JOINT VIDEO EXPLORATION TEAM OF ISO/IEC JTC1/SC29/WG11 AND ITU-T SG.16 ), no. JVET-N0025, 19 March 2019 (2019-03-19), XP030203579 *

Similar Documents

Publication Publication Date Title
US10194150B2 (en) Method and device for coding image, and method and device for decoding image
TWI558173B (en) Sample adaptive offset control
US20220312006A1 (en) Cross-component adaptive loop filter for chroma
US11006134B2 (en) Picture decoding and encoding methods and apparatuses, decoder, and encoder
US20210144370A1 (en) Encoding processing method and device, decoding processing method and device, encoder, and decoder
US11985313B2 (en) Filtering method and apparatus, and computer storage medium
JP2016518770A5 (en)
AU2012207827B2 (en) Video decoder with reduced dynamic range transform with inverse transform shifting memory
CN113068028A (en) Method and apparatus for predicting video image component, and computer storage medium
US10757424B2 (en) FLC-based image compression method and device
WO2021128277A1 (en) Cross component adaptive loop filtering method and apparatus, and video coding and decoding device
WO2014201862A1 (en) Image processing method and apparatus
EP3941057A1 (en) Filtering method and device, encoder and computer storage medium
JP2016506160A5 (en)
WO2021128281A1 (en) Coding and decoding method and apparatus using adaptive color transform, and video coding and decoding device
US20120230395A1 (en) Video decoder with reduced dynamic range transform with quantization matricies
WO2021203381A1 (en) Video encoding and decoding method and apparatus, and computer-readable storage medium
WO2021196234A1 (en) Video encoding and decoding method and device, and storage medium
US20230104806A1 (en) Encoding method and apparatus, decoding method and apparatus, and devices therefor
US11025910B2 (en) Video encoder, video decoder, and video system
WO2021128265A1 (en) Filtering method and device
WO2018068263A1 (en) Image coding method and device, and image processing apparatus
CN113940076A (en) Applying implicit transform selection
US11245896B1 (en) Deblocking filter level decision method
CN103096087A (en) Method and system of coding and decoding image and video

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 19957385

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 19957385

Country of ref document: EP

Kind code of ref document: A1