WO2021128265A1 - Dispositif et procédé de filtrage - Google Patents

Dispositif et procédé de filtrage Download PDF

Info

Publication number
WO2021128265A1
WO2021128265A1 PCT/CN2019/129144 CN2019129144W WO2021128265A1 WO 2021128265 A1 WO2021128265 A1 WO 2021128265A1 CN 2019129144 W CN2019129144 W CN 2019129144W WO 2021128265 A1 WO2021128265 A1 WO 2021128265A1
Authority
WO
WIPO (PCT)
Prior art keywords
quantization
scale
filter coefficients
filter
input image
Prior art date
Application number
PCT/CN2019/129144
Other languages
English (en)
Chinese (zh)
Inventor
徐陆航
朱建清
数井君彦
Original Assignee
富士通株式会社
徐陆航
朱建清
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 富士通株式会社, 徐陆航, 朱建清 filed Critical 富士通株式会社
Priority to PCT/CN2019/129144 priority Critical patent/WO2021128265A1/fr
Publication of WO2021128265A1 publication Critical patent/WO2021128265A1/fr

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/117—Filters, e.g. for pre-processing or post-processing
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/124—Quantisation
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/30—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using hierarchical techniques, e.g. scalability
    • H04N19/36—Scalability techniques involving formatting the layers as a function of picture distortion after decoding, e.g. signal-to-noise [SNR] scalability

Definitions

  • This application relates to the technical field of video coding and decoding and the technical field of image compression.
  • the loop filter is a series of filters in the current VCC (Versatile Video Coding) draft, which can improve subjective quality and coding efficiency at the same time.
  • VCC Very Video Coding
  • CC-ALF Cross Component Adaptive Loop Filter
  • CC-ALF As shown in Figure 1, the principle of CC-ALF is to use the edge information in the luminance information (Luma) to compensate the chroma (Chroma), because the chroma information may be lost during compression. As shown in Figure 2, CC-ALF currently supports 4 groups of 3 ⁇ 4 diamonds and 8 coefficient asymmetric filters in each frame, which is calculated by the encoder. Each coefficient is limited to 6 bits (from -32 to 31).
  • Figure 3 shows a quantification method, including:
  • Operation 301 Obtain the original filter coefficient in decimal form, and let C i denote the original filter coefficient in the CC-ALF filter, i ⁇ [1,8];
  • Operation 303 Limit C′ i to the range of [-32, 31] to obtain C′′ i ; here, use C′′ i to represent the quantization coefficient limited to a 6-bit integer:
  • Pi' chroma Pi chroma + round( ⁇ C′′ i ⁇ Pi luma ) ⁇ 128, where Pi' chroma is the chrominance information obtained by filtering the chrominance information of the input image , Round( ⁇ C′′ i ⁇ Pi luma ) ⁇ 128 is the chrominance compensation information obtained by filtering the luminance information of the input image.
  • the inventor of the present application found that using this process for quantization of all filter coefficients may cause a problem that some coefficients in a small range will be quantized to very low precision.
  • embodiments of the present application provide a filtering method and device, which modify the current CC-ALF filtering process and use an adaptive scale to quantize the CC-ALF filter coefficients.
  • the precision loss is reduced and the coding efficiency is improved.
  • a filtering method wherein the filtering method includes:
  • the quantization result of each set of filter coefficients is used to perform a filtering operation on the luminance information of the input image to obtain chrominance compensation information.
  • a filtering device wherein the filtering device includes:
  • a determining unit which determines a quantization scale for each set of filter coefficients in the multiple sets of filter coefficients of the cross-component adaptive loop filter (CC-ALF);
  • a quantization unit which uses the quantization scale corresponding to each group of filter coefficients to perform a quantization operation on each group of filter coefficients to obtain a quantization result of each group of filter coefficients;
  • the filtering unit uses the quantization result of each set of filter coefficients to perform a filtering operation on the luminance information of the input image to obtain chrominance compensation information.
  • a filtering method wherein the filtering method includes:
  • the luminance information of the input image is filtered by using the quantization scale, and the chrominance compensation information is output.
  • a filtering device wherein the filtering device includes:
  • a reading unit which obtains the quantization scale from the received code stream
  • the filtering unit uses the quantization scale to perform a filtering operation on the luminance information of the input image, and output chrominance compensation information.
  • an image encoder wherein the image encoder includes:
  • SAO Luma filter which performs a filtering operation on an input image and outputs the brightness information of the input image
  • An adaptive loop filter (CC-ALF Cb/Cr), which performs a filtering operation on the luminance information of the input image, and outputs chrominance compensation information;
  • ALF Chroma filter which performs a filtering operation on the input image, and outputs the chroma information of the input image
  • the adaptive loop filter (CC-ALF Cb/Cr) is configured to determine one filter coefficient for each of the multiple sets of filter coefficients of the cross-component adaptive loop filter (CC-ALF) Quantization scale; use the quantization scale corresponding to each set of filter coefficients to quantize each set of filter coefficients to obtain the quantization result of each set of filter coefficients; use the quantization result of each set of filter coefficients to filter the brightness information of the input image to obtain the color
  • the chrominance compensation information is used to compensate the chrominance information of the input image.
  • an image decoder wherein the image decoder includes:
  • SAO Luma filter which performs a filtering operation on an input image and outputs the brightness information of the input image
  • An adaptive loop filter (CC-ALF Cb/Cr), which performs a filtering operation on the luminance information of the input image, and outputs chrominance compensation information;
  • ALF Chroma filter which performs a filtering operation on the input image, and outputs the chroma information of the input image
  • the adaptive loop filter (CC-ALF Cb/Cr) is configured to obtain a quantization scale from the received code stream, use the quantization scale to filter the brightness information of the input image, and output color
  • the chrominance compensation information is used to compensate the chrominance information of the input image.
  • a computer-readable program is provided, wherein when the program is executed in an image processing device, the program causes the image processing device to execute the aforementioned first aspect or third aspect. The method described.
  • a storage medium storing a computer readable program, wherein the computer readable program causes an image processing device to execute the method described in the first aspect or the third aspect.
  • an adaptive quantization scale Scale is used in the quantization of CC-ALF coefficients to obtain higher precision and improve coding efficiency.
  • Figure 1 is a schematic diagram of the position of the cross-component adaptive loop filter (CC-ALF) in the encoder;
  • CC-ALF cross-component adaptive loop filter
  • FIG. 2 is a schematic diagram of each set of filter coefficients of a cross-component adaptive loop filter (CC-ALF);
  • Fig. 3 is a schematic diagram of a conventional cross-component adaptive loop filter (CC-ALF) filtering method
  • FIG. 4 is a schematic diagram of a filtering method according to an embodiment of the present application.
  • FIG. 5 is another schematic diagram of the filtering method according to an embodiment of the present application.
  • FIG. 6 is another schematic diagram of the filtering method according to an embodiment of the present application.
  • FIG. 7 is a schematic diagram of a filtering method according to an embodiment of the present application.
  • FIG. 8 is a schematic diagram of a filtering device according to an embodiment of the present application.
  • FIG. 9 is another schematic diagram of the filtering device of the embodiment of the present application.
  • Fig. 10 is a schematic diagram of an image encoder according to an embodiment of the present application.
  • Fig. 11 is a schematic diagram of an image decoder according to an embodiment of the present application.
  • Fig. 12 is a schematic diagram of an image processing device according to an embodiment of the present application.
  • the terms “first”, “second”, etc. are used to distinguish different elements from the terms, but they do not indicate the spatial arrangement or chronological order of these elements. These elements should not be used by these terms. Limited.
  • the term “and/or” includes any and all combinations of one or more of the associated listed terms.
  • the terms “comprising”, “including”, “having” and the like refer to the existence of the stated features, elements, elements or components, but do not exclude the presence or addition of one or more other features, elements, elements or components.
  • FIG. 4 is a schematic diagram of the filtering method of the embodiment of the present application. As shown in FIG. 4, the filtering method of the embodiment of the present application includes:
  • 401 Determine a quantization scale for each set of filter coefficients in multiple sets of filter coefficients of the cross-component adaptive loop filter (CC-ALF);
  • the embodiment of the present application modifies the current CC-ALF filtering process and uses an adaptive scale to quantize the CC-ALF filter coefficients, which can make full use of the bit range that needs to be quantized, reduce precision loss, and improve coding efficiency.
  • the cross-component adaptive loop filter has multiple sets of filter coefficients, such as four sets, and each set of filter coefficients has multiple filter coefficients, such as 8, but the application is not limited to this
  • the CC-ALF may also have other number of groups of filter coefficients, and each group of filter coefficients may also include other numbers of filter coefficients.
  • determining the quantization scale may be to obtain multiple original filter coefficients of each group of filter coefficients of CC-ALF, and calculate the quantization scale corresponding to each group of filter coefficients according to the maximum value of the multiple original filter coefficients.
  • the maximum value among the multiple original filter coefficients refers to the original filter coefficient with the largest absolute value among the multiple original filter coefficients.
  • the quantization scale may also be limited to a range that can be represented by the number of bits.
  • a range (referred to as the first range) is determined according to the number of bits representing the quantization scale, and the quantization scale is limited to the first range to obtain the restricted quantization scale.
  • the quantization operation may be performed by using the quantization scale corresponding to each group of filter coefficients to perform a quantization operation on each original filter coefficient of each group of filter coefficients to obtain a quantization result of each original filter coefficient of each group of filter coefficients.
  • the quantization result may also be limited to a range that can be represented by the number of bits.
  • a range (referred to as a second range) is determined according to the number of bits representing the quantization result, and the quantization result is limited to the second range to obtain the limited quantization result.
  • the filtering operation can be performed on the luminance information of the input image according to the quantization result of each group of filter coefficients and the quantization scale corresponding to each group of filter coefficients to obtain chrominance compensation information, which is used as the cross-component self
  • CC-ALF adaptive loop filter
  • the brightness information of the input image can be obtained by filtering the input image through the SAO Luma filter (SAO Luma).
  • SAO Luma SAO Luma filter
  • the embodiment of the present application uses the edge information in the luminance information to obtain chrominance compensation information.
  • the value of the aforementioned quantization scale can also be stored (be signaled to) in the adaptation parameter set (Adaption Parameter Set, APS) of the bin file of the video sequence, that is, encoded into the code stream , So that the decoder side reads the Scale Value from the received code stream, and uses the Scale Value to filter the pixels of the input image.
  • the adaptation parameter set Adaption Parameter Set, APS
  • Fig. 5 is another schematic diagram of the filtering method of an embodiment of the present application.
  • Fig. 5 shows the processing procedure for each set of filter coefficients.
  • Each set of filter coefficients contains 8 coefficients, the quantization scale is represented by 2 bits, and the quantization result (Quantized filter coefficients) are represented by 6 bits as an example, but the application is not limited to this.
  • each set of filter coefficients can also contain other numbers of coefficients, and the quantization scale can also be represented by 3 bits or other numbers. It is expressed in bits, and the quantization result can also be expressed in other numbers of bits.
  • the method includes:
  • C′ i round(C i ⁇ 128 ⁇ 2 Scale′ );
  • Pi' chroma Pi chroma + round ( ⁇ C " i ⁇ Pi luma ) ⁇ 128 ⁇ 2 Scale'
  • the above-mentioned Pi chroma is obtained by filtering the input image through a chroma filter (ALF Chroma)
  • ALF Chroma a chroma filter
  • the above-mentioned round ( ⁇ C" i ⁇ Pi luma ) ⁇ 128 ⁇ 2 Scale' is chromaticity compensation information.
  • Fig. 6 is another schematic diagram of the filtering method according to an embodiment of the present application.
  • Fig. 6 shows the processing process for each set of filter coefficients, still assuming that each set of filter coefficients contains 8 coefficients, the quantization scale is represented by 2 bits, and the quantization The result (quantized filter coefficient) is represented by 6 bits as an example, but the application is not limited to this.
  • each set of filter coefficients can also contain other numbers of coefficients, and the quantization scale can also be represented by 3 bits or other numbers.
  • the quantization result can also be expressed by other numbers of bits.
  • the method includes:
  • C′ i round(C i ⁇ 32 ⁇ 2 Scale′ );
  • 607 Obtain chrominance information Pi' chroma when filtering the pixels of the input image.
  • Pi' chroma Pi chroma + round ( ⁇ C " i ⁇ Pi luma ) ⁇ 32 ⁇ 2 Scale'
  • the above-mentioned Pi chroma is obtained by filtering the input image through a chroma filter (ALF Chroma)
  • ALF Chroma a chroma filter
  • the above-mentioned round ( ⁇ C" i ⁇ Pi luma ) ⁇ 32 ⁇ 2 Scale' is chromaticity compensation information.
  • the aforementioned 2-bit Scale value is obtained based on the maximum filter coefficient of each filter (that is, each group of filter coefficients), so it is adaptive.
  • the Scale value can be saved in the APS of the bin file of the video sequence and compiled into the transmitted code stream.
  • this application is not limited to this, and the aforementioned Scale value may also be other bit depths (3 bits as described above), or stored in other locations of the bin file of the video sequence.
  • an adaptive quantization scale (Scale) is used in the quantization of CC-ALF coefficients, thereby obtaining higher accuracy and improving coding efficiency.
  • FIG. 7 is a schematic diagram of the filtering method of the embodiment of the present application. As shown in FIG. 7, the filtering method of the embodiment of the present application includes:
  • an adaptive quantization scale (Scale) is used in the quantization of CC-ALF coefficients, thereby obtaining higher accuracy and improving decoding efficiency.
  • the embodiment of the present application provides a filtering device, which corresponds to the method of the first aspect of the embodiment, and the description of the same content is not repeated.
  • FIG. 8 is a schematic diagram of a filtering device of an embodiment of the present application.
  • the filtering device 800 of an embodiment of the present application includes: a determining unit 801, a quantizing unit 802, and a filtering unit 803.
  • Each set of filter coefficients in the multiple sets of filter coefficients of the channel filter (CC-ALF) determines a quantization scale;
  • the quantization unit 802 uses the quantization scale corresponding to each set of filter coefficients to perform a quantization operation on each set of filter coefficients to obtain each set of filter coefficients.
  • the filtering unit 803 uses the quantization result of each set of filter coefficients to perform a filtering operation on the luminance information of the input image to obtain chrominance compensation information.
  • the determining unit 801 obtains multiple original filter coefficients (C i , i ⁇ [1, 8]) of each set of filter coefficients of the cross-component adaptive loop filter (CC-ALF), according to The maximum value (C max ) of the plurality of original filter coefficients (C i ) is calculated for the quantization scale (Scale) corresponding to each group of filter coefficients.
  • the determining unit 801 further determines the first range according to the number of bits representing the quantization scale, limits the quantization scale (Scale) to the first range, and obtains the restricted quantization scale (Scale').
  • the maximum value C max in the plurality of original filter coefficients is the original filter coefficient with the largest absolute value among the plurality of original filter coefficients C i.
  • the quantization unit 802 uses the quantization scale (Scale) corresponding to each group of filter coefficients to perform a quantization operation on each original filter coefficient (C i ) of each group of filter coefficients to obtain each original filter coefficient of each group of filter coefficients. results quantized coefficients (C i) of (C 'i).
  • the quantization unit 802 further determines the second range according to the number of bits representing the quantization result, limits the quantization result (C′ i ) to the second range, and obtains the restricted quantization result (C′′ i ) .
  • the filtering unit 803 performs a filtering operation on the brightness information of the input image according to the quantization result (C" i ) of each set of filter coefficients and the quantization scale (Scale') corresponding to each set of filter coefficients to obtain chroma compensation.
  • Information as the output of the cross-component adaptive loop filter (CC-ALF).
  • the determining unit 801 calculates the quantization scale according to the following formula:
  • the filtering unit 803 calculates the chromaticity compensation information according to the following formula: round( ⁇ C′′ i ⁇ Pi luma ) ⁇ 128 ⁇ 2 Scale' ;
  • scale is the quantization scale
  • Scale′ is the limited quantization scale
  • C max is the maximum value among multiple original filter coefficients (C i ) in a set of filter coefficients
  • C i is the original filter coefficient
  • C'i is For the quantization result of the original filter coefficient
  • C" i is the quantization result after restriction
  • Pi luma is the brightness information of the input image.
  • the determining unit 801 calculates the quantization scale according to the following formula:
  • the filtering unit 803 calculates the chromaticity compensation information according to the following formula: round( ⁇ C′′ i ⁇ Pi luma ) ⁇ 32 ⁇ 2 Scale' ;
  • scale is the quantization scale
  • Scale′ is the limited quantization scale
  • C max is the maximum value among multiple original filter coefficients (C i ) in a set of filter coefficients
  • C i is the original filter coefficient
  • C'i is For the quantization result of the original filter coefficient
  • C" i is the quantization result after restriction
  • Pi luma is the brightness information of the input image.
  • the apparatus 800 further includes:
  • the processing unit 804 saves the quantization scale in an adaptive parameter set (APS).
  • APS adaptive parameter set
  • an adaptive quantization scale (Scale) is used in the quantization of CC-ALF coefficients, thereby obtaining higher accuracy and improving decoding efficiency.
  • the embodiment of the present application provides a filtering device, which corresponds to the method of the second aspect of the embodiment, and the same contents will not be repeated.
  • FIG. 9 is a schematic diagram of a filtering device according to an embodiment of the present application.
  • the filtering device 900 includes: a reading unit 901 and a filtering unit 902.
  • the reading unit 901 obtains from the received code stream The quantization scale Scale; the filtering unit 902 uses the quantization scale Scale to filter the pixels of the input image, and output chrominance compensation information, which is used to compensate the chrominance information of the input image.
  • an adaptive quantization scale (Scale) is used in the quantization of CC-ALF coefficients, thereby obtaining higher accuracy and improving decoding efficiency.
  • FIG. 10 is a schematic diagram of an image encoder according to an embodiment of the present application.
  • the image encoder 1000 according to an embodiment of the present application includes: a luminance filter (SAO Luma) 1001, adaptive loop filter 1002, and chroma filter (ALF Chroma) 1003.
  • SAO Luma luminance filter
  • ALF Chroma chroma filter
  • Luminance filter (SAO Luma) 1001 performs filtering operations on the input image, and outputs the brightness information of the input image; adaptive loop filter 1002 performs a filtering operation on the brightness information of the input image, and outputs chrominance compensation information; a chroma filter (ALF Chroma) 1003 performs a filtering operation on the input image, and outputs the chroma information of the input image.
  • SAO Luma Luminance filter
  • adaptive loop filter 1002 performs a filtering operation on the brightness information of the input image, and outputs chrominance compensation information
  • a chroma filter (ALF Chroma) 1003 performs a filtering operation on the input image, and outputs the chroma information of the input image.
  • the aforementioned chrominance compensation information is used to compensate the chrominance information of the input image
  • the adaptive loop filter 1002 is configured to implement the method of the first aspect of the embodiment, It may include the device of the third aspect of the embodiment, the content of which is incorporated here, and will not be repeated here.
  • the above-mentioned adaptive loop filter 1002 may include a cross-component adaptive loop filter (CC-ALF Cb) for outputting chrominance compensation information for blue, and may also include a cross-component adaptive loop filter (CC-ALF Cb) for outputting red
  • CC-ALF Cb cross-component adaptive loop filter
  • CC-ALF Cr cross-component adaptive loop filter
  • the processing of the luminance filter (SAO Luma) 1001 and the chrominance filter (ALF Chroma) 1003 is not limited, and the prior art can be referred to for details.
  • the embodiment of the present application also provides an image encoder, the image encoder includes a memory and a processor, the memory stores a computer program, and the processor is configured to execute the foregoing computer program to implement the method of the first aspect of the embodiment.
  • the content is merged here, so I won’t repeat it here.
  • the encoder can also include other components, such as the luminance adaptive loop filter (ALF Luma) as shown in Figure 1, the blue chrominance filter (SAO Cb), the red chrominance filter (SAO Cr), etc.
  • ALF Luma luminance adaptive loop filter
  • SAO Cb blue chrominance filter
  • SAO Cr red chrominance filter
  • an adaptive quantization scale (Scale) is used in the quantization of CC-ALF coefficients, thereby obtaining higher accuracy and improving decoding efficiency.
  • FIG. 11 is a schematic diagram of the image decoder of the embodiment of the present application.
  • the image decoder 1100 of the embodiment of the present application also includes: a luminance filter (SAO Luma) 1101, adaptive loop filter 1102, and chroma filter (ALF Chroma) 1103.
  • SAO Luma luminance filter
  • ALF Chroma chroma filter
  • Luma filter (SAO Luma) 1101 performs filtering operations on the input image, and outputs the brightness information of the input image; adaptive loop The filter 1102 performs a filtering operation on the brightness information of the input image and outputs chroma compensation information; the chroma filter (ALF Chroma) 1103 performs a filtering operation on the input image, and outputs the chroma information of the input image.
  • the adaptive loop filter (CC-ALF Cb/Cr) 1102 is used to obtain the quantization scale from the received code stream. , Using the quantization scale to perform a filtering operation on the luminance information of the input image, and output chrominance compensation information, where the chrominance compensation information is used to compensate the chrominance information of the input image.
  • the adaptive loop filter 1102 is configured to implement the method of the second aspect of the embodiment, and may include the device of the fourth aspect of the embodiment, the content of which is incorporated herein, and will not be repeated here.
  • the above-mentioned adaptive loop filter 1102 may include a cross-component adaptive loop filter (CC-ALF Cb) for outputting chrominance compensation information for blue, and may also include a cross-component adaptive loop filter (CC-ALF Cb) for outputting red
  • CC-ALF Cb cross-component adaptive loop filter
  • CC-ALF Cr cross-component adaptive loop filter
  • the processing of the luminance filter (SAO Luma) 1101 and the chrominance filter (ALF Chroma) 1103 is not limited, and the prior art can be referred to for details.
  • An embodiment of the present application further provides an image decoder, including a memory and a processor, the memory stores a computer program, and the processor is configured to execute the above computer program to implement the method of the second aspect of the embodiment, which The content is merged here, so I won’t repeat it here.
  • the decoder may also include other components.
  • the decoder may also include other components.
  • an adaptive quantization scale (Scale) is used in the quantization of CC-ALF coefficients, thereby obtaining higher accuracy and improving decoding efficiency.
  • the seventh aspect of the embodiments of the present application provides an encoding and decoding system, including an image encoder and an image decoder, and the image encoder is configured to: address multiple sets of cross-component adaptive loop filters (CC-ALF) Each group of filter coefficients in the filter coefficients determines a quantization scale; uses the quantization scale corresponding to each group of filter coefficients to quantize each group of filter coefficients to obtain the quantization result of each group of filter coefficients; use the quantization result of each group of filter coefficients to The luminance information of the input image is filtered to obtain the chrominance compensation information; the image decoder is configured to: obtain a quantization scale from the received code stream, use the quantization scale to perform a filtering operation on the luminance information of the input image, and output Chrominance compensation information, where the chrominance compensation information is used to compensate the chrominance information of the input image.
  • CC-ALF cross-component adaptive loop filters
  • An embodiment of the present application provides an image processing device that includes the image encoder according to the fifth aspect of the embodiments, or includes the image decoder according to the sixth aspect of the embodiments, the content of which is combined with this.
  • Fig. 12 is a schematic diagram of an image processing device according to an embodiment of the present application.
  • the image processing device 1200 may include: a central processing unit (CPU) 1201 and a memory 1202; the memory 1202 is coupled to the central processing unit 1201.
  • the memory 1202 can store various data; in addition, it also stores information processing programs, which are executed under the control of the central processing unit 1201.
  • the filtering device of the third aspect or the fourth aspect of the embodiment may be integrated into the central processing unit 1201.
  • the central processing unit 1201 may be configured to implement the method described in the first aspect or the second aspect of the embodiment.
  • the filtering device of the third aspect or the fourth aspect of the embodiment may be configured separately from the central processing unit 1201.
  • the filtering device of the third aspect or the fourth aspect of the embodiment may be configured to be connected to the central processing unit 1201.
  • the chip connected to 1201 realizes the function of the filter device of the third aspect or the fourth aspect of the embodiment through the control of the central processing unit 1201.
  • the image processing device may further include: an input/output (I/O) device 1203, a display 1204, etc.; wherein the functions of the above-mentioned components are similar to those in the prior art, and will not be repeated here. It is worth noting that the image processing device does not have to include all the components shown in FIG. 12; in addition, the image processing device may also include components not shown in FIG. 12, and reference may be made to the prior art.
  • I/O input/output
  • the embodiment of the present application provides a computer-readable program, wherein when the program is executed in an image processing device, the program causes the image processing device to execute the method described in the first aspect or the second aspect of the embodiment .
  • the embodiment of the present application provides a storage medium storing a computer readable program, wherein the computer readable program causes an image processing device to execute the method described in the first aspect or the second aspect of the embodiment.
  • the above devices and methods of this application can be implemented by hardware, or can be implemented by hardware combined with software.
  • This application relates to such a computer-readable program.
  • the logic component can realize the above-mentioned device or constituent component, or the logic component can realize the above-mentioned various methods. Or operation.
  • This application also relates to storage media used to store the above programs, such as hard disks, magnetic disks, optical disks, DVDs, flash memory, etc.
  • the method/device described in conjunction with the embodiments of the present application may be directly embodied as hardware, a software module executed by a processor, or a combination of the two.
  • one or more of the functional block diagrams and/or one or more combinations of the functional block diagrams shown in the figure may correspond to each software module of the computer program flow or each hardware module.
  • These software modules can respectively correspond to the operations shown in the figure.
  • These hardware modules can be implemented by solidifying these software modules by using a field programmable gate array (FPGA), for example.
  • FPGA field programmable gate array
  • the software module can be located in RAM memory, flash memory, ROM memory, EPROM memory, EEPROM memory, registers, hard disk, removable disk, CD-ROM or any other form of storage medium known in the art.
  • a storage medium may be coupled to the processor, so that the processor can read information from the storage medium and write information to the storage medium; or the storage medium may be a component of the processor.
  • the processor and the storage medium may be located in the ASIC.
  • the software module can be stored in the memory of the mobile terminal, or can be stored in a memory card that can be inserted into the mobile terminal.
  • the software module can be stored in the MEGA-SIM card or a large-capacity flash memory device.
  • One or more of the functional blocks described in the drawings and/or one or more combinations of the functional blocks can be implemented as general-purpose processors, digital signal processors (DSPs) for performing the functions described in this application. ), application specific integrated circuit (ASIC), field programmable gate array (FPGA) or other programmable logic device, discrete gate or transistor logic device, discrete hardware component or any appropriate combination thereof.
  • DSPs digital signal processors
  • ASIC application specific integrated circuit
  • FPGA field programmable gate array
  • One or more of the functional blocks described in the drawings and/or one or more combinations of the functional blocks can also be implemented as a combination of computing devices, for example, a combination of a DSP and a microprocessor, or multiple micro-processing Processor, one or more microprocessors in communication with the DSP, or any other such configuration.
  • a filtering method wherein the method includes:
  • the quantization result of each set of filter coefficients is used to perform a filtering operation on the luminance information of the input image to obtain chrominance compensation information.
  • determining the quantization scale includes:
  • determining the quantization scale further includes:
  • the quantization scale (Scale) is restricted to the first range to obtain a restricted quantization scale (Scale').
  • the second range is determined according to the number of bits representing the quantization result, and the quantization result (C' i ) is limited to the second range to obtain the limited quantization result (C" i ).
  • the luminance information of the input image is filtered to obtain chrominance compensation information, which is used as the cross-component adaptation
  • the output of the loop filter (CC-ALF) is used as the cross-component adaptation
  • the quantization scale is calculated according to the following formula:
  • scale is the quantization scale
  • Scale′ is the limited quantization scale
  • C max is the maximum value among multiple original filter coefficients (C i ) in a set of filter coefficients
  • C i is the original filter coefficient
  • C'i is As for the quantization result of the original filter coefficient
  • C" i is the limited quantization result
  • Pi luma is the brightness information of the input image.
  • the quantization scale is calculated according to the following formula:
  • scale is the quantization scale
  • Scale′ is the limited quantization scale
  • C max is the maximum value among multiple original filter coefficients (C i ) in a set of filter coefficients
  • C i is the original filter coefficient
  • C'i is For the quantization result of the original filter coefficient
  • C" i is the quantization result after restriction
  • Pi luma is the brightness information of the input image.
  • the quantization scale is stored in the adaptive parameter set (APS).
  • An image encoder comprising a memory and a processor, the memory storing a computer program, and the processor is configured to execute the above computer program to implement the following method:
  • the quantization result of each set of filter coefficients is used to perform a filtering operation on the luminance information of the input image to obtain chrominance compensation information.
  • An image decoder comprising a memory and a processor, the memory storing a computer program, and the processor is configured to execute the above computer program to implement the following method:
  • the quantization scale from the received code stream, use the quantization scale to filter the luminance information of the input image, and output chrominance compensation information.
  • the chrominance compensation information is used to perform the chrominance information of the input image. make up.
  • An encoding and decoding system including an image encoder and an image decoder
  • the image encoder is configured to: determine a quantization scale for each group of filter coefficients in a plurality of sets of filter coefficients of a cross-component adaptive loop filter (CC-ALF); use a pair of quantization scales corresponding to each group of filter coefficients Perform a quantization operation on each set of filter coefficients to obtain a quantization result of each set of filter coefficients; use the quantization result of each set of filter coefficients to perform a filtering operation on the luminance information of the input image to obtain chrominance compensation information;
  • CC-ALF cross-component adaptive loop filter
  • the image decoder is configured to: obtain a quantization scale from the received code stream, use the quantization scale to perform a filtering operation on the luminance information of the input image, and output chrominance compensation information.
  • the chrominance compensation information is used to The chrominance information of the input image is compensated.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Compression Or Coding Systems Of Tv Signals (AREA)

Abstract

Des modes de réalisation de l'invention concernent un procédé et un dispositif de filtrage. Le procédé consiste à : déterminer une échelle de quantification pour chacun de multiples ensembles de coefficients de filtre d'un filtre à boucle adaptatif à composante transversale (CC-ALF) ; effectuer une opération de quantification sur chaque ensemble de coefficients de filtre à l'aide de l'échelle de quantification lui correspondant, de façon à obtenir un résultat de quantification pour chaque ensemble de coefficients de filtre ; et utiliser les résultats de quantification d'ensembles respectifs de coefficients de filtre pour effectuer une opération de filtrage sur des informations de luminance d'une image d'entrée, de façon à obtenir des informations de compensation de chrominance. Dans la présente demande, des coefficients de filtre respectifs dans chaque ensemble de coefficients de filtre sont quantifiés à l'aide d'une seule échelle de quantification, puis des informations de luminance d'une image d'entrée sont filtrées sur la base des résultats de quantification, de façon à obtenir des informations de compensation de chrominance, améliorant ainsi l'efficacité de codage et de décodage.
PCT/CN2019/129144 2019-12-27 2019-12-27 Dispositif et procédé de filtrage WO2021128265A1 (fr)

Priority Applications (1)

Application Number Priority Date Filing Date Title
PCT/CN2019/129144 WO2021128265A1 (fr) 2019-12-27 2019-12-27 Dispositif et procédé de filtrage

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2019/129144 WO2021128265A1 (fr) 2019-12-27 2019-12-27 Dispositif et procédé de filtrage

Publications (1)

Publication Number Publication Date
WO2021128265A1 true WO2021128265A1 (fr) 2021-07-01

Family

ID=76573520

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2019/129144 WO2021128265A1 (fr) 2019-12-27 2019-12-27 Dispositif et procédé de filtrage

Country Status (1)

Country Link
WO (1) WO2021128265A1 (fr)

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102710936A (zh) * 2011-01-04 2012-10-03 香港中文大学 用于视频压缩的高性能环路滤波器
US20140286392A1 (en) * 2011-11-09 2014-09-25 Sk Telecom Co., Ltd. Method and apparatus for encoding/decoding image by using adaptive loop filter on frequency domain using conversion
CN105306957A (zh) * 2015-10-23 2016-02-03 北京中星微电子有限公司 自适应环路滤波方法和设备
CN107431814A (zh) * 2015-01-08 2017-12-01 微软技术许可有限责任公司 ρ域速率控制的变化

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102710936A (zh) * 2011-01-04 2012-10-03 香港中文大学 用于视频压缩的高性能环路滤波器
US20140286392A1 (en) * 2011-11-09 2014-09-25 Sk Telecom Co., Ltd. Method and apparatus for encoding/decoding image by using adaptive loop filter on frequency domain using conversion
CN107431814A (zh) * 2015-01-08 2017-12-01 微软技术许可有限责任公司 ρ域速率控制的变化
CN105306957A (zh) * 2015-10-23 2016-02-03 北京中星微电子有限公司 自适应环路滤波方法和设备

Similar Documents

Publication Publication Date Title
JP7490102B2 (ja) ビデオ処理における非線形適応ループフィルタリング
TW202101979A (zh) 具有適應性參數集之適應性迴路濾波器
JP7256293B2 (ja) 符号化映像における二次変換の使用
JP2018078611A (ja) サンプルアダプティブオフセット制御
TWI737137B (zh) 視訊編碼之非線性適應性迴圈濾波方法和裝置
CN113950829A (zh) 简化的变换编解码工具
US11778235B2 (en) Signaling coding of transform-skipped blocks
EP4006825A1 (fr) Procédé et appareil de traitement d'image, dispositif informatique et support de stockage
US11228787B2 (en) Signaling multiple transmission selection
WO2020094154A1 (fr) Améliorations apportées à un filtre à boucle adaptatif basé sur des régions
WO2024016520A1 (fr) Procédé, système et dispositif de compression vidéo, et support de stockage non volatil lisible par ordinateur
CN113994666A (zh) 隐式选择变换候选
US10757424B2 (en) FLC-based image compression method and device
WO2024114432A1 (fr) Procédé et dispositif de décalage adaptatif d'échantillon dans un codage vidéo
JP2018530278A (ja) 一連のピクチャをエンコード及びデコードする方法及びデバイス、並びに対応するコンピュータプログラム製品及びコンピュータ読取可能媒体
US20220094929A1 (en) Applicability of implicit transform selection
US20230023387A1 (en) Low complexity image filter
JP2018019239A (ja) 撮像装置及びその制御方法及びプログラム
WO2021128265A1 (fr) Dispositif et procédé de filtrage
US11917144B2 (en) Efficient in-loop filtering for video coding
WO2021203381A1 (fr) Procédé et appareil de codage et de décodage vidéo et support de stockage lisible par ordinateur
WO2021196234A1 (fr) Procédé et dispositif de codage et décodage vidéo, et support de stockage
WO2021054437A1 (fr) Dispositif et procédé de traitement d'image
WO2021128277A1 (fr) Procédé et appareil de filtrage à boucle adaptatif inter-composantes et dispositif de codage et de décodage vidéo
WO2018068263A1 (fr) Procédé et dispositif de codage d'images, et appareil de traitement d'images

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 19957201

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 19957201

Country of ref document: EP

Kind code of ref document: A1