WO2022116054A1 - 图像处理方法、系统、视频编码器及视频解码器 - Google Patents

图像处理方法、系统、视频编码器及视频解码器 Download PDF

Info

Publication number
WO2022116054A1
WO2022116054A1 PCT/CN2020/133427 CN2020133427W WO2022116054A1 WO 2022116054 A1 WO2022116054 A1 WO 2022116054A1 CN 2020133427 W CN2020133427 W CN 2020133427W WO 2022116054 A1 WO2022116054 A1 WO 2022116054A1
Authority
WO
WIPO (PCT)
Prior art keywords
pixel
boundary
filtered
pixel point
column
Prior art date
Application number
PCT/CN2020/133427
Other languages
English (en)
French (fr)
Inventor
唐桐
Original Assignee
Oppo广东移动通信有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Oppo广东移动通信有限公司 filed Critical Oppo广东移动通信有限公司
Priority to CN202080107384.0A priority Critical patent/CN116547973A/zh
Priority to PCT/CN2020/133427 priority patent/WO2022116054A1/zh
Publication of WO2022116054A1 publication Critical patent/WO2022116054A1/zh
Priority to US18/323,355 priority patent/US20230300329A1/en

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/85Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using pre-processing or post-processing specially adapted for video compression
    • H04N19/86Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using pre-processing or post-processing specially adapted for video compression involving reduction of coding artifacts, e.g. of blockiness
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/117Filters, e.g. for pre-processing or post-processing
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/103Selection of coding mode or of prediction mode
    • H04N19/105Selection of the reference unit for prediction within a chosen coding or prediction mode, e.g. adaptive choice of position and number of pixels used for prediction
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/134Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
    • H04N19/136Incoming video signal characteristics or properties
    • H04N19/14Coding unit complexity, e.g. amount of activity or edge presence estimation
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/169Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
    • H04N19/17Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object
    • H04N19/176Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a block, e.g. a macroblock
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/80Details of filtering operations specially adapted for video compression, e.g. for pixel interpolation

Definitions

  • the embodiments of the present application relate to the field of image processing, and more particularly, to an image processing method, system, video encoder, and video decoder.
  • DBF Deblocking Filter
  • the current method of judging whether to filter the block boundary will cause a problem of filtering.
  • Embodiments of the present application provide an image processing method, system, video encoder, and video decoder, which are used to accurately determine whether to filter block boundaries to reduce filtering.
  • an image processing method is provided, applied to a video encoder, including:
  • the partial or complete reconstructed image includes one or more reconstructed image blocks
  • the joint progressive feature of the boundary to be filtered is determined according to the pixel values of the pixels on both sides of the boundary to be filtered;
  • an embodiment of the present application provides an image processing method, which is applied to a video decoder, including:
  • decoding the code stream to obtain a partial or complete reconstructed image, wherein the partial or complete reconstructed image includes one or more reconstructed image blocks;
  • the joint progressive feature of the boundary to be filtered is determined according to the pixel values of the pixels on both sides of the boundary to be filtered;
  • a video encoder for performing the method in the above-mentioned first aspect or each of its implementations.
  • the encoder includes a functional unit for executing the method in the above-mentioned first aspect or each of its implementations.
  • a video decoder for performing the method in the above-mentioned second aspect or each of its implementations.
  • the decoder includes functional units for performing the methods in the second aspect or the respective implementations thereof.
  • a video encoder including a processor and a memory.
  • the memory is used for storing a computer program
  • the processor is used for calling and running the computer program stored in the memory, so as to execute the method in the above-mentioned first aspect or each implementation manner thereof.
  • a video decoder including a processor and a memory.
  • the memory is used for storing a computer program
  • the processor is used for calling and running the computer program stored in the memory, so as to execute the method in the above-mentioned second aspect or each implementation manner thereof.
  • an image processing system including a video encoder and a video decoder.
  • the video encoder is used to perform the method in the first aspect or each of its implementations
  • the video decoder is used to perform the method in the above-mentioned second aspect or each of its implementations.
  • a chip for implementing any one of the above-mentioned first aspect to the second aspect or the method in each implementation manner thereof.
  • the chip includes: a processor for calling and running a computer program from a memory, so that a device installed with the chip executes any one of the above-mentioned first to second aspects or each of its implementations method.
  • a computer-readable storage medium for storing a computer program, the computer program causing a computer to execute the method in any one of the above-mentioned first aspect to the second aspect or each of its implementations.
  • a computer program product comprising computer program instructions, the computer program instructions causing a computer to perform the method in any one of the above-mentioned first to second aspects or the implementations thereof.
  • a computer program which, when run on a computer, causes the computer to perform the method in any one of the above-mentioned first to second aspects or the respective implementations thereof.
  • the joint progressive feature of the border to be filtered is determined by the pixel values of the pixels on both sides of the border to be filtered, and the joint progressive feature can reflect that the pixel value of the pixel at the border to be filtered
  • the pixel values of the pixels at both ends of the boundary are concave or convex, that is to say, the joint progressive feature can truly reflect whether the boundary to be filtered is a real boundary, so whether to The filtering of the boundary to be filtered can improve the accuracy of the filtering judgment, thereby preventing the real boundary from being filtered.
  • FIG. 1 is a schematic block diagram of a video encoding and decoding system 100 involved in an embodiment of the present application
  • FIG. 2 is a schematic block diagram of a video encoder 200 provided by an embodiment of the present application.
  • FIG. 3 is a schematic block diagram of a decoding framework 300 provided by an embodiment of the present application.
  • FIG. 4 is a schematic flowchart of an image processing method 400 provided by an embodiment of the present application.
  • 5A is a schematic diagram of a first border region involved in an embodiment of the present application.
  • 5B is a schematic diagram of a second boundary region involved in an embodiment of the present application.
  • 5C is a schematic diagram of a curve formed by pixel values of pixel points on both sides of a boundary to be filtered according to an embodiment of the present application;
  • FIG. 6 is a schematic flowchart of an image processing method 500 provided by an embodiment of the present application.
  • FIG. 7 is a schematic flowchart of a filtering method provided by an embodiment of the present application.
  • FIG. 8 is a schematic flowchart of an image processing method 600 provided by an embodiment of the present application.
  • FIG. 9 is a schematic flowchart of an image transmission processing method 700 provided by an embodiment of the present application.
  • FIG. 10 is a schematic block diagram of a video encoder 800 provided by an embodiment of the present application.
  • FIG. 11 is a schematic block diagram of a video decoder 900 provided by an embodiment of the present application.
  • FIG. 12 is a schematic block diagram of an electronic device 10 provided by an embodiment of the present application.
  • FIG. 13 is a schematic block diagram of an image processing system 20 provided by an embodiment of the present application.
  • the present application can be applied to the field of image encoding and decoding, the field of video encoding and decoding, the field of hardware video encoding and decoding, the field of dedicated circuit video encoding and decoding, the field of real-time video encoding and decoding, and the like.
  • AVC Audio Video coding Standard
  • HEVC High Efficiency Video Coding
  • VVC Versatile Video Coding
  • the schemes of the present application may operate in conjunction with other proprietary or industry standards including ITU-TH.261, ISO/IECMPEG-1 Visual, ITU-TH.262 or ISO/IECMPEG-2 Visual, ITU-TH.263 , ISO/IECMPEG-4Visual, ITU-TH.264 (also known as ISO/IECMPEG-4AVC), including Scalable Video Codec (SVC) and Multi-View Video Codec (MVC) extensions.
  • SVC Scalable Video Codec
  • MVC Multi-View Video Codec
  • FIG. 1 For ease of understanding, the video coding and decoding system involved in the embodiments of the present application is first introduced with reference to FIG. 1 .
  • FIG. 1 is a schematic block diagram of a video encoding and decoding system 100 according to an embodiment of the present application.
  • the video codec system 100 includes an encoding device 110 and a decoding device 120 .
  • the encoding device is used to encode the video data (which can be understood as compression) to generate a code stream, and transmit the code stream to the decoding device.
  • the decoding device decodes the code stream encoded by the encoding device to obtain video data.
  • the encoding and decoding devices may include one or more processors and one or more memories.
  • the memory may include, but is not limited to, RAM, ROM, EEPROM, flash memory, or any other medium that can be used to store the desired program code in the form of instructions or data structures that can be accessed by a computer.
  • the encoding device 110 in this embodiment of the present application may be understood as a device with a video encoding function
  • the decoding device 120 may be understood as a device with a video decoding function, that is, the encoding device 110 and the decoding device 120 in the embodiments of the present application include a wider range of devices, Examples include smartphones, desktop computers, mobile computing devices, notebook (eg, laptop) computers, tablet computers, set-top boxes, televisions, cameras, display devices, digital media players, video game consoles, in-vehicle computers, and the like.
  • the encoding device 110 may transmit the encoded video data (eg, a code stream) to the decoding device 120 via the channel 130 .
  • Channel 130 may include one or more media and/or devices capable of transmitting encoded video data from encoding device 110 to decoding device 120 .
  • channel 130 includes one or more communication media that enables encoding device 110 to transmit encoded video data directly to decoding device 120 in real-time.
  • encoding apparatus 110 may modulate the encoded video data according to a communication standard and transmit the modulated video data to decoding apparatus 120 .
  • the communication medium includes a wireless communication medium, such as a radio frequency spectrum, optionally, the communication medium may also include a wired communication medium, such as one or more physical transmission lines.
  • channel 130 includes a storage medium that can store video data encoded by encoding device 110 .
  • Storage media include a variety of locally accessible data storage media such as optical discs, DVDs, flash memory, and the like.
  • the decoding apparatus 120 may obtain the encoded video data from the storage medium.
  • channel 130 may include a storage server that may store video data encoded by encoding device 110 .
  • the decoding device 120 may download the stored encoded video data from the storage server.
  • the storage server may store the encoded video data and may transmit the encoded video data to the decoding device 120, such as a web server (eg, for a website), a file transfer protocol (FTP) server, and the like.
  • FTP file transfer protocol
  • encoding apparatus 110 includes video encoder 112 and output interface 113 .
  • the output interface 113 may include a modulator/demodulator (modem) and/or a transmitter.
  • encoding device 110 may include video source 111 in addition to video encoder 112 and input interface 113 .
  • the video source 111 may include at least one of a video capture device (eg, a video camera), a video archive, a video input interface, a computer graphics system for receiving video data from a video content provider, a computer graphics system Used to generate video data.
  • a video capture device eg, a video camera
  • a video archive e.g., a video archive
  • a video input interface e.g., a video input interface
  • a computer graphics system for receiving video data from a video content provider e.g., a computer graphics system Used to generate video data.
  • the video encoder 112 encodes the video data from the video source 111 to generate a code stream.
  • Video data may include one or more pictures or a sequence of pictures.
  • the code stream contains the encoding information of the image or image sequence in the form of bit stream.
  • the encoded information may include encoded image data and associated data.
  • the associated data may include a sequence parameter set (Sequence Parameter Set, SPS for short), a Picture Parameter Set (Picture Parameter Set, PPS for short), and other syntax structures.
  • SPS Sequence Parameter Set
  • PPS Picture Parameter Set
  • An SPS may contain parameters that apply to zero or more sequences.
  • a PPS may contain parameters that apply to zero or more images.
  • a syntax structure refers to a set of zero or more syntax elements in a codestream arranged in a specified order.
  • the video encoder 112 may partition the image into a grid of Coding Tree Blocks (CTBs).
  • CTB Coding Tree Blocks
  • a CTB may be referred to as a "tree block", a "largest coding unit” (Largest Coding Block, LCU for short), or a "coding tree unit”.
  • a CTB may include one or more coding units (Coding Units, CUs for short).
  • Each CTB may be associated with a block of pixels of equal size within the image.
  • Each pixel may correspond to one luminance (luma) sample and two chrominance (chrominance or chroma) samples.
  • each CTB may be associated with one block of luma samples and two blocks of chroma samples.
  • the CTB of an image can be divided into one or more strips.
  • each stripe contains an integer number of CTBs.
  • video encoder 112 may generate encoding information for each slice of the picture, ie, encode the CTBs within the slice.
  • video encoder 112 may perform quadtree partitioning on the pixel blocks associated with the CTB to partition the pixel blocks associated with the CTB into smaller pixel blocks, the smaller pixel blocks.
  • a block can be associated with a CU.
  • the video encoder 112 directly transmits the encoded video data to the decoding device 120 via the output interface 113 .
  • the encoded video data may also be stored on a storage medium or a storage server for subsequent reading by the decoding device 120 .
  • decoding device 120 includes input interface 121 and video decoder 122 .
  • the decoding device 120 may include a display device 123 in addition to the input interface 121 and the video decoder 122 .
  • the input interface 121 includes a receiver and/or a modem.
  • the input interface 121 may receive the encoded video data through the channel 130 .
  • the video decoder 122 is configured to decode the encoded video data, obtain the decoded video data, and transmit the decoded video data to the display device 123 .
  • the display device 123 displays the decoded video data.
  • the display device 123 may be integrated with the decoding apparatus 120 or external to the decoding apparatus 120 .
  • the display device 123 may include various display devices, such as a liquid crystal display (LCD), a plasma display, an organic light emitting diode (OLED) display, or other types of display devices.
  • LCD liquid crystal display
  • plasma display a plasma display
  • OLED organic light emitting diode
  • FIG. 1 is only an example, and the technical solutions of the embodiments of the present application are not limited to FIG. 1 .
  • the technology of the present application may also be applied to single-side video encoding or single-side video decoding.
  • Video encoder 112 and video decoder 122 include one or more processors, including, for example, one or more microprocessors, digital signal processors (DSPs), application specific integrated circuits (ASICs), field programmable gate arrays (FPGAs) or any combination thereof. If some or all of the techniques of the present application are implemented in software, the video encoder 112 and the video decoder 122 further include one or more memories for storing computer instructions, and one or more processors execute these technical instructions to implement the present application. applied technology.
  • FIG. 2 is a schematic block diagram of a video encoder 200 provided by an embodiment of the present application. It should be understood that the video encoder 200 can be used to perform lossy compression on images, and can also be used to perform lossless compression on images.
  • the lossless compression may be visually lossless compression (visually lossless compression) or mathematically lossless compression (mathematically lossless compression).
  • the video encoder 200 can be applied to image data in luminance chrominance (YcbCr, YUV) format.
  • the YUV ratio can be 4:2:0, 4:2:2 or 4:4:4, Y represents the luminance (Luma), Cb(U) represents the blue chromaticity, Cr(V) represents the red chromaticity, U and V are expressed as chroma (Chroma) to describe color and saturation.
  • 4:2:0 means that every 4 pixels has 4 luma components
  • 2 chrominance components YYYYCbCr
  • 4:2:2 means that every 4 pixels has 4 luma components
  • 4 Chroma component YYYYCbCrCbCr
  • 4:4:4 means full pixel display (YYYYCbCrCbCrCbCrCbCr).
  • video encoder 200 may read unequal pixels, including luma and chroma components, for digital video in different color formats.
  • the video encoder 200 can read a pair of black and white or color images, that is, the image to be encoded.
  • the video encoder 200 divides the to-be-encoded image into block data, and performs encoding based on the block data.
  • the video encoder 200 reads video data, and for each frame of image in the video data, divides one frame of image into several coding tree units (Coding Tree Units, CTUs), one CTU is divided into one luminance CTB and two For chrominance CTB, the CTB size is 16, 32, or 64, for example.
  • CTUs Coding Tree Units
  • a CTU can be further divided into several coding units (Coding Unit, CU) for coding, and the CU can be a rectangular block or a square block.
  • the CU is further divided into a prediction unit (PU for short) and a transform unit (TU for short), so that coding, prediction, and transformation are separated and processing is more flexible.
  • a CTU is divided into CUs in a quad-tree manner, and the CU is, for example, 64x64 at the maximum and 8x8 at the minimum, and the CU is divided into TUs and PUs in a quad-tree manner.
  • There is no deterministic relationship with TU allowing TU to span multiple PUs, but in intra-frame prediction, one PU can correspond to multiple TUs, and one TU corresponds to at most one PU.
  • the video encoder may encode the CUs according to a zigzag scan order.
  • the video encoder may encode the CU as an upper left CU, an upper right CU, a lower left CU, and then a lower right CU.
  • the video encoder may encode the CUs associated with sub-blocks of pixel blocks of the partitioned CU according to a folded scan order.
  • a video encoder may encode the CUs according to a raster scan order.
  • Video encoders and video decoders may support various PU sizes. Assuming the size of a particular CU is 2Nx2N, video encoders and video decoders may support PU sizes of 2Nx2N or NxN for intra prediction, and support 2Nx2N, 2NxN, Nx2N, NxN or similar sized symmetric PUs for inter prediction. Video encoders and video decoders may also support 2NxnU, 2NxnD, nLx2N, and nRx2N asymmetric PUs for inter prediction.
  • the video encoder 200 may include: a prediction unit 210, a residual unit 220, a transform and quantization unit 230, an inverse transform and quantization unit 240, a reconstruction unit 250, a filtering unit 260, a decoded image Buffer 270 and header information decoding unit or entropy decoding unit 280. It should be noted that the video encoder 200 may include more, less or different functional components.
  • the prediction unit 210 may predict the image block to be encoded with reference to adjacent image blocks of the image frame to be encoded to output the predicted block.
  • the residual unit 220 may calculate a residual block based on the prediction block and the image block to be encoded, that is, the difference between the prediction block and the image block to be encoded, and the residual block may also be referred to as residual information.
  • the residual block can be transformed and quantized by the transform and quantization unit 230 to remove information insensitive to human eyes, so as to eliminate visual redundancy.
  • the residual block before transformation and quantization by the transform and quantization unit 230 may be referred to as a time domain residual block
  • the time domain residual block after transformation and quantization by the transform and quantization unit 230 may be referred to as a frequency residual block or a frequency residual block.
  • the header information decoding unit or the entropy decoding unit 280 receives the quantized variation coefficient output by the variation quantization unit 230, and can perform entropy coding on the quantized variation coefficient to output a code stream.
  • the header information decoding unit or the entropy decoding unit 280 may eliminate character redundancy according to the target context model and the probability information of the binary code stream.
  • the image block to be encoded may also be referred to as an original image block
  • a prediction block may also be referred to as a predicted image block or an image prediction block
  • a reconstructed image block may also be referred to as a reconstructed block or an image reconstructed image. piece.
  • prediction unit 210 includes an inter prediction unit 211 and an intra estimation unit 212 .
  • the intra-frame estimation unit 212 only refers to the information of the same frame of image, and predicts the pixel information in the to-be-coded image block, so as to eliminate the spatial redundancy.
  • Frames used for intra prediction may be I-frames.
  • the inter-frame prediction unit 211 can be used for inter-frame prediction, and the inter-frame prediction can refer to the image information of different frames, and use motion estimation to search for the motion vector information that best matches the image block to be encoded, so as to eliminate temporal redundancy;
  • the frames may be P frames and/or B frames, where P frames refer to forward predicted frames and B frames refer to bidirectional predicted frames.
  • Intra prediction can predict the image block to be coded by means of angular prediction mode and non-angular prediction mode.
  • the H.264/AVC standard involves 8 angle prediction modes and 1 non-angle prediction mode;
  • the H.265/HEVC standard involves 33 angle prediction modes and 2 non-angle prediction modes Prediction mode:
  • the H.266/VVC standard involves 67 prediction modes, including 2 non-angle prediction modes, extending the angle mode from 33 to 65 in H.265.
  • the intra-frame prediction will be more accurate and more in line with the demand for the development of high-definition and ultra-high-definition digital video.
  • Residual unit 220 may generate a residual block of the CU based on the pixel blocks of the CU and the prediction blocks of the PUs of the CU. For example, residual unit 220 may generate a residual block of the CU such that each sample in the residual block has a value equal to the difference between the samples in the CU's pixel block, and the CU's PU's Corresponding samples in the prediction block.
  • Transform quantization unit 230 may generate transform coefficients for each TU of the CU by applying one or more transforms to the block of residual samples associated with the TU. For example, transform quantization unit 230 may apply a discrete cosine transform (DCT), a directional transform, or a conceptually similar transform to the residual block.
  • DCT discrete cosine transform
  • Transform quantization unit 230 may quantize transform coefficients. Transform quantization unit 230 may quantize transform coefficients associated with TUs of the CU based on quantization parameter (QP) values associated with the CU. Video encoder 200 may adjust the degree of quantization applied to transform coefficients associated with the CU by adjusting the QP value associated with the CU.
  • QP quantization parameter
  • Inverse transform quantization unit 240 may apply inverse quantization and inverse transform, respectively, to the quantized transform coefficients to reconstruct a residual block from the quantized transform coefficients.
  • Reconstruction unit 250 may add the samples of the reconstructed residual block to corresponding samples of the one or more prediction blocks generated by prediction unit 210 to generate a reconstructed image block associated with the TU. By reconstructing the block of samples for each TU of the CU in this manner, video encoder 200 may reconstruct the block of pixels of the CU.
  • Filtering unit 260 may perform deblocking filtering operations to reduce blocking artifacts for pixel blocks associated with the CU.
  • the filtering unit 260 includes a deblocking filtering unit 261 and a sample adaptive compensation/adaptive loop filtering (SAO/ALF) unit 262, wherein the deblocking filtering unit 261 is used for deblocking, SAO/ALF Unit 262 is used to remove ringing effects.
  • SAO/ALF sample adaptive compensation/adaptive loop filtering
  • the deblocking filtering unit 261 in this embodiment of the present application may also be used to determine the boundary to be filtered of the reconstructed image block, and to determine the boundary to be filtered according to the encoding information of the first image block and the second image block adjacent to both sides of the boundary to be filtered.
  • the boundary filtering strength is greater than the first preset value
  • the joint progressive feature of the border to be filtered is determined according to the pixel values of the pixels on both sides of the border to be filtered, and the joint progressive feature of the border to be filtered is used to indicate Whether the boundary to be filtered is a real boundary; according to the joint progressive feature of the boundary to be filtered, it is determined whether to filter the boundary to be filtered.
  • the boundary to be filtered is a vertical boundary
  • the first boundary area formed by the first image block and the second image block includes N rows of pixels.
  • the deblocking filtering unit 261 uses the i-th row of pixels in the first boundary area.
  • the difference between the pixel values of the pixels at both ends and the pixel value of the middle pixel determine the i-th line parameter, where i is a positive integer greater than or equal to 1 and less than or equal to N; the first line parameter to the Nth line
  • At least one row parameter in the parameters is determined as the joint progressive feature of the boundary to be filtered, and whether to filter the boundary to be filtered is determined according to the joint progressive feature of the boundary to be filtered. For example, when the parameters in the first row to the Nth row of parameters are When at least two parameters are greater than or equal to the second preset value, it is determined that the boundary to be filtered is not filtered.
  • the joint progressive feature can truly reflect whether the boundary to be filtered is a real boundary, determining whether to filter the boundary to be filtered based on the joint progressive feature can improve the accuracy of the filtering judgment, thereby preventing the video encoder 200 from interpreting the real boundary. filter the boundaries.
  • the decoded image buffer 270 may store the reconstructed pixel blocks.
  • Inter-prediction unit 211 may use the reference picture containing the reconstructed pixel block to perform inter-prediction on PUs of other pictures.
  • intra-prediction unit 212 may use the reconstructed pixel blocks in decoded picture buffer 270 to perform intra-prediction on other PUs in the same picture as the CU.
  • Header decoding unit or entropy decoding unit 280 may receive the quantized transform coefficients from transform quantization unit 230 .
  • the header decoding unit or entropy decoding unit 280 may perform one or more entropy encoding operations on the quantized transform coefficients to generate entropy encoded data.
  • header decoding unit or entropy decoding unit 280 may perform context adaptive variable length coding (CAVLC) operations, context based adaptive binary arithmetic coding (CABAC) operations, variable to variable (V2V) operations on the data ) length codec operations, syntax-based context adaptive binary arithmetic codec (SBAC) operations, probabilistic interval partitioning entropy (PIPE) codec operations, or other types of entropy encoding operations.
  • CAVLC context adaptive variable length coding
  • CABAC context based adaptive binary arithmetic coding
  • V2V variable to variable
  • SBAC syntax-based context adaptive binary arithmetic codec
  • PIPE probabilistic interval partitioning entropy
  • FIG. 3 is a schematic block diagram of a decoding framework 300 provided by an embodiment of the present application.
  • the video decoder 300 includes a header information decoding unit or entropy decoding unit 310 , a prediction unit 320 , an inverse quantization transform unit 330 , a reconstruction unit 340 , a filtering unit 350 , and a decoded image buffer 360 . It should be noted that the video decoder 300 may include more, less or different functional components.
  • the prediction block and the frequency domain residual block are obtained, and for the frequency domain residual block, the inverse quantization and transformation unit 330 performs steps such as inverse transformation and inverse quantization, which can be Get the temporal residual block.
  • the reconstruction unit 340 superimposes the prediction block predicted by the prediction unit 320 and passes through the temporal residual block passed by the inverse quantization and transformation unit 330 to obtain a reconstructed image block.
  • the video decoder 300 may receive the code stream.
  • the header decoding unit or entropy decoding unit 310 may parse the codestream to extract syntax elements from the codestream. As part of parsing the codestream, the header decoding unit or entropy decoding unit 310 may parse the entropy-encoded syntax elements in the codestream.
  • the prediction unit 320, the inverse quantization and transform unit 330, the reconstruction unit 340, and the filtering unit 350 may decode the video data according to the syntax elements extracted from the codestream, ie, generate decoded video data.
  • prediction unit 320 includes intra prediction unit 321 and inter estimation unit 322 .
  • Intra-prediction unit 321 may perform intra-prediction to generate prediction blocks for the PU. Intra-prediction unit 321 may use an intra-prediction mode to generate prediction blocks for a PU based on pixel blocks of spatially neighboring PUs. Intra-prediction unit 321 may also determine an intra-prediction mode for the PU from one or more syntax elements parsed from the codestream.
  • Inter estimation unit 322 may construct a first reference picture list (List 0) and a second reference picture list (List 1) from the syntax elements parsed from the codestream. Furthermore, if the PU is encoded using inter-frame prediction, the header information decoding unit or entropy decoding unit 310 may parse the motion information of the PU. Inter estimation unit 322 may determine one or more reference blocks for the PU from the motion information of the PU. Inter estimation unit 322 may generate a prediction block for the PU from one or more reference blocks of the PU.
  • the inverse quantization transform unit 330 inversely quantizes (ie, dequantizes) the transform coefficients associated with the TUs. Inverse quantization transform unit 330 may use the QP value associated with the CU of the TU to determine the degree of quantization.
  • inverse quantizing transform unit 330 may apply one or more inverse transforms to the inverse quantizing transform coefficients to generate a residual block associated with the TU.
  • the inverse quantized transform coefficients can be inverse DCT, inverse integer transform, inverse Karhunen-Loeve transform (KLT), inverse rotational transform, inverse directional transform, or other transforms corresponding to the encoding end.
  • KLT Karhunen-Loeve transform
  • An inverse transform is applied to the inverse quantized transform coefficients, resulting in a residual block.
  • Reconstruction unit 340 uses the residual blocks associated with the TUs of the CU and the prediction blocks of the PUs of the CU to reconstruct the pixel blocks of the CU. For example, reconstruction unit 340 may add samples of the residual block to corresponding samples of the prediction block to reconstruct the pixel block of the CU, resulting in a reconstructed image block.
  • Filtering unit 350 may perform deblocking filtering operations to reduce blocking artifacts for pixel blocks associated with the CU.
  • the filtering unit 350 includes: a deblocking filtering unit 351 and a sample adaptive compensation/adaptive loop filtering (SAO/ALF) unit 352, wherein the deblocking filtering unit 351 is used for deblocking, SAO/ALF ALF unit 352 is used to remove ringing effects.
  • SAO/ALF ALF unit 352 is used to remove ringing effects.
  • the deblocking filtering unit 351 in the application embodiment can also be used to determine the boundary to be filtered of the reconstructed image block, and determine the boundary of the boundary to be filtered according to the coding information of the first image block and the second image block adjacent to both sides of the boundary to be filtered.
  • the boundary filtering strength when the boundary filtering strength is greater than the first preset value, the joint progressive feature of the boundary to be filtered is determined according to the pixel values of the pixels on both sides of the boundary to be filtered, and the joint progressive feature of the boundary to be filtered is used to indicate the boundary to be filtered. Whether the filtering boundary is a real boundary; and according to the joint progressive feature of the boundary to be filtered, it is determined whether to filter the boundary to be filtered.
  • the boundary to be filtered is a vertical boundary
  • the first boundary area formed by the first image block and the second image block includes N rows of pixel points
  • the deblocking filtering unit 351 determines the pixel points of the i-th row of the first boundary area according to the two
  • the difference between the pixel value of the end pixel and the pixel value of the middle pixel determines the parameter of the i-th row, where i is a positive integer greater than or equal to 1 and less than or equal to N
  • At least one row parameter of the to-be-filtered boundary is determined as the joint progressive feature of the to-be-filtered boundary, and it is determined whether to filter the to-be-filtered boundary according to the joint progressive characteristic of the to-be-filtered boundary, for example, when at least two of the parameters in the first row to the Nth row parameter When each parameter is greater than or equal to the second preset value, it is determined that the boundary to be filtered is not filtered.
  • the joint progressive feature can truly reflect whether the boundary to be filtered is a real boundary, determining whether to filter the boundary to be filtered based on the joint progressive feature can improve the accuracy of the filtering judgment, thereby reducing the need for the video decoder 300 to perform filtering.
  • the true boundary is filtered.
  • Video decoder 300 may store the reconstructed images of the CU in decoded image buffer 360 .
  • the video decoder 300 may use the reconstructed image in the decoded image buffer 360 as a reference image for subsequent prediction, or transmit the reconstructed image to a display device for presentation.
  • Deblocking filtering includes the following steps:
  • Determine the filtering boundary for example, determine the filtering boundary from the reconstructed image block according to a preset rule.
  • Different video encoders or video decoders may have different methods for selecting the filtering boundary. Exemplarily, for a 4-pixel length boundary on an image, whether to process or not is determined according to the flag bit and the grid line position where the boundary is located.
  • step 3 Calculate the boundary filtering strength of the filtering boundary. For example, determine the boundary filtering strength (BS) of the current boundary according to the coding information of the coding blocks at both ends of the boundary. If BS is not 0, perform step 3.
  • BS boundary filtering strength
  • the two sides of the filtering boundary are the first image block (also referred to as the P block) and the second image block (also referred to as the Q block), and the pixels in the first row of the first image block are close to the to-be-to-be
  • the 4 pixels of the filtering boundary are p 0,0 , p 1,0 , p 2,0 and p 3,0 in sequence
  • the 4 pixels of the second row of the first image block close to the filtering boundary are p 0,1 , p 1,1 , p 2,1 and p 3,1
  • the 4 pixels in the third row of the first image block close to the filtering boundary are p 0,2 , p 1,2 , p 2,2 and p 3 in sequence, 2
  • the 4 pixels in the fourth row of the first image block close to the filtering boundary are p 0,3 , p 1,3 , p 2,3 and p 3,3 in sequence.
  • the 4 pixels in the first row of the second image block close to the filtering boundary are q 0,0 , q 1,0 , q 2,0 and q 3,0 in sequence; the 4 pixels in the second row of the second image block close to the filtering boundary The pixels are q 0,1 , q 1,1 , q 2,1 and q 3,1 in sequence; the 4 pixels in the third row of the second image block close to the filtering boundary are q 0,2 , q 1,2 in sequence , q 2,2 and q 3,2 ; the 4 pixels in the fourth row of the second image block close to the filtering boundary are q 0,3 , q 1,3 , q 2,3 and q 3,3 in sequence.
  • the transformation rate dpqL of the pixel values of the pixel points on both sides of the boundary is determined based on the following formula (1):
  • the ⁇ can be obtained by looking up a table.
  • the ⁇ may be a preset fixed value.
  • the above parameter tc can be obtained by looking up a table.
  • the above parameter tc may be a preset fixed value.
  • the filtering boundary if the filtering boundary does not need filtering, the filtering boundary is not filtered. When it is determined that strong filtering is required, strong filtering is performed, and when it is determined that weak filtering is required, weak filtering is performed.
  • the real boundary itself is composed of progressively changing pixels. Based on the filtering determination method in the existing VVC, the real boundary will be judged as a boundary that can be filtered, which will cause the real boundary to be filtered and blurred, thereby reducing the reconstructed image. the quality of.
  • the joint progressive feature can reflect the change trend of the pixel value of the pixel at the boundary to be filtered compared to the pixel value of the pixel at both ends of the boundary to be filtered, that is, the joint progressive feature
  • the progressive feature can truly reflect whether the boundary to be filtered is a real boundary, so whether to filter the boundary to be filtered based on the joint progressive feature can improve the accuracy of filtering judgment, thereby reducing the filtering of the real boundary.
  • the encoding end is introduced with reference to FIG. 4 .
  • FIG. 4 is a schematic flowchart of an image processing method provided by an embodiment of the present application, and the embodiment of the present application is applied to the video encoder shown in FIG. 1 and FIG. 2 .
  • the method of the embodiment of the present application includes:
  • the video encoder divides each frame of image in the video data into one or more image blocks to be encoded.
  • the prediction unit 210 in the video encoder uses the frame After the prediction block of the image block to be encoded is generated by the inter prediction and the intra prediction, the prediction block is sent to the residual unit 220, which can be understood as a summer, including one or more components that perform subtraction operations.
  • the residual unit 220 subtracts the prediction block from the image block to be encoded to form a residual block, and sends the residual block to the transform and quantization unit 230.
  • the transform and quantization unit 230 transforms the residual block using, for example, discrete cosine transform (DCT) or the like, to obtain transform coefficients.
  • DCT discrete cosine transform
  • the transform and quantization unit 230 further quantizes the transform coefficients to obtain quantized transform coefficients.
  • the transform and quantization unit 230 forwards the quantized transform coefficients to the header information decoding unit or the entropy decoding unit 280 .
  • the header information decoding unit or entropy decoding unit 280 entropy-encodes the quantized transform coefficients.
  • header decoding unit or entropy decoding unit 280 may perform context adaptive variable length coding (CAVLC), context adaptive binary arithmetic coding (CABAC), syntax-based context adaptive binary arithmetic coding (SBAC), probability Entropy coding is performed on the quantized transform coefficients by coding methods such as Interval Partition Entropy (PIPE) coding to obtain a code stream.
  • CAVLC context adaptive variable length coding
  • CABAC context adaptive binary arithmetic coding
  • SBAC syntax-based context adaptive binary arithmetic coding
  • probability Entropy coding is performed on the quantized transform coefficients by coding methods such as Interval Partition Entropy (PIPE) coding to obtain a code stream
  • the transform and quantization unit 230 forwards the quantized transform coefficients to the inverse transform and quantization unit 240 .
  • the inverse transform and quantization unit 240 inversely quantizes and inversely transforms the quantized transform coefficients to reconstruct the residual block in the pixel domain.
  • Reconstruction unit 250 is understood to be a summer, including one or more components that perform subtraction operations.
  • the reconstruction unit 250 adds the reconstructed residual block to the prediction block generated by the prediction unit 210 to generate a partial or complete reconstructed image of the image block to be encoded, the partial or complete reconstructed image including one or more reconstructed images piece.
  • Different video encoders may have different methods for selecting the boundary to be filtered. For example, in H.264, the boundary of a 4 ⁇ 4 block is used as the boundary to be filtered. For example, in H.265, for the boundary of each 8x8 sub-block in the coding unit (CU), if the boundary is the division boundary of the transform unit of the coding unit, the boundary is determined as the boundary to be filtered; if the boundary is The division boundary of the prediction unit of the coding unit is set as the boundary to be filtered.
  • the boundary to be filtered may be a vertical boundary or a horizontal boundary.
  • edge The "boundary" mentioned in the embodiments of the present application may also be referred to as an edge.
  • S403 Determine the boundary filtering strength of the boundary to be filtered according to the encoding information of the first image block and the second image block adjacent to both sides of the boundary to be filtered.
  • the first image block is the image block on the left side of the boundary to be filtered adjacent to the boundary to be filtered
  • the second image block is the right side of the boundary to be filtered adjacent to the boundary to be filtered. adjacent image blocks.
  • the first image block is the image block adjacent to the boundary to be filtered above the boundary to be filtered
  • the second image block is below the boundary to be filtered adjacent to the boundary to be filtered image block.
  • FIG. 5A and FIG. 5B exemplarily show blocks in which the size of the first image block and the second image block are both 4 ⁇ 4. It should be noted that in this embodiment of the present application, the size of the first image block and the second image block is 4 ⁇ 4. The size can also be 2 ⁇ 2, 6 ⁇ 6, 8 ⁇ 8, 16 ⁇ 16, 32 ⁇ 32, etc.
  • the specific size of the first image block and the second image block is not limited in this embodiment of the present application, and the specific size is based on the reconstructed image block. The size and actual needs are determined.
  • the encoding information of the first image block and the second image block includes but is not limited to: encoding mode, quantization parameter, motion vector, quantization residual coefficient and flag bit, and the like.
  • the selected filtering methods are different for filtering the borders to be filtered with different border filtering strengths, when filtering the borders to be filtered, it is first necessary to determine the border filtering strength (BS) of the borders to be filtered.
  • BS border filtering strength
  • the BS of the boundary to be filtered is determined according to the encoding information of the first image block and the encoding information of the second image block, and the details are as follows:
  • the method for determining the BS described in the current standards may also be used to determine the BS of the boundary to be filtered.
  • This embodiment of the present application does not limit the specific value of the first preset value.
  • the BS of the boundary to be filtered may be 1 or 2. Therefore, the first preset value may also be 0 or 2. 1.
  • the above S404 can be understood as when the BS of the boundary to be filtered is 2, according to the pixel values of the pixels on both sides of the boundary to be filtered, the joint of the boundary to be filtered is determined. Progressive features.
  • the above-mentioned S404 can be understood as when the BS of the boundary to be filtered is 1 or 2, according to the pixel values of the pixels on both sides of the boundary to be filtered, determine the to-be-filtered boundary Joint asymptotic features of the boundaries.
  • the pixel value of the above-mentioned pixel point can be understood as the reconstructed value of the pixel point, that is, the reconstructed pixel value when the image is reconstructed.
  • the joint progressive feature of the boundary to be filtered in the embodiment of the present application is used to indicate whether the pixel value of the pixel at the boundary to be filtered presents a concave or convex change trend compared to the pixel values of the pixel points at both ends of the boundary to be filtered, that is, That is, the joint progressive feature can be used to indicate whether the boundary to be filtered is a real boundary.
  • the right side is the original boundary image of the boundary to be filtered
  • the pixels on the left side of the boundary to be filtered are p0, p1, p2 and p3
  • the pixels on the right side of the boundary to be filtered are q0, q1, q2 and q3 , where p0, p1, p2 and p3 belong to the first image block, and q0, q1, q2 and q3 belong to the second image block.
  • the curve L is obvious at the boundary to be filtered.
  • Concave shape that is to say, the pixel value of the pixel point at the boundary to be filtered shows an obvious concave change trend compared to the pixel value of the pixel point at both ends of the boundary to be filtered.
  • determining the joint progressive feature of the boundary to be filtered according to the pixel values of the pixels on both sides of the boundary to be filtered in the above S404 may include the following S404-A1:
  • S404-A1 Determine the joint progressive feature of the boundary to be filtered according to the difference between the pixel value of the middle pixel in the pixels on both sides of the boundary to be filtered and the pixel values of the pixels at both ends, wherein the middle pixel is the Among the pixels on both sides of the boundary to be filtered, the pixels on both sides of the boundary to be filtered are adjacent to the boundary to be filtered, and the pixels at both ends are the pixels on both sides of the boundary to be filtered that are adjacent to the middle pixel.
  • the intermediate pixels adjacent to the boundary to be filtered can be understood as the pixels at the boundary to be filtered.
  • the difference between the pixel values of the points to be filtered is used to determine the joint progressive feature of the boundary to be filtered. For example, when the above difference is greater than a predetermined value b1, it means that the pixel value of the pixel at the boundary to be filtered is compared with the boundary at both ends of the boundary to be filtered. The pixel value of the pixel point exhibits an obvious upward convex change trend, and it can be determined that the boundary to be filtered is the real boundary.
  • the difference value is less than a preset value b2
  • the pixel value of the pixel at the boundary to be filtered shows an obvious concave change trend compared with the pixel value of the pixel at both ends of the boundary to be filtered, and it can be determined that the pixel value to be filtered
  • the boundary is the real boundary.
  • the above difference value is greater than the preset value b2 and less than the preset value b1
  • it means that the pixel value of the pixel at the boundary to be filtered is not significantly changed compared with the pixel value of the pixel at both ends of the boundary to be filtered, and it can be determined that this The boundary to be filtered is not the true boundary.
  • the above-mentioned pixels on both sides of the boundary to be filtered may be pixels in the same row, or may be pixels in different rows, which are not limited in this embodiment of the present application.
  • the boundary to be filtered in the embodiment of the present application may be a vertical boundary or a horizontal boundary.
  • the above-mentioned S404-A1 is based on the pixel points on both sides of the boundary to be filtered.
  • the process of determining the joint progressive feature of the boundary to be filtered is different for the difference between the pixel value of the middle pixel point and the pixel value of the two end pixel points, and the two cases are introduced separately below.
  • the first boundary area formed by the first image block and the second image block includes N rows of pixel points, where N is a positive integer, such as 2, 3, 4, 6, 7, 8 etc.
  • the first row parameter can be understood as the row parameter corresponding to the first row of pixel points, which is used to indicate that the pixel value of the middle pixel point adjacent to the boundary to be filtered in the first row of pixel points is compared with the pixels of the pixels at both ends. Whether the value is concave or convex; the second line parameter can be understood as the line parameter corresponding to the second line of pixels, which is used to indicate the pixels of the second line of pixels that are adjacent to the border to be filtered.
  • the Nth row parameter can be understood as the row parameter corresponding to the Nth row pixel point, which is used to indicate the Nth row pixel.
  • the pixel value of the middle pixel point adjacent to the boundary to be filtered shows a change trend of concave or convex.
  • S404-A1 may include the following S404-A11 and S404-A12:
  • S404-A12 Determine at least one row parameter from the first row parameter to the Nth row parameter as the joint progressive feature of the boundary to be filtered.
  • the pixel points at both ends of the pixel point in the i-th row may be one or more pixels at the leftmost end of the pixel point in the i-th row, and one or more pixels at the rightmost end of the pixel point in the i-th row.
  • p 3,0 and q 3,0 in 5A the pixels at both ends of the i-th row of pixels may be the i-th row of pixels close to the left end but not the leftmost pixel, and the i-th row of pixels close to the right end but not the rightmost pixel, such as in FIG. 5A .
  • p 2,0 and q 2,0 the pixels at both ends of the pixel point in the i-th row may be one or more pixels at the leftmost end of the pixel point in the i-th row, and one or more pixels at the rightmost end of the pixel point in the i-th row.
  • the middle pixel point of the i-th row of pixels may be one or more pixels in the i-th row of pixels that are close to the boundary to be filtered, for example, in the i-th row of pixels, located on the left side of the to-be-filtered boundary and adjacent to the to-be-filtered boundary , and the pixels located on the right side of the boundary to be filtered and adjacent to the boundary to be filtered, such as p 0,0 and q 0,0 in FIG. 5A .
  • the middle pixel points of the i-th row of pixels include: among the i-th row of pixels, the left side of the boundary to be filtered is adjacent to the first left pixel (eg p 0,i ) and the boundary to be filtered.
  • the pixels at both ends of the pixel point in the i-th row include: the third left pixel point (eg p 2, i ) adjacent to the second left pixel point in the i-th row pixel point and the second right pixel point The third right pixel adjacent to the pixel (eg q 2,i ).
  • the above S404-A11 may include the following S404-A111:
  • the i-th line parameter is determined by the pixel points with the nearer boundary to be filtered, which can accurately determine the i-th line parameter, and can also reduce the amount of calculation, improve the speed of judging the filtering boundary, and improve the encoding or decoding efficiency.
  • the i-th row parameter can be determined by the following formula (9):
  • dpq i is the i-th row parameter
  • p 0,i is the first left pixel point in the i-th row pixel point
  • p 1,i is the second left pixel point in the i-th row pixel point
  • p 2,i is the third left pixel in the i-th row of pixels
  • q 0,i is the first right-hand pixel in the i-th row of pixels
  • q 1,i is the i-th row of pixels
  • the second right pixel in q 2,i is the third right pixel in the i-th row of pixels.
  • any one row parameter from the first row parameter to the Nth row parameter can be determined, and S404-A12 is executed, and any one row parameter from the first row parameter to the Nth row parameter is determined as the joint of the boundary to be filtered.
  • Progressive features For example, as shown in FIG. 5A , the size of the first boundary area formed by the first image block and the second image block is 4 ⁇ 8, that is, it includes 4 rows of pixels and 8 columns of pixels, and parameters of any row can be determined according to the above method.
  • the determined row parameter is determined as the joint progressive feature of the boundary to be filtered, for example, the first row parameter is determined as the joint progressive feature of the boundary to be filtered.
  • any two row parameters in the first row parameter, the second row parameter, the third row parameter, and the fourth row parameter can also be determined, and these two row parameters are determined as the joint progressive feature of the boundary to be filtered.
  • the parameters in the first row and the parameters in the fourth row are determined as joint progressive features of the boundary to be filtered.
  • the second boundary area formed by the first image block and the second image block includes M columns of pixels, where M is a positive integer, such as 2, 3, 4, 6, 7, 8 etc.
  • the first column parameter can be understood as the column parameter corresponding to the first column of pixels, which is used to indicate that the pixel value of the middle pixel adjacent to the boundary to be filtered in the first column of pixels is compared with the pixels of the pixels at both ends. Whether the value is concave or convex; the second column parameter can be understood as the column parameter corresponding to the second column of pixels, which is used to indicate the pixels of the second column of pixels that are adjacent to the boundary to be filtered.
  • the parameter in the Mth column can be understood as the column parameter corresponding to the pixel point in the Mth column, which is used to indicate the pixel in the Mth column.
  • the pixel value of the middle pixel point adjacent to the boundary to be filtered shows a change trend of concave or convex.
  • S404-A1 may include the following S404-A14 and S404-A15:
  • S404-A14 Determine the parameter of the jth column according to the difference between the pixel values of the pixel points at the two ends of the pixel point in the jth column of the second boundary area and the pixel value of the middle pixel point, where j is greater than or equal to 1 and less than or A positive integer equal to M;
  • S404-A15 Determine at least one column parameter from the first column parameter to the Mth column parameter as the joint progressive feature of the boundary to be filtered.
  • the pixel points at both ends of the pixel point in the jth column may be one or more pixels at the top of the pixel point in the jth column, and one or more pixels at the bottom of the pixel point in the jth column. p 3,0 and q 3,0 in 5B.
  • the pixels at both ends of the pixel point in the jth column may be the pixel point in the jth column that is close to the top but not the topmost pixel point, and the pixel point in the jth column is close to the bottom but not the bottommost pixel point, for example, p in FIG. 5B 2,0 and q 2,0 .
  • the middle pixel point of the jth column of pixels may be one or more pixels in the jth column of pixels that are close to the boundary to be filtered, for example, the jth column of pixels located above the to-be-filtered boundary and adjacent to the to-be-filtered boundary Pixel points, and pixel points located below the boundary to be filtered and adjacent to the boundary to be filtered, such as p 0,0 and q 0,0 in FIG. 5B .
  • the middle pixels of the jth column of pixels include: among the jth column of pixels, the first upper pixel (eg p 0,j ) adjacent to the boundary to be filtered and adjacent to the boundary to be filtered and the The second upper pixel point (eg p 1,j ) adjacent to the first upper pixel point, and the first lower pixel point (eg q 0,j ) adjacent to the boundary to be filtered below the boundary to be filtered and the The second lower pixel adjacent to the first lower pixel (eg q 1,j ).
  • the pixel points at both ends of the pixel point in the jth column include: the third upper pixel point (eg p 2,j ) adjacent to the second upper pixel point in the jth column pixel point and the second lower pixel point.
  • the adjacent third lower pixel point eg q 2,j ).
  • the above S404-A14 may include the following S404-A141:
  • the jth column parameter is determined by the difference between the pixel value of the pixel point and the pixel value of the first lower pixel point and the pixel value of the second lower pixel point.
  • the jth column parameter can be determined by the following formula (10):
  • dpq j is the parameter of the jth column
  • p 0,j is the first upper pixel point in the jth column pixel point
  • p 1,j is the second upper pixel point in the jth column pixel point
  • p 2 ,j is the third upper pixel in the jth column of pixels
  • q 0,j is the first lower pixel in the jth column of pixels
  • q 1,j is the second in the jth column of pixels below pixels
  • q 2,j is the third below pixel in the jth column of pixels.
  • any one of the parameters in the first column to the M-th column parameter can be determined, and S404-A15 is executed, and any one of the first-column parameters to the M-th column parameter is determined as the combination of the boundary to be filtered.
  • Progressive features For example, as shown in FIG. 5B , the size of the second boundary area formed by the first image block and the second image block is 8 ⁇ 4, that is, it includes 4 columns of pixels and 8 rows of pixels, and any column of parameters can be determined according to the above method.
  • the determined column parameter is determined as the joint progressive feature of the boundary to be filtered, for example, the first column parameter is determined as the joint progressive feature of the boundary to be filtered.
  • any two column parameters in the first column parameter, the second column parameter, the third column parameter, and the fourth column parameter can also be determined, and the two column parameters are determined as the joint progressive feature of the boundary to be filtered.
  • the parameters in the first column and the parameters in the fourth column are determined as the joint progressive features of the boundary to be filtered.
  • the present application determines whether to filter the boundary to be filtered based on the joint progressive feature of the boundary to be filtered by determining the joint progressive feature of the boundary to be filtered. For example, when the joint progressive feature of the boundary to be filtered is greater than a certain preset value b1 or smaller than a certain preset value b2, it indicates that the boundary to be filtered is a real boundary, and it is determined that the boundary to be filtered is not filtered; When the progressive feature is larger than b2 and smaller than b1, it indicates that the boundary to be filtered is not a real boundary, and it is determined to filter the boundary to be filtered.
  • the following describes the process of determining whether to filter the boundary to be filtered based on the joint progressive feature of the boundary to be filtered.
  • the above S405 includes the following situations:
  • the above S405 includes: when at least two parameters in the parameters in the first row to the Nth row parameters are greater than or equal to the second preset value, determining that the boundary to be filtered is not filtered.
  • dpq i is the i-th row parameter
  • T2 is the second preset value
  • N 4
  • the boundary to be filtered is not filtered.
  • the parameter in the first row and the parameter in the fourth row are greater than or equal to the second preset value T2
  • it is determined that the boundary to be filtered is not filtered.
  • the second preset value T2 is greater than 0.5 and less than 1.
  • the second preset value T2 is greater than 0.5 and less than 0.8.
  • the second preset value T2 can also be determined according to the quantization parameter QP.
  • the parameter ⁇ ' can be obtained by using the quantization parameter QP to look up the table, and ⁇ ' is positively correlated with the second preset value T2, that is, when ⁇ ' increases. , the second preset value T2 also increases. Based on this, according to a preset operation rule, ⁇ ' is operated to obtain a second preset value T2, wherein the second preset value T2 is less than 1.
  • the second preset value T2 is equal to Among them, ⁇ can be obtained by looking up the table, or is a preset value.
  • the above S405 includes: when the sum of any two parameters in the first row parameter to the Nth row parameter is greater than or equal to the fourth preset value T4, it is determined that the boundary to be filtered is not filtered.
  • the sum of any two parameters in the first row parameter, the second row parameter, the third row parameter and the fourth row parameter is greater than or equal to the fourth preset value T4
  • the sum of the parameters in the first row and the parameters in the fourth row is greater than or equal to the fourth preset value T4
  • it is determined that the boundary to be filtered is not filtered.
  • the fourth preset value T4 is greater than or equal to twice the second preset value.
  • the fourth preset value T4 is equal to ⁇ .
  • the above S405 includes the following S405-B1 and S405-B2:
  • S405-B2 Determine whether to filter the boundary to be filtered according to the transformation rate and at least one parameter from the first line parameter to the Nth line parameter.
  • the conversion rate of the pixel value of each row of pixel points can be determined, and then N rows of pixels can be obtained.
  • the transformation rate of the pixel value of the point is determined.
  • the conversion rate of the pixel values of the pixel points on both sides of the boundary to be filtered is determined according to the conversion rate of the pixel values of any two rows of pixel points in the N rows of pixel points. For example, according to the transformation ratios of the pixel values of the first row of pixels and the Nth row of pixels, the transformation ratios of the pixel values of the pixels on both sides of the boundary to be filtered are determined.
  • the transformation rate dpqL of the pixel values of the pixel points on both sides of the boundary to be filtered may be determined according to the above formula (1).
  • determining whether to filter the boundary to be filtered may include different situations:
  • T3 is the third preset value
  • T5 is the fifth preset value
  • dpqL is the transformation rate of the pixel value of the pixel point in the first row and the pixel point in the fourth row, wherein the determination process of dpqL refers to the above formula (1)
  • dpq0 is the first line parameter
  • dpq3 is the fourth line parameter.
  • the third preset value T3 ⁇ .
  • the above-mentioned fifth preset value T5 may be equal to the above-mentioned second preset value T2, for example
  • the above-mentioned transformation rate is greater than or equal to the third preset value T3, it is determined that the boundary to be filtered is not filtered; or, when at least two of the parameters in the first row to the Nth row of parameters are greater than or equal to the sixth preset value
  • the value is T6
  • it is determined that the boundary to be filtered is not filtered; or, when the above-mentioned transformation rate is greater than or equal to the third preset value T3, and at least two parameters in the first row of parameters to the Nth row of parameters are greater than or equal to the sixth preset value.
  • T6 is set, it is determined that the boundary to be filtered is not filtered.
  • the sixth preset value T6 is equal to the fifth preset value T5.
  • the above-mentioned sixth preset value T6 is equal to the above-mentioned second preset value T2.
  • any two parameters in the first row parameter to the Nth row parameter are the first row parameter dpq0 and the fourth row parameter dpq3, when the above formula (12) and the following formula (14) are satisfied , determine to filter the boundary to be filtered:
  • the above-mentioned seventh preset value T7 is equal to ⁇ .
  • the above-mentioned eighth preset value T8 is equal to the above-mentioned seventh preset value T7.
  • the above-mentioned eighth preset value T8 is equal to the above-mentioned third preset value T3.
  • whether to filter the boundary to be filtered can be determined according to at least one of the parameters in the first row to the Nth row parameter, which can reduce the filtering of the real boundary.
  • the above S405 includes the following situations:
  • the above S405 includes: when at least two parameters in the parameters in the first column to the M-th column are greater than or equal to the second preset value, determining that the boundary to be filtered is not subjected to column filtering.
  • dpq j is the jth column parameter
  • T2 is the second preset value
  • the above S405 includes: when the sum of any two parameters in the first column parameter to the Mth column parameter is greater than or equal to the fourth preset value, determining that the boundary to be filtered is not subjected to column filtering.
  • the sum of any two parameters in the first column parameter, the second column parameter, the third column parameter and the fourth column parameter is greater than or equal to the fourth preset value T4
  • T4 the sum of any two parameters in the first column parameter, the second column parameter, the third column parameter and the fourth column parameter is greater than or equal to the fourth preset value T4
  • the above S405 includes the following S405-D1 and S405-D2:
  • S405-D2 Determine whether to filter the boundary to be filtered according to the transformation rate and at least one parameter from the first column of parameters to the M-th column of parameters.
  • the conversion rate of the pixel value of each column of pixel points can be determined according to the pixel value of each column of pixel points in the M column of pixel points in the second boundary area, and then the M columns of pixels can be obtained.
  • the transformation rate of the pixel value of the point is determined according to the transformation ratios of the pixel values of the pixel points in the M columns. Then, according to the transformation ratios of the pixel values of the pixel points in the M columns, the transformation ratios of the pixel values of the pixel points on both sides of the boundary to be filtered are determined.
  • the conversion rate of the pixel values of the pixel points on both sides of the boundary to be filtered is determined according to the conversion rate of the pixel values of any two columns of pixel points in the M columns of pixel points. For example, according to the transformation ratios of the pixel values of the pixel points in the first column and the pixel points in the Mth column, the transformation ratio of the pixel values of the pixel points on both sides of the boundary to be filtered is determined.
  • the transformation rate dpqL of the pixel values of the pixel points on both sides of the boundary to be filtered can be determined according to the following formula (1).
  • determining whether to filter the boundary to be filtered may include different situations:
  • dpqL is the transformation rate of the pixel values of the first column pixel point and the fourth column pixel point, wherein the determination process of dpqL refers to the above formula (1), dpq0 is the first column parameter, dpq3 is the fourth column parameter.
  • the boundary to be filtered when the boundary to be filtered is a horizontal boundary, it may be determined whether to perform column filtering on the boundary to be filtered according to at least one of the parameters in the first column to the Mth column parameter, which can reduce the filtering of the real boundary. .
  • FIG. 6 is another schematic flowchart of an image processing method 500 provided by an embodiment of the present application, as shown in FIG. 6 , including:
  • each frame of image in the input video data into a plurality of image blocks to be encoded.
  • the video encoder divides the frame of image into one or more image blocks (CUs) to be encoded.
  • the quantized transform coefficients are directly sent to the entropy encoder, and the code stream is output after encoding.
  • the partial or complete reconstructed image includes one or more reconstructed image blocks.
  • the boundary to be filtered may be a horizontal boundary or a vertical boundary.
  • S402 the description of S402 above, which is not repeated here.
  • S506 Determine the boundary filtering strength of the boundary to be filtered according to the first image block and the second image block adjacent to both sides of the boundary to be filtered. For this step, reference may be made to the description of S403 above, which is not repeated here.
  • S507 Determine whether the boundary filtering strength is greater than the first preset value, if otherwise, perform S515; if yes, perform S508 and S509, or perform S510 and S511.
  • S509 Determine whether to filter the boundary to be filtered according to at least one parameter from the first row parameter to the Nth row parameter.
  • the boundary to be filtered is not filtered.
  • the sum of any two parameters in the first row of parameters to the Nth row of parameters is greater than or equal to the fourth preset value, it is determined that the boundary to be filtered is not filtered.
  • the transformation rate is less than the third preset value, and at least one of the parameters in the first row to the Nth row parameter is less than the fifth preset value, it is determined to filter the boundary to be filtered.
  • the transformation rate is greater than or equal to the third preset value, and/or at least two parameters of the first row parameter to the Nth row parameter are greater than or equal to the sixth preset value, it is determined that the boundary to be filtered is not filtered.
  • the transformation rate is less than the third preset value, and the sum of any two parameters in the first row parameter to the Nth row parameter is less than the seventh preset value, it is determined to filter the boundary to be filtered.
  • the transformation rate is greater than or equal to the third preset value, and/or the sum of any two parameters in the first row parameter to the Nth row parameter is greater than or equal to the eighth preset value, it is determined that the boundary to be filtered is not filtered .
  • the joint progressive feature includes: the first row of parameters and the fourth row of parameters
  • the above S508 may include the following S508-A1 and S508-A2:
  • S508-A2 Determine the parameters of the fourth row according to the difference between the pixel values of the pixel points at both ends of the pixel points in the fourth row of the first boundary area and the pixel value of the pixel value in the middle pixel point.
  • the middle pixel points of the first row of pixel points include: in the first row of pixel points, the first left pixel point adjacent to the to-be-filtered boundary on the left side of the to-be-filtered boundary and the first left pixel point adjacent to the to-be-filtered boundary
  • Two right pixels; the pixels at both ends of the first row of pixels include: the third left pixel adjacent to the second left pixel in the first row of pixels and the second right pixel The third right pixel point adjacent to the pixel point;
  • the middle pixel points of the fourth row of pixel points include: in the fourth row of pixel points, the first left pixel point adjacent to the to-be-filtered boundary on the left side of the boundary to be filtered and the first left pixel point adjacent to the first left pixel point.
  • the pixels at both ends of the pixel point include: the third left pixel point adjacent to the second left pixel point and the third right pixel point adjacent to the second right pixel point in the fourth row of pixel points pixel.
  • S508-A1 includes the following S508-A11:
  • the first line parameter is determined by the difference between the pixel values of the three right pixel points and the pixel value of the first right pixel point and the pixel value of the second right pixel point.
  • dpq 0 is the first line parameter
  • p 0,0 is the first left pixel point in the first line pixel point
  • p 1,0 is the second left pixel point in the first line pixel point
  • p 2,0 is the third left pixel in the first row of pixels
  • q 0,0 is the first right pixel in the first row of pixels
  • q 1,0 is the first row of pixels
  • the second right pixel in q 2,0 is the third right pixel in the first row of pixels.
  • S508-A2 includes the following S508-A21:
  • dpq 3 is the fourth row parameter
  • p 0,3 is the first left pixel point in the fourth row pixel point
  • p 1,3 is the second left pixel point in the fourth row pixel point
  • p 2,3 is the third left pixel in the fourth row of pixels
  • q 0,3 is the first right pixel in the fourth row of pixels
  • q 1,3 is the fourth row of pixels
  • the second right pixel in q 2,3 is the third right pixel in the fourth row of pixels.
  • Mode 3 According to the pixel values of the pixel points on both sides of the boundary to be filtered, the transformation rate of the pixel values of the pixel points on both sides of the boundary to be filtered is determined; according to the transformation rate, and at least one of the first line parameter and the fourth line parameter parameter to determine whether to filter the boundary to be filtered.
  • the transformation rate is less than the third preset value, and the parameters of the first row and/or the parameters of the fourth row are less than the fifth preset value, it is determined to filter the boundary to be filtered.
  • the transformation rate is less than the third preset value, and the parameters of the first row and the parameter of the fourth row are both greater than or equal to the sixth preset value, it is determined to filter the boundary to be filtered.
  • the transformation rate is smaller than the third preset value, and the sum of the parameters in the first row and the parameter in the fourth row is smaller than the seventh preset value, it is determined to filter the boundary to be filtered.
  • the transformation rate is smaller than the third preset value, and the sum of the parameters in the first row and the parameters in the fourth row is greater than or equal to the eighth preset value, it is determined to filter the boundary to be filtered.
  • S512 to S514 are performed, otherwise, S515 is performed.
  • S511 Determine whether to filter the boundary to be filtered according to at least one parameter in the first column of parameters to the M-th column of parameters.
  • the boundary to be filtered is not subjected to column filtering.
  • the sum of any two parameters in the first column parameter to the Mth column parameter is greater than or equal to the fourth preset value, it is determined that the boundary to be filtered is not subjected to column filtering.
  • the transformation rate is less than the third preset value, and at least one of the parameters in the first column to the Mth column parameter is less than the fifth preset value, it is determined that the boundary to be filtered is subjected to column filtering.
  • the transformation rate is greater than or equal to the third preset value, and/or at least two parameters in the parameters in the first column to the Mth column are greater than or equal to the sixth preset value, it is determined that the boundary to be filtered is not subjected to column filtering .
  • the transformation rate is less than the third preset value, and the sum of any two parameters in the first column of parameters to the Mth column of parameters is less than the seventh preset value, it is determined that the boundary to be filtered is subjected to column filtering.
  • the joint progressive feature includes: the first column parameter and the fourth column parameter, then the above S510 includes the following S510-A1 and S510-A2:
  • S510-A2 Determine the parameters of the fourth column according to the difference between the pixel values of the pixel points at both ends and the pixel value of the middle pixel point in the fourth column of the second boundary area.
  • the middle pixel points of the first column of pixel points include: in the first column of pixel points, the first upper pixel point adjacent to the boundary to be filtered above the boundary to be filtered and the first pixel point adjacent to the boundary to be filtered.
  • the pixels at both ends of a column of pixels include: a third upper pixel adjacent to the second upper pixel in the first column of pixels and a third lower pixel adjacent to the second lower pixel ;
  • the middle pixel points of the fourth column of pixel points include: in the fourth column of pixel points, the first upper pixel point adjacent to the boundary to be filtered above the boundary to be filtered and the second upper pixel point adjacent to the first upper pixel point Pixel points, the first lower pixel point adjacent to the boundary to be filtered below the boundary to be filtered, and the second lower pixel point adjacent to the first lower pixel point; the pixel points at both ends of the fourth column of pixel points include : The third upper pixel point adjacent to the second upper pixel point and the third lower pixel point adjacent to the second lower pixel point in the fourth column of pixels.
  • S510-A1 includes the following S510-A11:
  • the first column parameter is determined by the difference between the pixel value of the pixel point and the pixel value of the first lower pixel point and the pixel value of the second lower pixel point.
  • the first column parameter is determined according to the following formula:
  • dpq 0 is the parameter of the first column
  • p 0,0 is the first upper pixel in the first column of pixels
  • p 1,0 is the second upper pixel in the first column of pixels
  • p 2 ,0 is the third upper pixel in the first column of pixels
  • q 0,0 is the first lower pixel in the first column of pixels
  • q 1,0 is the second pixel in the first column of pixels below pixels
  • q 2,0 is the third below pixel in the first column of pixels.
  • the above S510-A2 includes the following S510-A21:
  • the fourth column parameter is determined by the difference between the pixel value of the pixel point and the pixel value of the first lower pixel point and the pixel value of the second lower pixel point.
  • dpq 3 is the fourth column parameter
  • p 0,3 is the first upper pixel point in the fourth column pixel point
  • p 1,3 is the second upper pixel point in the fourth column pixel point
  • p 2 ,3 is the third upper pixel in the fourth column of pixels
  • q 0,3 is the first lower pixel in the fourth column of pixels
  • q 1,3 is the second in the fourth column of pixels q 2 , 3 is the third lower pixel in the fourth column of pixels.
  • the above S511 includes the following implementations:
  • Mode 3 According to the pixel values of the pixels on both sides of the boundary to be filtered, the transformation rate of the pixel values of the pixels on both sides of the boundary to be filtered is determined; according to the transformation rate, and at least one of the first column parameter and the fourth column parameter parameter to determine whether to filter the boundary to be filtered.
  • the transformation rate is smaller than the third preset value, and the first column parameter and/or the fourth column parameter is smaller than the fifth preset value, it is determined to filter the boundary to be filtered.
  • the transformation rate is smaller than the third preset value, and the parameters in the first column and the parameter in the fourth column are both greater than or equal to the sixth preset value, it is determined to filter the boundary to be filtered.
  • the transformation rate is less than the third preset value, and the sum of the parameters in the first column and the parameters in the fourth column is less than the seventh preset value, it is determined to filter the boundary to be filtered.
  • the transformation rate is less than the third preset value, and the sum of the first column parameter and the fourth column parameter is greater than or equal to the eighth preset value, it is determined to filter the boundary to be filtered.
  • S512 to S514 are performed, otherwise, S515 is performed.
  • the filtering methods include strong filtering and weak filtering.
  • a method described in an existing standard may be used to determine the filtering manner of the boundary to be filtered.
  • the video encoder can obtain reference frames from the decoded picture buffer in the subsequent picture encoding process.
  • FIG. 6 is only an example of the present application, and should not be construed as a limitation of the present application.
  • FIG. 7 is a schematic flowchart of a filtering method provided by an embodiment of the present application, as shown in FIG. 7 , including:
  • S201 Determine whether the boundary of the reconstructed image block is the boundary to be filtered. For details, reference may be made to the description of 401 above, which will not be repeated here. If it is determined that the boundary of the reconstructed image block is the boundary to be filtered, S202 is performed, otherwise, S207 is performed.
  • S202 Determine the filtering boundary strength (BS) of the boundary to be filtered, and determine whether the BS is greater than 0. If it is determined that the BS of the boundary to be filtered is greater than 0, execute S203; otherwise, execute S207.
  • BS filtering boundary strength
  • S204 Determine whether the boundary to be filtered satisfies the strong filtering condition. If the strong filtering condition is satisfied, perform S205 to perform strong filtering on the boundary to be filtered. If the strong filtering condition is not satisfied, perform S206 to perform weak filtering on the boundary to be filtered.
  • FIG. 7 is only an example of the present application and should not be construed as a limitation of the present application.
  • the size of the sequence numbers of the above-mentioned processes does not mean the sequence of execution, and the execution sequence of each process should be determined by its functions and internal logic, and should not be dealt with in the present application.
  • the implementation of the embodiments constitutes no limitation.
  • the term "and/or" is only an association relationship for describing associated objects, indicating that three relationships may exist. Specifically, A and/or B can represent three situations: A exists alone, A and B exist at the same time, and B exists alone.
  • the character "/" in this document generally indicates that the related objects are an "or" relationship.
  • the image processing method of the embodiment of the present application is described in detail from the perspective of the encoding end, and the following describes the image processing method of the embodiment of the present application from the perspective of the decoding end with reference to FIGS. 8 and 9 .
  • FIG. 8 is a schematic flowchart of an image processing method 600 provided by an embodiment of the present application, and the embodiment of the present application is applied to the video decoder shown in FIG. 1 and FIG. 3 .
  • the method 600 in this embodiment of the present application includes:
  • the header information decoding unit or the entropy decoding unit 310 performs entropy decoding on the code stream to obtain a frequency domain residual block.
  • the header information decoding unit or entropy decoding unit 310 forwards the frequency domain residual block to the inverse quantization transform unit 330 .
  • the inverse quantization and transformation unit 330 performs steps such as inverse transformation and inverse quantization on the frequency-domain residual block to obtain a time-domain residual block, and forwards the time-domain residual block to the reconstruction unit 340 .
  • Reconstruction unit 340 can be understood as a summer, representing a component that performs this summation operation.
  • the reconstruction unit 340 superimposes the prediction block predicted by the prediction unit to the temporal residual block to obtain a partial or complete reconstructed image, where the partial or complete reconstructed image includes one or more reconstructed image blocks.
  • S603. Determine the boundary filtering strength of the boundary to be filtered according to the first image block and the second image block adjacent to both sides of the boundary to be filtered.
  • determining the joint progressive feature of the boundary to be filtered according to the pixel values of the pixels on both sides of the boundary to be filtered in the above S604 may include the following S604-A1:
  • S604-A1 Determine the joint progressive feature of the boundary to be filtered according to the difference between the pixel value of the middle pixel point in the pixel points on both sides of the boundary to be filtered and the pixel values of the pixel points at both ends.
  • the boundary to be filtered in the embodiment of the present application may be a vertical boundary or a horizontal boundary.
  • the boundary to be filtered is different, in the above-mentioned S604-A1, according to the pixel points on both sides of the boundary to be filtered.
  • the process of determining the joint progressive feature of the boundary to be filtered is different for the difference between the pixel value of the middle pixel point and the pixel value of the two end pixel points, and the two cases are introduced separately below.
  • the boundary to be filtered is a vertical boundary
  • the first boundary area formed by the first image block and the second image block includes N rows of pixel points.
  • the above S604-A1 may include the following S604-A11 and S604-A12:
  • S604-A12 Determine at least one row parameter from the first row parameter to the Nth row parameter as the joint progressive feature of the boundary to be filtered.
  • the middle pixel points of the pixel points in the i-th row include: in the pixel points in the i-th row, the left side of the boundary to be filtered is adjacent to the first left pixel point (eg p 0,i ) of the boundary to be filtered and the second left pixel point adjacent to the first left pixel point (eg p 1, i ), and the first right pixel point adjacent to the boundary to be filtered on the right side of the boundary to be filtered (eg q 0, i ) and a second right pixel adjacent to the first right pixel (eg q 1, i ).
  • the pixel points at both ends of the pixel point in the i-th row include: the third left-side pixel point (eg p 2,i ) adjacent to the second left-side pixel point in the pixel point in the i-th row and the second right-side pixel point.
  • the third right pixel point adjacent to the side pixel point eg q 2,i ).
  • the above S604-A11 may include the following S604-A111:
  • the i-th row parameter is determined by the difference between the pixel values of the three right pixel points and the pixel value of the first right pixel point and the pixel value of the second right pixel point.
  • the i-th row parameter is determined by the above formula (9).
  • any one row parameter from the first row parameter to the Nth row parameter can be determined, and S404-A12 is executed, and any one row parameter from the first row parameter to the Nth row parameter is determined as the joint of the boundary to be filtered.
  • the second boundary area formed by the first image block and the second image block includes M columns of pixels.
  • S604-A1 may include the following S604-A14 and S604-A15:
  • the above S604-A14 may include the following steps S604-A14:
  • S604-A14 Determine the parameter of the jth column according to the difference between the pixel values of the pixel points at the two ends of the pixel point in the jth column of the second boundary area and the pixel value of the middle pixel point, where j is greater than or equal to 1 and less than or A positive integer equal to M;
  • S604-A15 Determine at least one column parameter from the first column parameter to the Mth column parameter as the joint progressive feature of the boundary to be filtered.
  • the middle pixels of the jth column of pixels include: among the jth column of pixels, the first upper pixel (eg p 0,j ) adjacent to the boundary to be filtered and adjacent to the boundary to be filtered and the The second upper pixel point (eg p 1,j ) adjacent to the first upper pixel point, and the first lower pixel point (eg q 0,j ) adjacent to the boundary to be filtered below the boundary to be filtered and the The second lower pixel adjacent to the first lower pixel (eg q 1,j ).
  • the pixel points at both ends of the pixel point in the jth column include: the third upper pixel point (eg p 2,j ) adjacent to the second upper pixel point in the jth column pixel point and the second lower pixel point.
  • the adjacent third lower pixel point eg q 2,j ).
  • the above S604-A14 may include the following S404-A141:
  • the jth column parameter is determined by the difference between the pixel value of the pixel point and the pixel value of the first lower pixel point and the pixel value of the second lower pixel point.
  • the jth column parameter can be determined by the above formula (10).
  • any one of the parameters in the first column to the M-th column parameter can be determined, and then S604-A15 is executed, and any one of the first-column parameters to the M-th column parameter is determined as the boundary to be filtered. Joint progressive features.
  • S605. Determine whether to filter the boundary to be filtered according to the joint progressive feature of the boundary to be filtered.
  • the above S605 includes the following situations:
  • the transformation rate of the pixel values of the pixels on both sides of the boundary to be filtered is determined; At least one parameter in , determines whether to filter the boundary to be filtered.
  • the boundary to be filtered is determined filter.
  • the transformation rate is greater than or equal to the third preset value T3, and/or at least two parameters of the first row of parameters to the Nth row of parameters are greater than or equal to the sixth preset value
  • T6 the value is T6
  • the conversion rate is less than the third preset value T3
  • the sum of any two parameters in the first row parameter to the Nth row parameter is less than the seventh preset value T7, it is determined to treat filter boundary for filtering.
  • the transformation rate is greater than or equal to the third preset value T3, and/or the sum of any two parameters in the first row parameter to the Nth row parameter is greater than or equal to the eighth preset value
  • T8 it is determined that the boundary to be filtered is not filtered.
  • the above S605 includes the following situations:
  • the transformation rate of the pixel values of the pixels on both sides of the boundary to be filtered is determined; Any one of the parameters to determine whether to filter the boundary to be column filtered.
  • the boundary to be filtered is determined Column filtering.
  • the transformation rate is greater than or equal to the third preset value T3, and/or at least two parameters in the first column of parameters to the Mth column of parameters are greater than or equal to the sixth preset value At T6, it is determined that the boundary to be filtered is not subjected to column filtering.
  • the transformation rate is greater than or equal to the third preset value T3, and/or the sum of any two parameters in the first column parameter to the Mth column parameter is greater than or equal to the eighth preset value
  • T8 it is determined that the boundary to be filtered is not subjected to column filtering.
  • FIG. 9 is a schematic flowchart of an image processing method 700 provided by an embodiment of the present application, as shown in FIG. 9 , including:
  • the partial or complete reconstructed image includes one or more reconstructed image blocks.
  • the boundary to be filtered is a horizontal boundary or a vertical boundary.
  • S402 the description of S402 above, which is not repeated here.
  • S704 Determine the boundary filtering strength of the boundary to be filtered according to the first image block and the second image block adjacent to both sides of the boundary to be filtered. For this step, reference may be made to the description of S403 above, which is not repeated here.
  • S705 Determine whether the boundary filtering strength is greater than the first preset value, if otherwise, perform S713; if yes, perform S706 and S707, or perform S708 and S709.
  • S707 Determine whether to filter the boundary to be filtered according to at least one parameter from the first row parameter to the Nth row parameter.
  • the boundary to be filtered is not filtered.
  • the sum of any two parameters in the first row of parameters to the Nth row of parameters is greater than or equal to the fourth preset value, it is determined that the boundary to be filtered is not filtered.
  • the transformation rate is less than the third preset value, and at least one of the parameters in the first row to the Nth row parameter is less than the fifth preset value, it is determined to filter the boundary to be filtered.
  • the transformation rate is greater than or equal to the third preset value, and/or at least two parameters of the first row parameter to the Nth row parameter are greater than or equal to the sixth preset value, it is determined that the boundary to be filtered is not filtered.
  • the transformation rate is less than the third preset value, and the sum of any two parameters in the first row parameter to the Nth row parameter is less than the seventh preset value, it is determined to filter the boundary to be filtered.
  • the transformation rate is greater than or equal to the third preset value, and/or the sum of any two parameters in the first row parameter to the Nth row parameter is greater than or equal to the eighth preset value, it is determined that the boundary to be filtered is not filtered .
  • the joint progressive feature includes: the first row of parameters and the fourth row of parameters
  • the above S706 may include the following S706-A1 and S706-A2:
  • S706-A2 Determine the parameters of the fourth row according to the difference between the pixel values of the pixel points at both ends and the pixel value of the middle pixel point in the fourth row of the first boundary area.
  • the middle pixel points of the first row of pixel points include: in the first row of pixel points, the first left pixel point adjacent to the to-be-filtered boundary on the left side of the to-be-filtered boundary and the first left pixel point adjacent to the to-be-filtered boundary
  • Two right pixels; the pixels at both ends of the first row of pixels include: the third left pixel adjacent to the second left pixel in the first row of pixels and the second right pixel The third right pixel point adjacent to the pixel point;
  • the middle pixel points of the fourth row of pixel points include: in the fourth row of pixel points, the first left pixel point adjacent to the to-be-filtered boundary on the left side of the boundary to be filtered and the first left pixel point adjacent to the first left pixel point.
  • the pixels at both ends of the pixel point include: the third left pixel point adjacent to the second left pixel point and the third right pixel point adjacent to the second right pixel point in the fourth row of pixel points pixel.
  • S706-A1 includes the following S706-A11:
  • the first line parameter is determined by the difference between the pixel values of the three right pixel points and the pixel value of the first right pixel point and the pixel value of the second right pixel point.
  • dpq 0 is the first line parameter
  • p 0,0 is the first left pixel point in the first line pixel point
  • p 1,0 is the second left pixel point in the first line pixel point
  • p 2,0 is the third left pixel in the first row of pixels
  • q 0,0 is the first right pixel in the first row of pixels
  • q 1,0 is the first row of pixels
  • the second right pixel in q 2,0 is the third right pixel in the first row of pixels.
  • S706-A2 includes the following S706-A21:
  • dpq 3 is the fourth row parameter
  • p 0,3 is the first left pixel point in the fourth row pixel point
  • p 1,3 is the second left pixel point in the fourth row pixel point
  • p 2,3 is the third left pixel in the fourth row of pixels
  • q 0,3 is the first right pixel in the fourth row of pixels
  • q 1,3 is the fourth row of pixels
  • the second right pixel in q 2,3 is the third right pixel in the fourth row of pixels.
  • the above S707 includes the following implementations:
  • Mode 3 According to the pixel values of the pixel points on both sides of the boundary to be filtered, the transformation rate of the pixel values of the pixel points on both sides of the boundary to be filtered is determined; according to the transformation rate, and at least one of the first line parameter and the fourth line parameter parameter to determine whether to filter the boundary to be filtered.
  • the transformation rate is less than the third preset value, and the parameters of the first row and/or the parameters of the fourth row are less than the fifth preset value, it is determined to filter the boundary to be filtered.
  • the transformation rate is less than the third preset value, and the parameters of the first row and the parameter of the fourth row are both greater than or equal to the sixth preset value, it is determined to filter the boundary to be filtered.
  • the transformation rate is less than the third preset value, and the sum of the parameters in the first row and the parameters in the fourth row is less than the seventh preset value, it is determined to filter the boundary to be filtered.
  • the transformation rate is smaller than the third preset value, and the sum of the parameters in the first row and the parameters in the fourth row is greater than or equal to the eighth preset value, it is determined to filter the boundary to be filtered.
  • the boundary to be filtered is a horizontal boundary
  • S709 Determine whether to filter the boundary to be filtered according to at least one parameter in the first column of parameters to the M-th column of parameters.
  • the boundary to be filtered is not subjected to column filtering.
  • the sum of any two parameters in the first column parameter to the Mth column parameter is greater than or equal to the fourth preset value, it is determined that the boundary to be filtered is not subjected to column filtering.
  • the transformation rate is less than the third preset value, and at least one of the parameters in the first column to the Mth column parameter is less than the fifth preset value, it is determined that the boundary to be filtered is subjected to column filtering.
  • the transformation rate is greater than or equal to the third preset value, and/or at least two parameters in the parameters in the first column to the Mth column are greater than or equal to the sixth preset value, it is determined that the boundary to be filtered is not subjected to column filtering .
  • the transformation rate is less than the third preset value, and the sum of any two parameters in the first column of parameters to the Mth column of parameters is less than the seventh preset value, it is determined that the boundary to be filtered is subjected to column filtering.
  • the joint progressive feature includes: the first column parameter and the fourth column parameter
  • the above S708 includes the following S708-A1 and S708-A2:
  • S708-A2 Determine the parameters of the fourth column according to the difference between the pixel values of the pixel points at both ends and the pixel value of the middle pixel point in the fourth column of the second boundary area.
  • the middle pixel points of the first column of pixel points include: in the first column of pixel points, the first upper pixel point adjacent to the boundary to be filtered above the boundary to be filtered and the first pixel point adjacent to the boundary to be filtered.
  • the pixels at both ends of a column of pixels include: a third upper pixel adjacent to the second upper pixel in the first column of pixels and a third lower pixel adjacent to the second lower pixel ;
  • the middle pixel points of the fourth column of pixel points include: in the fourth column of pixel points, the first upper pixel point adjacent to the boundary to be filtered above the boundary to be filtered and the second upper pixel point adjacent to the first upper pixel point Pixel points, the first lower pixel point adjacent to the boundary to be filtered below the boundary to be filtered, and the second lower pixel point adjacent to the first lower pixel point; the pixel points at both ends of the fourth column of pixel points include : The third upper pixel point adjacent to the second upper pixel point and the third lower pixel point adjacent to the second lower pixel point in the fourth column of pixels.
  • S708-A1 includes the following S708-A11:
  • the first column parameter is determined by the difference between the pixel value of the pixel point and the pixel value of the first lower pixel point and the pixel value of the second lower pixel point.
  • the first column parameter is determined according to the following formula:
  • dpq 0 is the parameter of the first column
  • p 0,0 is the first upper pixel in the first column of pixels
  • p 1,0 is the second upper pixel in the first column of pixels
  • p 2 ,0 is the third upper pixel in the first column of pixels
  • q 0,0 is the first lower pixel in the first column of pixels
  • q 1,0 is the second pixel in the first column of pixels below pixels
  • q 2,0 is the third below pixel in the first column of pixels.
  • S708-A2 includes the following S708-A21:
  • the fourth column parameter is determined by the difference between the pixel value of the pixel point and the pixel value of the first lower pixel point and the pixel value of the second lower pixel point.
  • dpq 3 is the fourth column parameter
  • p 0,3 is the first upper pixel point in the fourth column pixel point
  • p 1,3 is the second upper pixel point in the fourth column pixel point
  • p 2 ,3 is the third upper pixel in the fourth column of pixels
  • q 0,3 is the first lower pixel in the fourth column of pixels
  • q 1,3 is the second in the fourth column of pixels q 2 , 3 is the third lower pixel in the fourth column of pixels.
  • the above S709 includes the following implementations:
  • Mode 3 According to the pixel values of the pixels on both sides of the boundary to be filtered, the transformation rate of the pixel values of the pixels on both sides of the boundary to be filtered is determined; according to the transformation rate, and at least one of the first column parameter and the fourth column parameter parameter to determine whether to filter the boundary to be filtered.
  • the transformation rate is smaller than the third preset value, and the first column parameter and/or the fourth column parameter is smaller than the fifth preset value, it is determined to filter the boundary to be filtered.
  • the transformation rate is smaller than the third preset value, and the parameters in the first column and the parameter in the fourth column are both greater than or equal to the sixth preset value, it is determined to filter the boundary to be filtered.
  • the transformation rate is less than the third preset value, and the sum of the parameters in the first column and the parameters in the fourth column is less than the seventh preset value, it is determined to filter the boundary to be filtered.
  • the transformation rate is less than the third preset value, and the sum of the first column parameter and the fourth column parameter is greater than or equal to the eighth preset value, it is determined to filter the boundary to be filtered.
  • the filtering methods include strong filtering and weak filtering.
  • S712 Store the filtered reconstructed image block in the decoded image buffer.
  • the video decoder can obtain the filtered reconstructed image from the decoded image buffer as a reference frame, or transmit the filtered reconstructed image to the display device for presentation.
  • FIG. 9 is only an example of the present application, and should not be construed as a limitation of the present application.
  • FIG. 10 is a schematic block diagram of a video encoder 800 provided by an embodiment of the present application.
  • the video encoder 800 includes:
  • an obtaining unit 810 configured to obtain a partial or complete reconstructed image of the image block to be encoded, wherein the partial or complete reconstructed image includes one or more reconstructed image blocks;
  • a boundary determination unit 812 configured to determine the boundary to be filtered of the reconstructed image block
  • an intensity determination unit 813 configured to determine the boundary filtering intensity of the boundary to be filtered according to the encoding information of the first image block and the second image block adjacent to both sides of the boundary to be filtered;
  • the feature determination unit 814 is configured to determine the joint progressive feature of the boundary to be filtered according to the pixel values of the pixels on both sides of the boundary to be filtered when the filter strength of the boundary is greater than the first preset value; optionally, the first preset value is 0;
  • the filtering determination unit 815 is configured to determine whether to filter the boundary to be filtered according to the joint progressive feature of the boundary to be filtered.
  • the feature determination unit 814 is specifically configured to determine the to-be-filtered pixel value according to the difference between the pixel value of the middle pixel point in the pixel points on both sides of the to-be-filtered boundary and the pixel value of the two end pixel points The joint progressive feature of the boundary, wherein the middle pixel point is the pixel point adjacent to the boundary to be filtered, and the two end pixel points are the pixel points adjacent to the middle pixel point.
  • the feature determination unit 814 is specifically configured to determine the i-th row according to the first boundary area.
  • the difference between the pixel values of the pixel points at both ends of the pixel point and the pixel value of the middle pixel point determines the i-th row parameter; at least one of the first row parameter to the Nth row parameter is determined as the joint progressive feature , where N is a positive integer, and i is an integer greater than or equal to 1 and less than the N;
  • the middle pixel points of the pixel points in the i-th row include: in the pixel points in the i-th row, the first left pixel point on the left side of the boundary to be filtered adjacent to the boundary to be filtered and the pixel point on the left adjacent to the boundary to be filtered The second left pixel point adjacent to the left pixel point, and the first right pixel point adjacent to the to-be-filtered boundary on the right side of the boundary to be filtered, and the second right pixel point adjacent to the first right pixel point right pixels;
  • the pixels at both ends of the pixel point in the i-th row include: the third left pixel point adjacent to the second left pixel point and the third right pixel point adjacent to the second right pixel point in the pixel point in the i-th row right pixels.
  • the feature determination unit 814 is specifically configured to, according to the pixel value of the third left pixel point in the i-th row of pixels, respectively correspond to the pixel value of the first left pixel point and the second left pixel point.
  • the feature determining unit 814 is specifically configured to determine the parameters of the i-th row according to the following formula:
  • dpq i is the i-th row parameter
  • p 0,i is the first left pixel point in the i-th row pixel point
  • p 1,i is the second left pixel point in the i-th row pixel point
  • p 2,i is the third left pixel in the i-th row of pixels
  • q 0,i is the first right-hand pixel in the i-th row of pixels
  • q 1,i is the i-th row of pixels
  • the second right pixel in q 2,i is the third right pixel in the i-th row of pixels.
  • the filtering determination unit 815 is specifically configured to determine that the boundary to be filtered is not to be filtered when at least two parameters in the first row parameter to the Nth row parameter are greater than or equal to the second preset value.
  • the second preset value is greater than 0.5 and less than 1.
  • the second preset value is greater than 0.5 and less than 0.8.
  • the second preset value is equal to half of the third preset value.
  • the filtering determining unit 815 further determines the second preset value according to the quantization parameter QP.
  • the filtering determination unit 815 is specifically configured to determine not to filter the boundary to be filtered when the sum of any two parameters in the first row parameter to the Nth row parameter is greater than or equal to the fourth preset value.
  • the filtering determination unit 815 is specifically configured to determine the transformation rate of the pixel values of the pixel points on both sides of the boundary to be filtered according to the pixel values of the pixel points on both sides of the boundary to be filtered; At least one parameter from the row parameter to the Nth row parameter determines whether to filter the boundary to be filtered.
  • the filtering determination unit 815 is specifically configured to determine to be filtered when the transformation rate is less than the third preset value and at least one parameter of the first row parameter to the Nth row parameter is less than the fifth preset value filter the boundaries.
  • the filtering determination unit 815 is specifically configured to, when the transformation rate is greater than or equal to the third preset value, and/or at least two parameters of the first row parameter to the Nth row parameter are greater than or equal to the sixth preset value When the value is set, it is determined that the boundary to be filtered is not filtered.
  • the filtering determining unit 815 is specifically configured to determine when the conversion rate is less than the third preset value and the sum of any two parameters in the first row parameter to the Nth row parameter is less than the seventh preset value Filter the boundary to be filtered.
  • the filtering determination unit 815 is specifically configured to, when the transformation rate is greater than or equal to the third preset value, and/or the sum of any two parameters in the first row parameter to the Nth row parameter is greater than or equal to the eighth When the preset value is used, it is determined that the boundary to be filtered is not filtered.
  • the joint progressive feature includes: the first line parameter and the fourth line parameter
  • the feature determination unit 814 is specifically configured to, according to the two parameters of the first line pixel points of the first boundary area
  • the difference between the pixel value of the end pixel point and the pixel value of the middle pixel point determines the parameters of the first line; according to the difference between the pixel value of the pixel points at the two ends of the pixel point of the fourth line of the first boundary area and the pixel value of the middle pixel point Difference, determine the fourth line parameter.
  • the middle pixel points of the first row of pixel points include: in the first row of pixel points, the first left pixel point on the left side of the boundary to be filtered adjacent to the boundary to be filtered and the first left pixel point adjacent to the boundary to be filtered.
  • the pixel points at both ends of the first row of pixels include: the third left pixel point adjacent to the second left pixel point in the first row pixel point and the third right pixel point adjacent to the second right pixel point. three right pixels;
  • the middle pixel points of the fourth row of pixel points include: in the fourth row of pixel points, the first left pixel point adjacent to the to-be-filtered boundary on the left side of the boundary to be filtered and the first left pixel point adjacent to the first left pixel point.
  • the pixels at both ends of the pixel point include: the third left pixel point adjacent to the second left pixel point and the third right pixel point adjacent to the second right pixel point in the fourth row of pixel points pixel.
  • the feature determination unit 814 is specifically configured to compare the pixel value of the third left pixel point in the first row of pixels with the pixel value of the first left pixel point and the pixel value of the second left pixel point respectively The difference between the values, and the difference between the pixel value of the third right pixel and the pixel value of the first right pixel and the pixel value of the second right pixel, respectively, determine the first line parameter.
  • the feature determining unit 814 is specifically configured to determine the parameters of the first row according to the following formula:
  • dpq 0 is the first line parameter
  • p 0,0 is the first left pixel point in the first line pixel point
  • p 1,0 is the second left pixel point in the first line pixel point
  • p 2,0 is the third left pixel in the first row of pixels
  • q 0,0 is the first right pixel in the first row of pixels
  • q 1,0 is the first row of pixels
  • the second right pixel in q 2,0 is the third right pixel in the first row of pixels.
  • the feature determination unit 814 is specifically used for according to the pixel value of the third left pixel in the fourth row of pixels and the pixel value of the first left pixel and the pixel value of the second left pixel respectively.
  • the feature determining unit 814 is specifically configured to determine the fourth row parameter according to the following formula:
  • dpq 3 is the fourth row parameter
  • p 0,3 is the first left pixel point in the fourth row pixel point
  • p 1,3 is the second left pixel point in the fourth row pixel point
  • p 2,3 is the third left pixel in the fourth row of pixels
  • q 0,3 is the first right pixel in the fourth row of pixels
  • q 1,3 is the fourth row of pixels
  • the second right pixel in q 2,3 is the third right pixel in the fourth row of pixels.
  • the filtering determination unit 815 is specifically configured to determine that the boundary to be filtered is not filtered when the parameters in the first row and the parameter in the fourth row are both greater than or equal to the second preset value;
  • the conversion rate of the pixel values of the pixel points on both sides of the boundary to be filtered determines the conversion rate of the pixel values of the pixel points on both sides of the boundary to be filtered; according to the conversion rate, and at least one parameter in the first line parameter and the fourth line parameter , to determine whether to filter the boundary to be filtered.
  • the transformation rate is less than the third preset value, and the parameters of the first row and/or the parameters of the fourth row are less than the fifth preset value, it is determined to filter the boundary to be filtered.
  • the transformation rate is less than the third preset value, and the parameters of the first row and the parameter of the fourth row are both greater than or equal to the sixth preset value, it is determined to filter the boundary to be filtered.
  • the transformation rate is smaller than the third preset value, and the sum of the parameters in the first row and the parameter in the fourth row is smaller than the seventh preset value, it is determined to filter the boundary to be filtered.
  • the transformation rate is smaller than the third preset value, and the sum of the parameters in the first row and the parameters in the fourth row is greater than or equal to the eighth preset value, it is determined to filter the boundary to be filtered.
  • the second boundary area formed by the first image block and the second image block includes M columns of pixels.
  • the difference between the pixel value of the pixel points at both ends and the pixel value of the middle pixel point determines the parameter in the jth column; at least one of the parameters in the first column to the Nth column parameter is determined as the joint progressive feature, wherein the M is a positive integer, and the j is an integer greater than or equal to 1 and less than the M.
  • the middle pixel points of the jth column of pixels include: among the jth column of pixels, the first upper pixel point adjacent to the to-be-filtered boundary above the boundary to be filtered and the pixel above the first pixel point adjacent to the boundary to be filtered The second upper pixel point adjacent to the pixel point, the first lower pixel point adjacent to the boundary to be filtered below the boundary to be filtered, and the second lower pixel point adjacent to the first lower pixel point;
  • the pixel points at both ends of the pixel point in the jth column include: the third upper pixel point adjacent to the second upper pixel point and the third lower pixel point adjacent to the second lower pixel point among the pixel points in the jth column point.
  • the above-mentioned feature determination unit 814 is specifically configured to, according to the pixel value of the third upper pixel in the jth column of pixels, and the pixel value of the first upper pixel and the second upper pixel, respectively, The difference between the pixel values of the point and the difference between the pixel value of the third lower pixel point and the pixel value of the first lower pixel point and the pixel value of the second lower pixel point, respectively, determines the jth column parameter.
  • the feature determination unit 814 is specifically configured to determine the parameter of the jth column according to the following formula:
  • dpq j is the parameter of the jth column
  • p 0,j is the first upper pixel point in the jth column pixel point
  • p 1,j is the second upper pixel point in the jth column pixel point
  • p 2 ,j is the third upper pixel in the jth column of pixels
  • q 0,j is the first lower pixel in the jth column of pixels
  • q 1,j is the second in the jth column of pixels below pixels
  • q 2,j is the third below pixel in the jth column of pixels.
  • the filtering determination unit 815 is specifically configured to determine not to filter the boundary to be filtered when at least two parameters in the first column of parameters to the Mth column of parameters are greater than or equal to the second preset value.
  • the second preset value is greater than 0.5 and less than 1.
  • the second preset value is greater than 0.5 and less than 0.8.
  • the second preset value is equal to half of the third preset value.
  • the filtering determining unit 815 further determines the second preset value according to the quantization parameter QP.
  • the filtering determination unit 815 is specifically configured to determine that the boundary to be filtered is not to be filtered when the sum of any two parameters in the first column of parameters to the Mth column of parameters is greater than or equal to the fourth preset value.
  • the filtering determination unit 815 is specifically configured to determine the transformation rate of the pixel values of the pixel points on both sides of the boundary to be filtered according to the pixel values of the pixel points on both sides of the boundary to be filtered; At least one parameter from the column parameter to the Mth column parameter determines whether to filter the boundary to be filtered.
  • the filtering determining unit 815 is specifically configured to determine to be filtered when the transformation rate is less than the third preset value and at least one parameter in the first column parameter to the Mth column parameter is less than the fifth preset value filter the boundaries.
  • the filtering determination unit 815 is specifically configured to, when the transformation rate is greater than or equal to the third preset value, and/or at least two parameters in the first column parameter to the Mth column parameter are greater than or equal to the sixth second parameter When the preset value is used, it is determined that the boundary to be filtered is not filtered.
  • the filtering determination unit 815 is specifically configured to determine when the transformation rate is less than the third preset value and the sum of any two parameters in the first column of parameters to the Mth column of parameters is less than the seventh preset value Filter the boundary to be filtered.
  • the filtering determination unit 815 is specifically configured to, when the transformation rate is greater than or equal to the third preset value, and/or the sum of any two parameters in the first column parameter to the Mth column parameter is greater than or equal to the eighth When the preset value is used, it is determined that the boundary to be filtered is not filtered.
  • the joint progressive feature includes: the first column parameter and the fourth column parameter
  • the feature determination unit 814 is specifically configured to, according to the two parameters of the pixel points of the first column of the second boundary region
  • the difference between the pixel value of the end pixel point and the pixel value of the middle pixel point determines the parameters of the first column; according to the difference between the pixel value of the pixel points at the two ends of the pixel point of the fourth column of the second boundary area and the pixel value of the middle pixel point Difference, determine the fourth column parameter.
  • the middle pixel points of the first column of pixel points include: in the first column of pixel points, a first upper pixel point adjacent to the boundary to be filtered above the boundary to be filtered and a pixel point adjacent to the first upper pixel point.
  • the end pixel points include: a third upper pixel point adjacent to the second upper pixel point and a third lower pixel point adjacent to the second lower pixel point in the first column of pixel points;
  • the middle pixel points of the fourth column of pixel points include: in the fourth column of pixel points, the first upper pixel point adjacent to the boundary to be filtered above the boundary to be filtered and the second upper pixel point adjacent to the first upper pixel point Pixel points, the first lower pixel point adjacent to the boundary to be filtered below the boundary to be filtered, and the second lower pixel point adjacent to the first lower pixel point; the pixel points at both ends of the fourth column of pixel points include : The third upper pixel point adjacent to the second upper pixel point and the third lower pixel point adjacent to the second lower pixel point in the fourth column of pixels.
  • the feature determination unit 814 is specifically configured to, according to the difference between the pixel value of the third upper pixel point in the first column of pixel points and the pixel value of the first upper pixel point and the pixel value of the second upper pixel point, respectively value, and the difference between the pixel value of the third lower pixel point and the pixel value of the first lower pixel point and the pixel value of the second lower pixel point, respectively, to determine the parameters of the first column.
  • the feature determination unit 814 is specifically configured to determine the parameters of the first column according to the following formula:
  • dpq 0 is the parameter of the first column
  • p 0,0 is the first upper pixel in the first column of pixels
  • p 1,0 is the second upper pixel in the first column of pixels
  • p 2 ,0 is the third upper pixel in the first column of pixels
  • q 0,0 is the first lower pixel in the first column of pixels
  • q 1,0 is the second pixel in the first column of pixels below pixels
  • q 2,0 is the third below pixel in the first column of pixels.
  • the feature determination unit 814 is specifically used for according to the difference value of the pixel value of the pixel value above the third pixel point in the fourth column of pixels and the pixel value of the pixel value above the first pixel point and the pixel value of the second pixel point above, and the difference between the pixel value of the third lower pixel point and the pixel value of the first lower pixel point and the pixel value of the second lower pixel point, respectively, to determine the fourth column parameter.
  • the feature determining unit 814 is specifically configured to determine the fourth column parameter according to the following formula:
  • dpq 3 is the fourth column parameter
  • p 0,3 is the first upper pixel point in the fourth column pixel point
  • p 1,3 is the second upper pixel point in the fourth column pixel point
  • p 2 ,3 is the third upper pixel in the fourth column of pixels
  • q 0,3 is the first lower pixel in the fourth column of pixels
  • q 1,3 is the second in the fourth column of pixels q 2 , 3 is the third lower pixel in the fourth column of pixels.
  • the filtering determination unit 815 is specifically configured to determine that the boundary to be filtered is not filtered when the parameters in the first column and the parameter in the fourth column are both greater than or equal to the second preset value;
  • the conversion rate of the pixel values of the pixel points on both sides of the boundary to be filtered determines the conversion rate of the pixel values of the pixel points on both sides of the boundary to be filtered; according to the conversion rate, and at least one parameter in the first column parameter and the fourth column parameter , to determine whether to filter the boundary to be filtered.
  • the transformation rate is smaller than the third preset value, and the first column parameter and/or the fourth column parameter is smaller than the fifth preset value, it is determined to filter the boundary to be filtered.
  • the transformation rate is smaller than the third preset value, and the parameters in the first column and the parameter in the fourth column are both greater than or equal to the sixth preset value, it is determined to filter the boundary to be filtered.
  • the transformation rate is less than the third preset value, and the sum of the parameters in the first column and the parameters in the fourth column is less than the seventh preset value, it is determined to filter the boundary to be filtered.
  • the transformation rate is less than the third preset value, and the sum of the first column parameter and the fourth column parameter is greater than or equal to the eighth preset value, it is determined to filter the boundary to be filtered.
  • the apparatus embodiments and the method embodiments may correspond to each other, and similar descriptions may refer to the method embodiments. To avoid repetition, details are not repeated here.
  • the video encoder 800 shown in FIG. 10 may perform the methods of the embodiments of the present application, and the aforementioned and other operations and/or functions of the respective units in the video encoder 800 are for implementing the methods in the respective methods such as method 400 or 500, respectively. The corresponding process, for the sake of brevity, will not be repeated here.
  • FIG. 11 is a schematic block diagram of a video decoder 900 provided by an embodiment of the present application.
  • the video decoder 900 may include:
  • a decoding unit 910 configured to decode the code stream to obtain a partial or complete reconstructed image, wherein the partial or complete reconstructed image includes one or more reconstructed image blocks;
  • a boundary determination unit 912 configured to determine the boundary to be filtered of the reconstructed image block
  • an intensity determination unit 913 configured to determine the boundary filtering intensity of the boundary to be filtered according to the first image block and the second image block adjacent to both sides of the boundary to be filtered;
  • the feature determination unit 914 is configured to determine the joint progressive feature of the boundary to be filtered according to the pixel values of the pixels on both sides of the boundary to be filtered when the filter strength of the boundary is greater than the first preset value; for example, the first preset value is 0;
  • the filtering determination unit 915 is configured to determine whether to filter the boundary to be filtered according to the joint progressive feature of the boundary to be filtered.
  • the feature determination unit 914 is specifically configured to determine the joint of the boundary to be filtered according to the difference between the pixel value of the middle pixel point and the pixel values of the pixel points at both ends of the boundary to be filtered according to the pixel value on both sides of the boundary to be filtered. Progressive features.
  • the boundary to be filtered is a vertical boundary
  • the first boundary area formed by the first image block and the second image block includes N rows of pixel points.
  • the feature determination unit 914 is specifically configured to determine The difference between the pixel values of the pixel points at the two ends of the pixel point in the i-th row and the pixel value of the middle pixel point determines the parameter of the i-th row; Joint progressive features of boundaries to be filtered, where N is a positive integer, and i is a positive integer greater than or equal to 1 and less than or equal to N.
  • the middle pixel points of the pixel points in the i-th row include: among the pixels in the i-th row, the first left pixel point on the left side of the boundary to be filtered adjacent to the boundary to be filtered and the first left pixel point on the left side of the boundary to be filtered The second left pixel adjacent to the pixel point, the first right pixel adjacent to the boundary to be filtered on the right side of the boundary to be filtered, and the second right pixel adjacent to the first right pixel pixel;
  • the pixels at both ends of the pixel point in the i-th row include: the third left pixel point adjacent to the second left pixel point and the third right pixel point adjacent to the second right pixel point in the pixel point in the i-th row right pixels.
  • the feature determining unit 914 is specifically configured to, according to the pixel value of the third left pixel in the i-th row of pixels, be respectively related to the pixel value of the first left pixel and the second left pixel. The difference between the pixel values of the point, and the difference between the pixel value of the third right pixel and the pixel value of the first right pixel and the pixel value of the second right pixel respectively, determine the i-th row parameter.
  • the feature determination unit 914 is specifically configured to determine the parameters of the i-th row according to the following formula:
  • dpq i is the i-th row parameter
  • p 0,i is the first left pixel point in the i-th row pixel point
  • p 1,i is the second left pixel point in the i-th row pixel point
  • p 2,i is the third left pixel in the i-th row of pixels
  • q 0,i is the first right-hand pixel in the i-th row of pixels
  • q 1,i is the i-th row of pixels
  • the second right pixel in q 2,i is the third right pixel in the i-th row of pixels.
  • the filtering determination unit 915 is specifically configured to determine that the boundary to be filtered is not to be filtered when at least two parameters in the first row parameter to the Nth row parameter are greater than or equal to the second preset value.
  • the second preset value is greater than 0.5 and less than 1.
  • the second preset value is greater than 0.5 and less than 0.8.
  • the second preset value is equal to half of the third preset value.
  • the filtering determining unit 915 is further configured to determine the second preset value according to the quantization parameter QP.
  • the filtering determination unit 915 is specifically configured to determine that the boundary to be filtered is not to be filtered when the sum of any two parameters in the first row parameter to the Nth row parameter is greater than or equal to the fourth preset value.
  • the filtering determination unit 915 is specifically configured to determine the transformation rate of the pixel values of the pixel points on both sides of the boundary to be filtered according to the pixel values of the pixels on both sides of the boundary to be filtered; At least one parameter from the row parameter to the Nth row parameter determines whether to filter the boundary to be filtered.
  • the filtering determination unit 915 is specifically configured to determine to be filtered when the transformation rate is less than the third preset value and at least one parameter of the first row parameter to the Nth row parameter is less than the fifth preset value filter the boundaries.
  • the filtering determination unit 915 is specifically configured to, when the transformation rate is greater than or equal to the third preset value, and/or at least two parameters of the first row parameter to the Nth row parameter are greater than or equal to the sixth preset value When the value is set, it is determined that the boundary to be filtered is not filtered.
  • the filtering determination unit 915 is specifically configured to determine when the transformation rate is less than the third preset value and the sum of any two parameters in the first row parameter to the Nth row parameter is less than the seventh preset value Filter the boundary to be filtered.
  • the filtering determination unit 915 is specifically configured to, when the transformation rate is greater than or equal to the third preset value, and/or the sum of any two parameters in the first row parameter to the Nth row parameter is greater than or equal to the eighth When the preset value is used, it is determined that the boundary to be filtered is not filtered.
  • the joint progressive feature includes: the first line parameter and the fourth line parameter
  • the feature determining unit 914 is specifically configured to determine the first line of pixels according to the two parameters of the first line of the first boundary area.
  • the difference between the pixel value of the end pixel point and the pixel value of the middle pixel point determines the parameters of the first line; according to the difference between the pixel value of the pixel points at the two ends of the pixel point of the fourth line of the first boundary area and the pixel value of the middle pixel point Difference, determine the fourth line parameter.
  • the middle pixel points of the first row of pixel points include: in the first row of pixel points, the first left pixel point on the left side of the boundary to be filtered adjacent to the boundary to be filtered and the first left pixel point adjacent to the boundary to be filtered.
  • the pixel points at both ends of the first row of pixels include: the third left pixel point adjacent to the second left pixel point in the first row pixel point and the third right pixel point adjacent to the second right pixel point. three right pixels;
  • the middle pixel points of the fourth row of pixel points include: in the fourth row of pixel points, the first left pixel point adjacent to the to-be-filtered boundary on the left side of the boundary to be filtered and the first left pixel point adjacent to the first left pixel point.
  • the pixels at both ends of the pixel point include: the third left pixel point adjacent to the second left pixel point and the third right pixel point adjacent to the second right pixel point in the fourth row of pixel points pixel.
  • the feature determining unit 914 is specifically configured to compare the pixel value of the third left pixel point in the first row of pixels with the pixel value of the first left pixel point and the pixel value of the second left pixel point respectively The difference between the values, and the difference between the pixel value of the third right pixel and the pixel value of the first right pixel and the pixel value of the second right pixel, respectively, determine the first line parameter.
  • the feature determining unit 914 is specifically configured to determine the parameters of the first row according to the following formula:
  • dpq 0 is the first line parameter
  • p 0,0 is the first left pixel point in the first line pixel point
  • p 1,0 is the second left pixel point in the first line pixel point
  • p 2,0 is the third left pixel in the first row of pixels
  • q 0,0 is the first right pixel in the first row of pixels
  • q 1,0 is the first row of pixels
  • the second right pixel in q 2,0 is the third right pixel in the first row of pixels.
  • the feature determination unit 914 is specifically used for according to the pixel value of the third left pixel in the fourth row of pixels and the pixel value of the first left pixel and the pixel value of the second left pixel respectively.
  • the feature determining unit 914 is specifically configured to determine the fourth row parameter according to the following formula:
  • dpq 3 is the fourth row parameter
  • p 0,3 is the first left pixel point in the fourth row pixel point
  • p 1,3 is the second left pixel point in the fourth row pixel point
  • p 2,3 is the third left pixel in the fourth row of pixels
  • q 0,3 is the first right pixel in the fourth row of pixels
  • q 1,3 is the fourth row of pixels
  • the second right pixel in q 2,3 is the third right pixel in the fourth row of pixels.
  • the filtering determination unit 915 is specifically configured to determine that the boundary to be filtered is not filtered when the parameters in the first row and the parameter in the fourth row are both greater than or equal to the second preset value;
  • the conversion rate of the pixel values of the pixel points on both sides of the boundary to be filtered determines the conversion rate of the pixel values of the pixel points on both sides of the boundary to be filtered; according to the conversion rate, and at least one parameter in the first line parameter and the fourth line parameter , to determine whether to filter the boundary to be filtered.
  • the transformation rate is less than the third preset value, and the parameters of the first row and/or the parameters of the fourth row are less than the fifth preset value, it is determined to filter the boundary to be filtered.
  • the transformation rate is less than the third preset value, and the parameters of the first row and the parameter of the fourth row are both greater than or equal to the sixth preset value, it is determined to filter the boundary to be filtered.
  • the transformation rate is smaller than the third preset value, and the sum of the parameters in the first row and the parameter in the fourth row is smaller than the seventh preset value, it is determined to filter the boundary to be filtered.
  • the transformation rate is smaller than the third preset value, and the sum of the parameters in the first row and the parameters in the fourth row is greater than or equal to the eighth preset value, it is determined to filter the boundary to be filtered.
  • the second boundary area formed by the first image block and the second image block includes M columns of pixel points.
  • the feature determining unit 914 is specifically configured to determine The difference between the pixel values of the pixel points at both ends of the pixel point in the jth column and the pixel value of the middle pixel point determines the parameter in the jth column; at least one of the parameters in the first column to the Nth column parameter is determined as the joint progressive feature, wherein the M is a positive integer, and the j is an integer greater than or equal to 1 and less than the M.
  • the middle pixel points of the jth column of pixels include: in the jth column of pixels, the first upper pixel point adjacent to the to-be-filtered boundary above the to-be-filtered boundary and the first upper pixel point The adjacent second upper pixel point, and the first lower pixel point adjacent to the boundary to be filtered below the boundary to be filtered and the second lower pixel point adjacent to the first lower pixel point;
  • the pixel points at both ends of the pixel point in the jth column include: the third upper pixel point adjacent to the second upper pixel point and the third lower pixel point adjacent to the second lower pixel point among the pixel points in the jth column point.
  • the feature determining unit 914 is specifically configured to, according to the pixel value of the third upper pixel point in the jth column of pixels, respectively correspond to the pixel value of the first upper pixel point and the pixel value of the second upper pixel point.
  • the feature determining unit 914 is specifically configured to determine the parameter of the jth column according to the following formula:
  • dpq j is the parameter of the jth column
  • p 0,j is the first upper pixel point in the jth column pixel point
  • p 1,j is the second upper pixel point in the jth column pixel point
  • p 2 ,j is the third upper pixel in the jth column of pixels
  • q 0,j is the first lower pixel in the jth column of pixels
  • q 1,j is the second in the jth column of pixels below pixels
  • q 2,j is the third below pixel in the jth column of pixels.
  • the filtering determination unit 915 is specifically configured to determine not to filter the boundary to be filtered when at least two parameters in the first column of parameters to the Mth column of parameters are greater than or equal to the second preset value.
  • the second preset value is greater than 0.5 and less than 1.
  • the second preset value is greater than 0.5 and less than 0.8.
  • the second preset value is equal to half of the third preset value.
  • the filtering determining unit 915 is further configured to determine the second preset value according to the quantization parameter QP.
  • the filtering determination unit 915 is specifically configured to determine that the boundary to be filtered is not to be filtered when the sum of any two parameters in the first column of parameters to the Mth column of parameters is greater than or equal to the fourth preset value.
  • the filtering determination unit 915 is specifically configured to determine the transformation rate of the pixel values of the pixel points on both sides of the boundary to be filtered according to the pixel values of the pixel points on both sides of the boundary to be filtered; according to the transformation rate and the first At least one parameter from the column parameter to the Mth column parameter determines whether to filter the boundary to be filtered.
  • the filtering determination unit 915 is specifically configured to determine to be filtered when the transformation rate is less than the third preset value and at least one parameter in the first column parameter to the Mth column parameter is less than the fifth preset value filter the boundaries.
  • the filtering determination unit 915 is specifically configured to, when the transformation rate is greater than or equal to the third preset value, and/or at least two parameters in the first column parameter to the Mth column parameter are greater than or equal to the sixth preset value When the value is set, it is determined that the boundary to be filtered is not filtered.
  • the filtering determination unit 915 is specifically configured to determine when the transformation rate is less than the third preset value and the sum of any two parameters in the first column of parameters to the Mth column of parameters is less than the seventh preset value Filter the boundary to be filtered.
  • the filtering determining unit 915 is specifically configured to, when the transformation rate is greater than or equal to the third preset value, and/or the sum of any two parameters in the first column parameter to the Mth column parameter is greater than or equal to the eighth When the preset value is used, it is determined that the boundary to be filtered is not filtered.
  • the joint progressive feature includes: the first column parameter and the Mth column parameter.
  • the joint progressive feature includes: the first column parameter and the fourth column parameter
  • the feature determining unit 914 is specifically configured to, according to the two parameters of the first column pixel points of the second boundary region The difference between the pixel value of the end pixel point and the pixel value of the middle pixel point determines the parameters of the first column; according to the difference between the pixel value of the pixel points at the two ends of the pixel point of the fourth column of the second boundary area and the pixel value of the middle pixel point Difference, determine the fourth column parameter.
  • the middle pixel points of the first column of pixel points include: in the first column of pixel points, a first upper pixel point adjacent to the boundary to be filtered above the boundary to be filtered and a pixel point adjacent to the first upper pixel point.
  • the end pixel points include: a third upper pixel point adjacent to the second upper pixel point and a third lower pixel point adjacent to the second lower pixel point in the first column of pixel points;
  • the middle pixel points of the fourth column of pixel points include: in the fourth column of pixel points, the first upper pixel point adjacent to the boundary to be filtered above the boundary to be filtered and the second upper pixel point adjacent to the first upper pixel point Pixel points, the first lower pixel point adjacent to the boundary to be filtered below the boundary to be filtered, and the second lower pixel point adjacent to the first lower pixel point; the pixel points at both ends of the fourth column of pixel points include : The third upper pixel point adjacent to the second upper pixel point and the third lower pixel point adjacent to the second lower pixel point in the fourth column of pixels.
  • the feature determination unit 914 is specifically configured to, according to the difference between the pixel value of the third upper pixel point in the first column of pixel points and the pixel value of the first upper pixel point and the pixel value of the second upper pixel point, respectively value, and the difference between the pixel value of the third lower pixel point and the pixel value of the first lower pixel point and the pixel value of the second lower pixel point, respectively, to determine the parameters of the first column.
  • the feature determining unit 914 is specifically configured to determine the parameters of the first column according to the following formula:
  • dpq 0 is the parameter of the first column
  • p 0,0 is the first upper pixel in the first column of pixels
  • p 1,0 is the second upper pixel in the first column of pixels
  • p 2 ,0 is the third upper pixel in the first column of pixels
  • q 0,0 is the first lower pixel in the first column of pixels
  • q 1,0 is the second pixel in the first column of pixels below pixels
  • q 2,0 is the third below pixel in the first column of pixels.
  • the feature determination unit 914 is specifically used for according to the pixel value of the 3rd upper pixel point in the 4th row pixel point respectively and the pixel value of the 1st upper pixel point and the pixel value of the 2nd upper pixel point difference value, and the difference between the pixel value of the third lower pixel point and the pixel value of the first lower pixel point and the pixel value of the second lower pixel point, respectively, to determine the fourth column parameter.
  • the feature determining unit 814 is specifically configured to determine the fourth column parameter according to the following formula:
  • dpq 3 is the fourth column parameter
  • p 0,3 is the first upper pixel point in the fourth column pixel point
  • p 1,3 is the second upper pixel point in the fourth column pixel point
  • p 2 ,3 is the third upper pixel in the fourth column of pixels
  • q 0,3 is the first lower pixel in the fourth column of pixels
  • q 1,3 is the second in the fourth column of pixels q 2 , 3 is the third lower pixel in the fourth column of pixels.
  • the filtering determination unit 915 is specifically configured to determine that the boundary to be filtered is not filtered when the parameters in the first column and the parameter in the fourth column are both greater than or equal to the second preset value;
  • the conversion rate of the pixel values of the pixel points on both sides of the boundary to be filtered determines the conversion rate of the pixel values of the pixel points on both sides of the boundary to be filtered; according to the conversion rate, and at least one parameter in the first column parameter and the fourth column parameter , to determine whether to filter the boundary to be filtered.
  • the transformation rate is smaller than the third preset value, and the first column parameter and/or the fourth column parameter is smaller than the fifth preset value, it is determined to filter the boundary to be filtered.
  • the transformation rate is smaller than the third preset value, and the parameters in the first column and the parameter in the fourth column are both greater than or equal to the sixth preset value, it is determined to filter the boundary to be filtered.
  • the transformation rate is less than the third preset value, and the sum of the parameters in the first column and the parameters in the fourth column is less than the seventh preset value, it is determined to filter the boundary to be filtered.
  • the transformation rate is less than the third preset value, and the sum of the first column parameter and the fourth column parameter is greater than or equal to the eighth preset value, it is determined to filter the boundary to be filtered.
  • the apparatus embodiments and the method embodiments may correspond to each other, and similar descriptions may refer to the method embodiments. To avoid repetition, details are not repeated here.
  • the video decoder 900 shown in FIG. 11 may correspond to the corresponding subject in performing the method 600 or 700 of the embodiments of the present application, and the aforementioned and other operations and/or functions of the respective units in the video decoder 900 are for the purpose of For the sake of brevity, the corresponding processes in each method such as the implementation method 600 or 700 will not be repeated here.
  • the functional unit may be implemented in the form of hardware, may also be implemented by an instruction in the form of software, or may be implemented by a combination of hardware and software units.
  • the steps of the method embodiments in the embodiments of the present application may be completed by hardware integrated logic circuits in the processor and/or instructions in the form of software, and the steps of the methods disclosed in conjunction with the embodiments of the present application may be directly embodied as hardware
  • the execution of the decoding processor is completed, or the execution is completed by a combination of hardware and software units in the decoding processor.
  • the software unit may be located in random access memory, flash memory, read-only memory, programmable read-only memory, electrically erasable programmable memory, registers, and other storage media mature in the art.
  • the storage medium is located in the memory, and the processor reads the information in the memory, and completes the steps in the above method embodiments in combination with its hardware.
  • FIG. 12 is a schematic block diagram of an electronic device 10 provided by an embodiment of the present application.
  • the electronic device 10 may be the video encoder or the video decoder described in this embodiment of the application, and the electronic device 10 may include:
  • the processor 12 can call and run the computer program 14 from the memory 11 to implement the methods in the embodiments of the present application.
  • the processor 12 may be configured to perform the steps of the method 200 described above according to instructions in the computer program 14 .
  • the processor 12 may include, but is not limited to:
  • DSP Digital Signal Processor
  • ASIC Application Specific Integrated Circuit
  • FPGA Field Programmable Gate Array
  • the memory 11 includes but is not limited to:
  • Non-volatile memory may be a read-only memory (Read-Only Memory, ROM), a programmable read-only memory (Programmable ROM, PROM), an erasable programmable read-only memory (Erasable PROM, EPROM), an electrically programmable read-only memory (Erasable PROM, EPROM). Erase programmable read-only memory (Electrically EPROM, EEPROM) or flash memory. Volatile memory may be Random Access Memory (RAM), which acts as an external cache.
  • RAM Random Access Memory
  • RAM Static RAM
  • DRAM Dynamic RAM
  • SDRAM Synchronous DRAM
  • SDRAM double data rate synchronous dynamic random access memory
  • Double Data Rate SDRAM DDR SDRAM
  • enhanced SDRAM ESDRAM
  • synchronous link dynamic random access memory SLDRAM
  • Direct Rambus RAM Direct Rambus RAM
  • the computer program 14 may be divided into one or more units, and the one or more units are stored in the memory 11 and executed by the processor 12 to complete the procedures provided by the present application.
  • the one or more units may be a series of computer program instruction segments capable of performing specific functions, and the instruction segments are used to describe the execution process of the computer program 14 in the electronic device 10 .
  • the electronic device 10 may further include:
  • a transceiver 13 which can be connected to the processor 12 or the memory 11 .
  • the processor 12 can control the transceiver 13 to communicate with other devices, and specifically, can send information or data to other devices, or receive information or data sent by other devices.
  • the transceiver 13 may include a transmitter and a receiver.
  • the transceiver 13 may further include antennas, and the number of the antennas may be one or more.
  • bus system includes a power bus, a control bus and a status signal bus in addition to a data bus.
  • FIG. 13 is a schematic block diagram of an image processing system provided by an embodiment of the present application.
  • the image processing system 20 may include: a video encoder 21 and a video decoder 22, where the video encoder 21 is used to execute the video encoding method involved in the embodiments of the present application, and the video decoder 22 is configured to execute the present invention.
  • the present application also provides a computer storage medium on which a computer program is stored, and when the computer program is executed by a computer, enables the computer to execute the methods of the above method embodiments.
  • the embodiments of the present application further provide a computer program product including instructions, when the instructions are executed by a computer, the instructions cause the computer to execute the methods of the above method embodiments.
  • the computer program product includes one or more computer instructions.
  • the computer may be a general purpose computer, a special purpose computer, a computer network, or other programmable device.
  • the computer instructions may be stored on or transmitted from one computer readable storage medium to another computer readable storage medium, for example, the computer instructions may be transmitted over a wire from a website site, computer, server or data center (eg coaxial cable, optical fiber, digital subscriber line (DSL)) or wireless (eg infrared, wireless, microwave, etc.) means to another website site, computer, server or data center.
  • the computer-readable storage medium can be any available medium that can be accessed by a computer or a data storage device such as a server, data center, etc. that includes one or more available media integrated.
  • the available media may be magnetic media (eg, floppy disk, hard disk, magnetic tape), optical media (eg, digital video disc (DVD)), or semiconductor media (eg, solid state disk (SSD)), and the like.
  • the disclosed system, apparatus and method may be implemented in other manners.
  • the apparatus embodiments described above are only illustrative.
  • the division of the unit is only a logical function division.
  • there may be other division methods for example, multiple units or components may be combined or Integration into another system, or some features can be ignored, or not implemented.
  • the shown or discussed mutual coupling or direct coupling or communication connection may be through some interfaces, indirect coupling or communication connection of devices or units, and may be in electrical, mechanical or other forms.
  • Units described as separate components may or may not be physically separated, and components shown as units may or may not be physical units, that is, may be located in one place, or may be distributed to multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution in this embodiment.
  • each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically alone, or two or more units may be integrated into one unit.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Image Processing (AREA)
  • Compression Or Coding Systems Of Tv Signals (AREA)

Abstract

一种图像处理方法、系统、视频编码器及视频解码器,基于待滤波边界两侧的像素点的像素值确定该待滤波边界的联合渐进特征,该联合渐进特征可以真实地反映出待滤波边界是不是真实边界,这样基于该联合渐进特征确定是否对该待滤波边界进行滤波,可以提高滤波判断的准确性,进而减少对真实边界进行过滤波。

Description

图像处理方法、系统、视频编码器及视频解码器 技术领域
本申请实施例涉及图像处理领域,更为具体地,涉及一种图像处理方法、系统、视频编码器及视频解码器。
背景技术
由于目前的编码技术都是基于块的编码,不同块的预测、变换、量化等过程相互独立,从而引入的量化误差大小及分布也相互独立,造成编码边界不连续而在视觉上产生方块效应。为了解决该技术问题,需要对块边界进行去方块滤波(Deblocking Filter,简称DBF),即对块边界进行平滑滤波以降低或去除方块效应。
为了防止对真实边界进行过滤波,在进行去方块滤波之前,需要判断是否对块边界进行滤波。
目前判断是否对块边界进行滤波的方法,会造成过滤波的问题。
发明内容
本申请实施例提供了一种图像处理方法、系统、视频编码器及视频解码器,用于实现准确判断是否对块边界进行滤波,以减少过滤波。
第一方面,提供了一种图像处理方法,应用于视频编码器,包括:
获取待编码图像块的部分或完整的重建图像,其中,部分或完整的重建图像包括一个或多个重建图像块;
确定重建图像块的待滤波边界;
根据待滤波边界两侧相邻的第一图像块和第二图像块的编码信息,确定待滤波边界的边界滤波强度;
在边界滤波强度大于第一预设值时,根据待滤波边界两侧的像素点的像素值,确定待滤波边界的联合渐进特征;
根据待滤波边界的联合渐进特征,确定是否对待滤波边界进行滤波。
第二方面,本申请实施例提供一种图像处理方法,应用于视频解码器,包括:
解码码流,得到部分或完整的重建图像,其中,部分或完整的重建图像包括一个或多个重建图像块;
确定重建图像块的待滤波边界;
根据待滤波边界两侧相邻的第一图像块和第二图像块,确定待滤波边界的边界滤波强度;
在边界滤波强度大于第一预设值时,根据待滤波边界两侧的像素点的像素值,确定待滤波边界的联合渐进特征;
根据待滤波边界的联合渐进特征,确定是否对待滤波边界进行滤波。
第三方面,提供了一种视频编码器,用于执行上述第一方面或其各实现方式中的方法。具体地,该编码器包括用于执行上述第一方面或其各实现方式中的方法的功能单元。
第四方面,提供了一种视频解码器,用于执行上述第二方面或其各实现方式中的方法。具体地,该解码器包括用于执行上述第二方面或其各实现方式中的方法的功能单元。
第五方面,提供了一种视频编码器,包括处理器和存储器。该存储器用于存储计算机程序,该处理器用于调用并运行该存储器中存储的计算机程序,以执行上述第一方面或其各实现方式中的方法。
第六方面,提供了一种视频解码器,包括处理器和存储器。该存储器用于存储计算机程序,该处理器用于调用并运行该存储器中存储的计算机程序,以执行上述第二方面或其各实现方式中的方法。
第七方面,提供了一种图像处理系统,包括视频编码器和视频解码器。视频编码器用于执行上述第一方面或其各实现方式中的方法,视频解码器用于执行上述第二方面或其各实现方式中的方法。
第八方面,提供了一种芯片,用于实现上述第一方面至第二方面中的任一方面或其各实现方式中的方法。具体地, 该芯片包括:处理器,用于从存储器中调用并运行计算机程序,使得安装有该芯片的设备执行如上述第一方面至第二方面中的任一方面或其各实现方式中的方法。
第九方面,提供了一种计算机可读存储介质,用于存储计算机程序,该计算机程序使得计算机执行上述第一方面至第二方面中的任一方面或其各实现方式中的方法。
第十方面,提供了一种计算机程序产品,包括计算机程序指令,该计算机程序指令使得计算机执行上述第一方面至第二方面中的任一方面或其各实现方式中的方法。
第十一方面,提供了一种计算机程序,当其在计算机上运行时,使得计算机执行上述第一方面至第二方面中的任一方面或其各实现方式中的方法。
基于以上技术方案,通过待滤波边界两侧的像素点的像素值来确定该待滤波边界的联合渐进特征,该联合渐进特征可以反映出待滤波边界处的像素点的像素值相比于待滤波边界两端的像素点的像素值的是内凹或外凸的变化趋势的,也就是说,该联合渐进特征可以真实地反映出待滤波边界是不是真实边界,这样基于该联合渐进特征确定是否对该待滤波边界进行滤波,可以提高滤波判断的准确性,进而防止对真实边界进行过滤波。
附图说明
图1为本申请实施例涉及的一种视频编解码系统100的示意性框图;
图2是本申请实施例提供的视频编码器200的示意性框图;
图3是本申请实施例提供的解码框架300的示意性框图;
图4为本申请实施例提供的图像处理方法400的一种流程示意图;
图5A为本申请实施例涉及的第一边界区域一种示意图;
图5B为本申请实施例涉及的第二边界区域一种示意图;
图5C为本申请实施例涉及待滤波边界两侧的像素点的像素值构成的曲线示意图;
图6为本申请实施例提供的图像处理方法500的一种流程示意图;
图7为本申请实施例提供的滤波方法的一种流程示意图;
图8为本申请实施例提供的图像处理方法600的一种流程示意图;
图9为本申请实施例提供的图传处理方法700的一种流程示意图;
图10是本申请实施例提供的视频编码器800的示意性框图;
图11是本申请实施例提供的视频解码器900的示意性框图;
图12是本申请实施例提供的电子设备10的示意性框图;
图13是本申请实施例提供的图像处理系统20的示意性框图。
具体实施方式
本申请可应用于图像编解码领域、视频编解码领域、硬件视频编解码领域、专用电路视频编解码领域、实时视频编解码领域等。例如,本申请的方案可结合至音视频编码标准(Audio Video coding Standard,AVS),例如,H.264/音视频编码(Audio Video coding,AVC)标准,H.265/高效视频编码(High Efficiency Video Coding,HEVC)标准以及H.266/多功能视频编码(Versatile Video Coding,VVC)标准。或者,本申请的方案可结合至其它专属或行业标准而操作,所述标准包含ITU-TH.261、ISO/IECMPEG-1Visual、ITU-TH.262或ISO/IECMPEG-2Visual、ITU-TH.263、ISO/IECMPEG-4Visual,ITU-TH.264(还称为ISO/IECMPEG-4AVC),包含可分级视频编解码(SVC)及多视图视频编解码(MVC)扩展。应理解,本申请的技术不限于任何特定编解码标准或技术。
为了便于理解,首先结合图1对本申请实施例涉及的视频编解码系统进行介绍。
图1为本申请实施例涉及的一种视频编解码系统100的示意性框图。如图1所示,该视频编解码系统100包含编码设备110和解码设备120。其中编码设备用于对视频数据进行编码(可以理解成压缩)产生码流,并将码流传输给解码设备。解码设备对编码设备编码产生的码流进行解码,得到视频数据。
编码设备和解码设备可以包含一或多个处理器以及一或多个存储器。所述存储器可包含但不限于RAM、ROM、EEPROM、快闪存储器或可用于以可由计算机存取的指令或数据结构的形式存储所要的程序代码的任何其它媒介。
本申请实施例的编码设备110可以理解为具有视频编码功能的设备,解码设备120可以理解为具有视频解码功能的设备,即本申请实施例对编码设备110和解码设备120包括更广泛的装置,例如包含智能手机、台式计算机、移动计算装置、笔记本(例如,膝上型)计算机、平板计算机、机顶盒、电视、相机、显示装置、数字媒体播放器、视频游戏控制台、车载计算机等。
在一些实施例中,编码设备110可以经由信道130将编码后的视频数据(如码流)传输给解码设备120。信道130可以包括能够将编码后的视频数据从编码设备110传输到解码设备120的一个或多个媒体和/或装置。
在一个实例中,信道130包括使编码设备110能够实时地将编码后的视频数据直接发射到解码设备120的一个或多个通信媒体。在此实例中,编码设备110可根据通信标准来调制编码后的视频数据,且将调制后的视频数据发射到解码设备120。其中通信媒体包含无线通信媒体,例如射频频谱,可选的,通信媒体还可以包含有线通信媒体,例如一根或多根物理传输线。
在另一实例中,信道130包括存储介质,该存储介质可以存储编码设备110编码后的视频数据。存储介质包含多种本地存取式数据存储介质,例如光盘、DVD、快闪存储器等。在该实例中,解码设备120可从该存储介质中获取编码后的视频数据。
在另一实例中,信道130可包含存储服务器,该存储服务器可以存储编码设备110编码后的视频数据。在此实例中,解码设备120可以从该存储服务器中下载存储的编码后的视频数据。可选的,该存储服务器可以存储编码后的视频数据且可以将该编码后的视频数据发射到解码设备120,例如web服务器(例如,用于网站)、文件传送协议(FTP)服务器等。
一些实施例中,编码设备110包含视频编码器112及输出接口113。其中,输出接口113可以包含调制器/解调器(调制解调器)和/或发射器。
在一些实施例中,编码设备110除了包括视频编码器112和输入接口113外,还可以包括视频源111。
视频源111可包含视频采集装置(例如,视频相机)、视频存档、视频输入接口、计算机图形系统中的至少一个,其中,视频输入接口用于从视频内容提供者处接收视频数据,计算机图形系统用于产生视频数据。
视频编码器112对来自视频源111的视频数据进行编码,产生码流。视频数据可包括一个或多个图像(picture)或图像序列(sequence of pictures)。码流以比特流的形式包含了图像或图像序列的编码信息。编码信息可以包含编码图像数据及相关联数据。相关联数据可包含序列参数集(Sequence Parameter Set,简称SPS)、图像参数集(Picture Parameter Set,简称PPS)及其它语法结构。SPS可含有应用于零个或多个序列的参数。PPS可含有应用于零个或多个图像的参数。语法结构是指码流中以指定次序排列的零个或多个语法元素的集合。
视频编码器112可将图像分割成编码树型块(Coding Tree Block,简称CTB)的栅格。在一些例子中,CTB可被称作“树型块”、“最大编码单元”(Largest Coding Block,简称LCU)或“编码树型单元”。一个CTB可包含一个或多个编码单元(Coding Unit,简称CU)。每一个CTB可以与图像内的具有相等大小的像素块相关联。每一像素可对应一个亮度(luminance或luma)采样及两个色度(chrominance或chroma)采样。因此,每一个CTB可与一个亮度采样块及两个色度采样块相关联。图像的CTB可分成一个或多个条带。在一些实例中,每一个条带包含整数个数的CTB。作为编码图像的一部分,视频编码器112可产生所述图像的每一条带的编码信息,即编码所述条带内的CTB。可选的,为了编码CTB,视频编码器112可对与CTB相关联的像素块执行四叉树分割,以将与CTB相关联的像素块像素块分割成较小 的像素块,较小的像素块可以和CU相关联。
视频编码器112经由输出接口113将编码后的视频数据直接传输到解码设备120。编码后的视频数据还可存储于存储介质或存储服务器上,以供解码设备120后续读取。
在一些实施例中,解码设备120包含输入接口121和视频解码器122。
在一些实施例中,解码设备120除包括输入接口121和视频解码器122外,还可以包括显示装置123。
其中,输入接口121包含接收器及/或调制解调器。输入接口121可通过信道130接收编码后的视频数据。
视频解码器122用于对编码后的视频数据进行解码,得到解码后的视频数据,并将解码后的视频数据传输至显示装置123。
显示装置123显示解码后的视频数据。显示装置123可与解码设备120整合或在解码设备120外部。显示装置123可包括多种显示装置,例如液晶显示器(LCD)、等离子体显示器、有机发光二极管(OLED)显示器或其它类型的显示装置。
此外,图1仅为实例,本申请实施例的技术方案不限于图1,例如本申请的技术还可以应用于单侧的视频编码或单侧的视频解码。
视频编码器112及视频解码器122包括一个或多个处理器,例如包括一个或多个微处理器、数字信号处理器(DSP)、专用集成电路(ASIC)、现场可编程门阵列(FPGA)或其任何组合。若本申请技术部分或者全部以软件实施,则视频编码器112及视频解码器122还包括一个或多个存储器,该存储器用于存储计算机指令,一个或多个处理器执行这些技术指令以实现本申请的技术。
下面对本申请实施例涉及的视频编码框架进行介绍。
图2是本申请实施例提供的视频编码器200的示意性框图。应理解,该视频编码器200可用于对图像进行有损压缩(lossy compression),也可用于对图像进行无损压缩(lossless compression)。该无损压缩可以是视觉无损压缩(visually lossless compression),也可以是数学无损压缩(mathematically lossless compression)。
该视频编码器200可应用于亮度色度(YcbCr,YUV)格式的图像数据上。例如,YUV比例可以为4:2:0、4:2:2或者4:4:4,Y表示明亮度(Luma),Cb(U)表示蓝色色度,Cr(V)表示红色色度,U和V表示为色度(Chroma)用于描述色彩及饱和度。例如,在颜色格式上,4:2:0表示每4个像素有4个亮度分量,2个色度分量(YYYYCbCr),4:2:2表示每4个像素有4个亮度分量,4个色度分量(YYYYCbCrCbCr),4:4:4表示全像素显示(YYYYCbCrCbCrCbCrCbCr)。
例如,视频编码器200可对不同颜色格式的数字视频读取不相等的像素,包含亮度分量和色度分量。换言之,视频编码器200可读取一副黑白或者彩色图像,即待编码图像。该视频编码器200读取到待编码图像后,将该待编码图像划分成为块数据,并基于块数据进行编码。例如,该视频编码器200读取视频数据,针对视频数据中的每帧图像,将一帧图像划分成若干个编码树单元(Coding Tree Unit,CTU),一个CTU分为一个亮度CTB和两个色度CTB,CTB大小例如有16、32、64。一个CTU又可以继续被划分成若干个编码单元(Coding Unit,CU)进行编码,CU可以为矩形块也可以为方形块。CU进一步划分为预测单元(prediction Unit,简称PU)和变换单元(Transform Unit,简称TU),进而使得编码、预测、变换分离,处理的时候更灵活。在一种示例中,CTU以四叉树方式划分为CU,CU例如最大为64x64,最小为8x8,CU以四叉树方式划分为TU、PU,TU例如最大为32x32,最小为8x8,其中PU与TU无确定关系,允许TU跨越多个PU,但在帧内预测中一个PU可对应多个TU,一个TU至多对应一个PU。
在一种实例中,视频编码器可根据Z形扫描次序来编码CU。换句话说,视频编码器可按左上CU、右上CU、左下CU及接着右下CU来编码该CU。当视频编码器编码分割后的CU时,视频编码器可根据折形扫描次序来编码与分割后的CU的像素块的子块相关联的CU。
在另一种实例中,视频编码器可根据光栅扫描次序来编码CU。
视频编码器及视频解码器可支持各种PU大小。假定特定CU的大小为2N×2N,视频编码器及视频解码器可支持2N×2N或N×N的PU大小以用于帧内预测,且支持2N×2N、2N×N、N×2N、N×N或类似大小的对称PU以用于帧间预测。视频编码器及视频解码器还可支持2N×nU、2N×nD、nL×2N及nR×2N的不对称PU以用于帧间预测。
在一些实施例中,如图2所示,该视频编码器200可包括:预测单元210、残差单元220、变换量化单元230、反变换量化单元240、重建单元250、滤波单元260、解码图像缓存270和头信息解码单元或熵解码单元280。需要说明的是,视频编码器200可包含更多、更少或不同的功能组件。
预测单元210可参考待编码图像帧的相邻图像块对待编码的图像块进行预测,以输出预测块。残差单元220可基于预测块与待编码的图像块计算残差块,即预测块和待编码的图像块的差值,该残差块也可称为残差信息。该残差块经由变换量化单元230变换与量化等过程,可以去除人眼不敏感的信息,以消除视觉冗余。可选的,经过变换量化单元230变换与量化之前的残差块可称为时域残差块,经过变换量化单元230变换与量化之后的时域残差块可称为频率残差块或频域残差块。头信息解码单元或熵解码单元280接收到变化量化单元230输出的量化后的变化系数,可对该量化后的变化系数进行熵编码,输出码流。例如,头信息解码单元或熵解码单元280可根据目标上下文模型以及二进制码流的概率信息消除字符冗余。
可选的,在本申请中,该待编码的图像块也可称为原始图像块,预测块也可称为预测图像块或图像预测块,重建图像块也可称为重建块或图像重建图像块。
在一些实施例中,预测单元210包括帧间预测单元211和帧内估计单元212。
其中,帧内估计单元212只参考同一帧图像的信息,预测待编码图像块内的像素信息,用于消除空间冗余。帧内预测所使用的帧可以为I帧。
帧间预测单元211可用于帧间预测,帧间预测可以参考不同帧的图像信息,利用运动估计搜索最匹配待编码图像块的运动矢量信息,用于消除时间冗余;帧间预测所使用的帧可以为P帧和/或B帧,P帧指的是向前预测帧,B帧指的是双向预测帧。
帧内预测可借助角度预测模式与非角度预测模式对待编码图像块进行预测。
以国际数字视频编码标准H系列为例,H.264/AVC标准涉及有8种角度预测模式和1种非角度预测模式;H.265/HEVC标准涉及有33种角度预测模式和2种非角度预测模式;H.266/VVC标准涉及有67种预测模式,其中包括2种非角度预测模式,将角度模式从H.265的33种扩展到了65种。毋庸置疑,随着角度模式的增加,帧内预测将会更加精确,也更加符合对高清以及超高清数字视频发展的需求。
残差单元220可基于CU的像素块及CU的PU的预测块来产生CU的残差块。举例来说,残差单元220可产生CU的残差块,使得残差块中的每一采样具有等于以下两者之间的差的值:CU的像素块中的采样,及CU的PU的预测块中的对应采样。
因为TU的残差块的像素可对应一个亮度采样及两个色度采样,所以每一个TU可与一个亮度采样块及两个色度采样块相关联。变换量化单元230可通过将一个或多个变换应用于与TU相关联的残差采样块而产生CU的每一个TU的变换系数。举例来说,变换量化单元230可将离散余弦变换(DCT)、方向性变换或概念上类似的变换应用于残差块。
变换量化单元230可量化变换系数。变换量化单元230可基于与CU相关联的量化参数(QP)值来量化与CU的TU相关联的变换系数。视频编码器200可通过调整与CU相关联的QP值来调整应用于与CU相关联的变换系数的量化程度。
反变换量化单元240可分别将逆量化及逆变换应用于量化后的变换系数,以从量化后的变换系数重建残差块。
重建单元250可将重建后的残差块的采样加到预测单元210产生的一个或多个预测块的对应采样,以产生与TU相关联的重建图像块。通过此方式重建CU的每一个TU的采样块,视频编码器200可重建CU的像素块。
滤波单元260可执行消块滤波操作以减少与CU相关联的像素块的块效应。
在一些实施例中,滤波单元260包括去块滤波单元261和样点自适应补偿/自适应环路滤波(SAO/ALF)单元262,其中去块滤波单元261用于去方块效应,SAO/ALF单元262用于去除振铃效应。
本申请实施例中的去块滤波单元261还可以用于确定重建图像块的待滤波边界,根据待滤波边界两侧相邻的第一图像块和第二图像块的编码信息,确定待滤波边界的边界滤波强度;在边界滤波强度大于第一预设值时,根据待滤波边界两侧的像素点的像素值,确定待滤波边界的联合渐进特征,该待滤波边界的联合渐进特征用于指示待滤波边界是否为真实边界;根据待滤波边界的联合渐进特征,确定是否对待滤波边界进行滤波。
例如,若待滤波边界为垂直边界,则第一图像块和第二图像块构成的第一边界区域包括N行像素点,此时去块滤波单元261根据第一边界区域的第i行像素点的两端像素点的像素值与中间像素点的像素值的差值,确定第i行参数,其中i为大于或等于1且小于或等于N的正整数;将第一行参数至第N行参数中的至少一个行参数,确定为该待滤波边界的联合渐进特征,根据该待滤波边界的联合渐进特征确定是否对待滤波边界进行滤波,例如,当第一行参数至第N行参数中的至少两个参数大于或等于第二预设值时,确定对该待滤波边界不进行滤波。
由于联合渐进特征可以真实地反映出待滤波边界是不是真实边界,这样基于该联合渐进特征确定是否对该待滤波边界进行滤波,可以提高是否滤波判断的准确性,进而防止视频编码器200对真实边界进行滤波。
解码图像缓存270可存储重建后的像素块。帧间预测单元211可使用含有重建后的像素块的参考图像来对其它图像的PU执行帧间预测。另外,帧内预测单元212可使用解码图像缓存270中的重建后的像素块来对在与CU相同的图像中的其它PU执行帧内预测。
头信息解码单元或熵解码单元280可接收来自变换量化单元230的量化后的变换系数。头信息解码单元或熵解码单元280可对量化后的变换系数执行一个或多个熵编码操作以产生熵编码后的数据。举例来说,头信息解码单元或熵解码单元280可对数据执行上下文自适应可变长度编解码(CAVLC)操作、基于上下文的自适应二进制算术编码(CABAC)操作、可变到可变(V2V)长度编解码操作、基于语法的上下文自适应二进制算术编解码(SBAC)操作、机率区间分割熵(PIPE)编解码操作,或其它类型的熵编码操作。
图3是本申请实施例提供的解码框架300的示意性框图。
如图3所示,视频解码器300包含:头信息解码单元或熵解码单元310、预测单元320、逆量化变换单元330、重建单元340、滤波单元350及解码图像缓存360。需要说明的是,视频解码器300可包含更多、更少或不同的功能组件。
头信息解码单元或熵解码单元310接收并解析码流后,以获取预测块和频域残差块,针对频域残差块,通过逆量化变换单元330进行反变换与反量化等步骤,可获取时域残差块。重建单元340将预测单元320预测得到的预测块叠加经过通过逆量化变换单元330的时域残差块,可得到重建图像块。
视频解码器300可接收码流。头信息解码单元或熵解码单元310可解析码流以从码流提取语法元素。作为解析码流的一部分,头信息解码单元或熵解码单元310可解析码流中的经熵编码后的语法元素。预测单元320、逆量化变换单元330、重建单元340及滤波单元350可根据从码流中提取的语法元素来解码视频数据,即产生解码后的视频数据。
在一些实施例中,预测单元320包括帧内预测单元321和帧间估计单元322。
帧内预测单元321可执行帧内预测以产生PU的预测块。帧内预测单元321可使用帧内预测模式以基于空间相邻PU的像素块来产生PU的预测块。帧内预测单元321还可根据从码流解析的一个或多个语法元素来确定PU的帧内预测模式。
帧间估计单元322可根据从码流解析的语法元素来构造第一参考图像列表(列表0)及第二参考图像列表(列表1)。此外,如果PU使用帧间预测编码,则头信息解码单元或熵解码单元310可解析PU的运动信息。帧间估计单元322可根据PU的运动信息来确定PU的一个或多个参考块。帧间估计单元322可根据PU的一个或多个参考块来产生PU的预测块。
逆量化变换单元330可逆量化(即,解量化)与TU相关联的变换系数。逆量化变换单元330可使用与TU的CU相 关联的QP值来确定量化程度。
在逆量化变换系数之后,逆量化变换单元330可将一个或多个逆变换应用于逆量化变换系数,以便产生与TU相关联的残差块。举例来说,逆量化变换系数可将逆DCT、逆整数变换、逆卡忽南-拉维(Karhunen-Loeve)变换(KLT)、逆旋转变换、逆方向性变换或其它与编码端的变换对应的逆变换应用于逆量化变换系数,得到残差块。
重建单元340使用与CU的TU相关联的残差块及CU的PU的预测块以重建CU的像素块。例如,重建单元340可将残差块的采样加到预测块的对应采样以重建CU的像素块,得到重建图像块。
滤波单元350可执行消块滤波操作以减少与CU相关联的像素块的块效应。
在一些实施例中,滤波单元350包括:去块滤波单元351和样点自适应补偿/自适应环路滤波(SAO/ALF)单元352,其中去块滤波单元351用于去方块效应,SAO/ALF单元352用于去除振铃效应。
申请实施例中的去块滤波单元351还可以用于确定重建图像块的待滤波边界,根据待滤波边界两侧相邻的第一图像块和第二图像块的编码信息,确定待滤波边界的边界滤波强度;在边界滤波强度大于第一预设值时,根据待滤波边界两侧的像素点的像素值,确定待滤波边界的联合渐进特征,该待滤波边界的联合渐进特征用于指示待滤波边界是否为真实边界;并根据待滤波边界的联合渐进特征,确定是否对待滤波边界进行滤波。
例如,若待滤波边界为垂直边界,则第一图像块和第二图像块构成的第一边界区域包括N行像素点,去块滤波单元351根据第一边界区域的第i行像素点的两端像素点的像素值与中间像素点的像素值的差值,确定第i行参数,其中i为大于或等于1且小于或等于N的正整数;将第一行参数至第N行参数中的至少一个行参数,确定为该待滤波边界的联合渐进特征,根据该待滤波边界的联合渐进特征确定是否对待滤波边界进行滤波,例如,当第一行参数至第N行参数中的至少两个参数大于或等于第二预设值时,确定对该待滤波边界不进行滤波。
由于联合渐进特征可以真实地反映出待滤波边界是不是真实边界,这样基于该联合渐进特征确定是否对该待滤波边界进行滤波,可以提高是否进行滤波判断的准确性,进而减少视频解码器300对真实边界进行过滤波。
视频解码器300可将CU的重建图像存储于解码图像缓存360中。视频解码器300可将解码图像缓存360中的重建图像作为参考图像用于后续预测,或者,将重建图像传输给显示装置呈现。
下面对滤波过程进行详细介绍。
去块滤波包括如下几个步骤:
1、确定滤波边界,例如按照预先设定的规则从重建图像块中确定滤波边界,不同的视频编码器或视频解码器选择滤波边界的方法可能不同。示例性的,对于图像上的4像素长度边界,根据标志位和边界所处的网格线位置决定是否处理。
2、计算滤波边界的边界滤波强度,例如根据边界两端的编码块的编码信息确定当前边界的边界滤波强度(boundary filtering strength,简称BS),若BS非0,则执行步骤3。
3、进行滤波决策,以决策是否对滤波边界进行去块滤波,若滤波,是进行强滤波还是弱滤波等。滤波边界处有可能存在真正的边界,即一开始拍摄到的原始图像中该滤波边界两侧的像素值的差异本来就非常大。为了减少对真实的边界进行过滤波,需要对边界两边的像素点的像素值进行分析,并依据分析的结果判断是否进行滤波以及采用何种强度的滤波,分析的过程需要用到边界滤波强度BS。
以图5A为例,假设滤波边界两侧为第一图像块(也可以称为P块)和第二图像块(也可以称为Q块),第一图像块第1行像素点靠近该待滤波边界的4像素点依次为p 0,0、p 1,0、p 2,0和p 3,0;第一图像块第2行靠近该滤波边界的4像素点依次为p 0,1、p 1,1、p 2,1和p 3,1;第一图像块第3行靠近该滤波边界的4像素点依次为p 0,2、p 1,2、p 2,2和p 3,2;第一图像块第4行靠近该滤波边界的4像素点依次为p 0,3、p 1,3、p 2,3和p 3,3。第二图像块第1行靠近该滤波边界的4像素点依次为q 0,0、q 1,0、q 2,0和q 3,0;第二图像块第2行靠近该滤波边界的4像素点依次为q 0,1、q 1,1、q 2,1和q 3,1;第二图像块第3行靠近该滤波边界的4像素点依次为q 0,2、q 1,2、q 2,2和q 3,2;第二图像块第4行靠近该滤波边界的4像素点依次为 q 0,3、q 1,3、q 2,3和q 3,3
基于如下公式(1)确定边界两侧的像素点的像素值的变换率dpqL:
dpqL=dp 0+dp 3+dq 0+dq 3           (1)
其中,
dp 0=|p 2,0-2p 1,0+p 0,0|         (2)
dp 3=|p 2,3-2p 1,3+p 0,3|         (3)
dq 0=|q 2,0-2q 1,0+q 0,0|           (4)
dq 3=|q 2,3-2q 1,3+q 0,3|            (5)
若上述变换率dpqL<β,则确定对该边界进行滤波。
可选的,该β可以查表获得。
可选的,该β可以为预设的固定值。
在确定对该边界进行滤波时,根据该边界两侧像素点的像素值,确定对该边界采用强滤波、还是弱滤波。
例如,公式(6)、(7)和(8)同时成立则采取强滤波,否则采取弱滤波。如图5A所示,如图i=0,1,2,3。
|p 2,i-2p 1,i+p 0,i|+|q 2,i-2q 1,i+q 0,i|<β/8            (6)
|p 3,i-p 0,i|+|q 0,i-q 3,i|<β/8             (7)
|p 0,i-q 0,i|<2.5tc                   (8)
可选的,上述参数tc可以查表获得。
可选的,上述参数tc可以为预设的固定值。
4、根据滤波决策确定滤波边界不需要滤波时则不对该滤波边界滤波,当确定需要进行强滤波时则进行强滤波,当确定需要进行弱滤波时则进行弱滤波。
由上述可知,步骤3中判断边界是否滤波时,通过判断边界两端的像素各自是否符合线性变化,如果两边的像素均是线性变化的,例如dpqL<β,则进行滤波。
但是基于公式(1)仅凭边界两端的像素各自是否符合线性变化来判定是否对该边界进行滤波时,存在过滤波的问题。例如,真实边界本身是由渐进变化的像素构成,基于已有VVC中的滤波判定方法,则会将真实边界判断为可以滤波的边界,进而导致对真实边界进行过滤波而模糊,从而降低重建图像的质量。
由于真实边界处的像素点的像素值相对于边界两端的像素点的像素值是呈现明显的内凹或外凸的变化趋势的,基于此,本申请根据待滤波边界两侧的像素点的像素值来确定待滤波边界的联合渐进特征,该联合渐进特征可以反映出待滤波边界处的像素点的像素值相比于待滤波边界两端的像素点的像素值的变化趋势,也就是说该联合渐进特征可以真实地反映出待滤波边界是不是真实边界,这样基于该联合渐进特征确定是否对该待滤波边界进行滤波,可以提高滤波判断的准确性,进而减少对真实边界进行过滤波。
下面结合具体的实施例对本申请实施例提供的技术方案进行详细描述。
首先结合图4对编码端进行介绍。
图4为本申请实施例提供的图像处理方法的一种流程示意图,本申请实施例应用于图1和图2所示视频编码器。如图4所示,本申请实施例的方法包括:
S401、获取待编码图像块的部分或完整的重建图像,其中,部分或完整的重建图像包括一个或多个重建图像块。
具体的,参照图2所示,视频编码器将视频数据中的每一帧图像划分成一个或多个待编码图像块,针对每个待编码图像块,视频编码器中的预测单元210经由帧间预测、帧内预测产生待编码图像块的预测块之后,将预测块发送给残差单元220,该残差单元220可以理解为求和器,包括执行减法运算的一个或多个组建。残差单元220从待编码图 像块中减去预测块形成残差块,并将残差块发送给变换量化单元230。变换量化单元230使用例如离散余弦变换(DCT)或者类似的变换将残差块进行变换处理,得到变换系数。变换量化单元230进一步对变换系数进行量化,得到量化后的变换系数。
由图2可知,一方面,变换量化单元230将量化后的变换系数转发给头信息解码单元或熵解码单元280。头信息解码单元或熵解码单元280对量化后的变换系数进行熵编码。举例来说,头信息解码单元或熵解码单元280可执行上下文自适应可变长度编码(CAVLC)、上下文自适应二进制算术编码(CABAC)、基于语法的上下文自适应二进制算术编码(SBAC)、概率区间分割熵(PIPE)编码等编码方法,对量化后的变换系数进行熵编码,得到码流。
另一方面,变换量化单元230将量化后的变换系数转发给反变换量化单元240。反变换量化单元240对量化后的变换系数进行逆量化和逆变换以在像素域中重构残差块。重建单元250理解为求和器,包括执行减法运算的一个或多个组件。重建单元250将重构后的残差块添加到预测单元210产生的预测块中,以产生待编码图像块的部分或完整的重建图像,该部分或完整的重建图像包括一个或多个重建图像块。
S402、确定重建图像块的待滤波边界。
不同的视频编码器选择待滤波边界的方法可能不同,例如,H.264中,以4x4块的边界为待滤波边界。例如,H.265中,针对编码单元(CU)中每一个8x8子块的边界,若该边界为该编码单元的变换单元的划分边界,则将该边界确定为待滤波边界;若该边界为编码单元的预测单元的划分边界,则将该边界设置为待滤波边界。
如图5A和和图5B所示,待滤波边界可以为垂直边界也可以为水平边界。
本申请实施例中提到的“边界”也可以称作边缘。
S403、根据待滤波边界两侧相邻的第一图像块和第二图像块的编码信息,确定待滤波边界的边界滤波强度。
例如图5A所示,当待滤波边界为垂直边界时,第一图像块为待滤波边界左侧与待滤波边界相邻的图像块,第二图像块为待滤波边界右侧与待滤波边界相邻的图像块。
例如图5B所示,当待滤波边界为水平边界时,第一图像块为待滤波边界上方与待滤波边界相邻的图像块,第二图像块为待滤波边界下方与待滤波边界相邻的图像块。
图5A和图5B示例性地示出了第一图像块和第二图像块的大小均为4×4的块,需要说明的是,本申请实施例中第一图像块和第二图像块的大小还可以是2×2、6×6、8×8、16×16、32×32等,本申请实施例对第一图像块和第二图像块的具体大小不作限制,具体根据重建图像块的大小和实际需要确定。
第一图像块和第二图像块的编码信息包括但不限于:编码方式、量化参数、运动矢量、量化残差系数和标志位等。
由于对不同边界滤波强度的待滤波边界进行滤波,所选用的滤波方式不同,因此,在对待滤波边界进行滤波时,首先需要确定待滤波边界的边界滤波强度(BS)。
例如,根据第一图像块的编码信息和第二图像块的编码信息确定该待滤波边界的BS,具体如下:
1、若第一图像块或者第二图像块的预测模式是帧内预测模式,则赋值BS=2;
2、若不满足上述步骤1,则若第一图像块或者第二图像块有非零量化系数(non-0coeffs),则赋值BS=1;
3、若不满足上述步骤1和步骤2,则若第一图像块和第二图像块的参考帧不同,则赋值BS=1;
4、若不满足上述步骤1、步骤2和步骤3,则若第一图像块和第二图像块的运动向量的水平分量的差值绝对值大于等于4或者垂直分量的差值绝对值大于等于4,则赋值BS=1。
需要说明的是,本步骤还可以采用目前各标准记载的确定BS的方法,来确定该待滤波边界的BS。
S404、在边界滤波强度大于第一预设值时,根据待滤波边界两侧的像素点的像素值,确定待滤波边界的联合渐进特征。
本申请实施例对第一预设值的具体取值不做限制,例如,由上述S403可知,待滤波边界的BS可能取值为1或2,因此,第一预设值也可以为0或1。
在一种示例中,若第一预设值为1,则上述S404可以理解为当待滤波边界的BS为2时,根据待滤波边界两侧的像素点的像素值,确定待滤波边界的联合渐进特征。
在另一种示例中,若第一预设值为0,则上述S404可以理解为当待滤波边界的BS为1或2时,根据待滤波边界两侧的像素点的像素值,确定待滤波边界的联合渐进特征。
上述像素点的像素值可以理解为像素点的重建值,即重建图像时所重建的像素值。
本申请实施例的待滤波边界的联合渐进特征用于指示待滤波边界处像素点的像素值相比于待滤波边界两端的像素点的像素值是呈现内凹还是外凸的变化趋势,也就是说,该联合渐进特征可以用于指示该待滤波边界是否为真实边界。例如图5C所示,右侧为待滤波边界的原始边界图,待滤波边界左侧的像素点为p0、p1、p2和p3,待滤波边界右侧的像素点为q0、q1、q2和q3,其中p0、p1、p2和p3属于第一图像块,q0、q1、q2和q3属于第二图像块。从左向右依次对像素点p3、p2、p1、p0、q0、q1、q2和q3的像素值进行连接,构成的曲线L,如图5C所示,曲线L在待滤波边界处呈明显的下凹状,也就是说该待滤波边界处的像素点的像素值相比于待滤波边界两端的像素点的像素值是呈现明显内凹的变化趋势。
在一些实施例中,上述S404中根据待滤波边界两侧的像素点的像素值,确定待滤波边界的联合渐进特征可以包括如下S404-A1:
S404-A1、根据待滤波边界两侧的像素点中的中间像素点的像素值与两端像素点的像素值的差值,确定该待滤波边界的联合渐进特征,其中,中间像素点为与待滤波边界两侧的像素点中与待滤波边界相邻的像素点,两端像素点为待滤波边界两侧的像素点中与中间像素点相邻的像素点。在该示例中,可以将与待滤波边界相邻的中间像素点理解为待滤波边界处的像素点,这样通过计算待滤波边界两侧的像素点中的中间像素点的像素值与两端像素点的像素值的差值,来确定该待滤波边界的联合渐进特征,例如当上述差值大于某预设值b1,说明待滤波边界处的像素点的像素值相比于待滤波边界两端的像素点的像素值呈现明显的上凸的变化趋势,可以确定该待滤波边界为真实边界。例如当上述差值小于某预设值b2,说明待滤波边界处的像素点的像素值相比于待滤波边界两端的像素点的像素值呈现明显的下凹的变化趋势,可以确定该待滤波边界为真实边界。例如当上述差值大于预设值b2且小于预设值b1时,说明待滤波边界处的像素点的像素值相比于待滤波边界两端的像素点的像素值变化趋势不明显,可以确定该待滤波边界不是真实边界。
上述待滤波边界两侧的像素点可以是同一行中的像素点,也可以是不用行中的像素点,本申请实施例对此不作限制。
由上述图5A和图5B可知,本申请实施例的待滤波边界可以是垂直边界也可以是水平边界,当待滤波边界不同时,上述S404-A1中根据待滤波边界两侧的像素点中的中间像素点的像素值与两端像素点的像素值的差值,确定该待滤波边界的联合渐进特征的过程不相同,下面对两种情况分别进行介绍。
情况1,当待滤波边界为垂直边界时,第一图像块和第二图像块构成的第一边界区域包括N行像素点,其中N是正整数,例如为2、3、4、6、7、8等。其中,第一行参数可以理解为第一行像素点对应的行参数,用于指示第一行像素点中与待滤波边界相邻的中间像素点的像素值相比于两端的像素点的像素值是呈现内凹还是外凸的变化趋势;第二行参数可以理解为第二行像素点对应的行参数,用于指示第二行像素点中与待滤波边界相邻的中间像素点的像素值相比于两端的像素点的像素值是呈现内凹还是外凸的变化趋势;以此类推,第N行参数可以理解为第N行像素点对应的行参数,用于指示第N行像素点中与待滤波边界相邻的中间像素点的像素值相比于两端的像素点的像素值是呈现内凹还是外凸的变化趋势。
在情况1中,上述S404-A1可以包括如下S404-A11和S404-A12:
S404-A11,根据第一边界区域的第i行像素点的两端像素点的像素值与中间像素点的像素值的差值,确定第i行参数,其中i为大于或等于1且小于或等于N的正整数;
S404-A12,将第一行参数至第N行参数中的至少一个行参数,确定为该待滤波边界的联合渐进特征。
本步骤A11中,第i行像素点的两端像素点可以是第i行像素点最左端的一个或多个像素点,以及第i行像素点最右端的一个或多个像素点,例如图5A中的p 3,0和q 3,0。或者,第i行像素点的两端像素点可以是第i行像素点靠近左端但不是最左端的像素点,以及第i行像素点靠近右端但不是最右端的像素点,例如图5A中的p 2,0和q 2,0。第i行像素点的中间像素点可以是第i行像素点中靠近待滤波边界的一个或多个像素点,例如为第i行像素点中,位于待滤波边界左侧与待滤波边界相邻的像素点,以及位于待滤波边界右侧与待滤波边界相邻的像素点,例如图5A中p 0,0和q 0,0
在一示例中,第i行像素点的中间像素点包括:第i行像素点中,待滤波边界左侧与待滤波边界相邻的第一个左侧像素点(例如p 0,i)和与第一个左侧像素点相邻的第二个左侧像素点(例如p 1,i),以及待滤波边界右侧与待滤波边界相邻的第一个右侧像素点(例如q 0,i)和与第一个右侧像素点相邻的第二个右侧像素点(例如q 1,i)。第i行像素点的两端像素点包括:第i行像素点中与第二个左侧像素点相邻的第三个左侧像素点(例如p 2,i)和与第二个右侧像素点相邻的第三个右侧像素点(例如q 2,i)。
在该示例中,上述S404-A11可以包括如下S404-A111:
S404-A111,根据第i行像素点中第三个左侧像素点的像素值分别与第一个左侧像素点的像素值和第二个左侧像素点的像素值的差值,以及第三个右侧像素点的像素值分别与第一个右侧像素点的像素值和第二个右侧像素点的像素值的差值,确定第i行参数。
由于距离待滤波边界较近的像素点可以更加准确性体现出该待滤波边界是否为真实边界,因此,本示例中舍弃距离待滤波边界较远的像素点,使用待滤波边界的左右两侧距离该待滤波边界较近的像素点来确定第i行参数,可以准确确定出第i行参数外,还可以降低计算量,提高判断滤波边界的速度,提高编码或解码效率。
在一种可能的实现方式中,可以通过如下公式(9)确定第i行参数:
dpq i=|2p 2,i-p 1,i-p 0,i+2q 2,i-q 1,i-q 0,i|            (9)
其中,dpq i为第i行参数,p 0,i为第i行像素点中的第一个左侧像素点,p 1,i为第i行像素点中的第二个左侧像素点,p 2,i为第i行像素点中的第三个左侧像素点,q 0,i为第i行像素点中的第一个右侧像素点,q 1,i为第i行像素点中的第二个右侧像素点,q 2,i为第i行像素点中的第三个右侧像素点。
根据上述方式可以确定出第一行参数至第N行参数中的任意一个行参数,执行S404-A12,将第一行参数至第N行参数中的任意一个行参数确定为待滤波边界的联合渐进特征。例如,如图5A所示,第一图像块和第二图像块构成的第一边界区域的大小为4X8,即包括4行像素点和8列像素点,可以根据上述方法,确定出任意一行参数,将该确定出的行参数确定为待滤波边界的联合渐进特征,例如将第一行参数确定为待滤波边界的联合渐进特征。可选的,还可以确定出第一行参数、第二行参数、第三行参数和第四行参数中的任意两个行参数,将这两个行参数确定为待滤波边界的联合渐进特征,例如将第一行参数和第四行参数确定为待滤波边界的联合渐进特征。
情况2,当待滤波边界为水平边界时,第一图像块和第二图像块构成的第二边界区域包括M列像素点,其中M是正整数,例如为2、3、4、6、7、8等。其中,第一列参数可以理解为第一列像素点对应的列参数,用于指示第一列像素点中与待滤波边界相邻的中间像素点的像素值相比于两端的像素点的像素值是呈现内凹还是外凸的变化趋势;第二列参数可以理解为第二列像素点对应的列参数,用于指示第二列像素点中与待滤波边界相邻的中间像素点的像素值相比于两端的像素点的像素值是呈现内凹还是外凸的变化趋势;以此类推,第M列参数可以理解为第M列像素点对应的列参数,用于指示第M列像素点中与待滤波边界相邻的中间像素点的像素值相比于两端的像素点的像素值是呈现内凹还是外凸的变化趋势。
在情况2中,上述S404-A1可以包括如下S404-A14和S404-A15:
S404-A14,根据第二边界区域的第j列像素点的两端像素点的像素值与中间像素点的像素值的差值,确定第j列参数,其中j为大于或等于1且小于或等于M的正整数;
S404-A15,将第一列参数至第M列参数中的至少一个列参数,确定为该待滤波边界的联合渐进特征。
本步骤A14中,第j列像素点的两端像素点可以是第j列像素点最上方的一个或多个像素点,以及第j列像素点最下方的一个或多个像素点,例如图5B中p 3,0和q 3,0。或者,第j列像素点的两端像素点可以是第j列像素点靠近上方但不是最上方的像素点,以及第j列像素点靠近下方但不是最下方的像素点,例如图5B中p 2,0和q 2,0。第j列像素点的中间像素点可以是第j列像素点中靠近待滤波边界的一个或多个像素点,例如为第j列像素点中,位于待滤波边界上方与待滤波边界相邻的像素点,以及位于待滤波边界下方与待滤波边界相邻的像素点,例如图5B中p 0,0和q 0,0
第一种示例中,第j列像素点的中间像素点包括:第j列像素点中,待滤波边界上方与待滤波边界相邻的第一个上方像素点(例如p 0,j)和与第一个上方像素点相邻的第二个上方像素点(例如p 1,j),以及待滤波边界下方与待滤波边界相邻的第一个下方像素点(例如q 0,j)和与第一个下方像素点相邻的第二个下方像素点(例如q 1,j)。第j列像素点的两端像素点包括:第j列像素点中与第二个上方像素点相邻的第三个上方像素点(例如p 2,j)和与第二个下方像素点相邻的第三个下方像素点(例如q 2,j)。
在该示例中,上述S404-A14可以包括如下S404-A141:
S404-A141,根据第j列像素点中第三个上方像素点的像素值分别与第一个上方像素点的像素值和第二个上方像素点的像素值的差值,以及第三个下方像素点的像素值分别与第一个下方像素点的像素值和第二个下方像素点的像素值的差值,确定第j列参数。
在一种可能的实现方式中,可以通过如下公式(10)确定第j列参数:
dpq j=|2p 2,j-p 1,j-p 0,j-2q 2,j-q 1,j-q 0,j|                (10)
其中,dpq j为第j列参数,p 0,j为第j列像素点中的第一个上方像素点,p 1,j为第j列像素点中的第二个上方像素点,p 2,j为第j列像素点中的第三个上方像素点,q 0,j为第j列像素点中的第一个下方像素点,q 1,j为第j列像素点中的第二个下方像素点,q 2,j为第j列像素点中的第三个下方像素点。
根据上述方式可以确定出第一列参数至第M列参数中的任意一个列参数,执行S404-A15,将第一列参数至第M列参数中的任意一个列参数确定为待滤波边界的联合渐进特征。例如,如图5B所示,第一图像块和第二图像块构成的第二边界区域的大小为8X4,即包括4列像素点和8行像素点,可以根据上述方法,确定出任意一列参数,将该确定出的列参数确定为待滤波边界的联合渐进特征,例如将第一列参数确定为待滤波边界的联合渐进特征。可选的,还可以确定出第一列参数、第二列参数、第三列参数和第四列参数中的任意两个列参数,将这两个列参数确定为待滤波边界的联合渐进特征,例如将第一列参数和第四列参数确定为待滤波边界的联合渐进特征。
S405、根据待滤波边界的联合渐进特征,确定是否对待滤波边界进行滤波。
本申请为了防止对真实边界进行滤波,通过确定待滤波边界的联合渐进特征,基于待滤波边界的联合渐进特征,确定是否对待滤波边界进行滤波。例如,当待滤波边界的联合渐进特征大于某预设值b1或小于某预设值b2时,说明该待滤波边界为真实边界,确定对该待滤波边界不进行滤波;当待滤波边界的联合渐进特征大于b2且小于b1时,说明该待滤波边界不是真实边界,确定对该待滤波边界进行滤波。
下面基于待滤波边界的联合渐进特征,对确定是否对待滤波边界进行滤波的过程进行详细介绍。
参照上述情况1,当待滤波边界为垂直边界时,上述S405包括如下几种情况:
在第一种情况下,上述S405包括:在第一行参数至第N行参数中的至少两个参数大于或等于第二预设值时,确定对待滤波边界不进行滤波。
例如,当第一行参数至第N行参数中的至少两个参数满足如下公式(11)时,确定对待滤波边界不进行滤波:
dpq i≥T2            (11)
其中,dpq i为第i行参数,T2为第二预设值。
示例性的,参照图5A,假设N为4,在第一行参数、第二行参数、第三行参数和第四行参数中的任意两个参数大于或等于第二预设值T2时,确定对待滤波边界不进行滤波。例如,第一行参数和第四行参数大于或等于第二预设值T2时,确定对待滤波边界不进行滤波。
可选的,第二预设值T2大于0.5小于1。
可选的,第二预设值T2大于0.5小于0.8。
可选的,还可以根据量化参数QP确定第二预设值T2,例如,使用量化参数QP查表可以得到参数β’,β’与第二预设值T2正相关,即当β’增大时,第二预设值T2也增大。基于此,根据预设的运算规则,对β’进行运算,得到第二预设值T2,其中第二预设值T2小于1。
可选的,第二预设值T2等于
Figure PCTCN2020133427-appb-000001
其中β可以查表获得,或者为预设值。
在第二种情况下,上述S405包括:在第一行参数至第N行参数中任意两个参数之和大于或等于第四预设值T4时,确定对待滤波边界不进行滤波。
示例性的,参照图5A,假设N为4,在第一行参数、第二行参数、第三行参数和第四行参数中的任意两个参数之和大于或等于第四预设值T4时,确定对该待滤波边界不进行滤波。例如,第一行参数和第四行参数之和大于或等于第四预设值T4时,确定对待滤波边界不进行滤波。
可选的,第四预设值T4大于或等于2倍的第二预设值。
可选的,第四预设值T4等于β。
在第三种情况下,上述S405包括如下S405-B1和S405-B2:
S405-B1,根据待滤波边界两侧的像素点的像素值,确定待滤波边界两侧的像素点的像素值的变换率;
S405-B2,根据变换率、以及第一行参数至所述第N行参数中的至少一个参数,确定是否对待滤波边界进行滤波。
在一种示例中,上述S405-B1中,例如可以根据第一边界区域的N行像素点中每一行像素点的像素值,确定每一行像素点的像素值的变换率,进而获得N行像素点的像素值的变换率。再根据N行像素点的像素值的变换率,确定待滤波边界两侧的像素点的像素值的变换率。
在另一种示例中,根据N行像素点中任意两行像素点的像素值的变换率,确定待滤波边界两侧的像素点的像素值的变换率。例如,根据第一行像素点和第N行像素点的像素值的变换率,确定待滤波边界两侧的像素点的像素值的变换率。
示例性的,可以根据如上公式(1)确定待滤波边界两侧的像素点的像素值的变换率dpqL。
上述S405-B2,根据变换率、以及第一行参数至所述第N行参数中的至少一个参数,确定是否对待滤波边界进行滤波可以包括不同的情况:
情况1,在变换率小于第三预设值T3,且第一行参数至第N行参数中的至少一个参数小于第五预设值T5时,确定对待滤波边界进行滤波。
例如,以图5A所示,满足如下公式(12)和公式(13),则确定对待滤波边界进行滤波:
dpqL<T3                (12)
dpq0<T5或dpq3<T5             (13)
其中,T3为第三预设值,T5为第五预设值,dpqL为第一行像素点和第4行像素点的像素值的变换率,其中dpqL的确定过程参照上述公式(1),dpq0为第一行参数,dpq3为第四行参数。
可选的,第三预设值T3=β。
可选的,第三预设值为2倍的第二预设值,例如当第三预设值T3=β时,
Figure PCTCN2020133427-appb-000002
可选的,第五预设值为1/2倍的第六预设值,例如当第六预设值T6=β时,
Figure PCTCN2020133427-appb-000003
可选的,上述第五预设值T5可以与上述第二预设值T2相等,例如
Figure PCTCN2020133427-appb-000004
情况2,在上述变换率大于或等于第三预设值T3,和/或第一行参数至第N行参数中的至少两个参数大于或等于第六预设值T6时,确定对待滤波边界不进行滤波。
例如,当上述变换率大于或等于第三预设值T3时,确定对待滤波边界不进行滤波;或者,当第一行参数至第N行参数中的至少两个参数大于或等于第六预设值T6时,确定对待滤波边界不进行滤波;或者,当上述变换率大于或等于第三预设值T3,且第一行参数至第N行参数中的至少两个参数大于或等于第六预设值T6时,确定对待滤波边界不进行滤波。
可选的,上述第六预设值T6等于第五预设值T5。
可选的,上述第六预设值T6等于上述第二预设值T2。
情况3,在变换率小于第三预设值T3,且第一行参数至第N行参数中任意两个参数之和小于第七预设值T7时,确定对待滤波边界进行滤波。
例如,以图5A所示,假设第一行参数至第N行参数中任意两个参数为第一行参数dpq0和第四行参数dpq3,当满足上述公式(12)和如下公式(14)时,确定对待滤波边界进行滤波:
dpq0+dpq3<T7          (14)
可选的,上述第七预设值T7等于β。
情况4,在变换率大于或等于第三预设值T3,和/或第一行参数至第N行参数中任意两个参数之和大于或等于第八预设值T8时,确定对待滤波边界不进行滤波。
可选的,上述第八预设值T8等于上述第七预设值T7。
可选的,上述第八预设值T8等于上述第三预设值T3。
本申请实施例中,当待滤波边界为垂直边界时,可以根据第一行参数至第N行参数中的至少一个来确定是否对该待滤波边界进行滤波,可以减少对真实边界进行过滤波。
结合上文,参照上述情况2,下面对待滤波边界为水平边界时,根据待滤波边界的联合渐进特征,确定是否对待滤波边界进行滤波的过程进行介绍。
当待滤波边界为水平边界时,上述S405包括如下几种情况:
在第一种情况下,上述S405包括:在第一列参数至第M列参数中的至少两个参数大于或等于第二预设值时,确定对待滤波边界不进列滤波。
例如,当第一列参数至第M列参数中的至少两个参数满足如下公式(15)时,确定对待滤波边界不进行滤波。
dpq j≥T2           (15)
其中,dpq j为第j列参数,T2为第二预设值。
示例性的,参照图5B,假设M为4,在第一列参数、第二列参数、第三列参数和第四列参数中的任意两个参数大于或等于第二预设值T2时,确定对待滤波边界不进列滤波。例如,第一列参数和第四列参数大于或等于第二预设值T2时,确定对待滤波边界不进列滤波。
在第二种情况下,上述S405包括:在第一列参数至第M列参数中任意两个参数之和大于或等于第四预设值时,确定对待滤波边界不进列滤波。
示例性的,参照图5B,假设M为4,在第一列参数、第二列参数、第三列参数和第四列参数中的任意两个参数之和大于或等于第四预设值T4时,确定对该待滤波边界不进列滤波。例如,第一列参数和第四列参数之和大于或等于第四预设值T4时,确定对待滤波边界不进列滤波。
在第三种情况下,上述S405包括如下S405-D1和S405-D2:
S405-D1,根据待滤波边界两侧的像素点的像素值,确定待滤波边界两侧的像素点的像素值的变换率;
S405-D2,根据变换率、以及第一列参数至所述第M列参数中的至少一个参数,确定是否对待滤波边界进行滤波。
在一种示例中,上述S405-D1中,例如可以根据第二边界区域的M列像素点中每一列像素点的像素值,确定每一列像素点的像素值的变换率,进而获得M列像素点的像素值的变换率。再根据M列像素点的像素值的变换率,确定待滤波边界两侧的像素点的像素值的变换率。
在另一种示例中,根据M列像素点中任意两列像素点的像素值的变换率,确定为待滤波边界两侧的像素点的像素值的变换率。例如,根据第一列像素点和第M列像素点的像素值的变换率,确定为待滤波边界两侧的像素点的像素值的变换率。
示例性的,可以根据如下公式(1)确定待滤波边界两侧的像素点的像素值的变换率dpqL。
上述S405-D2,根据变换率、以及第一列参数至所述第M列参数中的至少一个参数,确定是否对待滤波边界进行滤波可以包括不同的情况:
情况1,在变换率小于第三预设值T3,且第一列参数至第M列参数中的至少一个参数小于第五预设值T5时,确定对待滤波边界进列滤波。
例如,以图5B所示,满足如下公式(16)和公式(17),则确定对待滤波边界进行滤波:
dpqL<T3           (16)
dpq0<T5或dpq3<T5         (17)
其中,dpqL为第一列像素点和第四列像素点的像素值的变换率,其中dpqL的确定过程参照上述公式(1),dpq0为第一列参数,dpq3为第四列参数。
情况2,在变换率大于或等于第三预设值T3,和/或第一列参数至第M列参数中的至少两个参数大于或等于第六预设值T6时,确定对待滤波边界不进列滤波。
情况3,在变换率小于第三预设值T3,且第一列参数至第M列参数中任意两个参数之和小于第七预设值T7时,确定对待滤波边界进列滤波。
情况4,在变换率大于或等于第三预设值T3,和/或第一列参数至第M列参数中任意两个参数之和大于或等于第八预设值T8时,确定对待滤波边界不进列滤波。
需要说明的是,上述S405-D1和S405-D2的部分可以参照上述S405-B1和S405-B2的描述,在此不再赘述。
本申请实施例中,当待滤波边界为水平边界时,可以根据第一列参数至第M列参数中的至少一个来确定是否对该待滤波边界进列滤波,可以减少对真实边界进行过滤波。
图6为本申请实施例提供的图像处理方法500的另一种流程示意图,如图6所示,包括:
S501、将输入的视频数据中的每一帧图像划分成多个待编码图像块。例如,针对每一帧图像,视频编码器将该帧图像划分为一个或多个待编码图像块(CU)。
S502、从解码图像缓存中获得参考帧,并基于该参考帧进行预测,获得待编码图像块的预测块。例如,基于该参考帧,采用帧内预测或帧间估计方法,预测得到待编码图像块的预测块。
S503、对待编码图像块和预测块求差,获得残差块,并对残差块进行变换、量化处理,得到量化后的变换系数。
一方面,量化后的变换系数直接送入熵编码器,编码后输出码流。
另一方面,执行S504:
S504、对量化后的变换系数进行反量化、反变换处理,得到重建的残差块,重建的残差块与预测块进行叠加,得到待编码图像块的部分或完整重建图像。该部分或完整的重建图像包括一个或多个重建图像块。
S505、确定重建图像块的待滤波边界。其中,待滤波边界可以是水平边界,或者是垂直边界。该步骤可以参照上述S402的描述,在此不再赘述。
S506、根据待滤波边界两侧相邻的第一图像块和第二图像块,确定待滤波边界的边界滤波强度。该步骤可以参照上述S403的描述,在此不再赘述。
S507、判断边界滤波强度是否大于第一预设值,若否则执行S515,若是,则执行S508和S509,或执行S510和S511。
S508、若待滤波边界为垂直边界,根据第一边界区域的第i行像素点的两端像素点的像素值与中间像素点的像素值的差值,确定第i行参数,其中i为大于或等于1且小于或等于N的正整数。
S509、根据第一行参数至第N行参数中的至少一个参数,确定是否对待滤波边界进行滤波。
例如,在第一行参数至第N行参数中的至少两个参数大于或等于第二预设值时,确定对待滤波边界不进行滤波。或者,在第一行参数至第N行参数中任意两个参数之和大于或等于第四预设值时,确定对待滤波边界不进行滤波。或者,在变换率小于第三预设值,且第一行参数至第N行参数中的至少一个参数小于第五预设值时,确定对待滤波边界进行滤波。或者,在变换率大于或等于第三预设值,和/或第一行参数至第N行参数中的至少两个参数大于或等于第六预设值时,确定对待滤波边界不进行滤波。或者,在变换率小于第三预设值,且第一行参数至第N行参数中任意两个参数之和小于第七预设值时,确定对待滤波边界进行滤波。或者,在变换率大于或等于第三预设值,和/或第一行参数至第N行参数中任意两个参数之和大于或等于第八预设值时,确定对待滤波边界不进行滤波。
在一种具体的示例中,假设N=4,联合渐进特征包括:第一行参数和第四行参数,则上述S508可以包括如下S508-A1和S508-A2:
S508-A1、根据第一边界区域的第一行像素点的两端像素点的像素值与中间像素点的像素值的差值,确定第一行参数;
S508-A2、根据第一边界区域的第四行像素点的两端像素点的像素值与中间像素点的像素值的差值,确定第四行参数。
示例性的,如图5A所示,第一行像素点的中间像素点包括:第一行像素点中,待滤波边界左侧与待滤波边界相邻的第一个左侧像素点和与第一个左侧像素点相邻的第二个左侧像素点,以及待滤波边界右侧与待滤波边界相邻的第一个右侧像素点和与第一个右侧像素点相邻的第二个右侧像素点;第一行像素点的两端像素点包括:第一行像素点中与第二个左侧像素点相邻的第三个左侧像素点和与第二个右侧像素点相邻的第三个右侧像素点;
第四行像素点的中间像素点包括:第四行像素点中,待滤波边界左侧与待滤波边界相邻的第一个左侧像素点和与第一个左侧像素点相邻的第二个左侧像素点,以及待滤波边界右侧与待滤波边界相邻的第一个右侧像素点和与第一个右侧像素点相邻的第二个右侧像素点;第四行像素点的两端像素点包括:第四行像素点中与第二个左侧像素点相邻的第三个左侧像素点和与第二个右侧像素点相邻的第三个右侧像素点。
基于此,上述S508-A1包括如下S508-A11:
S508-A11、根据第一行像素点中第三个左侧像素点的像素值分别与第一个左侧像素点的像素值和第二个左侧像素点的像素值的差值,以及第三个右侧像素点的像素值分别与第一个右侧像素点的像素值和第二个右侧像素点的像素值的差值,确定第一行参数。
例如,根据如下公式确定第一行参数:
dpq 0=|2p 2,0-p 1,0-p 0,0+2q 2,0-q 1,0-q 0,0|,
其中,dpq 0为第一行参数,p 0,0为第一行像素点中的第一个左侧像素点,p 1,0为第一行像素点中的第二个左侧像素点,p 2,0为第一行像素点中的第三个左侧像素点,q 0,0为第一行像素点中的第一个右侧像素点,q 1,0为第一行像素点中的第二个右侧像素点,q 2,0为第一行像素点中的第三个右侧像素点。
上述S508-A2包括如下S508-A21:
S508-A21、根据第四行像素点中第三个左侧像素点的像素值分别与第一个左侧像素点的像素值和第二个左侧像素点的像素值的差值,以及第三个右侧像素点的像素值分别与第一个右侧像素点的像素值和第二个右侧像素点的像素值的差值,确定第四行参数。
例如,根据如下公式确定第四行参数:
dpq 3=|2p 2,3-p 1,3-p 0,3+2q 2,3-q 1,3-q 0,3|,
其中,dpq 3为第四行参数,p 0,3为第四行像素点中的第一个左侧像素点,p 1,3为第四行像素点中的第二个左侧像素点,p 2,3为第四行像素点中的第三个左侧像素点,q 0,3为第四行像素点中的第一个右侧像素点,q 1,3为第四行像素点中的第二个右侧像素点,q 2,3为第四行像素点中的第三个右侧像素点。
根据上述方法确定出第一行参数和第四行参数后,执行S509根据第一行参数和第四行参数判断是否对待滤波边界进行滤波,即上述S509包括如下几种实现方式:
方式一,在第一行参数和第四行参数均大于或等于第二预设值,确定对待滤波边界不进行滤波。
方式二,在第一行参数和第四行参数之和大于或等于第四预设值,确定对待滤波边界不进行滤波。
方式三,根据待滤波边界两侧的像素点的像素值,确定待滤波边界两侧的像素点的像素值的变换率;根据变换率、以及第一行参数和第四行参数中的至少一个参数,确定是否对待滤波边界进行滤波。
例如,在变换率小于第三预设值,且第一行参数和/或第四行参数小于第五预设值时,确定对待滤波边界进行滤波。
例如,在变换率小于第三预设值,且第一行参数与第四行参数均大于或等于第六预设值时,确定对待滤波边界进行滤波。
例如,在变换率小于第三预设值,且第一行参数与第四行参数之和小于第七预设值时,确定对待滤波边界进行滤波。
例如,在变换率小于第三预设值,且第一行参数与第四行参数之和大于或等于第八预设值时,确定对待滤波边界进行滤波。
若确定对待滤波边界进行滤波,则执行S512至S514,否则执行S515。
S510、若待滤波边界为水平边界,根据第二边界区域的第j列像素点的两端像素点的像素值与中间像素点的像素值的差值,确定第j列参数,其中j为大于或等于1且小于或等于M的正整数。
S511、根据第一列参数至第M列参数中的至少一个参数,确定是否对待滤波边界进行滤波。
例如,在第一列参数至第M列参数中的至少两个参数大于或等于第二预设值时,确定对待滤波边界不进列滤波。或者,在第一列参数至第M列参数中任意两个参数之和大于或等于第四预设值时,确定对待滤波边界不进列滤波。或者,在变换率小于第三预设值,且第一列参数至第M列参数中的至少一个参数小于第五预设值时,确定对待滤波边界进列滤波。或者,在变换率大于或等于第三预设值,和/或第一列参数至第M列参数中的至少两个参数大于或等于第六预设值时,确定对待滤波边界不进列滤波。或者,在变换率小于第三预设值,且第一列参数至第M列参数中任意两个参数之和小于第七预设值时,确定对待滤波边界进列滤波。
在一种具体的示例中,假设M=4,联合渐进特征包括:第一列参数和第四列参数,则上述S510包括如下S510-A1和S510-A2:
S510-A1、根据第二边界区域的第一列像素点的两端像素点的像素值与中间像素点的像素值的差值,确定第一列参数;
S510-A2、根据第二边界区域的第四列像素点的两端像素点的像素值与中间像素点的像素值的差值,确定第四列参数。
示例性的,如图5B所示,第一列像素点的中间像素点包括:第一列像素点中,待滤波边界上方与待滤波边界相 邻的第一个上方像素点和与第一个上方像素点相邻的第二个上方像素点,以及待滤波边界下方与待滤波边界相邻的第一个下方像素点和与第一个下方像素点相邻的第二个下方像素点;第一列像素点的两端像素点包括:第一列像素点中与第二个上方像素点相邻的第三个上方像素点和与第二个下方像素点相邻的第三个下方像素点;
第四列像素点的中间像素点包括:第四列像素点中,待滤波边界上方与待滤波边界相邻的第一个上方像素点和与第一个上方像素点相邻的第二个上方像素点,以及待滤波边界下方与待滤波边界相邻的第一个下方像素点和与第一个下方像素点相邻的第二个下方像素点;第四列像素点的两端像素点包括:第四列像素点中与第二个上方像素点相邻的第三个上方像素点和与第二个下方像素点相邻的第三个下方像素点。
基于此,上述S510-A1包括如下S510-A11:
S510-A11、根据第一列像素点中第三个上方像素点的像素值分别与第一个上方像素点的像素值和第二个上方像素点的像素值的差值,以及第三个下方像素点的像素值分别与第一个下方像素点的像素值和第二个下方像素点的像素值的差值,确定第一列参数。
例如,根据如下公式确定第一列参数:
dpq 0=|2p 2,0-p 1,0-p 0,0+2q 2,0-q 1,0-q 0,0|,
其中,dpq 0为第一列参数,p 0,0为第一列像素点中的第一个上方像素点,p 1,0为第一列像素点中的第二个上方像素点,p 2,0为第一列像素点中的第三个上方像素点,q 0,0为第一列像素点中的第一个下方像素点,q 1,0为第一列像素点中的第二个下方像素点,q 2,0为第一列像素点中的第三个下方像素点。
上述S510-A2包括如下S510-A21:
S510-A21、根据第四列像素点中第三个上方像素点的像素值分别与第一个上方像素点的像素值和第二个上方像素点的像素值的差值,以及第三个下方像素点的像素值分别与第一个下方像素点的像素值和第二个下方像素点的像素值的差值,确定第四列参数。
例如,根据如下公式确定第四列参数:
dpq 3=|2p 2,3-p 1,3-p 0,3+2q 2,3-q 1,3-q 0,3|,
其中,dpq 3为第四列参数,p 0,3为第四列像素点中的第一个上方像素点,p 1,3为第四列像素点中的第二个上方像素点,p 2,3为第四列像素点中的第三个上方像素点,q 0,3为第四列像素点中的第一个下方像素点,q 1,3为第四列像素点中的第二个下方像素点,q 2,3为第四列像素点中的第三个下方像素点。
根据上述方法确定出第一列参数和第四列参数后,根据第一列参数和第四列参数判断是否对待滤波边界进行滤波,即上述S511包括如下几种实现方式:
方式一,在第一列参数和第四列参数均大于或等于第二预设值,确定对待滤波边界不进行滤波。
方式二,在第一列参数和第四列参数之和大于或等于第四预设值,确定对待滤波边界不进行滤波。
方式三,根据待滤波边界两侧的像素点的像素值,确定待滤波边界两侧的像素点的像素值的变换率;根据变换率、以及第一列参数和第四列参数中的至少一个参数,确定是否对待滤波边界进行滤波。
例如,在变换率小于第三预设值,且第一列参数和/或第四列参数小于第五预设值时,确定对待滤波边界进行滤波。
例如,在变换率小于第三预设值,且第一列参数与第四列参数均大于或等于第六预设值时,确定对待滤波边界进行滤波。
例如,在变换率小于第三预设值,且第一列参数与第四列参数之和小于第七预设值时,确定对待滤波边界进行滤波。
例如,在变换率小于第三预设值,且第一列参数与第四列参数之和大于或等于第八预设值时,确定对待滤波边界进行滤波。
若确定对待滤波边界进行滤波,则执行S512至S514,否则执行S515。
S512、确定待滤波边界的滤波方式。其中,滤波方式包括强滤波和弱滤波。可选的,可以采用已有标准记载的方法确定该待滤波边界的滤波方式。
S513、使用确定的滤波方式对待滤波边界进行滤波。
S514、将滤波后的重建图像块存放至解码图像缓存。视频编码器在后续的图像编码过程中可以从解码图像缓存中获得参考帧。
S515、停止滤波操作。
应理解,图6仅为本申请的示例,不应理解为对本申请的限制。
在一种具体的示例中,以N=M=4为例对本申请实施例涉及的滤波过程做进一步说明,即对获得重建图像块后,如何判断是否对重建图像块进行滤波的过程进行说明。
图7为本申请实施例提供的滤波方法的一种流程示意图,如图7所示,包括:
S201、判断重建图像块的边界是否为待滤波边界,具体可以参照上述401的描述,在此不再赘述。若判断重建图像块的边界为待滤波边界,则执行S202,否则执行S207。
S202、确定该待滤波边界的滤波边界强度(BS),并判断该BS是否大于0。若判断该待滤波边界的BS大于0,则执行S203,否则执行S207。
S203、判断公式(1289)和公式(1290)是否满足,若满足则执行S204,否则执行S207。具体的,参照如下公式:
dp 0=|p 2,0-2p 1,0+p 0,0|            (1285)
dp 3=|p 2,3-2p 1,3+p 0,3|                (1286)
dq 0=|q 2,0-2q 1,0+q 0,0|             (1287)
dq 3=|q 2,3-2q 1,3+q 0,3|                (1288)
dpq 0=|2p 2,0-p 1,0-p 0,0+2q 2,0-q 1,0-q 0,0|              (1288-A)
dpq 3=|2p 2,3-p 1,3-p 0,3+2q 2,3-q 1,3-q 0,3|              (1288-B)
dp 0+dp 3+dq 0+dq 3<β             (1289)
dpq0<β/2或dpq3<β/2                  (1290)
S204、判断待滤波边界是否满足强滤波条件,若满足强滤波条件,则执行S205对待滤波边界进行强滤波,若不满足强滤波条件,则执行S206对待滤波边界进行弱滤波。
S205、执行强滤波。
S206、执行弱滤波。
S207、结束滤波操作。
应理解,图7仅为本申请的示例,不应理解为对本申请的限制。
以上结合附图详细描述了本申请的优选实施方式,但是,本申请并不限于上述实施方式中的具体细节,在本申请的技术构思范围内,可以对本申请的技术方案进行多种简单变型,这些简单变型均属于本申请的保护范围。例如,在上述具体实施方式中所描述的各个具体技术特征,在不矛盾的情况下,可以通过任何合适的方式进行组合,为了避免不必要的重复,本申请对各种可能的组合方式不再另行说明。又例如,本申请的各种不同的实施方式之间也可以进行任意组合,只要其不违背本申请的思想,其同样应当视为本申请所公开的内容。
还应理解,在本申请的各种方法实施例中,上述各过程的序号的大小并不意味着执行顺序的先后,各过程的执行顺序应以其功能和内在逻辑确定,而不应对本申请实施例的实施过程构成任何限定。另外,本申请实施例中,术语“和 /或”,仅仅是一种描述关联对象的关联关系,表示可以存在三种关系。具体地,A和/或B可以表示:单独存在A,同时存在A和B,单独存在B这三种情况。另外,本文中字符“/”,一般表示前后关联对象是一种“或”的关系。
上文中结合图1至图7,从编码端的角度详细描述本申请实施例的图像处理方法,下面将结合图8和图9,从解码端的角度描述本申请实施例的图像处理方法。
图8为本申请实施例提供的图像处理方法600的一种流程示意图,本申请实施例应用于图1和图3所示的视频解码器。如图8所示,本申请实施例的方法600包括:
S601、解码码流,得到部分或完整的重建图像,其中,部分或完整的重建图像包括一个或多个重建图像块。
具体的,参照图3所示,头信息解码单元或熵解码单元310对码流进行熵解码,以获取频域残差块。头信息解码单元或熵解码单元310将频域残差块转发到逆量化变换单元330。逆量化变换单元330对频域残差块进行反变换与反量化等步骤,可获取时域残差块,将时域残差块转发给重建单元340。重建单元340可以理解为求和器,表示执行此求和操作的组件。重建单元340将预测单元预测得到的预测块叠加至时域残差块,可得到部分或完整的重建图像,该部分或完整的重建图像包括一个或多个重建图像块。
S602、确定重建图像块的待滤波边界。
S603、根据待滤波边界两侧相邻的第一图像块和第二图像块,确定待滤波边界的边界滤波强度。
上述S602和S603的具体执行过程可以参照上述S402和S403的记载,在此不再赘述。
S604、在边界滤波强度大于第一预设值时,根据待滤波边界两侧的像素点的像素值,确定待滤波边界的联合渐进特征。
在一些实施例中,上述S604中根据待滤波边界两侧的像素点的像素值,确定待滤波边界的联合渐进特征可以包括如下S604-A1:
S604-A1、根据待滤波边界两侧的像素点中的中间像素点的像素值与两端像素点的像素值的差值,确定该待滤波边界的联合渐进特征。
由上述图5A和图5B可知,本申请实施例的待滤波边界可以是垂直边界也可以是水平边界,当待滤波边界不同时,上述S604-A1中根据待滤波边界两侧的像素点中的中间像素点的像素值与两端像素点的像素值的差值,确定该待滤波边界的联合渐进特征的过程不相同,下面对两种情况分别进行介绍。
情况1,当待滤波边界为垂直边界时,第一图像块和第二图像块构成的第一边界区域包括N行像素点。
在一些实施例中,上述S604-A1可以包括如下S604-A11和S604-A12:
S604-A11,根据第一边界区域的第i行像素点的两端像素点的像素值与中间像素点的像素值的差值,确定第i行参数,其中i为大于或等于1且小于或等于N的正整数;
S604-A12,将第一行参数至第N行参数中的至少一个行参数,确定为该待滤波边界的联合渐进特征。
在一示例中,上述第i行像素点的中间像素点包括:第i行像素点中,待滤波边界左侧与待滤波边界相邻的第一个左侧像素点(例如p 0,i)和与第一个左侧像素点相邻的第二个左侧像素点(例如p 1,i),以及待滤波边界右侧与待滤波边界相邻的第一个右侧像素点(例如q 0,i)和与第一个右侧像素点相邻的第二个右侧像素点(例如q 1,i)。上述第i行像素点的两端像素点包括:第i行像素点中与第二个左侧像素点相邻的第三个左侧像素点(例如p 2,i)和与第二个右侧像素点相邻的第三个右侧像素点(例如q 2,i)。
在该示例中,上述S604-A11可以包括如下S604-A111:
S604-A11,根据第i行像素点中第三个左侧像素点的像素值分别与第一个左侧像素点的像素值和第二个左侧像素点的像素值的差值,以及第三个右侧像素点的像素值分别与第一个右侧像素点的像素值和第二个右侧像素点的像素值的差值,确定第i行参数。
例如,通过上述公式(9)确定第i行参数。
根据上述方式可以确定出第一行参数至第N行参数中的任意一个行参数,执行S404-A12,将第一行参数至第N行参数中的任意一个行参数确定为待滤波边界的联合渐进特征。
该示例的部分具体执行过程可以参照上述S404中的情况1的相关描述。
情况2,当待滤波边界为水平边界时,第一图像块和第二图像块构成的第二边界区域包括M列像素点。
此时,上述S604-A1可以包括如下S604-A14和S604-A15:
在一些实施例中,上述S604-A14可以包括如下步骤S604-A14:
S604-A14,根据第二边界区域的第j列像素点的两端像素点的像素值与中间像素点的像素值的差值,确定第j列参数,其中j为大于或等于1且小于或等于M的正整数;
S604-A15,将第一列参数至第M列参数中的至少一个列参数,确定为该待滤波边界的联合渐进特征。
第一种示例中,第j列像素点的中间像素点包括:第j列像素点中,待滤波边界上方与待滤波边界相邻的第一个上方像素点(例如p 0,j)和与第一个上方像素点相邻的第二个上方像素点(例如p 1,j),以及待滤波边界下方与待滤波边界相邻的第一个下方像素点(例如q 0,j)和与第一个下方像素点相邻的第二个下方像素点(例如q 1,j)。第j列像素点的两端像素点包括:第j列像素点中与第二个上方像素点相邻的第三个上方像素点(例如p 2,j)和与第二个下方像素点相邻的第三个下方像素点(例如q 2,j)。
在该示例中,上述S604-A14可以包括如下S404-A141:
S604-A141,根据第j列像素点中第三个上方像素点的像素值分别与第一个上方像素点的像素值和第二个上方像素点的像素值的差值,以及第三个下方像素点的像素值分别与第一个下方像素点的像素值和第二个下方像素点的像素值的差值,确定第j列参数。
例如,可以通过如上公式(10)确定第j列参数。
根据上述方式可以确定出第一列参数至第M列参数中的任意一个列参数,接着执行S604-A15,将第一列参数至第M列参数中的任意一个列参数确定为待滤波边界的联合渐进特征。
需要说明的是,上述S604具体实现过程与上述S404基本一致,可以参照上述S404的描述,在此不再赘述。
S605、根据待滤波边界的联合渐进特征,确定是否对待滤波边界进行滤波。
当待滤波边界为垂直边界时,上述S605包括如下几种情况:
在第一种情况下,在第一行参数至第N行参数中的至少两个参数大于或等于第二预设值时,确定对待滤波边界不进行滤波。
在第二种情况下,在第一行参数至第N行参数中任意两个参数之和大于或等于第四预设值T4时,确定对待滤波边界不进行滤波。
在第三种情况下,根据待滤波边界两侧的像素点的像素值,确定待滤波边界两侧的像素点的像素值的变换率;根据变换率、以及第一行参数至第N行参数中的至少一个参数,确定是否对待滤波边界进行滤波。
在第三种情况的一些实施例中,在变换率小于第三预设值T3,且第一行参数至第N行参数中的至少一个参数小于第五预设值T5时,确定对待滤波边界进行滤波。
在第三种情况的一些实施例中,在上述变换率大于或等于第三预设值T3,和/或第一行参数至第N行参数中的至少两个参数大于或等于第六预设值T6时,确定对待滤波边界不进行滤波。
在第三种情况的一些实施例中,在变换率小于第三预设值T3,且第一行参数至第N行参数中任意两个参数之和小于第七预设值T7时,确定对待滤波边界进行滤波。
在第三种情况的一些实施例中,在变换率大于或等于第三预设值T3,和/或第一行参数至第N行参数中任意两个参数之和大于或等于第八预设值T8时,确定对待滤波边界不进行滤波。
当待滤波边界为水平边界时,上述S605包括如下几种情况:
在第一种情况下,在第一列参数至第M列参数中的至少两个参数大于或等于第二预设值时,确定对待滤波边界不进列滤波。
在第二种情况下,在第一列参数至第M列参数中任意两个参数之和大于或等于第四预设值时,确定对待滤波边界不进列滤波。
在第三种情况下,根据待滤波边界两侧的像素点的像素值,确定待滤波边界两侧的像素点的像素值的变换率;根据变换率、以及第一列参数至第M列参数中任意一个参数,确定是否对待滤波边界进列滤波。
在第三种情况的一些实施例中,在变换率小于第三预设值T3,且第一列参数至第M列参数中的至少一个参数小于第五预设值T5时,确定对待滤波边界进列滤波。
在第三种情况的一些实施例中,在变换率大于或等于第三预设值T3,和/或第一列参数至第M列参数中的至少两个参数大于或等于第六预设值T6时,确定对待滤波边界不进列滤波。
在第三种情况的一些实施例中,在变换率小于第三预设值T3,且第一列参数至第M列参数中任意两个参数之和小于第七预设值T7时,确定对待滤波边界进列滤波。
在第三种情况的一些实施例中,在变换率大于或等于第三预设值T3,和/或第一列参数至第M列参数中任意两个参数之和大于或等于第八预设值T8时,确定对待滤波边界不进列滤波。
需要说明的是,上述S605具体实现过程与上述S405基本一致,可以参照上述S405的描述,在此不再赘述。
图9为本申请实施例提供的图像处理方法700的一种流程示意图,如图9所示,包括:
S701、对码流进行熵解码、反量化和反变换,得到残差块。
S702、将残差块与帧间/帧内预测得到的预测块叠加,得到部分或完整重建图像。该部分或完整的重建图像包括一个或多个重建图像块。
S703、确定重建图像块的待滤波边界。待滤波边界是水平边界,或者是垂直边界。该步骤可以参照上述S402的描述,在此不再赘述。
S704、根据待滤波边界两侧相邻的第一图像块和第二图像块,确定待滤波边界的边界滤波强度。该步骤可以参照上述S403的描述,在此不再赘述。
S705、判断边界滤波强度是否大于第一预设值,若否则执行S713,若是,则执行S706和S707,或执行S708和S709。
S706、若待滤波边界为垂直边界,根据第一边界区域的第i行像素点的两端像素点的像素值与中间像素点的像素值的差值,确定第i行参数,其中i为大于或等于1且小于或等于N的正整数。
S707、根据第一行参数至第N行参数中的至少一个参数,确定是否对待滤波边界进行滤波。
例如,在第一行参数至第N行参数中的至少两个参数大于或等于第二预设值时,确定对待滤波边界不进行滤波。或者,在第一行参数至第N行参数中任意两个参数之和大于或等于第四预设值时,确定对待滤波边界不进行滤波。或者,在变换率小于第三预设值,且第一行参数至第N行参数中的至少一个参数小于第五预设值时,确定对待滤波边界进行滤波。或者,在变换率大于或等于第三预设值,和/或第一行参数至第N行参数中的至少两个参数大于或等于第六预设值时,确定对待滤波边界不进行滤波。或者,在变换率小于第三预设值,且第一行参数至第N行参数中任意两个参数之和小于第七预设值时,确定对待滤波边界进行滤波。或者,在变换率大于或等于第三预设值,和/或第一行参数至第N行参数中任意两个参数之和大于或等于第八预设值时,确定对待滤波边界不进行滤波。
在一种具体的示例中,假设N=4,联合渐进特征包括:第一行参数和第四行参数,则上述S706可以包括如下S706-A1和S706-A2:
S706-A1、根据第一边界区域的第一行像素点的两端像素点的像素值与中间像素点的像素值的差值,确定第一行 参数;
S706-A2、根据第一边界区域的第四行像素点的两端像素点的像素值与中间像素点的像素值的差值,确定第四行参数。
示例性的,如图5A所示,第一行像素点的中间像素点包括:第一行像素点中,待滤波边界左侧与待滤波边界相邻的第一个左侧像素点和与第一个左侧像素点相邻的第二个左侧像素点,以及待滤波边界右侧与待滤波边界相邻的第一个右侧像素点和与第一个右侧像素点相邻的第二个右侧像素点;第一行像素点的两端像素点包括:第一行像素点中与第二个左侧像素点相邻的第三个左侧像素点和与第二个右侧像素点相邻的第三个右侧像素点;
第四行像素点的中间像素点包括:第四行像素点中,待滤波边界左侧与待滤波边界相邻的第一个左侧像素点和与第一个左侧像素点相邻的第二个左侧像素点,以及待滤波边界右侧与待滤波边界相邻的第一个右侧像素点和与第一个右侧像素点相邻的第二个右侧像素点;第四行像素点的两端像素点包括:第四行像素点中与第二个左侧像素点相邻的第三个左侧像素点和与第二个右侧像素点相邻的第三个右侧像素点。
基于此,上述S706-A1包括如下S706-A11:
S706-A11、根据第一行像素点中第三个左侧像素点的像素值分别与第一个左侧像素点的像素值和第二个左侧像素点的像素值的差值,以及第三个右侧像素点的像素值分别与第一个右侧像素点的像素值和第二个右侧像素点的像素值的差值,确定第一行参数。
例如,根据如下公式确定第一行参数:
dpq 0=|2p 2,0-p 1,0-p 0,0+2q 2,0-q 1,0-q 0,0|,
其中,dpq 0为第一行参数,p 0,0为第一行像素点中的第一个左侧像素点,p 1,0为第一行像素点中的第二个左侧像素点,p 2,0为第一行像素点中的第三个左侧像素点,q 0,0为第一行像素点中的第一个右侧像素点,q 1,0为第一行像素点中的第二个右侧像素点,q 2,0为第一行像素点中的第三个右侧像素点。
上述S706-A2包括如下S706-A21:
S706-A21、根据第四行像素点中第三个左侧像素点的像素值分别与第一个左侧像素点的像素值和第二个左侧像素点的像素值的差值,以及第三个右侧像素点的像素值分别与第一个右侧像素点的像素值和第二个右侧像素点的像素值的差值,确定第四行参数。
例如,根据如下公式确定第四行参数:
dpq 3=|2p 2,3-p 1,3-p 0,3+2q 2,3-q 1,3-q 0,3|,
其中,dpq 3为第四行参数,p 0,3为第四行像素点中的第一个左侧像素点,p 1,3为第四行像素点中的第二个左侧像素点,p 2,3为第四行像素点中的第三个左侧像素点,q 0,3为第四行像素点中的第一个右侧像素点,q 1,3为第四行像素点中的第二个右侧像素点,q 2,3为第四行像素点中的第三个右侧像素点。
根据上述方法确定出第一行参数和第四行参数后,根据第一行参数和第四行参数判断是否对待滤波边界进行滤波,即上述S707包括如下几种实现方式:
方式一,在第一行参数和第四行参数均大于或等于第二预设值,确定对待滤波边界不进行滤波。
方式二,在第一行参数和第四行参数之和大于或等于第四预设值,确定对待滤波边界不进行滤波。
方式三,根据待滤波边界两侧的像素点的像素值,确定待滤波边界两侧的像素点的像素值的变换率;根据变换率、以及第一行参数和第四行参数中的至少一个参数,确定是否对待滤波边界进行滤波。
例如,在变换率小于第三预设值,且第一行参数和/或第四行参数小于第五预设值时,确定对待滤波边界进行滤波。
例如,在变换率小于第三预设值,且第一行参数与第四行参数均大于或等于第六预设值时,确定对待滤波边界进行滤波。
例如,在变换率小于第三预设值,且第一行参数与第四行参数之和小于第七预设值时,确定对待滤波边界进行滤 波。
例如,在变换率小于第三预设值,且第一行参数与第四行参数之和大于或等于第八预设值时,确定对待滤波边界进行滤波。
若确定对待滤波边界进行滤波,则执行S710至S712,否则执行S713。
S708、若待滤波边界为水平边界,根据第二边界区域的第j列像素点的两端像素点的像素值与中间像素点的像素值的差值,确定第j列参数,其中j为大于或等于1且小于或等于M的正整数。
S709、根据第一列参数至第M列参数中的至少一个参数,确定是否对待滤波边界进行滤波。
例如,在第一列参数至第M列参数中的至少两个参数大于或等于第二预设值时,确定对待滤波边界不进列滤波。或者,在第一列参数至第M列参数中任意两个参数之和大于或等于第四预设值时,确定对待滤波边界不进列滤波。或者,在变换率小于第三预设值,且第一列参数至第M列参数中的至少一个参数小于第五预设值时,确定对待滤波边界进列滤波。或者,在变换率大于或等于第三预设值,和/或第一列参数至第M列参数中的至少两个参数大于或等于第六预设值时,确定对待滤波边界不进列滤波。或者,在变换率小于第三预设值,且第一列参数至第M列参数中任意两个参数之和小于第七预设值时,确定对待滤波边界进列滤波。
在一种具体的示例中,假设M=4,联合渐进特征包括:第一列参数和第四列参数,则上述S708包括如下S708-A1和S708-A2:
S708-A1、根据第二边界区域的第一列像素点的两端像素点的像素值与中间像素点的像素值的差值,确定第一列参数;
S708-A2、根据第二边界区域的第四列像素点的两端像素点的像素值与中间像素点的像素值的差值,确定第四列参数。
示例性的,如图5B所示,第一列像素点的中间像素点包括:第一列像素点中,待滤波边界上方与待滤波边界相邻的第一个上方像素点和与第一个上方像素点相邻的第二个上方像素点,以及待滤波边界下方与待滤波边界相邻的第一个下方像素点和与第一个下方像素点相邻的第二个下方像素点;第一列像素点的两端像素点包括:第一列像素点中与第二个上方像素点相邻的第三个上方像素点和与第二个下方像素点相邻的第三个下方像素点;
第四列像素点的中间像素点包括:第四列像素点中,待滤波边界上方与待滤波边界相邻的第一个上方像素点和与第一个上方像素点相邻的第二个上方像素点,以及待滤波边界下方与待滤波边界相邻的第一个下方像素点和与第一个下方像素点相邻的第二个下方像素点;第四列像素点的两端像素点包括:第四列像素点中与第二个上方像素点相邻的第三个上方像素点和与第二个下方像素点相邻的第三个下方像素点。
基于此,上述S708-A1包括如下S708-A11:
S708-A11、根据第一列像素点中第三个上方像素点的像素值分别与第一个上方像素点的像素值和第二个上方像素点的像素值的差值,以及第三个下方像素点的像素值分别与第一个下方像素点的像素值和第二个下方像素点的像素值的差值,确定第一列参数。
例如,根据如下公式确定第一列参数:
dpq 0=|2p 2,0-p 1,0-p 0,0+2q 2,0-q 1,0-q 0,0|,
其中,dpq 0为第一列参数,p 0,0为第一列像素点中的第一个上方像素点,p 1,0为第一列像素点中的第二个上方像素点,p 2,0为第一列像素点中的第三个上方像素点,q 0,0为第一列像素点中的第一个下方像素点,q 1,0为第一列像素点中的第二个下方像素点,q 2,0为第一列像素点中的第三个下方像素点。
上述S708-A2包括如下S708-A21:
S708-A21、根据第四列像素点中第三个上方像素点的像素值分别与第一个上方像素点的像素值和第二个上方像素点的像素值的差值,以及第三个下方像素点的像素值分别与第一个下方像素点的像素值和第二个下方像素点的像素值 的差值,确定第四列参数。
例如,根据如下公式确定第四列参数:
dpq 3=|2p 2,3-p 1,3-p 0,3+2q 2,3-q 1,3-q 0,3|,
其中,dpq 3为第四列参数,p 0,3为第四列像素点中的第一个上方像素点,p 1,3为第四列像素点中的第二个上方像素点,p 2,3为第四列像素点中的第三个上方像素点,q 0,3为第四列像素点中的第一个下方像素点,q 1,3为第四列像素点中的第二个下方像素点,q 2,3为第四列像素点中的第三个下方像素点。
根据上述方法确定出第一列参数和第四列参数后,根据第一列参数和第四列参数判断是否对待滤波边界进行滤波,即上述S709包括如下几种实现方式:
方式一,在第一列参数和第四列参数均大于或等于第二预设值,确定对待滤波边界不进行滤波。
方式二,在第一列参数和第四列参数之和大于或等于第四预设值,确定对待滤波边界不进行滤波。
方式三,根据待滤波边界两侧的像素点的像素值,确定待滤波边界两侧的像素点的像素值的变换率;根据变换率、以及第一列参数和第四列参数中的至少一个参数,确定是否对待滤波边界进行滤波。
例如,在变换率小于第三预设值,且第一列参数和/或第四列参数小于第五预设值时,确定对待滤波边界进行滤波。
例如,在变换率小于第三预设值,且第一列参数与第四列参数均大于或等于第六预设值时,确定对待滤波边界进行滤波。
例如,在变换率小于第三预设值,且第一列参数与第四列参数之和小于第七预设值时,确定对待滤波边界进行滤波。
例如,在变换率小于第三预设值,且第一列参数与第四列参数之和大于或等于第八预设值时,确定对待滤波边界进行滤波。
若确定对待滤波边界进行滤波,则执行S710至S712,否则执行S713。
S710、确定对待滤波边界的滤波方式。其中,滤波方式包括强滤波和弱滤波。
S711、使用确定的滤波方式对待滤波边界进行滤波。可选的,可以采用已有标准记载的方法确定该待滤波边界的滤波方式。
S712、将滤波后的重建图像块存放至解码图像缓存。视频解码器可以从解码图像缓存中获得该滤波后的重建图像作为参考帧,或者将该滤波后的重建图像传输给显示装置呈现。
S713、停止滤波操作。
应理解,图9仅为本申请的示例,不应理解为对本申请的限制。
上文结合图1至图9,详细描述了本申请的方法实施例,下文结合图10至图12,详细描述本申请的装置实施例。
图10是本申请实施例提供的视频编码器800的示意性框图。
如图10所示,视频编码器800包括:
获取单元810,用于获取待编码图像块的部分或完整的重建图像,其中,部分或完整的重建图像包括一个或多个重建图像块;
边界确定单元812,用于确定重建图像块的待滤波边界;
强度确定单元813,用于根据待滤波边界两侧相邻的第一图像块和第二图像块的编码信息,确定待滤波边界的边界滤波强度;
特征确定单元814,用于在边界滤波强度大于第一预设值时,根据待滤波边界两侧的像素点的像素值,确定待滤波边界的联合渐进特征;可选的,第一预设值为0;
滤波确定单元815,用于根据待滤波边界的联合渐进特征,确定是否对待滤波边界进行滤波。
在一些实施例中,特征确定单元814,具体用于根据所述待滤波边界两侧的像素点中的中间像素点的像素值与两端像素点的像素值的差值,确定所述待滤波边界的联合渐进特征,其中,所述中间像素点为与所述待滤波边界相邻的像素点,所述两端像素点为与所述中间像素点相邻的像素点。
若待滤波边界为垂直边界,则第一图像块和第二图像块构成的第一边界区域包括N行像素点,则特征确定单元814,具体用于根据所述第一边界区域的第i行像素点的两端像素点的像素值与中间像素点的像素值的差值,确定所述第i行参数;将第一行参数至第N行参数中的至少一个确定为所述联合渐进特征,其中,N是正整数,i为大于或等于1且小于所述N的整数;
在一种可能的实现方式中,第i行像素点的中间像素点包括:第i行像素点中,待滤波边界左侧与待滤波边界相邻的第一个左侧像素点和与第一个左侧像素点相邻的第二个左侧像素点,以及待滤波边界右侧与待滤波边界相邻的第一个右侧像素点和与第一个右侧像素点相邻的第二个右侧像素点;
第i行像素点的两端像素点包括:第i行像素点中与第二个左侧像素点相邻的第三个左侧像素点和与第二个右侧像素点相邻的第三个右侧像素点。
基于上述可能的实现方式,则特征确定单元814,具体用于根据第i行像素点中第三个左侧像素点的像素值分别与第一个左侧像素点的像素值和第二个左侧像素点的像素值的差值,以及第三个右侧像素点的像素值分别与第一个右侧像素点的像素值和第二个右侧像素点的像素值的差值,确定第i行参数。
例如,特征确定单元814,具体用于根据如下公式确定第i行参数:
dpq i=|2p 2,i-p 1,i-p 0,i+2q 2,i-q 1,i-q 0,i|,
其中,dpq i为第i行参数,p 0,i为第i行像素点中的第一个左侧像素点,p 1,i为第i行像素点中的第二个左侧像素点,p 2,i为第i行像素点中的第三个左侧像素点,q 0,i为第i行像素点中的第一个右侧像素点,q 1,i为第i行像素点中的第二个右侧像素点,q 2,i为第i行像素点中的第三个右侧像素点。
在一些实施例中,滤波确定单元815,具体用于在第一行参数至第N行参数中的至少两个参数大于或等于第二预设值时,确定对待滤波边界不进行滤波。
可选的,第二预设值大于0.5小于1。
可选的,第二预设值大于0.5小于0.8。
可选的,第二预设值等于二分之一的第三预设值。
可选的,滤波确定单元815,还根据量化参数QP确定第二预设值。
在一些实施例中,滤波确定单元815,具体用于在第一行参数至第N行参数中任意两个参数之和大于或等于第四预设值时,确定对待滤波边界不进行滤波。
在一些实施例中,滤波确定单元815,具体用于根据待滤波边界两侧的像素点的像素值,确定待滤波边界两侧的像素点的像素值的变换率;根据变换率、以及第i行参数至第N行参数中的至少一个参数,确定是否对待滤波边界进行滤波。
在一些实施例中,滤波确定单元815,具体用于在变换率小于第三预设值,且第一行参数至第N行参数中的至少一个参数小于第五预设值时,确定对待滤波边界进行滤波。
在一些实施例中,滤波确定单元815,具体用于在变换率大于或等于第三预设值,和/或第一行参数至第N行参数中的至少两个参数大于或等于第六预设值时,确定对待滤波边界不进行滤波。
在一些实施例中,滤波确定单元815,具体用于在变换率小于第三预设值,且第一行参数至第N行参数中任意两个参数之和小于第七预设值时,确定对待滤波边界进行滤波。
在一些实施例中,滤波确定单元815,具体用于在变换率大于或等于第三预设值,和/或第一行参数至第N行参数中任意两个参数之和大于或等于第八预设值时,确定对待滤波边界不进行滤波。
在一种具体的示例中,假设N=4,联合渐进特征包括:第一行参数和第四行参数,则特征确定单元814,具体用于根据第一边界区域的第一行像素点的两端像素点的像素值与中间像素点的像素值的差值,确定第一行参数;根据第一边界区域的第四行像素点的两端像素点的像素值与中间像素点的像素值的差值,确定第四行参数。
示例性的,第一行像素点的中间像素点包括:第一行像素点中,待滤波边界左侧与待滤波边界相邻的第一个左侧像素点和与第一个左侧像素点相邻的第二个左侧像素点,以及待滤波边界右侧与待滤波边界相邻的第一个右侧像素点和与第一个右侧像素点相邻的第二个右侧像素点;第一行像素点的两端像素点包括:第一行像素点中与第二个左侧像素点相邻的第三个左侧像素点和与第二个右侧像素点相邻的第三个右侧像素点;
第四行像素点的中间像素点包括:第四行像素点中,待滤波边界左侧与待滤波边界相邻的第一个左侧像素点和与第一个左侧像素点相邻的第二个左侧像素点,以及待滤波边界右侧与待滤波边界相邻的第一个右侧像素点和与第一个右侧像素点相邻的第二个右侧像素点;第四行像素点的两端像素点包括:第四行像素点中与第二个左侧像素点相邻的第三个左侧像素点和与第二个右侧像素点相邻的第三个右侧像素点。
此时,特征确定单元814,具体用于根据第一行像素点中第三个左侧像素点的像素值分别与第一个左侧像素点的像素值和第二个左侧像素点的像素值的差值,以及第三个右侧像素点的像素值分别与第一个右侧像素点的像素值和第二个右侧像素点的像素值的差值,确定第一行参数。
例如,特征确定单元814,具体用于根据如下公式确定第一行参数:
dpq 0=|2p 2,0-p 1,0-p 0,0+2q 2,0-q 1,0-q 0,0|,
其中,dpq 0为第一行参数,p 0,0为第一行像素点中的第一个左侧像素点,p 1,0为第一行像素点中的第二个左侧像素点,p 2,0为第一行像素点中的第三个左侧像素点,q 0,0为第一行像素点中的第一个右侧像素点,q 1,0为第一行像素点中的第二个右侧像素点,q 2,0为第一行像素点中的第三个右侧像素点。
以及特征确定单元814,具体用于根据第四行像素点中第三个左侧像素点的像素值分别与第一个左侧像素点的像素值和第二个左侧像素点的像素值的差值,以及第三个右侧像素点的像素值分别与第一个右侧像素点的像素值和第二个右侧像素点的像素值的差值,确定第四行参数。
例如,特征确定单元814,具体用于根据如下公式确定第四行参数:
dpq 3=|2p 2,3-p 1,3-p 0,3+2q 2,3-q 1,3-q 0,3|,
其中,dpq 3为第四行参数,p 0,3为第四行像素点中的第一个左侧像素点,p 1,3为第四行像素点中的第二个左侧像素点,p 2,3为第四行像素点中的第三个左侧像素点,q 0,3为第四行像素点中的第一个右侧像素点,q 1,3为第四行像素点中的第二个右侧像素点,q 2,3为第四行像素点中的第三个右侧像素点。
对应的,滤波确定单元815,具体用于在第一行参数和第四行参数均大于或等于第二预设值,确定对待滤波边界不进行滤波;
或者,在第一行参数和第四行参数之和大于或等于第四预设值,确定对待滤波边界不进行滤波;
或者,根据待滤波边界两侧的像素点的像素值,确定待滤波边界两侧的像素点的像素值的变换率;根据变换率、以及第一行参数和第四行参数中的至少一个参数,确定是否对待滤波边界进行滤波。
例如,在变换率小于第三预设值,且第一行参数和/或第四行参数小于第五预设值时,确定对待滤波边界进行滤波。
例如,在变换率小于第三预设值,且第一行参数与第四行参数均大于或等于第六预设值时,确定对待滤波边界进行滤波。
例如,在变换率小于第三预设值,且第一行参数与第四行参数之和小于第七预设值时,确定对待滤波边界进行滤波。
例如,在变换率小于第三预设值,且第一行参数与第四行参数之和大于或等于第八预设值时,确定对待滤波边界进行滤波。
若待滤波边界为水平边界,则第一图像块和第二图像块构成的第二边界区域包括M列像素点,特征确定单元814,具体用于根据第二边界区域的第j列像素点的两端像素点的像素值与中间像素点的像素值的差值,确定第j列参数;将第一列参数至第N列参数中的至少一个确定为所述联合渐进特征,其中,所述M是正整数,所述j为大于或等于1且小于所述M的整数。
在一种可能的实现方式中,第j列像素点的中间像素点包括:第j列像素点中,待滤波边界上方与待滤波边界相邻的第一个上方像素点和与第一个上方像素点相邻的第二个上方像素点,以及待滤波边界下方与待滤波边界相邻的第一个下方像素点和与第一个下方像素点相邻的第二个下方像素点;
第j列像素点的两端像素点包括:第j列像素点中与第二个上方像素点相邻的第三个上方像素点和与第二个下方像素点相邻的第三个下方像素点。
基于该可能的实现方式,则上述特征确定单元814,具体用于根据第j列像素点中第三个上方像素点的像素值分别与第一个上方像素点的像素值和第二个上方像素点的像素值的差值,以及第三个下方像素点的像素值分别与第一个下方像素点的像素值和第二个下方像素点的像素值的差值,确定第j列参数。
例如,特征确定单元814,具体用于根据如下公式确定第j列参数:
dpq j=|2p 2,j-p 1,j-p 0,j+2q 2,j-q 1,j-q 0,j|,
其中,dpq j为第j列参数,p 0,j为第j列像素点中的第一个上方像素点,p 1,j为第j列像素点中的第二个上方像素点,p 2,j为第j列像素点中的第三个上方像素点,q 0,j为第j列像素点中的第一个下方像素点,q 1,j为第j列像素点中的第二个下方像素点,q 2,j为第j列像素点中的第三个下方像素点。
在一些实施例中,滤波确定单元815,具体用于在第一列参数至第M列参数中的至少两个参数大于或等于第二预设值时,确定对待滤波边界不进行滤波。
可选的,第二预设值大于0.5小于1。
可选的,第二预设值大于0.5小于0.8。
可选的,第二预设值等于二分之一的第三预设值。
可选的,滤波确定单元815,还根据量化参数QP确定第二预设值。
在一些实施例中,滤波确定单元815,具体用于在第一列参数至第M列参数中任意两个参数之和大于或等于第四预设值时,确定对待滤波边界不进行滤波。
在一些实施例中,滤波确定单元815,具体用于根据待滤波边界两侧的像素点的像素值,确定待滤波边界两侧的像素点的像素值的变换率;根据变换率、以及第j列参数至第M列参数中的至少一个参数,确定是否对待滤波边界进行滤波。
在一些实施例中,滤波确定单元815,具体用于在变换率小于第三预设值,且第一列参数至第M列参数中的至少一个参数小于第五预设值时,确定对待滤波边界进行滤波。
在一些实施例中,滤波确定单元815,具体用于在变换率大于或等于第三预设值,和/或第一列参数至第M列参数中的至少两个参数大于或等于第六二预设值时,确定对待滤波边界不进行滤波。
在一些实施例中,滤波确定单元815,具体用于在变换率小于第三预设值,且第一列参数至第M列参数中任意两个参数之和小于第七预设值时,确定对待滤波边界进行滤波。
在一些实施例中,滤波确定单元815,具体用于在变换率大于或等于第三预设值,和/或第一列参数至第M列参数中任意两个参数之和大于或等于第八预设值时,确定对待滤波边界不进行滤波。
在一种具体的示例中,假设M=4,联合渐进特征包括:第一列参数和第四列参数,则特征确定单元814,具体用于根据第二边界区域的第一列像素点的两端像素点的像素值与中间像素点的像素值的差值,确定第一列参数;根据第二边界区域的第四列像素点的两端像素点的像素值与中间像素点的像素值的差值,确定第四列参数。
示例性的,第一列像素点的中间像素点包括:第一列像素点中,待滤波边界上方与待滤波边界相邻的第一个上方像素点和与第一个上方像素点相邻的第二个上方像素点,以及待滤波边界下方与待滤波边界相邻的第一个下方像素点和与第一个下方像素点相邻的第二个下方像素点;第一列像素点的两端像素点包括:第一列像素点中与第二个上方像素点相邻的第三个上方像素点和与第二个下方像素点相邻的第三个下方像素点;
第四列像素点的中间像素点包括:第四列像素点中,待滤波边界上方与待滤波边界相邻的第一个上方像素点和与第一个上方像素点相邻的第二个上方像素点,以及待滤波边界下方与待滤波边界相邻的第一个下方像素点和与第一个下方像素点相邻的第二个下方像素点;第四列像素点的两端像素点包括:第四列像素点中与第二个上方像素点相邻的第三个上方像素点和与第二个下方像素点相邻的第三个下方像素点。
此时,特征确定单元814,具体用于根据第一列像素点中第三个上方像素点的像素值分别与第一个上方像素点的像素值和第二个上方像素点的像素值的差值,以及第三个下方像素点的像素值分别与第一个下方像素点的像素值和第二个下方像素点的像素值的差值,确定第一列参数。
例如,特征确定单元814,具体用于根据如下公式确定第一列参数:
dpq 0=|2p 2,0-p 1,0-p 0,0+2q 2,0-q 1,0-q 0,0|,
其中,dpq 0为第一列参数,p 0,0为第一列像素点中的第一个上方像素点,p 1,0为第一列像素点中的第二个上方像素点,p 2,0为第一列像素点中的第三个上方像素点,q 0,0为第一列像素点中的第一个下方像素点,q 1,0为第一列像素点中的第二个下方像素点,q 2,0为第一列像素点中的第三个下方像素点。
以及特征确定单元814,具体用于根据第四列像素点中第三个上方像素点的像素值分别与第一个上方像素点的像素值和第二个上方像素点的像素值的差值,以及第三个下方像素点的像素值分别与第一个下方像素点的像素值和第二个下方像素点的像素值的差值,确定第四列参数。
例如,特征确定单元814,具体用于根据如下公式确定第四列参数:
dpq 3=|2p 2,3-p 1,3-p 0,3+2q 2,3-q 1,3-q 0,3|,
其中,dpq 3为第四列参数,p 0,3为第四列像素点中的第一个上方像素点,p 1,3为第四列像素点中的第二个上方像素点,p 2,3为第四列像素点中的第三个上方像素点,q 0,3为第四列像素点中的第一个下方像素点,q 1,3为第四列像素点中的第二个下方像素点,q 2,3为第四列像素点中的第三个下方像素点。
对应的,滤波确定单元815,具体用于在第一列参数和第四列参数均大于或等于第二预设值,确定对待滤波边界不进行滤波;
或者,在第一列参数和第四列参数之和大于或等于第四预设值,确定对待滤波边界不进行滤波;
或者,根据待滤波边界两侧的像素点的像素值,确定待滤波边界两侧的像素点的像素值的变换率;根据变换率、以及第一列参数和第四列参数中的至少一个参数,确定是否对待滤波边界进行滤波。
例如,在变换率小于第三预设值,且第一列参数和/或第四列参数小于第五预设值时,确定对待滤波边界进行滤波。
例如,在变换率小于第三预设值,且第一列参数与第四列参数均大于或等于第六预设值时,确定对待滤波边界进行滤波。
例如,在变换率小于第三预设值,且第一列参数与第四列参数之和小于第七预设值时,确定对待滤波边界进行滤波。
例如,在变换率小于第三预设值,且第一列参数与第四列参数之和大于或等于第八预设值时,确定对待滤波边界进行滤波。
应理解,装置实施例与方法实施例可以相互对应,类似的描述可以参照方法实施例。为避免重复,此处不再赘述。具体地,图10所示的视频编码器800可以执行本申请实施例的方法,并且视频编码器800中的各个单元的前述和其它操作和/或功能分别为了实现方法400或500等各个方法中的相应流程,为了简洁,在此不再赘述。
图11是本申请实施例提供的视频解码器900的示意性框图。
如图11所示,该视频解码器900可包括:
解码单元910,用于解码码流,得到部分或完整的重建图像,其中,部分或完整的重建图像包括一个或多个重建图像块;
边界确定单元912,用于确定重建图像块的待滤波边界;
强度确定单元913,用于根据待滤波边界两侧相邻的第一图像块和第二图像块,确定待滤波边界的边界滤波强度;
特征确定单元914,用于在边界滤波强度大于第一预设值时,根据待滤波边界两侧的像素点的像素值,确定待滤波边界的联合渐进特征;例如第一预设值为0;
滤波确定单元915,用于根据待滤波边界的联合渐进特征,确定是否对待滤波边界进行滤波。
在一些实施例中,特征确定单元914,具体用于根据待滤波边界两侧的像素点中的中间像素点的像素值与两端像素点的像素值的差值,确定该待滤波边界的联合渐进特征。
若待滤波边界为垂直边界,则第一图像块和第二图像块构成的第一边界区域包括N行像素点,在一些实施例中,特征确定单元914,具体用于根据第一边界区域的第i行像素点的两端像素点的像素值与中间像素点的像素值的差值,确定第i行参数;将第一行参数至第N行参数中的至少一个行参数,确定为该待滤波边界的联合渐进特征,,其中,N是正整数,i为大于或等于1且小于或等于N的正整数。
在一些实施例中,第i行像素点的中间像素点包括:第i行像素点中,待滤波边界左侧与待滤波边界相邻的第一个左侧像素点和与第一个左侧像素点相邻的第二个左侧像素点,以及待滤波边界右侧与待滤波边界相邻的第一个右侧像素点和与第一个右侧像素点相邻的第二个右侧像素点;
第i行像素点的两端像素点包括:第i行像素点中与第二个左侧像素点相邻的第三个左侧像素点和与第二个右侧像素点相邻的第三个右侧像素点。
在一些实施例中,特征确定单元914,具体用于根据第i行像素点中第三个左侧像素点的像素值分别与第一个左侧像素点的像素值和第二个左侧像素点的像素值的差值,以及第三个右侧像素点的像素值分别与第一个右侧像素点的像素值和第二个右侧像素点的像素值的差值,确定第i行参数。
例如,特征确定单元914,具体用于根据如下公式确定第i行参数:
dpq i=|2p 2,i-p 1,i-p 0,i+2q 2,i-q 1,i-q 0,i|,
其中,dpq i为第i行参数,p 0,i为第i行像素点中的第一个左侧像素点,p 1,i为第i行像素点中的第二个左侧像素点,p 2,i为第i行像素点中的第三个左侧像素点,q 0,i为第i行像素点中的第一个右侧像素点,q 1,i为第i行像素点中的第二个右侧像素点,q 2,i为第i行像素点中的第三个右侧像素点。
在一些实施例中,滤波确定单元915,具体用于在第一行参数至第N行参数中的至少两个参数大于或等于第二预设值时,确定对待滤波边界不进行滤波。
可选的,第二预设值大于0.5小于1。
可选的,第二预设值大于0.5小于0.8。
可选的,第二预设值等于二分之一的第三预设值。
可选的,滤波确定单元915,还用于根据量化参数QP确定第二预设值。
在一些实施例中,滤波确定单元915,具体用于在第一行参数至第N行参数中任意两个参数之和大于或等于第四预设值时,确定对待滤波边界不进行滤波。
在一些实施例中,滤波确定单元915,具体用于根据待滤波边界两侧的像素点的像素值,确定待滤波边界两侧的像素点的像素值的变换率;根据变换率、以及第i行参数至第N行参数中的至少一个参数,确定是否对待滤波边界进 行滤波。
在一些实施例中,滤波确定单元915,具体用于在变换率小于第三预设值,且第一行参数至第N行参数中的至少一个参数小于第五预设值时,确定对待滤波边界进行滤波。
在一些实施例中,滤波确定单元915,具体用于在变换率大于或等于第三预设值,和/或第一行参数至第N行参数中的至少两个参数大于或等于第六预设值时,确定对待滤波边界不进行滤波。
在一些实施例中,滤波确定单元915,具体用于在变换率小于第三预设值,且第一行参数至第N行参数中任意两个参数之和小于第七预设值时,确定对待滤波边界进行滤波。
在一些实施例中,滤波确定单元915,具体用于在变换率大于或等于第三预设值,和/或第一行参数至第N行参数中任意两个参数之和大于或等于第八预设值时,确定对待滤波边界不进行滤波。
在一种具体的示例中,假设N=4,联合渐进特征包括:第一行参数和第四行参数,则特征确定单元914,具体用于根据第一边界区域的第一行像素点的两端像素点的像素值与中间像素点的像素值的差值,确定第一行参数;根据第一边界区域的第四行像素点的两端像素点的像素值与中间像素点的像素值的差值,确定第四行参数。
示例性的,第一行像素点的中间像素点包括:第一行像素点中,待滤波边界左侧与待滤波边界相邻的第一个左侧像素点和与第一个左侧像素点相邻的第二个左侧像素点,以及待滤波边界右侧与待滤波边界相邻的第一个右侧像素点和与第一个右侧像素点相邻的第二个右侧像素点;第一行像素点的两端像素点包括:第一行像素点中与第二个左侧像素点相邻的第三个左侧像素点和与第二个右侧像素点相邻的第三个右侧像素点;
第四行像素点的中间像素点包括:第四行像素点中,待滤波边界左侧与待滤波边界相邻的第一个左侧像素点和与第一个左侧像素点相邻的第二个左侧像素点,以及待滤波边界右侧与待滤波边界相邻的第一个右侧像素点和与第一个右侧像素点相邻的第二个右侧像素点;第四行像素点的两端像素点包括:第四行像素点中与第二个左侧像素点相邻的第三个左侧像素点和与第二个右侧像素点相邻的第三个右侧像素点。
此时,特征确定单元914,具体用于根据第一行像素点中第三个左侧像素点的像素值分别与第一个左侧像素点的像素值和第二个左侧像素点的像素值的差值,以及第三个右侧像素点的像素值分别与第一个右侧像素点的像素值和第二个右侧像素点的像素值的差值,确定第一行参数。
例如,特征确定单元914,具体用于根据如下公式确定第一行参数:
dpq 0=|2p 2,0-p 1,0-p 0,0+2q 2,0-q 1,0-q 0,0|,
其中,dpq 0为第一行参数,p 0,0为第一行像素点中的第一个左侧像素点,p 1,0为第一行像素点中的第二个左侧像素点,p 2,0为第一行像素点中的第三个左侧像素点,q 0,0为第一行像素点中的第一个右侧像素点,q 1,0为第一行像素点中的第二个右侧像素点,q 2,0为第一行像素点中的第三个右侧像素点。
以及特征确定单元914,具体用于根据第四行像素点中第三个左侧像素点的像素值分别与第一个左侧像素点的像素值和第二个左侧像素点的像素值的差值,以及第三个右侧像素点的像素值分别与第一个右侧像素点的像素值和第二个右侧像素点的像素值的差值,确定第四行参数。
例如,特征确定单元914,具体用于根据如下公式确定第四行参数:
dpq 3=|2p 2,3-p 1,3-p 0,3+2q 2,3-q 1,3-q 0,3|,
其中,dpq 3为第四行参数,p 0,3为第四行像素点中的第一个左侧像素点,p 1,3为第四行像素点中的第二个左侧像素点,p 2,3为第四行像素点中的第三个左侧像素点,q 0,3为第四行像素点中的第一个右侧像素点,q 1,3为第四行像素点中的第二个右侧像素点,q 2,3为第四行像素点中的第三个右侧像素点。
对应的,滤波确定单元915,具体用于在第一行参数和第四行参数均大于或等于第二预设值,确定对待滤波边界不进行滤波;
或者,在第一行参数和第四行参数之和大于或等于第四预设值,确定对待滤波边界不进行滤波;
或者,根据待滤波边界两侧的像素点的像素值,确定待滤波边界两侧的像素点的像素值的变换率;根据变换率、以及第一行参数和第四行参数中的至少一个参数,确定是否对待滤波边界进行滤波。
例如,在变换率小于第三预设值,且第一行参数和/或第四行参数小于第五预设值时,确定对待滤波边界进行滤波。
例如,在变换率小于第三预设值,且第一行参数与第四行参数均大于或等于第六预设值时,确定对待滤波边界进行滤波。
例如,在变换率小于第三预设值,且第一行参数与第四行参数之和小于第七预设值时,确定对待滤波边界进行滤波。
例如,在变换率小于第三预设值,且第一行参数与第四行参数之和大于或等于第八预设值时,确定对待滤波边界进行滤波。
若待滤波边界为水平边界,则第一图像块和第二图像块构成的第二边界区域包括M列像素点,在一些实施例中,特征确定单元914,具体用于根据第二边界区域的第j列像素点的两端像素点的像素值与中间像素点的像素值的差值,确定第j列参数;将第一列参数至第N列参数中的至少一个确定为所述联合渐进特征,其中,所述M是正整数,所述j为大于或等于1且小于所述M的整数。
在一些实施例中,第j列像素点的中间像素点包括:第j列像素点中,待滤波边界上方与待滤波边界相邻的第一个上方像素点和与第一个上方像素点相邻的第二个上方像素点,以及待滤波边界下方与待滤波边界相邻的第一个下方像素点和与第一个下方像素点相邻的第二个下方像素点;
第j列像素点的两端像素点包括:第j列像素点中与第二个上方像素点相邻的第三个上方像素点和与第二个下方像素点相邻的第三个下方像素点。
在一些实施例中,特征确定单元914,具体用于根据第j列像素点中第三个上方像素点的像素值分别与第一个上方像素点的像素值和第二个上方像素点的像素值的差值,以及第三个下方像素点的像素值分别与第一个下方像素点的像素值和第二个下方像素点的像素值的差值,确定第j列参数。
例如,特征确定单元914,具体用于根据如下公式确定第j列参数:
dpq j=|2p 2,j-p 1,j-p 0,j+2q 2,j-q 1,j-q 0,j|,
其中,dpq j为第j列参数,p 0,j为第j列像素点中的第一个上方像素点,p 1,j为第j列像素点中的第二个上方像素点,p 2,j为第j列像素点中的第三个上方像素点,q 0,j为第j列像素点中的第一个下方像素点,q 1,j为第j列像素点中的第二个下方像素点,q 2,j为第j列像素点中的第三个下方像素点。
在一些实施例中,滤波确定单元915,具体用于在第一列参数至第M列参数中的至少两个参数大于或等于第二预设值时,确定对待滤波边界不进行滤波。
可选的,第二预设值大于0.5小于1。
可选的,第二预设值大于0.5小于0.8。
可选的,第二预设值等于二分之一的第三预设值。
可选的,滤波确定单元915,还用于根据量化参数QP确定第二预设值。
在一些实施例中,滤波确定单元915,具体用于在第一列参数至第M列参数中任意两个参数之和大于或等于第四预设值时,确定对待滤波边界不进行滤波。
在一些实施例中,滤波确定单元915,具体用于根据待滤波边界两侧的像素点的像素值,确定待滤波边界两侧的像素点的像素值的变换率;根据变换率、以及第一列参数至第M列参数中的至少一个参数,确定是否对待滤波边界进行滤波。
在一些实施例中,滤波确定单元915,具体用于在变换率小于第三预设值,且第一列参数至第M列参数中的至少一个参数小于第五预设值时,确定对待滤波边界进行滤波。
在一些实施例中,滤波确定单元915,具体用于在变换率大于或等于第三预设值,和/或第一列参数至第M列参数中的至少两个参数大于或等于第六预设值时,确定对待滤波边界不进行滤波。
在一些实施例中,滤波确定单元915,具体用于在变换率小于第三预设值,且第一列参数至第M列参数中任意两个参数之和小于第七预设值时,确定对待滤波边界进行滤波。
在一些实施例中,滤波确定单元915,具体用于在变换率大于或等于第三预设值,和/或第一列参数至第M列参数中任意两个参数之和大于或等于第八预设值时,确定对待滤波边界不进行滤波。
可选的,联合渐进特征包括:第一列参数和第M列参数。
在一种具体的示例中,假设M=4,联合渐进特征包括:第一列参数和第四列参数,则特征确定单元914,具体用于根据第二边界区域的第一列像素点的两端像素点的像素值与中间像素点的像素值的差值,确定第一列参数;根据第二边界区域的第四列像素点的两端像素点的像素值与中间像素点的像素值的差值,确定第四列参数。
示例性的,第一列像素点的中间像素点包括:第一列像素点中,待滤波边界上方与待滤波边界相邻的第一个上方像素点和与第一个上方像素点相邻的第二个上方像素点,以及待滤波边界下方与待滤波边界相邻的第一个下方像素点和与第一个下方像素点相邻的第二个下方像素点;第一列像素点的两端像素点包括:第一列像素点中与第二个上方像素点相邻的第三个上方像素点和与第二个下方像素点相邻的第三个下方像素点;
第四列像素点的中间像素点包括:第四列像素点中,待滤波边界上方与待滤波边界相邻的第一个上方像素点和与第一个上方像素点相邻的第二个上方像素点,以及待滤波边界下方与待滤波边界相邻的第一个下方像素点和与第一个下方像素点相邻的第二个下方像素点;第四列像素点的两端像素点包括:第四列像素点中与第二个上方像素点相邻的第三个上方像素点和与第二个下方像素点相邻的第三个下方像素点。
此时,特征确定单元914,具体用于根据第一列像素点中第三个上方像素点的像素值分别与第一个上方像素点的像素值和第二个上方像素点的像素值的差值,以及第三个下方像素点的像素值分别与第一个下方像素点的像素值和第二个下方像素点的像素值的差值,确定第一列参数。
例如,特征确定单元914,具体用于根据如下公式确定第一列参数:
dpq 0=|2p 2,0-p 1,0-p 0,0+2q 2,0-q 1,0-q 0,0|,
其中,dpq 0为第一列参数,p 0,0为第一列像素点中的第一个上方像素点,p 1,0为第一列像素点中的第二个上方像素点,p 2,0为第一列像素点中的第三个上方像素点,q 0,0为第一列像素点中的第一个下方像素点,q 1,0为第一列像素点中的第二个下方像素点,q 2,0为第一列像素点中的第三个下方像素点。
以及特征确定单元914,具体用于根据第四列像素点中第三个上方像素点的像素值分别与第一个上方像素点的像素值和第二个上方像素点的像素值的差值,以及第三个下方像素点的像素值分别与第一个下方像素点的像素值和第二个下方像素点的像素值的差值,确定第四列参数。
例如,特征确定单元814,具体用于根据如下公式确定第四列参数:
dpq 3=|2p 2,3-p 1,3-p 0,3+2q 2,3-q 1,3-q 0,3|,
其中,dpq 3为第四列参数,p 0,3为第四列像素点中的第一个上方像素点,p 1,3为第四列像素点中的第二个上方像素点,p 2,3为第四列像素点中的第三个上方像素点,q 0,3为第四列像素点中的第一个下方像素点,q 1,3为第四列像素点中的第二个下方像素点,q 2,3为第四列像素点中的第三个下方像素点。
对应的,滤波确定单元915,具体用于在第一列参数和第四列参数均大于或等于第二预设值,确定对待滤波边界不进行滤波;
或者,在第一列参数和第四列参数之和大于或等于第四预设值,确定对待滤波边界不进行滤波;
或者,根据待滤波边界两侧的像素点的像素值,确定待滤波边界两侧的像素点的像素值的变换率;根据变换率、以及第一列参数和第四列参数中的至少一个参数,确定是否对待滤波边界进行滤波。
例如,在变换率小于第三预设值,且第一列参数和/或第四列参数小于第五预设值时,确定对待滤波边界进行滤波。
例如,在变换率小于第三预设值,且第一列参数与第四列参数均大于或等于第六预设值时,确定对待滤波边界进行滤波。
例如,在变换率小于第三预设值,且第一列参数与第四列参数之和小于第七预设值时,确定对待滤波边界进行滤波。
例如,在变换率小于第三预设值,且第一列参数与第四列参数之和大于或等于第八预设值时,确定对待滤波边界进行滤波。
应理解,装置实施例与方法实施例可以相互对应,类似的描述可以参照方法实施例。为避免重复,此处不再赘述。具体地,图11所示的视频解码器900可以对应于执行本申请实施例的方法600或700中的相应主体,并且视频解码器900中的各个单元的前述和其它操作和/或功能分别为了实现方法600或700等各个方法中的相应流程,为了简洁,在此不再赘述。
上文中结合附图从功能单元的角度描述了本申请实施例的装置和系统。应理解,该功能单元可以通过硬件形式实现,也可以通过软件形式的指令实现,还可以通过硬件和软件单元组合实现。具体地,本申请实施例中的方法实施例的各步骤可以通过处理器中的硬件的集成逻辑电路和/或软件形式的指令完成,结合本申请实施例公开的方法的步骤可以直接体现为硬件译码处理器执行完成,或者用译码处理器中的硬件及软件单元组合执行完成。可选地,软件单元可以位于随机存储器,闪存、只读存储器、可编程只读存储器、电可擦写可编程存储器、寄存器等本领域的成熟的存储介质中。该存储介质位于存储器,处理器读取存储器中的信息,结合其硬件完成上述方法实施例中的步骤。
图12是本申请实施例提供的电子设备10的示意性框图。
如图12所示,该电子设备10可以为本申请实施例所述的视频编码器,或者视频解码器,该电子设备10可包括:
存储器11和处理器12,该存储器11用于存储计算机程序14,并将该程序代码14传输给该处理器12。换言之,该处理器12可以从存储器11中调用并运行计算机程序14,以实现本申请实施例中的方法。
例如,该处理器12可用于根据该计算机程序14中的指令执行上述方法200中的步骤。
在本申请的一些实施例中,该处理器12可以包括但不限于:
通用处理器、数字信号处理器(Digital Signal Processor,DSP)、专用集成电路(Application Specific Integrated Circuit,ASIC)、现场可编程门阵列(Field Programmable Gate Array,FPGA)或者其他可编程逻辑器件、分立门或者晶体管逻辑器件、分立硬件组件等等。
在本申请的一些实施例中,该存储器11包括但不限于:
易失性存储器和/或非易失性存储器。其中,非易失性存储器可以是只读存储器(Read-Only Memory,ROM)、可编程只读存储器(Programmable ROM,PROM)、可擦除可编程只读存储器(Erasable PROM,EPROM)、电可擦除可编程只读存储器(Electrically EPROM,EEPROM)或闪存。易失性存储器可以是随机存取存储器(Random Access Memory,RAM),其用作外部高速缓存。通过示例性但不是限制性说明,许多形式的RAM可用,例如静态随机存取存储器(Static RAM,SRAM)、动态随机存取存储器(Dynamic RAM,DRAM)、同步动态随机存取存储器(Synchronous DRAM,SDRAM)、双倍数据速率同步动态随机存取存储器(Double Data Rate SDRAM,DDR SDRAM)、增强型同步动态随机存取存储器(Enhanced SDRAM,ESDRAM)、同步连接动态随机存取存储器(synch link DRAM,SLDRAM)和直接内存总线随机存取存储器(Direct Rambus RAM,DR RAM)。
在本申请的一些实施例中,该计算机程序14可以被分割成一个或多个单元,该一个或者多个单元被存储在该存储器11中,并由该处理器12执行,以完成本申请提供的方法。该一个或多个单元可以是能够完成特定功能的一系列计算机程序指令段,该指令段用于描述该计算机程序14在该电子设备10中的执行过程。
如图12所示,该电子设备10还可包括:
收发器13,该收发器13可连接至该处理器12或存储器11。
其中,处理器12可以控制该收发器13与其他设备进行通信,具体地,可以向其他设备发送信息或数据,或接收其他设备发送的信息或数据。收发器13可以包括发射机和接收机。收发器13还可以进一步包括天线,天线的数量可以为一个或多个。
应当理解,该电子设备10中的各个组件通过总线系统相连,其中,总线系统除包括数据总线之外,还包括电源总线、控制总线和状态信号总线。
图13是本申请实施例提供的图像处理系统的示意性框图。
如图13所示,该图像处理系统20可包括:视频编码器21和视频解码器22,其中视频编码器21用于执行本申请实施例涉及的视频编码方法,视频解码器22用于执行本申请实施例涉及的视频解码方法。
本申请还提供了一种计算机存储介质,其上存储有计算机程序,该计算机程序被计算机执行时使得该计算机能够执行上述方法实施例的方法。或者说,本申请实施例还提供一种包含指令的计算机程序产品,该指令被计算机执行时使得计算机执行上述方法实施例的方法。
当使用软件实现时,可以全部或部分地以计算机程序产品的形式实现。该计算机程序产品包括一个或多个计算机指令。在计算机上加载和执行该计算机程序指令时,全部或部分地产生按照本申请实施例该的流程或功能。该计算机可以是通用计算机、专用计算机、计算机网络、或者其他可编程装置。该计算机指令可以存储在计算机可读存储介质中,或者从一个计算机可读存储介质向另一个计算机可读存储介质传输,例如,该计算机指令可以从一个网站站点、计算机、服务器或数据中心通过有线(例如同轴电缆、光纤、数字用户线(digital subscriber line,DSL))或无线(例如红外、无线、微波等)方式向另一个网站站点、计算机、服务器或数据中心进行传输。该计算机可读存储介质可以是计算机能够存取的任何可用介质或者是包含一个或多个可用介质集成的服务器、数据中心等数据存储设备。该可用介质可以是磁性介质(例如,软盘、硬盘、磁带)、光介质(例如数字视频光盘(digital video disc,DVD))、或者半导体介质(例如固态硬盘(solid state disk,SSD))等。
本领域普通技术人员可以意识到,结合本文中所公开的实施例描述的各示例的单元及算法步骤,能够以电子硬件、或者计算机软件和电子硬件的结合来实现。这些功能究竟以硬件还是软件方式来执行,取决于技术方案的特定应用和设计约束条件。专业技术人员可以对每个特定的应用来使用不同方法来实现所描述的功能,但是这种实现不应认为超出本申请的范围。
在本申请所提供的几个实施例中,应该理解到,所揭露的系统、装置和方法,可以通过其它的方式实现。例如,以上所描述的装置实施例仅仅是示意性的,例如,该单元的划分,仅仅为一种逻辑功能划分,实际实现时可以有另外的划分方式,例如多个单元或组件可以结合或者可以集成到另一个系统,或一些特征可以忽略,或不执行。另一点,所显示或讨论的相互之间的耦合或直接耦合或通信连接可以是通过一些接口,装置或单元的间接耦合或通信连接,可以是电性,机械或其它的形式。
作为分离部件说明的单元可以是或者也可以不是物理上分开的,作为单元显示的部件可以是或者也可以不是物理单元,即可以位于一个地方,或者也可以分布到多个网络单元上。可以根据实际的需要选择其中的部分或者全部单元来实现本实施例方案的目的。例如,在本申请各个实施例中的各功能单元可以集成在一个处理单元中,也可以是各个单元单独物理存在,也可以两个或两个以上单元集成在一个单元中。
以上该,仅为本申请的具体实施方式,但本申请的保护范围并不局限于此,任何熟悉本技术领域的技术人员在本申请揭露的技术范围内,可轻易想到变化或替换,都应涵盖在本申请的保护范围之内。因此,本申请的保护范围应以该权利要求的保护范围为准。

Claims (111)

  1. 一种图像处理方法,用于视频编码器,其特征在于,包括:
    获取待编码图像的部分或完整的重建图像,其中,所述部分或完整的重建图像包括一个或多个重建图像块;
    确定所述重建图像块的待滤波边界;
    根据所述待滤波边界两侧相邻的第一图像块和第二图像块的编码信息,确定所述待滤波边界的边界滤波强度;
    在所述边界滤波强度大于第一预设值时,根据所述待滤波边界两侧的像素点的像素值,确定所述待滤波边界的联合渐进特征;
    根据所述待滤波边界的联合渐进特征,确定是否对所述待滤波边界进行滤波。
  2. 根据权利要求1所述的方法,其特征在于,所述根据所述待滤波边界两侧的像素点的像素值,确定所述待滤波边界的联合渐进特征,包括:
    根据所述待滤波边界两侧的像素点中的中间像素点的像素值与两端像素点的像素值的差值,确定所述待滤波边界的联合渐进特征,其中,所述中间像素点为与所述待滤波边界相邻的像素点,所述两端像素点为与所述中间像素点相邻的像素点。
  3. 根据权利要求2所述的方法,其特征在于,所述根据所述待滤波边界两侧的像素点中的中间像素点的像素值与两端像素点的像素值的差值,确定所述待滤波边界的联合渐进特征,包括:
    若所述待滤波边界为垂直边界,则所述第一图像块和所述第二图像块构成的第一边界区域包括N行像素点,根据所述第一边界区域的第i行像素点的两端像素点的像素值与中间像素点的像素值的差值,确定所述第i行参数;将第一行参数至第N行参数中的至少一个确定为所述联合渐进特征,其中,所述N是正整数,所述i为大于或等于1且小于所述N的整数;
    若所述待滤波边界为水平边界,则所述第一图像块和所述第二图像块构成的第二边界区域包括M列像素点,根据所述第二边界区域的第j列像素点的两端像素点的像素值与中间像素点的像素值的差值,确定所述第j列参数;将第一列参数至第N列参数中的至少一个确定为所述联合渐进特征,其中,所述M是正整数,所述j为大于或等于1且小于所述M的整数。
  4. 根据权利要求3所述的方法,其特征在于,所述第i行像素点的中间像素点包括:所述第i行像素点中,所述待滤波边界左侧与所述待滤波边界相邻的第一个左侧像素点和与所述第一个左侧像素点相邻的第二个左侧像素点,以及所述待滤波边界右侧与所述待滤波边界相邻的第一个右侧像素点和与所述第一个右侧像素点相邻的第二个右侧像素点;
    所述第i行像素点的两端像素点包括:所述第i行像素点中与所述第二个左侧像素点相邻的第三个左侧像素点和与所述第二个右侧像素点相邻的第三个右侧像素点。
  5. 根据权利要求4所述的方法,其特征在于,所述根据所述第一边界区域的第i行像素点的两端像素点的像素值与中间像素点的像素值的差值,确定所述第i行参数,包括:
    根据所述第i行像素点中所述第三个左侧像素点的像素值分别与所述第一个左侧像素点的像素值和所述第二个左侧像素点的像素值的差值,以及所述第三个右侧像素点的像素值分别与所述第一个右侧像素点的像素值和所述第二个右侧像素点的像素值的差值,确定所述第i行参数。
  6. 根据权利要求5所述的方法,其特征在于,所述根据所述第i行像素点的所述第三个左侧像素点的像素值分别与所述第一个左侧像素点的像素值和所述第二个左侧像素点的像素值的差值,以及所述第三个右侧像素点的像素值分别与所述第一个右侧像素点的像素值和所述第二个右侧像素点的像素值的差值,确定所述第i行参数,包括:
    根据如下公式确定所述第i行参数:
    dpq i=|2p 2,i-p 1,i-p 0,i+2q 2,i-q 1,i-q 0,i|,
    其中,所述dpq i为所述第i行参数,所述p 0,i为所述第i行像素点中的第一个左侧像素点,所述p 1,i为所述第i行像素点中的第二个左侧像素点,所述p 2,i为所述第i行像素点中的第三个左侧像素点,所述q 0,i为所述第i行像素点中的第一个右侧像素点,所述q 1,i为所述第i行像素点中的第二个右侧像素点,所述q 2,i为所述第i行像素点中的第三个右侧像素点。
  7. 根据权利要求3所述的方法,其特征在于,所述第j列像素点的中间像素点包括:所述第j列像素点中,所述待滤波边界上方与所述待滤波边界相邻的第一个上方像素点和与所述第一个上方像素点相邻的第二个上方像素点,以及所述待滤波边界下方与所述待滤波边界相邻的第一个下方像素点和与所述第一个下方像素点相邻的第二个下方像素点;
    所述第j列像素点的两端像素点包括:所述第j列像素点中与所述第二个上方像素点相邻的第三个上方像素点和与所述第二个下方像素点相邻的第三个下方像素点。
  8. 根据权利要求7所述的方法,其特征在于,所述根据所述第二边界区域的第j列像素点的两端像素点的像素值与中间像素点的像素值的差值,确定所述第j列参数,包括:
    根据所述第j列像素点中所述第三个上方像素点的像素值分别与所述第一个上方像素点的像素值和所述第二个上方像素点的像素值的差值,以及所述第三个下方像素点的像素值分别与所述第一个下方像素点的像素值和所述第二个下方像素点的像素值的差值,确定所述第j列参数。
  9. 根据权利要求8所述的方法,其特征在于,所述根据所述第j列像素点中所述第三个上方像素点的像素值分别与所述第一个上方像素点的像素值和所述第二个上方像素点的像素值的差值,以及所述第三个下方像素点的像素值分别与所述第一个下方像素点的像素值和所述第二个下方像素点的像素值的差值,确定所述第j列参数,包括:
    根据如下公式确定所述第j列参数:
    dpq j=|2p 2,j-p 1,j-p 0,j+2q 2,j-q 1,j-q 0,j|,
    其中,所述dpq j为所述第j列参数,所述p 0,j为所述第j列像素点中的第一个上方像素点,所述p 1,j为所述第j列像素点中的第二个上方像素点,所述p 2,j为所述第j列像素点中的第三个上方像素点,所述q 0,j为所述第j列像素点中的第一个下方像素点,所述q 1,j为所述第j列像素点中的第二个下方像素点,所述q 2,j为所述第j列像素点中的第三个下方像素点。
  10. 根据权利要求3-6任一项所述的方法,其特征在于,若所述待滤波边界的联合渐进特征包括所述第一行参数至所述第N行参数中的至少两个参数,则所述根据所述待滤波边界的联合渐进特征,确定是否对所述待滤波边界进行滤波,包括:
    在所述第一行参数至所述第N行参数中的至少两个参数大于或等于第二预设值时,确定对所述待滤波边界不进行滤波。
  11. 根据权利要求3-6任一项所述的方法,其特征在于,若所述待滤波边界的联合渐进特征包括所述第一行参数至所述第N行参数中的至少两个参数,则所述根据所述待滤波边界的联合渐进特征,确定是否对所述待滤波边界进行滤波,包括:
    在所述第一行参数至所述第N行参数中任意两个参数之和大于或等于第四预设值时,确定对所述待滤波边界不进行滤波。
  12. 根据权利要求3-6任一项所述的方法,其特征在于,所述根据所述待滤波边界的联合渐进特征,确定是否对所述待滤波边界进行滤波,包括:
    根据所述待滤波边界两侧的像素点的像素值,确定所述待滤波边界两侧的像素点的像素值的变换率;
    根据所述变换率、以及所述第一行参数至所述第N行参数中的至少一个参数,确定是否对所述待滤波边界进行滤 波。
  13. 根据权利要求12所述的方法,其特征在于,所述根据所述变换率、以及所述第一行参数至所述第N行参数中的至少一个参数,确定是否对所述待滤波边界进行滤波,包括:
    在所述变换率小于第三预设值,且所述第一行参数至所述第N行参数中的至少一个参数小于第五预设值时,确定对所述待滤波边界进行滤波。
  14. 根据权利要求12所述的方法,其特征在于,若所述待滤波边界的联合渐进特征包括所述第一行参数至所述第N行参数中的至少两个参数,则所述根据所述变换率、以及所述第一行参数至所述第N行参数中的至少一个参数,确定是否对所述待滤波边界进行滤波,包括:
    在所述变换率大于或等于第三预设值,和/或所述第一行参数至所述第N行参数中的至少两个参数大于或等于第六预设值时,确定对所述待滤波边界不进行滤波。
  15. 根据权利要求12所述的方法,其特征在于,若所述待滤波边界的联合渐进特征包括所述第一行参数至所述第N行参数中的至少两个参数,则所述根据所述变换率、以及所述第一行参数至所述第N行参数中的至少一个参数,确定是否对所述待滤波边界进行滤波,包括:
    在所述变换率小于第三预设值,且所述第一行参数至所述第N行参数中任意两个参数之和小于第七预设值时,确定对所述待滤波边界进行滤波。
  16. 根据权利要求12所述的方法,其特征在于,若所述待滤波边界的联合渐进特征包括所述第一行参数至所述第N行参数中的至少两个参数,则所述根据所述变换率,和/或所述第一行参数至所述第N行参数中的至少一个参数,确定是否对所述待滤波边界进行滤波,包括:
    在所述变换率大于或等于第三预设值,和/或所述第一行参数至所述第N行参数中任意两个参数之和大于或等于第八预设值时,确定对所述待滤波边界不进行滤波。
  17. 根据权利要求3-6任一项所述的方法,其特征在于,所述N等于4,所述联合渐进特征包括:第一行参数和第四行参数,所述根据所述待滤波边界两侧的像素点中的中间像素点的像素值与两端像素点的像素值的差值,确定所述待滤波边界的联合渐进特征,包括:
    根据所述第一边界区域的第一行像素点的两端像素点的像素值与中间像素点的像素值的差值,确定所述第一行参数;
    根据所述第一边界区域的第四行像素点的两端像素点的像素值与中间像素点的像素值的差值,确定所述第四行参数。
  18. 根据权利要求17所述的方法,其特征在于,所述第一行像素点的中间像素点包括:所述第一行像素点中,所述待滤波边界左侧与所述待滤波边界相邻的第一个左侧像素点和与所述第一个左侧像素点相邻的第二个左侧像素点,以及所述待滤波边界右侧与所述待滤波边界相邻的第一个右侧像素点和与所述第一个右侧像素点相邻的第二个右侧像素点;所述第一行像素点的两端像素点包括:所述第一行像素点中与所述第二个左侧像素点相邻的第三个左侧像素点和与所述第二个右侧像素点相邻的第三个右侧像素点;
    所述第四行像素点的中间像素点包括:所述第四行像素点中,所述待滤波边界左侧与所述待滤波边界相邻的第一个左侧像素点和与所述第一个左侧像素点相邻的第二个左侧像素点,以及所述待滤波边界右侧与所述待滤波边界相邻的第一个右侧像素点和与所述第一个右侧像素点相邻的第二个右侧像素点;所述第四行像素点的两端像素点包括:所述第四行像素点中与所述第二个左侧像素点相邻的第三个左侧像素点和与所述第二个右侧像素点相邻的第三个右侧像素点。
  19. 根据权利要求18所述的方法,其特征在于,所述根据所述第一边界区域的第一行像素点的两端像素点的像素值与中间像素点的像素值的差值,确定所述第一行参数,包括:
    根据所述第一行像素点中所述第三个左侧像素点的像素值分别与所述第一个左侧像素点的像素值和所述第二个左侧像素点的像素值的差值,以及所述第三个右侧像素点的像素值分别与所述第一个右侧像素点的像素值和所述第二个右侧像素点的像素值的差值,确定所述第一行参数。
  20. 根据权利要求19所述的方法,其特征在于,所述根据所述第一行像素点中所述第三个左侧像素点的像素值分别与所述第一个左侧像素点的像素值和所述第二个左侧像素点的像素值的差值,以及所述第三个右侧像素点的像素值分别与所述第一个右侧像素点的像素值和所述第二个右侧像素点的像素值的差值,确定所述第一行参数,包括:
    根据如下公式确定所述第一行参数:
    dpq 0=|2p 2,0-p 1,0-p 0,0+2q 2,0-q 1,0-q 0,0|,
    其中,所述dpq 0为所述第一行参数,所述p 0,0为所述第一行像素点中的第一个左侧像素点,所述p 1,0为所述第一行像素点中的第二个左侧像素点,所述p 2,0为所述第一行像素点中的第三个左侧像素点,所述q 0,0为所述第一行像素点中的第一个右侧像素点,所述q 1,0为所述第一行像素点中的第二个右侧像素点,所述q 2,0为所述第一行像素点中的第三个右侧像素点。
  21. 根据权利要求18所述的方法,其特征在于,所述根据所述第一边界区域的第四行像素点的两端像素点的像素值与中间像素点的像素值的差值,确定所述第四行参数,包括:
    根据所述第四行像素点中所述第三个左侧像素点的像素值分别与所述第一个左侧像素点的像素值和所述第二个左侧像素点的像素值的差值,以及所述第三个右侧像素点的像素值分别与所述第一个右侧像素点的像素值和所述第二个右侧像素点的像素值的差值,确定所述第四行参数。
  22. 根据权利要求21所述的方法,其特征在于,所述根据所述第四行像素点中所述第三个左侧像素点的像素值分别与所述第一个左侧像素点的像素值和所述第二个左侧像素点的像素值的差值,以及所述第三个右侧像素点的像素值分别与所述第一个右侧像素点的像素值和所述第二个右侧像素点的像素值的差值,确定所述第四行参数,包括:
    根据如下公式确定所述第四行参数:
    dpq 3=|2p 2,3-p 1,3-p 0,3+2q 2,3-q 1,3-q 0,3|,
    其中,所述dpq 3为所述第四行参数,所述p 0,3为所述第四行像素点中的第一个左侧像素点,所述p 1,3为所述第四行像素点中的第二个左侧像素点,所述p 2,3为所述第四行像素点中的第三个左侧像素点,所述q 0,3为所述第四行像素点中的第一个右侧像素点,所述q 1,3为所述第四行像素点中的第二个右侧像素点,所述q 2,3为所述第四行像素点中的第三个右侧像素点。
  23. 根据权利要求17所述的方法,其特征在于,所述根据所述待滤波边界的联合渐进特征,确定是否对所述待滤波边界进行滤波,包括:
    在所述第一行参数和所述第四行参数均大于或等于第二预设值,确定对所述待滤波边界不进行滤波。
  24. 根据权利要求17所述的方法,其特征在于,所述根据所述待滤波边界的联合渐进特征,确定是否对所述待滤波边界进行滤波,包括:
    在所述第一行参数和所述第四行参数之和大于或等于第四预设值,确定对所述待滤波边界不进行滤波。
  25. 根据权利要求17所述的方法,其特征在于,所述根据所述待滤波边界的联合渐进特征,确定是否对所述待滤波边界进行滤波,包括:
    根据所述待滤波边界两侧的像素点的像素值,确定所述待滤波边界两侧的像素点的像素值的变换率;
    根据所述变换率、以及所述第一行参数和所述第四行参数中的至少一个参数,确定是否对所述待滤波边界进行滤波。
  26. 根据权利要求25所述的方法,其特征在于,所述根据所述变换率、以及所述第一行参数和所述第四行参数中的至少一个参数,确定是否对所述待滤波边界进行滤波,包括:
    在所述变换率小于第三预设值,且所述第一行参数和/或所述第四行参数小于第五预设值时,确定对所述待滤波边界进行滤波。
  27. 根据权利要求25所述的方法,其特征在于,所述根据所述变换率、以及所述第一行参数和所述第四行参数中的至少一个参数,确定是否对所述待滤波边界进行滤波,包括:
    在所述变换率小于第三预设值,且所述第一行参数与所述第四行参数均大于或等于第六预设值时,确定对所述待滤波边界进行滤波。
  28. 根据权利要求25所述的方法,其特征在于,所述根据所述变换率、以及所述第一行参数和所述第四行参数中的至少一个参数,确定是否对所述待滤波边界进行滤波,包括:
    在所述变换率小于第三预设值,且所述第一行参数与所述第四行参数之和小于第七预设值时,确定对所述待滤波边界进行滤波。
  29. 根据权利要求25所述的方法,其特征在于,所述根据所述变换率、以及所述第一行参数和所述第四行参数中的至少一个参数,确定是否对所述待滤波边界进行滤波,包括:
    在所述变换率小于第三预设值,且所述第一行参数与所述第四行参数之和大于或等于第八预设值时,确定对所述待滤波边界进行滤波。
  30. 根据权利要求3、7-9任一项所述的方法,其特征在于,若所述待滤波边界的联合渐进特征包括所述第一列参数至所述第M列参数中的至少两个参数,则所述根据所述待滤波边界的联合渐进特征,确定是否对所述待滤波边界进行滤波,包括:
    在所述第一列参数至所述第M列参数中的至少两个参数大于或等于第二预设值时,确定对所述待滤波边界不进行滤波。
  31. 根据权利要求3、7-9任一项所述的方法,其特征在于,若所述待滤波边界的联合渐进特征包括所述第一列参数至所述第M列参数中的至少两个参数,则所述根据所述待滤波边界的联合渐进特征,确定是否对所述待滤波边界进行滤波,包括:
    在所述第一列参数至所述第M列参数中任意两个参数之和大于或等于第四预设值时,确定对所述待滤波边界不进行滤波。
  32. 根据权利要求3、7-9任一项所述的方法,其特征在于,所述根据所述待滤波边界的联合渐进特征,确定是否对所述待滤波边界进行滤波,包括:
    根据所述待滤波边界两侧的像素点的像素值,确定所述待滤波边界两侧的像素点的像素值的变换率;
    根据所述变换率、以及所述第一列参数至所述第M列参数中的至少一个参数,确定是否对所述待滤波边界进行滤波。
  33. 根据权利要求32所述的方法,其特征在于,所述根据所述变换率、以及所述第一列参数至所述第M列参数中的至少一个参数,确定是否对所述待滤波边界进行滤波,包括:
    在所述变换率小于第三预设值,且所述第一列参数至所述第M列参数中的至少一个参数小于第五预设值时,确定对所述待滤波边界进行滤波。
  34. 根据权利要求32所述的方法,其特征在于,若所述待滤波边界的联合渐进特征包括所述第一列参数至所述第M列参数中的至少两个参数,则所述根据所述变换率、以及所述第一列参数至所述第M列参数中的至少一个参数,确定是否对所述待滤波边界进行滤波,包括:
    在所述变换率大于或等于第三预设值,和/或所述第一列参数至所述第M列参数中的至少两个参数大于或等于第六二预设值时,确定对所述待滤波边界不进行滤波。
  35. 根据权利要求32所述的方法,其特征在于,若所述待滤波边界的联合渐进特征包括所述第一列参数至所述第M列参数中的至少两个参数,则所述根据所述变换率、以及所述第一列参数至所述第M列参数中的至少一个参数,确定是否对所述待滤波边界进行滤波,包括:
    在所述变换率小于第三预设值,且所述第一列参数至所述第M列参数中任意两个参数之和小于第七预设值时,确定对所述待滤波边界进行滤波。
  36. 根据权利要求32所述的方法,其特征在于,若所述待滤波边界的联合渐进特征包括所述第一列参数至所述第M列参数中的至少两个参数,则所述根据所述变换率、以及所述第一列参数至所述第M列参数中的至少一个参数,确定是否对所述待滤波边界进行滤波,包括:
    在所述变换率大于或等于第三预设值,和/或所述第一列参数至所述第M列参数中任意两个参数之和大于或等于第八预设值时,确定对所述待滤波边界不进行滤波。
  37. 根据权利要求3、7-9任一项所述的方法,其特征在于,M等于4,所述联合渐进特征包括:第一列参数和第四列参数,所述根据所述待滤波边界两侧的像素点中的中间像素点的像素值与两端像素点的像素值的差值,确定所述待滤波边界的联合渐进特征,包括:
    根据所述第二边界区域的第一列像素点的两端像素点的像素值与中间像素点的像素值的差值,确定所述第一列参数;
    根据所述第二边界区域的第四列像素点的两端像素点的像素值与中间像素点的像素值的差值,确定所述第四列参数。
  38. 根据权利要求37所述的方法,其特征在于,所述第一列像素点的中间像素点包括:所述第一列像素点中,所述待滤波边界上方与所述待滤波边界相邻的第一个上方像素点和与所述第一个上方像素点相邻的第二个上方像素点,以及所述待滤波边界下方与所述待滤波边界相邻的第一个下方像素点和与所述第一个下方像素点相邻的第二个下方像素点;所述第一列像素点的两端像素点包括:所述第一列像素点中与所述第二个上方像素点相邻的第三个上方像素点和与所述第二个下方像素点相邻的第三个下方像素点;
    所述第四列像素点的中间像素点包括:所述第四列像素点中,所述待滤波边界上方与所述待滤波边界相邻的第一个上方像素点和与所述第一个上方像素点相邻的第二个上方像素点,以及所述待滤波边界下方与所述待滤波边界相邻的第一个下方像素点和与所述第一个下方像素点相邻的第二个下方像素点;所述第四列像素点的两端像素点包括:所述第四列像素点中与所述第二个上方像素点相邻的第三个上方像素点和与所述第二个下方像素点相邻的第三个下方像素点。
  39. 根据权利要求38所述的方法,其特征在于,所述根据所述第二边界区域的第一列像素点的两端像素点的像素值与中间像素点的像素值的差值,确定所述第一列参数,包括:
    根据所述第一列像素点中所述第三个上方像素点的像素值分别与所述第一个上方像素点的像素值和所述第二个上方像素点的像素值的差值,以及所述第三个下方像素点的像素值分别与所述第一个下方像素点的像素值和所述第二个下方像素点的像素值的差值,确定所述第一列参数。
  40. 根据权利要求39所述的方法,其特征在于,所述根据所述第一列像素点中所述第三个上方像素点的像素值分别与所述第一个上方像素点的像素值和所述第二个上方像素点的像素值的差值,以及所述第三个下方像素点的像素值分别与所述第一个下方像素点的像素值和所述第二个下方像素点的像素值的差值,确定所述第一列参数,包括:
    根据如下公式确定所述第一列参数:
    dpq 0=|2p 2,0-p 1,0-p 0,0+2q 2,0-q 1,0-q 0,0|,
    其中,所述dpq 0为所述第一列参数,所述p 0,0为所述第一列像素点中的第一个上方像素点,所述p 1,0为所述第一列像素点中的第二个上方像素点,所述p 2,0为所述第一列像素点中的第三个上方像素点,所述q 0,0为所述第一列像素点 中的第一个下方像素点,所述q 1,0为所述第一列像素点中的第二个下方像素点,所述q 2,0为所述第一列像素点中的第三个下方像素点。
  41. 根据权利要求38所述的方法,其特征在于,所述根据所述第二边界区域的第四列像素点的两端像素点的像素值与中间像素点的像素值的差值,确定所述第四列参数,包括:
    根据所述第四列像素点中所述第三个上方像素点的像素值分别与所述第一个上方像素点的像素值和所述第二个上方像素点的像素值的差值,以及所述第三个下方像素点的像素值分别与所述第一个下方像素点的像素值和所述第二个下方像素点的像素值的差值,确定所述第四列参数。
  42. 根据权利要求41所述的方法,其特征在于,所述根据所述第四列像素点中所述第三个上方像素点的像素值分别与所述第一个上方像素点的像素值和所述第二个上方像素点的像素值的差值,以及所述第三个下方像素点的像素值分别与所述第一个下方像素点的像素值和所述第二个下方像素点的像素值的差值,确定所述第四列参数,包括:
    根据如下公式确定所述第四列参数:
    dpq 3=|2p 2,3-p 1,3-p 0,3+2q 2,3-q 1,3-q 0,3|,
    其中,所述dpq 3为所述第四列参数,所述p 0,3为所述第四列像素点中的第一个上方像素点,所述p 1,3为所述第四列像素点中的第二个上方像素点,所述p 2,3为所述第四列像素点中的第三个上方像素点,所述q 0,3为所述第四列像素点中的第一个下方像素点,所述q 1,3为所述第四列像素点中的第二个下方像素点,所述q 2,3为所述第四列像素点中的第三个下方像素点。
  43. 根据权利要求37所述的方法,其特征在于,所述根据所述待滤波边界的联合渐进特征,确定是否对所述待滤波边界进行滤波,包括:
    在所述第一列参数和所述第四列参数均大于或等于第二预设值,确定对所述待滤波边界不进行滤波。
  44. 根据权利要求37所述的方法,其特征在于,所述根据所述待滤波边界的联合渐进特征,确定是否对所述待滤波边界进行滤波,包括:
    在所述第一列参数和所述第四列参数之和大于或等于第四预设值,确定对所述待滤波边界不进行滤波。
  45. 根据权利要求37所述的方法,其特征在于,所述根据所述待滤波边界的联合渐进特征,确定是否对所述待滤波边界进行滤波,包括:
    根据所述待滤波边界两侧的像素点的像素值,确定所述待滤波边界两侧的像素点的像素值的变换率;
    根据所述变换率、以及所述第一列参数和所述第四列参数中的至少一个参数,确定是否对所述待滤波边界进行滤波。
  46. 根据权利要求45所述的方法,其特征在于,所述根据所述变换率、以及所述第一列参数和所述第四列参数中的至少一个参数,确定是否对所述待滤波边界进行滤波,包括:
    在所述变换率小于第三预设值,且所述第一列参数和/或所述第四列参数小于第五预设值时,确定对所述待滤波边界进行滤波。
  47. 根据权利要求45所述的方法,其特征在于,所述根据所述变换率、以及所述第一列参数和所述第四列参数中的至少一个参数,确定是否对所述待滤波边界进行滤波,包括:
    在所述变换率小于第三预设值,且所述第一列参数与所述第四列参数均大于或等于第六预设值时,确定对所述待滤波边界进行滤波。
  48. 根据权利要求45所述的方法,其特征在于,所述根据所述变换率、以及所述第一列参数和所述第四列参数中的至少一个参数,确定是否对所述待滤波边界进行滤波,包括:
    在所述变换率小于第三预设值,且所述第一列参数与所述第四列参数之和小于第七预设值时,确定对所述待滤波边界进行滤波。
  49. 根据权利要求45所述的方法,其特征在于,所述根据所述变换率、以及所述第一列参数和所述第四列参数中的至少一个参数,确定是否对所述待滤波边界进行滤波,包括:
    在所述变换率小于第三预设值,且所述第一列参数与所述第四列参数之和大于或等于第八预设值时,确定对所述待滤波边界进行滤波。
  50. 根据权利要求10所述的方法,其特征在于,所述第二预设值大于0.5小于1。
  51. 根据权利要求50所述的方法,其特征在于,所述第二预设值大于0.5小于0.8。
  52. 根据权利要求10所述的方法,其特征在于,所述第二预设值等于二分之一的第三预设值。
  53. 根据权利要求10所述的方法,其特征在于,所述方法还包括:
    根据量化参数QP确定所述第二预设值。
  54. 根据权利要求1所述的方法,其特征在于,所述第一预设值为0。
  55. 一种图像处理方法,用于解码器,其特征在于,包括:
    解码码流,得到部分或完整的重建图像,其中,所述部分或完整的重建图像包括一个或多个重建图像块;
    确定所述重建图像块的待滤波边界;
    根据所述待滤波边界两侧相邻的第一图像块和第二图像块,确定所述待滤波边界的边界滤波强度;
    在所述边界滤波强度大于第一预设值时,根据所述待滤波边界两侧的像素点的像素值,确定所述待滤波边界的联合渐进特征;
    根据所述待滤波边界的联合渐进特征,确定是否对所述待滤波边界进行滤波。
  56. 根据权利要求55所述的方法,其特征在于,包括:所述根据所述待滤波边界两侧的像素点的像素值,确定所述待滤波边界的联合渐进特征,包括:
    根据所述待滤波边界两侧的像素点中的中间像素点的像素值与两端像素点的像素值的差值,确定所述待滤波边界的联合渐进特征,其中,所述中间像素点为与所述待滤波边界相邻的像素点,所述两端像素点为与所述中间像素点相邻的像素点。
  57. 根据权利要求56所述的方法,其特征在于,所述根据所述待滤波边界两侧的像素点中的中间像素点的像素值与两端像素点的像素值的差值,确定所述待滤波边界的联合渐进特征,包括:
    若所述待滤波边界为垂直边界,则所述第一图像块和所述第二图像块构成的第一边界区域包括N行像素点,根据所述第一边界区域的第i行像素点的两端像素点的像素值与中间像素点的像素值的差值,确定所述第i行参数;将第一行参数至第N行参数中的至少一个确定为所述联合渐进特征,其中,所述N是正整数,所述i为大于或等于1且小于所述N的整数;
    若所述待滤波边界为水平边界,则所述第一图像块和所述第二图像块构成的第二边界区域包括M列像素点,使用所述第二边界区域的第j列像素点的像素值确定第j列参数,根据所述第二边界区域的第j列像素点的两端像素点的像素值与中间像素点的像素值的差值,确定所述第j列参数;将第一列参数至第N列参数中的至少一个确定为所述联合渐进特征,其中,所述M是正整数,所述j为大于或等于1且小于所述M的整数。
  58. 根据权利要求57所述的方法,其特征在于,所述第i行像素点的中间像素点包括:所述第i行像素点中,所述待滤波边界左侧与所述待滤波边界相邻的第一个左侧像素点和与所述第一个左侧像素点相邻的第二个左侧像素点,以及所述待滤波边界右侧与所述待滤波边界相邻的第一个右侧像素点和与所述第一个右侧像素点相邻的第二个右侧像素点;
    所述第i行像素点的两端像素点包括:所述第i行像素点中与所述第二个左侧像素点相邻的第三个左侧像素点和与所述第二个右侧像素点相邻的第三个右侧像素点。
  59. 根据权利要求58所述的方法,其特征在于,所述根据所述第一边界区域的第i行像素点的两端像素点的像素值与中间像素点的像素值的差值,确定所述第i行参数,包括:
    根据所述第i行像素点中所述第三个左侧像素点的像素值分别与所述第一个左侧像素点的像素值和所述第二个左侧像素点的像素值的差值,以及所述第三个右侧像素点的像素值分别与所述第一个右侧像素点的像素值和所述第二个右侧像素点的像素值的差值,确定所述第i行参数。
  60. 根据权利要求59所述的方法,其特征在于,所述根据所述第i行像素点的所述第三个左侧像素点的像素值分别与所述第一个左侧像素点的像素值和所述第二个左侧像素点的像素值的差值,以及所述第三个右侧像素点的像素值分别与所述第一个右侧像素点的像素值和所述第二个右侧像素点的像素值的差值,确定所述第i行参数,包括:
    根据如下公式确定所述第i行参数:
    dpq i=|2p 2,i-p 1,i-p 0,i+2q 2,i-q 1,i-q 0,i|,
    其中,所述dpq i为所述第i行参数,所述p 0,i为所述第i行像素点中的第一个左侧像素点,所述p 1,i为所述第i行像素点中的第二个左侧像素点,所述p 2,i为所述第i行像素点中的第三个左侧像素点,所述q 0,i为所述第i行像素点中的第一个右侧像素点,所述q 1,i为所述第i行像素点中的第二个右侧像素点,所述q 2,i为所述第i行像素点中的第三个右侧像素点。
  61. 根据权利要求58所述的方法,其特征在于,所述第j列像素点的中间像素点包括:所述第j列像素点中,所述待滤波边界上方与所述待滤波边界相邻的第一个上方像素点和与所述第一个上方像素点相邻的第二个上方像素点,以及所述待滤波边界下方与所述待滤波边界相邻的第一个下方像素点和与所述第一个下方像素点相邻的第二个下方像素点;
    所述第j列像素点的两端像素点包括:所述第j列像素点中与所述第二个上方像素点相邻的第三个上方像素点和与所述第二个下方像素点相邻的第三个下方像素点。
  62. 根据权利要求61所述的方法,其特征在于,所述根据所述第二边界区域的第j列像素点的两端像素点的像素值与中间像素点的像素值的差值,确定所述第j列参数,包括:
    根据所述第j列像素点中所述第三个上方像素点的像素值分别与所述第一个上方像素点的像素值和所述第二个上方像素点的像素值的差值,以及所述第三个下方像素点的像素值分别与所述第一个下方像素点的像素值和所述第二个下方像素点的像素值的差值,确定所述第j列参数。
  63. 根据权利要求62所述的方法,其特征在于,所述根据所述第j列像素点中所述第三个上方像素点的像素值分别与所述第一个上方像素点的像素值和所述第二个上方像素点的像素值的差值,以及所述第三个下方像素点的像素值分别与所述第一个下方像素点的像素值和所述第二个下方像素点的像素值的差值,确定所述第j列参数,包括:
    根据如下公式确定所述第j列参数:
    dpq j=|2p 2,j-p 1,j-p 0,j+2q 2,j-q 1,j-q 0,j|,
    其中,所述dpq j为所述第j列参数,所述p 0,j为所述第j列像素点中的第一个上方像素点,所述p 1,j为所述第j列像素点中的第二个上方像素点,所述p 2,j为所述第j列像素点中的第三个上方像素点,所述q 0,j为所述第j列像素点中的第一个下方像素点,所述q 1,j为所述第j列像素点中的第二个下方像素点,所述q 2,j为所述第j列像素点中的第三个下方像素点。
  64. 根据权利要求57-60任一项所述的方法,其特征在于,若所述待滤波边界的联合渐进特征包括所述第一行参数至所述第N行参数中的至少两个参数,所述根据所述待滤波边界的联合渐进特征,确定是否对所述待滤波边界进行滤波,包括:
    在所述第一行参数至所述第N行参数中的至少两个参数大于或等于第二预设值时,确定对所述待滤波边界不进行滤波。
  65. 根据权利要求57-60任一项所述的方法,其特征在于,若所述待滤波边界的联合渐进特征包括所述第一行参数至所述第N行参数中的至少两个参数,所述根据所述待滤波边界的联合渐进特征,确定是否对所述待滤波边界进行滤波,包括:
    在所述第一行参数至所述第N行参数中任意两个参数之和大于或等于第四预设值时,确定对所述待滤波边界不进行滤波。
  66. 根据权利要求57-60任一项述的方法,其特征在于,所述根据所述待滤波边界的联合渐进特征,确定是否对所述待滤波边界进行滤波,包括:
    根据所述待滤波边界两侧的像素点的像素值,确定所述待滤波边界两侧的像素点的像素值的变换率;
    根据所述变换率、以及所述第一行参数至所述第N行参数中的至少一个参数,确定是否对所述待滤波边界进行滤波。
  67. 根据权利要求66所述的方法,其特征在于,所述根据所述变换率、以及所述第一行参数至所述第N行参数中的至少一个参数,确定是否对所述待滤波边界进行滤波,包括:
    在所述变换率小于第三预设值,且所述第一行参数至所述第N行参数中的至少一个参数小于第五预设值时,确定对所述待滤波边界进行滤波。
  68. 根据权利要求66所述的方法,其特征在于,若所述待滤波边界的联合渐进特征包括所述第一行参数至所述第N行参数中的至少两个参数,所述根据所述变换率、以及所述第一行参数至所述第N行参数中的至少一个参数,确定是否对所述待滤波边界进行滤波,包括:
    在所述变换率大于或等于第三预设值,和/或所述第一行参数至所述第N行参数中的至少两个参数大于或等于第六预设值时,确定对所述待滤波边界不进行滤波。
  69. 根据权利要求66所述的方法,其特征在于,若所述待滤波边界的联合渐进特征包括所述第一行参数至所述第N行参数中的至少两个参数,所述根据所述变换率、以及所述第一行参数至所述第N行参数中的至少一个参数,确定是否对所述待滤波边界进行滤波,包括:
    在所述变换率小于第三预设值,且所述第一行参数至所述第N行参数中任意两个参数之和小于第七预设值时,确定对所述待滤波边界进行滤波。
  70. 根据权利要求66所述的方法,其特征在于,若所述待滤波边界的联合渐进特征包括所述第一行参数至所述第N行参数中的至少两个参数,所述根据所述变换率、以及所述第一行参数至所述第N行参数中的至少一个参数,确定是否对所述待滤波边界进行滤波,包括:
    在所述变换率大于或等于第三预设值,和/或所述第一行参数至所述第N行参数中任意两个参数之和大于或等于第八预设值时,确定对所述待滤波边界不进行滤波。
  71. 根据权利要求57-60任一项所述的方法,其特征在于,所述N等于4,所述联合渐进特征包括:第一行参数和第四行参数,所述根据所述待滤波边界两侧的像素点中的中间像素点的像素值与两端像素点的像素值的差值,确定所述待滤波边界的联合渐进特征,包括:
    根据所述第一边界区域的第一行像素点的两端像素点的像素值与中间像素点的像素值的差值,确定所述第一行参数;
    根据所述第一边界区域的第四行像素点的两端像素点的像素值与中间像素点的像素值的差值,确定所述第四行参数。
  72. 根据权利要求71所述的方法,其特征在于,所述第一行像素点的中间像素点包括:所述第一行像素点中,所述待滤波边界左侧与所述待滤波边界相邻的第一个左侧像素点和与所述第一个左侧像素点相邻的第二个左侧像素点,以及所述待滤波边界右侧与所述待滤波边界相邻的第一个右侧像素点和与所述第一个右侧像素点相邻的第二个右侧像 素点;所述第一行像素点的两端像素点包括:所述第一行像素点中与所述第二个左侧像素点相邻的第三个左侧像素点和与所述第二个右侧像素点相邻的第三个右侧像素点;
    所述第四行像素点的中间像素点包括:所述第四行像素点中,所述待滤波边界左侧与所述待滤波边界相邻的第一个左侧像素点和与所述第一个左侧像素点相邻的第二个左侧像素点,以及所述待滤波边界右侧与所述待滤波边界相邻的第一个右侧像素点和与所述第一个右侧像素点相邻的第二个右侧像素点;所述第四行像素点的两端像素点包括:所述第四行像素点中与所述第二个左侧像素点相邻的第三个左侧像素点和与所述第二个右侧像素点相邻的第三个右侧像素点。
  73. 根据权利要求72所述的方法,其特征在于,所述根据所述第一边界区域的第一行像素点的两端像素点的像素值与中间像素点的像素值的差值,确定所述第一行参数,包括:
    根据所述第一行像素点中所述第三个左侧像素点的像素值分别与所述第一个左侧像素点的像素值和所述第二个左侧像素点的像素值的差值,以及所述第三个右侧像素点的像素值分别与所述第一个右侧像素点的像素值和所述第二个右侧像素点的像素值的差值,确定所述第一行参数。
  74. 根据权利要求73所述的方法,其特征在于,所述根据所述第一行像素点中所述第三个左侧像素点的像素值分别与所述第一个左侧像素点的像素值和所述第二个左侧像素点的像素值的差值,以及所述第三个右侧像素点的像素值分别与所述第一个右侧像素点的像素值和所述第二个右侧像素点的像素值的差值,确定所述第一行参数,包括:
    根据如下公式确定所述第一行参数:
    dpq 0=|2p 2,0-p 1,0-p 0,0+2q 2,0-q 1,0-q 0,0|,
    其中,所述dpq 0为所述第一行参数,所述p 0,0为所述第一行像素点中的第一个左侧像素点,所述p 1,0为所述第一行像素点中的第二个左侧像素点,所述p 2,0为所述第一行像素点中的第三个左侧像素点,所述q 0,0为所述第一行像素点中的第一个右侧像素点,所述q 1,0为所述第一行像素点中的第二个右侧像素点,所述q 2,0为所述第一行像素点中的第三个右侧像素点。
  75. 根据权利要求72所述的方法,其特征在于,所述根据所述第一边界区域的第四行像素点的两端像素点的像素值与中间像素点的像素值的差值,确定所述第四行参数,包括:
    根据所述第四行像素点中所述第三个左侧像素点的像素值分别与所述第一个左侧像素点的像素值和所述第二个左侧像素点的像素值的差值,以及所述第三个右侧像素点的像素值分别与所述第一个右侧像素点的像素值和所述第二个右侧像素点的像素值的差值,确定所述第四行参数。
  76. 根据权利要求75所述的方法,其特征在于,所述根据所述第四行像素点中所述第三个左侧像素点的像素值分别与所述第一个左侧像素点的像素值和所述第二个左侧像素点的像素值的差值,以及所述第三个右侧像素点的像素值分别与所述第一个右侧像素点的像素值和所述第二个右侧像素点的像素值的差值,确定所述第四行参数,包括:
    根据如下公式确定所述第四行参数:
    dpq 3=|2p 2,3-p 1,3-p 0,3+2q 2,3-q 1,3-q 0,3|,
    其中,所述dpq 3为所述第四行参数,所述p 0,3为所述第四行像素点中的第一个左侧像素点,所述p 1,3为所述第四行像素点中的第二个左侧像素点,所述p 2,3为所述第四行像素点中的第三个左侧像素点,所述q 0,3为所述第四行像素点中的第一个右侧像素点,所述q 1,3为所述第四行像素点中的第二个右侧像素点,所述q 2,3为所述第四行像素点中的第三个右侧像素点。
  77. 根据权利要求71所述的方法,其特征在于,所述根据所述待滤波边界的联合渐进特征,确定是否对所述待滤波边界进行滤波,包括:
    在所述第一行参数和所述第四行参数均大于或等于第二预设值,确定对所述待滤波边界不进行滤波。
  78. 根据权利要求71所述的方法,其特征在于,所述根据所述待滤波边界的联合渐进特征,确定是否对所述待滤 波边界进行滤波,包括:
    在所述第一行参数和所述第四行参数之和大于或等于第四预设值,确定对所述待滤波边界不进行滤波。
  79. 根据权利要求71所述的方法,其特征在于,所述根据所述待滤波边界的联合渐进特征,确定是否对所述待滤波边界进行滤波,包括:
    根据所述待滤波边界两侧的像素点的像素值,确定所述待滤波边界两侧的像素点的像素值的变换率;
    根据所述变换率、以及所述第一行参数和所述第四行参数中的至少一个参数,确定是否对所述待滤波边界进行滤波。
  80. 根据权利要求79所述的方法,其特征在于,所述根据所述变换率、以及所述第一行参数和所述第四行参数中的至少一个参数,确定是否对所述待滤波边界进行滤波,包括:
    在所述变换率小于第三预设值,且所述第一行参数和/或所述第四行参数小于第五预设值时,确定对所述待滤波边界进行滤波。
  81. 根据权利要求79所述的方法,其特征在于,所述根据所述变换率、以及所述第一行参数和所述第四行参数中的至少一个参数,确定是否对所述待滤波边界进行滤波,包括:
    在所述变换率小于第三预设值,且所述第一行参数与所述第四行参数均大于或等于第六预设值时,确定对所述待滤波边界进行滤波。
  82. 根据权利要求79所述的方法,其特征在于,所述根据所述变换率、以及所述第一行参数和所述第四行参数中的至少一个参数,确定是否对所述待滤波边界进行滤波,包括:
    在所述变换率小于第三预设值,且所述第一行参数与所述第四行参数之和小于第七预设值时,确定对所述待滤波边界进行滤波。
  83. 根据权利要求79所述的方法,其特征在于,所述根据所述变换率、以及所述第一行参数和所述第四行参数中的至少一个参数,确定是否对所述待滤波边界进行滤波,包括:
    在所述变换率小于第三预设值,且所述第一行参数与所述第四行参数之和大于或等于第八预设值时,确定对所述待滤波边界进行滤波。
  84. 根据权利要求57、61-63任一项所述的方法,其特征在于,若所述待滤波边界的联合渐进特征包括所述第一列参数至所述第M列参数中的至少两个参数,则所述根据所述待滤波边界的联合渐进特征,确定是否对所述待滤波边界进行滤波,包括:
    在所述第一列参数至所述第M列参数中的至少两个参数大于或等于第二预设值时,确定对所述待滤波边界不进行滤波。
  85. 根据权利要求57、61-63任一项所述的方法,其特征在于,若所述待滤波边界的联合渐进特征包括所述第一列参数至所述第M列参数中的至少两个参数,则所述根据所述待滤波边界的联合渐进特征,确定是否对所述待滤波边界进行滤波,包括:
    在所述第一列参数至所述第M列参数中任意两个参数之和大于或等于第四预设值时,确定对所述待滤波边界不进行滤波。
  86. 根据权利要求57、61-63任一项述的方法,其特征在于,所述根据所述待滤波边界的联合渐进特征,确定是否对所述待滤波边界进行滤波,包括:
    根据所述待滤波边界两侧的像素点的像素值,确定所述待滤波边界两侧的像素点的像素值的变换率;
    根据所述变换率、以及所述第一列参数至所述第M列参数中的至少一个参数,确定是否对所述待滤波边界进行滤波。
  87. 根据权利要求86所述的方法,其特征在于,所述根据所述变换率、以及所述第一列参数至所述第M列参数中的至少一个参数,确定是否对所述待滤波边界进行滤波,包括:
    在所述变换率小于第三预设值,且所述第一列参数至所述第M列参数中的至少一个参数小于第五预设值时,确定对所述待滤波边界进行滤波。
  88. 根据权利要求86所述的方法,其特征在于,若所述待滤波边界的联合渐进特征包括所述第一列参数至所述第M列参数中的至少两个参数,所述根据所述变换率、以及所述第一列参数至所述第M列参数中的至少一个参数,确定是否对所述待滤波边界进行滤波,包括:
    在所述变换率大于或等于第三预设值,和/或所述第一列参数至所述第M列参数中的至少两个参数大于或等于第六预设值时,确定对所述待滤波边界不进行滤波。
  89. 根据权利要求86所述的方法,其特征在于,若所述待滤波边界的联合渐进特征包括所述第一列参数至所述第M列参数中的至少两个参数,所述根据所述变换率、以及所述第一列参数至所述第M列参数中的至少一个参数,确定是否对所述待滤波边界进行滤波,包括:
    在所述变换率小于第三预设值,且所述第一列参数至所述第M列参数中任意两个参数之和小于第七预设值时,确定对所述待滤波边界进行滤波。
  90. 根据权利要求86所述的方法,其特征在于,若所述待滤波边界的联合渐进特征包括所述第一列参数至所述第M列参数中的至少两个参数,所述根据所述变换率、以及所述第一列参数至所述第M列参数中的至少一个参数,确定是否对所述待滤波边界进行滤波,包括:
    在所述变换率大于或等于第三预设值,和/或所述第一列参数至所述第M列参数中任意两个参数之和大于或等于第八预设值时,确定对所述待滤波边界不进行滤波。
  91. 根据权利要求57、61-63任一项所述的方法,其特征在于,M等于4,所述联合渐进特征包括:所述第一列参数和第四列参数,所述根据所述待滤波边界两侧的像素点中的中间像素点的像素值与两端像素点的像素值的差值,确定所述待滤波边界的联合渐进特征,包括:
    根据所述第二边界区域的第一列像素点的两端像素点的像素值与中间像素点的像素值的差值,确定所述第一列参数;
    根据所述第二边界区域的第四列像素点的两端像素点的像素值与中间像素点的像素值的差值,确定所述第四列参数。
  92. 根据权利要求91所述的方法,其特征在于,所述第一列像素点的中间像素点包括:所述第一列像素点中,所述待滤波边界上方与所述待滤波边界相邻的第一个上方像素点和与所述第一个上方像素点相邻的第二个上方像素点,以及所述待滤波边界下方与所述待滤波边界相邻的第一个下方像素点和与所述第一个下方像素点相邻的第二个下方像素点;所述第一列像素点的两端像素点包括:所述第一列像素点中与所述第二个上方像素点相邻的第三个上方像素点和与所述第二个下方像素点相邻的第三个下方像素点;
    所述第四列像素点的中间像素点包括:所述第四列像素点中,所述待滤波边界上方与所述待滤波边界相邻的第一个上方像素点和与所述第一个上方像素点相邻的第二个上方像素点,以及所述待滤波边界下方与所述待滤波边界相邻的第一个下方像素点和与所述第一个下方像素点相邻的第二个下方像素点;所述第四列像素点的两端像素点包括:所述第四列像素点中与所述第二个上方像素点相邻的第三个上方像素点和与所述第二个下方像素点相邻的第三个下方像素点。
  93. 根据权利要求92所述的方法,其特征在于,所述根据所述第二边界区域的第一列像素点的两端像素点的像素值与中间像素点的像素值的差值,确定所述第一列参数,包括:
    根据所述第一列像素点中所述第三个上方像素点的像素值分别与所述第一个上方像素点的像素值和所述第二个上 方像素点的像素值的差值,以及所述第三个下方像素点的像素值分别与所述第一个下方像素点的像素值和所述第二个下方像素点的像素值的差值,确定所述第一列参数。
  94. 根据权利要求93所述的方法,其特征在于,所述根据所述第一列像素点中所述第三个上方像素点的像素值分别与所述第一个上方像素点的像素值和所述第二个上方像素点的像素值的差值,以及所述第三个下方像素点的像素值分别与所述第一个下方像素点的像素值和所述第二个下方像素点的像素值的差值,确定所述第一列参数,包括:
    根据如下公式确定所述第一列参数:
    dpq 0=|2p 2,0-p 1,0-p 0,0+2q 2,0-q 1,0-q 0,0|,
    其中,所述dpq 0为所述第一列参数,所述p 0,0为所述第一列像素点中的第一个上方像素点,所述p 1,0为所述第一列像素点中的第二个上方像素点,所述p 2,0为所述第一列像素点中的第三个上方像素点,所述q 0,0为所述第一列像素点中的第一个下方像素点,所述q 1,0为所述第一列像素点中的第二个下方像素点,所述q 2,0为所述第一列像素点中的第三个下方像素点。
  95. 根据权利要求92所述的方法,其特征在于,所述根据所述第二边界区域的第四列像素点的两端像素点的像素值与中间像素点的像素值的差值,确定所述第四列参数,包括:
    根据所述第四列像素点中所述第三个上方像素点的像素值分别与所述第一个上方像素点的像素值和所述第二个上方像素点的像素值的差值,以及所述第三个下方像素点的像素值分别与所述第一个下方像素点的像素值和所述第二个下方像素点的像素值的差值,确定所述第四列参数。
  96. 根据权利要求95所述的方法,其特征在于,所述根据所述第四列像素点中所述第三个上方像素点的像素值分别与所述第一个上方像素点的像素值和所述第二个上方像素点的像素值的差值,以及所述第三个下方像素点的像素值分别与所述第一个下方像素点的像素值和所述第二个下方像素点的像素值的差值,确定所述第四列参数,包括:
    根据如下公式确定所述第四列参数:
    dpq 3=|2p 2,3-p 1,3-p 0,3+2q 2,3-q 1,3-q 0,3|,
    其中,所述dpq 3为所述第四列参数,所述p 0,3为所述第四列像素点中的第一个上方像素点,所述p 1,3为所述第四列像素点中的第二个上方像素点,所述p 2,3为所述第四列像素点中的第三个上方像素点,所述q 0,3为所述第四列像素点中的第一个下方像素点,所述q 1,3为所述第四列像素点中的第二个下方像素点,所述q 2,3为所述第四列像素点中的第三个下方像素点。
  97. 根据权利要求91所述的方法,其特征在于,所述根据所述待滤波边界的联合渐进特征,确定是否对所述待滤波边界进行滤波,包括:
    在所述第一列参数和所述第四列参数均大于或等于第二预设值,确定对所述待滤波边界不进行滤波。
  98. 根据权利要求91所述的方法,其特征在于,所述根据所述待滤波边界的联合渐进特征,确定是否对所述待滤波边界进行滤波,包括:
    在所述第一列参数和所述第四列参数之和大于或等于第四预设值,确定对所述待滤波边界不进行滤波。
  99. 根据权利要求91所述的方法,其特征在于,所述根据所述待滤波边界的联合渐进特征,确定是否对所述待滤波边界进行滤波,包括:
    根据所述待滤波边界两侧的像素点的像素值,确定所述待滤波边界两侧的像素点的像素值的变换率;
    根据所述变换率、以及所述第一列参数和所述第四列参数中的至少一个参数,确定是否对所述待滤波边界进行滤波。
  100. 根据权利要求99所述的方法,其特征在于,所述根据所述变换率、以及所述第一列参数和所述第四列参数中的至少一个参数,确定是否对所述待滤波边界进行滤波,包括:
    在所述变换率小于第三预设值,且所述第一列参数和/或所述第四列参数小于第五预设值时,确定对所述待滤波边 界进行滤波。
  101. 根据权利要求99所述的方法,其特征在于,所述根据所述变换率、以及所述第一列参数和所述第四列参数中的至少一个参数,确定是否对所述待滤波边界进行滤波,包括:
    在所述变换率小于第三预设值,且所述第一列参数与所述第四列参数均大于或等于第六预设值时,确定对所述待滤波边界进行滤波。
  102. 根据权利要求101所述的方法,其特征在于,所述根据所述变换率、以及所述第一列参数和所述第四列参数中的至少一个参数,确定是否对所述待滤波边界进行滤波,包括:
    在所述变换率小于第三预设值,且所述第一列参数与所述第四列参数之和小于第七预设值时,确定对所述待滤波边界进行滤波。
  103. 根据权利要求99所述的方法,其特征在于,所述根据所述变换率、以及所述第一列参数和所述第四列参数中的至少一个参数,确定是否对所述待滤波边界进行滤波,包括:
    在所述变换率小于第三预设值,且所述第一列参数与所述第四列参数之和大于或等于第八预设值时,确定对所述待滤波边界进行滤波。
  104. 根据权利要求64所述的方法,其特征在于,所述第二预设值大于0.5小于1。
  105. 根据权利要求104所述的方法,其特征在于,所述第二预设值大于0.5小于0.8。
  106. 根据权利要求64所述的方法,其特征在于,所述第二预设值等于二分之一的第三预设值。
  107. 根据权利要求64所述的方法,其特征在于,所述方法还包括:
    根据量化参数QP确定所述第二预设值。
  108. 根据权利要求55所述的方法,其特征在于,所述第一预设值为0。
  109. 一种视频编码器,其特征在于,包括:
    获取单元,用于获取待编码图像块的部分或完整的重建图像,其中,所述部分或完整的重建图像包括一个或多个重建图像块;
    边界确定单元,用于确定所述重建图像块的待滤波边界;
    强度确定单元,用于根据所述待滤波边界两侧相邻的第一图像块和第二图像块的编码信息,确定所述待滤波边界的边界滤波强度;
    特征确定单元,用于在所述边界滤波强度大于第一预设值时,根据所述待滤波边界两侧的像素点的像素值,确定所述待滤波边界的联合渐进特征;
    滤波确定单元,用于根据所述待滤波边界的联合渐进特征,确定是否对所述待滤波边界进行滤波。
  110. 一种视频解码器,其特征在于,包括:
    解码单元,用于解码码流,得到部分或完整的重建图像,其中,所述部分或完整的重建图像包括一个或多个重建图像块;
    边界确定单元,用于确定所述重建图像块的待滤波边界;
    强度确定单元,用于根据所述待滤波边界两侧相邻的第一图像块和第二图像块,确定所述待滤波边界的边界滤波强度;
    特征确定单元,用于在所述边界滤波强度大于第一预设值时,根据所述待滤波边界两侧的像素点的像素值,确定所述待滤波边界的联合渐进特征;
    滤波确定单元,用于根据所述待滤波边界的联合渐进特征,确定是否对所述待滤波边界进行滤波。
  111. 一种图像处理系统,其特征在于,包括:如权利要求109所述的视频编码器;以及如权利要求110所述的视频解码器。
PCT/CN2020/133427 2020-12-02 2020-12-02 图像处理方法、系统、视频编码器及视频解码器 WO2022116054A1 (zh)

Priority Applications (3)

Application Number Priority Date Filing Date Title
CN202080107384.0A CN116547973A (zh) 2020-12-02 2020-12-02 图像处理方法、系统、视频编码器及视频解码器
PCT/CN2020/133427 WO2022116054A1 (zh) 2020-12-02 2020-12-02 图像处理方法、系统、视频编码器及视频解码器
US18/323,355 US20230300329A1 (en) 2020-12-02 2023-05-24 Picture processing method and video decoder

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2020/133427 WO2022116054A1 (zh) 2020-12-02 2020-12-02 图像处理方法、系统、视频编码器及视频解码器

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US18/323,355 Continuation US20230300329A1 (en) 2020-12-02 2023-05-24 Picture processing method and video decoder

Publications (1)

Publication Number Publication Date
WO2022116054A1 true WO2022116054A1 (zh) 2022-06-09

Family

ID=81853768

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2020/133427 WO2022116054A1 (zh) 2020-12-02 2020-12-02 图像处理方法、系统、视频编码器及视频解码器

Country Status (3)

Country Link
US (1) US20230300329A1 (zh)
CN (1) CN116547973A (zh)
WO (1) WO2022116054A1 (zh)

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20030053711A1 (en) * 2001-09-20 2003-03-20 Changick Kim Reducing blocking and ringing artifacts in low-bit-rate coding
CN1492686A (zh) * 2002-09-20 2004-04-28 精工爱普生株式会社 用于视频解块的方法和设备
CN1694537A (zh) * 2004-04-29 2005-11-09 联发科技股份有限公司 活动图像专家组视讯译码器可适性去区块滤波装置及方法
CN102098516A (zh) * 2011-03-07 2011-06-15 上海大学 多视点视频解码端去块滤波方法

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20030053711A1 (en) * 2001-09-20 2003-03-20 Changick Kim Reducing blocking and ringing artifacts in low-bit-rate coding
CN1492686A (zh) * 2002-09-20 2004-04-28 精工爱普生株式会社 用于视频解块的方法和设备
CN1694537A (zh) * 2004-04-29 2005-11-09 联发科技股份有限公司 活动图像专家组视讯译码器可适性去区块滤波装置及方法
CN102098516A (zh) * 2011-03-07 2011-06-15 上海大学 多视点视频解码端去块滤波方法

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
CHEN, YAFIE: "The Research of De-blocking Artifact Method Based on Video Codec Standard", CHINESE MASTER'S THESES FULL-TEXT DATABASE, 1 January 2007 (2007-01-01), XP055937385 *
M. IKEDA (SONY), T. SUZUKI (SONY): "CE11: Long-tap deblocking filter for luma and chroma (CE11.1.6)", 124. MPEG MEETING; 20181008 - 20181012; MACAO; (MOTION PICTURE EXPERT GROUP OR ISO/IEC JTC1/SC29/WG11), 25 September 2018 (2018-09-25), Macao CN, pages 1 - 7, XP030191056 *

Also Published As

Publication number Publication date
CN116547973A (zh) 2023-08-04
US20230300329A1 (en) 2023-09-21

Similar Documents

Publication Publication Date Title
US11979552B2 (en) Image coding method and device using transform skip flag
CA3105383C (en) Position dependent intra prediction combination with wide angle intra prediction
EP3639518B1 (en) Intra filtering applied together with transform processing in video coding
KR102574560B1 (ko) 비디오 코딩을 위해 액세스하는 샘플을 갖는 선형 모델 예측 모드
JP7163183B2 (ja) ビデオコード化のためのマルチタイプツリーフレームワーク
CN109716765B (zh) 用于视频译码中的帧内预测的经改进内插滤波器
US11611757B2 (en) Position dependent intra prediction combination extended with angular modes
EP3593531A1 (en) Intra filtering flag in video coding
CA2950168A1 (en) Determining quantization parameter (qp) values and delta qp values for palette coded blocks in video coding
CN112889286B (zh) 位置相关预测组合的模式相关和大小相关块级限制的方法和装置
JP2023153802A (ja) イントラ・サブパーティション・コーディング・ツールによって引き起こされるサブパーティション境界のためのデブロッキングフィルタ
CN113330743A (zh) 编码器、解码器及去块效应滤波器自适应的对应方法
US20220150503A1 (en) Method and apparatus for image coding based on transform
WO2023044868A1 (zh) 视频编解码方法、设备、系统、及存储介质
WO2022116054A1 (zh) 图像处理方法、系统、视频编码器及视频解码器
WO2023173255A1 (zh) 图像编解码方法、装置、设备、系统、及存储介质
WO2022155922A1 (zh) 视频编解码方法与系统、及视频编码器与视频解码器
WO2022179394A1 (zh) 图像块预测样本的确定方法及编解码设备
WO2024050723A1 (zh) 一种图像预测方法、装置及计算机可读存储介质
WO2022116105A1 (zh) 视频编解码方法与系统、及视频编码器与视频解码器
WO2023044919A1 (zh) 视频编解码方法、设备、系统、及存储介质
WO2022193390A1 (zh) 视频编解码方法与系统、及视频编解码器
WO2023122968A1 (zh) 帧内预测方法、设备、系统、及存储介质
US20230076486A1 (en) Image coding method based on transform, and device therefor
WO2022217447A1 (zh) 视频编解码方法与系统、及视频编解码器

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 20963902

Country of ref document: EP

Kind code of ref document: A1

WWE Wipo information: entry into national phase

Ref document number: 202080107384.0

Country of ref document: CN

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 20963902

Country of ref document: EP

Kind code of ref document: A1