WO2023202097A1 - 环路滤波方法、视频编解码方法、装置、介质、程序产品及电子设备 - Google Patents

环路滤波方法、视频编解码方法、装置、介质、程序产品及电子设备 Download PDF

Info

Publication number
WO2023202097A1
WO2023202097A1 PCT/CN2022/137900 CN2022137900W WO2023202097A1 WO 2023202097 A1 WO2023202097 A1 WO 2023202097A1 CN 2022137900 W CN2022137900 W CN 2022137900W WO 2023202097 A1 WO2023202097 A1 WO 2023202097A1
Authority
WO
WIPO (PCT)
Prior art keywords
unit
aps
image frame
video image
current strip
Prior art date
Application number
PCT/CN2022/137900
Other languages
English (en)
French (fr)
Inventor
张瀚
Original Assignee
腾讯科技（深圳）有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 腾讯科技（深圳）有限公司 filed Critical 腾讯科技（深圳）有限公司
Publication of WO2023202097A1 publication Critical patent/WO2023202097A1/zh

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/117—Filters, e.g. for pre-processing or post-processing
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/80—Details of filtering operations specially adapted for video compression, e.g. for pixel interpolation
    • H04N19/82—Details of filtering operations specially adapted for video compression, e.g. for pixel interpolation involving filtering within a prediction loop

Definitions

  • the present application relates to the field of computer and communication technologies, specifically, to a loop filtering method, a video encoding and decoding method, a device, a medium, a program product and an electronic device.
  • Adaptive Loop Filtering is a Wiener filter that can use the correlation with surrounding pixels within the coverage of the filter template to derive optimal coefficients, improve the quality of pixels after ALF filtering, and reduce The difference in raw pixels.
  • ALF uses a fixed template, and uses the output of a single loop filter as the input of ALF, which affects the performance of ALF itself and restricts the improvement of the filtering effect.
  • Embodiments of the present application provide a loop filtering method, a video encoding and decoding method, a device, a medium, a program product, and an electronic device, which can improve the filtering effect and filtering quality of ALF, thereby helping to improve encoding and decoding performance.
  • a loop filtering method which includes: obtaining a reconstruction component corresponding to a video image frame; filtering the reconstruction component through a loop filtering unit, where the loop filtering unit includes A deblocking filter (DF) unit, a designated loop filter and an adaptive loop filter (Adaptive Loop Filter, ALF) unit connected in sequence; wherein the input of the ALF unit also includes at least the following One: the signal input to the DF unit, the output signal of the DF unit; using the output of the loop filter unit as the reconstructed image corresponding to the video image frame.
  • DF deblocking filter
  • ALF adaptive loop filter
  • a video decoding method including: filtering the reconstruction components corresponding to the video image frames through the loop filtering method in the embodiments of the present application, to obtain the reconstructed components corresponding to the video image frames. Reconstruct the image; use the reconstructed image corresponding to the video image frame as the decoded video image.
  • a video encoding method including: obtaining a video image frame to be encoded; and processing the video image frame corresponding to the video image frame to be encoded through the loop filtering method in the embodiment of the present application.
  • the reconstructed component is filtered to obtain a reconstructed image corresponding to the video image frame to be encoded.
  • a loop filtering device including: an acquisition unit configured to acquire a reconstruction component corresponding to a video image frame; a filtering unit configured to perform the reconstruction component on the loop filtering unit; Filtering processing, the loop filter unit includes a DF unit, a designated loop filter and an ALF unit connected in sequence; wherein the input of the ALF unit also includes at least one of the following: a signal input to the DF unit, The output signal of the DF unit; and using the output of the loop filter unit as the reconstructed image corresponding to the video image frame.
  • a video decoding device including: an acquisition unit configured to acquire a reconstruction component corresponding to a video image frame; a filtering unit configured to filter the reconstruction component through a loop filtering unit Processing, the loop filter unit includes a DF unit, a designated loop filter and an ALF unit connected in sequence; wherein the input of the ALF unit also includes at least one of the following: the signal input to the DF unit, the The output signal of the DF unit; and the output of the loop filter unit as the reconstructed image corresponding to the video image frame; the decoding unit is configured to use the reconstructed image corresponding to the video image frame as the decoded video image.
  • a video encoding device including: an acquisition unit configured to acquire a video image frame to be encoded and a reconstruction component corresponding to the video image frame to be encoded; a filtering unit configured to In order to perform filtering processing on the reconstruction component corresponding to the video image frame to be encoded through a loop filtering unit, the loop filtering unit includes a DF unit, a designated loop filter and an ALF unit connected in sequence; wherein, The input of the ALF unit also includes at least one of the following: a signal input to the DF unit, an output signal of the DF unit; and using the output of the loop filter unit as a reconstruction corresponding to the video image frame to be encoded image.
  • a computer-readable medium on which a computer program is stored.
  • the loop filtering method and video decoding as described in the above embodiments are implemented. method or video encoding method.
  • an electronic device including: one or more processors; a storage device for storing one or more computer programs.
  • the electronic device When the one or more computer programs are described When executed by one or more processors, the electronic device implements the loop filtering method, video decoding method or video encoding method as described in the above embodiments.
  • a computer program product includes a computer program, and the computer program is stored in a computer-readable storage medium.
  • the processor of the electronic device reads and executes the computer program from the computer-readable storage medium, so that the electronic device performs the loop filtering method, video decoding method or video encoding method provided in the above various optional embodiments.
  • At least one of the signal input to the DF unit and the output signal of the DF unit is used as an additional input signal of the ALF unit during loop filtering, so that the ALFF unit
  • the filtering process can refer to the correlation between the current pixel to be filtered and surrounding pixels, thereby utilizing the correlation of surrounding pixels to achieve dynamic adaptive filtering. Compared with the filtering scheme using fixed templates in related technologies, filtering is more targeted. The filtering effect and filtering quality of ALF are improved, which in turn helps improve the encoding and decoding performance.
  • Figure 1 shows a schematic diagram of an exemplary system architecture to which the technical solution of the embodiment of the present application can be applied;
  • Figure 2 shows a schematic diagram of the placement of the video encoding device and the video decoding device in the streaming transmission system
  • Figure 3 shows the basic flow chart of a video encoder
  • Figure 4 shows the overall structure of VVC and a schematic diagram of the loop filtering process
  • Figure 5 shows the module structure diagram of loop filtering in VCC
  • Figure 6 shows a schematic diagram of the module structure of loop filtering in ECM
  • Figure 7 shows a schematic diagram of the module structure of loop filtering in one embodiment of the present application.
  • Figure 8 shows a schematic diagram of the module structure of loop filtering in one embodiment of the present application.
  • Figure 9 shows a schematic diagram of the module structure of loop filtering in one embodiment of the present application.
  • Figure 10 shows a flow chart of a loop filtering method according to an embodiment of the present application
  • Figure 11 shows a block diagram of a ring filter device according to an embodiment of the present application.
  • Figure 12 shows a block diagram of a video decoding device according to an embodiment of the present application.
  • Figure 13 shows a block diagram of a video encoding device according to an embodiment of the present application.
  • FIG. 14 shows a schematic structural diagram of a computer system suitable for implementing an electronic device according to an embodiment of the present application.
  • Figure 1 shows a schematic diagram of an exemplary system architecture to which the technical solution of the embodiment of the present application can be applied.
  • system architecture 100 includes a plurality of electronic devices that can communicate with each other through, for example, network 150 .
  • system architecture 100 may include first electronic device 110 and second electronic device 120 interconnected by network 150 .
  • the first electronic device 110 and the second electronic device 120 perform one-way data transmission.
  • the first electronic device 110 may encode video data (such as a video picture stream collected by the electronic device 110) for transmission to the second electronic device 120 through the network 150, and the encoded video data may be encoded in one or more formats.
  • the encoded video is transmitted in the form of a code stream.
  • the second electronic device 120 can receive the encoded video data from the network 150, decode the encoded video data to restore the video data, and display video pictures according to the restored video data.
  • the system architecture 100 may include a third electronic device 130 and a fourth electronic device 140 that perform bidirectional transmission of encoded video data, such as may occur during a video conference.
  • each of the third electronic device 130 and the fourth electronic device 140 may encode video data (eg, a video picture stream collected by the electronic device) for transmission to the third electronic device through the network 150 130 and another electronic device in the fourth electronic device 140 .
  • Each of the third electronic device 130 and the fourth electronic device 140 may also receive the encoded video data transmitted by the other electronic device of the third electronic device 130 and the fourth electronic device 140 , and may perform processing of the encoded video data.
  • the video data is decoded to recover the video data, and the video picture can be displayed on an accessible display device based on the recovered video data.
  • the first electronic device 110 , the second electronic device 120 , the third electronic device 130 and the fourth electronic device 140 may be servers or terminals, and the servers may be independent physical servers or multiple
  • a server cluster or distributed system composed of physical servers can also provide cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communications, middleware services, domain name services, security services, and content distribution networks ( Content Delivery Network (CDN), as well as cloud servers for basic cloud computing services such as big data and artificial intelligence platforms.
  • the terminal can be a smartphone, tablet, laptop, desktop computer, smart speaker, smart watch, smart voice interaction device, smart home appliance, vehicle-mounted terminal, aircraft, etc., but is not limited to this.
  • Network 150 represents any number of networks that communicate encoded video data between first electronic device 110 , second electronic device 120 , third electronic device 130 , and fourth electronic device 140 , including, for example, wired and/or wireless communication networks.
  • Communication network 150 may exchange data in circuit-switched and/or packet-switched channels.
  • the network may include telecommunications networks, local area networks, wide area networks, and/or the Internet. For purposes of this application, unless explained below, the architecture and topology of network 150 may be immaterial to the operations disclosed herein.
  • FIG. 2 illustrates the placement of a video encoding device and a video decoding device in a streaming environment.
  • the subject matter disclosed herein is equally applicable to other video-enabled applications, including, for example, video conferencing, digital television (TeleVision, TV), storage of compressed video on digital media including CDs, DVDs, memory sticks, etc., and the like.
  • the streaming system may include a capture subsystem 213, which may include a video source 201 such as a digital camera, which creates an uncompressed video picture stream 202.
  • video picture stream 202 includes samples captured by a digital camera. Compared to the encoded video data 204 (or the encoded video stream 204), the video picture stream 202 is depicted as a thick line to emphasize the high data volume of the video picture stream.
  • the video picture stream 202 can be processed by the electronic device 220.
  • Device 220 includes video encoding device 203 coupled to video source 201 .
  • Video encoding device 203 may include hardware, software, or a combination of hardware and software to implement or implement aspects of the disclosed subject matter as described in greater detail below.
  • the encoded video data 204 (or encoded video stream 204 ) is depicted as a thin line compared to the video picture stream 202 to emphasize the lower data amount of the encoded video data 204 (or encoded video stream 202 ).
  • 204 which may be stored on the streaming server 205 for future use.
  • One or more streaming client subsystems such as client subsystem 206 and client subsystem 208 in FIG. 2 , may access streaming server 205 to retrieve copies 207 and 209 of encoded video data 204 .
  • Client subsystem 206 may include, for example, video decoding device 210 in electronic device 230 .
  • Video decoding device 210 decodes the incoming copy of the encoded video data 207 and produces an output video picture stream 211 that can be presented on a display 212 (eg, a display screen) or another presentation device.
  • the encoded video data 204, video data 207, and video data 209 may be encoded according to certain video encoding/compression standards.
  • electronic device 220 and electronic device 230 may include other components not shown in the figures.
  • electronic device 220 may include a video decoding device
  • electronic device 230 may further include a video encoding device.
  • the international video coding standards are High Efficiency Video Coding (HEVC), Versatile Video Coding (VVC), and China National Video Coding Standard (Audio Video Coding) Standard, AVS) for example, when a video frame image is input, the video frame image will be divided into several non-overlapping processing units according to a block size, and each processing unit will perform similar compression operations.
  • This processing unit is called CTU, or Largest Coding Unit (LCU).
  • the CTU can be further divided into more refined divisions to obtain one or more basic coding units (Coding Unit, CU).
  • CU is the most basic element in a coding link.
  • Predictive Coding includes intra-frame prediction and inter-frame prediction. After the original video signal is predicted by the selected reconstructed video signal, the residual video signal is obtained. The encoding end needs to decide which predictive coding mode to select for the current CU and inform the decoding end. Among them, intra-frame prediction means that the predicted signal comes from an area in the same image that has been encoded and reconstructed; inter-frame prediction means that the predicted signal comes from other images that have been encoded and are different from the current image (called a reference image). .
  • Transform & Quantization After the residual video signal undergoes transformation operations such as Discrete Fourier Transform (DFT) and Discrete Cosine Transform (DCT), the signal is converted into the transform domain. Called the transformation coefficient. The transform coefficients are further subjected to a lossy quantization operation, losing certain information, making the quantized signal conducive to compressed expression. In some video coding standards, there may be more than one transformation method to choose from, so the encoding end also needs to select one of the transformation methods for the current CU and inform the decoding end. The degree of fineness of quantization is usually determined by the quantization parameter (Quantization Parameter, QP).
  • QP Quantization Parameter
  • a larger value of QP means that coefficients with a larger value range will be quantized into the same output, so it usually results in greater distortion and comparison.
  • Low code rate on the contrary, the QP value is small, which means that coefficients with a smaller value range will be quantized into the same output, so it usually brings smaller distortion and corresponds to a higher code rate.
  • Entropy Coding or statistical coding The quantized transform domain signal will be statistically compressed and coded according to the frequency of occurrence of each value, and finally a binary (0 or 1) compressed code stream will be output. At the same time, encoding produces other information, such as the selected encoding mode, motion vector data, etc., which also require entropy encoding to reduce the code rate.
  • Statistical coding is a lossless coding method that can effectively reduce the bit rate required to express the same signal. Common statistical coding methods include variable length coding (VLC) or context-based binary arithmetic coding (Content Adaptive Binary Arithmetic Coding, CABAC).
  • the context-based Adaptive Binary Arithmetic Coding (CABAC) process mainly includes three steps: binarization, context modeling and binary arithmetic coding.
  • the binary data can be encoded through conventional encoding mode and bypass coding mode (Bypass Coding Mode).
  • the bypass encoding mode does not need to assign a specific probability model to each binary bit.
  • the input binary bin value is directly encoded with a simple bypass encoder to speed up the entire encoding and decoding.
  • different grammatical elements are not completely independent, and the same grammatical elements themselves also have certain memorability.
  • conditional encoding using other encoded grammatical elements can further improve encoding performance compared with independent encoding or memoryless encoding.
  • the encoded symbolic information used as conditions is called context.
  • the binary bits of the syntax element enter the context modeler sequentially, and the encoder assigns an appropriate probability model to each input binary bit based on the value of the previously encoded syntax element or binary bit.
  • the process is context modeling.
  • the context model corresponding to the syntax element can be located through the context index increment (context index increment, ctxIdxInc) and the context start index (context index Start, ctxIdxStart). After the bin value and the assigned probability model are sent to the binary arithmetic encoder for encoding, the context model needs to be updated according to the bin value, which is the adaptive process in encoding.
  • Loop Filtering The changed and quantized signal will obtain a reconstructed image through the operations of inverse quantization, inverse transformation and prediction compensation. Compared with the original image, some information of the reconstructed image is different from the original image due to the influence of quantization, that is, the reconstructed image will produce distortion. Therefore, filtering operations can be performed on the reconstructed image to effectively reduce the degree of distortion caused by quantization. Since these filtered reconstructed images will be used as references for subsequent encoded images to predict future image signals, the above-mentioned filtering operations are also called loop filtering, that is, filtering operations within the encoding loop.
  • FIG. 3 shows a basic flow chart of a video encoder.
  • intra prediction is taken as an example for explanation.
  • the original image signal s k [x, y] and the predicted image signal Perform a difference operation to obtain the residual signal u k [x, y].
  • the residual signal u k [x, y] is transformed and quantized to obtain the quantized coefficient.
  • the quantized coefficient is used to obtain the encoded value through entropy coding.
  • bit stream on the other hand, is used to obtain the reconstructed residual signal u' k [x, y] through inverse quantization and inverse transformation processing, and predict the image signal Superimposed with the reconstructed residual signal u' k [x, y] to generate a reconstructed image signal Reconstruct image signal
  • it is input to the intra mode decision module and the intra prediction module for intra prediction processing.
  • it is filtered through loop filtering and outputs the filtered image signal s' k [x, y].
  • the filtered The image signal s' k [x, y] can be used as a reference image of the next frame for motion estimation and motion compensation prediction. Then based on the motion compensation prediction result s' r [x+m x ,y+m y ] and the intra prediction result Get the predicted image signal of the next frame And continue to repeat the above process until the encoding is completed.
  • loop filtering is one of the core modules of video encoding, which can effectively remove various encoding distortions.
  • the latest generation of international video coding standard VVC supports four different types of loop filters: DF, Sample Adaptive Offset (SAO), ALF and cross-component adaptive loop filtering (CC-ALF).
  • the overall structure of VVC and the loop filtering process are shown in Figure 4.
  • the overall process is similar to the encoder process shown in Figure 3.
  • ALF and CC-ALF are one dimension.
  • Nanofilters can adaptively determine filter coefficients based on the content of different video components, thereby reducing the mean square error (MSE) between the reconstructed component and the original component.
  • MSE mean square error
  • the input of ALF is the reconstructed pixel value after filtering by DF and SAO
  • the output is the enhanced reconstructed brightness image and reconstructed chroma image
  • the input of CC-ALF is after filtering by DF and SAO without ALF
  • the luminance component before processing is outputted as the correction value of the corresponding chrominance component.
  • CC-ALF only acts on the chrominance component. Specifically, it uses the correlation between the luminance component and the chrominance component to obtain the correction value of the chrominance component through linear filtering of the luminance component. This correction value is consistent with the ALF filtered value.
  • the chroma components are added together as the final reconstructed chroma components.
  • the Wiener filter can generate different filter coefficients for video content with different characteristics. Therefore, ALF and CC-ALF need to classify video content and use corresponding filters for each category of video content.
  • the ALF of the luma component supports 25 different categories of filters
  • the ALF of each chroma component supports up to 8 different categories of filters
  • the CC-ALF of each chroma component supports up to 4 different types of filters.
  • An APS can contain up to 25 sets of luminance filter coefficients and corresponding limiting value indexes, up to 8 sets of chroma filter coefficients and corresponding limiting value indexes for two chroma components, and up to 4 sets of CC for each chroma component. -ALF filter coefficients.
  • the loop filtering process in VVC includes five main modules: Luma Mapping with Chroma Scaling (LMCS), DF, Sample Adaptive Compensation (SAO), ALF and CC-ALF .
  • LMCS Luma Mapping with Chroma Scaling
  • SAO Sample Adaptive Compensation
  • ALF CC-ALF
  • the input-output relationship of these five modules is shown in Figure 5.
  • the reconstructed pixels are input to LMCS.
  • the input of DF is the reconstructed pixels processed by LMCS
  • the input of ALF is the reconstructed pixel values processed by DF and SAO.
  • the output is Pixel values enhanced by ALF filtering.
  • the ALF filtering process can be expressed as the following formula (1):
  • formula (1) represents the filtered pixel;
  • R(x,y) represents the current pixel to be filtered;
  • fi ,0 , fi,1 represents the limiting value of the difference between the surrounding pixels covered by the ALF filter template used by VVC and the current pixel;
  • the ALF filter used by VVC can be a 7 ⁇ 7 diamond filter with a centrally symmetrical shape.
  • ECM Enhanced Compression Model
  • BIF bilateral sideband filtering
  • CCSAO Cross-Component Sample Adaptive Offset
  • the loop filtering process of ECM is shown in Figure 6.
  • BIF and CCSAO operate in parallel with SAO.
  • the correction values generated and the correction values generated by SAO are added to the reconstructed pixels after deblocking filtering at the same time. Therefore, the input of ALF in ECM is
  • the reconstructed values processed by BIF, SAO, and CCSAO are output as enhanced pixel values.
  • the ALF filtering process can be expressed as the following formula (2):
  • Equation (2) represents the filtered pixel;
  • R(x,y) represents the current pixel to be filtered;
  • fi ,0 , fi,1 represents the limiting value of the difference between the surrounding pixels covered by the ALF filter template used by the ECM and the current pixel;
  • g i represents the limiting value of the difference between the intermediate value generated by the fixed filter and the current pixel value to be filtered;
  • These filter coefficients also need to be sent to the decoder.
  • the ALF filter used by ECM can be a 9 ⁇ 9 diamond filter with a centrally symmetrical shape.
  • ALF in ECM can only use the reconstructed pixels after SAO as the input of ALF. Since the ALF in the related art uses a fixed template and uses the output of a single loop filter as the input of the ALF, these all affect the performance of the ALF itself.
  • embodiments of the present application propose a solution of using reconstructed pixels before deblocking filtering as an additional input to ALF to achieve further performance improvement.
  • the reconstructed pixels after the output of LMCS and before the input of DF are used as an additional input to ALF.
  • the filtering process of ALF can be expressed as follows: Formula (3):
  • R(x,y) represents the current pixel to be filtered
  • fi ,0 , fi,1 represents the limiting value of the difference between the surrounding pixels covered by the ALF filter template used by the ECM and the current pixel
  • g i represents the limiting value of the difference between the intermediate value generated by the fixed filter and the current pixel value to be filtered
  • c i , i 20,21, represents the filter coefficient corresponding to the intermediate value
  • h i,0 , h i,1 represents the limiting value of the difference between the surrounding pixels before deblocking filtering and the current pixel
  • N-22 represents the number of coefficients corresponding to the pixel difference value before deblocking
  • embodiments of the present application also propose that reconstructed pixels after deblocking filtering and before the next step of loop filtering can be used as an additional input to ALF.
  • reconstructed pixels after the output of DF and before the input of SAO are used as an additional input to ALF.
  • the filtering process of ALF can be expressed as follows:
  • the embodiment of the present application also proposes a solution that can simultaneously use the reconstructed pixels before deblocking filtering, and use the reconstructed pixels after deblocking filtering and before the next loop filtering as additional inputs to the ALF, to obtain further Performance improvements.
  • the reconstructed pixels after the output of LMCS and before the input of DF, and the reconstructed pixels after the output of DF and before the input of SAO are used as additional inputs to ALF.
  • the filtering process of ALF can be expressed as follows:
  • loop filter after the DF output can be processed in parallel by SAO, BIF and CCSAO as shown in Figures 7 to 9, or it can be replaced by SAO,
  • SAO the loop filter after the DF output
  • BIF and CCSAO the loop filter after the DF output
  • the single processing method of one filter in BIF and CCSAO can also be replaced by the parallel processing method of two filters in SAO, BIF and CCSAO.
  • FIG. 10 shows a flowchart of a loop filtering method according to an embodiment of the present application.
  • the loop filtering method may be executed by a video encoding device or a video decoding device.
  • the loop filtering method includes at least step S1010 to step S1030. The details are as follows:
  • step S1010 the reconstructed component corresponding to the video image frame is obtained.
  • the reconstruction component corresponding to the video image frame may be a reconstructed image signal generated after superposing the reconstructed residual signal and the predicted image signal.
  • the reconstruction component corresponding to the video image frame is the reconstruction component corresponding to the video image frame to be encoded; for the decoding end, the reconstruction component corresponding to the video image frame is the reconstruction component obtained by decoding.
  • step S1020 the reconstructed component corresponding to the video image frame is filtered through a loop filtering unit, which includes a sequentially connected DF unit, a designated loop filter, and an adaptive loop filtering ALF unit;
  • the input of the ALF unit also includes at least one of the following: a signal input to the DF unit and an output signal of the DF unit.
  • the specified loop filter includes at least one of the following: double sideband filter BIF, sample adaptive compensation filter SAO, and cross-component sample adaptive compensation filter CCSAO. If two or three of SAO, BIF and CCSAO are included, these loop filters can be processed in parallel.
  • the specific loop filtering process can be shown in Figure 7; if the input of the ALF unit also includes the output signal of the DF unit, then The specific loop filtering process can be shown in Figure 8; if the input of the ALF unit also includes the signal input to the DF unit and the output signal of the DF unit, then the specific loop filtering process can be shown in Figure 9.
  • the designated loop filters are SAO, BIF and CCSAO processed in parallel.
  • the designated loop filter can also be replaced by a single filter among SAO, BIF and CCSAO, or can be replaced by two filters among SAO, BIF and CCSAO in parallel. The way to deal with it.
  • the input of the ALF unit also includes the signal input to the DF unit, or also includes the output signal of the DF unit, or includes the signal input to the DF unit and the output signal of the DF unit.
  • the input of the ALF unit includes the signal input to the DF unit.
  • the input of the ALF unit includes a signal input to the DF unit
  • the video image frame or the current strip in the video image frame does not turn on the DF unit
  • the time-limited video image frame or current slice refers to the first APS; wherein the first APS contains a first flag bit, and the value of the first flag bit contained in the first APS is used to indicate the first adaptive parameter set
  • the APS includes the filter coefficients at the first corresponding position, and the first corresponding position is the coefficient position corresponding to the signal input to the DF unit.
  • the first APS with reference that is, the restricted reference includes the APS corresponding to the filter coefficients of the signal input to the DF unit.
  • the input of the ALF unit includes a signal input to the DF unit, then during the filtering process, if the video image frame or the current strip turns on the DF unit, then during the filtering process, the video image frame or The current strip refers to the second APS; wherein the second APS contains a first flag bit, and the value of the first flag bit contained in the second APS is used to indicate the default first corresponding position in the second APS. Filter coefficients.
  • the filter coefficient corresponding to the signal input to the DF unit needs to be used during the filtering process. Therefore, the video image frame or the current strip reference can be limited.
  • the second APS that is, the APS whose limiting reference defaults to the filter coefficient corresponding to the signal input to the DF unit.
  • the filter coefficient at the first corresponding position in the first APS is set to 0; where, the An APS contains a first flag bit, and the value of the first flag bit contained in the first APS is used to indicate that the first APS contains a filter coefficient at a first corresponding position, and the first corresponding position is input to The coefficient position corresponding to the signal of the DF unit.
  • the filter coefficient at the first corresponding position in the first APS can be set to 0.
  • the input of the ALF unit includes a signal input to the DF unit
  • the video image frame or the current strip turns on the DF unit
  • the video image frame or the current strip refers to the Two APS
  • the second APS when applying the second APS to the video image frame or the current strip for filtering processing, fill the filter coefficient at the first corresponding position in the second APS with 0; where, the second APS contains The first flag bit, and the value of the first flag bit contained in the second APS is used to indicate the filter coefficient at the default first corresponding position in the second APS.
  • the filter coefficient corresponding to the signal input to the DF unit needs to be used in the filtering process. Therefore, if the video image frame or the current strip refers to If the second APS of the filter coefficient corresponding to the signal input to the DF unit is defaulted, then the filter coefficient at the first corresponding position in the second APS can be filled with 0.
  • the video image frame or the current strip in the video image frame can be In the APS of the filter coefficients of the strip, the filter coefficient at the first corresponding position is set to 0, and the first corresponding position is the coefficient position corresponding to the signal input to the DF unit.
  • the DF unit since the DF unit is not turned on for the video image frame or the current strip, it is not necessary to use the filter coefficient corresponding to the signal input to the DF unit during the filtering process. Therefore, the video image frame or the current strip can be included in the filtering process.
  • the filter coefficient at the first corresponding position in the APS of the strip's filter coefficient is set to 0 to reduce encoding and decoding redundancy.
  • the filter coefficient at the first corresponding position in the video image frame or the current strip referenced by the APS can be set to 0, and the first corresponding position is The coefficient position corresponding to the signal input to the DF unit.
  • the video image frame or the current strip can be The filter coefficient at the first corresponding position in the APS referenced by the band is set to 0.
  • the following describes the application scenario in which the input of the ALF unit includes the output signal of the DF unit.
  • the video image frame or the current slice is limited to refer to the third APS; wherein the third APS contains a second flag bit, and the value of the second flag bit contained in the third APS is used to indicate the third APS. contains the filter coefficients at the second corresponding position, and the second corresponding position refers to the coefficient position corresponding to the output signal of the DF unit.
  • the video image frame or current strip since the video image frame or current strip does not turn on the specified loop filter, there is no need to use the signal input to the specified loop filter (ie, the output signal of the DF unit) during the filtering process.
  • the corresponding filter coefficient therefore, the video image frame or the current strip can be restricted to refer to the third APS, that is, the reference to the APS containing the filter coefficient corresponding to the output signal of the DF unit is restricted.
  • the video image frame or the current strip turns on the specified loop filter, the video will be limited during the filtering process.
  • the image frame or current slice refers to the fourth APS; wherein the fourth APS contains a second flag bit, and the value of the second flag bit contained in the fourth APS is used to indicate the default second correspondence in the fourth APS.
  • the filter coefficients at the location if the input of the ALF unit includes the output signal of the DF unit, then during the filtering process, if the video image frame or the current strip turns on the specified loop filter, the video will be limited during the filtering process.
  • the image frame or current slice refers to the fourth APS; wherein the fourth APS contains a second flag bit, and the value of the second flag bit contained in the fourth APS is used to indicate the default second correspondence in the fourth APS.
  • the filter coefficients at the location if the input of the ALF unit includes the output signal of the DF unit.
  • the filter coefficient corresponding to the output signal of the DF unit needs to be used during the filtering process. Therefore, the video image frame or the current strip can be limited.
  • the strip refers to the fourth APS, that is, the restriction refers to the APS that defaults to the filter coefficient corresponding to the output signal of the DF unit.
  • the filter coefficient at the second corresponding position in the third APS is set to 0. ;
  • the third APS contains the second flag bit, and the value of the second flag bit contained in the third APS is used to indicate that the third APS contains the filter coefficient at the second corresponding position, and the second corresponding The position refers to the coefficient position corresponding to the output signal of the DF unit.
  • the filter coefficient at the second corresponding position in the third APS can be set to 0.
  • the filter coefficient at the second corresponding position in the fourth APS is filled with 0; where, the fourth APS contains a second flag bit, and the value of the second flag bit contained in the fourth APS is used to indicate the filter coefficient at the default second corresponding position in the fourth APS.
  • the filter coefficient corresponding to the output signal of the DF unit needs to be used during the filtering process. Therefore, if the video image frame or the current strip
  • the video image can be included in the video image frame.
  • the filter coefficient at the second corresponding position is set to 0, and the second corresponding position is the coefficient position corresponding to the output signal of the DF unit.
  • the video image frame or the current strip since the video image frame or the current strip does not turn on the specified loop filter, it is not necessary to use the filter coefficient corresponding to the output signal of the DF unit during the filtering process. Therefore, the video image containing The filter coefficient at the second corresponding position in the APS of the filter coefficient of the frame or current strip is set to 0 to reduce encoding and decoding redundancy.
  • the video image frame or the current strip in the video image frame is
  • the filter coefficient at the second corresponding position in the video image frame or the APS referenced by the current strip can be set to 0, and the second The corresponding position is the coefficient position corresponding to the output signal of the DF unit.
  • the video image frame or the current strip since the video image frame or the current strip does not turn on the specified loop filter, it is not necessary to use the filter coefficient corresponding to the output signal of the DF unit during the filtering process. Therefore, the video image frame can be Or the filter coefficient at the second corresponding position in the APS referenced by the current strip is set to 0.
  • the following describes the application scenario in which the input of the ALF unit includes the signal input to the DF unit and the output signal of the DF unit.
  • the aforementioned embodiment in which the input of the ALF unit includes the signal input to the DF unit is combined with the embodiment in which the input of the ALF unit includes the output signal of the DF unit, that is, depending on whether the DF unit is turned on, And whether to turn on the specified loop filter to limit the video image frame or the APS referenced by the current strip, and whether to set the filter coefficient of the corresponding position to 0 during filtering processing.
  • step S1030 the output of the loop filter unit is used as the reconstructed image corresponding to the video image frame.
  • the reconstructed image corresponding to the video image frame can be used as the decoded Obtained video image.
  • the reconstruction component corresponding to the video image frame to be encoded can be filtered through the loop filtering method, Obtain the reconstructed image corresponding to the video image frame to be encoded.
  • the DF unit can be turned on according to the video image frame or the current strip in the video image frame, A first flag bit is added to the APS containing the filter coefficient of the video image frame or the current strip. The value of the first flag bit is used to indicate whether the filter coefficient at the first corresponding position is defaulted in the APS.
  • the first flag bit is The corresponding position is the coefficient position corresponding to the signal input to the DF unit.
  • the value of the first flag bit added in the APS is set to the first value to indicate the filter coefficient at the default first corresponding position in the APS. ; If the DF unit is enabled in the video image frame or the current strip, the value of the first flag bit added in the APS is set to the second value to indicate that the APS contains the filter coefficient at the first corresponding position.
  • the technical solution of this embodiment allows the encoding end to indicate whether the filter coefficient at the first corresponding position is defaulted in the APS by setting the first flag bit in the APS, thereby facilitating the decoding end to determine the filter coefficient based on the first flag bit. Whether the filter coefficient at the first corresponding position is defaulted in the reference APS, so that corresponding countermeasures can be adopted when performing loop filtering, that is, the processing method in the loop filtering method part mentioned above.
  • a specified loop can be opened according to whether the video image frame or the current strip in the video image frame Filter, add a second flag bit in the APS containing the filter coefficient of the video image frame or the current strip, the value of the second flag bit is used to indicate whether the filter coefficient at the second corresponding position is defaulted in the APS,
  • the second corresponding position refers to the coefficient position corresponding to the output signal of the DF unit.
  • the value of the second flag bit added in the APS is set to the first value to indicate the default second corresponding position in the APS.
  • filter coefficient if the video image frame or the current strip turns on the specified loop filter, then the value of the second flag bit added in the APS is set to the second value to indicate that the APS contains the second corresponding position. Filter coefficients.
  • the technical solution of this embodiment allows the encoding end to indicate whether the filter coefficient at the second corresponding position is defaulted in the APS by setting the second flag bit in the APS, thereby facilitating the decoding end to determine the filter coefficient based on the second flag bit. Whether the filter coefficient at the second corresponding position is defaulted in the reference APS, so that corresponding countermeasures can be adopted when performing loop filtering, that is, the processing method in the loop filtering method part mentioned above.
  • the encoding end can encode according to the video image frame or the video image frame. Whether the current strip in the DF unit is turned on, and whether the specified loop filter is turned on, add the first flag bit and the second flag bit in the APS containing the filter coefficient of the video image frame or the current strip, and set the corresponding The value is indicated.
  • a loop filtering method using reconstructed pixels at different positions (such as reconstructed pixels input to the DF unit and/or reconstructed pixels output by the DF unit) is proposed, so that the filtering process of the ALFF unit It can refer to the correlation between the current pixel to be filtered and surrounding pixels.
  • the filtering is more targeted and can make full use of the correlation with surrounding pixels to improve the quality of ALF filtering.
  • a corresponding filter coefficient index method is proposed to further reduce the cost of encoding ALF filter coefficients to improve the overall coding performance of ALF. The following is explained in detail again in two parts:
  • the loop filter outputs at different positions involved in the embodiment of the present application include: reconstructed pixels after LMCS and before DF (that is, reconstructed pixels input to DF), after DF and the next loop filter The previous reconstructed pixel (that is, the reconstructed pixel of the DF output), and the combination of the two.
  • a new flag bit can be added to the APS, and based on the usage of the loop filter corresponding to the position of the reconstructed pixel used, it is decided whether to use the reconstructed pixel at that position as input, and the flag bit is used in the APS.
  • Bits indicate the use of reconstructed pixels at different positions, which can avoid the following situation: when the deblocking filter is turned off, since there are no reconstructed pixels before the so-called deblocking effect, if you continue to calculate and transmit the corresponding coefficients, the code rate will increase. of waste.
  • This application uses the value of 0 or 1 in the added flag bit to indicate not to transmit or to transmit the coefficient, thereby avoiding a waste of code rate, which will be described in detail below.
  • the flag bit in the APS that contains the filter coefficient of the current image or strip will be Set to 0, indicating that the corresponding filter coefficients do not need to be transmitted. If DF is selected for the current image or strip, the flag bit in the APS containing the filter coefficient of the current image or strip is set to 1, indicating that the corresponding filter coefficient is transmitted.
  • the current image or strip is selected and SAO, CCSAO, BIF and other tools are turned off at the same time, the current image will be included Or the flag bit in the APS of the strip's filter coefficient is set to 0, which means that the corresponding filter coefficient does not need to be transmitted; if the current image or strip is not selected, SAO, CCSAO, BIF and other tools are turned off at the same time (that is, SAO, CCSAO is turned on and part in BIF), the flag bit in APS containing the filter coefficient of the current image or strip is set to 1.
  • the restricted reference contains the APS with a flag bit of 1; if the current image or strip is selected to use one of SAO, CCSAO, BIF and other tools or If there are multiple types, the reference is limited to APS containing a flag bit of 0.
  • two new flag bits can be added to the APS, corresponding to the reconstructed pixels before DF respectively.
  • the corresponding flag bits are respectively set according to the conditions of the two aforementioned embodiments, and the corresponding coefficients and adjustments to the decoding process are transmitted.
  • the filter coefficient at the corresponding position in the APS generated by the current frame is set to 0. If you refer to the filter coefficients in the APS generated by other frames, when decoding the current image or slice, the filter coefficient at the corresponding position is set to 0, and the effect is equivalent to not using the reconstructed pixels at the corresponding position for filtering. This change does not affect the decoding of other image frames or slices that still have DF turned on.
  • the APS generated by the current frame will be The filter coefficient at the corresponding position is set to 0. If you refer to the filter coefficients in the APS generated by other frames, when decoding the current image or slice, the filter coefficient at the corresponding position is set to 0, and the effect is equivalent to not using the reconstructed pixels at the corresponding position for filtering. This change does not affect the decoding of other frames or slices that still use one or more of SAO, CCSAO, BIF and other tools.
  • the corresponding position coefficients are calculated according to the conditions of the two aforementioned embodiments. set up.
  • the technical solution of the embodiment of the present application uses a loop filtering method using reconstructed pixels at different positions (such as reconstructed pixels input to the DF unit and/or reconstructed pixels output by the DF unit), so that the filtering process of the ALFF unit can refer to The correlation between the current pixel to be filtered and the surrounding pixels.
  • the filtering is more targeted and can better utilize the correlation of surrounding pixels to perform targeted operations on the current pixel to be filtered.
  • the unique filtering process improves the filtering effect and filtering quality of ALF, which in turn helps improve the encoding and decoding performance.
  • the added flag bit is used to indicate whether the corresponding filter coefficient needs to be transmitted, which avoids unnecessary transmission of coefficients when the deblocking filter is turned off, further reducing the number of ALF filter coefficients. overhead to improve the overall encoding performance of ALF.
  • FIG 11 shows a block diagram of a loop filtering device according to an embodiment of the present application.
  • the loop filtering device may be provided in a video encoding device or a video decoding device.
  • a loop filtering device 1100 includes: an acquisition unit 1102 and a filtering unit 1104.
  • the acquisition unit 1102 is configured to acquire the reconstruction component corresponding to the video image frame;
  • the filtering unit 1104 is configured to filter the reconstruction component through a loop filtering unit, which includes sequentially connected DF units, designated The loop filter and the ALF unit; wherein, the input of the ALF unit also includes at least one of the following: the signal input to the DF unit, the output signal of the DF unit; and the output of the loop filter unit As the reconstructed image corresponding to the video image frame.
  • the filtering unit 1104 is configured to: if the video image frame or the video image If the current strip in the frame does not turn on the DF unit, then the video image frame or the current strip is limited to refer to the first adaptive parameter set APS during filtering processing; wherein the first adaptive parameter set APS contains a first flag bit, and the value of the first flag bit contained in the first APS is used to indicate that the first adaptive parameter set APS contains the filter coefficient at the first corresponding position, so The first corresponding position is the coefficient position corresponding to the signal input to the DF unit.
  • the filtering unit 1104 is configured to: if the video image frame or the current bar If the DF unit is turned on, the video image frame or the current strip is limited to refer to the second APS during filtering processing; wherein the second APS contains a first flag bit, and the second APS The value of the first flag bit contained in is used to indicate the default filter coefficient at the first corresponding position in the second APS.
  • the filtering unit 1104 is configured to: if the video image frame or the video image If the current strip of the frame does not turn on the DF unit, and the video image frame or the current strip refers to the first APS, then the first APS is applied to the video image frame or the current strip.
  • the filter coefficient at the first corresponding position in the first APS is set to 0; wherein the first APS contains a first flag bit, and the first APS contains The value of the first flag bit is used to indicate that the first APS contains the filter coefficient at the first corresponding position, and the first corresponding position is the coefficient position corresponding to the signal input to the DF unit .
  • the filtering unit 1104 is configured to: if the video image frame or the current bar If the DF unit is turned on and the video image frame or the current strip refers to the second APS, then when the second APS is applied to the video image frame or the current strip for filtering processing, Fill the filter coefficient at the first corresponding position in the second APS with 0; wherein the second APS contains a first flag bit, and the first flag bit contained in the second APS The value of the flag bit is used to indicate that the filter coefficient at the first corresponding position is defaulted in the second APS.
  • the filtering unit 1104 is configured to: if the video image frame or the video image frame If the specified loop filter is not turned on for the current strip in , then the video image frame or the current strip is limited to refer to the third APS during the filtering process; wherein the third APS contains the second flag bit, and the value of the second flag bit included in the third APS is used to indicate that the third APS includes the filter coefficient at the second corresponding position, and the second corresponding position is the index.
  • the coefficient position corresponding to the output signal of the DF unit if the input of the ALF unit includes the output signal of the DF unit.
  • the filtering unit 1104 is configured to: if the video image frame or the current strip When the designated loop filter is turned on, the video image frame or the current strip is limited to refer to the fourth APS during filtering processing; wherein the fourth APS includes a second flag bit, and the The value of the second flag bit included in the fourth APS is used to indicate the default filter coefficient at the second corresponding position in the fourth APS.
  • the filtering unit 1104 is configured to: if the video image frame or the video image frame The current strip in does not turn on the specified loop filter, and the video image frame or the current strip refers to the third APS, then the third APS is applied to the video image frame or the When the current strip is filtered, the filter coefficient at the second corresponding position in the third APS is set to 0; wherein the third APS includes a second flag bit, and the third APS The value of the second flag bit contained in the APS is used to indicate that the third APS contains the filter coefficient at the second corresponding position, and the second corresponding position is located at the output signal of the DF unit. The corresponding coefficient position.
  • the filtering unit 1104 is configured to: if the video image frame or the current strip When the specified loop filter is turned on and the video image frame or the current strip refers to the fourth APS, the fourth APS is applied to the video image frame or the current strip for filtering.
  • the filter coefficient at the second corresponding position in the fourth APS is filled with 0; wherein the fourth APS contains a second flag bit, and the fourth APS contains The value of the second flag bit is used to indicate the default filter coefficient at the second corresponding position in the fourth APS.
  • the loop filtering device 1100 further includes: a processing unit configured to: if the If the video image frame or the current strip in the video image frame does not turn on the DF unit, then in the APS containing the filter coefficient of the video image frame or the current strip, the first corresponding position is The filter coefficient is set to 0, and the first corresponding position is the coefficient position corresponding to the signal input to the DF unit.
  • the filtering unit 1104 is configured to: if the video image frame or the video image If the current strip in the frame does not turn on the DF unit, then when the APS referenced by the video image frame or the current strip is applied to the video image frame or the current strip for filtering processing, The filter coefficient at the first corresponding position in the APS referenced by the video image frame or the current strip is set to 0, and the first corresponding position is the coefficient position corresponding to the signal input to the DF unit.
  • the loop filtering device 1100 further includes: a processing unit configured to: frame or the current strip in the video image frame does not turn on the specified loop filter, then in the APS containing the filter coefficient of the video image frame or the current strip, the second corresponding position The filter coefficient at is set to 0, and the second corresponding position is the coefficient position corresponding to the output signal of the DF unit.
  • the filtering unit 1104 is configured to: if the video image frame or the video image frame If the specified loop filter is not turned on for the current strip in , then the APS referenced by the video image frame or the current strip is applied to the video image frame or the current strip for filtering processing.
  • the filter coefficient at the second corresponding position in the APS referenced by the video image frame or the current strip is 0, and the second corresponding position is the coefficient corresponding to the output signal of the DF unit Location.
  • the specified loop filter includes at least one of the following: a double sideband filter, a sample adaptive compensation filter, and a cross-component sample adaptive compensation filter.
  • FIG. 12 shows a block diagram of a video decoding device according to an embodiment of the present application, and the video decoding device may be provided within a video decoding device.
  • a video decoding device 1200 includes: an acquisition unit 1202, a filtering unit 1204, and a decoding unit 1206.
  • the acquisition unit 1202 is configured to acquire the reconstruction component corresponding to the video image frame;
  • the filtering unit 1204 is configured to filter the reconstruction component through a loop filtering unit, the loop filtering unit includes sequentially connected DF units, designated The loop filter and the ALF unit; wherein, the input of the ALF unit also includes at least one of the following: the signal input to the DF unit, the output signal of the DF unit; and the output of the loop filter unit As the reconstructed image corresponding to the video image frame;
  • the decoding unit 1206 is configured to use the reconstructed image corresponding to the video image frame as the decoded video image.
  • FIG. 13 shows a block diagram of a video encoding device according to an embodiment of the present application, and the video encoding device may be disposed within a video encoding device.
  • a video encoding device 1300 includes: an acquisition unit 1302 and a filtering unit 1304.
  • the acquisition unit 1302 is configured to acquire the video image frame to be encoded and the reconstruction component corresponding to the video image frame to be encoded;
  • the filtering unit 1304 is configured to use a loop filtering unit to obtain the video image frame to be encoded corresponding to the video image frame to be encoded.
  • the reconstructed component is subjected to filtering processing.
  • the loop filter unit includes a DF unit, a designated loop filter and an ALF unit connected in sequence; wherein the input of the ALF unit also includes at least one of the following: input to the DF unit signal, the output signal of the DF unit; and using the output of the loop filter unit as the reconstructed image corresponding to the video image frame to be encoded.
  • the video encoding device 1300 further includes: an encoding unit configured to Whether the frame or the current strip in the video image frame turns on the DF unit, add a first flag bit in the APS containing the filter coefficient of the video image frame or the current strip, the first flag The value of the bit is used to indicate whether the filter coefficient at the first corresponding position is defaulted in the APS, and the first corresponding position is the coefficient position corresponding to the signal input to the DF unit.
  • the coding unit is configured to: if the video image frame or the current slice does not enable the DF unit, then the first flag added in the APS The value of the bit is set to a first value to indicate the default filter coefficient at the first corresponding position in the APS; if the video image frame or the current strip turns on the DF unit, then all The value of the first flag added in the APS is set to a second value to indicate that the APS contains the filter coefficient at the first corresponding position.
  • the video encoding device 1300 further includes: an encoding unit configured to Or whether the current strip in the video image frame turns on the specified loop filter, add a second flag bit in the APS containing the filter coefficient of the video image frame or the current strip, the The value of the second flag bit is used to indicate whether the filter coefficient at the second corresponding position is defaulted in the APS, and the second corresponding position is the coefficient position corresponding to the output signal of the DF unit.
  • the encoding unit is configured to: if the video image frame or the current slice does not turn on the specified loop filter, then add The value of the second flag bit is set to the first value to indicate the default filter coefficient at the second corresponding position in the APS; if the video image frame or the current strip turns on the specified loop filter, then set the value of the second flag bit added in the APS to the second value to indicate that the APS contains the filter coefficient at the second corresponding position.
  • FIG. 14 shows a schematic structural diagram of a computer system suitable for implementing an electronic device according to an embodiment of the present application.
  • the computer system 1400 includes a central processing unit (Central Processing Unit, CPU) 1401, which can be loaded into a random computer according to a program stored in a read-only memory (Read-Only Memory, ROM) 1402 or from a storage part 1408. Access the program in the memory (Random Access Memory, RAM) 1403 to perform various appropriate actions and processing, such as performing the method described in the above embodiment. In RAM 1403, various programs and data required for system operation are also stored.
  • CPU 1401, ROM 1402 and RAM 1403 are connected to each other through bus 1404.
  • An input/output (I/O) interface 1405 is also connected to bus 1404.
  • the following components are connected to the I/O interface 1405: an input part 1406 including a keyboard, a mouse, etc.; an output part 1407 including a cathode ray tube (Cathode Ray Tube, CRT), a liquid crystal display (Liquid Crystal Display, LCD), etc., and a speaker, etc. ; a storage part 1408 including a hard disk, etc.; and a communication part 1409 including a network interface card such as a LAN (Local Area Network) card, a modem, etc.
  • the communication section 1409 performs communication processing via a network such as the Internet.
  • Driver 1410 is also connected to I/O interface 1405 as needed.
  • Removable media 1411 such as magnetic disks, optical disks, magneto-optical disks, semiconductor memories, etc., are installed on the drive 1410 as needed, so that a computer program read therefrom is installed into the storage portion 1408 as needed.
  • the process described above with reference to the flowchart may be implemented as a computer software program.
  • embodiments of the present application include a computer program product including a computer program carried on a computer-readable medium, the computer program including a computer program for performing the method shown in the flowchart.
  • the computer program may be downloaded and installed from the network via communications portion 1409, and/or installed from removable media 1411.
  • CPU central processing unit
  • this application also provides a computer-readable medium.
  • the computer-readable medium may be included in the electronic device described in the above embodiments; it may also exist independently without being assembled into the electronic device. , such as non-volatile storage media in the form of CD-ROM, USB flash drive, mobile hard disk, etc.
  • the computer-readable medium carries one or more computer programs. When the one or more computer programs are executed by an electronic device, the electronic device implements the method described in the above embodiments.
  • the example embodiments described here can be implemented by software, or can be implemented by software combined with necessary hardware. Therefore, the technical solution according to the embodiment of the present application can be embodied in the form of a software product, which can be stored in a non-volatile storage medium (which can be a CD-ROM, U disk, mobile hard disk, etc.) or on the network , including several instructions to cause a computing device (which can be a personal computer, server, touch terminal, or network device, etc.) to execute the method according to the embodiment of the present application.
  • a non-volatile storage medium which can be a CD-ROM, U disk, mobile hard disk, etc.
  • a computing device which can be a personal computer, server, touch terminal, or network device, etc.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Compression Or Coding Systems Of Tv Signals (AREA)

Abstract

本申请的实施例提供了一种环路滤波方法、视频编解码方法、装置、介质、程序产品及电子设备。该环路滤波方法包括：获取视频图像帧对应的重建分量；通过环路滤波单元对所述重建分量进行滤波处理，所述环路滤波单元包括顺次相连的去块效应滤波DF单元、指定的环路滤波器和自适应环路滤波ALF单元；其中，所述ALF单元的输入还包括以下至少一个：输入至所述DF单元的信号、所述DF单元的输出信号；将所述环路滤波单元的输出作为所述视频图像帧对应的重建图像。

Description

环路滤波方法、视频编解码方法、装置、介质、程序产品及电子设备
相关申请的交叉引用
本申请基于申请号为202210444332.3、申请日为2022年4月20日的中国专利申请提出，并要求该中国专利申请的优先权，该中国专利申请的全部内容在此引入本申请作为参考。
技术领域
本申请涉及计算机及通信技术领域，具体而言，涉及一种环路滤波方法、视频编解码方法、装置、介质、程序产品及电子设备。
背景技术
自适应环路滤波(Adaptive Loop Filtering，ALF)是一种维纳滤波器，可以利用与滤波器模板覆盖范围内的周围像素的相关性导出最优系数，提升ALF滤波之后像素的质量，减少与原始像素的差异。但是相关技术中ALF使用的是固定模板，并且使用单一的环路滤波器的输出作为ALF的输入，这些都影响了ALF本身的性能，制约了滤波效果的提升。
发明内容
本申请的实施例提供了一种环路滤波方法、视频编解码方法、装置、介质、程序产品及电子设备，可以提高ALF的滤波效果和滤波质量，进而有利于提高编解码性能。
根据本申请实施例的一个方面，提供了一种环路滤波方法，包括：获取视频图像帧对应的重建分量；通过环路滤波单元对所述重建分量进行滤波处理，所述环路滤波单元包括顺次相连的去块效应滤波器(Deblocking filter，DF)单元、指定的环路滤波器和自适应环路滤波(Adaptive Loop Filter，ALF)单元；其中，所述ALF单元的输入还包括以下至少一个：输入至所述DF单元的信号、所述DF单元的输出信号；将所述环路滤波单元的输出作为所述视频图像帧对应的重建图像。
根据本申请实施例的一个方面，提供了一种视频解码方法，包括：通过本申请实施例中的环路滤波方法对视频图像帧对应的重建分量进行滤波处理，得到所述视频图像帧对应的重建图像；将所述视频图像帧对应的重建图像作为解码得到的视频图像。
根据本申请实施例的一个方面，提供了一种视频编码方法，包括：获 取待编码的视频图像帧；通过本申请实施例中的环路滤波方法对所述待编码的视频图像帧所对应的重建分量进行滤波处理，得到所述待编码的视频图像帧对应的重建图像。
根据本申请实施例的一个方面，提供了一种环路滤波装置，包括：获取单元，配置为获取视频图像帧对应的重建分量；滤波单元，配置为通过环路滤波单元对所述重建分量进行滤波处理，所述环路滤波单元包括顺次相连的DF单元、指定的环路滤波器和ALF单元；其中，所述ALF单元的输入还包括以下至少一个：输入至所述DF单元的信号、所述DF单元的输出信号；以及将所述环路滤波单元的输出作为所述视频图像帧对应的重建图像。
根据本申请实施例的一个方面，提供了一种视频解码装置，包括：获取单元，配置为获取视频图像帧对应的重建分量；滤波单元，配置为通过环路滤波单元对所述重建分量进行滤波处理，所述环路滤波单元包括顺次相连的DF单元、指定的环路滤波器和ALF单元；其中，所述ALF单元的输入还包括以下至少一个：输入至所述DF单元的信号、所述DF单元的输出信号；以及将所述环路滤波单元的输出作为所述视频图像帧对应的重建图像；解码单元，配置为将所述视频图像帧对应的重建图像作为解码得到的视频图像。
根据本申请实施例的一个方面，提供了一种视频编码装置，包括：获取单元，配置为获取待编码的视频图像帧，以及所述待编码的视频图像帧对应的重建分量；滤波单元，配置为通过环路滤波单元对所述待编码的视频图像帧对应的重建分量进行滤波处理，所述环路滤波单元包括顺次相连的DF单元、指定的环路滤波器和ALF单元；其中，所述ALF单元的输入还包括以下至少一个：输入至所述DF单元的信号、所述DF单元的输出信号；以及将所述环路滤波单元的输出作为所述待编码的视频图像帧对应的重建图像。
根据本申请实施例的一个方面，提供了一种计算机可读介质，其上存储有计算机程序，所述计算机程序被处理器执行时实现如上述实施例中所述的环路滤波方法、视频解码方法或视频编码方法。
根据本申请实施例的一个方面，提供了一种电子设备，包括：一个或多个处理器；存储装置，用于存储一个或多个计算机程序，当所述一个或多个计算机程序被所述一个或多个处理器执行时，使得所述电子设备实现如上述实施例中所述的环路滤波方法、视频解码方法或视频编码方法。
根据本申请实施例的一个方面，提供了一种计算机程序产品，该计算机程序产品包括计算机程序，该计算机程序存储在计算机可读存储介质中。电子设备的处理器从计算机可读存储介质读取并执行该计算机程序，使得该电子设备执行上述各种可选实施例中提供的环路滤波方法、视频解码方法或视频编码方法。
在本申请的一些实施例所提供的技术方案中，通过在环路滤波时，将输入至DF单元的信号与DF单元的输出信号中的至少一个作为ALF单元额外的输入信号，使得ALFF单元的滤波过程能够参考当前待滤波像素和周边像素的相关性，从而利用周边像素的相关性实现了动态的自适应的滤波处理，与相关技术使用固定模板的滤波方案相比，滤波更有针对性，提高了ALF的滤波效果和滤波质量，进而有利于提高编解码性能。
应当理解的是，以上的一般描述和后文的细节描述仅是示例性和解释性的，并不能限制本申请。
附图说明
此处的附图被并入说明书中并构成本说明书的一部分，示出了符合本申请的实施例，并与说明书一起用于解释本申请的原理。显而易见地，下面描述中的附图仅仅是本申请的一些实施例，对于本领域普通技术人员来讲，在不付出创造性劳动的前提下，还可以根据这些附图获得其他的附图。在附图中：
图1示出了可以应用本申请实施例的技术方案的示例性系统架构的示意图；
图2示出视频编码装置和视频解码装置在流式传输系统中的放置方式示意图；
图3示出了一个视频编码器的基本流程图；
图4示出了VVC的整体结构以及环路滤波过程示意图；
图5示出了VCC中环路滤波的模块结构示意图；
图6示出了ECM中环路滤波的模块结构示意图；
图7示出了本申请一个实施例中环路滤波的模块结构示意图；
图8示出了本申请一个实施例中环路滤波的模块结构示意图；
图9示出了本申请一个实施例中环路滤波的模块结构示意图；
图10示出了根据本申请的一个实施例的环路滤波方法的流程图；
图11示出了根据本申请的一个实施例的环形滤波装置的框图；
图12示出了根据本申请的一个实施例的视频解码装置的框图；
图13示出了根据本申请的一个实施例的视频编码装置的框图；
图14示出了适于用来实现本申请实施例的电子设备的计算机系统的结构示意图。
具体实施方式
现在参考附图以更全面的方式描述示例实施方式。然而，示例的实施方式能够以各种形式实施，且不应被理解为仅限于这些范例；相反，提供这些实施方式的目的是使得本申请更加全面和完整，并将示例实施方式的 构思全面地传达给本领域的技术人员。
此外，本申请所描述的特征、结构或特性可以以任何合适的方式结合在一个或更多实施例中。在下面的描述中，有许多具体细节从而可以充分理解本申请的实施例。然而，本领域技术人员应意识到，在实施本申请的技术方案时可以不需用到实施例中的所有细节特征，可以省略一个或更多特定细节，或者可以采用其它的方法、元件、装置、步骤等。
附图中所示的方框图仅仅是功能实体，不一定必须与物理上独立的实体相对应。即，可以采用软件形式来实现这些功能实体，或在一个或多个硬件模块或集成电路中实现这些功能实体，或在不同网络和/或处理器装置和/或微控制器装置中实现这些功能实体。
附图中所示的流程图仅是示例性说明，不是必须包括所有的内容和操作/步骤，也不是必须按所描述的顺序执行。例如，有的操作/步骤还可以分解，而有的操作/步骤可以合并或部分合并，因此实际执行的顺序有可能根据实际情况改变。
图1示出了可以应用本申请实施例的技术方案的示例性系统架构的示意图。
如图1所示，系统架构100包括多个电子设备，所述电子设备可通过例如网络150彼此通信。举例来说，系统架构100可以包括通过网络150互连的第一电子设备110和第二电子设备120。在图1的实施例中，第一电子设备110和第二电子设备120执行单向数据传输。
举例来说，第一电子设备110可对视频数据(例如由电子设备110采集的视频图片流)进行编码以通过网络150传输到第二电子设备120，已编码的视频数据以一个或多个已编码视频码流形式传输，第二电子设备120可从网络150接收已编码视频数据，对已编码视频数据进行解码以恢复视频数据，并根据恢复的视频数据显示视频图片。
在本申请的一个实施例中，系统架构100可以包括执行已编码视频数据的双向传输的第三电子设备130和第四电子设备140，所述双向传输比如可以发生在视频会议期间。对于双向数据传输，第三电子设备130和第四电子设备140中的每个电子设备可对视频数据(例如由电子设备采集的视频图片流)进行编码，以通过网络150传输到第三电子设备130和第四电子设备140中的另一电子设备。第三电子设备130和第四电子设备140中的每个电子设备还可接收由第三电子设备130和第四电子设备140中的另一电子设备传输的已编码视频数据，且可对已编码视频数据进行解码以恢复视频数据，并可根据恢复的视频数据在可访问的显示装置上显示视频图片。
在图1的实施例中，第一电子设备110、第二电子设备120、第三电子设备130和第四电子设备140可为服务器或者终端，服务器可以是独立的物理服务器，也可以是多个物理服务器构成的服务器集群或者分布式系统， 还可以是提供云服务、云数据库、云计算、云函数、云存储、网络服务、云通信、中间件服务、域名服务、安全服务、内容分发网络(Content Delivery Network，CDN)、以及大数据和人工智能平台等基础云计算服务的云服务器。终端可以是智能手机、平板电脑、笔记本电脑、台式计算机、智能音箱、智能手表、智能语音交互设备、智能家电、车载终端、飞行器等，但并不局限于此。
网络150表示在第一电子设备110、第二电子设备120、第三电子设备130和第四电子设备140之间传送已编码视频数据的任何数目的网络，包括例如有线和/或无线通信网络。通信网络150可在电路交换和/或分组交换信道中交换数据。该网络可包括电信网络、局域网、广域网和/或互联网。出于本申请的目的，除非在下文中有所解释，否则网络150的架构和拓扑对于本申请公开的操作来说可能是无关紧要的。
在本申请的一个实施例中，图2示出视频编码装置和视频解码装置在流式传输环境中的放置方式。本申请所公开主题可同等地适用于其它支持视频的应用，包括例如视频会议、数字电视机(TeleVision，TV)、在包括CD、DVD、存储棒等的数字介质上存储压缩视频等等。
流式传输系统可包括采集子系统213，采集子系统213可包括数码相机等视频源201，视频源创建未压缩的视频图片流202。在一些实施例中，视频图片流202包括由数码相机拍摄的样本。相较于已编码的视频数据204(或已编码的视频码流204)，视频图片流202被描绘为粗线以强调高数据量的视频图片流，视频图片流202可由电子装置220处理，电子装置220包括耦接到视频源201的视频编码装置203。视频编码装置203可包括硬件、软件或软硬件组合以实现或实施如下文更详细地描述的所公开主题的各方面。相较于视频图片流202，已编码的视频数据204(或已编码的视频码流204)被描绘为细线以强调较低数据量的已编码的视频数据204(或已编码的视频码流204)，其可存储在流式传输服务器205上以供将来使用。一个或多个流式传输客户端子系统，例如图2中的客户端子系统206和客户端子系统208，可访问流式传输服务器205以检索已编码的视频数据204的副本207和副本209。客户端子系统206可包括例如电子装置230中的视频解码装置210。视频解码装置210对已编码的视频数据的传入副本207进行解码，且产生可在显示器212(例如显示屏)或另一呈现装置上呈现的输出视频图片流211。在一些流式传输系统中，可根据某些视频编码/压缩标准对已编码的视频数据204、视频数据207和视频数据209(例如视频码流)进行编码。
应注意，电子装置220和电子装置230可包括图中未示出的其它组件。举例来说，电子装置220可包括视频解码装置，且电子装置230还可包括视频编码装置。
在本申请的一个实施例中，以国际视频编码标准是高效率视频编码 (High Efficiency Video Coding，HEVC)、多功能视频编码(Versatile Video Coding，VVC)，以及中国国家视频编码标准(Audio Video coding Standard，AVS)为例，当输入一个视频帧图像之后，会根据一个块大小，将视频帧图像划分成若干个不重叠的处理单元，每个处理单元将进行类似的压缩操作。这个处理单元被称作CTU，或者称之为最大编码单元(Largest Coding Unit，LCU)。CTU再往下可以继续进行更加精细的划分，得到一个或多个基本的编码单元(Coding Unit，CU)，CU是一个编码环节中最基本的元素。
以下介绍对CU进行编码时的一些概念：
预测编码(Predictive Coding)：预测编码包括了帧内预测和帧间预测等方式，原始视频信号经过选定的已重建视频信号的预测后，得到残差视频信号。编码端需要为当前CU决定选择哪一种预测编码模式，并告知解码端。其中，帧内预测是指预测的信号来自于同一图像内已经编码重建过的区域；帧间预测是指预测的信号来自已经编码过的、不同于当前图像的其它图像(称之为参考图像)。
变换及量化(Transform & Quantization)：残差视频信号经过离散傅里叶变换(Discrete Fourier Transform，DFT)、离散余弦变换(Discrete Cosine Transform，DCT)等变换操作后，将信号转换到变换域中，称之为变换系数。变换系数进一步进行有损的量化操作，丢失掉一定的信息，使得量化后的信号有利于压缩表达。在一些视频编码标准中，可能有多于一种变换方式可以选择，因此编码端也需要为当前CU选择其中的一种变换方式，并告知解码端。量化的精细程度通常由量化参数(Quantization Parameter，QP)来决定，QP取值较大，表示更大取值范围的系数将被量化为同一个输出，因此通常会带来更大的失真及较低的码率；相反，QP取值较小，表示较小取值范围的系数将被量化为同一个输出，因此通常会带来较小的失真，同时对应较高的码率。
熵编码(Entropy Coding)或统计编码：量化后的变换域信号将根据各个值出现的频率进行统计压缩编码，最后输出二值化(0或者1)的压缩码流。同时，编码产生其他信息，例如选择的编码模式、运动矢量数据等，也需要进行熵编码以降低码率。统计编码是一种无损的编码方式，可以有效的降低表达同样信号所需要的码率，常见的统计编码方式有变长编码(Variable Length Coding，VLC)或者基于上下文的二值化算术编码(Content Adaptive Binary Arithmetic Coding，CABAC)。
基于上下文的二值化算术编码(Context-based Adaptive Binary Arithmetic Coding，CABAC)过程主要包含3个步骤：二值化、上下文建模和二进制算术编码。在对输入的语法元素进行二值化处理后，可以通过常规编码模式和旁路编码模式(Bypass Coding Mode)对二元数据进行编码。旁路编码模式无须为每个二元位分配特定的概率模型，输入的二元位bin值直接用一个简单的旁路编码器进行编码，以加快整个编码以及解码的速 度。一般情况下，不同的语法元素之间并不是完全独立的，且相同语法元素自身也具有一定的记忆性。因此，根据条件熵理论，利用其他已编码的语法元素进行条件编码，相对于独立编码或者无记忆编码能够进一步提高编码性能。这些用来作为条件的已编码符号信息称为上下文。在常规编码模式中，语法元素的二元位顺序地进入上下文模型器，编码器根据先前编码过的语法元素或二元位的值，为每一个输入的二元位分配合适的概率模型，该过程即为上下文建模。通过上下文索引增量(context index increment，ctxIdxInc)和上下文起始索引(context index Start，ctxIdxStart)即可定位到语法元素所对应的上下文模型。将bin值和分配的概率模型一起送入二元算术编码器进行编码后，需要根据bin值更新上下文模型，也就是编码中的自适应过程。
环路滤波(Loop Filtering)：经过变化及量化的信号会通过反量化、反变换及预测补偿的操作获得重建图像。重建图像与原始图像相比由于存在量化的影响，部分信息与原始图像有所不同，即重建图像会产生失真(Distortion)。因此，可以对重建图像进行滤波操作，以有效降低量化所产生的失真程度。由于这些经过滤波后的重建图像将作为后续编码图像的参考来对将来的图像信号进行预测，因此上述的滤波操作也被称为环路滤波，即在编码环路内的滤波操作。
在本申请的一个实施例中，图3示出了一个视频编码器的基本流程图，在该流程中以帧内预测为例进行说明。其中，原始图像信号s k[x,y]与预测图像信号
Figure PCTCN2022137900-appb-000001
做差值运算，得到残差信号u k[x,y]，残差信号u k[x,y]经过变换及量化处理之后得到量化系数，量化系数一方面用于通过熵编码得到编码后的比特流，另一方面用于通过反量化及反变换处理得到重构残差信号u' k[x,y]，预测图像信号
Figure PCTCN2022137900-appb-000002
与重构残差信号u' k[x,y]叠加生成重建图像信号
Figure PCTCN2022137900-appb-000003
重建图像信号
Figure PCTCN2022137900-appb-000004
一方面输入至帧内模式决策模块和帧内预测模块进行帧内预测处理，另一方面通过环路滤波进行滤波处理，并输出滤波后的图像信号s' k[x,y]，滤波后的图像信号s' k[x,y]可以作为下一帧的参考图像进行运动估计及运动补偿预测。然后基于运动补偿预测的结果s' r[x+m x,y+m y]和帧内预测结果
Figure PCTCN2022137900-appb-000005
得到下一帧的预测图像信号
Figure PCTCN2022137900-appb-000006
并继续重复上述过程，直至编码完成。
在上述的编码流程中，环路滤波是视频编码的核心模块之一，可以有效去除多种编码失真。最新一代国际视频编码标准VVC支持四种不同类型的环路滤波器：DF、样点自适应补偿(Sample Adaptive Offset，SAO)、ALF以及跨分量自适应环路滤波(CC-ALF)。
在一些实施例中，VVC的整体结构以及环路滤波过程如图4所示，其整体流程与图3所示的编码器流程类似，在环路滤波中，ALF和CC-ALF是一种维纳滤波器，可以根据不同视频分量的内容自适应的决定滤波器系 数，从而减少重建分量和原始分量之间的均方误差(Mean Square Error，MSE)。其中，ALF的输入是经过DF和SAO滤波后的重建像素值，输出的是经过增强的重建亮度图像和重建色度图像；而CC-ALF的输入是经过DF和SAO滤波后、且未经ALF处理之前的亮度分量，输出的是对应的色度分量的修正值。即CC-ALF只作用于色度分量，具体是利用亮度分量和色度分量之间的相关性，通过对亮度分量的线性滤波得到色度分量的修正值，该修正值与经过ALF滤波后的色度分量相加，作为最终的重建色度分量。作为一种自适应滤波器，维纳滤波器可以为不同特性的视频内容产生不同的滤波系数，因此ALF与CC-ALF需要将视频内容进行分类，为各个类别的视频内容使用对应的滤波器。在当前的VVC设计中，亮度分量的ALF支持25种不同类别的滤波器，每个色度分量的ALF最多支持8种不同类别的滤波器，而每个色度分量的CC-ALF最多支持4种不同类别的滤波器。
ALF滤波器相关参数保存在APS中。一个APS可以包含最多25组亮度滤波器系数及对应的限幅值索引、两个色度分量最多8组色度滤波器系数与对应的限幅值索引，以及每个色度分量最多4组CC-ALF滤波器系数。
如图5所示，VVC中的环路滤波过程包含五个主要模块：亮度映射色度缩放(Luma Mapping with Chroma Scaling，LMCS)、DF、样点自适应补偿(SAO)、ALF以及CC-ALF。这五个模块的输入输出关系如图5所示，重建像素输入至LMCS，DF的输入是经过LMCS处理后的重建像素，而ALF的输入是经过DF和SAO处理之后的重建像素值，输出为经过ALF滤波增强的像素值。ALF滤波过程可以通过如下述公式(1)所示：
Figure PCTCN2022137900-appb-000007
在公式(1)中，
Figure PCTCN2022137900-appb-000008
表示滤波后的像素；R(x,y)表示当前待滤波像素；f i,0,f i,1表示VVC使用的ALF滤波器模板所覆盖的周边像素与当前像素差值的限幅值；c i,i＝0,…,11表示滤波器模板中对应位置的滤波器系数，需要传送至解码端。VVC使用的ALF滤波器可以为形状呈中心对称的7×7菱形滤波器。
在VVC基础上，进一步增强的压缩模型(Enhanced Compression Model，ECM)已经开始进行探索研究。ECM的环路滤波部分除继续使用VVC中已有的环路滤波器外，还额外引入了多种环路滤波器，比如双边带滤波(Bilateral Filtering，BIF)、跨分量样点自适应补偿(Cross-Component Sample Adaptive Offset，CCSAO)。ECM的环路滤波过程如图6所示，BIF和CCSAO与SAO并行操作，产生的修正值与SAO产生的修正值同时加入到经过去块效应滤波的重建像素上，因此ECM中ALF的输入是经过BIF、SAO、CCSAO处理之后的重建值，输出为增强的像素值。ALF滤波过程可以通过 如下述公式(2)所示：
Figure PCTCN2022137900-appb-000009
在公式(2)中，
Figure PCTCN2022137900-appb-000010
表示滤波后的像素；R(x,y)表示当前待滤波像素；f i,0,f i,1表示ECM使用的ALF滤波器模板所覆盖的周边像素与当前像素差值的限幅值；c i,i＝0,…,19表示滤波器模板中对应位置的滤波器系数；g i表示固定滤波器产生的中间值与当前待滤波像素值的差值的限幅值；c i,i＝20,21表示中间值对应的滤波器系数。这些滤波器系数同样需要传送至解码端。ECM使用的ALF滤波器可以是形状呈中心对称的9×9菱形滤波器。
ECM中的ALF可以只使用SAO之后的重建像素作为ALF的输入。由于相关技术中ALF使用的是固定模板，并且使用单一的环路滤波器的输出作为ALF的输入，这些都影响了ALF本身的性能。
在此基础上，本申请的实施例提出了使用去块效应滤波之前的重建像素作为ALF的一个额外输入的方案，以取得进一步的性能提升。具体如图7所示，将LMCS的输出之后、DF输入之前的重建像素作为ALF的一个额外输入，ALF的滤波过程可以通过如下述公式(3)所示：
Figure PCTCN2022137900-appb-000011
在公式(3)中，
Figure PCTCN2022137900-appb-000012
表示滤波后的像素；R(x,y)表示当前待滤波像素；f i,0,f i,1表示ECM使用的ALF滤波器模板所覆盖的周边像素与当前像素差值的限幅值；c i,i＝0,…,19，表示滤波器模板中对应位置的滤波器系数；g i表示固定滤波器产生的中间值与当前待滤波像素值的差值的限幅值；c i,i＝20,21，表示中间值对应的滤波器系数；h i,0,h i,1表示去块效应滤波之前的周围像素与当前像素差值的限幅值；c i,i＝22,…,N，表示去块效应滤波之前像素差值对应的滤波器系数，同样需要传送至解码端；N-22表示去块效应滤波之前像素差值对应需要索引传送的系数个数。本申请实施例中使用的ALF滤波器形状可以为中心对称的9×9菱形滤波器。
除了使用去块效应滤波之前的重建像素作为ALF的一个额外输入的方案之外，本申请实施例还提出了可以使用去块效应滤波之后且下一步环路滤波之前的重建像素作为ALF的一个额外输入的方案，以取得进一步的性能提升。具体如图8所示，将DF的输出之后、SAO输入之前的重建像素作为ALF的一个额外输入，ALF的滤波过程可以通过如下述公式(4)所示：
Figure PCTCN2022137900-appb-000013
在公式(4)中，
Figure PCTCN2022137900-appb-000014
表示滤波后的像素；R(x,y)表示当前待滤波像素；f i,0,f i,1表示ECM使用的ALF滤波器模板所覆盖的周边像素与当前像素差值的限幅值；c i,i＝0,…,19，表示滤波器模板中对应位置的滤波器系数；g i表示固定滤波器产生的中间值与当前待滤波像素值的差值的限幅值；c i,i＝20,21，表示中间值对应的滤波器系数；p i,0,p i,1表示去块效应滤波之后且下一步环路滤波之前的重建像素与当前像素差值的限幅值；c i,i＝22,…,K，表示去块效应滤波之后的像素差值对应的滤波器系数，同样需要传送至解码端；本申请实施例中使用的ALF滤波器形状可以是任意形状。
另外，本申请实施例还提出了可以同时使用去块效应滤波之前的重建像素，以及使用去块效应滤波之后且下一步环路滤波之前的重建像素作为ALF的额外输入的方案，以取得进一步的性能提升。具体如图9所示，将LMCS的输出之后、DF输入之前的重建像素，以及DF的输出之后、SAO输入之前的重建像素作为ALF的额外输入，ALF的滤波过程可以通过如下述公式所示：
Figure PCTCN2022137900-appb-000015
该公式中具体参数的含义同前述公式(3)和公式(4)。
需要说明的是，在图7至图9中，DF输出之后的环路滤波器既可以是图7至图9中所示的由SAO、BIF和CCSAO并行处理的方式，也可以替换为SAO、BIF和CCSAO中的一个滤波器单独处理的方式，还可以替换为SAO、BIF和CCSAO中的两个滤波器并行处理的方式。
以下对本申请实施例的技术方案的实现细节进行详细阐述：
图10示出了根据本申请的一个实施例的环路滤波方法的流程图，该环路滤波方法可以由视频编码设备或者视频解码设备来执行。参照图10所示，该环路滤波方法至少包括步骤S1010至步骤S1030，详细介绍如下：
在步骤S1010中，获取视频图像帧对应的重建分量。
在本申请的一个实施例中，视频图像帧对应的重建分量可以是重构残差信号与预测图像信号叠加之后生成的重建图像信号。对于编码端而言，视频图像帧对应的重建分量是待编码的视频图像帧对应的重建分量；对于解码端而言，视频图像帧对应的重建分量是解码得到的重建分量。
在步骤S1020中，通过环路滤波单元对视频图像帧对应的重建分量进行滤波处理，该环路滤波单元包括顺次相连的DF单元、指定的环路滤波器和自适应环路滤波ALF单元；其中，ALF单元的输入还包括以下至少一个： 输入至DF单元的信号、DF单元的输出信号。
在一些实施例中，指定的环路滤波器包括以下至少一种：双边带滤波器BIF、样点自适应补偿滤波器SAO、跨分量样点自适应补偿滤波器CCSAO。如果包含SAO、BIF和CCSAO中的两种或三种，那么这些环路滤波器可以采用并行处理的方式。
在本申请的实施例中，如果ALF单元的输入还包括输入至DF单元的信号，那么具体的环路滤波过程可以如图7所示；如果ALF单元的输入还包括DF单元的输出信号，那么具体的环路滤波过程可以如图8所示；如果ALF单元的输入还包括输入至DF单元的信号和DF单元的输出信号，那么具体的环路滤波过程可以如图9所示。
当然，在图7至图9中是以指定的环路滤波器是SAO、BIF和CCSAO并行处理的方式来表示的。在本申请的其它实施例中，指定的环路滤波器也可以替换为SAO、BIF和CCSAO中的一个滤波器单独处理的方式，还可以替换为SAO、BIF和CCSAO中的两个滤波器并行处理的方式。
以下分别对ALF单元的输入还包括输入至DF单元的信号，或者还包括DF单元的输出信号，或者包括输入至DF单元的信号和DF单元的输出信号为例对具体的滤波过程进行详细阐述。
下面说明ALF单元的输入包括输入至DF单元的信号的应用场景。
在本申请的一个实施例中，若ALF单元的输入包括输入至DF单元的信号，那么在滤波处理时，如果视频图像帧或视频图像帧中的当前条带不开启DF单元，则在滤波处理时限制视频图像帧或当前条带参考第一APS；其中，第一APS中包含有第一标志位，且第一APS中所包含的第一标志位的值用于指示第一自适应参数集APS中包含有第一对应位置处的滤波器系数，第一对应位置为输入至DF单元的信号所对应的系数位置。
在本申请实施例中，由于视频图像帧或当前条带不开启DF单元，那么在滤波处理时没有必要使用输入至DF单元的信号所对应的滤波器系数，因此可以限制视频图像帧或当前条带参考第一APS，即限制参考包含有输入至DF单元的信号所对应的滤波器系数的APS。
在本申请的一个实施例中，若ALF单元的输入包括输入至DF单元的信号，那么在滤波处理时，若视频图像帧或当前条带开启DF单元，则在滤波处理时限制视频图像帧或当前条带参考第二APS；其中，第二APS中包含有第一标志位，且第二APS中所包含的第一标志位的值用于指示第二APS中缺省第一对应位置处的滤波器系数。
在本申请实施例中，由于视频图像帧或当前条带开启DF单元，那么在滤波处理时需要使用输入至DF单元的信号所对应的滤波器系数，因此可以限制视频图像帧或当前条带参考第二APS，即限制参考缺省了输入至DF单元的信号所对应的滤波器系数的APS。
在本申请的一个实施例中，若ALF单元的输入包括输入至DF单元的 信号，那么在滤波处理时，若视频图像帧或视频图像帧的当前条带不开启DF单元，且视频图像帧或当前条带参考第一APS，则在将第一APS应用到视频图像帧或当前条带进行滤波处理时，将第一APS中的第一对应位置处的滤波器系数设置为0；其中，第一APS中包含有第一标志位，且第一APS中所包含的第一标志位的值用于指示第一APS中包含有第一对应位置处的滤波器系数，第一对应位置为输入至DF单元的信号所对应的系数位置。
在本申请实施例中，由于视频图像帧或当前条带不开启DF单元，那么在滤波处理时没有必要使用输入至DF单元的信号所对应的滤波器系数，因此如果视频图像帧或当前条带参考了包含有输入至DF单元的信号所对应的滤波器系数的第一APS，那么可以将第一APS中第一对应位置处的滤波器系数设置为0。
在本申请的一个实施例中，若ALF单元的输入包括输入至DF单元的信号，那么在滤波处理时，若视频图像帧或当前条带开启DF单元，且视频图像帧或当前条带参考第二APS，则在将第二APS应用到视频图像帧或当前条带进行滤波处理时，将第二APS中的第一对应位置处的滤波器系数填充为0；其中，第二APS中包含有第一标志位，且第二APS中所包含的第一标志位的值用于指示第二APS中缺省第一对应位置处的滤波器系数。
在本申请实施例中，由于视频图像帧或当前条带开启DF单元，那么在滤波处理时需要使用输入至DF单元的信号所对应的滤波器系数，因此如果视频图像帧或当前条带参考了缺省输入至DF单元的信号所对应的滤波器系数的第二APS，那么可以将第二APS中第一对应位置处的滤波器系数填充为0。
在本申请的一个实施例中，若ALF单元的输入包括输入至DF单元的信号，那么在视频图像帧或视频图像帧中的当前条带不开启DF单元时，可以在包含视频图像帧或当前条带的滤波器系数的APS中，将第一对应位置处的滤波器系数设为0，该第一对应位置为输入至DF单元的信号所对应的系数位置。
在本申请实施例中，由于视频图像帧或当前条带不开启DF单元，那么在滤波处理时没有必要使用输入至DF单元的信号所对应的滤波器系数，因此可以将包含视频图像帧或当前条带的滤波器系数的APS中第一对应位置处的滤波器系数设置为0，以减少编解码冗余。
在本申请的一个实施例中，若ALF单元的输入包括输入至DF单元的信号，且视频图像帧或视频图像帧中的当前条带不开启DF单元，那么在将视频图像帧或当前条带所参考的APS应用到视频图像帧或当前条带进行滤波处理时，可以将视频图像帧或当前条带所参考的APS中第一对应位置处的滤波器系数设置为0，第一对应位置为输入至DF单元的信号所对应的系数位置。
在本申请实施例中，由于视频图像帧或当前条带不开启DF单元，那么 在滤波处理时没有必要使用输入至DF单元的信号所对应的滤波器系数，因此可以将视频图像帧或当前条带所参考的APS中第一对应位置处的滤波器系数设置为0。
下面说明ALF单元的输入包括DF单元的输出信号的应用场景。
在本申请的一个实施例中，若ALF单元的输入包括DF单元的输出信号，那么在滤波处理时，如果视频图像帧或视频图像帧中的当前条带不开启指定的环路滤波器，则在滤波处理时限制视频图像帧或当前条带参考第三APS；其中，第三APS中包含有第二标志位、且第三APS中所包含的第二标志位的值用于指示第三APS中包含有第二对应位置处的滤波器系数，第二对应位置为指DF单元的输出信号所对应的系数位置。
在本申请实施例中，由于视频图像帧或当前条带不开启指定的环路滤波器，那么在滤波处理时没有必要使用输入至指定的环路滤波器的信号(即DF单元的输出信号)所对应的滤波器系数，因此可以限制视频图像帧或当前条带参考第三APS，即限制参考包含有DF单元的输出信号所对应的滤波器系数的APS。
在本申请的一个实施例中，若ALF单元的输入包括DF单元的输出信号，那么在滤波处理时，如果视频图像帧或当前条带开启指定的环路滤波器，则在滤波处理时限制视频图像帧或当前条带参考第四APS；其中，第四APS中包含有第二标志位、且第四APS中所包含的第二标志位的值用于指示第四APS中缺省第二对应位置处的滤波器系数。
在本申请实施例中，由于视频图像帧或当前条带开启指定的环路滤波器，那么在滤波处理时需要使用DF单元的输出信号所对应的滤波器系数，因此可以限制视频图像帧或当前条带参考第四APS，即限制参考缺省了DF单元的输出信号所对应的滤波器系数的APS。
在本申请的一个实施例中，若ALF单元的输入包括DF单元的输出信号，那么在滤波处理时，如果视频图像帧或视频图像帧中的当前条带不开启指定的环路滤波器，且视频图像帧或当前条带参考第三APS，则在将第三APS应用到视频图像帧或当前条带进行滤波处理时，将第三APS中的第二对应位置处的滤波器系数设置为0；其中，第三APS中包含有第二标志位、且第三APS中所包含的第二标志位的值用于指示第三APS中包含有第二对应位置处的滤波器系数，第二对应位置为指DF单元的输出信号所对应的系数位置。
在本申请实施例中，由于视频图像帧或当前条带不开启指定的环路滤波器，那么在滤波处理时没有必要使用DF单元的输出信号所对应的滤波器系数，因此如果视频图像帧或当前条带参考了包含有DF单元的输出信号所对应的滤波器系数的第三APS，那么可以将第三APS中第二对应位置处的滤波器系数设置为0。
在本申请的一个实施例中，若ALF单元的输入包括DF单元的输出信 号，那么在滤波处理时，若视频图像帧或当前条带开启指定的环路滤波器，且视频图像帧或当前条带参考第四APS，则在将第四APS应用到视频图像帧或当前条带进行滤波处理时，将第四APS中的第二对应位置处的滤波器系数填充为0；其中，第四APS中包含有第二标志位、且第四APS中所包含的第二标志位的值用于指示第四APS中缺省第二对应位置处的滤波器系数。
在本申请实施例中，由于视频图像帧或当前条带开启指定的环路滤波器，那么在滤波处理时需要使用DF单元的输出信号所对应的滤波器系数，因此如果视频图像帧或当前条带参考了缺省DF单元的输出信号所对应的滤波器系数的第四APS，那么可以将第四APS中第二对应位置处的滤波器系数填充为0。
在本申请的一个实施例中，若ALF单元的输入包括DF单元的输出信号，那么在视频图像帧或视频图像帧中的当前条带不开启指定的环路滤波器时，可以在包含视频图像帧或当前条带的滤波器系数的APS中，将第二对应位置处的滤波器系数设为0，该第二对应位置为DF单元的输出信号所对应的系数位置。
在本申请实施例中，由于视频图像帧或当前条带不开启指定的环路滤波器，那么在滤波处理时没有必要使用DF单元的输出信号所对应的滤波器系数，因此可以将包含视频图像帧或当前条带的滤波器系数的APS中第二对应位置处的滤波器系数设置为0，以减少编解码冗余。
在本申请的一个实施例中，若ALF单元的输入包括DF单元的输出信号，且视频图像帧或视频图像帧中的当前条带不开启指定的环路滤波器，那么在将视频图像帧或当前条带所参考的APS应用到视频图像帧或当前条带进行滤波处理时，可以将视频图像帧或当前条带所参考的APS中第二对应位置处的滤波器系数设置为0，第二对应位置为DF单元的输出信号所对应的系数位置。
在本申请实施例中，由于视频图像帧或当前条带不开启指定的环路滤波器，那么在滤波处理时没有必要使用DF单元的输出信号所对应的滤波器系数，因此可以将视频图像帧或当前条带所参考的APS中第二对应位置处的滤波器系数设置为0。
下面说明ALF单元的输入包括输入至DF单元的信号，以及DF单元的输出信号的应用场景。
在这种应用场景下，是将前述的ALF单元的输入包括输入至DF单元的信号的实施例，以及ALF单元的输入包括DF单元的输出信号的实施例进行结合，即根据是否开启DF单元，以及是否开启指定的环路滤波器来限制视频图像帧或当前条带所参考的APS，以及滤波处理时是否将对应位置的滤波器系数设置为0。
在步骤S1030中，将环路滤波单元的输出作为视频图像帧对应的重建 图像。
在本申请的一个实施例中，如果将图10所示的环路滤波方法应用到视频解码方法中，那么在得到视频图像帧对应的重建图像之后，可以将视频图像帧对应的重建图像作为解码得到的视频图像。
在本申请的一个实施例中，如果将图10所示的环路滤波方法应用到视频编码方法中，那么可以通过该环路滤波方法对待编码的视频图像帧所对应的重建分量进行滤波处理，得到待编码的视频图像帧对应的重建图像。
在一些实施例中，在本申请实施例的视频编码方法中，如果ALF单元的输入包括输入至DF单元的信号，那么可以根据视频图像帧或视频图像帧中的当前条带是否开启DF单元，在包含视频图像帧或当前条带的滤波器系数的APS中添加第一标志位，该第一标志位的值用于指示APS中是否缺省第一对应位置处的滤波器系数，该第一对应位置为输入至DF单元的信号所对应的系数位置。
具体地，比如若视频图像帧或当前条带不开启DF单元，则将APS中添加的第一标志位的值设置为第一值，以指示APS中缺省第一对应位置处的滤波器系数；若视频图像帧或当前条带开启DF单元，则将APS中添加的第一标志位的值设置为第二值，以指示APS中包含第一对应位置处的滤波器系数。
该实施例的技术方案使得编码端可以通过在APS中设置第一标志位来指示APS中是否缺省了第一对应位置处的滤波器系数，进而便于解码端根据该第一标志位来确定所参考的APS中是否缺省了第一对应位置处的滤波器系数，以在进行环路滤波时采用相应的对策，即前述环路滤波方法部分的处理方式。
在一些实施例中，在本申请实施例的视频编码方法中，如果ALF单元的输入包括DF单元的输出信号，那么可以根据视频图像帧或视频图像帧中的当前条带是否开启指定的环路滤波器，在包含视频图像帧或当前条带的滤波器系数的APS中添加第二标志位，该第二标志位的值用于指示APS中是否缺省第二对应位置处的滤波器系数，该第二对应位置为指DF单元的输出信号所对应的系数位置。
具体地，比如若视频图像帧或当前条带不开启指定的环路滤波器，则将APS中添加的第二标志位的值设置为第一值，以指示APS中缺省第二对应位置处的滤波器系数；若视频图像帧或当前条带开启指定的环路滤波器，则将APS中添加的第二标志位的值设置为第二值，以指示APS中包含第二对应位置处的滤波器系数。
该实施例的技术方案使得编码端可以通过在APS中设置第二标志位来指示APS中是否缺省了第二对应位置处的滤波器系数，进而便于解码端根据该第二标志位来确定所参考的APS中是否缺省了第二对应位置处的滤波器系数，以在进行环路滤波时采用相应的对策，即前述环路滤波方法部分 的处理方式。
需要说明的是，在本申请的实施例中，如果ALF单元的输入包括输入至DF单元的信号，以及DF单元的输出信号，那么编码端在进行编码时，可以根据视频图像帧或视频图像帧中的当前条带是否开启DF单元，以及是否开启指定的环路滤波器，在包含视频图像帧或当前条带的滤波器系数的APS中添加第一标志位和第二标志位，并设置相应的值进行指示。
可见，在本申请的实施例中，提出一种使用不同位置的重建像素(如输入至DF单元的重建像素和/或DF单元输出的重建像素)的环路滤波方法，使得ALFF单元的滤波过程能够参考当前待滤波像素和周边像素的相关性，与相关技术使用固定模板的滤波方案相比，滤波更有针对性，能够充分利用与周围像素的相关性提升ALF滤波后的质量。同时提出对应的滤波器系数索引方法，进一步减少编码ALF滤波器系数的开销，以提升ALF整体的编码性能。以下分两部分再次进行详细说明：
1、利用不同位置的环路滤波器输出的重建像素作为ALF输入的滤波器系数索引的实施例：
如前所述，本申请实施例中所涉及的不同位置的环路滤波器输出包括：LMCS之后且DF之前的重建像素(即输入至DF的重建像素)、DF之后且下一步环路滤波器之前的重建像素(即DF输出的重建像素)，以及这两者的组合。
在一些实施例中，可以在APS中新增标志位，根据使用的重建像素的位置所对应的环路滤波器的使用情况，决定是否使用该位置的重建像素作为输入，并在APS中用标志位说明不同位置重建像素的使用情况，可以避免如下情况：当去块效应滤波器关闭时，由于不存在所谓的去块效应之前的重建像素，如果继续计算并传输对应的系数，会造成码率的浪费。本申请通过增设的标志位的0或1的取值，来指示不传输或传输系数，从而可以避免码率浪费的情况，下面具体说明。
在一个实施例中，对于使用DF之前的重建像素作为ALF额外输入的方法，如果当前图像或者条带选择不开启DF，则将包含了当前图像或者条带的滤波器系数的APS中的标志位设为0，表示不需传送对应的滤波器系数。如果当前图像或者条带选择开启DF，则将包含了当前图像或者条带的滤波器系数的APS中的标志位设为1，表示传送对应的滤波器系数。对应解码过程有如下两种方案：
a)限制APS的参考选择。如果当前图像或者条带选择不开启DF，则限制参考所包含的标志位为1的APS；如果当前图像或者条带选择使用DF(即开启DF)，则限制参考所包含的标志位为0的APS。
b)调整系数取值。如果当前图像或者条带选择不开启DF，且参考的APS中对应标志位为1，则在将APS中对应位置的滤波器系数应用到当前图像时设为0；如果当前图像或者条带选择使用DF，且参考的APS中对应 标志位为0，则使用0填充APS中缺省的对应位置的系数。
在一个实施例中，对于使用DF之后且下一步环路滤波之前的重建像素作为ALF额外输入的方法，如果当前图像或者条带选择同时关闭SAO、CCSAO、BIF等工具，则将包含了当前图像或者条带的滤波器系数的APS中标志位设为0，表示不需传送对应的滤波器系数；如果当前图像或者条带选择不同时关闭SAO、CCSAO、BIF等工具(即开启了SAO、CCSAO和BIF中的部分)，则将包含了当前图像或者条带的滤波器系数的APS中标志位设为1。对应解码过程有如下两种方案：
a)限制APS的参考选择。如果当前图像或者条带选择同时关闭SAO、CCSAO、BIF等工具，则限制参考所包含的标志位为1的APS；如果当前图像或者条带选择使用SAO、CCSAO、BIF等工具中的一种或多种，则限制参考所包含的标志位为0的APS。
b)调整系数取值。如果当前图像或者条带选择同时关闭SAO、CCSAO、BIF等工具，且参考的APS中对应标志位为1，则在应用APS到当前图像或条带时将对应位置的滤波器系数设为0；如果当前图像或者条带选择使用SAO、CCSAO、BIF等工具中的一种或多种，且参考的APS中对应标志位为0，则使用0填充APS中缺省的对应位置的系数。
在一个实施例中，对于同时使用DF之前的重建像素与DF之后且下一步环路滤波之前的重建像素作为ALF额外输入的方法，可以在APS中新增两个标志位，分别对应DF之前的重建像素使用情况，以及DF之后且下一步环路滤波之前的重建像素使用情况。根据前述两个实施例的条件分别设置对应标志位，以及传送对应系数以及解码过程的调整。
2、根据使用重建像素的位置所对应的环路滤波器的使用情况，设置对应系数的取值。
在一个实施例中，对于使用DF之前的重建像素作为ALF额外输入信息的方法，如果当前图像或者条带选择不开启DF，则将当前帧生成的APS中对应位置的滤波器系数设为0。如果参考由其它帧生成的APS中的滤波器系数，则在解码当前图像或条带时，将对应位置处的滤波器系数设为0，其效果等同于不使用对应位置的重建像素进行滤波。该改动不影响其它仍打开DF的图像帧或条带的解码。
在一个实施例中，对于使用DF之后且下一步环路滤波之前作为ALF额外输入信息的方法，如果当前图像或者条带选择同时关闭SAO、CCSAO、BIF等工具，则将当前帧生成的APS中对应位置的滤波器系数设为0。如果参考由其它帧生成的APS中的滤波器系数，则在解码当前图像或条带时，将对应位置处的滤波器系数设为0，其效果等同于不使用对应位置的重建像素进行滤波。该改动不影响其他仍使用SAO、CCSAO、BIF等工具中的一种或多种的帧或条带的解码。
在一个实施例中，对于同时使用DF之前的重建像素，以及DF之后且 下一步环路滤波之前的重建像素作为ALF额外输入信息的方法，则根据前述两个实施例的条件进行对应位置系数的设置。
可见，本申请实施例的技术方案，通过使用不同位置的重建像素(如输入至DF单元的重建像素和/或DF单元输出的重建像素)的环路滤波方法，使得ALFF单元的滤波过程能够参考当前待滤波像素和周边像素的相关性，与相关技术使用固定模板的滤波方案相比，滤波更有针对性，可以更好的利用周边像素的相关性，来针对当前的待滤波像素进行有针对性的滤波处理，提高了ALF的滤波效果和滤波质量，进而有利于提高编解码性能。
此外，在滤波器系数索引方案中，通过增设的标志位来指示是否需要传送对应的滤波器系数，避免了当去块效应滤波器关闭时不必要的系数的传输，进一步减少ALF滤波器系数的开销，以提升ALF整体的编码性能。
以下介绍本申请的装置实施例，可以用于执行本申请上述实施例中的方法。对于本申请装置实施例中未披露的细节，请参照本申请上述的方法实施例。
图11示出了根据本申请的一个实施例的环路滤波装置的框图，该环路滤波装置可以设置在视频编码设备或者视频解码设备内。
参照图11所示，根据本申请的一个实施例的环路滤波装置1100，包括：获取单元1102和滤波单元1104。
其中，获取单元1102配置为获取视频图像帧对应的重建分量；滤波单元1104配置为通过环路滤波单元对所述重建分量进行滤波处理，所述环路滤波单元包括顺次相连的DF单元、指定的环路滤波器和ALF单元；其中，所述ALF单元的输入还包括以下至少一个：输入至所述DF单元的信号、所述DF单元的输出信号；以及将所述环路滤波单元的输出作为所述视频图像帧对应的重建图像。
在本申请的一些实施例中，基于前述方案，若所述ALF单元的输入包括输入至所述DF单元的信号，则所述滤波单元1104配置为：若所述视频图像帧或所述视频图像帧中的当前条带不开启所述DF单元，则在滤波处理时限制所述视频图像帧或所述当前条带参考第一自适应参数集APS；其中，所述第一自适应参数集APS中包含有第一标志位，且所述第一APS中所包含的第一标志位的值用于指示所述第一自适应参数集APS中包含有第一对应位置处的滤波器系数，所述第一对应位置为输入至所述DF单元的信号所对应的系数位置。
在本申请的一些实施例中，基于前述方案，若所述ALF单元的输入包括输入至所述DF单元的信号，则所述滤波单元1104配置为：若所述视频图像帧或所述当前条带开启所述DF单元，则在滤波处理时限制所述视频图像帧或所述当前条带参考第二APS；其中，所述第二APS中包含有第一标志位，且所述第二APS中所包含的第一标志位的值用于指示所述第二APS 中缺省所述第一对应位置处的滤波器系数。
在本申请的一些实施例中，基于前述方案，若所述ALF单元的输入包括输入至所述DF单元的信号，则所述滤波单元1104配置为：若所述视频图像帧或所述视频图像帧的当前条带不开启所述DF单元，且所述视频图像帧或所述当前条带参考第一APS，则在将所述第一APS应用到所述视频图像帧或所述当前条带进行滤波处理时，将所述第一APS中的第一对应位置处的滤波器系数设置为0；其中，所述第一APS中包含有第一标志位，且所述第一APS中所包含的第一标志位的值用于指示所述第一APS中包含有所述第一对应位置处的滤波器系数，所述第一对应位置为输入至所述DF单元的信号所对应的系数位置。
在本申请的一些实施例中，基于前述方案，若所述ALF单元的输入包括输入至所述DF单元的信号，则所述滤波单元1104配置为：若所述视频图像帧或所述当前条带开启所述DF单元，且所述视频图像帧或所述当前条带参考第二APS，则在将所述第二APS应用到所述视频图像帧或所述当前条带进行滤波处理时，将所述第二APS中的所述第一对应位置处的滤波器系数填充为0；其中，所述第二APS中包含有第一标志位，且所述第二APS中所包含的第一标志位的值用于指示所述第二APS中缺省所述第一对应位置处的滤波器系数。
在本申请的一些实施例中，基于前述方案，若所述ALF单元的输入包括所述DF单元的输出信号，则所述滤波单元1104配置为：若所述视频图像帧或所述视频图像帧中的当前条带不开启所述指定的环路滤波器，则在滤波处理时限制所述视频图像帧或所述当前条带参考第三APS；其中，所述第三APS中包含有第二标志位、且所述第三APS中所包含的第二标志位的值用于指示所述第三APS中包含有第二对应位置处的滤波器系数，所述第二对应位置为所述指DF单元的输出信号所对应的系数位置。
在本申请的一些实施例中，基于前述方案，若所述ALF单元的输入包括所述DF单元的输出信号，则所述滤波单元1104配置为：若所述视频图像帧或所述当前条带开启所述指定的环路滤波器，则在滤波处理时限制所述视频图像帧或所述当前条带参考第四APS；其中，所述第四APS中包含有第二标志位、且所述第四APS中所包含的第二标志位的值用于指示所述第四APS中缺省所述第二对应位置处的滤波器系数。
在本申请的一些实施例中，基于前述方案，若所述ALF单元的输入包括所述DF单元的输出信号，则所述滤波单元1104配置为：若所述视频图像帧或所述视频图像帧中的当前条带不开启所述指定的环路滤波器，且所述视频图像帧或所述当前条带参考第三APS，则在将所述第三APS应用到所述视频图像帧或所述当前条带进行滤波处理时，将所述第三APS中的第二对应位置处的滤波器系数设置为0；其中，所述第三APS中包含有第二标志位、且所述第三APS中所包含的第二标志位的值用于指示所述第三 APS中包含有所述第二对应位置处的滤波器系数，所述第二对应位置为所述指DF单元的输出信号所对应的系数位置。
在本申请的一些实施例中，基于前述方案，若所述ALF单元的输入包括所述DF单元的输出信号，则所述滤波单元1104配置为：若所述视频图像帧或所述当前条带开启所述指定的环路滤波器，且所述视频图像帧或所述当前条带参考第四APS，则在将所述第四APS应用到所述视频图像帧或所述当前条带进行滤波处理时，将所述第四APS中的所述第二对应位置处的滤波器系数填充为0；其中，所述第四APS中包含有第二标志位、且所述第四APS中所包含的第二标志位的值用于指示所述第四APS中缺省所述第二对应位置处的滤波器系数。
在本申请的一些实施例中，基于前述方案，若所述ALF单元的输入包括输入至所述DF单元的信号，则所述环路滤波装置1100还包括：处理单元，配置为：若所述视频图像帧或所述视频图像帧中的当前条带不开启所述DF单元，则在包含所述视频图像帧或所述当前条带的滤波器系数的APS中，将第一对应位置处的滤波器系数设为0，所述第一对应位置为输入至所述DF单元的信号所对应的系数位置。
在本申请的一些实施例中，基于前述方案，若所述ALF单元的输入包括输入至所述DF单元的信号，则所述滤波单元1104配置为：若所述视频图像帧或所述视频图像帧中的当前条带不开启所述DF单元，则在将所述视频图像帧或所述当前条带所参考的APS应用到所述视频图像帧或所述当前条带进行滤波处理时，将所述视频图像帧或所述当前条带所参考的APS中第一对应位置处的滤波器系数设置为0，所述第一对应位置为输入至所述DF单元的信号所对应的系数位置。
在本申请的一些实施例中，基于前述方案，若所述ALF单元的输入包括所述DF单元的输出信号，则所述环路滤波装置1100还包括：处理单元，配置为若所述视频图像帧或所述视频图像帧中的当前条带不开启所述指定的环路滤波器，则在包含所述视频图像帧或所述当前条带的滤波器系数的APS中，将第二对应位置处的滤波器系数设为0，所述第二对应位置为所述DF单元的输出信号所对应的系数位置。
在本申请的一些实施例中，基于前述方案，若所述ALF单元的输入包括所述DF单元的输出信号，则所述滤波单元1104配置为：若所述视频图像帧或所述视频图像帧中的当前条带不开启所述指定的环路滤波器，则在将所述视频图像帧或所述当前条带所参考的APS应用到所述视频图像帧或所述当前条带进行滤波处理时，将所述视频图像帧或所述当前条带所参考的APS中第二对应位置处的滤波器系数设置为0，所述第二对应位置为所述DF单元的输出信号所对应的系数位置。
在本申请的一些实施例中，基于前述方案，所述指定的环路滤波器包括以下至少一种：双边带滤波器、样点自适应补偿滤波器、跨分量样点自 适应补偿滤波器。
图12示出了根据本申请的一个实施例的视频解码装置的框图，该视频解码装置可以设置在视频解码设备内。
参照图12所示，根据本申请的一个实施例的视频解码装置1200，包括：获取单元1202、滤波单元1204和解码单元1206。
其中，获取单元1202配置为获取视频图像帧对应的重建分量；滤波单元1204配置为通过环路滤波单元对所述重建分量进行滤波处理，所述环路滤波单元包括顺次相连的DF单元、指定的环路滤波器和ALF单元；其中，所述ALF单元的输入还包括以下至少一个：输入至所述DF单元的信号、所述DF单元的输出信号；以及将所述环路滤波单元的输出作为所述视频图像帧对应的重建图像；解码单元1206配置为将所述视频图像帧对应的重建图像作为解码得到的视频图像。
图13示出了根据本申请的一个实施例的视频编码装置的框图，该视频编码装置可以设置在视频编码设备内。
参照图13所示，根据本申请的一个实施例的视频编码装置1300，包括：获取单元1302和滤波单元1304。
其中，获取单元1302配置为获取待编码的视频图像帧，以及所述待编码的视频图像帧对应的重建分量；滤波单元1304配置为通过环路滤波单元对所述待编码的视频图像帧对应的重建分量进行滤波处理，所述环路滤波单元包括顺次相连的DF单元、指定的环路滤波器和ALF单元；其中，所述ALF单元的输入还包括以下至少一个：输入至所述DF单元的信号、所述DF单元的输出信号；以及将所述环路滤波单元的输出作为所述待编码的视频图像帧对应的重建图像。
在本申请的一些实施例中，基于前述方案，若所述ALF单元的输入包括输入至所述DF单元的信号，则所述视频编码装置1300还包括：编码单元，配置为根据所述视频图像帧或所述视频图像帧中的当前条带是否开启所述DF单元，在包含所述视频图像帧或所述当前条带的滤波器系数的APS中添加第一标志位，所述第一标志位的值用于指示所述APS中是否缺省第一对应位置处的滤波器系数，所述第一对应位置为输入至所述DF单元的信号所对应的系数位置。
在本申请的一些实施例中，基于前述方案，所述编码单元配置为：若所述视频图像帧或所述当前条带不开启所述DF单元，则将所述APS中添加的第一标志位的值设置为第一值，以指示所述APS中缺省所述第一对应位置处的滤波器系数；若所述视频图像帧或所述当前条带开启所述DF单元，则将所述APS中添加的第一标志位的值设置为第二值，以指示所述APS中包含所述第一对应位置处的滤波器系数。
在本申请的一些实施例中，基于前述方案，若所述ALF单元的输入包括所述DF单元的输出信号，则所述视频编码装置1300还包括：编码单元， 配置为根据所述视频图像帧或所述视频图像帧中的当前条带是否开启所述指定的环路滤波器，在包含所述视频图像帧或所述当前条带的滤波器系数的APS中添加第二标志位，所述第二标志位的值用于指示所述APS中是否缺省第二对应位置处的滤波器系数，所述第二对应位置为所述指DF单元的输出信号所对应的系数位置。
在本申请的一些实施例中，基于前述方案，所述编码单元配置为：若所述视频图像帧或所述当前条带不开启所述指定的环路滤波器，则将所述APS中添加的第二标志位的值设置为第一值，以指示所述APS中缺省所述第二对应位置处的滤波器系数；若所述视频图像帧或所述当前条带开启所述指定的环路滤波器，则将所述APS中添加的第二标志位的值设置为第二值，以指示所述APS中包含所述第二对应位置处的滤波器系数。
图14示出了适于用来实现本申请实施例的电子设备的计算机系统的结构示意图。
需要说明的是，图14示出的电子设备的计算机系统1400仅是一个示例，不应对本申请实施例的功能和使用范围带来任何限制。
如图14所示，计算机系统1400包括中央处理单元(Central Processing Unit，CPU)1401，其可以根据存储在只读存储器(Read-Only Memory，ROM)1402中的程序或者从存储部分1408加载到随机访问存储器(Random Access Memory，RAM)1403中的程序而执行各种适当的动作和处理，例如执行上述实施例中所述的方法。在RAM 1403中，还存储有系统操作所需的各种程序和数据。CPU 1401、ROM 1402以及RAM 1403通过总线1404彼此相连。输入/输出(Input/Output，I/O)接口1405也连接至总线1404。
以下部件连接至I/O接口1405：包括键盘、鼠标等的输入部分1406；包括诸如阴极射线管(Cathode Ray Tube，CRT)、液晶显示器(Liquid Crystal Display，LCD)等以及扬声器等的输出部分1407；包括硬盘等的存储部分1408；以及包括诸如LAN(Local Area Network，局域网)卡、调制解调器等的网络接口卡的通信部分1409。通信部分1409经由诸如因特网的网络执行通信处理。驱动器1410也根据需要连接至I/O接口1405。可拆卸介质1411，诸如磁盘、光盘、磁光盘、半导体存储器等等，根据需要安装在驱动器1410上，以便于从其上读出的计算机程序根据需要被安装入存储部分1408。
特别地，根据本申请的实施例，上文参考流程图描述的过程可以被实现为计算机软件程序。例如，本申请的实施例包括一种计算机程序产品，其包括承载在计算机可读介质上的计算机程序，该计算机程序包含用于执行流程图所示的方法的计算机程序。在这样的实施例中，该计算机程序可以通过通信部分1409从网络上被下载和安装，和/或从可拆卸介质1411被安装。在该计算机程序被中央处理单元(CPU)1401执行时，执行本申请的系统中限定的各种功能。
作为另一方面，本申请还提供了一种计算机可读介质，该计算机可读 介质可以是上述实施例中描述的电子设备中所包含的；也可以是单独存在，而未装配入该电子设备中，例如存储在CD-ROM，U盘，移动硬盘等形式的非易失性存储介质。上述计算机可读介质承载有一个或者多个计算机程序，当上述一个或者多个计算机程序被一个该电子设备执行时，使得该电子设备实现上述实施例中所述的方法。
应当注意，尽管在上文详细描述中提及了用于动作执行的设备的若干模块或者单元，但是这种划分并非强制性的。实际上，根据本申请的实施方式，上文描述的两个或更多模块或者单元的特征和功能可以在一个模块或者单元中具体化。反之，上文描述的一个模块或者单元的特征和功能可以进一步划分为由多个模块或者单元来具体化。
通过以上的实施方式的描述，本领域的技术人员易于理解，这里描述的示例实施方式可以通过软件实现，也可以通过软件结合必要的硬件的方式来实现。因此，根据本申请实施方式的技术方案可以以软件产品的形式体现出来，该软件产品可以存储在一个非易失性存储介质(可以是CD-ROM，U盘，移动硬盘等)中或网络上，包括若干指令以使得一台计算设备(可以是个人计算机、服务器、触控终端、或者网络设备等)执行根据本申请实施方式的方法。
本领域技术人员在考虑说明书及实践这里公开的实施方式后，将容易想到本申请的其它实施方案。本申请旨在涵盖本申请的任何变型、用途或者适应性变化，这些变型、用途或者适应性变化遵循本申请的一般性原理并包括本申请未公开的本技术领域中的公知常识或惯用技术手段。
应当理解的是，本申请并不局限于上面已经描述并在附图中示出的精确结构，并且可以在不脱离其范围进行各种修改和改变。本申请的范围仅由所附的权利要求来限制。

Claims (20)

  1. 一种环路滤波方法，包括：
    获取视频图像帧对应的重建分量；
    通过环路滤波单元对所述重建分量进行滤波处理，所述环路滤波单元包括顺次相连的去块效应滤波DF单元、指定的环路滤波器和自适应环路滤波ALF单元；其中，所述ALF单元的输入还包括以下至少一个：输入至所述DF单元的信号、所述DF单元的输出信号；
    将所述环路滤波单元的输出作为所述视频图像帧对应的重建图像。
  2. 根据权利要求1所述的环路滤波方法，其中，若所述ALF单元的输入包括输入至所述DF单元的信号，所述通过环路滤波单元对所述重建分量进行滤波处理，包括：
    若所述视频图像帧或所述视频图像帧中的当前条带不开启所述DF单元，在滤波处理时限制所述视频图像帧或所述当前条带参考第一自适应参数集APS；其中，所述第一自适应参数集APS中包含有第一标志位，且所述第一APS中所包含的第一标志位的值用于指示所述第一自适应参数集APS中包含有第一对应位置处的滤波器系数，所述第一对应位置为输入至所述DF单元的信号所对应的系数位置；
    若所述视频图像帧或所述当前条带开启所述DF单元，在滤波处理时限制所述视频图像帧或所述当前条带参考第二APS；其中，所述第二APS中包含有第一标志位，且所述第二APS中所包含的第一标志位的值用于指示所述第二APS中缺省所述第一对应位置处的滤波器系数。
  3. 根据权利要求1所述的环路滤波方法，其中，若所述ALF单元的输入包括输入至所述DF单元的信号，所述通过环路滤波单元对所述重建分量进行滤波处理，包括：
    若所述视频图像帧或所述视频图像帧的当前条带不开启所述DF单元，且所述视频图像帧或所述当前条带参考第一APS，在将所述第一APS应用到所述视频图像帧或所述当前条带进行滤波处理时，将所述第一APS中的第一对应位置处的滤波器系数设置为0；其中，所述第一APS中包含有第一标志位，且所述第一APS中所包含的第一标志位的值用于指示所述第一APS中包含有所述第一对应位置处的滤波器系数，所述第一对应位置为输入至所述DF单元的信号所对应的系数位置；
    若所述视频图像帧或所述当前条带开启所述DF单元，且所述视频图像帧或所述当前条带参考第二APS，在将所述第二APS应用到所述视频图像帧或所述当前条带进行滤波处理时，将所述第二APS中的所述第一对应位置处的滤波器系数填充为0；其中，所述第二APS中包含有第一标志位，且所述第二APS中所包含的第一标志位的值用于指示所述第二APS中缺省所述第一对应位置处的滤波器系数。
  4. 根据权利要求1至3中任一项所述的环路滤波方法，其中，若所述ALF单元的输入包括所述DF单元的输出信号，所述通过环路滤波单元对所述重建分量进行滤波处理，包括：
    若所述视频图像帧或所述视频图像帧中的当前条带不开启所述指定的环路滤波器，在滤波处理时限制所述视频图像帧或所述当前条带参考第三APS；其中，所述第三APS中包含有第二标志位、且所述第三APS中所包含的第二标志位的值用于指示所述第三APS中包含有第二对应位置处的滤波器系数，所述第二对应位置为所述指DF单元的输出信号所对应的系数位置；
    若所述视频图像帧或所述当前条带开启所述指定的环路滤波器，在滤波处理时限制所述视频图像帧或所述当前条带参考第四APS；其中，所述第四APS中包含有第二标志位、且所述第四APS中所包含的第二标志位的值用于指示所述第四APS中缺省所述第二对应位置处的滤波器系数。
  5. 根据权利要求1至3中任一项所述的环路滤波方法，其中，若所述ALF单元的输入包括所述DF单元的输出信号，所述通过环路滤波单元对所述重建分量进行滤波处理，包括：
    若所述视频图像帧或所述视频图像帧中的当前条带不开启所述指定的环路滤波器，且所述视频图像帧或所述当前条带参考第三APS，在将所述第三APS应用到所述视频图像帧或所述当前条带进行滤波处理时，将所述第三APS中的第二对应位置处的滤波器系数设置为0；其中，所述第三APS中包含有第二标志位、且所述第三APS中所包含的第二标志位的值用于指示所述第三APS中包含有所述第二对应位置处的滤波器系数，所述第二对应位置为所述指DF单元的输出信号所对应的系数位置；
    若所述视频图像帧或所述当前条带开启所述指定的环路滤波器，且所述视频图像帧或所述当前条带参考第四APS，在将所述第四APS应用到所述视频图像帧或所述当前条带进行滤波处理时，将所述第四APS中的所述第二对应位置处的滤波器系数填充为0；其中，所述第四APS中包含有第二标志位、且所述第四APS中所包含的第二标志位的值用于指示所述第四APS中缺省所述第二对应位置处的滤波器系数。
  6. 根据权利要求1所述的环路滤波方法，其中，若所述ALF单元的输入包括输入至所述DF单元的信号，所述方法还包括：
    若所述视频图像帧或所述视频图像帧中的当前条带不开启所述DF单元，在包含所述视频图像帧或所述当前条带的滤波器系数的APS中，将第一对应位置处的滤波器系数设为0，所述第一对应位置为输入至所述DF单元的信号所对应的系数位置。
  7. 根据权利要求1所述的环路滤波方法，其中，若所述ALF单元的输入包括输入至所述DF单元的信号，所述通过环路滤波单元对所述重建分量进行滤波处理，包括：
    若所述视频图像帧或所述视频图像帧中的当前条带不开启所述DF单元，在将所述视频图像帧或所述当前条带所参考的APS应用到所述视频图像帧或所述当前条带进行滤波处理时，将所述视频图像帧或所述当前条带所参考的APS中第一对应位置处的滤波器系数设置为0，所述第一对应位置为输入至所述DF单元的信号所对应的系数位置。
  8. 根据权利要求1、6至7中任一项所述的环路滤波方法，其中，若所述ALF单元的输入包括所述DF单元的输出信号，所述方法还包括：
    若所述视频图像帧或所述视频图像帧中的当前条带不开启所述指定的环路滤波器，在包含所述视频图像帧或所述当前条带的滤波器系数的APS中，将第二对应位置处的滤波器系数设为0，所述第二对应位置为所述DF单元的输出信号所对应的系数位置。
  9. 根据权利要求1、6至7中任一项所述的环路滤波方法，其中，若所述ALF单元的输入包括所述DF单元的输出信号，所述通过环路滤波单元对所述重建分量进行滤波处理，包括：
    若所述视频图像帧或所述视频图像帧中的当前条带不开启所述指定的环路滤波器，在将所述视频图像帧或所述当前条带所参考的APS应用到所述视频图像帧或所述当前条带进行滤波处理时，将所述视频图像帧或所述当前条带所参考的APS中第二对应位置处的滤波器系数设置为0，所述第二对应位置为所述DF单元的输出信号所对应的系数位置。
  10. 根据权利要求1至3、6至7中任一项所述的环路滤波方法，其中，所述指定的环路滤波器包括以下至少一种：双边带滤波器、样点自适应补偿滤波器、跨分量样点自适应补偿滤波器。
  11. 一种视频解码方法，包括：
    通过权利要求1至10中任一项所述的环路滤波方法对视频图像帧对应的重建分量进行滤波处理，得到所述视频图像帧对应的重建图像；
    将所述视频图像帧对应的重建图像作为解码得到的视频图像。
  12. 一种视频编码方法，包括：
    获取待编码的视频图像帧；
    通过权利要求1至10中任一项所述的环路滤波方法对所述待编码的视频图像帧所对应的重建分量进行滤波处理，得到所述待编码的视频图像帧对应的重建图像。
  13. 根据权利要求12所述的视频编码方法，其中，若所述ALF单元的输入包括输入至所述DF单元的信号，所述方法还包括：
    根据所述视频图像帧或所述视频图像帧中的当前条带是否开启所述DF单元，在包含所述视频图像帧或所述当前条带的滤波器系数的APS中添加第一标志位，所述第一标志位的值用于指示所述APS中是否缺省第一对应位置处的滤波器系数，所述第一对应位置为输入至所述DF单元的信号所对应的系数位置。
  14. 根据权利要求13所述的视频编码方法，其中，所述根据所述视频图像帧或所述视频图像帧中的当前条带是否开启所述DF单元，在包含所述视频图像帧或所述当前条带的滤波器系数的APS中添加第一标志位，包括：
    若所述视频图像帧或所述当前条带不开启所述DF单元，将所述APS中添加的第一标志位的值设置为第一值，以指示所述APS中缺省所述第一对应位置处的滤波器系数；
    若所述视频图像帧或所述当前条带开启所述DF单元，将所述APS中添加的第一标志位的值设置为第二值，以指示所述APS中包含所述第一对应位置处的滤波器系数。
  15. 根据权利要求12至14中任一项所述的视频编码方法，其中，若所述ALF单元的输入包括所述DF单元的输出信号，所述方法还包括：
    根据所述视频图像帧或所述视频图像帧中的当前条带是否开启所述指定的环路滤波器，在包含所述视频图像帧或所述当前条带的滤波器系数的APS中添加第二标志位，所述第二标志位的值用于指示所述APS中是否缺省第二对应位置处的滤波器系数，所述第二对应位置为所述指DF单元的输出信号所对应的系数位置。
  16. 根据权利要求15所述的视频编码方法，其中，所述根据所述视频图像帧或所述视频图像帧中的当前条带是否开启所述指定的环路滤波器，在包含所述视频图像帧或所述当前条带的滤波器系数的APS中添加第二标志位，包括：
    若所述视频图像帧或所述当前条带不开启所述指定的环路滤波器，将所述APS中添加的第二标志位的值设置为第一值，以指示所述APS中缺省所述第二对应位置处的滤波器系数；
    若所述视频图像帧或所述当前条带开启所述指定的环路滤波器，将所述APS中添加的第二标志位的值设置为第二值，以指示所述APS中包含所述第二对应位置处的滤波器系数。
  17. 一种环路滤波装置，包括：
    获取单元，配置为获取视频图像帧对应的重建分量；
    滤波单元，配置为通过环路滤波单元对所述重建分量进行滤波处理，所述环路滤波单元包括顺次相连的去块效应滤波DF单元、指定的环路滤波器和自适应环路滤波ALF单元；其中，所述ALF单元的输入还包括以下至少一个：输入至所述DF单元的信号、所述DF单元的输出信号；以及将所述环路滤波单元的输出作为所述视频图像帧对应的重建图像。
  18. 一种计算机可读介质，其上存储有计算机程序，所述计算机程序被处理器执行时实现如权利要求1至10中任一项所述的环路滤波方法；或实现如权利要求11所述的视频解码方法；或实现如权利要求12至16中任一项所述的视频解码方法。
  19. 一种电子设备，包括：
    一个或多个处理器；
    存储器，用于存储一个或多个计算机程序，当所述一个或多个计算机程序被所述一个或多个处理器执行时，使得所述电子设备实现如权利要求1至10中任一项所述的环路滤波方法；或实现如权利要求11所述的视频解码方法；或实现如权利要求12至16中任一项所述的视频解码方法。
  20. 一种计算机程序产品，所述计算机程序产品包括计算机程序，所述计算机程序存储在计算机可读存储介质中，电子设备的处理器从所述计算机可读存储介质读取并执行所述计算机程序，使得所述电子设备执行如权利要求1至10中任一项所述的环路滤波方法；或实现如权利要求11所述的视频解码方法；或实现如权利要求12至16中任一项所述的视频解码方法。
PCT/CN2022/137900 2022-04-20 2022-12-09 环路滤波方法、视频编解码方法、装置、介质、程序产品及电子设备 WO2023202097A1 (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202210444332.3A CN116962688A (zh) 2022-04-20 2022-04-20 环路滤波方法、视频编解码方法、装置、介质及电子设备
CN202210444332.3 2022-04-20

Publications (1)

Publication Number Publication Date
WO2023202097A1 true WO2023202097A1 (zh) 2023-10-26

Family

ID=88419029

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2022/137900 WO2023202097A1 (zh) 2022-04-20 2022-12-09 环路滤波方法、视频编解码方法、装置、介质、程序产品及电子设备

Country Status (2)

Country Link
CN (1) CN116962688A (zh)
WO (1) WO2023202097A1 (zh)

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103891277A (zh) * 2011-10-14 2014-06-25 联发科技股份有限公司 回路滤波方法及其装置
US20160241881A1 (en) * 2015-02-13 2016-08-18 Mediatek Inc. Method and Apparatus of Loop Filters for Efficient Hardware Implementation
CN106716997A (zh) * 2014-07-31 2017-05-24 三星电子株式会社 使用环路内滤波器参数预测的视频编码方法和设备以及相应视频解码方法和设备
US20190373258A1 (en) * 2018-06-01 2019-12-05 Qualcomm Incorporated Block-based adaptive loop filter (alf) design and signaling

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103891277A (zh) * 2011-10-14 2014-06-25 联发科技股份有限公司 回路滤波方法及其装置
CN106716997A (zh) * 2014-07-31 2017-05-24 三星电子株式会社 使用环路内滤波器参数预测的视频编码方法和设备以及相应视频解码方法和设备
US20160241881A1 (en) * 2015-02-13 2016-08-18 Mediatek Inc. Method and Apparatus of Loop Filters for Efficient Hardware Implementation
US20190373258A1 (en) * 2018-06-01 2019-12-05 Qualcomm Incorporated Block-based adaptive loop filter (alf) design and signaling

Also Published As

Publication number Publication date
CN116962688A (zh) 2023-10-27

Similar Documents

Publication Publication Date Title
WO2022078163A1 (zh) 视频解码方法、视频编码方法及相关装置
WO2022116836A1 (zh) 视频解码方法、视频编码方法、装置及设备
WO2022078304A1 (zh) 视频解码方法、装置、计算机可读介质、程序及电子设备
WO2022063033A1 (zh) 视频解码方法、视频编码方法、装置、计算机可读介质及电子设备
WO2022174660A1 (zh) 视频编解码方法、装置、计算机可读介质及电子设备
WO2022062880A1 (zh) 视频解码方法、装置、计算机可读介质及电子设备
CN114257810B (zh) 上下文模型的选择方法、装置、设备及存储介质
WO2022174637A1 (zh) 视频编解码方法、装置、计算机可读介质及电子设备
WO2022105678A1 (zh) 视频解码方法、视频编码方法及相关装置
WO2023202097A1 (zh) 环路滤波方法、视频编解码方法、装置、介质、程序产品及电子设备
WO2021263251A1 (en) State transition for dependent quantization in video coding
CN115209157A (zh) 视频编解码方法、装置、计算机可读介质及电子设备
WO2023130899A1 (zh) 环路滤波方法、视频编解码方法、装置、介质及电子设备
WO2022174701A1 (zh) 视频编解码方法、装置、计算机可读介质及电子设备
WO2023051222A1 (zh) 滤波及编解码方法、装置、计算机可读介质及电子设备
WO2023051223A1 (zh) 滤波及编解码方法、装置、计算机可读介质及电子设备
WO2024082632A1 (zh) 视频编解码方法、装置、计算机可读介质及电子设备
WO2024212676A1 (zh) 视频编解码方法、装置、计算机可读介质及电子设备
JP7483029B2 (ja) ビデオ復号方法、ビデオ符号化方法、装置、媒体、及び電子機器
WO2022174659A1 (zh) 视频编解码方法、装置、计算机可读介质及电子设备
WO2024109099A1 (zh) 视频编解码方法、装置、计算机可读介质及电子设备
WO2022116854A1 (zh) 视频解码方法、装置、可读介质、电子设备及程序产品
WO2022037477A1 (zh) 视频解码方法、装置、计算机可读介质及电子设备
WO2022174638A1 (zh) 视频编解码方法、装置、计算机可读介质及电子设备
CN115209138A (zh) 视频编解码方法、装置、计算机可读介质及电子设备

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 22938315

Country of ref document: EP

Kind code of ref document: A1