CN112822489B - Hardware implementation method and device for sample self-adaptive offset compensation filtering - Google Patents

Hardware implementation method and device for sample self-adaptive offset compensation filtering Download PDF

Info

Publication number
CN112822489B
CN112822489B CN202011625536.4A CN202011625536A CN112822489B CN 112822489 B CN112822489 B CN 112822489B CN 202011625536 A CN202011625536 A CN 202011625536A CN 112822489 B CN112822489 B CN 112822489B
Authority
CN
China
Prior art keywords
boundary
mode
compensation
image block
value
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202011625536.4A
Other languages
Chinese (zh)
Other versions
CN112822489A (en
Inventor
王世超
文湘鄂
宋磊
张广耀
东健慧
向国庆
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Boya Huishi Intelligent Technology Research Institute Co ltd
Original Assignee
Beijing Boya Huishi Intelligent Technology Research Institute Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Boya Huishi Intelligent Technology Research Institute Co ltd filed Critical Beijing Boya Huishi Intelligent Technology Research Institute Co ltd
Priority to CN202011625536.4A priority Critical patent/CN112822489B/en
Publication of CN112822489A publication Critical patent/CN112822489A/en
Application granted granted Critical
Publication of CN112822489B publication Critical patent/CN112822489B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/134Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
    • H04N19/146Data rate or code amount at the encoder output
    • H04N19/147Data rate or code amount at the encoder output according to rate distortion criteria
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/117Filters, e.g. for pre-processing or post-processing
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/169Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
    • H04N19/17Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object
    • H04N19/176Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a block, e.g. a macroblock
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/169Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
    • H04N19/186Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being a colour or a chrominance component
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • H04N19/503Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal prediction
    • H04N19/51Motion estimation or motion compensation
    • H04N19/583Motion compensation with overlapping blocks

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Compression Or Coding Systems Of Tv Signals (AREA)

Abstract

The application provides a hardware implementation method and device for sample self-adaptive offset compensation filtering, wherein the method comprises the following steps: dividing a source image and a reconstruction image corresponding to the source image into a plurality of image blocks according to a preset size; calculating the compensation value of a first image block under each color channel in parallel through a compensation filter circuit corresponding to each color channel, wherein the first image block is any image block included in a source image; and compensating the reconstructed image block corresponding to the first image block in the reconstructed image according to the compensation value of the first image block under each color channel. According to the method and the device, the sample self-adaptive offset filtering is realized through the hardware circuit, the optimal rate distortion value and the optimal compensation value in each mode are calculated through the circuit in parallel, the optimal compensation value corresponding to the minimum optimal rate distortion value is selected from the optimal rate distortion values in each mode to compensate the reconstructed image, the compensation accuracy is higher, the calculation speed is high, the delay is low, and the real-time requirement of the hardware encoder is met while the 'ringing effect' of the encoder is solved.

Description

Hardware implementation method and device for sample self-adaptive offset compensation filtering
Technical Field
The application belongs to the technical field of video processing, and particularly relates to a hardware implementation method and device for sample self-adaptive offset compensation filtering.
Background
Sample adaptive offset compensation filtering (Sample Adaptive Offset, SAO) is pixel compensating an image to reduce distortion between a source image and a reconstructed image.
At present, a method for realizing sample adaptive offset compensation filtering is provided in the related art, the method is based on a software program to perform sample adaptive offset compensation, each pixel point in an image needs to be compensated in sequence when the compensation is performed based on the software program, and the pixel-by-pixel compensation mode causes low efficiency, high delay and poor real-time performance of the adaptive offset compensation.
Disclosure of Invention
The application provides a hardware implementation method and device for sample self-adaptive offset compensation filtering, which realizes the sample self-adaptive offset filtering through a hardware circuit, calculates an optimal rate distortion value and a corresponding optimal compensation value in each mode through the circuit in parallel, has higher compensation accuracy, high calculation speed and low delay, and meets the real-time requirement of a hardware encoder while solving the 'ringing effect' of the encoder.
An embodiment of a first aspect of the present application provides a hardware implementation method of sample adaptive offset compensation filtering, including:
dividing a source image and a reconstruction image corresponding to the source image into a plurality of image blocks according to a preset size;
calculating the compensation value of a first image block under each color channel in parallel through a compensation filter circuit corresponding to each color channel, wherein the first image block is any image block included in the source image;
and compensating the reconstructed image block corresponding to the first image block in the reconstructed image according to the compensation value of the first image block under each color channel.
In some embodiments of the present application, the calculating, in parallel, the compensation value of the first image block under each color channel by the compensation filter circuit corresponding to each color channel includes:
inputting a first image block into a first compensation filter circuit corresponding to a first channel, wherein the first channel is any channel in the color coding YUV three channels;
in parallel in the first compensation filter circuit, calculating a parameter fusion compensation value and a fusion rate distortion value of the first image block under the first channel through a parameter fusion mode circuit, and calculating a boundary compensation value, a boundary rate distortion value, a strip compensation value and a strip rate distortion value of the first image block under the first channel through a boundary-strip mode circuit;
And determining a final compensation value of the first image block under the first channel from the parameter fusion compensation value, the boundary compensation value, the strip compensation value and the preset compensation value corresponding to the uncompensated mode according to the fusion rate distortion value, the boundary rate distortion value, the strip rate distortion value and the preset rate distortion value corresponding to the uncompensated mode.
In some embodiments of the present application, the calculating, by the boundary-stripe mode circuit, a boundary compensation value, a boundary rate distortion value, a stripe compensation value, and a stripe rate distortion value for the first image block under the first channel includes:
and calculating boundary compensation values and boundary rate distortion values corresponding to all boundary modes under the first channel of the first image block and stripe compensation values and stripe rate distortion values corresponding to stripe modes in series through a boundary-stripe mode circuit, wherein all boundary modes comprise a boundary horizontal mode, a boundary vertical mode, a boundary 45-degree mode and a boundary 135-degree mode.
In some embodiments of the present application, calculating, serially, by a boundary-stripe mode circuit, boundary compensation values and boundary rate distortion values of the first image block corresponding to respective boundary modes in the first channel includes:
Calculating optimal rate distortion values and corresponding compensation values corresponding to each type of the first image block under the first channel in parallel according to a first boundary mode by a peak type circuit, a valley type circuit, a concave angle type circuit and a convex angle type circuit which are included in a boundary-stripe mode circuit, wherein the first boundary mode is any one mode of a boundary horizontal mode, a boundary vertical mode, a boundary 45-degree mode and a boundary 135-degree mode;
calculating the sum value of the optimal rate distortion values corresponding to the various types, and determining the sum value as a boundary rate distortion value of the first image block under the first channel when the first boundary mode is adopted;
and determining the compensation values corresponding to the various types as boundary compensation values of the first image block under the first channel when the first boundary mode is adopted.
In some embodiments of the present application, the peak type circuit, valley type circuit, reentrant type circuit and lobe type circuit included in the pass boundary-stripe mode circuit calculate, in parallel, an optimal rate distortion value and a compensation value corresponding to each type of the first image block under the first channel according to a first boundary mode, including:
Judging whether each pixel point in a preset number of pixel points in the first image block accords with a first type in a first boundary mode or not in parallel through a first type circuit; the first type circuit is any one of a peak type circuit, a valley type circuit, a reentrant type circuit and a lobe type circuit included in the boundary-stripe mode circuit;
determining all first pixel points conforming to a first type under a first boundary mode from the first image block according to a preset traversal sequence;
and calculating an optimal rate distortion value and a corresponding compensation value of the first image block under the first type under the first boundary mode through the first type circuit according to the number of the first pixel points, the original pixel value and the reconstruction pixel value corresponding to the first pixel points.
In some embodiments of the present application, the determining, according to the fusion rate distortion value, the boundary rate distortion value, the slice rate distortion value, and the preset rate distortion value corresponding to the uncompensated mode, the final compensation value of the first image block under the first channel from the parameter fusion compensation value, the boundary compensation value, the slice compensation value, and the preset compensation value corresponding to the uncompensated mode includes:
Determining a minimum rate distortion value from the fusion rate distortion value, the boundary rate distortion value, the stripe rate distortion value and a preset rate distortion value corresponding to an uncompensated mode;
and determining a compensation value corresponding to the minimum rate distortion value as a final compensation value of the first image block under the first channel.
In some embodiments of the present application, the compensating the reconstructed image block corresponding to the first image block in the reconstructed image according to the compensation value of the first image block under each color channel includes:
determining a compensation mode corresponding to a compensation value of the first image block under a first channel;
if the compensation mode is a boundary compensation mode, determining pixel points which respectively accord with a peak type, a valley type, a concave angle type and a convex angle type in a reconstructed image block corresponding to the first image block; respectively adding the reconstructed pixel values corresponding to the pixel points of each type to the compensation values corresponding to each type under the first channel;
if the compensation mode is a strip compensation mode, determining pixel points respectively belonging to each strip in the reconstructed image block; respectively adding the reconstructed pixel values corresponding to the pixel points of each strip with the compensation values corresponding to each strip under the first channel;
And if the compensation mode is a parameter fusion mode, respectively adding the reconstructed pixel values corresponding to the pixel points in the reconstructed image block to the compensation value under the first channel.
Embodiments of the second aspect of the present application provide a hardware-implemented device for sample adaptive offset compensation filtering, including:
the image dividing module is used for dividing the source image and the corresponding reconstructed image into a plurality of image blocks according to a preset size;
three compensation filter circuits, which are used for calculating the compensation value of the first image block under YUV three color channels in parallel, wherein the first image block is any image block included in the source image;
and the compensation module is used for compensating the reconstructed image block corresponding to the first image block in the reconstructed image according to the compensation values of the first image block under the three color channels.
In some embodiments of the present application, the compensation filter circuit includes:
the parameter fusion mode circuit is used for calculating a parameter fusion compensation value and a fusion rate distortion value of the first image block under a first channel, wherein the first channel is any one channel of color coding YUV three channels;
the boundary-stripe mode circuit is used for calculating a boundary compensation value, a boundary rate distortion value, a stripe compensation value and a stripe rate distortion value of the first image block under the first channel through the boundary-stripe mode circuit;
The uncompensated mode circuit is used for providing a preset rate distortion value and a corresponding preset compensation value.
In some embodiments of the present application, the boundary-stripe mode circuit includes a boundary mode circuit and a stripe mode circuit, the boundary mode circuit including a peak type circuit, a valley type circuit, a reentrant type circuit, and a lobe type circuit;
the stripe mode circuit is used for calculating a stripe rate distortion value of the first image block under the first channel and a compensation value corresponding to each stripe according to a stripe compensation mode;
the boundary mode circuit is configured to calculate, in parallel, an optimal rate distortion value and a compensation value corresponding to each type of the first image block under the first channel when a first boundary mode is adopted, by using the peak type circuit, the valley type circuit, the reentrant type circuit, and the lobe type circuit, and determine a sum of the optimal rate distortion values corresponding to each type as a boundary rate distortion value of the first image block under the first channel when the first boundary mode is adopted; and determining the compensation value corresponding to each type as a boundary compensation value of the first image block under the first channel when the first boundary mode is adopted, wherein the first boundary mode is any one mode of the boundary horizontal mode, the boundary vertical mode, the boundary 45 degree mode and the boundary 135 degree mode.
The technical scheme provided in the embodiment of the application has at least the following technical effects or advantages:
in the embodiment of the application, the sample adaptive offset filtering is realized through the hardware circuit, the optimal rate distortion value and the corresponding optimal compensation value in each mode are calculated through the circuit in parallel, the optimal compensation value corresponding to the minimum optimal rate distortion value is selected from the optimal rate distortion values in each mode to compensate the reconstructed image, the compensation accuracy is higher, the calculation speed is high, the delay is low, and the real-time requirement of the hardware encoder is met while the 'ringing effect' of the encoder is solved.
Additional aspects and advantages of the application will be set forth in part in the description which follows and, in part, will be obvious from the description, or may be learned by practice of the application.
Drawings
Various other advantages and benefits will become apparent to those of ordinary skill in the art upon reading the following detailed description of the preferred embodiments. The drawings are only for purposes of illustrating the preferred embodiments and are not to be construed as limiting the application. Also, like reference numerals are used to designate like parts throughout the figures. In the drawings:
FIG. 1 is a schematic diagram illustrating the partitioning of boundary modes according to an embodiment of the present application;
FIG. 2 is a schematic diagram showing the shapes of pixel value lines of each type in a boundary mode according to an embodiment of the present application;
FIG. 3 shows a schematic diagram of a stripe provided by an embodiment of the present application;
FIG. 4 is a schematic diagram of a current image block with reference to left and upper neighboring image blocks in a parameter fusion mode according to an embodiment of the present disclosure;
FIG. 5 illustrates a schematic diagram of a boundary 135 degree mode provided by an embodiment of the present application;
FIG. 6 is a flow chart of a hardware implementation method of sample adaptive offset compensation filtering according to an embodiment of the present application;
FIG. 7 is a schematic diagram of a hardware circuit of sample adaptive offset compensation filtering according to an embodiment of the present application;
FIG. 8 illustrates a schematic diagram of a boundary 45 degree mode provided by an embodiment of the present application;
FIG. 9 shows a schematic diagram of a boundary level mode provided by an embodiment of the present application;
FIG. 10 illustrates another schematic diagram of a boundary 135 degree mode provided by an embodiment of the present application;
FIG. 11 illustrates a schematic diagram of a boundary vertical mode provided by an embodiment of the present application;
Fig. 12 is a schematic structural diagram of a hardware implementation device of sample adaptive offset compensation filtering according to an embodiment of the present application.
Detailed Description
Exemplary embodiments of the present application will be described in more detail below with reference to the accompanying drawings. While exemplary embodiments of the present application are shown in the drawings, it should be understood that the present application may be embodied in various forms and should not be limited to the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the scope of the disclosure to those skilled in the art.
It is noted that unless otherwise indicated, technical or scientific terms used herein should be given the ordinary meaning as understood by one of ordinary skill in the art to which this application belongs.
A hardware implementation method and apparatus for sample adaptive offset compensation filtering according to embodiments of the present application are described below with reference to the accompanying drawings.
The embodiment of the application provides a hardware implementation method of sample adaptive offset compensation filtering, wherein a compensation mode adopted by the method comprises a boundary mode, a stripe mode and a parameter fusion mode, and a rate distortion optimization algorithm is applied to the three modes. Therefore, the boundary mode, the stripe mode, the parameter fusion mode and the rate distortion optimization algorithm will be described first.
The boundary mode is a way to classify the current pixel by comparing the magnitude of the current pixel value with the magnitude of the neighboring pixel value and compensate the same value for the same kind of pixel. Specifically, the pixels are divided into 4 modes according to the position difference EO (Edge Offset) between adjacent pixels. As shown in fig. 1. In fig. 1, a, b, and c are three pixels, respectively, and the pixel c is located between the pixels a and b, and the three pixels are continuous. The positional relationship between the current pixel and surrounding pixels is divided into four boundary modes as shown in fig. 1: eo_0: boundary horizontal mode; eo_90 boundary vertical mode; eo_45 boundary 45 degree mode; eo_135 boundary 135 degree mode.
In any of the above boundary modes, the reconstructed pixels are further classified into 5 types, and as shown in table 1, the 5 types are classified according to the magnitude relation between the pixel value of the pixel point c and the pixel values of the pixel points a and b.
TABLE 1
Figure BDA0002873030240000061
Figure BDA0002873030240000071
The pixel position relationships represented by types 1-4 in table 1 are shown in fig. 2, and in any one of the boundary horizontal mode, the boundary vertical mode, the boundary 45 degree mode, and the boundary 135 degree mode, the pixel position relationships may be divided into the following 5 types according to the pixel value magnitude relationships shown in table 1 and the pixel value continuous shapes corresponding to types 1-4 shown in fig. 2: valley type, reentrant type, lobe type, peak type, and others. Which in turn correspond to types 1, 2, 3, 4 and 0 in table 1 above. In the adaptive offset compensation filtering, the offset values of the valley type and the concave angle type are equal to or greater than 0, and the offset values of the lobe type and the peak type are equal to or less than 0. Other types of compensation values are equal to 0.
The stripe pattern is classified according to pixel intensity values, the pixel range is equally divided into 32 stripes, then each stripe is compensated according to the pixel characteristics, and the same compensation value is used for the same stripe. Finally, the selection of 4 different bands is determined by a Rate distortion optimization (Rate-Distortion Optimization) algorithm, wherein two bands are continuous and the other two bands are continuous. As shown in fig. 3, where the 4 bands that are thickened are the 4 bands that are ultimately selected.
For each pixel in the image (represented by 8 bits, with a pixel value range of [0,255 ]), the manner in which the pixel is divided into specific bands is as follows: calculating the pixel value/8 of x=pixel point; if x=0, dividing the pixel point into stripe 0; x=1, dividing the pixel point into stripe 1; and so on, …, if x=31, the pixel is divided into stripes 31.
The parameter fusion mode refers to that for one image block, the compensation value of the image block is directly calculated by using the compensation value of the adjacent image block. As shown in fig. 4, the C block may select the compensation values of the a block and the B block that have already been determined, or may use the compensation value calculated by the current block itself. If an adjacent image block to the left or an adjacent image block above the current image block exists, the current image block may be compensated using the compensation value that has been calculated for the left or the upper image block. In the parameter fusion mode, the compensation value of a specific image block may be calculated by using the boundary mode and/or the stripe mode.
In the calculation process of the compensation values in the boundary mode, the stripe mode and the parameter fusion mode, a rate distortion optimization algorithm is needed, and specifically, the rate distortion value is calculated by the following formula (1).
△J=△D+λR…(1)
In formula (1), Δd=nh×h-2hE; lambda is a known constant; r is the bit number coded by the syntax element under the related mode type, and is related to the adopted video coding standard; n represents the number of pixels conforming to different types (peak, valley, lobe, 32 stripes) in different boundary modes (eo_0, eo_90, eo_45 or eo_135) or the number of pixels belonging to different stripes (32 stripes) in stripe mode; e represents the sum of the differences between the original pixel values and the reconstructed pixel values corresponding to all the pixel points conforming to the same type or belonging to the same stripe; h represents the compensation value, h=e/N, h belongs to the interval [ -7,7], h= -7 being assigned if the calculated h is smaller than-7, h=7 being assigned if the calculated h is larger than 7.
Under the boundary mode, the compensation value ranges corresponding to different types in different boundary modes are obtained, then each compensation value in the range is substituted into DeltaJ= DeltaD+lambdaR, and h corresponding to the minimum DeltaJ is obtained to be the optimal compensation value.
For example, for pattern eo_135, valley type: as shown in fig. 5, for an image block of 64×64 pixels, if the comparison between each pixel and the upper left and lower right pixels satisfies the condition c < a & c < b, then the pixel is divided into the pattern eo_135, valley type; the same comparison operation is performed on all pixels in the 64x64 image block, and it is determined that a total of 20 pixels meet the valley type condition, n=20. For the determined 20 pixels, the difference value is made between the original pixel value of the pixel x (i.e., the pixel value of the pixel x in the source image) and the reconstructed pixel value before the adaptive offset compensation (i.e., the pixel value corresponding to the pixel x in the reconstructed image) to obtain Ex. E=e1+e2+ … … +ex+ … … +e20. Since the compensation value h must be greater than 0 because of the valley type, when h=e/N is calculated and h is less than 0, h=0 is assigned, and the compensation value range is 0, 7. If h is greater than 7, then h=7 is assigned and the compensation value range is 0, 7. If the calculated h belongs to [0,7], the compensation value range is determined to be [0, h ]. Substituting each integer value in the determined compensation value range into DeltaJ= DeltaD+lambdaR, and obtaining the h value corresponding to the minimum DeltaJ as the optimal compensation value h.
Referring to fig. 6, the method specifically includes the steps of:
step 101: and dividing the source image and the corresponding reconstructed image into a plurality of image blocks according to the preset size.
The method comprises the steps of obtaining a source image and a corresponding reconstructed image thereof, dividing the source image and the corresponding reconstructed image thereof into a plurality of image blocks according to preset sizes, wherein the preset sizes can be 32 x 32 or 64 x 64 and the like.
Step 102: and calculating the compensation value of the first image block under each color channel in parallel through the compensation filter circuit corresponding to each color channel, wherein the first image block is any image block included in the source image.
The color channels mentioned above represent the three channels of luminance Y and chrominance U and V in color coded YUV. The color codes of the source image and the reconstructed image are in YUV format, and if the coding format of the image obtained in step 101 is RGB or RGBA format, the image is converted into YUV format.
The embodiment of the application realizes the sample adaptive offset compensation filtering through a hardware circuit, and the hardware circuit structure based on the sample adaptive offset compensation filtering is shown in fig. 7. The circuit structure comprises three parallel compensation filter circuits, and the three compensation rate wave circuits respectively correspond to one of three channels Y, U, V. The three compensation filter circuits can be used for calculating the compensation values of the same image block under the Y, U, V channels respectively in parallel. The parallel calculation can improve the calculation speed, reduce the delay time of the sample self-adaptive offset compensation filtering, and meet the real-time requirement of the hardware encoder while solving the ringing effect of the encoder.
The hardware configuration of the three compensation filter circuits is the same, and only the specific configuration of the compensation filter circuit is shown in detail in fig. 7. As shown in fig. 7, the compensation filter circuit corresponding to the Y channel includes a parameter fusion mode circuit, a boundary-stripe mode circuit, and an uncompensated mode circuit connected in parallel. The parameter fusion Mode circuit is used for calculating an optimal rate distortion value and a corresponding compensation value of the image block under the Y channel by adopting a parameter fusion Mode (Merge Mode). The boundary-stripe mode circuit is used for calculating an optimal rate distortion value and a corresponding compensation value of the image block under the Y channel by adopting the boundary mode and the stripe mode in series. The uncompensated mode circuit is used for providing a preset rate distortion value and a corresponding preset compensation value, wherein the preset compensation value is 0, and the preset rate distortion value is a known initialization constant.
As shown in fig. 7, the boundary-stripe mode circuit includes a boundary mode circuit and a stripe mode circuit, and the stripe mode circuit is used for calculating an optimal rate distortion value of the first image block in the Y channel and a compensation value corresponding to each stripe according to a stripe compensation mode. As shown in fig. 7, the boundary mode circuit includes a peak type circuit, a valley type circuit, and a lobe type circuit, and is configured to calculate, in parallel, optimal rate distortion values and corresponding compensation values for each type of image block under the Y channel when an arbitrary boundary mode is adopted, by the peak type circuit, the valley type circuit, and the lobe type circuit. The boundary mode may be any one of a boundary horizontal mode, a boundary vertical mode, a boundary 45 degree mode, and a boundary 135 degree mode.
In the embodiment of the present application, the sample adaptive compensation filtering is performed based on the circuit structure shown in fig. 7, and the compensation operation for each image block is the same, so the first image block is specifically described by taking the first image block as an example, where the first image block is any image block included in the source image.
The first image block is firstly input into a first compensation filter circuit corresponding to a first channel, wherein the first channel is any one channel of YUV three channels of color coding. Since the circuit structure and compensation operation of each channel are the same, the embodiment of the present application will specifically describe the Y channel as an example, and reference may be made to the Y channel for specific operation of both the U and V channels.
Inputting the first image block into a first compensation filter circuit corresponding to the Y channel, and calculating a parameter fusion compensation value and a fusion rate distortion value of the first image block under the first channel through a parameter fusion mode circuit and calculating a boundary compensation value, a boundary rate distortion value, a stripe compensation value and a stripe rate distortion value of the first image block under the first channel through a boundary-stripe mode circuit in parallel in the first compensation filter circuit; and finally, determining a final compensation value of the first image block under the first channel from the parameter fusion compensation value, the boundary compensation value, the stripe compensation value and the preset compensation value corresponding to the uncompensated mode according to the fusion rate distortion value, the boundary rate distortion value, the stripe rate distortion value and the preset rate distortion value corresponding to the uncompensated mode.
As shown in fig. 7, the boundary-stripe mode circuit includes a boundary mode circuit and a stripe mode circuit, the boundary mode circuit serially calculates boundary compensation values and boundary rate distortion values corresponding to respective boundary modes of the first image block under the first channel, and the stripe mode circuit calculates stripe compensation values and stripe rate distortion values corresponding to the first image block under the first channel under the stripe mode, and the respective boundary modes include a boundary horizontal mode, a boundary vertical mode, a boundary 45 degree mode and a boundary 135 degree mode.
In this embodiment of the present application, the boundary mode circuit and the stripe mode circuit may be two circuits connected in parallel, or may be one circuit, and the calculation of the optimal rate distortion value and the compensation value of the boundary mode and the stripe mode is implemented by time-multiplexing the circuits.
The boundary mode comprises a boundary horizontal mode, a boundary vertical mode, a boundary 45-degree mode and a boundary 135-degree mode, and the boundary mode circuit calculates the optimal rate distortion value and the corresponding compensation value of each boundary mode in series. The processing procedure of each boundary mode is the same, and a first boundary mode is described below as an example, and the first boundary mode is any one of a boundary horizontal mode, a boundary vertical mode, a boundary 45 degree mode, and a boundary 135 degree mode.
As shown in fig. 7, the boundary mode circuit includes a peak type circuit, a valley type circuit, a concave angle type circuit and a convex angle type circuit connected in parallel, and the peak type circuit, the valley type circuit, the concave angle type circuit and the convex angle type circuit are used for calculating the optimal rate distortion value and the compensation value corresponding to each type of the first image block under the first channel in parallel according to the first boundary mode; calculating the sum value of the optimal rate distortion values corresponding to various types, and determining the sum value as the boundary rate distortion value of the first image block under the first channel when the first boundary mode is adopted; and determining the compensation value corresponding to each type as the boundary compensation value of the first image block under the first channel when the first boundary mode is adopted.
The processing procedures for the peak type circuit, the valley type circuit, the reentrant type circuit, and the lobe type circuit are the same, and the first type circuit is described below as an example, and the first type circuit is any one of the peak type circuit, the valley type circuit, the reentrant type circuit, and the lobe type circuit included in the boundary-stripe mode circuit.
Specifically, whether each pixel point in the preset number of pixel points in the first image block accords with the first type in the first boundary mode is judged in parallel through the first type circuit. Determining all first pixel points conforming to a first type under a first boundary mode from a first image block according to a preset traversal sequence; according to the number of the first pixel points, the original pixel values and the reconstructed pixel values corresponding to the first pixel points, calculating an optimal rate distortion value and a corresponding compensation value of the first image block under a first type under a first boundary mode through a first type circuit.
For example, in the boundary 45 degree mode shown in fig. 8, the Y-channel value of the current pixel is compared with the Y-channel values of the upper right and lower left adjacent pixels to determine which of the 4 types of peaks, valleys, reentrant angles, and lobes the current pixel belongs to. If a or b in the pixel a/b/c does not exist, not operating the pixel c; as shown in fig. 8, the first row of pixels is not processed since a does not exist; the pixels in the left column 1, the right column 1 and the bottom 1 row are not processed in the boundary 45 degree mode.
When the peak type circuit calculates the difference value sum E of the peak type pixel number N and the corresponding original pixel and the reconstruction pixel, the peak type circuit simultaneously judges the class condition of a whole row of pixels of the first image block in parallel so as to reduce the calculation time; as shown in fig. 8, it is determined how many pixels in the second row of pixels conform to the peak type, and the difference Ex between the Y channel value of the original pixel corresponding to the pixel conforming to the peak type and the Y channel value of the reconstructed pixel is calculated; and then accumulating and summing Ex corresponding to the peak type pixels to obtain E. And accumulating the number of the pixels of the peak type to obtain N. And (3) carrying out the same calculation on each row from top to bottom in sequence, and finally calculating the peak type pixel number N and the corresponding difference sum E of the original pixel and the reconstruction pixel of the first image block in the boundary 45-degree mode.
According to the same operation, the difference sum E of the corresponding original pixel and the reconstructed pixel is calculated by the valley type circuit, the concave angle type circuit and the convex angle type circuit in parallel, wherein the pixel number N of the valley type, the concave angle, the convex angle and the like in the boundary 45-degree mode is calculated. Finally, the boundary 45 degree mode is obtained: the number N0 of the peak type pixels and the corresponding difference sum E0 of the original pixels and the reconstructed pixels; the number N1 of valley type pixels and the corresponding difference sum E1 of original pixels and reconstructed pixels; the number N2 of the concave angle type pixels and the corresponding difference sum E2 of the original pixels and the reconstructed pixels; the lobe type pixel number N3 and the corresponding original pixel and reconstructed pixel difference sum E3.
And then calculating the optimal rate distortion value and the corresponding compensation value corresponding to each type respectively through the rate distortion optimization algorithm. The peak type is described as an example. And when the calculated h is greater than 0, assigning h=0, and the compensation value range is [ -7,0]. If the calculated h is less than-7, then h= -7 is assigned and the compensation value range is [ -7,0]. If the calculated h belongs to [ -7,0], the compensation value range is determined to be [ h,0]. Substituting each integer value and N0 and E0 corresponding to the peak type in the determined compensation value range into DeltaJ= DeltaD+lambdaR, and obtaining the h value corresponding to the minimum DeltaJ as the optimal compensation value h.
And respectively calculating optimal rate distortion values and corresponding compensation values corresponding to the valley type, the concave angle type and the convex angle type according to the same mode as the peak type. And then adding the optimal rate distortion values corresponding to the peak type, the valley type, the concave angle type and the convex angle type, determining the obtained sum value as the optimal rate distortion value of the first image block in the boundary 45-degree mode, and recording the optimal compensation value h corresponding to the peak type, the valley type, the concave angle type and the convex angle type.
For the boundary horizontal mode, the boundary vertical mode and the boundary 135 degree mode, the optimal rate distortion values corresponding to the boundary horizontal mode, the boundary vertical mode and the boundary 135 degree mode and the optimal compensation values corresponding to the various types in each mode can be calculated in sequence in the same mode as the boundary 45 degree mode.
Note that, as shown in fig. 9, the leftmost column and the rightmost column of each image block are not subjected to the boundary horizontal mode processing. As shown in fig. 10, the pixels of the 1 st row, the 1 st column, the 1 right column, and the 1 st row of each image block are not subjected to the boundary 135 degree mode processing. As shown in the figure 11 of the drawings,
in the parameter fusion mode circuit, the parameter fusion mode circuit firstly determines whether the image blocks adjacent to the left side and/or the image blocks adjacent to the upper side of the first image block exist or not, if the image blocks adjacent to the left side and/or the image blocks adjacent to the upper side exist, and the optimal rate distortion value and the corresponding optimal compensation value are calculated, the minimum optimal rate distortion value and the optimal compensation value corresponding to the minimum optimal rate distortion value are selected from the image blocks adjacent to the left side and/or the image blocks adjacent to the upper side and are used as the optimal rate distortion value and the optimal compensation value corresponding to the first image block. If the source image does not have the image block adjacent to the left side and/or the image block adjacent to the upper side, calculating an optimal rate distortion value and an optimal compensation value corresponding to the first image block according to the calculation mode of the boundary mode and/or the stripe mode.
After the optimal rate distortion value and the optimal compensation value in each mode are calculated in the mode, the minimum rate distortion value is determined from the fusion rate distortion value, the boundary rate distortion value, the stripe rate distortion value and the preset rate distortion value corresponding to the uncompensated mode; and determining the compensation value corresponding to the minimum rate distortion value as the final compensation value of the first image block under the first channel.
For the Y, U, V three channels, the optimal rate distortion value and the optimal compensation value of the first image block under the three channels are calculated through the hardware circuit in the above manner.
Step 103: and compensating the reconstructed image block corresponding to the first image block in the reconstructed image according to the compensation value of the first image block under each color channel.
Determining a compensation mode corresponding to a compensation value of the first image block under the first channel; if the compensation mode is a boundary compensation mode, determining pixel points which respectively accord with a peak type, a valley type, a concave angle type and a convex angle type in a reconstructed image block corresponding to the first image block; respectively adding the reconstructed pixel values corresponding to the pixel points of each type with the compensation values corresponding to each type under the first channel; if the compensation mode is a strip compensation mode, determining pixel points respectively belonging to each strip in the reconstructed image block; respectively adding the reconstructed pixel values corresponding to the pixel points of each strip with the compensation values corresponding to each strip under the first channel; if the compensation mode is a parameter fusion mode, respectively adding the compensation value under the first channel to the reconstructed pixel value corresponding to each pixel point in the reconstructed image block.
The hardware circuit is used for simultaneously operating the preset number of pixels in parallel, so that the calculation time is reduced, the instantaneity is improved, and the preset number can be one or more rows of pixels. Compensation filter pixel = reconstructed pixel + compensation value, and finally the pixel value after the sample adaptive compensation filter SAO filter compensation is output.
In the embodiment of the application, the sample self-adaptive offset filtering is realized through the hardware circuit, the delay is low, the speed is high, and the real-time requirement of the hardware encoder is met while the ringing effect of the encoder is solved.
The embodiment of the application also provides a hardware implementation device of the sample adaptive offset compensation filtering, which is used for executing the hardware implementation method of the sample adaptive offset compensation filtering provided by any embodiment. Referring to fig. 12, the apparatus includes:
the image dividing module 1201 is configured to divide the source image and the reconstructed image corresponding to the source image into a plurality of image blocks according to a preset size;
three compensation filter circuits 1202, configured to calculate, in parallel, compensation values of a first image block in YUV three color channels, where the first image block is any image block included in a source image;
the compensation module 1203 is configured to compensate a reconstructed image block corresponding to the first image block in the reconstructed image according to the compensation values of the first image block in the three color channels.
As shown in fig. 7, the compensation filter circuit 1202 includes:
the parameter fusion mode circuit is used for calculating a parameter fusion compensation value and a fusion rate distortion value of the first image block under a first channel, wherein the first channel is any one channel of the color coding YUV three channels;
the boundary-stripe mode circuit is used for calculating a boundary compensation value, a boundary rate distortion value, a stripe compensation value and a stripe rate distortion value of the first image block under the first channel through the boundary-stripe mode circuit;
the uncompensated mode circuit is used for providing a preset rate distortion value and a corresponding preset compensation value.
The boundary-stripe mode circuit includes a boundary mode circuit and a stripe mode circuit, the boundary mode circuit including a peak type circuit, a valley type circuit, a reentrant type circuit, and a lobe type circuit;
the band mode circuit is used for calculating a band rate distortion value of the first image block under the first channel and a compensation value corresponding to each band according to the band compensation mode;
the boundary mode circuit is used for parallelly calculating an optimal rate distortion value and a corresponding compensation value corresponding to each type of the first image block under the first channel when the first boundary mode is adopted through the peak type circuit, the valley type circuit, the concave angle type circuit and the convex angle type circuit, and determining the sum value of the optimal rate distortion values corresponding to each type as the boundary rate distortion value of the first image block under the first channel when the first boundary mode is adopted; and determining the compensation value corresponding to each type as a boundary compensation value of the first image block under the first channel when a first boundary mode is adopted, wherein the first boundary mode is any one mode of a boundary horizontal mode, a boundary vertical mode, a boundary 45 degree mode and a boundary 135 degree mode.
The hardware implementation device of the sample adaptive offset compensation filtering provided by the above embodiment of the present application and the hardware implementation method of the sample adaptive offset compensation filtering provided by the embodiment of the present application have the same beneficial effects as the method adopted, operated or implemented by the application program stored therein, because of the same inventive concept.
It should be noted that:
in the description provided herein, numerous specific details are set forth. However, it is understood that embodiments of the present application may be practiced without these specific details. In some instances, well-known structures and techniques have not been shown in detail in order not to obscure an understanding of this description.
Similarly, it should be appreciated that in the foregoing description of exemplary embodiments of the application, various features of the application are sometimes grouped together in a single embodiment, figure, or description thereof for the purpose of streamlining the application and aiding in the understanding of one or more of the various inventive aspects. However, the disclosed method should not be construed as reflecting the following schematic diagram: i.e., the claimed application requires more features than are expressly recited in each claim. Rather, as the following claims reflect, inventive aspects lie in less than all features of a single foregoing disclosed embodiment. Thus, the claims following the detailed description are hereby expressly incorporated into this detailed description, with each claim standing on its own as a separate embodiment of this application.
Furthermore, those skilled in the art will appreciate that while some embodiments described herein include some features but not others included in other embodiments, combinations of features of different embodiments are meant to be within the scope of the present application and form different embodiments. For example, in the following claims, any of the claimed embodiments can be used in any combination.
The foregoing is merely a preferred embodiment of the present application, but the scope of the present application is not limited thereto, and any changes or substitutions easily contemplated by those skilled in the art within the technical scope of the present application should be covered by the scope of the present application. Therefore, the protection scope of the present application shall be subject to the protection scope of the claims.

Claims (8)

1. A hardware implementation method of sample adaptive offset compensation filtering, comprising:
dividing a source image and a reconstruction image corresponding to the source image into a plurality of image blocks according to a preset size;
calculating the compensation value of a first image block under each color channel in parallel through a compensation filter circuit corresponding to each color channel, wherein the first image block is any image block included in the source image;
According to the compensation value of the first image block under each color channel, compensating the reconstructed image block corresponding to the first image block in the reconstructed image;
the calculating, in parallel, the compensation value of the first image block under each color channel by the compensation filter circuit corresponding to each color channel includes:
inputting a first image block into a first compensation filter circuit corresponding to a first channel, wherein the first channel is any channel in the color coding YUV three channels; in parallel in the first compensation filter circuit, calculating a parameter fusion compensation value and a fusion rate distortion value of the first image block under the first channel through a parameter fusion mode circuit, and calculating a boundary compensation value, a boundary rate distortion value, a strip compensation value and a strip rate distortion value of the first image block under the first channel through a boundary-strip mode circuit; and determining a final compensation value of the first image block under the first channel from the parameter fusion compensation value, the boundary compensation value, the strip compensation value and the preset compensation value corresponding to the uncompensated mode according to the fusion rate distortion value, the boundary rate distortion value, the strip rate distortion value and the preset rate distortion value corresponding to the uncompensated mode.
2. The method of claim 1, wherein the calculating, by a boundary-stripe mode circuit, boundary compensation values, boundary rate distortion values, stripe compensation values, and stripe rate distortion values for the first image block under the first channel comprises:
and calculating boundary compensation values and boundary rate distortion values corresponding to all boundary modes of the first image block under the first channel and stripe compensation values and stripe rate distortion values corresponding to stripe modes in series through a boundary-stripe mode circuit, wherein all boundary modes comprise a boundary horizontal mode, a boundary vertical mode, a boundary 45-degree mode and a boundary 135-degree mode.
3. The method of claim 2, wherein serially calculating, by a boundary-stripe mode circuit, boundary compensation values and boundary rate distortion values for each boundary mode of the first image block in the first channel comprises:
calculating optimal rate distortion values and corresponding compensation values corresponding to various types of circuits of the first image block under the first channel in parallel according to a first boundary mode by using a peak type circuit, a valley type circuit, a concave angle type circuit and a convex angle type circuit which are included in a boundary-stripe mode circuit, wherein the first boundary mode is any one mode of a boundary horizontal mode, a boundary vertical mode, a boundary 45-degree mode and a boundary 135-degree mode;
Calculating the sum of optimal rate distortion values corresponding to the various types of circuits, and determining the sum as a boundary rate distortion value of the first image block under the first channel when the first boundary mode is adopted;
and determining compensation values corresponding to the various types of circuits as boundary compensation values of the first image block under the first channel when the first boundary mode is adopted.
4. A method according to claim 3, wherein the calculating, in parallel, by the boundary-stripe mode circuit, peak-type, valley-type, and lobe-type circuits according to the first boundary mode, optimal rate distortion values and corresponding compensation values for each type of circuit of the first image block under the first channel comprises:
judging whether each pixel point in a preset number of pixel points in the first image block accords with a first type in a first boundary mode or not in parallel through a first type circuit; the first type circuit is any one of a peak type circuit, a valley type circuit, a reentrant type circuit and a lobe type circuit included in the boundary-stripe mode circuit;
determining all first pixel points conforming to a first type under a first boundary mode from the first image block according to a preset traversal sequence;
And calculating an optimal rate distortion value and a corresponding compensation value of the first image block under the first type under the first boundary mode through the first type circuit according to the number of the first pixel points, the original pixel value and the reconstruction pixel value corresponding to the first pixel points.
5. The method according to claim 1, wherein the determining, according to the fusion rate distortion value, the boundary rate distortion value, the banding rate distortion value, and the preset rate distortion value corresponding to the uncompensated mode, a final compensation value of the first image block in the first channel from the parameter fusion compensation value, the boundary compensation value, the banding compensation value, and the preset compensation value corresponding to the uncompensated mode includes:
determining a minimum rate distortion value from the fusion rate distortion value, the boundary rate distortion value, the stripe rate distortion value and a preset rate distortion value corresponding to an uncompensated mode;
and determining a compensation value corresponding to the minimum rate distortion value as a final compensation value of the first image block under the first channel.
6. The method according to claim 1, wherein compensating the reconstructed image block corresponding to the first image block in the reconstructed image according to the compensation value of the first image block under each color channel comprises:
Determining a compensation mode corresponding to a compensation value of the first image block under a first channel;
if the compensation mode is a boundary compensation mode, determining pixel points which respectively accord with a peak type, a valley type, a concave angle type and a convex angle type in a reconstructed image block corresponding to the first image block; respectively adding the reconstructed pixel values corresponding to the pixel points of each type to the compensation values corresponding to the circuits of each type under the first channel;
if the compensation mode is a strip compensation mode, determining pixel points respectively belonging to each strip in the reconstructed image block; respectively adding the reconstructed pixel values corresponding to the pixel points of each strip to the compensation values corresponding to each strip under the first channel;
and if the compensation mode is a parameter fusion mode, respectively adding the reconstructed pixel values corresponding to the pixel points in the reconstructed image block to the compensation value under the first channel.
7. A hardware implementation apparatus for sample adaptive offset compensation filtering, comprising:
the image dividing module is used for dividing the source image and the corresponding reconstructed image into a plurality of image blocks according to a preset size;
three compensation filter circuits, which are used for calculating the compensation value of a first image block under YUV three color channels in parallel, wherein the first image block is any image block included in the source image;
The compensation module is used for compensating the reconstructed image block corresponding to the first image block in the reconstructed image according to the compensation values of the first image block under the three color channels;
the compensation filter circuit includes: the parameter fusion mode circuit is used for calculating a parameter fusion compensation value and a fusion rate distortion value of the first image block under a first channel, wherein the first channel is any one channel of color coding YUV three channels; the boundary-stripe mode circuit is used for calculating a boundary compensation value, a boundary rate distortion value, a stripe compensation value and a stripe rate distortion value of the first image block under the first channel through the boundary-stripe mode circuit; the uncompensated mode circuit is used for providing a preset rate distortion value and a corresponding preset compensation value.
8. The apparatus of claim 7, wherein the boundary-stripe mode circuit comprises a boundary mode circuit and a stripe mode circuit, the boundary mode circuit comprising a peak type circuit, a valley type circuit, and a lobe type circuit;
the stripe mode circuit is used for calculating a stripe rate distortion value of the first image block under the first channel and a compensation value corresponding to each stripe according to a stripe compensation mode;
The boundary mode circuit is configured to calculate, in parallel, an optimal rate distortion value and a corresponding compensation value corresponding to each type of circuit under the first channel by using the peak type circuit, the valley type circuit, the reentrant type circuit and the lobe type circuit when a first boundary mode is adopted, and determine a sum of the optimal rate distortion values corresponding to each type of circuit as a boundary rate distortion value of the first image block under the first channel when the first boundary mode is adopted; and determining compensation values corresponding to the various types of circuits as boundary compensation values of the first image block under the first channel when the first boundary mode is adopted, wherein the first boundary mode is any one of the boundary horizontal mode, the boundary vertical mode, the boundary 45 degree mode and the boundary 135 degree mode.
CN202011625536.4A 2020-12-30 2020-12-30 Hardware implementation method and device for sample self-adaptive offset compensation filtering Active CN112822489B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202011625536.4A CN112822489B (en) 2020-12-30 2020-12-30 Hardware implementation method and device for sample self-adaptive offset compensation filtering

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202011625536.4A CN112822489B (en) 2020-12-30 2020-12-30 Hardware implementation method and device for sample self-adaptive offset compensation filtering

Publications (2)

Publication Number Publication Date
CN112822489A CN112822489A (en) 2021-05-18
CN112822489B true CN112822489B (en) 2023-05-16

Family

ID=75854807

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202011625536.4A Active CN112822489B (en) 2020-12-30 2020-12-30 Hardware implementation method and device for sample self-adaptive offset compensation filtering

Country Status (1)

Country Link
CN (1) CN112822489B (en)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114066914A (en) * 2020-07-30 2022-02-18 华为技术有限公司 Image processing method and related equipment
CN113645466B (en) * 2021-06-29 2024-03-08 深圳市迪威码半导体有限公司 Image deblocking algorithm based on random probability

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2013109419A1 (en) * 2012-01-21 2013-07-25 General Instrument Corporation Devices and methods for sample adaptive offset coding and/or selection of band offset parameters
CN104823446A (en) * 2012-12-06 2015-08-05 索尼公司 Image processing device, image processing method, and program
CN105409221A (en) * 2014-04-29 2016-03-16 微软技术许可有限责任公司 Encoder-side decisions for sample adaptive offset filtering

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9344743B2 (en) * 2011-08-24 2016-05-17 Texas Instruments Incorporated Flexible region based sample adaptive offset (SAO) and adaptive loop filter (ALF)
US9473784B2 (en) * 2013-05-20 2016-10-18 Texas Instruments Incorporated Sample adaptive offset (SAO) filtering in video coding
US20170006283A1 (en) * 2015-06-30 2017-01-05 Microsoft Technology Licensing, Llc Computationally efficient sample adaptive offset filtering during video encoding

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2013109419A1 (en) * 2012-01-21 2013-07-25 General Instrument Corporation Devices and methods for sample adaptive offset coding and/or selection of band offset parameters
CN104823446A (en) * 2012-12-06 2015-08-05 索尼公司 Image processing device, image processing method, and program
CN105409221A (en) * 2014-04-29 2016-03-16 微软技术许可有限责任公司 Encoder-side decisions for sample adaptive offset filtering

Also Published As

Publication number Publication date
CN112822489A (en) 2021-05-18

Similar Documents

Publication Publication Date Title
KR100791375B1 (en) Apparatus and method for color correction
CN112822489B (en) Hardware implementation method and device for sample self-adaptive offset compensation filtering
US8660174B2 (en) Apparatus and method of adaptive offset for video coding
US6456325B1 (en) Image signal processing device for minimizing false signals at color boundaries
US7956871B2 (en) Color disparity correction in image sensors methods and circuits
KR100280909B1 (en) Image rendering system
US8537234B2 (en) Image restoration with enhanced filtering
US20200007872A1 (en) Video decoding method, video decoder, video encoding method and video encoder
US9473784B2 (en) Sample adaptive offset (SAO) filtering in video coding
JP5165083B2 (en) Apparatus and method for adaptive offset of video coding
KR100332268B1 (en) How to make hierarchical estimates of movement in television signals
US20010033399A1 (en) Method of and apparatus for image processing
US20060232690A1 (en) Image processing method
JP3862374B2 (en) Image processing apparatus and method
US20050013502A1 (en) Method of improving image quality
US6625326B1 (en) Edge enhancement method by 4-directional 1-dimensional high pass filtering
US6747698B2 (en) Image interpolating device
US6826302B2 (en) Luminance correction of colorless low saturation regions using correction constants calculated from color saturation values
US8498031B2 (en) Correction of white balance deviation in a captured image
US8963968B2 (en) Image processing apparatus and image processing method to perform screen process on image data of a plurality of colors using threshold matrix for each color
JP2021507643A (en) Image demosaic processing system and method
KR100306756B1 (en) Method for Enhancing the Edge of Color Image Based on Luminance Component
US11379956B2 (en) Image processing circuit and associated image processing method
JPH11296672A (en) Image color information extraction method
US6417501B1 (en) Image processing method for an image processing system having a changed image

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant