CN105120270B - Using the method and device of the adaptive migration processing reconstructing video of sample - Google Patents

Using the method and device of the adaptive migration processing reconstructing video of sample Download PDF

Info

Publication number
CN105120270B
CN105120270B CN201510473630.5A CN201510473630A CN105120270B CN 105120270 B CN105120270 B CN 105120270B CN 201510473630 A CN201510473630 A CN 201510473630A CN 105120270 B CN105120270 B CN 105120270B
Authority
CN
China
Prior art keywords
sample
adaptive
chroma
migration processing
video
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201510473630.5A
Other languages
Chinese (zh)
Other versions
CN105120270A (en
Inventor
傅智铭
陈庆晔
蔡家扬
黄毓文
雷少民
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
HFI Innovation Inc
Original Assignee
HFI Innovation Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from US13/158,427 external-priority patent/US9055305B2/en
Priority claimed from US13/311,953 external-priority patent/US20120294353A1/en
Application filed by HFI Innovation Inc filed Critical HFI Innovation Inc
Publication of CN105120270A publication Critical patent/CN105120270A/en
Application granted granted Critical
Publication of CN105120270B publication Critical patent/CN105120270B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/85—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using pre-processing or post-processing specially adapted for video compression
    • H04N19/86—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using pre-processing or post-processing specially adapted for video compression involving reduction of coding artifacts, e.g. of blockiness
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/117—Filters, e.g. for pre-processing or post-processing
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
    • H04N19/17—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object
    • H04N19/176—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a block, e.g. a macroblock
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
    • H04N19/186—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being a colour or a chrominance component
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/46—Embedding additional information in the video signal during the compression process
    • H04N19/463—Embedding additional information in the video signal during the compression process by compressing encoding parameters before transmission
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/60—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding
    • H04N19/61—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding in combination with predictive coding
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/70—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by syntax aspects related to video coding, e.g. related to compression standards
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/80—Details of filtering operations specially adapted for video compression, e.g. for pixel interpolation
    • H04N19/82—Details of filtering operations specially adapted for video compression, e.g. for pixel interpolation involving filtering within a prediction loop
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/90—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using coding techniques not provided for in groups H04N19/10-H04N19/85, e.g. fractals
    • H04N19/96—Tree coding, e.g. quad-tree coding

Abstract

The invention discloses a kind of method and devices of the method using the adaptive migration processing reconstructing video of sample, wherein method includes：Reconstructed video data is obtained from video bit stream, wherein reconstructed video data includes luminance component and multiple chromatic components；If the luma samples in video bit stream, which adaptively deviate instruction, shows that the adaptive migration processing of sample is applied to luminance component, single chroma sample is received from video bit stream and adaptively deviates instruction；If single chroma sample, which adaptively deviates instruction, shows that the adaptive migration processing of sample is applied to multiple chromatic components, the adaptive offset information of chroma sample is determined；And if single chroma sample adaptively deviates instruction and shows that the adaptive migration processing of sample is applied to multiple chromatic components, according to the adaptive offset information of chroma sample, using the adaptive migration processing of sample to multiple chromatic components.Method and device provided by the invention using the adaptive migration processing reconstructing video of sample can be encoded efficiently.

Description

Using the method and device of the adaptive migration processing reconstructing video of sample
Related application
The application be the applying date be on November 12nd, 2013, it is entitled " to be used for application No. is 201280022870.8 The divisional application of the application of the method and apparatus that the sample of brightness and chromatic component adaptively deviates ".
Technical field
The present invention is handled about video, and (sample is adaptively deviated using sample in particular to a kind of Adaptive offset, SAO) processing reconstructing video method and device.
Background technology
In video coding system, video data is carried out a variety of processing such as：Prediction, conversion, quantization, deblocking and from Adaptation loop filters.It is processed because carrying out aforesaid operations on video data along the processing path of video coding system Certain features of video data may be changed from original video data.Such as：The average value of processed video may occur partially It moves.Strength offsets may lead to visual impairment or artifact (artifacts), and especially when changing from frame to frame, intensity is inclined It moves more obvious.Therefore, image pixel intensities offset need to be compensated carefully or be restored to mitigate artifact.In this field, some intensity Compensation scheme is used.Such as：One kind being known as sample and adaptively deviates (sample adaptive offset, SAO) Strength offsets scheme, the intensity compensation scheme are generally selected according to context, by each pixel in processed video data point One in class to multiple classifications.Traditional SAO schemes are only applied to luminance component (luma component).It needs to extend SAO schemes apply equally to processing chromatic component (chroma component).SAO schemes usually require to combine video bit stream (bitstream) picture or piece (slice) (for example, is carried out the partition information (partition of piecemeal by the SAO information for including in Information) and the SAO deviants of each block), to allow a decoder to operation appropriate.SAO information may account for According to quite a few of the bit rate of compression video, and need to develop the method for efficiently encoding and including SAO information.In addition to SAO, self-adaption loop filtering is another type of loop filtering (in-loop filter), is usually applied to reconstructing video (reconstructed video) is to improve video quality.Similarly, it needs self-adaption loop filtering application in processing coloration Component is to improve video quality.Furthermore it needs to include self-adaption loop filtering information in video bit stream (for example, partition information And filtering parameter), to allow a decoder to operation appropriate.Therefore, it is also desirable to which the efficient coding of exploitation is returned comprising adaptive The method of the video bit stream of road filtering information.
Invention content
In order to solve the above technical problems, the present invention provides a kind of using the adaptive migration processing reconstructing video of sample Method and device.
The present invention provides a kind of method using the adaptive migration processing reconstructing video of sample, is used in Video Decoder, The method includes：From video bit stream obtain reconstructed video data, wherein the reconstructed video data include luminance component and Multiple chromatic components；If the luma samples in the video bit stream, which adaptively deviate instruction, shows that sample adaptively deviates Processing is applied to the luminance component, and single chroma sample is received from the video bit stream and adaptively deviates instruction；If The single chroma sample adaptively deviates instruction and shows the adaptive migration processing of the sample applied to the multiple coloration point Amount, determines the adaptive offset information of chroma sample；And if the single chroma sample adaptively deviate instruction show it is described The adaptive migration processing of sample is applied to the multiple chromatic component, according to the adaptive offset information of the chroma sample, application The adaptive migration processing of sample is to the multiple chromatic component.
The present invention also provides a kind of methods using the adaptive migration processing reconstructing video of sample, are used for video encoder In, the method includes：Acquisition includes the reconstructed video data of luminance component and multiple chromatic components；If luma samples are adaptive Instruction should be deviated and show that the adaptive migration processing of the sample is applied to the luminance component, video bit stream includes single color Degree sample adaptively deviates instruction；If the single chroma sample, which adaptively deviates instruction, shows that the sample adaptively deviates Applied to the multiple chromatic component, the video bit stream includes the adaptive offset information of chroma sample；And if institute State single chroma sample adaptively deviate instruction show the adaptive migration processing of the sample be applied to the multiple chromatic component, According to the adaptive offset information of the chroma sample, using the adaptive migration processing of the sample to the multiple chromatic component.
The present invention separately provides a kind of device using the adaptive migration processing reconstructing video of sample, is used for Video Decoder In, described device includes：Device for obtaining reconstructed video data from video bit stream, wherein the reconstructed video data packet Include luminance component and multiple chromatic components；Show sample certainly if the brightness in the video bit stream adaptively deviates instruction It adapts to migration processing and is applied to the luminance component, it is adaptively inclined for receiving single chroma sample from the video bit stream Move the device of instruction；If the single chroma sample, which adaptively deviates instruction, shows the adaptive migration processing application of the sample In the multiple chromatic component, the device for determining the adaptive offset information of chroma sample；And the if single coloration Sample adaptively deviates instruction and shows that the adaptive migration processing of the sample is applied to the multiple chromatic component, for according to institute State device of the adaptive offset information of chroma sample using the adaptive migration processing of the sample to the multiple chromatic component.
The present invention separately provides a kind of device using the adaptive migration processing reconstructing video of sample, is used for video encoder In, described device includes：Device for obtaining the reconstructed video data for including luminance component and multiple chromatic components；If bright Degree sample adaptively deviates instruction and shows that the adaptive migration processing of the sample is applied to the luminance component, for showing video Bit stream includes the device that single chroma sample adaptively deviates instruction；If adaptively offset refers to the single chroma sample Show and shows the adaptive offset applications of the sample in the multiple chromatic component, for showing that the video bit stream includes color Spend the device of the adaptive offset information of sample；And if the single chroma sample adaptively deviates instruction and shows the sample Adaptive migration processing is applied to the multiple chromatic component, for applying institute according to the adaptive offset information of the chroma sample The adaptive migration processing of sample is stated to the device of the multiple chromatic component.
The present invention separately provides a kind of method using the adaptive migration processing reconstructing video of sample, is used for Video Decoder In, the method includes：Reconstructed video data is obtained from video bit stream, wherein the reconstructed video data includes luminance component With multiple chromatic components；Whether the adaptive migration processing of judgement sample is applied to the luminance component；From the video bit stream The middle single chroma sample of reception adaptively deviates instruction；If the single chroma sample, which adaptively deviates instruction, shows the sample This adaptive migration processing is applied to the multiple chromatic component, determines the adaptive offset information of chroma sample；And if institute State single chroma sample adaptively deviate instruction show the adaptive migration processing of the sample be applied to the multiple chromatic component, According to the adaptive offset information of the chroma sample, using the adaptive migration processing of the sample to the multiple chromatic component.
The present invention separately provides a kind of method using the adaptive migration processing reconstructing video of sample, is used for video encoder In, the method includes：Acquisition includes the reconstructed video data of luminance component and multiple chromatic components；Judgement sample is adaptively inclined Whether shifting processing is applied to the luminance component；Single chroma sample is adaptively deviated to instruction to be incorporated in video bit stream；Such as Single chroma sample described in fruit adaptively deviates instruction and shows the adaptive offset applications of the sample in the multiple chromatic component, The adaptive offset information of chroma sample is incorporated in the video bit stream；And if the single chroma sample is adaptively inclined It moves instruction and shows that the adaptive migration processing of the sample is applied to the multiple chromatic component, it is adaptive according to the chroma sample Offset information, using the adaptive migration processing of the sample to the multiple chromatic component.
The present invention separately provides a kind of device using the adaptive migration processing reconstructing video of sample, is used for Video Decoder In, described device includes：Device for obtaining reconstructed video data from video bit stream, wherein the reconstructed video data packet Include luminance component and multiple chromatic components；Whether it is applied to the dress of the luminance component for the adaptive migration processing of judgement sample It sets；The device for adaptively deviating instruction for receiving single chroma sample from the video bit stream；If the single color Degree sample adaptively deviates instruction and shows that the adaptive migration processing of the sample is applied to the multiple chromatic component, for determining The device of the adaptive offset information of chroma sample；And if the single chroma sample adaptively deviates instruction and shows the sample This adaptive migration processing is applied to the multiple chromatic component, for according to the adaptive offset information application of the chroma sample The adaptive migration processing of sample to the multiple chromatic component device.
The present invention separately provides a kind of device using the adaptive migration processing reconstructing video of sample, is used for video encoder In, described device includes：Device for obtaining the reconstructed video data for including luminance component and multiple chromatic components；For sentencing Whether the adaptive migration processing of disconnected sample is applied to the device of the luminance component；For single chroma sample adaptively to be deviated Indicate the device being incorporated in video bit stream；If the single chroma sample, which adaptively deviates instruction, shows that the sample is adaptive Answer offset applications in the multiple chromatic component, for the adaptive offset information of chroma sample to be incorporated in the video bit stream Device；And if the single chroma sample adaptively deviates instruction and shows that the adaptive migration processing of the sample is applied to The multiple chromatic component, for applying the adaptive migration processing of the sample according to the adaptive offset information of the chroma sample To the device of the multiple chromatic component.
Method and device provided by the invention using the adaptive migration processing reconstructing video of sample can carry out efficient Coding.
Description of the drawings
Fig. 1 is the system block diagram of the video encoder comprising reconstruct circuit (reconstruction loop), intermediate ring road Be filtered adaptively deviated including de-blocking filter, sample and self-adaption loop filtering.
Fig. 2 be include reconstruct circuit Video Decoder system block diagram, loop filter processing include de-blocking filter, Sample adaptively offset and self-adaption loop filtering.
Fig. 3 is the embodiment that the present invention carries out that SAO encodes current block C using the information of adjacent block A, D, B, E.
Fig. 4 A are the implementation that the present invention is divided for the image based on quaternary tree (quadtree-based) of SAO processing Example.
Fig. 4 B are the embodiment that the present invention is divided for the image based on LCU of SAO processing.
Fig. 5 A are the embodiment that block C allows quaternary tree subregion, and wherein block A and D is located at identical subregion, and block B is located at difference Subregion.
Fig. 5 B are another embodiment that block C allows quaternary tree subregion, and wherein block A and D is located at identical subregion, and block B is located at Different subregions.
Fig. 5 C are the embodiment that block C does not allow quaternary tree subregion, and wherein block A and D is located at identical subregion, and block B is located at not Same subregion.
Fig. 6 A are the embodiment that block C allows quaternary tree subregion, and wherein block B and D is located at identical subregion, and block A is located at difference Subregion.
Fig. 6 B are another embodiment that block C allows quaternary tree subregion, and wherein block B and D is located at identical subregion, and block A is located at Different subregions.
Fig. 6 C are the embodiment that block C does not allow quaternary tree subregion, and wherein block B and D is located at identical subregion, and block A is located at not Same subregion.
It includes that the grammer of (flag) is marked to set that Fig. 7, which is in sequence parameter set (Sequence Parameter Set, SPS), It counts (syntax design), wherein it is enabled or forbidden energy that label, which is used to indicate SAO in the sequence,.
Fig. 8 is the grammar design of SAO parameter sao_param (), wherein individual SAO information allows chromatic component.
Fig. 9 is the grammar design of SAO partitioning parameters sao_split_param (), wherein SAO partitioning parameters sao_split_ Param () includes " component " parameter, and " component " can be one in luminance component or multiple chromatic components.
Figure 10 is the grammar design of SAO partitioning parameters sao_split_param (), wherein SAO partitioning parameters sao_ Split_param () includes " component " parameter, and " component " can be in luminance component or multiple chromatic components one It is a.
Figure 11 is the embodiment that the image based on quaternary tree determined for SAO types divides.
Figure 12 A are the embodiment of the SAO based on image, and wherein whole image uses identical SAO parameters.
Figure 12 B are the embodiment of the SAO based on LCU, wherein every LCU uses respective SAO parameters.
Figure 13 is running the example for the SAO information for first three LCU, which is equal to 2.
Figure 14 is using run signal and to merge overlay mark (merge-above flag) to encode shared SAO information Embodiment.
Figure 15 is that overlay mark is predicted and merged using run signal, operation to encode the embodiment of shared SAO information.
Specific implementation mode
The present invention is handled about video, and (sample adaptive are adaptively deviated in particular to including sample Offset, SAO) compensate the adaptive loop filter that (adaptive loop filter, ALF) is filtered with self-adaption loop (adaptive in-loop filtering) device and method.
In the field high efficiency Video coding (High Efficiency Video Coding, HEVC), a kind of title is introduced Adaptively to deviate the technology of (Adaptive Offset, AO), the offset for compensating reconstructing video, and adaptively deviate Technology is applied in reconstruct circuit.Application No. is 13/158,427, entitled " Apparatus and Method of The U.S. patent application case of Sample Adaptive Offset for Video Coding " discloses a kind of migration side Method and system.The offset compensating method and system are by each pixel classifications a to class, and the classification based on each pixel is to place It manages the compensation of video data application strength offsets or repairs.Other than adaptively deviating, in high efficiency field of video encoding, also draw Self-adaption loop filtering (Adaptive Loop Filter, ALF) is entered to improve the quality of video.Self-adaption loop filtering fortune The video being located in reconstruct circuit is rebuild with space filtering (spatial filter).In the present invention as stated above, AO and ALF all by It is considered a kind of loop filtering.
The example of encoder as shown in Figure 1 illustrates one using prediction (intra/inter- within the frame/frames Prediction system).Video data of the intraprediction unit 110 based on same image is responsible for providing prediction data.For Inter-prediction, ME/MC units 112, i.e. motion prediction (motion estimation, ME) and motion compensation (motion Compensation, MC), provide prediction data for the video data based on other images.Switch 114 for selecting in frame or Person's inter-prediction data, and selected prediction data is provided to adder 116 to generate prediction error (prediction Errors), also it is residual error (residues).The prediction error is then successively by T (transformation, conversion) 118 and Q (quantization, quantization) 120 processing.The coding of unit 122 is coded by entropy to form correspondence by the residual error after conversion and quantization In the bit stream of the compressed video data.With the relevant bit stream of conversion parameter and additional information (side information) It is packaged.The additional information can be：Movement, pattern and the other and relevant information of image-region.The additional information also by into Row entropy coding is to reduce required bandwidth.As shown in Figure 1, being provided to entropy code unit 122 with the relevant data of additional information.When Using inter-frame forecast mode, a reference picture or multiple reference pictures must be reconstructed in encoder-side.Therefore, IQ (inverse Quantization, inverse quantization) 124 and IT (inverse transformation, inverse conversion) 126 handles this and converted and measured Residual error after change is to restore the residual error.Then, in REC (reconstruction, reconstruct) 128, it is pre- which is added back to this Measured data 136 is with reconstructed video data.The reconstructed video data can be stored in reference picture buffer 134, and be used for pre- Survey other frames.As shown in Figure 1, the video data of input experienced a series of processing in coded system.By the weight of REC128 Structure video data is because strength offsets and other noises may occur for a series of above-mentioned processing.Therefore, it is deposited in reconstruct data Before storage to the reference picture buffer 134, (sample is adaptive by 130 and SAO by DF (deblocking filter, de-blocking filter) Offset) 131 and ALF (self-adaption loop filtering) 132 is applied to the reconstructed video data to improve video quality.The sample Adaptive offset information and the adaptive-filtering information must be transmitted in this bitstream, therefore decoder appropriate can restore Information needed is with the adaptive offset of application and adaptive-filtering.Therefore, to be incorporated to the bit stream, SAO131 is exported adaptive inclined The self-adaption loop filtering information for moving information and ALF132 outputs is provided to entropy coder 122.In order to obtain adaptive offset Information and self-adaption loop filtering information, encoder may need to access original video data.It does not draw clearly in Fig. 1 From the path being input between SAO131, ALF132.
Fig. 2 is the system block diagram of the Video Decoder embodiment filtered comprising de-blocking filter and self-adaption loop.Because compiling Code device is also comprising local decoder to reconstruct the video data, therefore in addition to entropy decoder 222, some decoder elements are It is used in encoder.Further, only motion compensation units 212 are required in decoder end.Switch unit 214 selects frame Interior or inter-frame forecast mode, and the prediction data selected is provided to REC128 to merge with the residual error of recovery.In addition to Compressed video data executes entropy decoding, the also entropy decoding additional information of entropy decoding unit 222 and provides the additional information to respective Block.For example, frame mode information is provided to intraprediction unit 110, and inter-frame mode information is provided to motion compensation Unit MC 212, adaptive offset information are provided to SAO131, and self-adaption loop filtering information is provided to ALF 132, with And residual error is provided to IQ 124.IQ 124, IT 126 and subsequent reconstruction processing handle the residual error, are regarded with reconstructing this Frequency evidence.Again, as shown in Fig. 2, the reconstructed video data exported from REC 128 is after including a series of of IQ124 and IT126 Strength offsets occur after processing.The reconstructed video data is further by de-blocking filter 130, SAO131 and ALF132 processing.
According to existing HEVC standard, loop filtering is only applied to the luminance component of reconstructing video.Equally, by loop filtering Chromatic component for reconstructing video is also quite beneficial.For chromatic component, with the relevant information of loop filtering be phase When big.However, chromatic component usually can be with the smaller compressed data of boil down to specific luminance component.Therefore, it is necessary to develop one kind Effectively using the method and apparatus of loop filtering to chromatic component.Therefore, the bright exposure one kind of this law is efficiently applied to chromatic component SAO method and apparatus.
In one embodiment of this invention, when the SAO for luminance component has been turned on, an instruction is provided (indication) it is to start or close for the loop filtering of chromatic component with signal (signaling).If being used for brightness The SAO of component does not start, then the SAO for chromatic component will not start.Therefore, in this case, there is no need to Instruction is provided, to illustrate the loop filtering for chromatic component to be to start or close.Pseudo-code (pseudo in the present embodiment Codes example) is as follows：
Indicate that the SAO for chromatic component is that the label started is known as the instruction of coloration loop filtering, because it can be used for ALF can be used for SAO.SAO is a kind of embodiment of loop filtering processing, and loop filtering processing can also be ALF.At this In another embodiment of invention, when the SAO for luminance component has been turned on, respective instruction (individual is provided Indications), to illustrate the loop filtering for multiple chromatic components (such as Cb and Cr) to be to start or close.If with Do not start in the SAO of luminance component, then the SAO for two chromatic components will not start.Therefore, in such case Under, there is no need to provide respective instruction, to illustrate the loop filtering for two chromatic components to be to start or close.This reality The example for applying the pseudo-code in example is as follows：
As described above, needing to develop a kind of effective loop circuit filtering method to reduce data volume.For example, reducing about SAO If information such as the SAO parameters instruction whether started and SAO required when starting.Since adjacent block usually has similar spy Sign, therefore adjacent block can be used for reducing required SAO information.Fig. 3 is the embodiment that SAO information is reduced using adjacent block. Block C is the current block that SAO is being handled.As shown in figure 3, block B, D, E and A are phase that is being handled before block C and surrounding block C Adjacent block.The parameter of currently processed piece of block-based syntactic representation.Block can be a coding unit (coding unit, CU), most Big coding unit (largest coding unit, LCU) or multiple maximum coding units (multiple LCUs).Using mark Remember to indicate that the shared SAO parameters of current block and adjacent block can reduce the bit rate needed for current block.Such as the processing sequence of fruit block For raster scan order, then when the parameter of encoding block C, the parameter of block D, B, E and A are available.When from adjacent block When parameter is available, the parameter of these blocks can be used for encoding current block.Need to send indicating the mark of shared SAO parameters The data volume of note is usually far less than the data volume of SAO parameters.Therefore, it can be achieved that efficient SAO.However, SAO is filtered as loop Wave illustrates the parameter sharing based on adjacent block, is merely possible to example, which can also be applied to other loops Filtering, such as ALF.
In current HEVC standard, the algorithm based on quaternary tree can be used for that image-region is adaptively divided into four Sub-regions, to realize better performance.In order to maintain the coding gain of SAO, the coding for the SAO divisions based on quaternary tree Algorithm needs are effectively designed.SAO parameters (SAOP) include the deviant of types index (type index) and selected type. Fig. 4 A and Fig. 4 B are the embodiment that the SAO based on quaternary tree is divided.Fig. 4 A expressions will be divided using quaternary tree partition method The image in area, wherein each corresponding LCU of small square.First subregion (0 subregion of depth) is indicated with split_0 ().Value 0 indicates not divide, and value 1 indicates application segmentation.In figure 4b, image include 12 LCU, be respectively labeled as P1, P2 ..., P12.0 quaternary tree subregion of depth, split_0 (1) divide the image into 4 parts, upper left, upper right, lower-left and lower right area.Due to Lower-left and lower right area only have a row block, therefore cannot further apply quaternary tree subregion.Therefore, 1 quaternary tree subregion of depth Consider upper left and right regions.In embodiment shown in Fig. 4 A, top left region is not divided, using split_1 (0) come table Show；Right regions are further split into four regions, are indicated using split_1 (1).Correspondingly, four forks in Figure 4 A Tree division result be 7 subregions, divide list notation be P ' 0 ..., P ' 6, wherein：
The SAO parameters of P1 are identical as the parameter of P2, P5 and P6；
The SAO parameters of P9 are identical as the SAO parameters of P10；And
The SAO parameters of P11 are identical as the SAO parameters of P12.
According to the partition information of SAO, each LCU can be a new subregion, or be merged into other LCU For a subregion.If current LCU instructions are merged, multiple merging can be selected candidate.In order to illustrate permission information Shared grammar design example only allows in quaternary tree subregion shown in Fig. 3 candidate there are two merging.Although in the present embodiment In only there are two candidate, but multiple candidates can be selected from adjacent block in other embodiments of the invention.Grammar design is such as Under：
According to another embodiment of the present invention, the attribute of the relationship between adjacent block (LCUs) and quaternary tree subregion, can For reducing the data volume for the SAO relevant informations for needing to transmit.In addition, the boundary condition of image-region (such as piece) may wrap Containing the relation information between adjacent block, it can be used for reducing the data volume of the required SAO relevant informations transmitted.Relationship between adjacent block The relationship that may also can be introduced between redundancy and adjacent block dependent on adjacent block can be used for reducing the required SAO phases transmitted Close the data volume of information.
Fig. 5 A- Fig. 5 C are the embodiment of the redundancy dependent on adjacent block.As fig. 5 a and fig. 5b, according to quaternary tree subregion Attribute, if fruit block D and A is in identical subregion, block B is in another subregion, then block A and block C will be at different points In area.In other words, according to quaternary tree subregion, the situation shown in Fig. 5 C is not allow to occur.Therefore, the merging in Fig. 5 C is waited Choosing is redundancy (redundant), and is not necessarily to indicate that the merging mark of corresponding diagram 5C distributes a code.Implement to close And the pseudo-code embodiment of algorithm is as follows：
As described in above-described embodiment, only there are two types of allowing, i.e. block C is a new subregion or block C and block B It merges.Therefore, only with individual bit (single bit) come indicate newPartitionFlag be enough to identify this two Kind situation.In another embodiment, as shown in Figure 6 A and 6 B, block D and block B are in identical subregion, and block A is in another subregion Interior, block B and block C will be in different subregions.In other words, according to quaternary tree subregion, the situation shown in Fig. 6 C is not fair Perhaps occur.Therefore, the merging candidate in Fig. 6 C is redundancy, and is not necessarily to indicate the merging mark point of corresponding diagram 6C With a code.The pseudo-code embodiment for implementing to merge algorithm is as follows：
Fig. 5 A-5C and Fig. 6 A-6C illustrate to be further reduced working as required transmission with the redundancy dependent on adjacent block Two embodiments of preceding piece of relevant SAO information.System utilizes the redundancy dependent on adjacent block, and there are many more other conditions.Example Such as, if fruit block A, B and D are in identical subregion, then block C cannot be in other subregions.Therefore, block C must be with block A, B With D in identical subregion, and also It is not necessary to the instruction of transmission SAO information sharings.The LCU blocks of sheet border also contemplate for using The relevant SAO information of current block transmitted needed for reduction.For example, be not present such as fruit block A, that just only can be into there are one direction Row merges.If fruit block B is not present, equally also can only be merged there are one direction.If fruit block A and B are not present, just do not have Necessity transmission marks to indicate the block C subregions new as one.In order to be further reduced transfer syntax element (syntax Elements quantity) can show that current slice only applies a kind of SAO types with a label, is based on without any The signaling (signaling) of LCU.When sheet above is single subregion, the quantity of transfer syntax element can also be reduced.However, In the above-described embodiments, LCU is the unit as block, and other blocks can also be used to configure (for example, size and shape of block). Although here using piece as image-region example, the block in image-region is grouped with shared common information, certainly Other image-regions can be used, such as：One pack and piece image.
In addition, coloration and luminance component can share the identical SAO information for color video data.SAO information also may be used To be shared between multiple chromatic components.For example, brightness partition information can be used in multiple chromatic components (Cb and Cr), thus without Partition information need to be provided for chromatic component.In another embodiment, chromatic component Cb and Cr can share identical SAO parameters, because This, need to only transmit one group of SAO parameter so that Cb and Cr is shared.The SAO grammers of luminance component can be used for chromatic component, wherein SAO grammers may include quaternary tree grammer and the grammer based on LCU.
The SAO information transmitted needed for being reduced with the redundancy dependent on adjacent block as shown in Fig. 5 A-5C and Fig. 6 A-6C The embodiment of relevant data can also be applied to chromatic component.SAO parameters include the SAO of SAO types index and selected type Deviant, SAO parameters can be encoded before partition information, thus can be formed SAO parameter sets (SAO parameter set, SAOPS).Correspondingly, the SAO parameters of current block can be identified from SAO parameter sets using index, wherein transmission index Data be typically less than transmit SAO parameters data.When partition information is encoded, to indicate the index selection of SAO parameters It can be encoded together.The quantity of SAO parameter sets dynamically increases.For example, after signal has new SAO parameters, SAO parameters The quantity of the SAO parameters of concentration will increase by 1.In order to indicate the quantity in SAO parameter sets, bit number can be dynamically adjusted (number of bits) with data area to be consistent.E.g., including the SAO parameter sets of 5-8 parameter need with 3 bits come It indicates.After signal has new SAO parameters, the quantity in SAO parameter sets can increase to 9, at this moment just need with 4 bits come Expression includes the SAO parameter sets of 9 parameters.
If the processing of SAO is related to the data in other, SAO can be avoided using filling technique from any other Middle acquisition data or change pattern (pattern) are to replace from other data.In order to reduce required SAO information Data, SAO parameters can be used prediction after form (predicted form) transmit, for example, transmission current block SAO parameters with Difference between the SAO parameters of adjacent block.The SAO parameters for chromatic component are reduced according to another embodiment of the present invention.Example Such as, the offset based on edge (Edge-based Offset, EO) classification is by four kinds of each pixel classifications to chromatic component In class.The quantity of the EO types of chromatic component can be reduced to two kinds, to reduce the relevant transmission number of SAO information with current block According to.The band quantity of band offset (band offset, the BO) classification of luminance component is typically 16.In another embodiment, brightness point The band quantity of band offset (band offset, the BO) classification of amount can be reduced to 8.
Embodiment shown in Fig. 3 illustrates that there are four merge candidate (that is, block A, B, D and E) to current block C.If Merge candidate blocks to be located in identical subregion, merging candidate quantity can be reduced.Correspondingly, which is used to indicate and merges time Select selected bit number that can reduce or save.If the processing of SAO is related to the data in other, SAO will be avoided Data are obtained from any other, and skip currently processed pixel to avoid from other data.In addition, label It can be used for controlling whether SAO processing avoids from any other acquisition data.Whether avoided from any other about SAO processing The control label for obtaining data, may be embodied in sequence level or image level.About SAO processing whether avoid from it is any its Its piece obtains the control label of data, or the non-crossing sheet border of adaptive-filtering or de-blocking filter label is shared. In order to be further reduced transmission and the relevant data of SAO information, the ON/OFF control of coloration SAO depends on the ON/OFF of brightness SAO Information.The type of coloration SAO can be the subset of the brightness SAO in specific SAO types.
Grammar design example according to various embodiments of the present invention is described as follows.Fig. 7 illustrates to be included in sequence level Sao_used_flag in data, such as sequence parameter set (Sequence Parameter Set, SPS).Work as sao_used_ When the value of flag is 0, SAO is forbidden energy to sequence.When the value of sao_used_flag is 1, SAO is enabled to sequence.Figure 8 disclose a grammer example of SAO parameters, wherein sao_param () grammer may be embodied in auto-adaptive parameter set (Adaptation Parameter Set, APS), picture parameter set (Picture Parameter Set, PPS) or piece header (header) in.In addition to PPS, APS are the headers of another image level, including may be with the parameter of image modification.If Sao_flag instruction SAO be it is enabled, grammer by will include for luminance component partitioning parameters sao_split_param (0, And offset parameter sao_offset_param (0,0,0,0) 0,0,0).In addition, grammer further includes the SAO labels for Cb components Sao_flag_cb and for Cr components SAO mark sao_flag_cr.If sao_flag_cb instructions are for Cb components SAO be it is enabled, grammer by will include for chromatic component Cb partitioning parameters sao_split_param (0,0,0,1) and partially Shifting parameter sao_offset_param (0,0,0,1).If SAO of the sao_flag_cr instructions for Cr components is enabled, language Method will will include partitioning parameters sao_split_param (0,0,0,2) and offset parameter sao_ for chromatic component Cr offset_param(0,0,0,2).Fig. 9 discloses a language of sao_split_param (rx, ry, Depth, component) Method example, the wherein grammer are similar to traditional sao_split_param (), in addition to increased additional parameter " component ", wherein " component " is used to indicate one in luminance component or multiple chromatic components.Figure 10 is disclosed A grammer example of sao_offset_param (rx, ry, Depth, component), wherein the grammer and traditional sao_ Offset_param () is similar, in addition to increased additional " component " parameter.Sao_offset_param (rx, ry, Depth, component) in, if segmentation mark sao_split_flag [component] [Depth] [ry] [rx] indicates this One region will not further be divided, and grammer will include sao_type_idx [component] [Depth] [ry] [rx].Grammer The explanation of sao_type_idx [component] [Depth] [ry] [rx] is as shown in table 1.
Table 1
As shown in figure 11, the sample of HM-3.0 applications adaptively deviates (SAO) and uses the grammer based on quaternary tree, is based on four Image-region recurrence (recursively) is divided into 4 sub-regions by the grammer of fork tree using dividing mark.Each leaf region (leaf region) has the SAO parameters of oneself, and wherein SAO parameters include SAO types and the offset value information of application region. In Figure 11 embodiments of the disclosure, image is divided into 7 leaf regions, and 1110 to 1170, wherein band offset type SAO is applied to leaf area Domain 1110 and 1150, edge offset type SAO are applied to leaf region 1130,1140 and 1160, and for 1120 He of leaf region 1170, SAO be to close.In order to improve coding gain, grammar design according to an embodiment of the invention uses image level mark Note is to switch in the SAO based on image and between block-based SAO, wherein block can be a LCU or other block sizes. Figure 12 A disclose the embodiment of the SAO based on image, and Figure 12 B disclose the embodiment of block-based SAO, wherein each region For a LCU, and there are 15 LCU in the picture.In the SAO based on image, whole image shares a SAO parameter (SAOP).The SAO based on piece can also be used, so that entire piece or a multiple shared SAOP.In the SAO based on LCU In, each LCU has the SAO parameters of oneself and 15 LCU (LCU1-LCU15) to use one in SAOP1-SAOP15 respectively It is a.
In another embodiment in accordance with the invention, the SAOP of each LCU can be shared by subsequent LCU.It is shared identical The quantity of the continuous subsequent LCU of SAOP can be indicated by run signal (run signal).Embodiment shown in Figure 13 In, SAOP1, SAOP2 and SAOP3 are identical.In other words, the SAOP of first LCU is SAOP1, and SAOP1 be used for Two LCU afterwards.In this case, grammer " run=2 " will be encoded to the continuous subsequent of the shared identical SAOP of signal The quantity of LCU.Since the SAOP of following two LCU is without transmission, the bit rate for encoding these SAOP can be saved. It in another embodiment in accordance with the invention, can according to the LCU in the next line of raster scan order in addition to using run signal To share the SAOP of current LCU.If the LCU of top is available, it can use and merge overlay mark (merge-above Flag) come indicate the shared tops current LCU LCU SAOP.If being set as 1 by overlay mark is merged, current LCU will make With the SAOP of the LCU of top.As shown in figure 14, SAOP2 is shared by four LCU, i.e. 1410-1440, wherein " run=1 " and " no Merge-above " is used to refer to the shared SAOP2 of LCU1410 and 1420, and does not share the SAOP of the LCU above them.This Outside, " run=1 " and " merge-above=1 " is used to refer to the shared SAOP2 of LCU1430 and 1440, and their shared tops LCU SAOP.In addition, SAOP1 and SAOP3 are shared by two subsequent LCU respectively, SAOP4 is by four subsequent LCU It shares.Correspondingly, the run signal that the run signal of SAOP1 and SAOP3 is 2, SAOP4 is 4.Since these LCU are not total The SAOP of the LCU of top is enjoyed, therefore the value of the merge-above grammers of SAOP1, SAOP3 and SAOP4 is 0.
In order to reduce the bit rate of run signal, the run signal of the LCU of top may be used as the run signal of current LCU Predictor.Directly run signal is not encoded, instead the difference between two run signal is compiled Code, wherein difference is expressed as d_run in fig.15.When the LCU of top is not first LCU with runtime value in LCU groups When, operation predicted value (run prediction value) can be that the runtime value of LCU groups above subtracts LCU above The number of the LCU in identical LCU groups before.The runtime value of first LCU of shared SAOP3 is 2, above first LCU The runtime value of LCU of shared SAOP1 be also 2, then the value of the d_run of the LCU of shared SAOP3 is 0.The of shared SAOP4 The runtime value of one LCU is 4, and the runtime value of the LCU of the shared SAOP3 above first LCU is 2.Correspondingly, SAOP4 is shared LCU d_run value be 2.If the predictor of operation is disabled, can be by using no symbol variable-length code (VLC) (unsigned variable length code, U_VLC) come to operation encode.If predictor exists, can pass through Come to operation difference (delta run) using symbol variable-length code (VLC) (signed variable length code, S_VLC), I.e. d_run is encoded.U_VLC and S_VLC can be k ranks Exp- Golomb (exp-Golomb coding), Binary conversion treatment (binarization proces) in Golomb-Rice codings or CABAC codings.
In an embodiment according to the present invention, can with label come indicate all SAOP in current LCU rows be all with The LCU of lastrow is identical.For example, the RepeatedRow for each LCU rows is marked, the institute being used to refer in current LCU rows There is SAOP all identical as the LCU rows of top.If RepeatedRow labels are equal to 1, there is no need to encode more information.When The relevant SAOP of each LCU in preceding LCU rows are that LCU is replicated from the LCU rows of top.If RepeatedRow Label is equal to 0, and the SAOP of current LCU rows then needs to encode.
In another embodiment in accordance with the invention, RepeatedRow can be illustrated to mark whether can be used with label.Example Such as, EnableRepeatedRow labels can be used to refer to RepeatedRow and mark whether can be used.EnableRepeatedRow Label can be indicated in piece or image level.It is marked not if EnableRepeatedRow is equal to 0, RepeatedRow Every LCU rows can be encoded.It is marked to every LCU if EnableRepeatedRow is equal to 1, RepeatedRow Row is all encoded.
In another embodiment in accordance with the invention, the RepeatedRow labels in the first LCU rows of image or piece can be with It is saved (save).In the case where image only has a piece of, the RepeatedRow labels in the first LCU rows can be saved.One In the case that a image has multiple, if SAO processing is piece independent operation (slice-independent operation), The RepeatedRow labels in the first LCU rows can so be saved；Conversely, then RepeatedRow labels need to be encoded.One The method that the RepeatedRow labels in the first LCU rows are saved in a image or a piece can also be applied to use The case where EnableRepeatedRow is marked.
In order to reduce transmission and the relevant data of SAOP, an embodiment according to the present invention uses run signal to indicate All SAOP in the LCU rows of lower section are identical as in the LCU rows of top.For example, N number of continuous LCU rows include identical SAOP, in the first LCU rows in N number of LCU rows continuously repeatedly, SAOP and run signal are transmitted equal to N-1.One In a image or piece, the minimum and maximum operation of the LCU rows repeated can be obtained and be transmitted in piece or image level.It is based on Maximum value and minimum value, operation number can be encoded with regular length code word (fixed-length code word).It is fixed The length of length codewords can determine according to maximum runtime value and minimum runtime value, therefore can be adaptive in piece or image level Change with answering.
In another embodiment in accordance with the invention, the operation number in the first LCU rows of image or piece is encoded.It is using In the operation of above-mentioned refer to the image of entropy coding or the first LCU rows in a piece and the method for operation difference, if SAOP is repeated in continuous LCU, operation is encoded to indicate the quantity of the LCU of shared SAOP.If the predictor of operation can not With, can by using no symbol variable-length code (VLC) U_VLC or regular length code word come encode operation.If using regular length Code word, word length can be based on figure based on picture traverse, the operation of coding or remaining LCU come adaptive coding or word length Image width degree and it is fixed or transmitted to decoder.For example, include N number of LCU image in a LCU row, by SAO processing LCU is k-th of LCU in the LCU rows, wherein k=0 ..., N-1.If operation needs to be encoded, the maximum number run For N-1-k.It is floor (log2 (N-1-k)+1) by the word length for the operation being encoded.In another example, in a piece of or image In operation maximum number and minimum number can be first calculated out.Based on maximum value and minimum value, the word of regular length code word Length can be acquired and encode.
In another embodiment in accordance with the invention, the information of operation number and operation difference number may be embodied in piece level In.The quantity (NumSaoRun) for running number, operation difference number or LCU, can be transmitted in piece level.Present encoding SAOP The quantity of LCU can be illustrated with NumSaoRun labels.In addition, the quantity of operation number, operation difference number or LCU can be with The quantity of LCU in a coded image is predicted.Predictive equation formula is as follows：
NumSaoRun=sao_num_run_info+NumTBsInPicture
Wherein, NumTBsInPicture is the quantity of LCU in one image, and sao_num_run_info is prediction Residual values.Grammer sao_num_run_info available symbols variable-length code (VLC) is encoded without symbol variable-length code (VLC).Language Method sao_num_run_info also available symbols regular length code word or is encoded without symbol regular length code word.
The embodiment of loop filtering according to the present invention as set forth above, it is possible to using multiple hardwares, software code, or both It combines to realize.For example, one embodiment of the invention can be that circuit is integrated into video compress chip or procedure code is integrated To video compression system, to carry out respective handling.One embodiment of the invention is alternatively in digital signal processor (Digital Signal Processor, DSP) on execute to carry out respective treated procedure code.The present invention also may include a series of functions, and By computer processor, digital signal processor, microprocessor, field programmable gate array (Field Programmable Gate Array, FPGA) it executes.The machine-readable software code or firmware code of the embodiment of the present invention are defined by execution, above-mentioned processor can Particular task is executed according to the present invention.Software code or firmware code can carry out in distinct program language and different-format or mode. Different target platforms can be compiled into software code.But, different coded formats, mode and software code language, and with this hair The bright related other methods for making code execute task meet the spirit of the present invention, fall into protection scope of the present invention.
Although the present invention is disclosed above with regard to preferred embodiment, so it is not intended to limiting the invention.Skill belonging to the present invention Those skilled in the art in art field, without departing from the spirit and scope of the present invention, when can be used for a variety of modifications and variations.Cause This, protection scope of the present invention is subject to claims depending on before define.

Claims (26)

1. a kind of method using the adaptive migration processing reconstructing video of sample, in Video Decoder, which is characterized in that institute The method of stating includes：
Reconstructed video data is obtained from video bit stream, wherein the reconstructed video data includes luminance component and multiple colorations point Amount；
If the luma samples in the video bit stream, which adaptively deviate instruction, shows the adaptive migration processing application of sample In the luminance component, single chroma sample is received from the video bit stream and adaptively deviates instruction；
Show the adaptive migration processing of the sample applied to described more if the single chroma sample adaptively deviates instruction A chromatic component determines the adaptive offset information of chroma sample；And
Show the adaptive migration processing of the sample applied to described more if the single chroma sample adaptively deviates instruction A chromatic component, according to the adaptive offset information of the chroma sample, using the adaptive migration processing of the sample to described more A chromatic component；
Wherein, if for current chroma image-region the adaptive migration processing of the sample with come from it is one or more of the other The external data of coloration image-region is related, then the adaptive migration processing of the sample for being applied to the multiple chromatic component is used Given data or the current chroma image area data replace the external data, alternatively, the sample is adaptively at offset Reason is skipped.
2. the method as described in claim 1, which is characterized in that the single chroma sample, which adaptively deviates, to be indicated using single The adaptive offset marker of chroma sample is shared for the multiple chromatic component.
3. the method as described in claim 1, which is characterized in that the coloration image region division of the reconstructing video is multiple colors Block is spent, the adaptive offset applications of chroma sample are in the multiple chrominance block；If corresponding to the multiple chromatic component The current subregion for reconstructing chrominance block and being new of one of them, the adaptive offset information of chroma sample is from the video bits Stream obtains；If the current reconstruct chrominance block is not the new subregion, the adaptive offset information of chroma sample be from Target colorimetric block obtains；And the current reconstruct chrominance block and the target colorimetric merged block, the target colorimetric block be from Corresponding to being selected in the candidate chrominance blocks of one or more of one or more adjacent chroma blocks of the current reconstruct chrominance block.
4. method as claimed in claim 3, which is characterized in that if one or more of adjacent chroma blocks comprise more than one A adjacent chroma block, the adaptive offset information of chroma sample are marked based on the merging in the video bit stream and are determined； And if one or more of adjacent chroma blocks include an adjacent chroma block, the adaptive offset information of chroma sample It is deduced.
5. method as claimed in claim 4, which is characterized in that according to quaternary tree zone attribute and one or more of candidates The pooling information of chrominance block, one or more of candidate's at least one of chrominance blocks from the current reconstruct chrominance block It is eliminated in merging.
6. the method as described in claim 1, which is characterized in that the image-region of the reconstructing video is divided into multiple pieces；Institute The adaptive offset applications of luma samples are stated in multiple luminance blocks, the adaptive offset applications of chroma sample are in multiple chrominance blocks； And the partition information of the multiple chromatic component is obtained from the partition information of the luminance component.
7. method as claimed in claim 6, which is characterized in that it is adaptive that the multiple chromatic component shares the chroma sample Offset information.
8. method as claimed in claim 6, which is characterized in that the image-region of the reconstructing video using quaternary tree subregion into Row divides；And the grammer based on quaternary tree of the multiple chromatic component is the language based on quaternary tree from the luminance component Method obtains.
9. the method as described in claim 1, which is characterized in that the image-region of the reconstructing video is divided into multiple pieces；Institute The adaptive offset applications of luma samples are stated in multiple luminance blocks using the adaptive offset information of luma samples, the chroma sample Adaptive offset applications are in multiple chrominance blocks using the adaptive offset information of chroma sample；And it is relevant with each luminance block The adaptive offset information of luma samples is the rope using the first set for being directed toward the adaptive offset information of luma samples It introduces row coding, or with the relevant adaptive offset information of chroma sample of each chrominance block is using being directed toward the coloration What the index of the second set of the adaptive offset information of sample was encoded.
10. method as claimed in claim 9, which is characterized in that when the adaptive offset information of new luma samples is transmitted, It is updated, or works as corresponding to the first set size of the quantity of the adaptive offset information of luma samples in the first set When the adaptive offset information of new chroma sample is transmitted, letter is adaptively deviated corresponding to the chroma sample in the second set The second set size of the quantity of breath is updated.
11. method as claimed in claim 10, which is characterized in that represent the first bit length quilt of the first set size It dynamically adjusts to adapt to the first set size, or represents the second bit length of the second set size by dynamically It is adapted to the second set size.
12. the method as described in claim 1, which is characterized in that control label is used to refer to the sample and adaptively deviates Whether processing replaces external data, or if is used for the adaptive migration processing of the sample of the current chroma image-region It is related to the external data, if to skip the adaptive migration processing of the sample.
13. method as claimed in claim 12, which is characterized in that the control is labeled as sequence level label or image level Label.
14. method as claimed in claim 12, which is characterized in that adaptively offset is total by multiple samples for the control label It enjoys.
15. the method as described in claim 1, which is characterized in that the image-region of the reconstructing video is divided into multiple pieces；Institute The adaptive offset applications of luma samples are stated in multiple luminance blocks using the adaptive offset information of luma samples, the chroma sample Adaptive offset applications are in multiple chrominance blocks using the adaptive offset information of chroma sample.
16. method as claimed in claim 15, which is characterized in that the adaptive offset information of the luma samples of current block is It is predicted according to the adaptive offset information of the luma samples of one or more adjacent blocks corresponding to the current block or institute The adaptive offset information of the chroma sample for stating current block is according to the one or more adjacent blocks for corresponding to the current block The chroma sample adaptive offset information predict.
17. a kind of method using the adaptive migration processing reconstructing video of sample is used in video encoder, to provide video ratio Spy's stream, which is characterized in that the method includes：
Acquisition includes the reconstructed video data of luminance component and multiple chromatic components；
If the adaptive migration processing of sample is applied to the luminance component, the video bit stream includes brightness sample This adaptive offset instruction, the luma samples adaptively deviate instruction and show that the adaptive migration processing of the sample is applied to institute State luminance component；
If the adaptive migration processing of sample is also applied to the multiple chromatic component, also wrapped in the video bit stream It includes single chroma sample and adaptively deviates instruction and the adaptive offset information of chroma sample, the single chroma sample is adaptively inclined It moves instruction and shows that the adaptive migration processing of the sample is applied to the multiple chromatic component；
Wherein, if for current chroma image-region the adaptive migration processing of the sample with come from it is one or more of the other The external data of coloration image-region is related, then the adaptive migration processing of the sample for being applied to the multiple chromatic component is used Given data or the current chroma image area data replace the external data, alternatively, the sample is adaptively at offset Reason is skipped.
18. method as claimed in claim 17, which is characterized in that the coloration image region division of the reconstructing video is multiple Chrominance block, the adaptive offset applications of chroma sample are in the multiple chrominance block；If corresponding to the multiple chromatic component One of current reconstruct chrominance block be new subregion, the adaptive offset information of chroma sample is contained in the video In bit stream；If the current reconstruct chrominance block is not the new subregion, the adaptive offset information of chroma sample is It is obtained from target colorimetric block；And the current reconstruct chrominance block and the target colorimetric merged block, the target colorimetric block are It is selected from the candidate chrominance block of one or more of one or more adjacent chroma blocks corresponding to the current reconstruct chrominance block Out.
19. method as claimed in claim 17, which is characterized in that the image-region of the reconstructing video is divided into multiple pieces； The adaptive offset applications of luma samples are in multiple luminance blocks, and the adaptive offset applications of chroma sample are in multiple colorations Block；And the partition information of the multiple chromatic component is obtained from the partition information of the luminance component.
20. method as claimed in claim 17, which is characterized in that the image-region of the reconstructing video is divided into multiple pieces； The adaptive offset applications of luma samples are in multiple luminance blocks using the adaptive offset information of luma samples, the coloration sample This adaptive offset applications is in multiple chrominance blocks using the adaptive offset information of chroma sample；And it is related to each luminance block The adaptive offset information of the luma samples using the first set for being directed toward the adaptive offset information of luma samples rope Row coding is introduced, or adaptive using the chroma sample is directed toward with the relevant chroma sample adaptive information of each chrominance block The index of the second set of offset information is answered to be encoded.
21. method as claimed in claim 17, which is characterized in that the image-region of the reconstructing video is divided into multiple pieces； The adaptive offset applications of luma samples are in multiple luminance blocks using the adaptive offset information of luma samples, the coloration sample This adaptive offset applications is in multiple chrominance blocks using the adaptive offset information of chroma sample；And according to it is one or more its The adaptive offset information of the luma samples of the adaptive offset information prediction current block of the luma samples of its block, or according to The chroma sample of one or more of the other piece of the adaptive offset information prediction current block of the chroma sample is adaptively inclined Move information.
22. a kind of device using the adaptive migration processing reconstructing video of sample, in Video Decoder, which is characterized in that Described device includes：
For from video bit stream obtain reconstructed video data device, wherein the reconstructed video data include luminance component and Multiple chromatic components；
If the brightness in the video bit stream, which adaptively deviates instruction, shows that the adaptive migration processing of sample is applied to institute Luminance component is stated, the device for adaptively deviating instruction for receiving single chroma sample from the video bit stream；
Show the adaptive migration processing of the sample applied to described more if the single chroma sample adaptively deviates instruction A chromatic component, the device for determining the adaptive offset information of chroma sample；And
Show the adaptive migration processing of the sample applied to described more if the single chroma sample adaptively deviates instruction A chromatic component, for according to the adaptive offset information of the chroma sample using the adaptive migration processing of the sample to described The device of multiple chromatic components；
Wherein, if for current chroma image-region the adaptive migration processing of the sample with come from it is one or more of the other The external data of coloration image-region is related, then the adaptive migration processing of the sample for being applied to the multiple chromatic component is used Given data or the current chroma image area data replace the external data, alternatively, the sample is adaptively at offset Reason is skipped.
23. device as claimed in claim 22, which is characterized in that the coloration image region division of the reconstructing video is multiple Chrominance block, the adaptive offset applications of chroma sample are in the multiple chrominance block；If corresponding to the multiple chromatic component One of current reconstruct chrominance block be new subregion, the adaptive offset information of chroma sample is from the video ratio Spy's stream obtains；If the current reconstruct chrominance block is not the new subregion, the adaptive offset information of chroma sample is It is obtained from target colorimetric block；And the current reconstruct chrominance block and the target colorimetric merged block, the target colorimetric block are It is selected from the candidate chrominance block of one or more of one or more adjacent chroma blocks corresponding to the current reconstruct chrominance block.
24. a kind of device using the adaptive migration processing reconstructing video of sample, in video encoder, which is characterized in that Described device includes：
Device for obtaining the reconstructed video data for including luminance component and multiple chromatic components；And for providing video ratio The device of spy's stream；
If the adaptive migration processing of sample is applied to the luminance component, the video bit stream includes brightness sample This adaptive offset instruction, the luma samples adaptively deviate instruction and show that the adaptive migration processing of the sample is applied to institute State luminance component；
Further include list in the video bit stream if adaptively offset is also applied to the multiple chromatic component to the sample One chroma sample adaptively deviates instruction and the adaptive offset information of chroma sample, and adaptively offset refers to the single chroma sample Show and shows that the adaptive migration processing of the sample is applied to the multiple chromatic component；
Wherein, if for current chroma image-region the adaptive migration processing of the sample with come from it is one or more of the other The external data of coloration image-region is related, then the adaptive migration processing of the sample for being applied to the multiple chromatic component is used Given data or the current chroma image area data replace the external data, alternatively, the sample is adaptively at offset Reason is skipped.
25. a kind of method using the adaptive migration processing reconstructing video of sample, in Video Decoder, which is characterized in that The method includes：
Reconstructed video data is obtained from video bit stream, wherein the reconstructed video data includes luminance component and multiple colorations point Amount；
Whether the adaptive migration processing of judgement sample is applied to the luminance component；
Single chroma sample is received from the video bit stream adaptively deviates instruction；
Show the adaptive migration processing of the sample applied to described more if the single chroma sample adaptively deviates instruction A chromatic component determines the adaptive offset information of chroma sample；And
Show the adaptive migration processing of the sample applied to described more if the single chroma sample adaptively deviates instruction A chromatic component, according to the adaptive offset information of the chroma sample, using the adaptive migration processing of the sample to described more A chromatic component；
Wherein, if for current chroma image-region the adaptive migration processing of the sample with come from it is one or more of the other The external data of coloration image-region is related, then the adaptive migration processing of the sample for being applied to the multiple chromatic component is used Given data or the current chroma image area data replace the external data, alternatively, the sample is adaptively at offset Reason is skipped.
26. a kind of device using the adaptive migration processing reconstructing video of sample, in Video Decoder, which is characterized in that Described device includes：
For from video bit stream obtain reconstructed video data device, wherein the reconstructed video data include luminance component and Multiple chromatic components；
Whether it is applied to the device of the luminance component for the adaptive migration processing of judgement sample；
The device for adaptively deviating instruction for receiving single chroma sample from the video bit stream；
Show the adaptive migration processing of the sample applied to described more if the single chroma sample adaptively deviates instruction A chromatic component, the device for determining the adaptive offset information of chroma sample；And
Show the adaptive migration processing of the sample applied to described more if the single chroma sample adaptively deviates instruction A chromatic component, for according to the adaptive offset information of the chroma sample using the adaptive migration processing of the sample to described The device of multiple chromatic components；
Wherein, if for current chroma image-region the adaptive migration processing of the sample with come from it is one or more of the other The external data of coloration image-region is related, then the adaptive migration processing of the sample for being applied to the multiple chromatic component is used Given data or the current chroma image area data replace the external data, alternatively, the sample is adaptively at offset Reason is skipped.
CN201510473630.5A 2011-05-16 2012-02-15 Using the method and device of the adaptive migration processing reconstructing video of sample Active CN105120270B (en)

Applications Claiming Priority (11)

Application Number Priority Date Filing Date Title
US201161486504P 2011-05-16 2011-05-16
US61/486,504 2011-05-16
US13/158,427 US9055305B2 (en) 2011-01-09 2011-06-12 Apparatus and method of sample adaptive offset for video coding
US13/158,427 2011-06-12
US201161498949P 2011-06-20 2011-06-20
US61/498,949 2011-06-20
US201161503870P 2011-07-01 2011-07-01
US61/503,870 2011-07-01
US13/311,953 US20120294353A1 (en) 2011-05-16 2011-12-06 Apparatus and Method of Sample Adaptive Offset for Luma and Chroma Components
US13/311,953 2011-12-06
CN201280022870.8A CN103535035B (en) 2011-05-16 2012-02-15 For the method and apparatus that the sample self adaptation of brightness and chromatic component offsets

Related Parent Applications (1)

Application Number Title Priority Date Filing Date
CN201280022870.8A Division CN103535035B (en) 2011-05-16 2012-02-15 For the method and apparatus that the sample self adaptation of brightness and chromatic component offsets

Publications (2)

Publication Number Publication Date
CN105120270A CN105120270A (en) 2015-12-02
CN105120270B true CN105120270B (en) 2018-09-04

Family

ID=47176199

Family Applications (3)

Application Number Title Priority Date Filing Date
CN201280022870.8A Active CN103535035B (en) 2011-05-16 2012-02-15 For the method and apparatus that the sample self adaptation of brightness and chromatic component offsets
CN201510473630.5A Active CN105120270B (en) 2011-05-16 2012-02-15 Using the method and device of the adaptive migration processing reconstructing video of sample
CN201610409900.0A Active CN106028050B (en) 2011-05-16 2012-02-15 The method and apparatus that sample for brightness and chromatic component adaptively deviates

Family Applications Before (1)

Application Number Title Priority Date Filing Date
CN201280022870.8A Active CN103535035B (en) 2011-05-16 2012-02-15 For the method and apparatus that the sample self adaptation of brightness and chromatic component offsets

Family Applications After (1)

Application Number Title Priority Date Filing Date
CN201610409900.0A Active CN106028050B (en) 2011-05-16 2012-02-15 The method and apparatus that sample for brightness and chromatic component adaptively deviates

Country Status (5)

Country Link
CN (3) CN103535035B (en)
DE (1) DE112012002125T5 (en)
GB (1) GB2500347B (en)
WO (1) WO2012155553A1 (en)
ZA (1) ZA201305528B (en)

Families Citing this family (31)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
HUE060260T2 (en) 2011-06-14 2023-02-28 Lg Electronics Inc Method for encoding and decoding image information
KR102104594B1 (en) 2011-06-24 2020-04-24 엘지전자 주식회사 Image information encoding and decoding method
JPWO2013001794A1 (en) * 2011-06-27 2015-02-23 パナソニック インテレクチュアル プロパティ コーポレーション オブアメリカＰａｎａｓｏｎｉｃ Ｉｎｔｅｌｌｅｃｔｕａｌ Ｐｒｏｐｅｒｔｙ Ｃｏｒｐｏｒａｔｉｏｎ ｏｆ Ａｍｅｒｉｃａ Image coding method and image coding apparatus
JP5907367B2 (en) * 2011-06-28 2016-04-26 ソニー株式会社 Image processing apparatus and method, program, and recording medium
CN105049864A (en) 2011-06-28 2015-11-11 三星电子株式会社 Video encoding method using offset adjustments according to pixel classification and apparatus therefor
GB201119206D0 (en) 2011-11-07 2011-12-21 Canon Kk Method and device for providing compensation offsets for a set of reconstructed samples of an image
US9936200B2 (en) * 2013-04-12 2018-04-03 Qualcomm Incorporated Rice parameter update for coefficient level coding in video coding process
US10021419B2 (en) 2013-07-12 2018-07-10 Qualcomm Incorported Rice parameter initialization for coefficient level coding in video coding process
JP6094838B2 (en) * 2015-08-31 2017-03-15 ソニー株式会社 Image processing apparatus and method, program, and recording medium
CN107710760A (en) * 2015-10-15 2018-02-16 富士通株式会社 Method for encoding images, device and image processing equipment
US20180041778A1 (en) * 2016-08-02 2018-02-08 Qualcomm Incorporated Geometry transformation-based adaptive loop filtering
JP6341304B2 (en) * 2017-02-14 2018-06-13 ソニー株式会社 Image processing apparatus and method, program, and recording medium
US10623738B2 (en) 2017-04-06 2020-04-14 Futurewei Technologies, Inc. Noise suppression filter
US10531085B2 (en) * 2017-05-09 2020-01-07 Futurewei Technologies, Inc. Coding chroma samples in video compression
US20180359486A1 (en) * 2017-06-07 2018-12-13 Mediatek Inc. Non-local adaptive loop filter processing
TW202015409A (en) * 2018-06-29 2020-04-16 財團法人工業技術研究院 Video data decoding method, video data decoder, video data encoding method and video data encoder
CN113287316B (en) 2018-10-23 2023-07-21 寰发股份有限公司 Method and apparatus for reducing loop filter buffer
WO2020094154A1 (en) * 2018-11-09 2020-05-14 Beijing Bytedance Network Technology Co., Ltd. Improvements for region based adaptive loop filter
CN113711604B (en) 2019-04-20 2023-10-27 北京字节跳动网络技术有限公司 Signaling of chroma and luma syntax elements in video coding
WO2020239119A1 (en) * 2019-05-30 2020-12-03 Beijing Bytedance Network Technology Co., Ltd. Adaptive loop filtering for chroma components
WO2020259538A1 (en) * 2019-06-27 2020-12-30 Mediatek Inc. Method and apparatus of cross-component adaptive loop filtering for video coding
CN117221540A (en) 2019-07-08 2023-12-12 Lg电子株式会社 Image encoding/decoding method, data transmission method, and computer-readable storage medium
EP4005213A4 (en) * 2019-07-26 2023-05-31 HFI Innovation Inc. Method and apparatus of cross-component adaptive loop filtering for video coding
WO2021025597A1 (en) * 2019-08-07 2021-02-11 Huawei Technologies Co., Ltd. Method and apparatus of sample adaptive offset in-loop filter with application region size constraint
WO2021040482A1 (en) * 2019-08-29 2021-03-04 엘지전자 주식회사 Adaptive loop filtering-based image coding device and method
US20220345698A1 (en) * 2019-09-11 2022-10-27 Sharp Kabushiki Kaisha Systems and methods for reducing a reconstruction error in video coding based on a cross-component correlation
KR20210063258A (en) * 2019-11-22 2021-06-01 한국전자통신연구원 Method and apparatus for adaptive in-loop filtering
US11303914B2 (en) 2020-01-08 2022-04-12 Tencent America LLC Method and apparatus for video coding
CN116366859A (en) 2020-07-28 2023-06-30 北京达佳互联信息技术有限公司 Method, apparatus and medium for decoding video signal
US11849117B2 (en) * 2021-03-14 2023-12-19 Alibaba (China) Co., Ltd. Methods, apparatus, and non-transitory computer readable medium for cross-component sample adaptive offset
CN116433783A (en) * 2021-12-31 2023-07-14 中兴通讯股份有限公司 Method and device for video processing, storage medium and electronic device

Family Cites Families (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8149926B2 (en) * 2005-04-11 2012-04-03 Intel Corporation Generating edge masks for a deblocking filter
CN101371571B (en) * 2006-01-12 2013-06-19 Lg电子株式会社 Processing multiview video
US9001899B2 (en) * 2006-09-15 2015-04-07 Freescale Semiconductor, Inc. Video information processing system with selective chroma deblock filtering
EP1944974A1 (en) * 2007-01-09 2008-07-16 Matsushita Electric Industrial Co., Ltd. Position dependent post-filter hints
CN101578877B (en) * 2007-01-11 2016-05-04 汤姆森许可贸易公司 To in CAVLC4:4:4 frame in the high-rise coding of MPEG-4AVC, in high 4:4:4 frame and high 4:4:4 prediction profile use the method and apparatus for the grammer of CODED_BLOCK_FLAG syntactic element and CODED_BLOCK_PATTERN syntactic element
US8938009B2 (en) * 2007-10-12 2015-01-20 Qualcomm Incorporated Layered encoded bitstream structure
US20120033040A1 (en) * 2009-04-20 2012-02-09 Dolby Laboratories Licensing Corporation Filter Selection for Video Pre-Processing in Video Applications
JP5763210B2 (en) * 2011-04-21 2015-08-12 メディアテック インコーポレイテッド Method and apparatus for improved loop-type filtering process
US9008170B2 (en) * 2011-05-10 2015-04-14 Qualcomm Incorporated Offset type and coefficients signaling method for sample adaptive offset
US9497455B2 (en) * 2011-06-23 2016-11-15 Huawei Technologies Co., Ltd. Offset decoding device, offset coding device, image filtering device, and data structure

Also Published As

Publication number Publication date
CN103535035B (en) 2017-03-15
CN103535035A (en) 2014-01-22
GB201311592D0 (en) 2013-08-14
WO2012155553A1 (en) 2012-11-22
CN105120270A (en) 2015-12-02
DE112012002125T5 (en) 2014-02-20
CN106028050A (en) 2016-10-12
CN106028050B (en) 2019-04-26
GB2500347B (en) 2018-05-16
ZA201305528B (en) 2014-10-29
GB2500347A (en) 2013-09-18

Similar Documents

Publication Publication Date Title
CN105120270B (en) Using the method and device of the adaptive migration processing reconstructing video of sample
CN105120271B (en) Video coding-decoding method and device
US10116967B2 (en) Method and apparatus for coding of sample adaptive offset information
US10405004B2 (en) Apparatus and method of sample adaptive offset for luma and chroma components
CN106797466B (en) A kind of method and device handling video data
AU2013248857B2 (en) Method and apparatus for loop filtering across slice or tile boundaries
CN103733627B (en) Method for coding and decoding image information
KR101919394B1 (en) Parameter determination for exp-golomb residuals binarization for lossless intra hevc coding
CN103503456A (en) Method and apparatus for reduction of in-loop filter buffer
CN105230020A (en) For the method for the sampling self adaptation migration processing of Video coding
CN107172424A (en) Loop circuit filtering method and its equipment
CN110063057A (en) The method and apparatus of the adaptive migration processing of sampling for coding and decoding video
KR20220046686A (en) Method and apparatus for constrained cross-component adaptive loop filtering for video coding

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C41 Transfer of patent application or patent right or utility model
TA01 Transfer of patent application right

Effective date of registration: 20160920

Address after: Hsinchu County, Taiwan, China

Applicant after: Atlas Limited by Share Ltd

Address before: Hsinchu Science Park Hsinchu city Dusing a road No.

Applicant before: MediaTek.Inc

GR01 Patent grant
GR01 Patent grant