WO2020192109A1 - 图像分量预测方法、编码器、解码器以及存储介质 - Google Patents

图像分量预测方法、编码器、解码器以及存储介质 Download PDF

Info

Publication number
WO2020192109A1
WO2020192109A1 PCT/CN2019/113765 CN2019113765W WO2020192109A1 WO 2020192109 A1 WO2020192109 A1 WO 2020192109A1 CN 2019113765 W CN2019113765 W CN 2019113765W WO 2020192109 A1 WO2020192109 A1 WO 2020192109A1
Authority
WO
WIPO (PCT)
Prior art keywords
current block
candidate
pixels
reference pixel
pixel
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/CN2019/113765
Other languages
English (en)
French (fr)
Chinese (zh)
Inventor
马彦卓
霍俊彦
万帅
张伟
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Guangdong Oppo Mobile Telecommunications Corp Ltd
Original Assignee
Guangdong Oppo Mobile Telecommunications Corp Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority to CN202510882383.8A priority Critical patent/CN120568060A/zh
Priority to CN202111193882.4A priority patent/CN113992916B/zh
Priority to KR1020217034571A priority patent/KR20210138760A/ko
Priority to CN202511720177.3A priority patent/CN121334365A/zh
Priority to EP19921790.2A priority patent/EP3930324A4/en
Priority to CN201980093368.8A priority patent/CN113508584A/zh
Priority to CN202510882359.4A priority patent/CN120455666A/zh
Priority to JP2021556936A priority patent/JP2022528331A/ja
Priority to CN202510882414.XA priority patent/CN120455667A/zh
Application filed by Guangdong Oppo Mobile Telecommunications Corp Ltd filed Critical Guangdong Oppo Mobile Telecommunications Corp Ltd
Publication of WO2020192109A1 publication Critical patent/WO2020192109A1/zh
Priority to US17/480,865 priority patent/US12137204B2/en
Anticipated expiration legal-status Critical
Priority to JP2024112963A priority patent/JP7836362B2/ja
Priority to US18/781,956 priority patent/US12526402B2/en
Priority to US19/369,579 priority patent/US20260052237A1/en
Priority to US19/369,605 priority patent/US20260052238A1/en
Priority to US19/369,667 priority patent/US20260052240A1/en
Priority to US19/369,642 priority patent/US20260052239A1/en
Ceased legal-status Critical Current

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/103—Selection of coding mode or of prediction mode
    • H04N19/105—Selection of the reference unit for prediction within a chosen coding or prediction mode, e.g. adaptive choice of position and number of pixels used for prediction
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/117—Filters, e.g. for pre-processing or post-processing
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/132—Sampling, masking or truncation of coding units, e.g. adaptive resampling, frame skipping, frame interpolation or high-frequency transform coefficient masking
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
    • H04N19/136—Incoming video signal characteristics or properties
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
    • H04N19/146—Data rate or code amount at the encoder output
    • H04N19/149—Data rate or code amount at the encoder output by estimating the code amount by means of a model, e.g. mathematical model or statistical model
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
    • H04N19/157—Assigned coding mode, i.e. the coding mode being predefined or preselected to be further used for selection of another element or parameter
    • H04N19/159—Prediction type, e.g. intra-frame, inter-frame or bidirectional frame prediction
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
    • H04N19/167—Position within a video image, e.g. region of interest [ROI]
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
    • H04N19/17—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object
    • H04N19/176—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a block, e.g. a macroblock
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
    • H04N19/186—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being a colour or a chrominance component
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/42—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by implementation details or hardware specially adapted for video compression or decompression, e.g. dedicated software implementation
    • H04N19/423—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by implementation details or hardware specially adapted for video compression or decompression, e.g. dedicated software implementation characterised by memory arrangements
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/44—Decoders specially adapted therefor, e.g. video decoders which are asymmetric with respect to the encoder

Definitions

  • the embodiments of the present application relate to the field of image processing technologies, and in particular, to an image component prediction method, an encoder, a decoder, and a storage medium.
  • the prediction model construction it is necessary to use the prediction model construction, and then the predicted value of the video image in the video codec is derived from the constructed prediction model.
  • the number of sample points currently used for model parameter derivation is relatively large, the computational complexity and memory bandwidth are high; at the same time, there may be abnormal sample points in these sample points, resulting in inaccurate prediction model construction .
  • the embodiments of the application provide an image component prediction method, encoder, decoder, and storage medium.
  • By reducing the number of pixels in the reference pixel set not only the computational complexity and memory bandwidth are reduced, but the accuracy of the prediction model is improved. Therefore, the prediction accuracy of the image components to be predicted is improved, and the prediction efficiency of the video image is improved.
  • an image component prediction method which includes:
  • the reference pixel subset is used to calculate the model parameters of the prediction model; wherein, the prediction model is used to perform cross-component prediction processing on the image component to be predicted of the current block.
  • an encoder which includes a first determining unit and a first calculating unit, wherein:
  • a first determining unit configured to determine a first reference pixel set of the image component to be predicted of the current block
  • the first determining unit is further configured to determine a reference pixel subset from the first reference pixel set; wherein the reference pixel subset includes one or more candidate pixels selected from the first reference pixel set;
  • the first calculation unit is configured to use the reference pixel subset to calculate model parameters of the prediction model; wherein the prediction model is used to perform cross-component prediction processing on the image component to be predicted of the current block.
  • an embodiment of the present application provides an encoder.
  • the encoder includes a first memory and a first processor, where:
  • the first memory is used to store a computer program that can run on the first processor
  • the first processor is configured to execute the method described in the first aspect when running the computer program.
  • an embodiment of the present application provides a decoder, which includes a second determining unit and a second calculating unit, where:
  • a second determining unit configured to determine the first reference pixel set of the image component to be predicted of the current block
  • the second determining unit is further configured to determine a reference pixel subset from the first reference pixel set; wherein the reference pixel subset includes one or more candidate pixels selected from the first reference pixel set;
  • the second calculation unit is configured to use the reference pixel subset to calculate model parameters of the prediction model; wherein the prediction model is used to perform cross-component prediction processing on the image component to be predicted of the current block.
  • an embodiment of the present application provides a decoder, which includes a second memory and a second processor, wherein:
  • the second memory is used to store a computer program that can run on the second processor
  • the second processor is configured to execute the method described in the first aspect when running the computer program.
  • an embodiment of the present application provides a computer storage medium that stores an image component prediction program, and when the image component prediction program is executed by the first processor or the second processor, the implementation is as described in the first aspect. Methods.
  • the embodiments of the present application provide an image component prediction method, an encoder, a decoder, and a storage medium to determine a first reference pixel set of an image component to be predicted of a current block; from the first reference pixel set, determine a reference pixel subset Wherein, the reference pixel subset includes one or more candidate pixels selected from the first reference pixel set; the reference pixel subset is used to calculate the model parameters of the prediction model; wherein, the prediction model is used for the current block to be
  • the predicted image components are subjected to cross-component prediction processing; in this way, because the first reference pixel set is filtered, unimportant reference pixels or abnormal reference pixels can be removed, thereby reducing the number of pixels in the first reference pixel set.
  • the accuracy of the prediction model can be improved; because the prediction model is used to realize the prediction processing of the image components to be predicted through the model parameters, thereby improving The prediction accuracy of the image component to be predicted improves the prediction efficiency of the video image.
  • FIG. 1 is a schematic flowchart of an image component prediction method provided by an embodiment of this application
  • 2A is a schematic structural diagram of a reference pixel position provided by an embodiment of the application.
  • 2B is a schematic structural diagram of another reference pixel position provided by an embodiment of the application.
  • FIG. 3 is a schematic structural diagram for selecting a subset of adjacent reference pixels on the side of the current block provided by an embodiment of the application;
  • FIG. 4 is a schematic diagram of another structure for selecting a subset of adjacent reference pixels on the upper side of the current block provided by an embodiment of the application;
  • FIG. 5 is a schematic diagram of a comparison structure of a prediction model provided by an embodiment of the application.
  • FIG. 6 is a schematic flowchart of another image component prediction method provided by an embodiment of the application.
  • FIG. 7 is a schematic diagram of the composition structure of an encoder provided by an embodiment of the application.
  • FIG. 8 is a schematic diagram of a specific hardware structure of an encoder provided by an embodiment of the application.
  • FIG. 9 is a schematic diagram of the composition structure of a decoder provided by an embodiment of the application.
  • FIG. 10 is a schematic diagram of a specific hardware structure of a decoder provided by an embodiment of the application.
  • the first image component, the second image component, and the third image component are generally used to characterize the coding block (CB); among them, the three image components are a luminance component and a blue chrominance component. And a red chrominance component, specifically, the luminance component is usually represented by the symbol Y, the blue chrominance component is usually represented by the symbol Cb or U, and the red chrominance component is usually represented by the symbol Cr or V; in this way, the video image can be in YCbCr format It can also be expressed in YUV format.
  • the first image component may be a luminance component
  • the second image component may be a blue chrominance component
  • the third image component may be a red chrominance component
  • the cross-component prediction technology mainly includes cross-component Linear Model Prediction (CCLM) mode and Multi-Directional Linear Model Prediction (MDLM) mode.
  • CCLM mode and MDLM The prediction model constructed by the mode can realize the first image component to the second image component, the second image component to the first image component, the first image component to the third image component, the third image component to the first image component, and the Prediction between image components such as the second image component to the third image component, or the third image component to the second image component.
  • the prediction technology within the image component it mainly includes the chrominance component compensation technology and the luminance component compensation technology, such as IC technology and LIC technology.
  • the prediction model constructed by the prediction technology within the image component can realize the first image component to the second Prediction techniques within image components such as prediction of an image component, prediction of a second image component to a second image component, or prediction of a third image component to a third image component.
  • the following description will mainly take the prediction model constructed by the prediction technology within the image component as an example.
  • the embodiment of the present application provides an image component prediction method, by determining the first reference pixel set of the image component to be predicted of the current block; determining the reference pixel subset from the first reference pixel set; wherein, the reference pixel The subset includes one or more candidate pixels selected from the first reference pixel set; the reference pixel subset is used to calculate the model parameters of the prediction model; wherein the prediction model is used to span the image components to be predicted in the current block.
  • Component prediction processing in this way, due to the screening process of the first reference pixel set, unimportant reference pixels or abnormal reference pixels can be removed, thereby reducing the number of pixels in the first reference pixel set, not only Computational complexity and memory bandwidth can also improve the accuracy of the prediction model, thereby improving the prediction accuracy of the image components to be predicted, and improving the prediction efficiency of the video image.
  • the image component prediction method of the embodiment of the present application can be applied to both a video encoding system and a video decoding system, and can even be applied to both a video encoding system and a video decoding system.
  • the “current block” specifically refers to the current coding block in intra prediction
  • the “current block” specifically refers to the frame The current decoded block in intra prediction.
  • FIG. 1 shows a schematic flowchart of an image component prediction method provided by an embodiment of the present application.
  • the method may include:
  • S101 Determine the first reference pixel set of the image component to be predicted of the current block
  • S102 Determine a reference pixel subset from the first reference pixel set; wherein the reference pixel subset includes one or more candidate pixels selected from the first reference pixel set;
  • S103 Calculate model parameters of a prediction model by using the reference pixel subset; wherein, the prediction model is used to perform cross-component prediction processing on the image components to be predicted of the current block.
  • each current block may include a first image component, a second image component, and a third image component; and the current block is the current prediction of the first image component, the second image component, or the third image component in the video image.
  • the first image component needs to be predicted by the prediction model
  • the image component to be predicted is the first image component
  • the second image component needs to be predicted by the prediction model
  • the image component to be predicted is the second image component
  • the third image component needs to be predicted by the prediction model
  • the image component to be predicted is the third image component.
  • the first reference pixel set is the reference pixel set corresponding to the prediction model constructed in the current related technical solution.
  • the first reference pixel set there may be some unimportant reference pixels (for example, these reference pixels have poor correlation) or some abnormal reference pixels.
  • these The reference pixel points are eliminated, thereby obtaining a reference pixel subset; according to the reference pixel subset, the accuracy of the prediction model can be ensured, so that the prediction efficiency of the image component to be predicted is high.
  • the first reference pixel set of the image component to be predicted of the current block is first determined; then, the reference pixel subset is determined from the first reference pixel set; wherein, the reference pixel subset includes the first reference pixel set.
  • One or more candidate pixels selected in the reference pixel set then use the reference pixel subset to calculate the model parameters of the prediction model; where the prediction model is used to perform cross-component prediction processing on the image components to be predicted in the current block; Filtering the first reference pixel set can remove unimportant reference pixels or reference pixels that are abnormal, thereby reducing the number of pixels in the first reference pixel set, not only reducing computational complexity and memory bandwidth, Moreover, the accuracy of the prediction model can be improved, thereby improving the prediction accuracy of the image components to be predicted, and improving the prediction efficiency of the video image.
  • the determination of the first reference pixel set may be obtained based on the adjacent reference pixels around the current block, or may be obtained by reconstructing the adjacent reference pixels inside the block.
  • the embodiment of the present application does not specifically limit it. Describe them separately.
  • the determining the first reference pixel set of the image component to be predicted of the current block may include:
  • At least one side of the current block includes at least one of the following: upper side, left side, upper right Side and lower left side;
  • the first reference pixel set is obtained.
  • FIG. 2A shows a schematic structural diagram of a reference pixel position provided by an embodiment of the present application.
  • the reference pixels are located around the current block, that is, the reference pixels adjacent to at least one side of the current block, and at least one side of the current block can refer to the left side of the current block or the current block.
  • the upper side of the block may even refer to the left side and upper side of the current block; the embodiment of the present application does not specifically limit it.
  • the determining the first reference pixel set of the image component to be predicted of the current block may include:
  • Acquiring reference pixels adjacent to at least one side of the current block wherein the at least one side includes the left side of the current block and/or the upper side of the current block;
  • the first reference pixel set is obtained.
  • At least one side of the current block may include the left side of the current block and/or the upper side of the current block; that is, at least one side of the current block may refer to the upper side of the current block, or it may refer to the upper side of the current block.
  • the left side of the current block may even refer to the upper side and the left side of the current block, which is not specifically limited in the embodiment of the present application.
  • the first reference pixel set at this time can be composed of the reference pixels adjacent to the left side of the current block and the upper side of the current block. It is composed of adjacent reference pixels.
  • the first reference pixel set can be composed of adjacent to the left side of the current block.
  • the adjacent area on the left is an invalid area and the adjacent area on the upper side is an effective area
  • the first reference pixel set can be composed of reference pixels adjacent to the upper side of the current block. Points.
  • the first reference pixel set of the image component to be predicted of the block may include:
  • the first reference pixel set is obtained.
  • the reference row adjacent to the current block may be composed of the upper side of the current block and the row adjacent to the upper right side
  • the reference column adjacent to the current block may be composed of the current block.
  • the left side of the block and the columns adjacent to the lower left side; the reference row or reference column adjacent to the current block can refer to the reference row adjacent to the upper side of the current block, or it can refer to the current block
  • the reference column adjacent to the left side may even refer to the reference row or reference column adjacent to the other side of the current block, which is not specifically limited in the embodiment of the present application.
  • the reference row adjacent to the current block will be described as an example of the reference behavior with adjacent sides above, and the reference column adjacent to the current block will be taken as an example of the reference column adjacent to the left side. description.
  • the reference pixels in the reference row adjacent to the current block may include reference pixels adjacent to the upper side and the upper right side (also referred to as adjacent reference pixels corresponding to the upper side and the upper right side) Dot), where the upper side represents the upper side of the current block, and the upper right side represents the side length of the current block’s upper side horizontally extending to the right and the same height as the current block; in the reference column adjacent to the current block
  • the reference pixels may also include reference pixels adjacent to the left side and the lower left side (also referred to as the adjacent reference pixels corresponding to the left side and the lower left side), where the left side represents the current block
  • the left side and the lower left side represent the side length that is the same width as the current decoded block, which is vertically extended downward from the left side of the current block; however, the embodiment of the present application does not specifically limit it.
  • the first reference pixel set at this time can be composed of reference pixels in the reference column adjacent to the current block; when the upper side is adjacent When the area and the upper-right adjacent area are valid areas, the first reference pixel set at this time may be composed of reference pixels in a reference row adjacent to the current block.
  • the determining the first reference pixel set of the image component to be predicted of the current block may include:
  • the reconstruction block obtain reference pixels adjacent to at least one side of the reconstruction block; wherein, the reconstruction block is an image block that is adjacent to the current block and has been coded and reconstructed. At least one side includes: lower side, right side, or lower side and right side;
  • the first reference pixel set is obtained.
  • FIG. 2B shows a schematic structural diagram of a reference pixel position provided in an embodiment of the present application.
  • the reference pixel is located inside the reconstruction block, that is, the reference pixel adjacent to at least one side of the reconstruction block, and at least one side of the reconstruction block can refer to the right side of the reconstruction block, or it can refer to the reconstruction block.
  • the lower side of the block may even refer to the right side and the lower side of the reconstructed block, which is not specifically limited in the embodiment of the present application.
  • the reference pixels can be called "pixels used to build the prediction model".
  • the current block is already in the coding and reconstruction stage. At this time, a prediction model is constructed.
  • the prediction model can be It is convenient for other coding blocks in subsequent images to use.
  • the adjacent reference pixels in the reconstruction block can be used to obtain the first reference pixel set, which is convenient for subsequent construction of the prediction model of the current block; on the other hand, the prediction model corresponding to the reconstruction block can also be directly borrowed , Regard it as the prediction model of the current block; that is to say, for the current block being coded, the use of the relevant information of the reconstructed block in the adjacent area can be directly used by the corresponding prediction model, without the need to use the reconstructed block
  • the adjacent reference pixels are used to construct the prediction model.
  • the first reference pixel set After the first reference pixel set is obtained, there may be some unimportant reference pixels (for example, these reference pixels have poor correlation) or some abnormal reference pixels in the first reference pixel set. To ensure the accuracy of model parameter derivation, these reference pixels need to be eliminated to obtain a reference pixel subset; in this way, based on the reference pixel subset, the accuracy of the prediction model can be guaranteed, and the prediction efficiency of the image components to be processed is high .
  • the determining a reference pixel subset according to the first reference pixel set may include:
  • a reference pixel corresponding to the candidate position is selected from the first reference pixel set, and the selected parameter pixels are formed into the reference pixel subset.
  • the determining the candidate position of the candidate pixel based on at least one side of the current block or the reconstructed block may include:
  • the candidate position is determined based on the pixel position corresponding to the reference pixel adjacent to the at least one side.
  • the determining the candidate position of the candidate pixel based on at least one side of the current block or the reconstructed block may include:
  • the candidate position is determined based on the image component intensity value corresponding to the reference pixel adjacent to the at least one side.
  • the determining the candidate position of the candidate pixel based on at least one side of the current block or the reconstructed block may include:
  • the candidate position is determined based on the pixel position and the image component intensity value corresponding to the reference pixel adjacent to the at least one side.
  • the image component intensity can be represented by image component values, such as brightness value, chroma value, etc.; here, the larger the image component value, the higher the image component intensity.
  • the reference pixels selected in the embodiments of the present application may be selected by the candidate positions of the candidate pixels; wherein, the candidate positions may be determined according to the pixel position, or may be determined according to the intensity value of the image component (such as luminance value, chrominance value) Etc.) It is determined that the embodiments of this application do not make specific limitations.
  • the reference pixel subset is formed by filtering the first reference pixel set and then selecting some reference pixels; while the model parameters are calculated based on the reference pixel subset; in this way, due to the reference
  • the reduction of the number of samples in the pixel subset also reduces the number of samples required to calculate the model parameters, thereby achieving the goal of reducing computational complexity and memory bandwidth (or called memory bandwidth).
  • the reference pixels selected in the embodiment of the present application can be selected by referring to the pixel position corresponding to the pixel, or can be selected based on the intensity value of the image component corresponding to the reference pixel (such as luminance value, chrominance value, etc.)
  • the embodiments of this application do not make specific limitations.
  • the first reference pixel set is screened either by the pixel position corresponding to the reference pixel or the image component intensity value corresponding to the reference pixel to select the appropriate reference pixel, and then form the reference pixel subset; in this way, according to the reference
  • the model parameters derived from the pixel subset are more accurate, so that the prediction model constructed based on the model parameters can also be more accurate.
  • the determining the candidate position of the candidate pixel based on at least one edge of the current block or the reconstructed block may include:
  • the candidate position is determined according to the preset number of candidate pixels and the length of the at least one side; wherein the length of the at least one side is equal to the number of pixels included in the at least one side.
  • the corresponding prediction model can be used directly, without the need to construct the prediction model through the adjacent reference pixels of the reconstructed block; therefore, the embodiments of this application will mainly use At least one edge of the current block is taken as an example to describe how to determine the candidate position of the candidate pixel.
  • the preset number of candidate pixels represents a preset number of pixels to be sampled, that is, the number of pixels included in the reference pixel subset.
  • the candidate position of the candidate pixel can be calculated according to the side length of at least one side and the preset number of candidate pixels; then according to the candidate position, the first reference pixel set Select appropriate reference pixels to form a subset of reference pixels.
  • the model parameters calculated based on the reference pixel subset are more accurate, and the constructed prediction model can also be more accurate, thereby improving the prediction accuracy of the image components to be predicted and improving the prediction efficiency of the video image.
  • the first sampling interval may be calculated first, and then the at least one edge is sampled according to the first sampling interval to determine the candidate pixel position of the candidate pixel corresponding to the at least one edge. Therefore, in some embodiments, the determining the candidate position of the candidate pixel based on at least one edge of the current block or the reconstructed block may include:
  • a reference point is determined from the at least one edge, and the candidate position is determined according to the first sampling interval.
  • the reference point may be the midpoint of the at least one side, or the first reference pixel position to the left of the midpoint of the at least one side, or the midpoint of the at least one side.
  • the position of the first reference pixel point to the right of the point may even be the position of other reference pixel points on the at least one side, which is not specifically limited in the embodiment of the present application.
  • the midpoint of the at least one side may be determined according to the length of the at least one side, and then the midpoint of the at least one side is used as the reference point.
  • the reference point may be the midpoint of the at least one side, or the first reference pixel position where the midpoint of the at least one side is leftward, or the midpoint of the at least one side rightward
  • the first reference pixel position of may even be another reference pixel position of the at least one side, which is not specifically limited in the embodiment of the present application.
  • the first reference pixel position of the middle position to the right or left can be used as the reference point of the side; if the current block’s The left side is taken as an example for description, then the position of the first reference pixel point lower or upper than the middle position can be used as the reference point of the side.
  • the preset number of reference pixels for the edge, or the initial offset for the edge from the starting position according to the preset offset, and the offset reference pixel position as the starting point to obtain a new edge, and then The middle position corresponding to the new edge is used as the reference point.
  • the middle position of the left side or the upper side of the current block is between two points.
  • the first pixel to the left of the middle position is used as the midpoint of the side; however, in the embodiment of the present application, the first pixel to the right of the middle position may also be used as the midpoint of the side.
  • Figure 4 the first pixel to the left of the middle position (3 in Figure 3) is taken as the midpoint of the side. Since the preset number of samples is 2, then the reference pixel to be selected can be determined
  • the positions (for example, the gray points in Fig. 3) are 1 and 5.
  • the corresponding reference pixels can also be selected to form a reference pixel subset. Therefore, in this embodiment of the application, for the upper side of the current block, either the first pixel to the right of the middle position can be used as the midpoint of the side, or the first pixel to the left of the middle position As the midpoint of the side, the embodiment of the present application does not specifically limit it; in addition, for the left side of the current block, either the first pixel point lower than the middle position can be used as the midpoint of the side, or the middle position The first pixel on the upper side is taken as the midpoint of the side, which is not specifically limited in the embodiment of the present application.
  • the following will take the upper side of the current block as an example, but the image component prediction method in the embodiment of the present application is also applicable to the left side of the current block, or even the right side of the reconstructed block or reconstruction
  • the lower side of the block is not specifically limited in the embodiment of the present application.
  • the second reference pixel set can also be constructed according to equations (1) and (2),
  • ⁇ represents the sampling interval
  • length represents the number of reference pixels in a row adjacent to the upper side of the current block, or the number of reference pixels in a column adjacent to the left side of the current block
  • N 2 represents the current
  • the number of reference pixels in the reference pixel subset expected to constitute the block generally, the left side and the upper side are each one-half, but the embodiment of this application does not specifically limit it
  • shift represents the selection of the reference pixel Starting point position.
  • N 2 is equal to 4
  • 1 is the starting point position
  • 4 is the sampling interval
  • the position of the reference pixel to be selected can be determined, such as 1 and 5, and then the corresponding reference pixel can be selected to form a reference pixel subset.
  • the values of the preset number of samples corresponding to the left side and the preset number of samples corresponding to the upper side may be the same or different, which is not specifically limited in the embodiment of the present application.
  • the first sampling interval corresponding to the side can be calculated.
  • the middle position of the left side or the upper side of the current block is between two points, and the calculation is The midpoint value of is a non-integer, and the calculated reference pixel position is also a non-integer; however, if the length of the left side or top side of the current block is not an integer multiple of 2, then the left side or top of the current block The middle position of the side will not be between two points.
  • the calculated midpoint value is an integer
  • the calculated reference pixel position is also an integer; that is, the calculated midpoint value can be an integer, It may also be a non-integer; correspondingly, the calculated reference pixel position may also be an integer or a non-integer; the embodiment of the present application does not specifically limit it.
  • the calculated reference pixel position is also an integer.
  • the calculated reference pixel position can be directly used as a candidate position; when the calculated midpoint value is When it is a non-integer, correspondingly, the calculated reference pixel position is also a non-integer.
  • the candidate position can be determined by rounding to the larger or smaller.
  • the method may further include:
  • the candidate position is determined according to the second sampling interval.
  • the first sampling interval can be fine-tuned, for example, the first sampling interval can be increased or decreased by 1 to obtain the second sampling interval.
  • the adjusted second sampling interval can be 3 or 5.
  • a small range for example, plus 1 or minus 1 may be adjusted, but the specific setting of the adjustment range is not specifically limited in the embodiment of the present application.
  • the method may further include:
  • a candidate position corresponding to one side of the reference point is determined according to the first sampling interval, and a candidate position corresponding to the other side of the reference point is determined according to the second sampling interval.
  • uniform sampling can be performed according to the first sampling interval or the second sampling interval; non-uniform sampling can also be performed according to the first sampling interval and the second sampling interval, and
  • the candidate positions determined after sampling may be symmetrically distributed on both sides of the reference point, or may be asymmetrically distributed on both sides of the reference point; the embodiment of the present application does not specifically limit it.
  • the reference pixel of the preset number of consecutive samples near the middle position The pixel position is used as the reference pixel position to be selected.
  • This method can be referred to as the solution of continuously taking points from the intermediate position. Specifically, assuming that the reference pixel positions on the row/column adjacent to the upper side or the left side of the current block are numbered starting from 0, then the number of adjacent reference pixels in the reference pixel subset composed in this embodiment is The numbers and the corresponding reference pixel positions to be selected are shown in Table 1. At this time, the consecutive preset number of sampled reference pixel positions near the middle position can be used as candidate positions to form a reference pixel subset.
  • the side length of at least one side of the current block Preset number of candidate pixels 2 0,1 2 4 1,2 2 8 2, 3, 4 (or 3, 4, 5) 3 16 6,7,8,9 4 32 13,14,15,16,17,18,19,20 8
  • the reference pixel points of at least one side may also be skipped, that is, the unimportant reference pixels or the abnormal reference pixels are skipped (also can be regarded as Delete processing) to obtain a reference pixel subset; on this basis, that is, after partial reference pixels of at least one side are skipped, a second reference pixel set is obtained, and the second reference pixel set is filtered, To get a subset of reference pixels. Therefore, in some embodiments, the determining the candidate position of the candidate pixel based on at least one edge of the current block or the reconstructed block may include:
  • K is a positive integer greater than or equal to 1
  • the preset number of skipped pixels represents a preset number of pixels to be deleted or to be skipped.
  • the starting position of at least one side represents the leftmost edge position of the upper side of the current block or the uppermost edge position of the left side of the current block, and the end position of at least one side represents the rightmost edge of the upper side of the current block. The position or the bottom edge position of the left side of the current block.
  • the value of K can be a preset number of reference pixels, such as 1, 2, or 4; it can also be calculated according to the side length of the current block and the corresponding preset ratio; However, in actual applications, it is still set according to actual conditions, and the embodiments of the present application do not make specific limitations.
  • the preset ratio corresponding to the upper side of the current block can be represented by a first preset ratio
  • the preset ratio corresponding to the left side of the current block can be represented by a second preset ratio
  • the first preset ratio is equal to
  • the value of the second preset ratio may be the same or different, and the embodiment of the present application does not specifically limit it.
  • the leftmost edge position of the upper side can be started At the beginning, determine the position corresponding to the continuous K pixels to be skipped to the right, and then continuously skip the K pixels to be skipped to obtain the new upper side; this time, you can use the new upper side
  • the side length and the preset number of candidate pixels are used to determine the candidate position corresponding to the new upper side, so that the selected candidate pixels form a reference pixel subset; if at least one side is the left side of the current block, you can Starting from the top edge position of the left side, determine the position corresponding to the continuous K pixels to be skipped downward, and then continuously skip the K pixels to be skipped to obtain the new left side; this time
  • the candidate position corresponding to the new left side can be determined according to the side length of the new left side and the preset number of candidate pixels, so that the selected candidate pixels form a reference
  • K continuous pixels to be skipped can be determined to the left Point corresponding to the position, and then continuously skip the K pixels to be skipped to obtain the new upper side; at this time, the new upper side can be determined according to the side length of the new upper side and the preset number of candidate pixels Candidate positions corresponding to the upper side, so that the selected candidate pixels form a reference pixel subset; if at least one side is the left side of the current block, then it can start from the bottom edge position of the left side and determine upwards The positions corresponding to the continuous K pixels to be skipped, and then the K pixels to be skipped are continuously skipped to obtain the new left side; at this time, the side length of the new left side and the preset candidate The number of pixels, the candidate position corresponding to the new left side is determined, and the selected candidate pixels are formed into a reference pixel subset.
  • the embodiment of the present application uses part of the pixels in the first reference pixel set obtained by the reference pixels adjacent to the current block (ie, a subset of reference pixels) to derive the model corresponding to a complex model (such as a nonlinear model or a multi-model) parameter. Since unimportant reference pixels or abnormal reference pixels have been eliminated from the obtained subset (ie reference pixel subset), it has fewer reference pixels, which not only reduces the computational complexity It also improves the accuracy of complex models and improves the accuracy of the image components to be processed and the prediction efficiency of video images.
  • a complex model such as a nonlinear model or a multi-model
  • the model parameters of the prediction model can be calculated based on the reference pixel subset, so as to facilitate the construction of the prediction model. Therefore, in some embodiments, for S103, using the reference pixel subset to calculate the model parameters of the prediction model may include:
  • the adjacent pixel reconstruction value of the image component to be predicted corresponding to the current block and the adjacent pixel reconstruction value of the image component to be predicted corresponding to the reference block are obtained; wherein the current block is located at the Nth Frames of video images, the reference block is located in the N-1th frame of video images;
  • the model parameters are calculated.
  • the reference block and the current block are not located in the same frame, and the relationship between the two is an inter-frame relationship.
  • the reference block and the current block are located in different frames of video images, and the frame where the reference block is located is the frame before the frame where the current block is located, that is, the current block is in the Nth frame of video image, and the reference block is in the Nth frame.
  • -1 frame of video image in addition, the position of the current block in the Nth frame of video image and the position of the reference block in the N-1th frame of video image will have a motion vector (MV) offset.
  • MV motion vector
  • model parameters include a first model parameter ⁇ and a second model parameter ⁇ .
  • ⁇ and ⁇ There are many ways to calculate ⁇ and ⁇ . It can be a preset factor calculation model constructed by the least squares method, or a preset factor calculation model constructed by the maximum and minimum values, or even other ways.
  • the preset factor calculation model is not specifically limited in the embodiment of this application.
  • the prediction model is mainly used for the prediction processing of the brightness component, such as IC technology or LIC technology; at this time, ⁇ and ⁇ can be compared with the brightness component corresponding to the current block.
  • the adjacent pixel reconstruction value and the luminance component adjacent pixel reconstruction value corresponding to the reference block are derived by minimizing the regression error.
  • L(n) represents the reconstruction value of the adjacent pixels of the luminance component corresponding to the reference block
  • C(n) represents the reconstruction value of the adjacent pixels of the luminance component corresponding to the current block
  • N is the number of adjacent pixels of the luminance component corresponding to the current block.
  • the preset factor calculation model constructed by the maximum and minimum values provides a simplified version of the model parameter derivation method. Specifically, the maximum value can be searched for in the reconstructed values of the adjacent pixels of the luminance component corresponding to the reference block. And the minimum value, according to the principle of "two points determine a line" to derive ⁇ and ⁇ , as the preset factor calculation model shown in formula (4):
  • L max and L min represent the maximum and minimum values found in the reconstruction values of the adjacent pixels of the luminance component corresponding to the reference block
  • C max and C min represent that the reference pixel at the corresponding position of L max and L min is in the current block.
  • the first model parameter ⁇ and the second model parameter ⁇ can also be obtained through the calculation of formula (4).
  • a predictive model can be constructed. Specifically, based on ⁇ and ⁇ , assuming that the predicted value of the brightness component corresponding to the current block is predicted based on the predicted value of the brightness component corresponding to the reference block, the constructed prediction model is shown in equation (5),
  • i, j represent the position coordinates of the pixel in the current block
  • i represents the horizontal direction
  • j represents the vertical direction
  • Pred 1 [i,j] represents the pixel corresponding to the location coordinate [i,j] in the current block
  • the predicted value of the brightness component, Pred[i,j] represents the predicted value of the brightness component corresponding to the pixel with the position coordinate of [i,j] in the reference block.
  • the prediction model in the embodiment of the present application may be a linear model or a nonlinear model.
  • the non-linear model can be a non-linear form such as a quadratic curve, or a non-linear form composed of multiple linear models.
  • the multi-model CCLM Multiple Model CCLM, MMLM
  • FIG. 5 shows a schematic diagram of a comparative structure of a prediction model provided by an embodiment of the present application.
  • the prediction model in the embodiment of the present application can be used not only for the prediction processing of the luminance component, but also for the prediction processing of the chrominance component.
  • the predicted value of the image component to be predicted (such as the luminance component or the chrominance component) can be updated, so that the prediction of the image component is more accurate, and the prediction accuracy and video of the image component to be predicted can be improved.
  • the purpose of image prediction efficiency can be used not only for the prediction processing of the luminance component, but also for the prediction processing of the chrominance component.
  • the method may further include:
  • the image components to be predicted can be predicted based on the prediction model.
  • the first image component of the reference block can be used to predict the first image component of the current block
  • the brightness component of the reference block can be used to predict the brightness component of the current block to update the predicted value of the brightness component
  • the second image component of the reference block can be used to predict the second image component of the current block.
  • the blue chrominance component of the reference block can be used to predict the blue chrominance component of the current block to update the predicted value of the blue chrominance component
  • the third image component of the reference block can also be used to predict the third image component of the current block.
  • the red chrominance component of the reference block can be used to predict the red chrominance component of the current block to update the predicted value of the red chrominance component. ;
  • the embodiments of this application do not make specific limitations.
  • This embodiment provides an image component prediction method, by determining the first reference pixel set of the image component to be predicted of the current block; determining the reference pixel subset from the first reference pixel set; wherein the reference pixel subset includes One or more candidate pixels selected from the first reference pixel set; use a subset of reference pixels to calculate model parameters of a prediction model; wherein the prediction model is used to perform cross-component prediction processing on the image component to be predicted in the current block;
  • the prediction model is used to perform cross-component prediction processing on the image component to be predicted in the current block;
  • FIG. 6 shows a schematic flowchart of another image component prediction method provided by an embodiment of the present application. As shown in Figure 6, the method may include:
  • S601 Select a part of reference pixels from the first reference pixel set to form a reference pixel subset
  • the reference pixel subset is obtained by selecting some reference pixels from the first reference pixel set; and the model parameters are calculated based on the reference pixel subset; in this way, due to the number of samples in the reference pixel subset The reduction also reduces the number of samples required to calculate the model parameters, thereby achieving the goal of reducing computational complexity and memory bandwidth (or called memory bandwidth).
  • the determining the first reference pixel set of the image component to be predicted of the current block may include:
  • first neighboring pixels of the current block as the first reference pixel set; wherein, the first neighboring pixels are located on the vertical side of the current block and horizontally to the current block. Edges, or pixels adjacent to the vertical and horizontal edges of the current block.
  • the method may further include:
  • the first adjacent pixel is located outside the current block, it is determined that the vertical edge of the current block is the left adjacent column outside the current block, and the horizontal edge of the current block is the upper adjacent column outside the current block. Row.
  • the method may further include:
  • the first neighboring pixel is located in the current block, it is determined that the vertical side of the current block is the right side column in the current block, and the horizontal side of the current block is the lower side of the current block Row.
  • the vertical edge of the current block can be regarded as the left side of the current block, and the horizontal edge of the current block can be regarded as the upper side of the current block;
  • the vertical edge of the current block can be regarded as the right side of the current block, and the horizontal edge of the current block can be regarded as the lower side of the current block.
  • the first reference pixel set can be formed. Since there may be some unimportant reference pixels (for example, these reference pixels have poor correlation) or some abnormal reference pixels in the first reference pixel set, in order to ensure the accuracy of model parameter derivation, these need to be The reference pixels are eliminated, so that a subset of reference pixels can be obtained. Therefore, in some embodiments, the determining a subset of reference pixels may include:
  • the determining the candidate position of the candidate pixel may include:
  • the determining the candidate position of the candidate pixel may include:
  • the determining the candidate position of the candidate pixel may include:
  • the candidate position of the candidate pixel is determined according to the position of the pixel in the first reference pixel set and the image component intensity.
  • the image component intensity can be represented by image component values, such as brightness value, chroma value, etc.; here, the larger the image component value, the higher the image component intensity.
  • the reference pixels selected in the embodiments of the present application may be selected by the candidate positions of the candidate pixels; wherein, the candidate positions may be determined according to the pixel position, or may be determined according to the intensity value of the image component (such as luminance value, chrominance value) Etc.) It is determined that the embodiments of this application do not make specific limitations.
  • the reference pixel subset is formed by filtering the first reference pixel set and then selecting some reference pixels; while the model parameters are calculated based on the reference pixel subset; in this way, due to the reference
  • the reduction of the number of samples in the pixel subset also reduces the number of samples required to calculate the model parameters, thereby achieving the goal of reducing computational complexity and memory bandwidth (or called memory bandwidth).
  • the reference pixels selected in the embodiment of the present application can be selected by referring to the pixel position corresponding to the pixel, or can be selected based on the intensity value of the image component corresponding to the reference pixel (such as luminance value, chrominance value, etc.)
  • the embodiments of this application do not make specific limitations.
  • the first reference pixel set is screened either by the pixel position corresponding to the reference pixel or the image component intensity value corresponding to the reference pixel to select the appropriate reference pixel, and then form the reference pixel subset; in this way, according to the reference
  • the model parameters derived from the pixel subset are more accurate, so that the prediction model constructed based on the model parameters can also be more accurate.
  • the determining the candidate position of the candidate pixel may include:
  • the preset number of candidate pixels represents a preset number of pixels to be sampled, that is, the number of pixels included in the reference pixel subset.
  • the candidate position of the candidate pixel can be calculated according to the side length of at least one side and the preset number of candidate pixels; then according to the candidate position, the first reference pixel set Select appropriate reference pixels to form a subset of reference pixels.
  • the model parameters calculated based on the reference pixel subset are more accurate, and the constructed prediction model can also be more accurate, thereby improving the prediction accuracy of the image components to be predicted and improving the prediction efficiency of the video image.
  • the first sampling interval may be calculated first, and then the at least one edge is sampled according to the first sampling interval to determine the candidate pixel position of the candidate pixel corresponding to the at least one edge. Therefore, in some embodiments, the determining the candidate position of the candidate pixel may include:
  • the first sampling interval is calculated according to the length of the side of the current block and the preset number of candidate pixels.
  • the determining the candidate position of the candidate pixel may include:
  • the first sampling interval is adjusted to obtain the second sampling interval.
  • the first sampling interval can be fine-tuned, for example, the first sampling interval can be increased or decreased by 1 to obtain the second sampling interval.
  • the adjusted second sampling interval can be 3 or 5.
  • a small range for example, plus 1 or minus 1 may be adjusted, but the specific setting of the adjustment range is not specifically limited in the embodiment of the present application.
  • the method may further include:
  • a reference point is determined on the side of the current block, and from the reference point, a candidate position on the side of the current block is determined at the first sampling interval.
  • the method may further include:
  • a reference point is determined on the side of the current block, and candidate positions on both sides of the reference point are determined at the first sampling interval.
  • the method may further include:
  • a reference point is determined on the edge of the current block, and from the reference point, a candidate position on the edge of the current block is determined at the second sampling interval.
  • the method may further include:
  • a reference point is determined on the side of the current block, and candidate positions on both sides of the reference point are determined at the second sampling interval.
  • the reference point may be the midpoint of the at least one side, or the first reference pixel position to the left of the midpoint of the at least one side, or the midpoint of the at least one side.
  • the position of the first reference pixel point to the right of the point may even be the position of other reference pixel points on the at least one side, which is not specifically limited in the embodiment of the present application.
  • the midpoint of the at least one side may be determined according to the length of the at least one side, and then the midpoint of the at least one side is used as the reference point.
  • the reference point may be the midpoint of the at least one side, or the first reference pixel position where the midpoint of the at least one side is leftward, or the midpoint of the at least one side rightward
  • the first reference pixel position of may even be another reference pixel position of the at least one side, which is not specifically limited in the embodiment of the present application.
  • the method may further include:
  • uniform sampling can be performed according to the first sampling interval or the second sampling interval; non-uniform sampling can also be performed according to the first sampling interval and the second sampling interval, and
  • the candidate positions determined after sampling may be symmetrically distributed on both sides of the reference point, or may be asymmetrically distributed on both sides of the reference point; the embodiment of the present application does not specifically limit it.
  • the reference pixel point of at least one side can also be skipped, that is, the unimportant reference pixel point or the abnormal reference pixel point is skipped (also can be regarded as Delete processing) to obtain a reference pixel subset; on this basis, that is, after partial reference pixels of at least one side are skipped, a second reference pixel set is obtained, and the second reference pixel set is filtered, To get a subset of reference pixels. Therefore, the method may also include:
  • the end position of the side of the current block is the start pixel position or the end pixel position of the side of the current block.
  • the preset number of skipped pixels represents a preset number of pixels to be deleted or to be skipped.
  • the starting position of at least one side represents the leftmost edge position of the upper side of the current block or the uppermost edge position of the left side of the current block, and the end position of at least one side represents the rightmost edge of the upper side of the current block. The position or the bottom edge position of the left side of the current block.
  • the value of K can be a preset number of reference pixels, such as 1, 2, or 4; it can also be calculated according to the side length of the current block and the corresponding preset ratio; However, in actual applications, it is still set according to actual conditions, and the embodiments of the present application do not make specific limitations.
  • the preset ratio corresponding to the upper side of the current block can be represented by a first preset ratio
  • the preset ratio corresponding to the left side of the current block can be represented by a second preset ratio
  • the first preset ratio is equal to
  • the value of the second preset ratio may be the same or different, and the embodiment of the present application does not specifically limit it.
  • the model parameters of the prediction model can also be calculated according to the reference pixel subset, so as to facilitate the construction of the prediction model. Therefore, in some embodiments, using the reference pixel subset to calculate the model parameters of the prediction model may include:
  • the pixel at the same position of the reference pixel in the reference pixel subset is the relative position between the reference pixel and the reference block in the image where the reference block is located and the reference pixel in the second reference pixel set and the current block Pixels with the same relative position between.
  • the method may further include:
  • the prediction value of the image component to be predicted of the current block is calculated.
  • the reference block may be an image block indicated by the inter prediction parameter of the current block.
  • a prediction model can be constructed, as shown in the aforementioned formula (5). According to the prediction model and the reference block of the current block, the predicted value of the image component to be predicted of the current block can be further calculated.
  • the image component prediction method when the image component prediction method is applied to the encoder side, some pixels can be selected from the first reference pixel set of the current block to construct a reference pixel subset, and then the prediction is calculated based on the reference pixel subset
  • the model parameters of the model, and the calculated model parameters are written into the code stream; the code stream is transmitted from the encoder side to the decoder side; correspondingly, when the image component prediction method is applied to the decoder side, it can be analyzed Code stream to directly obtain the model parameters of the prediction model; or on the decoder side, you can also select some pixels from the first reference pixel set of the current block to construct a reference pixel subset, and then calculate the model of the prediction model based on the reference pixel subset Parameters to construct a prediction model, and use the prediction model to perform cross-component prediction processing on at least one image component of the current block.
  • This embodiment provides an image component prediction method.
  • the specific implementation of the foregoing embodiment is described in detail. It can be seen from the technical solutions of the foregoing embodiment that because the first reference pixel set is filtered, the unimportant can be removed The number of pixels in the first reference pixel set is reduced, which not only reduces the computational complexity and memory bandwidth, but also improves the accuracy of the prediction model; due to the prediction The model is used to implement the prediction processing of the image component to be predicted through the model parameters, thereby improving the prediction accuracy of the image component to be predicted and improving the prediction efficiency of the video image.
  • FIG. 7 shows a schematic diagram of the composition structure of an encoder 70 provided by an embodiment of the present application.
  • the encoder 70 may include: a first determining unit 701 and a first calculating unit 702, where
  • the first determining unit 701 is configured to determine the first reference pixel set of the image component to be predicted of the current block
  • the first determining unit 701 is further configured to determine a reference pixel subset from the first reference pixel set; wherein, the reference pixel subset includes one or more selected from the first reference pixel set. Candidate pixels;
  • the first calculation unit 702 is configured to use the reference pixel subset to calculate model parameters of a prediction model; wherein the prediction model is used to perform cross-component prediction processing on the image component to be predicted of the current block.
  • the encoder 70 may further include a first obtaining unit 703 configured to obtain, outside the current block, a reference pixel adjacent to at least one side of the current block; wherein, The at least one side of the current block includes at least one of the following: an upper side, a left side, an upper right side, and a lower left side; and the first reference pixel set is obtained according to the acquired reference pixels.
  • a first obtaining unit 703 configured to obtain, outside the current block, a reference pixel adjacent to at least one side of the current block; wherein, The at least one side of the current block includes at least one of the following: an upper side, a left side, an upper right side, and a lower left side; and the first reference pixel set is obtained according to the acquired reference pixels.
  • the first obtaining unit 703 is further configured to obtain reference pixels adjacent to at least one side of the reconstructed block within the reconstructed block; wherein, the reconstructed block is the same as the current block. Adjacent to an image block that has been reconstructed by encoding, at least one side of the reconstructed block includes: a bottom side, a right side, or a bottom side and a right side; and according to the obtained reference pixels, the first Reference pixel collection.
  • the encoder 70 may further include a first selecting unit 704, where:
  • the first determining unit 701 is further configured to determine a candidate position of a candidate pixel based on at least one edge of the current block or the reconstructed block;
  • the first selection unit 704 is configured to select reference pixels corresponding to the candidate position from the first reference pixel set, and compose the selected parameter pixels into the reference pixel subset.
  • the first determining unit 701 is further configured to determine the candidate position based on the pixel position corresponding to the reference pixel adjacent to the at least one side.
  • the first determining unit 701 is further configured to determine the candidate position based on the image component intensity value corresponding to the reference pixel adjacent to the at least one side.
  • the first determining unit 701 is further configured to determine the candidate position based on the pixel position and the image component intensity value corresponding to the reference pixel adjacent to the at least one side.
  • the first determining unit 701 is further configured to determine a preset number of candidate pixels; wherein, the preset number of candidate pixels represents the number of pixels sampled from the reference pixels adjacent to the at least one side And determining the candidate position according to the preset number of candidate pixels and the length of the at least one side; wherein the length of the at least one side is equal to the number of pixels included in the at least one side.
  • the first calculation unit 702 is further configured to calculate the first sampling interval according to the preset number of candidate pixels and the length of the at least one side;
  • the first determining unit 701 is further configured to determine a reference point from the at least one edge, and determine the candidate position according to the first sampling interval.
  • the encoder 70 may further include a first adjustment unit 705, configured as the first determining unit 701, and further configured to adjust the first sampling interval to obtain a second sampling interval;
  • the first determining unit 701 is further configured to determine the candidate position according to the second sampling interval based on the reference point.
  • the first determining unit 701 is further configured to determine, based on the reference point, a candidate position corresponding to one side of the reference point according to the first sampling interval, and determine the corresponding candidate position according to the second sampling interval. The candidate position corresponding to the other side of the reference point.
  • the first determining unit 701 is further configured to determine the preset number of skipped pixels K corresponding to the at least one side, where K is a positive integer greater than or equal to 1; and from the at least one Starting from the start position and/or end position of the edge, determine the positions corresponding to the K pixels to be skipped; and based on the positions corresponding to the K pixels to be skipped, from the start position of the at least one edge and /Or the end position continuously skips K pixels to be skipped to obtain at least one new side; and based on the at least one new side and the preset number of candidate pixels, the candidate position is determined.
  • the first selection unit 704 is further configured to obtain, based on the reference pixel subset, the neighboring pixel reconstruction value of the image component to be predicted corresponding to the current block and the image component to be predicted corresponding to the reference block Reconstruction values of adjacent pixels; wherein the current block is located in the Nth frame of video image, and the reference block is located in the N-1th frame of video image;
  • the first calculation unit 702 is further configured to calculate the reconstruction value of the neighboring pixel of the image component to be predicted corresponding to the current block and the reconstruction value of the neighboring pixel of the image component to be predicted corresponding to the reference block. Model parameters.
  • the encoder 70 may further include a first construction unit 706 and a first prediction unit 707, where
  • the first construction unit 706 is configured to construct the prediction model according to the model parameters
  • the first prediction unit 707 is configured to perform prediction processing on the image component to be predicted of the current block by using the prediction model to obtain a predicted value corresponding to the image component to be predicted.
  • the first determining unit 701 is further configured to use one or more first adjacent pixels of the current block as the first reference pixel set; wherein, the first adjacent pixels are The pixels are located adjacent to the vertical side of the current block, the horizontal side of the current block, or the vertical side and the horizontal side of the current block.
  • the first determining unit 701 is further configured to determine that the vertical edge of the current block is the left adjacent column outside the current block if the first neighboring pixel is located outside the current block , The horizontal edge of the current block is the upper adjacent line outside the current block.
  • the first determining unit 701 is further configured to determine that the vertical edge of the current block is the right edge column in the current block if the first neighboring pixel is located in the current block ,
  • the horizontal side of the current block is the lower side row in the current block.
  • the first determining unit 701 is further configured to determine the candidate position of the candidate pixel on the edge of the current block, wherein the edge of the current block is the vertical of the current block. Edge or horizontal edge; and selecting a pixel located at the candidate position from the first reference pixel set, and composing the selected pixel into the reference pixel subset.
  • the first determining unit 701 is further configured to determine the candidate position of the candidate pixel according to the position of the pixel in the first reference pixel set.
  • the first determining unit 701 is further configured to determine the candidate position of the candidate pixel according to the image component intensity of the pixel in the first reference pixel set.
  • the first determining unit 701 is further configured to determine the candidate position of the candidate pixel according to the position of the pixel in the first reference pixel set and the image component intensity.
  • the first determining unit 701 is further configured to determine a preset number of candidate pixels, where the preset number of candidate pixels indicates the number of pixels selected from the side of the current block;
  • the first calculation unit 702 is further configured to calculate the first sampling interval according to the length of the side of the current block and the preset number of candidate pixels.
  • the first adjustment unit 705 is configured to adjust the first sampling interval to obtain the second sampling interval.
  • the first determining unit 701 is further configured to determine a reference point on the edge of the current block, and from the reference point, determine the edge of the current block at the first sampling interval. Candidate positions.
  • the first determining unit 701 is further configured to determine a reference point on the edge of the current block, and determine candidate positions on both sides of the reference point at the first sampling interval.
  • the first determining unit 701 is further configured to determine a reference point on the edge of the current block, and from the reference point, determine the edge of the current block at the second sampling interval. Candidate positions.
  • the first determining unit 701 is further configured to determine a reference point on the edge of the current block, and determine candidate positions on both sides of the reference point at the second sampling interval.
  • the first determining unit 701 is further configured to determine a reference point on the side of the current block, determine a candidate position corresponding to one side of the reference point at the first sampling interval, and use the The second sampling interval determines the candidate position corresponding to the other side of the reference point.
  • the first determining unit 701 is further configured to determine the preset number of skipped pixels K of the side of the current block, where K is a non-negative integer; and from the end position of the side of the current block From the beginning, the Kth pixel position is set as the reference point; wherein the end position of the side of the current block is the start pixel position or the end pixel position of the side of the current block.
  • the first calculation unit 702 is further configured to use a reference pixel in the reference pixel subset and a pixel in the reference block of the current block that is located at the same position of the reference pixel in the reference pixel subset, Calculate the model parameters of the prediction model; wherein the pixels in the same position of the reference pixels in the reference pixel subset are located in the image where the reference block is located, and the relative position between the reference block and the second reference pixel set is A pixel with the same relative position between the reference pixel and the current block.
  • the first calculation unit 702 is further configured to calculate the predicted value of the image component to be predicted of the current block according to the prediction model and the reference block of the current block.
  • the reference block is the image block indicated by the inter prediction parameter of the current block.
  • a “unit” may be a part of a circuit, a part of a processor, a part of a program, or software, etc., of course, may also be a module, or may also be non-modular.
  • the various components in this embodiment may be integrated into one processing unit, or each unit may exist alone physically, or two or more units may be integrated into one unit.
  • the above-mentioned integrated unit can be realized in the form of hardware or software function module.
  • the integrated unit is implemented in the form of a software function module and is not sold or used as an independent product, it can be stored in a computer readable storage medium.
  • the technical solution of this embodiment is essentially or It is said that the part that contributes to the existing technology or all or part of the technical solution can be embodied in the form of a software product.
  • the computer software product is stored in a storage medium and includes several instructions to enable a computer device (which can A personal computer, server, or network device, etc.) or a processor (processor) executes all or part of the steps of the method described in this embodiment.
  • the aforementioned storage media include: U disk, mobile hard disk, read only memory (Read Only Memory, ROM), random access memory (Random Access Memory, RAM), magnetic disk or optical disk and other media that can store program codes.
  • an embodiment of the present application provides a computer storage medium that stores an image component prediction program that implements the steps of the method described in the foregoing embodiment when the image component prediction program is executed by at least one processor.
  • FIG. 8 shows an example of the specific hardware structure of the encoder 70 provided by the embodiment of the present application, which may include: a first communication interface 801, a first memory 802, and a first communication interface 801; A processor 803; various components are coupled together through a first bus system 804.
  • the first bus system 804 is used to implement connection and communication between these components.
  • the first bus system 804 also includes a power bus, a control bus, and a status signal bus.
  • various buses are marked as the first bus system 804 in FIG. 8. among them,
  • the first communication interface 801 is used for receiving and sending signals in the process of sending and receiving information with other external network elements;
  • the first memory 802 is configured to store a computer program that can run on the first processor 803;
  • the first processor 803 is configured to execute: when the computer program is running:
  • the reference pixel subset is used to calculate the model parameters of the prediction model; wherein, the prediction model is used to perform cross-component prediction processing on the image component to be predicted of the current block.
  • the first memory 802 in the embodiment of the present application may be a volatile memory or a non-volatile memory, or may include both volatile and non-volatile memory.
  • the non-volatile memory can be read-only memory (Read-Only Memory, ROM), programmable read-only memory (Programmable ROM, PROM), erasable programmable read-only memory (Erasable PROM, EPROM), and electrically available Erase programmable read-only memory (Electrically EPROM, EEPROM) or flash memory.
  • the volatile memory may be a random access memory (Random Access Memory, RAM), which is used as an external cache.
  • RAM static random access memory
  • DRAM dynamic random access memory
  • DRAM synchronous dynamic random access memory
  • DDRSDRAM Double Data Rate Synchronous Dynamic Random Access Memory
  • Enhanced SDRAM, ESDRAM Synchronous Link Dynamic Random Access Memory
  • Synchlink DRAM Synchronous Link Dynamic Random Access Memory
  • DRRAM Direct Rambus RAM
  • the first processor 803 may be an integrated circuit chip with signal processing capability. In the implementation process, the steps of the foregoing method can be completed by an integrated logic circuit of hardware in the first processor 803 or instructions in the form of software.
  • the above-mentioned first processor 803 may be a general-purpose processor, a digital signal processor (Digital Signal Processor, DSP), an application specific integrated circuit (ASIC), a ready-made programmable gate array (Field Programmable Gate Array, FPGA) Or other programmable logic devices, discrete gates or transistor logic devices, discrete hardware components.
  • DSP Digital Signal Processor
  • ASIC application specific integrated circuit
  • FPGA ready-made programmable gate array
  • the methods, steps, and logical block diagrams disclosed in the embodiments of the present application can be implemented or executed.
  • the general-purpose processor may be a microprocessor or the processor may also be any conventional processor or the like.
  • the steps of the method disclosed in the embodiments of the present application may be directly embodied as being executed and completed by a hardware decoding processor, or executed and completed by a combination of hardware and software modules in the decoding processor.
  • the software module can be located in a mature storage medium in the field such as random access memory, flash memory, read-only memory, programmable read-only memory or electrically erasable programmable memory, registers.
  • the storage medium is located in the first memory 802, and the first processor 803 reads the information in the first memory 802, and completes the steps of the foregoing method in combination with its hardware.
  • the embodiments described in this application can be implemented by hardware, software, firmware, middleware, microcode, or a combination thereof.
  • the processing unit can be implemented in one or more Application Specific Integrated Circuits (ASIC), Digital Signal Processing (DSP), Digital Signal Processing Equipment (DSP Device, DSPD), programmable Logic device (Programmable Logic Device, PLD), Field-Programmable Gate Array (Field-Programmable Gate Array, FPGA), general-purpose processors, controllers, microcontrollers, microprocessors, and others for performing the functions described in this application Electronic unit or its combination.
  • ASIC Application Specific Integrated Circuits
  • DSP Digital Signal Processing
  • DSP Device Digital Signal Processing Equipment
  • PLD programmable Logic Device
  • PLD programmable Logic Device
  • Field-Programmable Gate Array Field-Programmable Gate Array
  • FPGA Field-Programmable Gate Array
  • the technology described in this application can be implemented through modules (such as procedures, functions, etc.) that perform the functions described in this application.
  • the first processor 803 is further configured to execute the method described in any one of the foregoing embodiments when the computer program is running.
  • This embodiment provides an encoder, which may include a first determining unit and a first calculating unit, wherein the first determining unit is configured to determine a first reference pixel set of the image component to be predicted of the current block; To determine a reference pixel subset from the first reference pixel set; wherein the reference pixel subset includes one or more candidate pixels selected from the first reference pixel set; the first calculation unit is configured to use the reference pixel subset Set, calculate the model parameters of the prediction model; among them, the prediction model is used to perform cross-component prediction processing on the image components to be predicted in the current block; in this way, because the first reference pixel set is filtered, unimportant reference pixels can be removed Or there are abnormal reference pixels, thereby reducing the number of pixels in the first reference pixel set, which can not only reduce computational complexity and memory bandwidth, but also improve the accuracy of the prediction model; because the prediction model is used for The prediction processing of the image component to be predicted is realized through the model parameters, thereby improving the prediction accuracy of the image component to be predicted and improving the prediction
  • FIG. 9 shows a schematic diagram of the composition structure of a decoder 90 provided by an embodiment of the present application.
  • the decoder 90 may include: a second determining unit 901 and a second calculating unit 902, where
  • the second determining unit 901 is configured to determine the first reference pixel set of the image component to be predicted of the current block
  • the second determining unit 901 is further configured to determine a reference pixel subset from the first reference pixel set; wherein, the reference pixel subset includes one or more selected from the first reference pixel set. Candidate pixels;
  • the second calculation unit 902 is configured to use the reference pixel subset to calculate model parameters of a prediction model; wherein, the prediction model is used to perform cross-component prediction processing on the image component to be predicted of the current block.
  • the decoder 90 may further include a second obtaining unit 903, configured to obtain, outside the current block, a reference pixel adjacent to at least one side of the current block; wherein, The at least one side of the current block includes at least one of the following: an upper side, a left side, an upper right side, and a lower left side; and the first reference pixel set is obtained according to the acquired reference pixels.
  • the second acquiring unit 903 is further configured to acquire reference pixels adjacent to at least one side of the reconstruction block within the reconstruction block; wherein, the reconstruction block is the same as the current block. Adjacent to an image block that has been reconstructed by encoding, at least one side of the reconstructed block includes: a bottom side, a right side, or a bottom side and a right side; and according to the obtained reference pixels, the first Reference pixel collection.
  • the decoder 90 may further include a second selecting unit 904, where:
  • the second determining unit 901 is further configured to determine a candidate position of a candidate pixel based on at least one edge of the current block or the reconstruction block;
  • the second selecting unit 904 is configured to select reference pixels corresponding to the candidate positions from the first reference pixel set, and compose the selected parameter pixels into the reference pixel subset.
  • the second determining unit 901 is further configured to determine the candidate position based on the pixel position corresponding to the reference pixel adjacent to the at least one side.
  • the second determining unit 901 is further configured to determine the candidate position based on the image component intensity value corresponding to the reference pixel adjacent to the at least one side.
  • the second determining unit 901 is further configured to determine the candidate position based on the pixel position and the image component intensity value corresponding to the reference pixel adjacent to the at least one side.
  • the second determining unit 901 is further configured to determine a preset number of candidate pixels; wherein, the preset number of candidate pixels represents the number of pixels sampled from the reference pixels adjacent to the at least one side And determining the candidate position according to the preset number of candidate pixels and the length of the at least one side; wherein the length of the at least one side is equal to the number of pixels included in the at least one side.
  • the second calculation unit 902 is further configured to calculate the first sampling interval according to the preset number of candidate pixels and the length of the at least one side;
  • the second determining unit 901 is further configured to determine a reference point from the at least one edge, and determine the candidate position according to the first sampling interval.
  • the decoder 90 may further include a second adjustment unit 905, configured as the second determining unit 901, and further configured to adjust the first sampling interval to obtain a second sampling interval;
  • the second determining unit 901 is further configured to determine the candidate position according to the second sampling interval based on the reference point.
  • the second determining unit 901 is further configured to determine, based on the reference point, a candidate position corresponding to one side of the reference point according to the first sampling interval, and determine the candidate position corresponding to one side of the reference point according to the second sampling interval. The candidate position corresponding to the other side of the reference point.
  • the second determining unit 901 is further configured to determine the preset number of skipped pixels K corresponding to the at least one side, where K is a positive integer greater than or equal to 1; and from the at least one Starting from the start position and/or end position of the edge, determine the positions corresponding to the K pixels to be skipped; and based on the positions corresponding to the K pixels to be skipped, from the start position of the at least one edge and /Or the end position continuously skips K pixels to be skipped to obtain at least one new side; and based on the at least one new side and the preset number of candidate pixels, the candidate position is determined.
  • the second selecting unit 904 is further configured to obtain, based on the reference pixel subset, the neighboring pixel reconstruction value of the image component to be predicted corresponding to the current block and the image component to be predicted corresponding to the reference block Reconstruction values of adjacent pixels; wherein the current block is located in the Nth frame of video image, and the reference block is located in the N-1th frame of video image;
  • the second calculation unit 902 is further configured to calculate the reconstruction value of the neighboring pixel of the image component to be predicted corresponding to the current block and the reconstruction value of the neighboring pixel of the image component to be predicted corresponding to the reference block. Model parameters.
  • the decoder 90 may further include a second construction unit 906 and a second prediction unit 907, where:
  • the second construction unit 906 is configured to construct the prediction model according to the model parameters
  • the second prediction unit 907 is configured to perform prediction processing on the image component to be predicted of the current block by using the prediction model to obtain a predicted value corresponding to the image component to be predicted.
  • the second determining unit 901 is further configured to use one or more first neighboring pixels of the current block as the first reference pixel set; wherein, the first neighboring pixels are The pixels are located adjacent to the vertical side of the current block, the horizontal side of the current block, or the vertical side and the horizontal side of the current block.
  • the second determining unit 901 is further configured to determine that the vertical edge of the current block is the left adjacent column outside the current block if the first neighboring pixel is located outside the current block , The horizontal edge of the current block is the upper adjacent line outside the current block.
  • the second determining unit 901 is further configured to determine that the vertical edge of the current block is the right edge column in the current block if the first neighboring pixel is located in the current block ,
  • the horizontal side of the current block is the lower side row in the current block.
  • the second determining unit 901 is further configured to determine the candidate position of the candidate pixel on the edge of the current block, wherein the edge of the current block is the vertical direction of the current block. Edge or horizontal edge; and selecting a pixel located at the candidate position from the first reference pixel set, and composing the selected pixel into the reference pixel subset.
  • the second determining unit 901 is further configured to determine the candidate position of the candidate pixel according to the position of the pixel in the first reference pixel set.
  • the second determining unit 901 is further configured to determine the candidate position of the candidate pixel according to the image component intensity of the pixel in the first reference pixel set.
  • the second determining unit 901 is further configured to determine the candidate position of the candidate pixel according to the position of the pixel in the first reference pixel set and the image component intensity.
  • the second determining unit 901 is further configured to determine a preset number of candidate pixels, where the preset number of candidate pixels indicates the number of pixels selected from the side of the current block;
  • the second calculation unit 902 is further configured to calculate the first sampling interval according to the length of the side of the current block and the preset number of candidate pixels.
  • the second adjustment unit 905 is configured to adjust the first sampling interval to obtain a second sampling interval.
  • the second determining unit 901 is further configured to determine a reference point on the edge of the current block, and from the reference point, determine the edge of the current block at the first sampling interval. Candidate positions.
  • the second determining unit 901 is further configured to determine a reference point on the edge of the current block, and determine candidate positions on both sides of the reference point at the first sampling interval.
  • the second determining unit 901 is further configured to determine a reference point on the edge of the current block, and from the reference point, determine the edge of the current block at the second sampling interval. Candidate positions.
  • the second determining unit 901 is further configured to determine a reference point on the edge of the current block, and determine candidate positions on both sides of the reference point at the second sampling interval.
  • the second determining unit 901 is further configured to determine a reference point on the side of the current block, determine a candidate position corresponding to one side of the reference point at the first sampling interval, and use the The second sampling interval determines the candidate position corresponding to the other side of the reference point.
  • the second determining unit 901 is further configured to determine the preset number of skipped pixels K of the side of the current block, where K is a non-negative integer; and from the end position of the side of the current block From the beginning, the Kth pixel position is set as the reference point; wherein the end position of the side of the current block is the start pixel position or the end pixel position of the side of the current block.
  • the second calculation unit 902 is further configured to use the reference pixel in the reference pixel subset and the pixel in the reference block of the current block that is located at the same position of the reference pixel in the reference pixel subset, Calculate the model parameters of the prediction model; wherein the pixels in the same position of the reference pixels in the reference pixel subset are located in the image where the reference block is located, and the relative position between the reference block and the second reference pixel set is A pixel with the same relative position between the reference pixel and the current block.
  • the second calculation unit 902 is further configured to calculate the predicted value of the image component to be predicted of the current block according to the prediction model and the reference block of the current block.
  • the reference block is the image block indicated by the inter prediction parameter of the current block.
  • a "unit" may be a part of a circuit, a part of a processor, a part of a program, or software, etc., of course, may also be a module, or may be non-modular.
  • the various components in this embodiment may be integrated into one processing unit, or each unit may exist alone physically, or two or more units may be integrated into one unit.
  • the above-mentioned integrated unit can be realized in the form of hardware or software function module.
  • the integrated unit is implemented in the form of a software function module and is not sold or used as an independent product, it can be stored in a computer readable storage medium.
  • this embodiment provides a computer storage medium that stores an image component prediction program, and when the image component prediction program is executed by a second processor, the image component prediction program implements any one of the foregoing embodiments. Methods.
  • FIG. 10 shows the specific hardware structure of the decoder 90 provided by an embodiment of the present application, which may include: a second communication interface 1001, a second memory 1002, and a second Processor 1003; each component is coupled together through a second bus system 1004.
  • the second bus system 1004 is used to implement connection and communication between these components.
  • the second bus system 1004 also includes a power bus, a control bus, and a status signal bus.
  • various buses are marked as the second bus system 1004 in FIG. 10. among them,
  • the second communication interface 1001 is used for receiving and sending signals in the process of sending and receiving information with other external network elements;
  • the second memory 1002 is configured to store a computer program that can run on the second processor 1003;
  • the second processor 1003 is configured to execute: when the computer program is running:
  • the reference pixel subset is used to calculate the model parameters of the prediction model; wherein, the prediction model is used to perform cross-component prediction processing on the image component to be predicted of the current block.
  • the second processor 1003 is further configured to execute the method described in any one of the foregoing embodiments when running the computer program.
  • the hardware function of the second memory 1002 is similar to that of the first memory 802, and the hardware function of the second processor 1003 is similar to that of the first processor 803; it will not be detailed here.
  • This embodiment provides a decoder, which may include a second determining unit and a second calculating unit, wherein the second determining unit is configured to determine a first reference pixel set of the image component to be predicted of the current block; To determine a reference pixel subset from the first reference pixel set; wherein the reference pixel subset includes one or more candidate pixels selected from the first reference pixel set; the second calculation unit is configured to use the reference pixel subset Set, calculate the model parameters of the prediction model; among them, the prediction model is used to perform cross-component prediction processing on the image components to be predicted in the current block; in this way, because the first reference pixel set is filtered, unimportant reference pixels can be removed Or there are abnormal reference pixels, thereby reducing the number of pixels in the first reference pixel set, which can not only reduce computational complexity and memory bandwidth, but also improve the accuracy of the prediction model; because the prediction model is used for The prediction processing of the image component to be predicted is realized through the model parameters, thereby improving the prediction accuracy of the image component to be predicted and improving
  • the first reference pixel set of the image component to be predicted of the current block is determined; then the reference pixel subset is determined from the first reference pixel set; wherein the reference pixel subset includes the reference pixel set from the first reference pixel set.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Physics & Mathematics (AREA)
  • Algebra (AREA)
  • General Physics & Mathematics (AREA)
  • Mathematical Analysis (AREA)
  • Mathematical Optimization (AREA)
  • Pure & Applied Mathematics (AREA)
  • Compression Or Coding Systems Of Tv Signals (AREA)
PCT/CN2019/113765 2019-03-25 2019-10-28 图像分量预测方法、编码器、解码器以及存储介质 Ceased WO2020192109A1 (zh)

Priority Applications (16)

Application Number Priority Date Filing Date Title
CN202510882383.8A CN120568060A (zh) 2019-03-25 2019-10-28 图像分量预测方法、编码器、解码器以及存储介质
CN202111193882.4A CN113992916B (zh) 2019-03-25 2019-10-28 图像分量预测方法、编码器、解码器以及存储介质
KR1020217034571A KR20210138760A (ko) 2019-03-25 2019-10-28 이미지 요소 예측 방법, 인코더, 디코더 및 저장 매체
CN202511720177.3A CN121334365A (zh) 2019-03-25 2019-10-28 图像分量预测方法、编码器、解码器以及存储介质
EP19921790.2A EP3930324A4 (en) 2019-03-25 2019-10-28 IMAGE COMPONENT PREDICTION METHOD, ENCODER, DECODER AND STORAGE MEDIUM
CN201980093368.8A CN113508584A (zh) 2019-03-25 2019-10-28 图像分量预测方法、编码器、解码器以及存储介质
CN202510882359.4A CN120455666A (zh) 2019-03-25 2019-10-28 图像分量预测方法、编码器、解码器以及存储介质
JP2021556936A JP2022528331A (ja) 2019-03-25 2019-10-28 画像成分予測方法、エンコーダー、デコーダー及び記憶媒体
CN202510882414.XA CN120455667A (zh) 2019-03-25 2019-10-28 图像分量预测方法、编码器、解码器以及存储介质
US17/480,865 US12137204B2 (en) 2019-03-25 2021-09-21 Image component prediction method, encoder, decoder, and storage medium
JP2024112963A JP7836362B2 (ja) 2019-03-25 2024-07-12 画像成分予測方法、エンコーダー、デコーダー及び記憶媒体
US18/781,956 US12526402B2 (en) 2019-03-25 2024-07-23 Image component prediction method, encoder, decoder, and storage medium
US19/369,579 US20260052237A1 (en) 2019-03-25 2025-10-27 Image component prediction method, encoder, decoder, and storage medium
US19/369,605 US20260052238A1 (en) 2019-03-25 2025-10-27 Image component prediction method, encoder, decoder, and storage medium
US19/369,667 US20260052240A1 (en) 2019-03-25 2025-10-27 Image component prediction method, encoder, decoder, and storage medium
US19/369,642 US20260052239A1 (en) 2019-03-25 2025-10-27 Image component prediction method, encoder, decoder, and storage medium

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US201962823609P 2019-03-25 2019-03-25
US62/823,609 2019-03-25

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US17/480,865 Continuation US12137204B2 (en) 2019-03-25 2021-09-21 Image component prediction method, encoder, decoder, and storage medium

Publications (1)

Publication Number Publication Date
WO2020192109A1 true WO2020192109A1 (zh) 2020-10-01

Family

ID=72609614

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2019/113765 Ceased WO2020192109A1 (zh) 2019-03-25 2019-10-28 图像分量预测方法、编码器、解码器以及存储介质

Country Status (6)

Country Link
US (6) US12137204B2 (https=)
EP (1) EP3930324A4 (https=)
JP (2) JP2022528331A (https=)
KR (1) KR20210138760A (https=)
CN (6) CN120455667A (https=)
WO (1) WO2020192109A1 (https=)

Families Citing this family (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN116438796A (zh) * 2020-10-28 2023-07-14 Oppo广东移动通信有限公司 图像预测方法、编码器、解码器以及计算机存储介质
CN115988212A (zh) * 2022-11-21 2023-04-18 浙江大华技术股份有限公司 编码方法、编码器及计算机可读存储介质
US12425572B2 (en) * 2022-10-20 2025-09-23 Tencent America LLC Local illumination compensation
WO2024090923A1 (ko) * 2022-10-26 2024-05-02 주식회사 윌러스표준기술연구소 휘도 샘플 기반 색차 샘플 예측을 사용하는 비디오 신호 처리 방법 및 이를 위한 장치
KR20260023641A (ko) * 2023-05-26 2026-02-20 엘지전자 주식회사 Mip 기반 영상 부호화/복호화 방법, 비트스트림을 전송하는 방법 및 비트스트림을 저장한 기록 매체
US12445624B2 (en) 2023-07-02 2025-10-14 Alibaba (China) Co., Ltd. Cross component prediction
WO2025071283A1 (ko) * 2023-09-26 2025-04-03 가온그룹 주식회사 개선된 국소적 조도 보상 템플릿 결정에 기반한 동영상 부호화/복호화 방법 및 장치
WO2025147920A1 (zh) * 2024-01-10 2025-07-17 深圳传音控股股份有限公司 处理方法、处理设备及存储介质
WO2025217770A1 (zh) * 2024-04-15 2025-10-23 Oppo广东移动通信有限公司 编解码方法、编解码器以及存储介质

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20060050972A1 (en) * 2004-07-21 2006-03-09 Amimon Ltd. Interpolation image compression
CN107580222A (zh) * 2017-08-01 2018-01-12 北京交通大学 一种基于线性模型预测的图像或视频编码方法
CN109417619A (zh) * 2016-04-29 2019-03-01 英迪股份有限公司 用于编码/解码视频信号的方法和设备

Family Cites Families (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103096055B (zh) * 2011-11-04 2016-03-30 华为技术有限公司 一种图像信号帧内预测及解码的方法和装置
JP2013141187A (ja) * 2012-01-06 2013-07-18 Sony Corp 画像処理装置及び画像処理方法
EP2920964B1 (en) * 2013-03-26 2018-05-09 MediaTek Inc. Method of cross color intra prediction
KR20170035832A (ko) * 2014-07-18 2017-03-31 파나소닉 인텔렉츄얼 프로퍼티 코포레이션 오브 아메리카 화상 부호화 방법, 화상 복호 방법, 화상 부호화 장치, 화상 복호 장치, 및 콘텐츠 전송 방법
US9998742B2 (en) 2015-01-27 2018-06-12 Qualcomm Incorporated Adaptive cross component residual prediction
CN108600749B (zh) * 2015-08-29 2021-12-28 华为技术有限公司 图像预测的方法及设备
CN106210747A (zh) * 2016-07-19 2016-12-07 北京工业大学 一种基于四叉树概率预测的低复杂度视频编码方法
US20190200021A1 (en) * 2016-09-22 2019-06-27 Lg Electronics Inc. Illumination compensation-based inter-prediction method and apparatus in image coding system
JP2018056685A (ja) * 2016-09-27 2018-04-05 株式会社ドワンゴ 画像符号化装置、画像符号化方法、及び画像符号化プログラム、並びに、画像復号装置、画像復号方法、及び画像復号プログラム
US10951912B2 (en) * 2016-10-05 2021-03-16 Qualcomm Incorporated Systems and methods for adaptive selection of weights for video coding
US10225573B1 (en) * 2017-01-31 2019-03-05 Google Llc Video coding using parameterized motion models
CN107147911B (zh) 2017-07-05 2019-07-26 中南大学 基于局部亮度补偿lic的快速帧间编码模式选择方法及装置

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20060050972A1 (en) * 2004-07-21 2006-03-09 Amimon Ltd. Interpolation image compression
CN109417619A (zh) * 2016-04-29 2019-03-01 英迪股份有限公司 用于编码/解码视频信号的方法和设备
CN107580222A (zh) * 2017-08-01 2018-01-12 北京交通大学 一种基于线性模型预测的图像或视频编码方法

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See also references of EP3930324A4 *

Also Published As

Publication number Publication date
JP2024138498A (ja) 2024-10-08
US20240380883A1 (en) 2024-11-14
US20260052237A1 (en) 2026-02-19
JP7836362B2 (ja) 2026-03-26
KR20210138760A (ko) 2021-11-19
CN113992916B (zh) 2023-06-27
JP2022528331A (ja) 2022-06-10
CN113992916A (zh) 2022-01-28
EP3930324A4 (en) 2022-07-20
US12526402B2 (en) 2026-01-13
US20260052239A1 (en) 2026-02-19
EP3930324A1 (en) 2021-12-29
US12137204B2 (en) 2024-11-05
CN113508584A (zh) 2021-10-15
CN120568060A (zh) 2025-08-29
CN120455666A (zh) 2025-08-08
CN120455667A (zh) 2025-08-08
US20260052238A1 (en) 2026-02-19
CN121334365A (zh) 2026-01-13
US20220007011A1 (en) 2022-01-06
US20260052240A1 (en) 2026-02-19

Similar Documents

Publication Publication Date Title
WO2020192109A1 (zh) 图像分量预测方法、编码器、解码器以及存储介质
CN113676732B (zh) 图像分量预测方法、编码器、解码器以及存储介质
JP7753433B2 (ja) デコードのための予測方法及びその装置、並びにコンピュータ記憶媒体
WO2020192085A1 (zh) 图像预测方法、编码器、解码器以及存储介质
WO2024152385A1 (zh) 编解码方法、码流、编码器、解码器以及存储介质
US20250343904A1 (en) Encoding method, decoding method, encoder, decoder, and storage medium
WO2021203381A1 (zh) 一种视频编解码方法、装置以及计算机可读存储介质
WO2024145852A1 (zh) 编解码方法、码流、编码器、解码器以及存储介质
WO2025007263A1 (zh) 编解码方法、码流、编码器、解码器以及存储介质
WO2020258016A1 (zh) 图像分量预测方法、装置及计算机存储介质
WO2020258052A1 (zh) 图像分量预测方法、装置及计算机存储介质
WO2020258053A1 (zh) 图像分量预测方法、装置及计算机存储介质
CN114979627B (zh) 视频编码中的运动矢量(mv)约束和变换约束
WO2020140214A1 (zh) 解码预测方法、装置及计算机存储介质
WO2024153241A1 (zh) 编解码方法、码流、编码器、解码器以及存储介质
WO2025065694A1 (zh) 编解码方法及装置、编解码器、码流、存储介质
WO2024145850A1 (zh) 编解码方法、码流、编码器、解码器以及存储介质
WO2024234380A1 (zh) 编解码方法、码流、编码器、解码器以及存储介质
WO2025145440A1 (zh) 编解码方法、编码器、解码器以及存储介质
WO2024212251A1 (zh) 编解码方法、码流、编码器、解码器以及存储介质
WO2023197193A1 (zh) 编解码方法、装置、编码设备、解码设备以及存储介质
WO2024197748A1 (zh) 编解码方法、码流、编码器、解码器以及存储介质
WO2025007272A1 (zh) 编解码方法、码流、编码器、解码器以及存储介质
WO2024077569A1 (zh) 编解码方法、码流、编码器、解码器以及存储介质

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 19921790

Country of ref document: EP

Kind code of ref document: A1

ENP Entry into the national phase

Ref document number: 2021556936

Country of ref document: JP

Kind code of ref document: A

NENP Non-entry into the national phase

Ref country code: DE

ENP Entry into the national phase

Ref document number: 2019921790

Country of ref document: EP

Effective date: 20210921

ENP Entry into the national phase

Ref document number: 20217034571

Country of ref document: KR

Kind code of ref document: A

WWR Wipo information: refused in national office

Ref document number: 1020217034571

Country of ref document: KR

WWC Wipo information: continuation of processing after refusal or withdrawal

Ref document number: 1020217034571

Country of ref document: KR