WO2018068259A1 - 图像编码/解码方法、装置以及图像处理设备 - Google Patents

图像编码/解码方法、装置以及图像处理设备 Download PDF

Info

Publication number
WO2018068259A1
WO2018068259A1 PCT/CN2016/101990 CN2016101990W WO2018068259A1 WO 2018068259 A1 WO2018068259 A1 WO 2018068259A1 CN 2016101990 W CN2016101990 W CN 2016101990W WO 2018068259 A1 WO2018068259 A1 WO 2018068259A1
Authority
WO
WIPO (PCT)
Prior art keywords
prediction
image
sub
prediction unit
unit
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/CN2016/101990
Other languages
English (en)
French (fr)
Inventor
朱建清
王争
数井君彦
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Fujitsu Ltd
Original Assignee
Fujitsu Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Fujitsu Ltd filed Critical Fujitsu Ltd
Priority to PCT/CN2016/101990 priority Critical patent/WO2018068259A1/zh
Priority to JP2019508207A priority patent/JP2019528621A/ja
Priority to CN201680087832.9A priority patent/CN109479144A/zh
Publication of WO2018068259A1 publication Critical patent/WO2018068259A1/zh
Priority to US16/262,343 priority patent/US20190166373A1/en
Anticipated expiration legal-status Critical
Priority to JP2021072977A priority patent/JP7067655B2/ja
Ceased legal-status Critical Current

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
    • H04N19/157—Assigned coding mode, i.e. the coding mode being predefined or preselected to be further used for selection of another element or parameter
    • H04N19/159—Prediction type, e.g. intra-frame, inter-frame or bidirectional frame prediction
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/103—Selection of coding mode or of prediction mode
    • H04N19/11—Selection of coding mode or of prediction mode among a plurality of spatial predictive coding modes
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/119—Adaptive subdivision aspects, e.g. subdivision of a picture into rectangular or non-rectangular coding blocks
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/129—Scanning of coding units, e.g. zig-zag scan of transform coefficients or flexible macroblock ordering [FMO]
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
    • H04N19/17—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object
    • H04N19/176—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a block, e.g. a macroblock
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
    • H04N19/184—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being bits, e.g. of the compressed video stream
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • H04N19/593—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving spatial prediction techniques
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/70—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by syntax aspects related to video coding, e.g. related to compression standards

Definitions

  • the present invention relates to the field of graphic image technology, and in particular, to an image encoding/decoding method, apparatus, and image processing apparatus.
  • intra coding In video coding (also referred to as image coding) standards (eg, MPEG 2, H.264/AVC, H.265/HEVC), intra coding (hereinafter also referred to as intra prediction coding) is used.
  • the reconstructed neighboring pixels are used to predict the current block to be encoded; the block to be encoded may be referred to as a prediction unit (PU).
  • PU prediction unit
  • FIG. 1 is a schematic diagram of an intra prediction mode. As shown in FIG. 1, a block to be coded (PU) may be predicted by reconstructed neighboring pixels.
  • the coding unit (CU, Coding Unit) may be predicted by one PU or may be predicted by multiple PUs.
  • FIG. 2 is a schematic diagram of the relationship between a CU and a PU. As shown in FIG. 2, one CU can be predicted by one or four PUs; each PU has its own prediction mode.
  • the coding end first determines the prediction mode of the prediction unit and the residual information (Residual Information), and then encodes the information into the bit stream (also referred to as a code stream); the decoding end is from the bit stream.
  • the prediction mode information of the prediction unit and the residual information are obtained, and the image is reconstructed based on the information.
  • Embodiments of the present invention provide an image encoding/decoding method, apparatus, and image processing apparatus, and are expected to provide more accurate intra prediction results without increasing excessive coding cost.
  • an image coding method which uses an intra prediction method.
  • the plurality of sub-prediction units of the prediction unit perform encoding, and the image encoding method includes:
  • the prediction mode information of the prediction unit and the residual information of the plurality of sub-prediction units are encoded into a bitstream.
  • an image encoding apparatus that encodes a plurality of sub-prediction units of a prediction unit by using an intra prediction method, the image encoding apparatus comprising:
  • a mode determining unit that determines a prediction mode of the prediction unit
  • An information calculation unit that calculates residual information of the plurality of sub-prediction units of the prediction unit
  • a bitstream encoding unit that encodes prediction mode information of the prediction unit and residual information of the plurality of sub-prediction units into a bitstream.
  • an image decoding method in which a plurality of sub-prediction units of a prediction unit are decoded by using an intra prediction method, where the image decoding method includes:
  • an image decoding apparatus that decodes a plurality of sub-prediction units of a prediction unit by using an intra prediction method, where the image decoding apparatus includes:
  • An information acquisition unit that obtains prediction mode information of the prediction unit and residual information of the plurality of sub prediction units of the prediction unit from the bitstream;
  • An image reconstruction unit that calculates a reconstructed image of the sub-prediction unit based on a prediction mode of the prediction unit and residual information of the plurality of sub-prediction units, respectively.
  • an image processing apparatus wherein the image processing apparatus comprises:
  • An encoder comprising an image encoding device as previously described; and/or
  • the decoder includes the image decoding device as described above.
  • a computer readable program wherein the program causes the image encoding device or image when the program is executed in an image encoding device or an image processing device
  • the processing device performs the image encoding method as described above.
  • a storage medium storing a computer readable program, wherein the computer readable program causes an image encoding device or an image processing device to perform an image encoding method as described above.
  • An embodiment of the present invention provides a computer readable program, wherein when the program is executed in an image decoding device or an image processing device, the program causes the image decoding device or the image processing device to execute the image decoding method as described above .
  • An embodiment of the present invention provides a storage medium storing a computer readable program, wherein the computer readable program causes an image decoding device or an image processing device to perform an image decoding method as described above.
  • the beneficial effects of the embodiments of the present invention are: determining a prediction mode of the prediction unit and separately calculating residual information of the plurality of sub prediction units of the prediction unit; and predicting mode information of the prediction unit and the plurality of sub prediction units
  • the residual information is programmed into the bitstream.
  • 1 is a schematic diagram of an intra prediction mode
  • FIG. 2 is a schematic diagram of a relationship between a CU and a PU
  • FIG. 3 is a schematic diagram of encoding using an intra prediction method
  • 4 is a schematic diagram of decoding using intra prediction
  • FIG. 5 is a schematic diagram of an image encoding method according to Embodiment 1 of the present invention.
  • FIG. 6 is a schematic diagram of a relationship between a PU and a sub-PU according to Embodiment 1 of the present invention.
  • FIG. 7 is another schematic diagram of an image encoding method according to Embodiment 1 of the present invention.
  • FIG. 8 is a schematic diagram of a raster scanning method according to Embodiment 1 of the present invention.
  • FIG. 9 is a schematic diagram of a Z-scan mode according to Embodiment 1 of the present invention.
  • FIG. 10 is another schematic diagram of an image encoding method according to Embodiment 1 of the present invention.
  • FIG. 11 is a schematic diagram of an image decoding method according to Embodiment 2 of the present invention.
  • FIG. 12 is another schematic diagram of an image decoding method according to Embodiment 2 of the present invention.
  • FIG. 13 is another schematic diagram of an image decoding method according to Embodiment 2 of the present invention.
  • Figure 14 is a schematic diagram of an image encoding apparatus according to a third embodiment of the present invention.
  • Figure 15 is another schematic diagram of an image encoding apparatus according to Embodiment 3 of the present invention.
  • Figure 16 is a schematic diagram of an image decoding apparatus according to Embodiment 4 of the present invention.
  • Figure 17 is a schematic diagram of an image reconstruction unit according to a fourth embodiment of the present invention.
  • Figure 18 is a diagram showing an encoder or decoder of Embodiment 5 of the present invention.
  • FIG. 3 is a schematic diagram of encoding using intra prediction, showing the case where the encoding end is for one PU.
  • the prediction mode of the PU may be determined first, and then a prediction image (Prediction image) is calculated.
  • the residual information can be calculated based on the original image and the predicted image.
  • the encoding end may further perform coding operations on the residual information, for example, performing transform (Quantization) and quantization (Quantilization) operations; and then performing decoding operations on the residual information after the encoding operation, for example.
  • Performing operations such as inverse quantization (IQ, Inverse Quantilization) and inverse transform (IT, Inverse Transform) to obtain a result of decoding operation dec_resi; then calculating a reconstructed image based on the dec_resi and the predicted image; the reconstructed image may be Save it for subsequent encoding.
  • IQ inverse quantization
  • IT Inverse Transform
  • the encoding end can program the prediction mode information and the residual information into the bit stream.
  • the decoding end can obtain the prediction mode information and the residual information of each PU from the bit stream, and then can calculate the prediction image.
  • the decoding end may decode the residual information, for example, perform inverse quantization (IQ) and inverse transform (IT) operations, and obtain a result of the decoding operation dec_resi; and then calculate a reconstructed image based on the dec_resi and the predicted image.
  • the reconstructed image can be saved for subsequent decoding.
  • the above only schematically illustrates the case where the encoding end and the decoding end use the intra prediction method for encoding and decoding, but the present invention is not limited thereto; for example, the prediction mode information may also be programmed into the bit stream after being determined. Etc.; specific implementation methods can be determined based on actual conditions.
  • specific content of the prediction mode and the residual information, and how to calculate the residual information and the like the existing standard may be referred to, and the present invention will not be described again.
  • the above scheme uses the prediction unit as the granularity for intra prediction. If the prediction unit is larger, the prediction result is inaccurate. If the prediction unit is smaller, more prediction mode information and residual information need to be programmed into the bit stream. , resulting in a larger coding cost.
  • the embodiments of the present invention are described in detail below.
  • Embodiments of the present invention provide an image encoding method for encoding a plurality of sub-prediction units (sub-PUs) of a prediction unit (PU) by using an intra prediction method.
  • FIG. 5 is a schematic diagram of an image encoding method according to an embodiment of the present invention, which is described from a coding end to a prediction unit. As shown in FIG. 5, the image encoding method includes:
  • Step 501 Determine a prediction mode of the prediction unit.
  • Step 502 respectively calculating residual information of the plurality of sub-prediction units of the prediction unit
  • Step 503 The prediction mode information of the prediction unit and the residual information of the plurality of sub prediction units are programmed into the bit stream.
  • the size of the sub-prediction unit can be determined in advance. For example, whether the shape of the PU is square or rectangular, or other shapes, the sub-PU can always be square and have a predefined size.
  • the size information of the sub-prediction unit may be included in a sequence parameter set (SPS, Sequence Parameter Set), or included in a PDS (Picture Parameter Set), or a predetermined value (for example, a default) value).
  • FIG. 6 is a schematic diagram showing the relationship between a PU and a sub-PU according to an embodiment of the present invention, showing several examples.
  • PU and sub-PU may both be square, and one PU may be divided into 16 sub-PUs.
  • the PU is a rectangle whose length is smaller than the width, and the sub-PU is a square, and one PU can be divided into 8 sub-PUs.
  • the PU is a rectangle whose length is greater than the width, and the sub-PU is a square, and one PU can be divided into 8 sub-PUs.
  • the size and shape of the sub-PU may be fixed, for example, 4*4 (pixels*pixels) or 8*8. It should be noted that FIG. 6 only schematically shows the relationship between the PU and the sub-PU, but the present invention is not limited thereto, and the specific division manner may be determined according to actual conditions.
  • the plurality of sub-prediction units of one prediction unit correspond to the same prediction mode. That is, a plurality of sub-prediction units of the same prediction unit share the same intra prediction mode. Thereby, it is not necessary to perform bit stream encoding on the prediction mode information of each sub-prediction unit without excessively increasing the bit stream cost of the encoding. Furthermore, since the prediction unit is divided into finer prediction blocks, the accuracy of intra prediction can be improved.
  • FIG. 7 is another schematic diagram of an image encoding method according to an embodiment of the present invention, illustrating a prediction unit from an encoding end. As shown in FIG. 7, the image encoding method includes:
  • Step 701 Determine a prediction mode of the prediction unit.
  • Step 702 Select a sub-prediction unit of the prediction unit
  • Step 703 calculating a predicted image of the sub-prediction unit
  • the predicted image can be represented as a prediction.
  • Step 704 Calculate residual information of the sub-prediction unit based on the original image and the predicted image.
  • resi original-prediction
  • resi represents the residual information of the sub-prediction unit
  • original represents the original image
  • Step 705 Perform an encoding operation on the residual information.
  • the resi may be subjected to operations such as transform and quantization, but the present invention is not limited thereto, and may be other encoding operations.
  • operations such as transform and quantization
  • the present invention is not limited thereto, and may be other encoding operations.
  • Step 706 performing a decoding operation on the residual information after the encoding operation
  • the residual information after the encoding operation can be subjected to operations such as inverse quantization (IQ, Inverse Quantilization) and inverse transform (IT, Inverse Transform), and the decoded result dec_resi can be obtained.
  • IQ inverse quantization
  • IT inverse Transform
  • decoded result dec_resi can be obtained.
  • the present invention is not limited thereto, and may be other decoding operations; for related specific how to perform decoding operations, reference may be made to related technologies.
  • Step 707 Calculate a reconstructed image of the sub-prediction unit based on a result of the decoding operation and the predicted image.
  • reco dec_resi+prediction; where reco represents the reconstructed image of the sub-prediction unit.
  • Step 708 storing the reconstructed image
  • the reconstructed image can be used for subsequent encoding.
  • Step 709 it is determined whether there are other sub-prediction units; if there are other sub-prediction units, step 702 is performed to continue the processing of the next sub-prediction unit; if there are no other sub-prediction units, step 710 may be performed.
  • Step 710 Program prediction mode information of the prediction unit and residual information of the multiple sub-prediction units into a bitstream.
  • the prediction mode information of the prediction unit may be obtained from step 701, and the residual information of the plurality of sub prediction units may be obtained from step 705.
  • FIG. 7 is only illustrative of an embodiment of the invention, but the invention is not limited thereto.
  • the order of execution between the various steps can be appropriately adjusted, and other steps can be added or some of the steps can be reduced.
  • Those skilled in the art can appropriately modify the above based on the above contents, and are not limited to the description of the above drawings.
  • bit stream encoding may be performed after the processing of the entire prediction unit is completed; or the bit stream encoding may be performed immediately after determining the prediction mode information of the prediction unit or the residual information of the plurality of sub prediction units; The timing of bitstream encoding is determined according to actual conditions.
  • each sub-prediction unit in the prediction unit for example, a raster scan method or a Z-type method may be employed; however, the present invention is not limited thereto.
  • FIG. 8 is a schematic diagram of a raster scanning mode according to an embodiment of the present invention, showing an example of several raster scanning modes; and
  • FIG. 9 is a schematic diagram of a Z-scanning method according to an embodiment of the present invention, showing several Z-scanning modes. An example of the way.
  • the prediction unit is divided into a plurality of sub-prediction units.
  • the indication information indicating whether the prediction unit is divided into the plurality of sub-prediction units may be encoded into the bit stream;
  • the intra prediction is adaptively performed with the prediction unit as the granularity, or the intra prediction is performed with the sub prediction unit as the granularity.
  • the granularity of the indication information may be a prediction unit (PU) level, or a coding unit (CU) level, or a slice level, or a picture level, or a sequence ( Sequence) level; however, the invention is not limited thereto.
  • PU prediction unit
  • CU coding unit
  • Sequence Sequence
  • FIG. 10 is another schematic diagram of an image encoding method according to an embodiment of the present invention, illustrating a prediction unit from an encoding end;
  • FIG. 10 schematically illustrates adaptively using a prediction unit (PU) level or sub prediction for granularity of indication information. The case at the unit (sub-PU) level.
  • the image encoding method includes:
  • Step 1001 Determine a prediction mode when the prediction unit is granular (that is, not sub-prediction unit) (for example, represented by best_mode_no_split) and calculate a corresponding cost (for example, represented by best_cost_no_split);
  • Step 1002 determining a prediction mode when the sub-prediction unit is granular (ie, dividing the sub-prediction unit) (for example, represented by best_mode_split) and calculating a corresponding cost (for example, represented by best_cost_split);
  • step 1003 it is determined whether best_cost_split is smaller than best_cost_no_split; if yes, step 1004 is performed; otherwise, step 1014 is performed.
  • steps 1004 to 1013 show the case of dividing the sub-prediction unit.
  • step 1004 intra_sub_pu_flag is set to 1, and best_cost_split is used as the intra prediction mode.
  • Step 1005 Select a sub-prediction unit of the prediction unit
  • Step 1006 Calculate a predicted image of the sub-prediction unit
  • the predicted image can be represented as a prediction.
  • Step 1007 Calculate residual information of the sub-prediction unit based on the original image and the predicted image.
  • resi original-prediction
  • resi represents the residual information of the sub-prediction unit
  • original represents the original image
  • Step 1008 Perform an encoding operation on the residual information.
  • the resi may be subjected to operations such as transform and quantization, but the present invention is not limited thereto, and may be other encoding operations.
  • operations such as transform and quantization
  • the present invention is not limited thereto, and may be other encoding operations.
  • Step 1009 Perform decoding operation on the residual information after the encoding operation
  • the residual information after the encoding operation can be subjected to operations such as inverse quantization (IQ, Inverse Quantilization) and inverse transform (IT, Inverse Transform), and the decoded result dec_resi can be obtained.
  • IQ inverse quantization
  • IT inverse Transform
  • decoded result dec_resi can be obtained.
  • the present invention is not limited thereto, and may be other decoding operations; for related specific how to perform decoding operations, reference may be made to related technologies.
  • Step 1010 Calculate a reconstructed image of the sub-prediction unit based on a result of the decoding operation and the predicted image.
  • reco dec_resi+prediction; where reco represents the reconstructed image of the sub-prediction unit.
  • Step 1011 storing the reconstructed image.
  • the reconstructed image can be used for subsequent encoding.
  • step 1012 it is determined whether there are other sub-prediction units; if there are other sub-prediction units, step 1005 is performed to continue the processing of the next sub-prediction unit; if there are no other sub-prediction units, step 1013 may be performed.
  • Step 1013 The prediction mode information, the indication information (ie, intra_sub_pu_flag) of the prediction unit, and the residual information of the plurality of sub-prediction units are encoded into the bitstream.
  • step 1014 to step 1021 show a case where the sub prediction unit is not divided.
  • step 1014 intra_sub_pu_flag is set to 0, and best_cost_no_split is used as the intra prediction mode.
  • Step 1015 Calculate a predicted image of the prediction unit.
  • the predicted image can be represented as a prediction.
  • Step 1016 Calculate residual information of the prediction unit based on the original image and the predicted image.
  • resi original-prediction
  • resi represents the residual information of the prediction unit
  • original represents the original image
  • Step 1017 Perform coding operation on the residual information.
  • the resi may be subjected to operations such as transform and quantization, but the present invention is not limited thereto, and may be other encoding operations.
  • operations such as transform and quantization
  • the present invention is not limited thereto, and may be other encoding operations.
  • Step 1018 Perform decoding operation on the residual information after the coding operation.
  • the residual information after the encoding operation may be subjected to operations such as inverse quantization (IQ, Inverse Quantilization) and inverse transform (IT, Inverse Transform), but the present invention is not limited thereto, and may be other decoding operations; Refer to the related art for decoding operations.
  • IQ inverse quantization
  • IT inverse Transform
  • Step 1019 Calculate a reconstructed image of the prediction unit based on a result of the decoding operation and the predicted image.
  • reco dec_resi+prediction; where reco represents the reconstructed image of the prediction unit.
  • Step 1020 storing the reconstructed image.
  • the reconstructed image can be used for subsequent encoding.
  • Step 1021 The prediction mode information, the indication information (ie, intra_sub_pu_flag), and the residual information of the prediction unit are programmed into the bitstream.
  • FIG. 10 is only illustrative of an embodiment of the invention, but the invention is not limited thereto.
  • the order of execution between the various steps can be appropriately adjusted, and other steps can be added or some of the steps can be reduced.
  • Those skilled in the art can appropriately modify the above based on the above contents, and are not limited to the description of the above drawings.
  • the present invention is schematically illustrated by taking only one prediction unit as an example, and the plurality of prediction units may be separately encoded using the above steps.
  • the above has only described various steps or processes related to the present invention, but the present invention is not limited thereto.
  • the image encoding method may also include other steps or processes, and the specific content of these steps or processes may refer to the prior art.
  • Embodiments of the present invention provide an image decoding method for decoding a plurality of sub-prediction units (sub-PUs) of a prediction unit (PU) by using an intra prediction method.
  • the second embodiment corresponds to the image encoding method of the first embodiment, and the same content as the first embodiment will not be described again.
  • FIG. 11 is a schematic diagram of an image decoding method according to an embodiment of the present invention, illustrating a prediction unit from a decoding end. As shown in FIG. 11, the image decoding method includes:
  • Step 1101 Obtain prediction mode information of the prediction unit and residual information of the plurality of sub prediction units of the prediction unit from the bitstream.
  • Step 1102 Calculate a reconstructed image of the sub-prediction unit according to a prediction mode of the prediction unit and residual information of the plurality of sub-prediction units.
  • FIG. 12 is another schematic diagram of an image decoding method according to an embodiment of the present invention, illustrating a prediction unit from a decoding end. As shown in FIG. 12, the image decoding method includes:
  • Step 1201 Obtain prediction mode information of the prediction unit and residual information of the plurality of sub prediction units of the prediction unit from the bitstream.
  • the image decoding method may further include:
  • Step 1202 Select a sub-prediction unit of the prediction unit
  • Step 1203 Calculate a predicted image of the sub-prediction unit
  • the predicted image can be represented as a prediction.
  • Step 1204 Perform a decoding operation on the residual information of the sub prediction unit.
  • the residual information may be subjected to operations such as inverse quantization (IQ, Inverse Quantilization) and inverse transform (IT, Inverse Transform), and the decoded result dec_resi may be obtained.
  • IQ inverse quantization
  • IT inverse Transform
  • the present invention is not limited thereto, and may be other decoding operations; for related specific how to perform decoding operations, reference may be made to related technologies.
  • Step 1205 Calculate a reconstructed image of the sub-prediction unit based on a result of the decoding operation and the predicted image.
  • reco dec_resi+prediction; where reco represents the reconstructed image of the sub-prediction unit.
  • Step 1206 storing the reconstructed image
  • the reconstructed image can be used for subsequent decoding.
  • Step 1207 it is determined whether there are other sub-prediction units; if there are other sub-prediction units, step 1202 is performed to continue the processing of the next sub-prediction unit; if there are no other sub-prediction units, the processing of the prediction unit may be completed. .
  • the indication information indicating whether the prediction unit is divided into a plurality of sub-prediction units may be incorporated into the bit stream; thereby, intra prediction may be adaptively performed with the prediction unit as the granularity, or intra prediction may be performed with the sub-prediction unit as the granularity.
  • FIG. 13 is another schematic diagram of an image decoding method according to an embodiment of the present invention, illustrating a prediction unit from a decoding end. As shown in FIG. 13, the image decoding method includes:
  • Step 1301 Obtain prediction mode information and residual information from the bitstream, and indicate whether to divide the sub-pre- The indication information of the measurement unit (for example, expressed by intra_sub_pu_flag).
  • Step 1302 it is determined whether intra_sub_pu_flag is equal to 1; in the case of YES, step 1303 is performed; otherwise, step 1309 is performed;
  • steps 1303 to 1308 show the case of dividing the sub-prediction unit.
  • Step 1303 Select a sub-prediction unit of the prediction unit
  • Step 1304 calculating a predicted image of the sub-prediction unit
  • the predicted image can be represented as a prediction.
  • Step 1305 Perform a decoding operation on the residual information of the sub-prediction unit.
  • the residual information may be subjected to operations such as inverse quantization (IQ, Inverse Quantilization) and inverse transform (IT, Inverse Transform), and the decoded result dec_resi may be obtained.
  • IQ inverse quantization
  • IT inverse Transform
  • the present invention is not limited thereto, and may be other decoding operations; for related specific how to perform decoding operations, reference may be made to related technologies.
  • Step 1306 calculating a reconstructed image of the sub-prediction unit based on a result of the decoding operation and the predicted image.
  • reco dec_resi+prediction; where reco represents the reconstructed image of the sub-prediction unit.
  • Step 1307 storing the reconstructed image
  • the reconstructed image can be used for subsequent decoding.
  • steps 1309 to 1312 show the case where the sub prediction unit is not divided.
  • Step 1309 calculating a predicted image of the prediction unit
  • the predicted image can be represented as a prediction.
  • Step 1310 Perform decoding operation on the residual information of the prediction unit.
  • the residual information may be subjected to operations such as inverse quantization (IQ, Inverse Quantilization) and inverse transform (IT, Inverse Transform), but the present invention is not limited thereto, and may be other decoding operations; Related technology.
  • IQ inverse quantization
  • IT inverse Transform
  • Step 1311 Calculate a reconstructed image of the prediction unit based on a result of the decoding operation and the predicted image.
  • reco dec_resi+prediction; where reco represents the reconstructed image of the prediction unit.
  • Step 1312 storing the reconstructed image.
  • the reconstructed image can be used for subsequent decoding.
  • FIG. 13 is only illustrative of an embodiment of the invention, but the invention is not limited thereto.
  • the order of execution between the various steps can be appropriately adjusted, and other steps can be added or some of the steps can be reduced.
  • Those skilled in the art can appropriately modify the above based on the above contents, and are not limited to the description of the above drawings.
  • the present invention is schematically illustrated by taking only one prediction unit as an example, and the above steps may be separately used for decoding for a plurality of prediction units.
  • the above has only described various steps or processes related to the present invention, but the present invention is not limited thereto.
  • the image decoding method may also include other steps or processes, and the specific content of these steps or processes may refer to the prior art.
  • Embodiments of the present invention provide an image encoding apparatus that encodes a plurality of sub-prediction units of a prediction unit by using an intra prediction method.
  • the embodiment of the present invention corresponds to the image encoding method of Embodiment 1, and the same content is not described again.
  • FIG. 14 is a schematic diagram of an image encoding apparatus according to an embodiment of the present invention. As shown in FIG. 14, the image encoding apparatus 1400 includes:
  • a mode determining unit 1401 that determines a prediction mode of the prediction unit
  • An information calculation unit 1402 that calculates residual information of the plurality of sub-prediction units of the prediction unit, respectively;
  • the bit stream encoding unit 1403 encodes the prediction mode information of the prediction unit and the residual information of the plurality of sub-prediction units into the bit stream.
  • the size of the sub-prediction unit may be predetermined.
  • Sub-prediction unit size information It may be included in the sequence parameter set, or may be included in the image parameter set, or may be a predetermined value; however, the invention is not limited thereto.
  • the plurality of sub-prediction units of the prediction unit correspond to the same prediction mode.
  • the image encoding apparatus 1500 includes a mode determining unit 1401, an information calculating unit 1402, and a bit stream encoding unit 1403, as described above.
  • the information calculation unit 1402 may include:
  • a predicted image calculation unit 1501 that calculates a predicted image of the sub-prediction unit for each of the sub-prediction units
  • the residual calculation unit 1502 calculates residual information of the sub-prediction unit based on the original image and the predicted image.
  • the image encoding device 1500 may further include:
  • a coding operation unit 1503 that performs coding operation on the residual information
  • a decoding operation unit 1504 that performs decoding operation on the residual information after the encoding operation
  • the reconstructed image calculation unit 1505 calculates a reconstructed image of the sub-prediction unit based on the result of the decoding operation and the predicted image.
  • the bitstream encoding unit 1403 may be further configured to: instruct the indication information indicating whether the prediction unit is divided into multiple sub-prediction units into the bitstream.
  • the indication information may be a 1-bit identifier, but the invention is not limited thereto.
  • the granularity of the indication information may be a prediction unit level, or may be a coding unit level, or may be a slice level, or may be an image level, or may be a sequence level.
  • the image encoding device may also include other components or modules, and for the specific content of these components or modules, reference may be made to the prior art.
  • Embodiments of the present invention provide an image decoding apparatus that decodes a plurality of sub-prediction units of a prediction unit by using an intra prediction method.
  • the embodiment of the present invention corresponds to the image decoding method of Embodiment 2, and the same content is not described again.
  • FIG. 16 is a schematic diagram of an image decoding apparatus according to an embodiment of the present invention. As shown in FIG. 16, the image decoding apparatus 1800 includes:
  • the information acquisition unit 1601 obtains prediction mode information of the prediction unit and residual information of the plurality of sub-prediction units of the prediction unit from the bit stream.
  • the image reconstruction unit 1602 calculates a reconstructed image of the sub-prediction unit based on a prediction mode of the prediction unit and residual information of the plurality of sub-prediction units, respectively.
  • FIG. 17 is a schematic diagram of an image reconstruction unit according to an embodiment of the present invention. As shown in FIG. 17, the image reconstruction unit 1602 may include:
  • a predicted image calculation section 1701 that calculates, for each of the sub-prediction units, a predicted image of the sub-prediction unit
  • a decoding operation unit 1702 that performs a decoding operation on the residual information of the sub-prediction unit
  • the reconstructed image calculation unit 1703 calculates a reconstructed image of the sub-prediction unit based on the result of the decoding operation and the predicted image.
  • the information acquiring unit 1601 may be further configured to: obtain, from the bitstream, indication information indicating whether the prediction unit is divided into multiple sub-prediction units.
  • the prediction image calculation unit 1701 may be further configured to: calculate a prediction image of the prediction unit; the decoding operation unit 1702 may further be configured to: Decoding the residual information of the prediction unit; the reconstructed image calculation unit 1703 is further configured to: calculate a reconstructed image of the prediction unit based on a result of the decoding operation and the predicted image.
  • the image decoding device may also include other components or modules, and the specific content of these components or modules may refer to the prior art.
  • Embodiments of the present invention provide an image processing apparatus including an encoder and/or a decoder.
  • the encoder comprises the image encoding device as described in embodiment 3; and the decoder comprises the image decoding device as described in embodiment 4.
  • An embodiment of the present invention further provides an encoder.
  • Figure 18 is a schematic diagram of an encoder in accordance with an embodiment of the present invention.
  • the encoder 1800 can include a central processing unit (CPU) 100 and a memory 110; the memory 110 is coupled to the central processing unit 100.
  • the memory 110 can store various data; in addition, a program for information processing is stored, and the program is executed under the control of the central processing unit 100.
  • the functionality of image encoding device 1400 or 1500 can be integrated into central processor 100.
  • the central processing unit 100 can be configured to implement the image encoding method as described in Embodiment 1.
  • the image encoding device 1400 or 1500 may be configured separately from the central processing unit 100.
  • the image encoding device 1400 or 1500 may be configured as a chip connected to the central processing unit 100 by the control of the central processing unit 100. The function of the image encoding device 1400 or 1500 is implemented.
  • the central processing unit 100 may be configured to perform control of: determining a prediction mode of the prediction unit; separately calculating residual information of the plurality of sub-prediction units of the prediction unit; and predicting mode information and the prediction unit
  • the residual information of the plurality of sub-prediction units is programmed into the bit stream.
  • the encoder 1800 may further include: an input/output (I/O) device 120, a display 130, and the like; wherein the functions of the above components are similar to those of the prior art, and are not described herein again. It should be noted that the encoder 1800 does not have to include all of the components shown in FIG. 18; in addition, the encoder 1800 may also include components not shown in FIG. 18, and reference may be made to the prior art.
  • I/O input/output
  • the embodiment of the present invention further provides a decoder, and the decoder may be configured as shown in FIG. 18.
  • the central processing unit 100 may be configured to perform control of: obtaining prediction mode information of a prediction unit from a bitstream and residual information of a plurality of sub-prediction units of the prediction unit; and prediction mode according to the prediction unit And residual information of the plurality of sub-prediction units respectively calculating a reconstructed image of the sub-prediction unit.
  • Embodiments of the present invention provide a computer readable program, when in an image encoding device or an image processing device When the program is executed, the program causes the image encoding device or the image processing device to execute the image encoding method as described in Embodiment 1.
  • An embodiment of the present invention provides a storage medium storing a computer readable program, wherein the computer readable program causes an image encoding device or an image processing device to perform the image encoding method as described in Embodiment 1.
  • An embodiment of the present invention provides a computer readable program, wherein when the program is executed in an image decoding device or an image processing device, the program causes the image decoding device or the image processing device to perform the method as described in Embodiment 2 Image decoding method.
  • An embodiment of the present invention provides a storage medium storing a computer readable program, wherein the computer readable program causes an image decoding device or an image processing device to perform the image decoding method as described in Embodiment 2.
  • the above apparatus and method of the present invention may be implemented by hardware or by hardware in combination with software.
  • the present invention relates to a computer readable program that, when executed by a logic component, enables the logic component to implement the apparatus or components described above, or to cause the logic component to implement the various methods described above Or steps.
  • the present invention also relates to a storage medium for storing the above program, such as a hard disk, a magnetic disk, an optical disk, a DVD, a flash memory, or the like.
  • the method/apparatus described in connection with the embodiments of the invention may be embodied directly in hardware, a software module executed by a processor, or a combination of both.
  • one or more of the functional block diagrams shown in FIG. 14 and/or one or more combinations of functional block diagrams may correspond to various software of a computer program flow.
  • Modules can also correspond to individual hardware modules.
  • These software modules may correspond to the respective steps shown in FIG. 5, respectively.
  • These hardware modules can be implemented, for example, by curing these software modules using a Field Programmable Gate Array (FPGA).
  • FPGA Field Programmable Gate Array
  • the software module can reside in RAM memory, flash memory, ROM memory, EPROM memory, EEPROM memory, registers, hard disk, removable disk, CD-ROM, or any other form of storage medium known in the art.
  • a storage medium can be coupled to the processor to enable the processor to read information from, and write information to, the storage medium; or the storage medium can be an integral part of the processor.
  • the processor and the storage medium can be located in an ASIC.
  • the software module can be stored in the memory of the mobile terminal or in a memory card that can be inserted into the mobile terminal.
  • the software module can be stored in the MEGA-SIM card or a large-capacity flash memory device.
  • a general purpose processor, digital signal processor (DSP), application specific integrated circuit (ASIC), field programmable gate array (FPGA) or other programmable logic device, discrete gate or transistor for performing the functions described herein can be implemented.
  • One or more of the functional blocks described with respect to the figures and/or one or more combinations of functional blocks may also be implemented as a combination of computing devices, eg, a combination of a DSP and a microprocessor, multiple microprocessors One or more microprocessors in conjunction with DSP communication or any other such configuration.
  • An image encoding method for encoding a plurality of sub-prediction units of a prediction unit by using an intra prediction method comprising:
  • the prediction mode information of the prediction unit and the residual information of the plurality of sub-prediction units are encoded into a bitstream.
  • the image encoding method according to supplementary note 1, wherein the size of the sub-prediction unit is predetermined.
  • the image encoding method wherein the size information of the sub-prediction unit is included in the sequence parameter set, or included in the image parameter set, or is a predetermined value.
  • calculating the residual information of the plurality of sub-prediction units of the prediction unit respectively includes:
  • the residual information of the sub-prediction unit is calculated based on the original image and the predicted image.
  • the image encoding method further comprises:
  • a reconstructed image of the sub-prediction unit is calculated based on a result of the decoding operation and the predicted image.
  • the image encoding method according to the supplementary note 1, wherein the image encoding method further comprises:
  • the indication information indicating whether the prediction unit is divided into a plurality of sub-prediction units is programmed into the bit stream.
  • the image encoding method according to supplementary note 7, wherein the indication information is a 1-bit identifier.
  • the image encoding method wherein the granularity of the indication information is a prediction unit level, or a coding unit level, or a slice level, or an image level, or a sequence level.
  • Supplementary note 10 is an image decoding method for decoding a plurality of sub-prediction units of a prediction unit by using an intra prediction method, where the image decoding method includes:
  • calculating the reconstructed image of the sub-prediction unit according to the prediction mode of the prediction unit and the residual information of the plurality of sub-prediction units respectively includes:
  • a reconstructed image of the sub-prediction unit is calculated based on a result of the decoding operation and the predicted image.
  • the image decoding method according to supplementary note 10, wherein the size of the sub-prediction unit is predetermined.
  • the image decoding method wherein the size information of the sub-prediction unit is included in the sequence parameter set, or included in the image parameter set, or is a predetermined value.
  • the indication information for indicating whether the prediction unit is divided into a plurality of sub prediction units is obtained from the bit stream.
  • the image decoding method according to supplementary note 15, wherein the indication information is a 1-bit identifier.
  • the image decoding method according to the supplementary note 15, wherein the granularity of the indication information is a prediction unit level, or a coding unit level, or a slice level, or an image level, or a sequence level.
  • a reconstructed image of the prediction unit is calculated according to a prediction mode of the prediction unit and residual information.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Compression Or Coding Systems Of Tv Signals (AREA)

Abstract

一种图像编码/解码方法、装置以及图像处理设备，使用帧内预测方式对预测单元的多个子预测单元进行编码/解码。所述图像编码方法包括：确定所述预测单元的预测模式；分别计算所述预测单元的多个子预测单元的残差信息；以及将所述预测单元的预测模式信息以及所述多个子预测单元的残差信息编入比特流中。由此，在不增加过多编码代价的情况下，可以提供更准确的帧内预测结果。

Description

图像编码/解码方法、装置以及图像处理设备 技术领域
本发明涉及图形图像技术领域，特别涉及一种图像编码/解码方法、装置以及图像处理设备。
背景技术
在视频编码(也可称为图像编码)标准(例如MPEG 2，H.264/AVC，H.265/HEVC)中，帧内编码(Intra coding，后文也可称为帧内预测编码)使用重建的相邻像素来预测当前的待编码块；该待编码块可以称为预测单元(PU，Prediction Unit)。
图1是帧内预测方式的一示意图，如图1所示，待编码块(PU)可以由重建的相邻像素来预测。其中，编码单元(CU，Coding Unit)可以被一个PU所预测，也可以被多个PU所预测。
图2是CU和PU之间关系的一示意图，如图2所示，一个CU可以被一个或四个PU所预测；其中每个PU具有自己的预测模式(Prediction Mode)。在使用帧内编码方式时，编码端先确定预测单元的预测模式以及残差信息(Residual Information)，然后将这些信息编入比特流(也可称为码流)中；解码端从比特流中获得预测单元的预测模式信息以及残差信息，根据这些信息重建图像。
应该注意，上面对技术背景的介绍只是为了方便对本发明的技术方案进行清楚、完整的说明，并方便本领域技术人员的理解而阐述的。不能仅仅因为这些方案在本发明的背景技术部分进行了阐述而认为上述技术方案为本领域技术人员所公知。
发明内容
但是，发明人发现：目前的方案以预测单元为粒度进行帧内预测，如果预测单元较大则会导致预测结果不准确，如果预测单元较小则需要向比特流编入更多的预测模式信息和残差信息，导致编码代价(或称为比特代价)变大。
本发明实施例提供一种图像编码/解码方法、装置以及图像处理设备，期待在不增加过多编码代价的情况下提供更准确的帧内预测结果。
根据本发明实施例的第一个方面，提供一种图像编码方法，使用帧内预测方式对 预测单元的多个子预测单元进行编码，所述图像编码方法包括：
确定所述预测单元的预测模式；
分别计算所述预测单元的多个子预测单元的残差信息；以及
将所述预测单元的预测模式信息以及所述多个子预测单元的残差信息编入比特流中。
根据本发明实施例的第二个方面，提供一种图像编码装置，使用帧内预测方式对预测单元的多个子预测单元进行编码，所述图像编码装置包括：
模式确定部，其确定所述预测单元的预测模式；
信息计算部，其分别计算所述预测单元的多个子预测单元的残差信息；以及
比特流编码部，其将所述预测单元的预测模式信息以及所述多个子预测单元的残差信息编入比特流中。
根据本发明实施例的第三个方面，提供一种图像解码方法，使用帧内预测方式对预测单元的多个子预测单元进行解码，所述图像解码方法包括：
从比特流中获得预测单元的预测模式信息和所述预测单元的多个子预测单元的残差信息；
根据所述预测单元的预测模式以及所述多个子预测单元的残差信息分别计算所述子预测单元的重建图像。
根据本发明实施例的第四个方面，提供一种图像解码装置，使用帧内预测方式对预测单元的多个子预测单元进行解码，所述图像解码装置包括：
信息获取部，其从比特流中获得预测单元的预测模式信息和所述预测单元的多个子预测单元的残差信息；
图像重建部，其根据所述预测单元的预测模式以及所述多个子预测单元的残差信息分别计算所述子预测单元的重建图像。
根据本发明实施例的第五个方面，提供一种图像处理设备，其中，所述图像处理设备包括：
编码器，包括如前所述的图像编码装置；和/或
解码器，包括如前所述的图像解码装置。
根据本发明实施例的又一个方面，提供一种计算机可读程序，其中当在图像编码装置或者图像处理设备中执行所述程序时，所述程序使得所述图像编码装置或者图像 处理设备执行如上所述的图像编码方法。
根据本发明实施例的又一个方面，提供一种存储有计算机可读程序的存储介质，其中所述计算机可读程序使得图像编码装置或者图像处理设备执行如上所述的图像编码方法。
本发明实施例提供一种计算机可读程序，其中当在图像解码装置或图像处理设备中执行所述程序时，所述程序使得所述图像解码装置或图像处理设备执行如上所述的图像解码方法。
本发明实施例提供一种存储有计算机可读程序的存储介质，其中所述计算机可读程序使得图像解码装置或图像处理设备执行如上所述的图像解码方法。
本发明实施例的有益效果在于：确定预测单元的预测模式并分别计算所述预测单元的多个子预测单元的残差信息；以及将所述预测单元的预测模式信息以及所述多个子预测单元的残差信息编入比特流中。由此，在不增加过多编码代价的情况下，可以提供更准确的帧内预测结果。
参照后文的说明和附图，详细公开了本发明的特定实施方式，指明了本发明的原理可以被采用的方式。应该理解，本发明的实施方式在范围上并不因而受到限制。在所附权利要求的精神和条款的范围内，本发明的实施方式包括许多改变、修改和等同。
针对一种实施方式描述和/或示出的特征可以以相同或类似的方式在一个或更多个其它实施方式中使用，与其它实施方式中的特征相组合，或替代其它实施方式中的特征。
应该强调，术语“包括/包含”在本文使用时指特征、整件、步骤或组件的存在，但并不排除一个或更多个其它特征、整件、步骤或组件的存在或附加。
附图说明
参照以下的附图可以更好地理解本发明的很多方面。附图中的部件不是成比例绘制的，而只是为了示出本发明的原理。为了便于示出和描述本发明的一些部分，附图中对应部分可能被放大或缩小。
在本发明的一个附图或一种实施方式中描述的元素和特征可以与一个或更多个其它附图或实施方式中示出的元素和特征相结合。此外，在附图中，类似的标号表示几个附图中对应的部件，并可用于指示多于一种实施方式中使用的对应部件。
图1是帧内预测方式的一示意图；
图2是CU和PU之间关系的一示意图；
图3是使用帧内预测方式进行编码的一示意图；
图4是使用帧内预测方式进行解码的一示意图；
图5是本发明实施例1的图像编码方法的一示意图；
图6是本发明实施例1的PU和sub-PU关系的一示意图；
图7是本发明实施例1的图像编码方法的另一示意图；
图8是本发明实施例1的光栅扫描方式的一示意图；
图9是本发明实施例1的Z型扫描方式的一示意图；
图10是本发明实施例1的图像编码方法的另一示意图；
图11是本发明实施例2的图像解码方法的一示意图；
图12是本发明实施例2的图像解码方法的另一示意图；
图13是本发明实施例2的图像解码方法的另一示意图；
图14是本发明实施例3的图像编码装置的一示意图；
图15是本发明实施例3的图像编码装置的另一示意图；
图16是本发明实施例4的图像解码装置的一示意图；
图17是本发明实施例4的图像重建部的一示意图；
图18是本发明实施例5的编码器或者解码器的一示意图。
具体实施方式
参照附图，通过下面的说明书，本发明的前述以及其它特征将变得明显。在说明书和附图中，具体公开了本发明的特定实施方式，其表明了其中可以采用本发明的原则的部分实施方式，应了解的是，本发明不限于所描述的实施方式，相反，本发明包括落入所附权利要求的范围内的全部修改、变型以及等同物。
图3是使用帧内预测方式进行编码的一示意图，示出了编码端针对一个PU的情况。如图3所示，对于每一PU可以先确定该PU的预测模式，然后计算预测图像(Prediction image)。基于原始图像和预测图像可以计算残差信息。
如图3所示，编码端还可以对残差信息进行编码运算，例如进行变换(Transform)和量化(Quantilization)等运算；然后可对编码运算后的残差信息进行解码运算，例 如进行反量化(IQ，Inverse Quantilization)和反变换(IT，Inverse Transform)等运算，得到解码运算后的结果dec_resi；然后基于该dec_resi以及预测图像计算重建图像(Reconstructed image)；可以将该重建图像保存起来用于后续的编码。
如图3所示，编码端可以将预测模式信息和残差信息编入比特流中。
图4是使用帧内预测方式进行解码的一示意图，示出了解码端针对一个PU的情况。如图4所示，解码端可以从比特流中获得每一PU的预测模式信息以及残差信息，然后可以计算出预测图像。
如图4所示，解码端可对残差信息进行解码，例如进行反量化(IQ)和反变换(IT)等运算，得到解码运算后的结果dec_resi；然后基于该dec_resi以及预测图像计算重建图像；可以将该重建图像保存起来用于后续的解码。
值得注意的是，以上仅示意性说明了编码端和解码端使用帧内预测方式进行编码和解码的情况，但本发明不限于此；例如预测模式信息还可以在确定之后就编入比特流，等等；可以根据实际情况确定具体的实施方式。此外，关于预测模式和残差信息的具体内容，以及具体如何计算残差信息等，可以参考现有标准，本发明不再赘述。
以上的方案以预测单元为粒度进行帧内预测，如果预测单元的较大则会导致预测结果不准确，如果预测单元的较小则需要向比特流编入更多的预测模式信息和残差信息，导致编码代价变大。以下对本发明实施例进行详细说明。
实施例1
本发明实施例提供一种图像编码方法，使用帧内预测方式对预测单元(PU)的多个子预测单元(sub-PU)进行编码。
图5是本发明实施例的图像编码方法的一示意图，从编码端针对一个预测单元进行说明。如图5所示，所述图像编码方法包括：
步骤501，确定预测单元的预测模式；
步骤502，分别计算所述预测单元的多个子预测单元的残差信息；以及
步骤503，将所述预测单元的预测模式信息以及所述多个子预测单元的残差信息编入比特流中。
在本实施例中，子预测单元的大小可以被预先确定。例如，无论PU的形状是正方形还是长方形，还是其他形状，sub-PU可以一直是正方形并具有预先定义的大小。 其中，子预测单元的大小信息可以被包含在序列参数集(SPS，Sequence Parameter Set)中，或者被包含在图像参数集(PPS，Picture Parameter Set)中，或者为预先确定值(例如为一个默认值)。
图6是本发明实施例的PU和sub-PU关系的一示意图，示出了几个示例。如图6所示，例如PU和sub-PU可以均为正方形，一个PU可以被划分为16个sub-PU。或者，例如PU为长度小于宽度的矩形，而sub-PU为正方形，一个PU可以被划分为8个sub-PU。或者，例如PU为长度大于宽度的矩形，而sub-PU为正方形，一个PU可以被划分为8个sub-PU。
如图6所示，sub-PU的大小和形状可以是固定的，例如可以是4*4(像素*像素)或者8*8。值得注意的是，图6仅示意性示出了PU和sub-PU的关系，但本发明不限于此，可以根据实际情况确定具体的划分方式。
在本实施例中，一个预测单元的多个子预测单元对应相同的预测模式。即，同一预测单元的多个子预测单元共享同一帧内预测模式。由此，不必要对每个子预测单元的预测模式信息进行比特流编码，不会过多地增加编码的比特流代价。此外，由于将预测单元划分为更细的预测块，可以提高帧内预测的准确性。
图7是本发明实施例的图像编码方法的另一示意图，从编码端针对一个预测单元进行说明。如图7所示，所述图像编码方法包括：
步骤701，确定预测单元的预测模式；
步骤702，选择所述预测单元的一个子预测单元；
步骤703，计算所述子预测单元的预测图像；
其中预测图像可以表示为prediction。
步骤704，基于原始图像以及所述预测图像计算所述子预测单元的残差信息。
即，resi＝original–prediction；其中resi表示该子预测单元的残差信息，original表示原始图像；关于具体如何计算残差信息可以参考相关技术。
步骤705，对所述残差信息进行编码运算；
例如可以对该resi进行变换(Transform)和量化(Quantilization)等运算，但本发明不限于此，还可以是其他的编码运算；关于具体如何进行编码运算可以参考相关技术。
步骤706，对编码运算后的残差信息进行解码运算；
例如，可以对编码运算后的残差信息进行反量化(IQ，Inverse Quantilization)和反变换(IT，Inverse Transform)等运算，可以获得解码后的结果dec_resi。但本发明不限于此，还可以是其他的解码运算；关于具体如何进行解码运算可以参考相关技术。
在本实施例中，由于编码运算和解码运算是有损运算，在进行上述步骤705和步骤706后可以获得不同于初始resi的结果。
步骤707，基于解码运算的结果以及预测图像计算所述子预测单元的重建图像。
例如，reco＝dec_resi+prediction；其中reco表示该子预测单元的重建图像。
步骤708，存储该重建图像；
在本实施例中，可以将该重建图像用于后续的编码。
步骤709，确定是否还有其他子预测单元；如果还有其他的子预测单元，则执行步骤702，继续下一子预测单元的处理；如果没有其他的子预测单元则可以执行步骤710。
步骤710，将所述预测单元的预测模式信息以及所述多个子预测单元的残差信息编入比特流中。其中，所述预测单元的预测模式信息可以从步骤701获得，所述多个子预测单元的残差信息可以从步骤705获得。
值得注意的是，附图7仅示意性地对本发明实施例进行了说明，但本发明不限于此。例如可以适当地调整各个步骤之间的执行顺序，此外还可以增加其他的一些步骤或者减少其中的某些步骤。本领域的技术人员可以根据上述内容进行适当地变型，而不仅限于上述附图的记载。
例如，可以在对整个预测单元的处理完成后再进行比特流编码；也可以在确定所述预测单元的预测模式信息或者所述多个子预测单元的残差信息之后，立即进行比特流编码；可以根据实际情况确定比特流编码的时机。
在本实施例中，对于预测单元中各子预测单元的处理顺序，例如可以采用光栅扫描(raster scan)方式，或者Z型方式；但本发明不限于此。
图8是本发明实施例的光栅扫描方式的一示意图，示出了几种光栅扫描方式的示例；图9是本发明实施例的Z型扫描方式的一示意图，示出了几种Z型扫描方式的示例。
在本实施例中，还可以对预测单元是否被划分为多个子预测单元进行指示。可以将指示预测单元是否被划分为多个子预测单元的指示信息编入比特流中；由此可以自 适应地以预测单元为粒度进行帧内预测，或者以子预测单元为粒度进行帧内预测。
在本实施例中，该指示信息例如可以为1比特标识，以下以intra_sub_pu_flag为例进行说明；其中intra_sub_pu_flag＝0表示预测单元没有被划分为多个子预测单元，即以预测单元为粒度进行帧内预测；intra_sub_pu_flag＝1表示预测单元被划分为多个子预测单元，即以子预测单元为粒度进行帧内预测。
在本实施例中，所述指示信息的粒度可以为预测单元(PU)级别，或者为编码单元(CU)级别，或者为切片(Slice)级别，或者为图像(Picture)级别，或者为序列(Sequence)级别；但本发明不限于此。
图10是本发明实施例的图像编码方法的另一示意图，从编码端针对一个预测单元进行说明；图10示意性示出了指示信息的粒度自适应地使用预测单元(PU)级别或者子预测单元(sub-PU)级别的情况。如图10所示，所述图像编码方法包括：
步骤1001，确定以预测单元为粒度(即不划分子预测单元)时的预测模式(例如用best_mode_no_split表示)并计算相应的代价(例如用best_cost_no_split表示)；
步骤1002，确定以子预测单元为粒度(即划分子预测单元)时的预测模式(例如用best_mode_split表示)并计算相应的代价(例如用best_cost_split表示)；
在本实施例中，关于具体如何确定预测模式以及具体如何计算代价，可以参考相关技术。
步骤1003，确定best_cost_split是否小于best_cost_no_split；如果是则执行步骤1004，否则执行步骤1014。
在本实施例中，步骤1004至步骤1013示出了划分子预测单元的情况。
步骤1004，将intra_sub_pu_flag置为1，并使用best_cost_split作为帧内预测模式。
步骤1005，选择所述预测单元的一个子预测单元；
步骤1006，计算所述子预测单元的预测图像；
其中预测图像可以表示为prediction。
步骤1007，基于原始图像以及所述预测图像计算所述子预测单元的残差信息。
即，resi＝original–prediction；其中resi表示该子预测单元的残差信息，original表示原始图像；关于具体如何计算残差信息可以参考相关技术。
步骤1008，对所述残差信息进行编码运算；
例如可以对该resi进行变换(Transform)和量化(Quantilization)等运算，但本发明不限于此，还可以是其他的编码运算；关于具体如何进行编码运算可以参考相关技术。
步骤1009，对编码运算后的所述残差信息进行解码运算；
例如，可以对编码运算后的残差信息进行反量化(IQ，Inverse Quantilization)和反变换(IT，Inverse Transform)等运算，可以获得解码后的结果dec_resi。但本发明不限于此，还可以是其他的解码运算；关于具体如何进行解码运算可以参考相关技术。
步骤1010，基于解码运算的结果以及所述预测图像计算所述子预测单元的重建图像。
例如，reco＝dec_resi+prediction；其中reco表示该子预测单元的重建图像。
步骤1011，存储该重建图像；
在本实施例中，可以将该重建图像用于后续的编码。
步骤1012，确定是否还有其他子预测单元；如果还有其他的子预测单元，则执行步骤1005，继续下一子预测单元的处理；如果没有其他的子预测单元则可以执行步骤1013。
步骤1013，将所述预测单元的预测模式信息、指示信息(即intra_sub_pu_flag)以及所述多个子预测单元的残差信息编入比特流中。
在本实施例中，步骤1014至步骤1021示出了不划分子预测单元的情况。
步骤1014，将intra_sub_pu_flag置为0，并使用best_cost_no_split作为帧内预测模式。
步骤1015，计算所述预测单元的预测图像；
其中预测图像可以表示为prediction。
步骤1016，基于原始图像以及所述预测图像计算所述预测单元的残差信息。
即，resi＝original–prediction；其中resi表示该预测单元的残差信息，original表示原始图像；关于具体如何计算残差信息可以参考相关技术。
步骤1017，对所述残差信息进行编码运算；
例如可以对该resi进行变换(Transform)和量化(Quantilization)等运算，但本发明不限于此，还可以是其他的编码运算；关于具体如何进行编码运算可以参考相关技术。
步骤1018，对编码运算后的所述残差信息进行解码运算；
例如，可以对编码运算后的残差信息进行反量化(IQ，Inverse Quantilization)和反变换(IT，Inverse Transform)等运算，但本发明不限于此，还可以是其他的解码运算；关于具体如何进行解码运算可以参考相关技术。
步骤1019，基于解码运算的结果以及预测图像计算所述预测单元的重建图像。
例如，reco＝dec_resi+prediction；其中reco表示该预测单元的重建图像。
步骤1020，存储该重建图像；
在本实施例中，可以将该重建图像用于后续的编码。
步骤1021，将所述预测单元的预测模式信息、指示信息(即intra_sub_pu_flag)以及残差信息编入比特流中。
值得注意的是，附图10仅示意性地对本发明实施例进行了说明，但本发明不限于此。例如可以适当地调整各个步骤之间的执行顺序，此外还可以增加其他的一些步骤或者减少其中的某些步骤。本领域的技术人员可以根据上述内容进行适当地变型，而不仅限于上述附图的记载。
此外，以上仅以一个预测单元为例对本发明进行了示意性说明，对于多个预测单元可以分别使用上述步骤进行编码。以上仅对与本发明相关的各步骤或过程进行了说明，但本发明不限于此。图像编码方法还可以包括其他步骤或者过程，关于这些步骤或者过程的具体内容，可以参考现有技术。
由上述实施例可知，确定预测单元的预测模式并分别计算所述预测单元的多个子预测单元的残差信息；以及将所述预测单元的预测模式信息以及所述多个子预测单元的残差信息编入比特流中。由此，在不增加过多编码代价的情况下，可以提供更准确的帧内预测结果。
实施例2
本发明实施例提供一种图像解码方法，使用帧内预测方式对预测单元(PU)的多个子预测单元(sub-PU)进行解码。本实施例2对应于实施例1的图像编码方法，与实施例1相同的内容不再赘述。
图11是本发明实施例的图像解码方法的一示意图，从解码端针对一个预测单元进行说明。如图11所示，所述图像解码方法包括：
步骤1101，从比特流中获得预测单元的预测模式信息和所述预测单元的多个子预测单元的残差信息。
步骤1102，根据所述预测单元的预测模式以及所述多个子预测单元的残差信息分别计算所述子预测单元的重建图像。
图12是本发明实施例的图像解码方法的另一示意图，从解码端针对一个预测单元进行说明。如图12所示，所述图像解码方法包括：
步骤1201，从比特流中获得预测单元的预测模式信息和所述预测单元的多个子预测单元的残差信息。
如图12所示，所述图像解码方法还可以包括：
步骤1202，选择所述预测单元的一个子预测单元；
步骤1203，计算所述子预测单元的预测图像；
其中预测图像可以表示为prediction。
步骤1204，对所述子预测单元的残差信息进行解码运算；
例如，可以对残差信息进行反量化(IQ，Inverse Quantilization)和反变换(IT，Inverse Transform)等运算，可以获得解码后的结果dec_resi。但本发明不限于此，还可以是其他的解码运算；关于具体如何进行解码运算可以参考相关技术。
步骤1205，基于解码运算的结果以及预测图像计算所述子预测单元的重建图像。
例如，reco＝dec_resi+prediction；其中reco表示该子预测单元的重建图像。
步骤1206，存储该重建图像；
在本实施例中，可以将该重建图像用于后续的解码。
步骤1207，确定是否还有其他子预测单元；如果还有其他的子预测单元，则执行步骤1202，继续下一子预测单元的处理；如果没有其他的子预测单元则可以完成本预测单元的处理。
在本实施例中，还可以对预测单元是否被划分为多个子预测单元进行指示。可以将指示预测单元是否被划分为多个子预测单元的指示信息编入比特流中；由此可以自适应地以预测单元为粒度进行帧内预测，或者以子预测单元为粒度进行帧内预测。
图13是本发明实施例的图像解码方法的另一示意图，，从解码端针对一个预测单元进行说明。如图13所示，所述图像解码方法包括：
步骤1301，从比特流中获得预测模式信息和残差信息，以及指示是否划分子预 测单元的指示信息(例如用intra_sub_pu_flag表示)。
步骤1302，确定intra_sub_pu_flag是否等于1；在是的情况下执行步骤1303，否则执行步骤1309；
在本实施例中，以intra_sub_pu_flag为例进行说明；其中intra_sub_pu_flag＝0表示预测单元没有被划分为多个子预测单元，即以预测单元为粒度进行帧内预测；intra_sub_pu_flag＝1表示预测单元被划分为多个子预测单元，即以子预测单元为粒度进行帧内预测。
在本实施例中，步骤1303至步骤1308示出了划分子预测单元的情况。
步骤1303，选择所述预测单元的一个子预测单元；
步骤1304，计算所述子预测单元的预测图像；
其中预测图像可以表示为prediction。
步骤1305，对所述子预测单元的残差信息进行解码运算；
例如，可以对残差信息进行反量化(IQ，Inverse Quantilization)和反变换(IT，Inverse Transform)等运算，可以获得解码后的结果dec_resi。但本发明不限于此，还可以是其他的解码运算；关于具体如何进行解码运算可以参考相关技术。
步骤1306，基于解码运算的结果以及预测图像计算所述子预测单元的重建图像。
例如，reco＝dec_resi+prediction；其中reco表示该子预测单元的重建图像。
步骤1307，存储该重建图像；
在本实施例中，可以将该重建图像用于后续的解码。
步骤1308，确定是否还有其他子预测单元；如果还有其他的子预测单元，则执行步骤1303，继续下一子预测单元的处理；如果没有其他的子预测单元则可以完成本预测单元的处理。
在本实施例中，步骤1309至步骤1312示出了不划分子预测单元的情况。
步骤1309，计算所述预测单元的预测图像；
其中预测图像可以表示为prediction。
步骤1310，对所述预测单元的所述残差信息进行解码运算；
例如，可以残差信息进行反量化(IQ，Inverse Quantilization)和反变换(IT，Inverse Transform)等运算，但本发明不限于此，还可以是其他的解码运算；关于具体如何进行解码运算可以参考相关技术。
步骤1311，基于解码运算的结果以及预测图像计算所述预测单元的重建图像。
例如，reco＝dec_resi+prediction；其中reco表示该预测单元的重建图像。
步骤1312，存储该重建图像；
在本实施例中，可以将该重建图像用于后续的解码。
值得注意的是，附图13仅示意性地对本发明实施例进行了说明，但本发明不限于此。例如可以适当地调整各个步骤之间的执行顺序，此外还可以增加其他的一些步骤或者减少其中的某些步骤。本领域的技术人员可以根据上述内容进行适当地变型，而不仅限于上述附图的记载。
此外，以上仅以一个预测单元为例对本发明进行了示意性说明，对于多个预测单元可以分别使用上述步骤进行解码。以上仅对与本发明相关的各步骤或过程进行了说明，但本发明不限于此。图像解码方法还可以包括其他步骤或者过程，关于这些步骤或者过程的具体内容，可以参考现有技术。
由上述实施例可知，确定预测单元的预测模式并分别计算所述预测单元的多个子预测单元的残差信息；以及将所述预测单元的预测模式信息以及所述多个子预测单元的残差信息编入比特流中。由此，在不增加过多编码代价的情况下，可以提供更准确的帧内预测结果。
实施例3
本发明实施例提供一种图像编码装置，使用帧内预测方式对预测单元的多个子预测单元进行编码。本发明实施例对应于实施例1的图像编码方法，相同的内容不再赘述。
图14是本发明实施例的图像编码装置的一示意图，如图14所示，图像编码装置1400包括：
模式确定部1401，其确定所述预测单元的预测模式；
信息计算部1402，其分别计算所述预测单元的多个子预测单元的残差信息；以及
比特流编码部1403，其将所述预测单元的预测模式信息以及所述多个子预测单元的残差信息编入比特流中。
在本实施例中，所述子预测单元的大小可以被预先确定。子预测单元的大小信息 可以被包含在序列参数集，或者可以被包含在图像参数集，或者可以为预先确定值；但本发明不限于此。
在本实施例中，所述预测单元的多个子预测单元对应相同的预测模式。
图15是本发明实施例的图像编码装置的另一示意图，如图15所示，图像编码装置1500包括：模式确定部1401，信息计算部1402以及比特流编码部1403，如上所述。
如图15所示，信息计算部1402可以包括：
预测图像计算部1501，其对于每个所述子预测单元，计算所述子预测单元的预测图像；
残差计算部1502，其基于原始图像以及所述预测图像计算所述子预测单元的残差信息。
如图15所示，图像编码装置1500还可以包括：
编码运算部1503，其对所述残差信息进行编码运算；
解码运算部1504，其对编码运算后的所述残差信息进行解码运算；以及
重建图像计算部1505，其基于解码运算的结果以及所述预测图像计算所述子预测单元的重建图像。
在本实施例中，比特流编码部1403还可以用于：将指示所述预测单元是否被划分为多个子预测单元的指示信息编入所述比特流中。
在本实施例中，所述指示信息可以为1比特标识，但本发明不限于此。其中，所述指示信息的粒度可以为预测单元级别，或者可以为编码单元级别，或者可以为切片级别，或者可以为图像级别，或者可以为序列级别。
值得注意的是，以上仅对与本发明相关的各部件进行了说明，但本发明不限于此。图像编码装置还可以包括其他部件或者模块，关于这些部件或者模块的具体内容，可以参考现有技术。
由上述实施例可知，确定预测单元的预测模式并分别计算所述预测单元的多个子预测单元的残差信息；以及将所述预测单元的预测模式信息以及所述多个子预测单元的残差信息编入比特流中。由此，在不增加过多编码代价的情况下，可以提供更准确的帧内预测结果。
实施例4
本发明实施例提供一种图像解码装置，使用帧内预测方式对预测单元的多个子预测单元进行解码。本发明实施例对应于实施例2的图像解码方法，相同的内容不再赘述。
图16是本发明实施例的图像解码装置的一示意图，如图16所示，图像解码装置1800包括：
信息获取部1601，其从比特流中获得预测单元的预测模式信息和所述预测单元的多个子预测单元的残差信息。
图像重建部1602，其根据所述预测单元的预测模式以及所述多个子预测单元的残差信息分别计算所述子预测单元的重建图像。
图17是本发明实施例的图像重建部的一示意图，如图17所示，图像重建部1602可以包括：
预测图像计算部1701，其对于每个所述子预测单元，计算所述子预测单元的预测图像；
解码运算部1702，其对所述子预测单元的残差信息进行解码运算；
重建图像计算部1703，其基于解码运算的结果以及所述预测图像计算所述子预测单元的重建图像。
在本实施例中，信息获取单元1601还可以用于：从所述比特流中获得指示所述预测单元是否被划分为多个子预测单元的指示信息。
在所述指示信息指示所述预测单元没有被划分为多个子预测单元的情况下，预测图像计算部1701还可以用于：计算所述预测单元的预测图像；解码运算部1702还可以用于：对所述预测单元的残差信息进行解码运算；重建图像计算部1703还可以用于：基于解码运算的结果以及所述预测图像计算所述预测单元的重建图像。
值得注意的是，以上仅对与本发明相关的各部件进行了说明，但本发明不限于此。图像解码装置还可以包括其他部件或者模块，关于这些部件或者模块的具体内容，可以参考现有技术。
由上述实施例可知，确定预测单元的预测模式并分别计算所述预测单元的多个子预测单元的残差信息；以及将所述预测单元的预测模式信息以及所述多个子预测单元的残差信息编入比特流中。由此，在不增加过多编码代价的情况下，可以提供更准确 的帧内预测结果。
实施例5
本发明实施例提供一种图像处理设备，该图像处理设备包括编码器和/或解码器。其中编码器包括如实施例3所述的图像编码装置；解码器包括如实施例4所述的图像解码装置。
本发明实施例还提供一种编码器。
图18是本发明实施例的编码器的一示意图。如图18所示，编码器1800可以包括：中央处理器(CPU)100和存储器110；存储器110耦合到中央处理器100。其中该存储器110可存储各种数据；此外还存储信息处理的程序，并且在中央处理器100的控制下执行该程序。
在一个实施方式中，图像编码装置1400或1500的功能可以被集成到中央处理器100中。其中，中央处理器100可以被配置为实现如实施例1所述的图像编码方法。
在另一个实施方式中，图像编码装置1400或1500可以与中央处理器100分开配置，例如可以将图像编码装置1400或1500配置为与中央处理器100连接的芯片，通过中央处理器100的控制来实现图像编码装置1400或1500的功能。
例如，中央处理器100可以被配置为进行如下的控制：确定预测单元的预测模式；分别计算所述预测单元的多个子预测单元的残差信息；以及将所述预测单元的预测模式信息以及所述多个子预测单元的残差信息编入比特流中。
此外，如图18所示，编码器1800还可以包括：输入输出(I/O)设备120和显示器130等；其中，上述部件的功能与现有技术类似，此处不再赘述。值得注意的是，编码器1800也并不是必须要包括图18中所示的所有部件；此外，编码器1800还可以包括图18中没有示出的部件，可以参考现有技术。
本发明实施例还提供一种解码器，该解码器的构成可以参考图18。
例如，中央处理器100可以被配置为进行如下的控制：从比特流中获得预测单元的预测模式信息和所述预测单元的多个子预测单元的残差信息；以及根据所述预测单元的预测模式以及所述多个子预测单元的残差信息分别计算所述子预测单元的重建图像。
本发明实施例提供一种计算机可读程序，其中当在图像编码装置或图像处理设备 中执行所述程序时，所述程序使得所述图像编码装置或图像处理设备执行如实施例1所述的图像编码方法。
本发明实施例提供一种存储有计算机可读程序的存储介质，其中所述计算机可读程序使得图像编码装置或图像处理设备执行如实施例1所述的图像编码方法。
本发明实施例提供一种计算机可读程序，其中当在图像解码装置或图像处理设备中执行所述程序时，所述程序使得所述图像解码装置或图像处理设备执行如实施例2所述的图像解码方法。
本发明实施例提供一种存储有计算机可读程序的存储介质，其中所述计算机可读程序使得图像解码装置或图像处理设备执行如实施例2所述的图像解码方法。
本发明以上的装置和方法可以由硬件实现，也可以由硬件结合软件实现。本发明涉及这样的计算机可读程序，当该程序被逻辑部件所执行时，能够使该逻辑部件实现上文所述的装置或构成部件，或使该逻辑部件实现上文所述的各种方法或步骤。本发明还涉及用于存储以上程序的存储介质，如硬盘、磁盘、光盘、DVD、flash存储器等。
结合本发明实施例描述的方法/装置可直接体现为硬件、由处理器执行的软件模块或二者组合。例如，图14中所示的功能框图中的一个或多个和/或功能框图的一个或多个组合(例如，模式确定部、信息计算部等)，既可以对应于计算机程序流程的各个软件模块，亦可以对应于各个硬件模块。这些软件模块，可以分别对应于图5所示的各个步骤。这些硬件模块例如可利用现场可编程门阵列(FPGA)将这些软件模块固化而实现。
软件模块可以位于RAM存储器、闪存、ROM存储器、EPROM存储器、EEPROM存储器、寄存器、硬盘、移动磁盘、CD-ROM或者本领域已知的任何其它形式的存储介质。可以将一种存储介质耦接至处理器，从而使处理器能够从该存储介质读取信息，且可向该存储介质写入信息；或者该存储介质可以是处理器的组成部分。处理器和存储介质可以位于ASIC中。该软件模块可以存储在移动终端的存储器中，也可以存储在可插入移动终端的存储卡中。例如，若设备(如移动终端)采用的是较大容量的MEGA-SIM卡或者大容量的闪存装置，则该软件模块可存储在该MEGA-SIM卡或者大容量的闪存装置中。
针对附图中描述的功能方框中的一个或多个和/或功能方框的一个或多个组合， 可以实现为用于执行本申请所描述功能的通用处理器、数字信号处理器(DSP)、专用集成电路(ASIC)、现场可编程门阵列(FPGA)或者其它可编程逻辑器件、分立门或者晶体管逻辑器件、分立硬件组件或者其任意适当组合。针对附图描述的功能方框中的一个或多个和/或功能方框的一个或多个组合，还可以实现为计算设备的组合，例如，DSP和微处理器的组合、多个微处理器、与DSP通信结合的一个或多个微处理器或者任何其它这种配置。
以上结合具体的实施方式对本发明进行了描述，但本领域技术人员应该清楚，这些描述都是示例性的，并不是对本发明保护范围的限制。本领域技术人员可以根据本发明的精神和原理对本发明做出各种变型和修改，这些变型和修改也在本发明的范围内。
关于包括以上实施例的实施方式，还公开下述的附记：
附记1、一种图像编码方法，使用帧内预测方式对预测单元的多个子预测单元进行编码，所述图像编码方法包括：
确定所述预测单元的预测模式；
分别计算所述预测单元的多个子预测单元的残差信息；以及
将所述预测单元的预测模式信息以及所述多个子预测单元的残差信息编入比特流中。
附记2、根据附记1所述的图像编码方法，其中，所述子预测单元的大小被预先确定。
附记3、根据附记2所述的图像编码方法，其中，子预测单元的大小信息被包含在序列参数集，或者被包含在图像参数集，或者为预先确定值。
附记4、根据附记1所述的图像编码方法，其中，所述预测单元的多个子预测单元对应相同的预测模式。
附记5、根据附记1所述的图像编码方法，其中，分别计算所述预测单元的多个子预测单元的残差信息，包括：
对于每个所述子预测单元，计算所述子预测单元的预测图像；
基于原始图像以及所述预测图像计算所述子预测单元的残差信息。
附记6、根据附记5所述的图像编码方法，其中，所述图像编码方法还包括：
对所述残差信息进行编码运算；
对编码运算后的所述残差信息进行解码运算；以及
基于解码运算的结果以及所述预测图像计算所述子预测单元的重建图像。
附记7、根据附记1所述的图像编码方法，其中，所述图像编码方法还包括：
将指示所述预测单元是否被划分为多个子预测单元的指示信息编入所述比特流中。
附记8、根据附记7所述的图像编码方法，其中，所述指示信息为1比特标识。
附记9、根据附记7所述的图像编码方法，其中，所述指示信息的粒度为预测单元级别，或者为编码单元级别，或者为切片级别，或者为图像级别，或者为序列级别。
附记10、一种图像解码方法，使用帧内预测方式对预测单元的多个子预测单元进行解码，所述图像解码方法包括：
从比特流中获得预测单元的预测模式信息和所述预测单元的多个子预测单元的残差信息；
根据所述预测单元的预测模式以及所述多个子预测单元的残差信息分别计算所述子预测单元的重建图像。
附记11、根据附记10所述的图像解码方法，其中，根据所述预测单元的预测模式以及所述多个子预测单元的残差信息分别计算所述子预测单元的重建图像，包括：
对于每个所述子预测单元，计算所述子预测单元的预测图像；
对所述子预测单元的残差信息进行解码运算；
基于解码运算的结果以及所述预测图像计算所述子预测单元的重建图像。
附记12、根据附记10所述的图像解码方法，其中，所述子预测单元的大小被预先确定。
附记13、根据附记12所述的图像解码方法，其中，子预测单元的大小信息被包含在序列参数集，或者被包含在图像参数集，或者为预先确定值。
附记14、根据附记10所述的图像解码方法，其中，所述预测单元的多个子预测单元对应相同的预测模式。
附记15、根据附记10所述的图像解码方法，其中，所述图像解码方法还包括：
从比特流中获得用于指示所述预测单元是否被划分为多个子预测单元的指示信息。
附记16、根据附记15所述的图像解码方法，其中，所述指示信息为1比特标识。
附记17、根据附记15所述的图像解码方法，其中，所述指示信息的粒度为预测单元级别，或者为编码单元级别，或者为切片级别，或者为图像级别，或者为序列级别。
附记18、根据附记15所述的图像解码方法，其中，所述图像解码方法还包括：
在所述指示信息指示所述预测单元没有被划分为多个子预测单元的情况下，根据所述预测单元的预测模式以及残差信息计算所述预测单元的重建图像。

Claims (19)

  1. 一种图像编码装置，使用帧内预测方式对预测单元的多个子预测单元进行编码，所述图像编码装置包括：
    模式确定部，其确定所述预测单元的预测模式；
    信息计算部，其分别计算所述预测单元的多个子预测单元的残差信息；以及
    比特流编码部，其将所述预测单元的预测模式信息以及所述多个子预测单元的残差信息编入比特流中。
  2. 根据权利要求1所述的图像编码装置，其中，所述子预测单元的大小被预先确定。
  3. 根据权利要求2所述的图像编码装置，其中，子预测单元的大小信息被包含在序列参数集，或者被包含在图像参数集，或者为预先确定值。
  4. 根据权利要求1所述的图像编码装置，其中，所述预测单元的多个子预测单元对应相同的预测模式。
  5. 根据权利要求1所述的图像编码装置，其中，所述信息计算部包括：
    预测图像计算部，其对于每个所述子预测单元，计算所述子预测单元的预测图像；
    残差计算部，其基于原始图像以及所述预测图像计算所述子预测单元的残差信息。
  6. 根据权利要求5所述的图像编码装置，其中，所述图像编码装置还包括：
    编码运算部，其对所述残差信息进行编码运算；
    解码运算部，其对编码运算后的所述残差信息进行解码运算；以及
    重建图像计算部，其基于解码运算的结果以及所述预测图像计算所述子预测单元的重建图像。
  7. 根据权利要求1所述的图像编码装置，其中，所述比特流编码部还用于：将指示所述预测单元是否被划分为多个子预测单元的指示信息编入所述比特流中。
  8. 根据权利要求7所述的图像编码装置，其中，所述指示信息为1比特标识。
  9. 根据权利要求7所述的图像编码装置，其中，所述指示信息的粒度为预测单元级别，或者为编码单元级别，或者为切片级别，或者为图像级别，或者为序列级别。
  10. 一种图像解码装置，使用帧内预测方式对预测单元的多个子预测单元进行解 码，所述图像解码装置包括：
    信息获取部，其从比特流中获得预测单元的预测模式信息和所述预测单元的多个子预测单元的残差信息；
    图像重建部，其根据所述预测单元的预测模式以及所述多个子预测单元的残差信息分别计算所述子预测单元的重建图像。
  11. 根据权利要求10所述的图像解码装置，其中，图像重建部包括：
    预测图像计算部，其对于每个所述子预测单元，计算所述子预测单元的预测图像；
    解码运算部，其对所述子预测单元的残差信息进行解码运算；
    重建图像计算部，其基于解码运算的结果以及所述预测图像计算所述子预测单元的重建图像。
  12. 根据权利要求10所述的图像解码装置，其中，所述子预测单元的大小被预先确定。
  13. 根据权利要求12所述的图像解码装置，其中，子预测单元的大小信息被包含在序列参数集，或者被包含在图像参数集，或者为预先确定值。
  14. 根据权利要求10所述的图像解码装置，其中，所述预测单元的多个子预测单元对应相同的预测模式。
  15. 根据权利要求10所述的图像解码装置，其中，所述信息获取部还用于：从比特流中获得用于指示所述预测单元是否被划分为多个子预测单元的指示信息。
  16. 根据权利要求15所述的图像解码装置，其中，所述指示信息为1比特标识。
  17. 根据权利要求15所述的图像解码装置，其中，所述指示信息的粒度为预测单元级别，或者为编码单元级别，或者为切片级别，或者为图像级别，或者为序列级别。
  18. 根据权利要求15所述的图像解码装置，其中，所述图像重建部还用于：在所述指示信息指示所述预测单元没有被划分为多个子预测单元的情况下，根据所述预测单元的预测模式以及残差信息计算所述预测单元的重建图像。
  19. 一种图像处理设备，其中，所述图像处理设备包括：
    编码器，其包括如权利要求1所述的图像编码装置；和/或
    解码器，其包括如权利要求10所述的图像解码装置。
PCT/CN2016/101990 2016-10-13 2016-10-13 图像编码/解码方法、装置以及图像处理设备 Ceased WO2018068259A1 (zh)

Priority Applications (5)

Application Number Priority Date Filing Date Title
PCT/CN2016/101990 WO2018068259A1 (zh) 2016-10-13 2016-10-13 图像编码/解码方法、装置以及图像处理设备
JP2019508207A JP2019528621A (ja) 2016-10-13 2016-10-13 画像コーディング／デコーディング方法、装置及び画像処理機器
CN201680087832.9A CN109479144A (zh) 2016-10-13 2016-10-13 图像编码/解码方法、装置以及图像处理设备
US16/262,343 US20190166373A1 (en) 2016-10-13 2019-01-30 Image encoding/decoding method and apparatus and image processing equipment
JP2021072977A JP7067655B2 (ja) 2016-10-13 2021-04-23 画像コーディング装置、画像デコーディング装置、及び画像処理機器

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2016/101990 WO2018068259A1 (zh) 2016-10-13 2016-10-13 图像编码/解码方法、装置以及图像处理设备

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US16/262,343 Continuation US20190166373A1 (en) 2016-10-13 2019-01-30 Image encoding/decoding method and apparatus and image processing equipment

Publications (1)

Publication Number Publication Date
WO2018068259A1 true WO2018068259A1 (zh) 2018-04-19

Family

ID=61905097

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2016/101990 Ceased WO2018068259A1 (zh) 2016-10-13 2016-10-13 图像编码/解码方法、装置以及图像处理设备

Country Status (4)

Country Link
US (1) US20190166373A1 (zh)
JP (2) JP2019528621A (zh)
CN (1) CN109479144A (zh)
WO (1) WO2018068259A1 (zh)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN116074500B (zh) * 2021-11-11 2024-10-25 杭州海康威视数字技术股份有限公司 图像解码方法、编码方法及装置
CN120151513A (zh) 2022-01-07 2025-06-13 杭州海康威视数字技术股份有限公司 图像编解码方法、装置及存储介质

Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102754442A (zh) * 2010-02-10 2012-10-24 Lg电子株式会社 处理视频信号的方法和装置

Family Cites Families (17)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101222641B (zh) * 2007-01-11 2011-08-24 华为技术有限公司 帧内预测编解码方法及其装置
KR101365570B1 (ko) * 2007-01-18 2014-02-21 삼성전자주식회사 인트라 예측 부호화, 복호화 방법 및 장치
KR101608426B1 (ko) * 2008-03-28 2016-04-04 삼성전자주식회사 영상의 인트라 예측 부호화/복호화 방법 및 그 장치
JP4990927B2 (ja) * 2008-03-28 2012-08-01 三星電子株式会社 動きベクトル情報の符号化／復号化方法及び装置
KR101379187B1 (ko) * 2008-06-23 2014-04-15 에스케이 텔레콤주식회사 블록 변환을 이용한 인트라 예측 방법 및 장치와 그를이용한 영상 부호화/복호화 방법 및 장치
KR101458471B1 (ko) * 2008-10-01 2014-11-10 에스케이텔레콤 주식회사 영상 부호화/복호화 방법 및 장치
KR101356448B1 (ko) * 2008-10-01 2014-02-06 한국전자통신연구원 예측 모드를 이용한 복호화 장치
KR20100095992A (ko) * 2009-02-23 2010-09-01 한국과학기술원 비디오 부호화에서의 분할 블록 부호화 방법, 비디오 복호화에서의 분할 블록 복호화 방법 및 이를 구현하는 기록매체
KR101379188B1 (ko) * 2010-05-17 2014-04-18 에스케이 텔레콤주식회사 인트라 블록 및 인터 블록이 혼합된 코딩블록을 이용하는 영상 부호화/복호화 장치 및 그 방법
JP2012205287A (ja) * 2011-03-28 2012-10-22 Jvc Kenwood Corp 画像符号化装置、画像符号化方法および画像符号化プログラム
DK3402200T3 (da) * 2011-10-24 2023-04-24 Gensquare Llc Billeddekodningsapparat
RS61146B1 (sr) * 2011-10-24 2020-12-31 Innotive Ltd Postupak i aparat za dekodiranje slike
KR20130049524A (ko) * 2011-11-04 2013-05-14 오수미 인트라 예측 블록 생성 방법
EP3886433A3 (en) * 2013-03-07 2021-10-27 Telefonaktiebolaget LM Ericsson (publ) Video transcoding
WO2015100515A1 (en) * 2013-12-30 2015-07-09 Qualcomm Incorporated Simplification of segment-wise dc coding of large prediction blocks in 3d video coding
US10070130B2 (en) * 2015-01-30 2018-09-04 Qualcomm Incorporated Flexible partitioning of prediction units
US9998739B2 (en) * 2015-03-06 2018-06-12 Qualcomm Incorporated Optimization for encoding video data using non-square partitions

Patent Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102754442A (zh) * 2010-02-10 2012-10-24 Lg电子株式会社 处理视频信号的方法和装置

Non-Patent Citations (3)

* Cited by examiner, † Cited by third party
Title
KEN MCCANN ET AL., SAMSUNG'S RESPONSE TO THE CALL FOR PROPOSALS ON VIDEO COMPRESSION TECHNOLOGY JOINT COLLABORATIVE TEAM ON VIDEO CODING (JCT-VC) OF ITU-T SG 16 WP3, 15 April 2010 (2010-04-15), DRESDEN , DE *
SANG HEON LEE ET AL.: "A New Intra Prediction Method Using Channel Correlations for the H. 264/AVC Intra Coding", PICTURE CODING SYMPOSIUM, 2009. PCS 2009, 6 May 2009 (2009-05-06), PISCATAWAY, NJ, USA, pages 1 - 4, XP031491624 *
SANG HEON LEE ET AL.: "Intra Prediction Method Based on the Linear Relationship Between the Channels for YUV 4:2:0 Intra Coding", IMAGE PROCESSING (ICIP) , 2009 16 TH IEEE INTERNATIONAL CONFERENCE ON, 7 November 2009 (2009-11-07), PISCATAWAY, NJ, USA ., pages 1037 - 1040, XP031628426, DOI: doi:10.1109/ICIP.2009.5413727 *

Also Published As

Publication number Publication date
CN109479144A (zh) 2019-03-15
US20190166373A1 (en) 2019-05-30
JP7067655B2 (ja) 2022-05-16
JP2019528621A (ja) 2019-10-10
JP2021122123A (ja) 2021-08-26

Similar Documents

Publication Publication Date Title
KR102773788B1 (ko) 비디오 데이터를 코딩하기 위한 디바이스 및 방법
CN112335241B (zh) 对视频样本的变换块编码和解码的方法、设备和系统
KR102138931B1 (ko) 이미지 예측 방법 및 장치
US11405648B2 (en) Device and method for coding video data
CN111903130A (zh) 在多参考列预测中编码视频数据的设备及方法
CN112369026A (zh) 用于基于一个或多个参考线编码视频数据的设备和方法
KR20130132613A (ko) 인코딩 방법 및 장치와, 디코딩 방법 및 장치
JP6708374B2 (ja) 画像群内で修正可能要素のセットを決定するための方法、デバイス、プログラム、及び可読媒体
CN114026871B (zh) 用于对视频数据编码的装置和方法
CN105453567A (zh) 用于非变换编码的扫描次序
CN110798683A (zh) 数据解码方法、装置和数据编码方法、装置
JP7067655B2 (ja) 画像コーディング装置、画像デコーディング装置、及び画像処理機器
US10609388B2 (en) Method and apparatus for encoding and decoding image
WO2015196929A1 (zh) 一种帧内深度图像块编码、解码的方法及装置
CN115988223A (zh) 帧内预测模式的确定、图像编码以及图像解码方法
KR20180061196A (ko) 컬러 컴포넌트의 동적 범위를 이용한 영상 처리 방법 및 그 장치
CN113473154B (zh) 视频编码、视频解码方法、装置及存储介质
WO2018068264A1 (zh) 图像编码/解码方法、装置以及图像处理设备
WO2018068263A1 (zh) 图像编码方法、装置以及图像处理设备
CN118592023A (zh) 编解码方法、码流、编码器、解码器以及存储介质
KR102412244B1 (ko) 모드 정보를 코딩 및 디코딩하기 위한 방법 및 장치, 그리고 전자 디바이스
US20200162756A1 (en) Image processing device and method, and program
US20240305771A1 (en) Device and method for decoding video data
CN117041597B (zh) 一种视频编码、解码方法、装置、电子设备及存储介质
WO2024113311A1 (zh) 编解码方法、编解码器、码流以及存储介质

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 16918703

Country of ref document: EP

Kind code of ref document: A1

ENP Entry into the national phase

Ref document number: 2019508207

Country of ref document: JP

Kind code of ref document: A

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 16918703

Country of ref document: EP

Kind code of ref document: A1