WO2015188585A1 - 图像编码方法和装置以及图像解码方法和装置 - Google Patents

图像编码方法和装置以及图像解码方法和装置 Download PDF

Info

Publication number
WO2015188585A1
WO2015188585A1 PCT/CN2014/091240 CN2014091240W WO2015188585A1 WO 2015188585 A1 WO2015188585 A1 WO 2015188585A1 CN 2014091240 W CN2014091240 W CN 2014091240W WO 2015188585 A1 WO2015188585 A1 WO 2015188585A1
Authority
WO
WIPO (PCT)
Prior art keywords
image
resolution
reference frame
frame image
same
Prior art date
Application number
PCT/CN2014/091240
Other languages
English (en)
French (fr)
Inventor
武晓阳
沈林杰
苏辉
Original Assignee
杭州海康威视数字技术股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 杭州海康威视数字技术股份有限公司 filed Critical 杭州海康威视数字技术股份有限公司
Priority to US15/317,444 priority Critical patent/US10659800B2/en
Priority to EP14894440.8A priority patent/EP3139612A4/en
Publication of WO2015188585A1 publication Critical patent/WO2015188585A1/zh

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • H04N19/503Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal prediction
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/103Selection of coding mode or of prediction mode
    • H04N19/105Selection of the reference unit for prediction within a chosen coding or prediction mode, e.g. adaptive choice of position and number of pixels used for prediction
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/134Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
    • H04N19/157Assigned coding mode, i.e. the coding mode being predefined or preselected to be further used for selection of another element or parameter
    • H04N19/159Prediction type, e.g. intra-frame, inter-frame or bidirectional frame prediction
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/169Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
    • H04N19/17Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object
    • H04N19/172Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a picture, frame or field
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • H04N19/503Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal prediction
    • H04N19/51Motion estimation or motion compensation
    • H04N19/563Motion estimation with padding, i.e. with filling of non-object values in an arbitrarily shaped picture block or region for estimation purposes
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • H04N19/59Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving spatial sub-sampling or interpolation, e.g. alteration of picture size or resolution
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • H04N19/597Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding specially adapted for multi-view video sequence encoding

Definitions

  • the present application relates to image processing technologies, and in particular, to image encoding methods and apparatus, and image decoding methods and apparatus.
  • Video compression refers to the process of converting a video sequence of one format into a video sequence of another format by a specific compression technique.
  • the existing video compression standards mainly include H.261, H.263, and the International Standards Organization (ISO) developed by the International Telecommunication Standardization Organization (ITU-T).
  • ISO International Standards Organization
  • MPEG-1 Moving Pictures Experts Group-1
  • MPEG-4 Moving Pictures Experts Group-1
  • MPEG-2/H.262 jointly developed by the two.
  • the above standards all use block-based hybrid coding framework, one of the important technologies is predictive coding.
  • each frame image in a video sequence can be classified into the following three types according to different sources of prediction data: I frame (intra prediction frame, Intra), P frame (inter prediction frame, Prediction), B frame ( Bi-Prediction, correspondingly, an image of the I frame type may be referred to as an I frame image, an image of a P frame type is referred to as a P frame image, and an image of a B frame type is referred to as a B frame.
  • I frame intra prediction frame
  • P frame inter prediction frame
  • Prediction Prediction
  • B frame Bi-Prediction
  • the previous one or more frames of image are needed as the reference frame image.
  • the reference frame image needs to be a reconstructed image, and the reconstructed image refers to the encoded image.
  • the decoded image is necessary to use the previous one or more frames and the subsequent one or more frames as the reference frame image; wherein the reference frame image needs to be a reconstructed image, and the reconstructed image refers to the encoded image.
  • FIG. 1 is a schematic diagram of a reference frame image of a conventional P frame image. As shown in FIG. 1, when it is necessary to perform predictive coding on the second P-frame image (in order from left to right), the first two frames of the image can be used as the reference frame image.
  • FIG. 2 is a schematic diagram of a reference frame image of a conventional B frame image. As shown in FIG. 2, when it is necessary to predictively encode a B frame image therein, the first two frames (forward reference frame) image and the following one frame (backward reference frame) image may be used as reference frame images.
  • intra prediction coding In practical applications, the prediction coding method corresponding to the above I frame image is generally referred to as intra prediction coding, and the prediction coding mode corresponding to the P frame image and the B frame image is referred to as inter prediction coding, and simply speaking, intraframe Predictive coding means that only the data of the current frame is used for prediction, and interframe predictive coding requires prediction of data of other frames.
  • intra-prediction coding is less efficient, which increases the code rate after coding, thereby increasing transmission and storage costs.
  • the resolution of the reference frame image and the resolution of the image x must be the same, if not, then It is considered that the video sequence is switched and processed according to the new video sequence, that is, starting with an I frame image that can be randomly cut in. That is, if the resolution of the reference frame image and the resolution of the image x are the same, then The image x is inter-predictively encoded in a normal manner, otherwise, the image x is intra-predictive encoded.
  • the resolution refers to the number of pixels in the image width and height, assuming that the resolution of the image x is 704 ⁇ 576. Then 704 refers to the number of horizontal pixels of image x, and 576 refers to the number of vertical pixels of image x.
  • FIG. 3 is a schematic diagram showing changes in resolution of each frame image in a conventional video sequence.
  • the image of the first frame is an I frame image
  • all other frame images are P frame images
  • the resolution of the fourth frame image is larger than The resolution of the third frame image
  • the resolution of the sixth frame image is smaller than the resolution of the fifth frame image, assuming that the third frame image is the reference frame image of the fourth frame image, and the fifth frame image is the sixth frame image.
  • the 4th frame image and the 6th frame image will not be able to perform interframe predictive coding, that is, only intra prediction coding can be performed, which is equivalent to the 4th frame image and
  • the 6th frame image is processed as an I frame image.
  • the present application provides an image encoding method and apparatus, which can improve encoding efficiency, and accordingly, an image decoding method and apparatus are provided.
  • An image encoding method comprising:
  • the reference frame image of the image x is determined, and the image x is a P frame image or a B frame image;
  • each reference frame image the following processing is respectively performed: determining whether the resolution of the reference frame image is the same as the resolution of the image x, and if not, adjusting the resolution of the reference frame image The whole is the same resolution as the image x;
  • the image x is inter-predictive-coded according to each reference frame image.
  • An image encoding device comprising:
  • a first processing module configured to determine a reference frame image of the image x when an interframe predictive encoding of the image x of any frame is required, and notify the second processing module that the image x is a P frame image or a B frame image;
  • the second processing module is configured to perform, for each reference frame image, a process of determining whether the resolution of the reference frame image is the same as the resolution of the image x, and if not, adjusting the resolution of the reference frame image.
  • the image is identical to the resolution of the image x; when it is determined that the resolution of each reference frame image is the same as the resolution of the image x, the image x is inter-predictively encoded according to each reference frame image.
  • An image decoding method includes:
  • the following processing is respectively performed: if it is determined that the resolution of the reference frame image is different from the resolution of the image y, the resolution of the reference frame image is adjusted to be the same as the resolution of the image y;
  • the image y is decoded according to each reference frame image.
  • An image decoding device comprising:
  • a third processing module configured to determine a reference frame image of the image y when the frame image y after the interframe prediction encoding needs to be decoded, and notify the fourth processing module;
  • the fourth processing module is configured to separately perform the following processing for each reference frame image: if it is determined that the resolution of the reference frame image is different from the resolution of the image y, the reference frame is The resolution of the image is adjusted to be the same as the resolution of the image y; when it is determined that the resolution of each reference frame image is the same as the resolution of the image y, the image y is decoded according to each reference frame image.
  • the resolution of the reference frame image may be first used. Adjusted to the same resolution as the image x, and then inter-predictively encodes the image x, thereby avoiding the problems in the prior art, correspondingly improving the coding efficiency, reducing the code rate after encoding, and further reducing Transmission and storage costs, etc.
  • FIG. 1 is a schematic diagram of a reference frame image of a conventional P frame image.
  • FIG. 2 is a schematic diagram of a reference frame image of a conventional B frame image.
  • FIG. 3 is a schematic diagram showing changes in resolution of each frame image in a conventional video sequence.
  • FIG. 4 is a flow chart of an embodiment of an image encoding method of the present application.
  • FIG. 5 is a schematic diagram of the manner in which the resolution of the reference frame image is adjusted to be the same as the resolution of the image x by image expansion according to the present application.
  • FIG. 6 is a schematic diagram of adjusting the resolution of a reference frame image to be the same as the resolution of the image x by image reduction according to the present application.
  • FIG. 7 is a schematic diagram of adjusting the resolution of a reference frame image to be the same as the resolution of the image x by image filling according to the present application.
  • FIG. 8 is a schematic diagram of adjusting the resolution of a reference frame image to be the same as the resolution of the image x by image cropping according to the present application.
  • FIG. 9 is a schematic structural diagram of an embodiment of an image encoding apparatus according to the present application.
  • FIG. 10 is a schematic structural diagram of an embodiment of an image decoding apparatus according to the present application.
  • FIG. 11 is a schematic structural diagram of another embodiment of an image encoding apparatus according to the present application.
  • FIG. 12 is a schematic structural diagram of another embodiment of an image decoding apparatus according to the present application.
  • FIG. 4 is a flow chart of an embodiment of an image encoding method of the present application. As shown in FIG. 4, the following steps 41 to 43 are included.
  • Step 41 When inter-prediction encoding is required for any frame of image x, the reference frame image of image x is determined, and image x is a P-frame image or a B-frame image.
  • image x is used to represent any frame of any video sequence.
  • the image x When it is necessary to predictively encode the image x, it may first determine its type, that is, an I frame image, or a P frame image or a B frame image. If it is an I frame image, it needs to perform intra prediction encoding, if it is a P frame. For an image or a B frame image, inter prediction encoding is required, and accordingly, a reference frame image of the image x needs to be determined.
  • Step 42 For each reference frame image, respectively perform the following processes: determining whether the resolution of the reference frame image is the same as the resolution of the image x, and if not, adjusting the resolution of the reference frame image to be resolved with the image x The rate is the same.
  • the number of reference frame images of the image x determined in step 41 may be one, or may be multiple; if it is one, the reference frame image may need to be adjusted, or may not need to be adjusted; if it is multiple , will include the following three situations:
  • each reference frame image does not need to be adjusted, that is, it is the same as the resolution of the image x;
  • each reference frame image needs to be adjusted, that is, it is different from the resolution of the image x;
  • the resolution of the reference frame image and the image x may be increased by increasing the resolution of the reference frame image.
  • the resolution is the same.
  • the resolution of the reference frame image is greater than the resolution of the image x, the resolution of the reference frame image may be adjusted such that the resolution of the reference frame image is the same as the resolution of the image x.
  • the manner of increasing the resolution of the reference frame image includes, but is not limited to, one of the following: image enlargement or image filling; and the manner of reducing the resolution of the reference frame image includes, but is not limited to, one of the following: image reduction or image Cropped.
  • FIG. 5 is a schematic diagram of the manner in which the resolution of the reference frame image is adjusted to be the same as the resolution of the image x by image expansion according to the present application.
  • the oblique line filling area therein indicates an enlarged portion, and how to perform image expansion is a prior art, such as an interpolation method or the like.
  • FIG. 6 is a schematic diagram of adjusting the resolution of a reference frame image to be the same as the resolution of the image x by image reduction according to the present application. As shown in FIG. 6, the oblique line filling area indicates the reduced portion, and how to perform image reduction is also a prior art.
  • FIG. 7 is a schematic diagram of adjusting the resolution of a reference frame image to be the same as the resolution of the image x by image filling according to the present application.
  • the oblique line filling area represents the filling part, and how to perform image filling is a prior art, such as constant filling, copy filling, mirror filling, period filling, etc., and filling data around the reference frame image. .
  • FIG. 8 is a schematic diagram of adjusting the resolution of a reference frame image to be the same as the resolution of the image x by image cropping according to the present application.
  • the slash filled area is Representing the cropping portion, that is, cropping around the image of the reference frame, how to perform image cropping is also a prior art.
  • the resolution change is caused by the object getting closer to the larger or gradually getting smaller, such as a vehicle approaching, gradually becoming larger, the resolution is also larger, and the resolution of each frame is different.
  • the vehicle that is turned on is exactly the opposite.
  • the images shown in FIGS. 5 and 6 can be used.
  • the resolution of the reference frame image is adjusted to be the same as the resolution of the image to be encoded, that is, the image x, wherein FIG. 5 corresponds to the case where the object gradually becomes larger, and FIG. 6 corresponds to the case where the object gradually becomes smaller and smaller. ;
  • the image filling method shown in FIG. 7 may be employed, and the reference frame may be adopted.
  • the resolution of the image is adjusted to be the same as the resolution of the image x;
  • the image cropping mode shown in FIG. 8 may be employed, and the reference will be made.
  • the resolution of the frame image is adjusted to be the same as the resolution of the image x.
  • each reference frame image may adopt the same adjustment mode, or may adopt different adjustment methods, depending on the actual situation.
  • Step 43 When it is determined that the resolution of each reference frame image is the same as the resolution of the image x, the image x is inter-predictive-coded according to each reference frame image.
  • the image x can be inter-predictively encoded according to each reference frame image, such as How to perform interframe predictive coding is prior art.
  • the resolution change situation shown in FIG. 3 is taken as an example.
  • the reference frame image that is, the third frame may be firstly used.
  • the resolution of the image is adjusted to be the same as the resolution of the image of the fourth frame, and then the fourth frame image is inter-predictive-coded.
  • the reference may be firstly referred to.
  • the frame image, that is, the resolution of the fifth frame image is adjusted to be the same as the resolution of the sixth frame image, and then the sixth frame image is inter-predictively encoded, so that the fourth frame image and the sixth frame image are not required.
  • the intra prediction coding method is used as in the prior art, thereby improving coding efficiency.
  • the decoding manner may include:
  • the resolution of the reference frame image is the same as the resolution of the image y, and if not, the resolution of the reference frame image is adjusted according to the adjustment manner of the reference frame image recorded in the encoded code stream. Same resolution as image y;
  • the encoded code stream may be directly read, and the resolution of the reference frame image corresponding to each adjustment mode is adjusted to be the same as the resolution of the image y according to each adjustment manner recorded therein;
  • the present application also discloses an image encoding device and an image decoding device.
  • FIG. 9 is a schematic structural diagram of an embodiment of an image encoding apparatus according to the present application. As shown in FIG. 9, the first processing module 901 and the second processing module 902 are included.
  • the first processing module 901 is configured to determine a reference frame image of the image x when it is required to perform inter prediction encoding on the image x of any frame, and notify the second processing module that the image x is a P frame image or a B frame image;
  • the second processing module 902 is configured to: respectively, determine, for each reference frame image, whether the resolution of the reference frame image is the same as the resolution of the image x, and if not, adjust the resolution of the reference frame image to The resolution of the image x is the same; when it is determined that the resolution of each reference frame image is the same as the resolution of the image x, the image x is interframe-predicted and encoded according to each reference frame image.
  • the second processing module 902 determines that the resolution of a reference frame image is smaller than the resolution of the image x, and the resolution of the reference frame image is adjusted to be the same as the resolution of the image x by image expansion or image filling.
  • the second processing module 902 determines that the resolution of a reference frame image is greater than the resolution of the image x, and the resolution of the reference frame image is adjusted to be the same as the resolution of the image x by image reduction or image cropping.
  • the second processing module 902 is further configured to write the adjustment manner of the reference frame image that has undergone the resolution adjustment into the encoded code stream for subsequent decoding.
  • FIG. 10 is a schematic structural diagram of an embodiment of an image decoding apparatus according to the present application. As shown in FIG. 10, the third processing module 101 and the fourth processing module 102 are included.
  • the third processing module 101 is configured to: when it is required to perform inter prediction encoding, When the frame image y is decoded, the reference frame image of the image y is determined and notified to the fourth processing module;
  • the fourth processing module 102 is configured to perform the following processing for each reference frame image: if it is determined that the resolution of the reference frame image is different from the resolution of the image y, the resolution of the reference frame image is adjusted to be the same image.
  • the resolution of y is the same; when it is determined that the resolution of each reference frame image is the same as the resolution of the image y, the image y is decoded according to each reference frame image.
  • FIG. 11 is a schematic structural diagram of another embodiment of an image encoding apparatus according to the present application.
  • the image encoding apparatus includes a central processing unit (CPU) 110, a memory 111, and a nonvolatile memory 112.
  • the nonvolatile memory 112 stores a computer program for realizing image encoding.
  • the CPU 110 can load the computer program from the non-volatile memory 112 into the memory 111 to form computer executable instructions.
  • the computer executable instructions include a first processing instruction 1110 and a second processing instruction 1112.
  • the first processing instruction 1110 is used to indicate a reference frame image of the determined image x, wherein the image x is a P frame image or a B frame image.
  • the second processing instruction 1112 is used to indicate that the resolution of the reference frame image is the same as the resolution of the image x, and if not, the resolution of the reference frame image is adjusted to The resolution of the image x is the same; when it is determined that the resolution of each reference frame image is the same as the resolution of the image x, the image x is interframe-predicted and encoded according to each reference frame image.
  • the second processing instruction 1112 is further configured to indicate that the resolution of the reference frame image is adjusted to be resolved with the image x by means of image expansion or image filling.
  • the rate is the same.
  • the second processing finger When it is determined that the resolution of a reference frame image is greater than the resolution of the image x, the second processing finger The 1112 is further used to indicate that the resolution of the reference frame image is adjusted to be the same as the resolution of the image x by means of image reduction or image cropping.
  • the second processing instruction 1112 may be further configured to indicate that the adjustment mode of the reference frame image subjected to the resolution adjustment is written into the encoded code stream for subsequent decoding.
  • FIG. 12 is a schematic structural diagram of another embodiment of an image decoding apparatus according to the present application.
  • the image decoding apparatus includes a central processing unit (CPU) 120, a memory 121, and a nonvolatile memory 122.
  • CPU central processing unit
  • memory 121 a nonvolatile memory 122.
  • the nonvolatile memory 122 stores a computer program for realizing image decoding.
  • the CPU 120 can load the computer program from the non-volatile memory 122 into the memory 121 to form computer executable instructions.
  • the computer executable instructions include a third processing instruction 1210 and a fourth processing instruction 1212.
  • the third processing instruction 1210 is used to instruct the determination of the reference frame image of the image y.
  • the fourth processing instruction 1212 is configured to indicate that the resolution of the reference frame image is adjusted to be the same as the image if the resolution of the reference frame image is different from the resolution of the image y.
  • the resolution of y is the same; when it is determined that the resolution of each reference frame image is the same as the resolution of the image y, the image y is decoded according to each reference frame image.
  • the reference frame image is compared with the resolution of the image x or the image y, whether for the image x or the image y, the reference frame image is referred to.
  • the native resolution ie, the resolution before adjustment

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Compression Or Coding Systems Of Tv Signals (AREA)

Abstract

本申请公开了一种图像编码方法和装置:当需要对任意一帧图像x进行帧间预测编码时,确定图像x的参考帧图像,图像x为P帧图像或B帧图像;针对各参考帧图像,分别进行以下处理:确定该参考帧图像的分辨率与图像x的分辨率是否相同,如果否,则将该参考帧图像的分辨率调整为与图像x的分辨率相同;当确定各参考帧图像的分辨率均与图像x的分辨率相同时,根据各参考帧图像对图像x进行帧间预测编码。应用本申请所述方案,能够提高编码效率。相应地,本申请同时公开了一种图像解码方法和装置。

Description

图像编码方法和装置以及图像解码方法和装置
本申请要求于2014年6月10日提交中国专利局、申请号为201410253454.X、发明名称为“图像编码方法和装置以及图像解码方法和装置”的中国专利申请的优先权,其全部内容通过引用结合在本申请中。
技术领域
本申请涉及图像处理技术,特别涉及图像编码方法和装置以及图像解码方法和装置。
发明背景
视频压缩,是指通过特定的压缩技术,将某个格式的视频序列转换成另一种格式的视频序列的过程。
现有的视频压缩标准主要有国际电信联盟远程通信标准化组织(ITU-T,for ITU Telecommunication Standardization Sector)制定的H.261、H.263,国际标准化组织(ISO,International Standards Organization)制定的动态图像专家组-1(MPEG-1,Moving Pictures Experts Group-1)、MPEG-4,以及两者共同制定的MPEG-2/H.262等。上述标准均采用基于块的混合编码框架,其中的一项重要技术即是预测编码。
通常,根据预测数据来源的不同,可将视频序列中的各帧图像分为以下三种类型:I帧(帧内预测帧,Intra)、P帧(帧间预测帧,Prediction)、B帧(双向预测帧,Bi-Prediction),相应地,可将I帧类型的图像称为I帧图像,将P帧类型的图像称为P帧图像,将B帧类型的图像称为B 帧图像。
其中,在对I帧图像进行预测编码时,只需要采用本帧的数据进行预测,而在对P帧图像进行预测编码时,则需要采用前面的一帧或多帧图像作为参考帧图像,在对B帧图像进行预测编码时,则需要采用前面的一帧或多帧图像以及后面的一帧或多帧图像作为参考帧图像;其中,参考帧图像需要是重建图像,重建图像即指编码后又解码出来的图像。
图1为现有P帧图像的参考帧图像示意图。如图1所示,当需要对第2个P帧图像(按照从左到右的顺序)进行预测编码时,可将其前面的两帧图像作为参考帧图像。
图2为现有B帧图像的参考帧图像示意图。如图2所示,当需要对其中的B帧图像进行预测编码时,可将其前面的两帧(前向参考帧)图像以及后面的一帧(后向参考帧)图像作为参考帧图像。
在实际应用中,通常将上述I帧图像对应的预测编码方式称为帧内预测编码,将上述P帧图像和B帧图像对应的预测编码方式称为帧间预测编码,简单来说,帧内预测编码即指只采用本帧的数据进行预测,而帧间预测编码则需要采用其它帧的数据进行预测。
相比于帧间预测编码,帧内预测编码的编码效率较低,从而会增加编码后的码率,进而增加传输和存储成本。
现有处理方式中,当对某一视频序列中的某一帧图像x进行帧间预测编码时,要求参考帧图像的分辨率和图像x的分辨率必须相同才行,如果不相同,则会认为视频序列发生了切换,并按照新的视频序列进行处理,即以能够随机切入的I帧图像为起始,也就是说,如果参考帧图像的分辨率和图像x的分辨率相同,则按照正常的方式对图像x进行帧间预测编码,否则,对图像x进行帧内预测编码。
分辨率是指图像宽高的像素个数,假设图像x的分辨率为704×576, 那么704则是指图像x的横向像素个数,576则是指图像x的纵向像素个数。
图3为现有某一视频序列中的各帧图像的分辨率变化情况示意图。如图3所示,假设按照从左到右的顺序,理想情况下,希望除第1帧图像为I帧图像外,其它各帧图像均为P帧图像,但第4帧图像的分辨率大于第3帧图像的分辨率,而第6帧图像的分辨率又小于第5帧图像的分辨率,假设第3帧图像为第4帧图像的参考帧图像,第5帧图像为第6帧图像的参考帧图像,那么由于与参考帧图像的分辨率不同,第4帧图像和第6帧图像将不能进行帧间预测编码,即只能进行帧内预测编码,相当于是将第4帧图像和第6帧图像作为I帧图像进行处理。
鉴于上述情况,当对某一视频序列进行视频压缩时,如果其中的各帧图像的分辨率均相同,则不会存在问题,但如果其中的各帧图像的分辨率经常发生变化,如极端情况下,每帧图像的分辨率都不相同,这样,每帧图像都只能进行帧内预测编码,而如前所述,帧内预测编码的编码效率较低,从而会增加编码后的码率,进而增加传输和存储成本。
发明内容
有鉴于此,本申请提供了一种图像编码方法和装置,能够提高编码效率,相应地,提供了一种图像解码方法和装置。
为了达到上述目的,本申请的技术方案是这样实现的:
一种图像编码方法,包括:
当需要对任意一帧图像x进行帧间预测编码时,确定图像x的参考帧图像,图像x为P帧图像或B帧图像;
针对各参考帧图像,分别进行以下处理:确定该参考帧图像的分辨率与图像x的分辨率是否相同,如果否,则将该参考帧图像的分辨率调 整为与图像x的分辨率相同;
当确定各参考帧图像的分辨率均与图像x的分辨率相同时,根据各参考帧图像对图像x进行帧间预测编码。
一种图像编码装置,包括:
第一处理模块,用于当需要对任意一帧图像x进行帧间预测编码时,确定图像x的参考帧图像,并通知给第二处理模块,图像x为P帧图像或B帧图像;
所述第二处理模块,用于针对各参考帧图像,分别进行以下处理:确定该参考帧图像的分辨率与图像x的分辨率是否相同,如果否,则将该参考帧图像的分辨率调整为与图像x的分辨率相同;当确定各参考帧图像的分辨率均与图像x的分辨率相同时,根据各参考帧图像对图像x进行帧间预测编码。
一种图像解码方法,包括:
当需要对进行了帧间预测编码后的任意一帧图像y进行解码时,确定图像y的参考帧图像;
针对各参考帧图像,分别进行以下处理:若确定该参考帧图像的分辨率与图像y的分辨率不相同,则将该参考帧图像的分辨率调整为与图像y的分辨率相同;
当确定各参考帧图像的分辨率均与图像y的分辨率相同时,根据各参考帧图像对图像y进行解码。
一种图像解码装置,包括:
第三处理模块,用于当需要对进行了帧间预测编码后的任意一帧图像y进行解码时,确定图像y的参考帧图像,并通知给第四处理模块;
所述第四处理模块,用于针对各参考帧图像,分别进行以下处理:若确定该参考帧图像的分辨率与图像y的分辨率不相同,则将该参考帧 图像的分辨率调整为与图像y的分辨率相同;当确定各参考帧图像的分辨率均与图像y的分辨率相同时,根据各参考帧图像对图像y进行解码。
可见,采用本申请所述方案,当需要对任意一帧图像x进行帧间预测编码时,如果参考帧图像的分辨率与图像x的分辨率不相同,那么可先将参考帧图像的分辨率调整为与图像x的分辨率相同,之后再对图像x进行帧间预测编码,从而避免了现有技术中存在的问题,相应地,提高了编码效率,降低了编码后的码率,进而降低了传输和存储成本等。
附图简要说明
图1为现有P帧图像的参考帧图像示意图。
图2为现有B帧图像的参考帧图像示意图。
图3为现有某一视频序列中的各帧图像的分辨率变化情况示意图。
图4为本申请图像编码方法实施例的流程图。
图5为本申请所述通过图像扩大将参考帧图像的分辨率调整为与图像x的分辨率相同的方式示意图。
图6为本申请所述通过图像缩小将参考帧图像的分辨率调整为与图像x的分辨率相同的方式示意图。
图7为本申请所述通过图像填充将参考帧图像的分辨率调整为与图像x的分辨率相同的方式示意图。
图8为本申请所述通过图像裁剪将参考帧图像的分辨率调整为与图像x的分辨率相同的方式示意图。
图9为本申请图像编码装置实施例的组成结构示意图。
图10为本申请图像解码装置实施例的组成结构示意图。
图11为本申请另外一种图像编码装置实施例的组成结构示意图。
图12为本申请另外一种图像解码装置实施例的组成结构示意图。
实施本发明的方式
为了使本申请的技术方案更加清楚、明白,以下参照附图并举实施例,对本申请所述方案作进一步的详细说明。
图4为本申请图像编码方法实施例的流程图。如图4所示,包括以下步骤41~步骤43。
步骤41:当需要对任意一帧图像x进行帧间预测编码时,确定图像x的参考帧图像,图像x为P帧图像或B帧图像。
为便于表述,用图像x来表示任一视频序列中的任意一帧图像。
当需要对图像x进行预测编码时,可首先确定出其类型,即是I帧图像,还是P帧图像或B帧图像,如果是I帧图像,则需要进行帧内预测编码,如果是P帧图像或B帧图像,则需要进行帧间预测编码,相应地,需要确定出图像x的参考帧图像。
如何确定图像x的参考帧图像为现有技术。
步骤42:针对各参考帧图像,分别进行以下处理:确定该参考帧图像的分辨率与图像x的分辨率是否相同,如果否,则将该参考帧图像的分辨率调整为与图像x的分辨率相同。
步骤41中确定出的图像x的参考帧图像的个数可能为一个,也可能为多个;如果是一个,那么该参考帧图像可能需要进行调整,也可能不需要进行调整;如果是多个,则会包括以下三种情况:
1)各参考帧图像的分辨率均不需要进行调整,即均与图像x的分辨率相同;
2)各参考帧图像的分辨率均需要进行调整,即均与图像x的分辨率不相同;
3)部分参考帧图像的分辨率需要进行调整,剩余的参考帧图像的分辨率不需要进行调整。
无论是哪种情况,均需要通过比较分析才能获知,相应地,需要针对各参考帧图像,分别进行以下处理:将该参考帧图像的分辨率与图像x的分辨率进行比较,即确定该参考帧图像的分辨率与图像x的分辨率是否相同,如果否,则将该参考帧图像的分辨率调整为与图像x的分辨率相同,如果是,则无需对该参考帧图像的分辨率进行调整。
具体来说,针对各参考帧图像,当该参考帧图像的分辨率小于图像x的分辨率时,可通过调大该参考帧图像的分辨率,使得该参考帧图像的分辨率与图像x的分辨率相同,当该参考帧图像的分辨率大于图像x的分辨率时,可通过调小该参考帧图像的分辨率,使得该参考帧图像的分辨率与图像x的分辨率相同。
其中,调大该参考帧图像的分辨率的方式包括但不限于以下之一:图像扩大或图像填充;调小该参考帧图像的分辨率的方式包括但不限于以下之一:图像缩小或图像裁剪。
图5为本申请所述通过图像扩大将参考帧图像的分辨率调整为与图像x的分辨率相同的方式示意图。如图5所示,其中的斜线填充区域即表示扩大部分,如何进行图像扩大为现有技术,如可采用内插值方法等。
图6为本申请所述通过图像缩小将参考帧图像的分辨率调整为与图像x的分辨率相同的方式示意图。如图6所示,其中的斜线填充区域即表示缩小部分,如何进行图像缩小同样为现有技术。
图7为本申请所述通过图像填充将参考帧图像的分辨率调整为与图像x的分辨率相同的方式示意图。如图7所示,其中的斜线填充区域即表示填充部分,如何进行图像填充为现有技术,如可采用常数填充、复制填充、镜像填充、周期填充等方法,在参考帧图像四周填充数据。
图8为本申请所述通过图像裁剪将参考帧图像的分辨率调整为与图像x的分辨率相同的方式示意图。如图8所示,其中的斜线填充区域即 表示裁剪部分,即将参考帧图像的四周进行裁剪,如何进行图像裁剪同样为现有技术。
在实际应用中,具体采用上述哪种方式来对参考帧图像的分辨率进行调整可根据实际需要而定。
比如:
1)当分辨率变化是由于物体逐渐靠近变大或逐渐远离变小引起的时,如一车辆迎面开来,逐渐变大,分辨率也跟着变大,每帧图像的分辨率均不相同,背向开去的车辆则正好相反,此时,假设除第1帧图像为I帧图像外,其余的各帧图像均为P帧图像,那么,则可采用图5和图6中所示的图像缩放方式,将参考帧图像的分辨率调整为与待编码的图像即图像x的分辨率相同,其中,图5对应于物体逐渐靠近变大的情况,图6对应于物体逐渐远离变小的情况;
2)当图像x的分辨率大于其参考帧图像的分辨率,且其参考帧图像的分辨率是由于裁剪所导致的变小时,则可采用图7中所示的图像填充方式,将参考帧图像的分辨率调整为与图像x的分辨率相同;
3)当图像x的分辨率小于其参考帧图像的分辨率,且其参考帧图像的分辨率是由于填充所导致的变大时,则可采用图8中所示的图像裁剪方式,将参考帧图像的分辨率调整为与图像x的分辨率相同。
当图像x存在多个参考帧图像时,各参考帧图像可以采用相同的调整方式,也可以采用不同的调整方式,视实际情况而定。
另外,如何确定引起参考帧图像分辨率变化的原因为现有技术。
步骤43:当确定各参考帧图像的分辨率均与图像x的分辨率相同时,根据各参考帧图像对图像x进行帧间预测编码。
经过步骤42中的处理后,当各参考帧图像的分辨率均与图像x的分辨率相同时,即可根据各参考帧图像对图像x进行帧间预测编码,如 何进行帧间预测编码为现有技术。
基于上述介绍,仍以图3所示分辨率变化情况为例,采用本申请所述方案后,当需要对第4帧图像进行帧间预测编码时,可首先将其参考帧图像即第3帧图像的分辨率调整为与第4帧图像的分辨率相同,然后再对第4帧图像进行帧间预测编码,同样,当需要对第6帧图像进行帧间预测编码时,可首先将其参考帧图像即第5帧图像的分辨率调整为与第6帧图像的分辨率相同,然后再对第6帧图像进行帧间预测编码,这样一来,第4帧图像和第6帧图像则无需再像现有技术中一样采用帧内预测编码方式,从而提高了编码效率。
需要说明的是,在实际应用中,对于进行了分辨率调整的参考帧图像,需要记录其调整方式,如记录扩大、缩小的中心点位置,填充、裁剪的四周距离等,并写入到编码码流中,以便后续相应的进行解码。
具体地,所述解码方式可包括:
A、当需要对进行了帧间预测编码后的任意一帧图像y进行解码时,确定图像y的参考帧图像;
B、针对图像y的各参考帧图像,分别进行以下处理:若确定该参考帧图像的分辨率与图像y的分辨率不相同,则将该参考帧图像的分辨率调整为与图像y的分辨率相同;
比如,可比较该参考帧图像的分辨率与图像y的分辨率是否相同,如果否,则根据编码码流中所记录的该参考帧图像的调整方式,将该参考帧图像的分辨率调整为与图像y的分辨率相同;
或者,也可以直接读取编码码流,根据其中记录的各调整方式,将各调整方式对应的参考帧图像的分辨率调整为与图像y的分辨率相同;
C、当确定图像y的各参考帧图像的分辨率均与图像y的分辨率相同时,根据各参考帧图像对图像y进行解码;
如何进行解码为现有技术。
本申请同时公开了一种图像编码装置以及一种图像解码装置。
图9为本申请图像编码装置实施例的组成结构示意图。如图9所示,包括:第一处理模块901和第二处理模块902。
第一处理模块901,用于当需要对任意一帧图像x进行帧间预测编码时,确定图像x的参考帧图像,并通知给第二处理模块,图像x为P帧图像或B帧图像;
第二处理模块902,用于针对各参考帧图像,分别进行以下处理:确定该参考帧图像的分辨率与图像x的分辨率是否相同,如果否,则将该参考帧图像的分辨率调整为与图像x的分辨率相同;当确定各参考帧图像的分辨率均与图像x的分辨率相同时,根据各参考帧图像对图像x进行帧间预测编码。
较佳地,
第二处理模块902确定一参考帧图像的分辨率小于图像x的分辨率,通过图像扩大或图像填充的方式,将该参考帧图像的分辨率调整为与图像x的分辨率相同。
第二处理模块902确定一参考帧图像的分辨率大于图像x的分辨率,通过图像缩小或图像裁剪的方式,将该参考帧图像的分辨率调整为与图像x的分辨率相同。
另外,
第二处理模块902还可进一步用于,将进行了分辨率调整的参考帧图像的调整方式写入到编码码流中,以便后续进行解码。
图10为本申请图像解码装置实施例的组成结构示意图。如图10所示,包括:第三处理模块101和第四处理模块102。
第三处理模块101,用于当需要对进行了帧间预测编码后的任意一 帧图像y进行解码时,确定图像y的参考帧图像,并通知给第四处理模块;
第四处理模块102,用于针对各参考帧图像,分别进行以下处理:若确定该参考帧图像的分辨率与图像y的分辨率不相同,则将该参考帧图像的分辨率调整为与图像y的分辨率相同;当确定各参考帧图像的分辨率均与图像y的分辨率相同时,根据各参考帧图像对图像y进行解码。
图11为本申请另外一种图像编码装置实施例的组成结构示意图。如图11所示,该图像编码装置包括一中央处理器(CPU)110,一内存111,以及一非易失存储器112。
其中,非易失性存储器112存储有用于实现图像编码的计算机程序。
CPU 110可以从非易失性存储器112中将所述计算机程序加载到内存111中运行,形成计算机可执行指令。其中所述计算机可执行指令包括第一处理指令1110和第二处理指令1112。
当需要对任意一帧图像x进行帧间预测编码时,第一处理指令1110用于指示确定图像x的参考帧图像,其中图像x为P帧图像或B帧图像。
针对各参考帧图像,第二处理指令1112用于指示分别进行以下处理:确定该参考帧图像的分辨率与图像x的分辨率是否相同,如果否,则将该参考帧图像的分辨率调整为与图像x的分辨率相同;当确定各参考帧图像的分辨率均与图像x的分辨率相同时,根据各参考帧图像对图像x进行帧间预测编码。
当确定一参考帧图像的分辨率小于图像x的分辨率时,第二处理指令1112进一步用于指示通过图像扩大或图像填充的方式,将该参考帧图像的分辨率调整为与图像x的分辨率相同。
当确定一参考帧图像的分辨率大于图像x的分辨率时,第二处理指 令1112进一步用于指示通过图像缩小或图像裁剪的方式,将该参考帧图像的分辨率调整为与图像x的分辨率相同。
另外,第二处理指令1112还可进一步用于指示,将进行了分辨率调整的参考帧图像的调整方式写入到编码码流中,以便后续进行解码。
图12为本申请另外一种图像解码装置实施例的组成结构示意图。如图12所示,该图像解码装置包括一中央处理器(CPU)120,一内存121,以及一非易失存储器122。
其中,非易失性存储器122存储有用于实现图像解码的计算机程序。
CPU 120可以从非易失性存储器122中将所述计算机程序加载到内存121中运行,形成计算机可执行指令。其中所述计算机可执行指令包括第三处理指令1210和第四处理指令1212。
当需要对进行了帧间预测编码后的任意一帧图像y进行解码时,第三处理指令1210用于指示确定图像y的参考帧图像。
针对各参考帧图像,第四处理指令1212用于指示分别进行以下处理:若确定该参考帧图像的分辨率与图像y的分辨率不相同,则将该参考帧图像的分辨率调整为与图像y的分辨率相同;当确定各参考帧图像的分辨率均与图像y的分辨率相同时,根据各参考帧图像对图像y进行解码。
图9,图10,图11和图12所示装置实施例的具体工作流程请参照前述方法实施例中的相应说明,此处不再赘述。
需要说明的是,上述各实施例中,无论是针对图像x还是图像y,当将一参考帧图像的分辨率与图像x或图像y的分辨率进行比较时,均是指将该参考帧图像的原始分辨率(即未进调整之前的分辨率)与图像x或图像y的分辨率进行比较。
综上所述,以上仅为本申请的较佳实施例而已,并非用于限定本申请的保护范围。凡在本申请的精神和原则之内,所作的任何修改、等同替换、改进等,均应包含在本申请的保护范围之内。

Claims (10)

  1. 一种图像编码方法,其特征在于,包括:
    当需要对任意一帧图像x进行帧间预测编码时,确定图像x的参考帧图像,图像x为P帧图像或B帧图像;
    针对各参考帧图像,分别进行以下处理:确定该参考帧图像的分辨率与图像x的分辨率是否相同,如果否,则将该参考帧图像的分辨率调整为与图像x的分辨率相同;
    当确定各参考帧图像的分辨率均与图像x的分辨率相同时,根据各参考帧图像对图像x进行帧间预测编码。
  2. 根据权利要求1所述的方法,其特征在于,
    所述将该参考帧图像的分辨率调整为与图像x的分辨率相同包括:
    当该参考帧图像的分辨率小于图像x的分辨率时,通过图像扩大或图像填充的方式,将该参考帧图像的分辨率调整为与图像x的分辨率相同。
  3. 根据权利要求1所述的方法,其特征在于,
    所述将该参考帧图像的分辨率调整为与图像x的分辨率相同包括:
    当该参考帧图像的分辨率大于图像x的分辨率时,通过图像缩小或图像裁剪的方式,将该参考帧图像的分辨率调整为与图像x的分辨率相同。
  4. 根据权利要求1所述的方法,其特征在于,
    该方法进一步包括:将进行了分辨率调整的参考帧图像的调整方式写入到编码码流中;
    当需要对进行了帧间预测编码后的任意一帧图像y进行解码时,确定图像y的参考帧图像;
    针对图像y的各参考帧图像,分别进行以下处理:若确定该参考帧图像的分辨率与图像y的分辨率不相同,则根据编码码流中所记录的该参考帧图像的调整方式,将该参考帧图像的分辨率调整为与图像y的分辨率相同;
    当确定图像y的各参考帧图像的分辨率均与图像y的分辨率相同时,根据各参考帧图像对图像y进行解码。
  5. 一种图像编码装置,其特征在于,包括:
    第一处理模块,用于当需要对任意一帧图像x进行帧间预测编码时,确定图像x的参考帧图像,并通知给第二处理模块,图像x为P帧图像或B帧图像;
    所述第二处理模块,用于针对各参考帧图像,分别进行以下处理:确定该参考帧图像的分辨率与图像x的分辨率是否相同,如果否,则将该参考帧图像的分辨率调整为与图像x的分辨率相同;当确定各参考帧图像的分辨率均与图像x的分辨率相同时,根据各参考帧图像对图像x进行帧间预测编码。
  6. 根据权利要求5所述的装置,其特征在于,
    所述第二处理模块确定一参考帧图像的分辨率小于图像x的分辨率,通过图像扩大或图像填充的方式,将该参考帧图像的分辨率调整为与图像x的分辨率相同。
  7. 根据权利要求5所述的装置,其特征在于,
    所述第二处理模块确定一参考帧图像的分辨率大于图像x的分辨率,通过图像缩小或图像裁剪的方式,将该参考帧图像的分辨率调整为与图像x的分辨率相同。
  8. 根据权利要求5所述的装置,其特征在于,
    所述第二处理模块进一步用于,将进行了分辨率调整的参考帧图像 的调整方式写入到编码码流中。
  9. 一种图像解码方法,其特征在于,包括:
    当需要对进行了帧间预测编码后的任意一帧图像y进行解码时,确定图像y的参考帧图像;
    针对各参考帧图像,分别进行以下处理:若确定该参考帧图像的分辨率与图像y的分辨率不相同,则将该参考帧图像的分辨率调整为与图像y的分辨率相同;
    当确定各参考帧图像的分辨率均与图像y的分辨率相同时,根据各参考帧图像对图像y进行解码。
  10. 一种图像解码装置,其特征在于,包括:
    第三处理模块,用于当需要对进行了帧间预测编码后的任意一帧图像y进行解码时,确定图像y的参考帧图像,并通知给第四处理模块;
    所述第四处理模块,用于针对各参考帧图像,分别进行以下处理:若确定该参考帧图像的分辨率与图像y的分辨率不相同,则将该参考帧图像的分辨率调整为与图像y的分辨率相同;当确定各参考帧图像的分辨率均与图像y的分辨率相同时,根据各参考帧图像对图像y进行解码。
PCT/CN2014/091240 2014-06-10 2014-11-17 图像编码方法和装置以及图像解码方法和装置 WO2015188585A1 (zh)

Priority Applications (2)

Application Number Priority Date Filing Date Title
US15/317,444 US10659800B2 (en) 2014-06-10 2014-11-17 Inter prediction method and device
EP14894440.8A EP3139612A4 (en) 2014-06-10 2014-11-17 Image encoding method and device, and image decoding method and device

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201410253454.XA CN105187824A (zh) 2014-06-10 2014-06-10 图像编码方法和装置以及图像解码方法和装置
CN201410253454.X 2014-06-10

Publications (1)

Publication Number Publication Date
WO2015188585A1 true WO2015188585A1 (zh) 2015-12-17

Family

ID=54832844

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2014/091240 WO2015188585A1 (zh) 2014-06-10 2014-11-17 图像编码方法和装置以及图像解码方法和装置

Country Status (4)

Country Link
US (1) US10659800B2 (zh)
EP (1) EP3139612A4 (zh)
CN (1) CN105187824A (zh)
WO (1) WO2015188585A1 (zh)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
GB2551199A (en) * 2016-06-10 2017-12-13 Advanced Risc Mach Ltd Video data processing system

Families Citing this family (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107155107B (zh) * 2017-03-21 2018-08-03 腾讯科技(深圳)有限公司 视频编码方法和装置、视频解码方法和装置
CN108833917B (zh) 2018-06-20 2022-04-08 腾讯科技(深圳)有限公司 视频编码、解码方法、装置、计算机设备和存储介质
CN113826386B (zh) * 2019-05-11 2023-10-24 北京字节跳动网络技术有限公司 视频处理中编解码工具的选择性使用
EP4029245A4 (en) 2019-10-12 2022-11-23 Beijing Bytedance Network Technology Co., Ltd. HIGH LEVEL SYNTAX FOR VIDEO CODING TOOLS
CN115066900A (zh) * 2020-01-06 2022-09-16 现代自动车株式会社 基于具有不同分辨率的参考图片的图像编码和解码

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP1775957A1 (en) * 2005-10-14 2007-04-18 Inria Institut National de Recherche en Informatique et en Automatique Improved multi-resolution image processing
EP0883299B1 (en) * 1997-06-06 2009-08-26 Fujitsu Limited Apparatus and method for coding and decoding video images
CN101646084A (zh) * 2008-08-06 2010-02-10 联发科技股份有限公司 视频解码方法及系统
TW201023624A (en) * 2008-12-11 2010-06-16 Novatek Microelectronics Corp Apparatus for reference picture resampling generation and method thereof and video decoding system

Family Cites Families (16)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7956930B2 (en) 2006-01-06 2011-06-07 Microsoft Corporation Resampling and picture resizing operations for multi-resolution video coding and decoding
US20090207915A1 (en) * 2008-02-15 2009-08-20 Freescale Semiconductor, Inc. Scalable motion search ranges in multiple resolution motion estimation for video compression
EP2338281A4 (en) 2008-10-17 2012-08-15 Nokia Corp SHARING THE MOTION VECTOR IN 3D VIDEO CODING
US8761266B2 (en) * 2008-11-12 2014-06-24 Cisco Technology, Inc. Processing latticed and non-latticed pictures of a video program
CN101765014B (zh) * 2008-12-23 2012-06-27 联咏科技股份有限公司 产生重新取样参考画面的装置及其方法与影像解码系统
CN102165778A (zh) * 2009-02-10 2011-08-24 松下电器产业株式会社 图像处理装置、图像处理方法、程序及集成电路
CN101867816A (zh) * 2010-05-10 2010-10-20 南京邮电大学 一种基于人眼视觉特性的立体视频非对称压缩编码方法
JP5767816B2 (ja) 2011-01-20 2015-08-19 ルネサスエレクトロニクス株式会社 記録装置に搭載可能な半導体集積回路およびその動作方法
KR20120118781A (ko) 2011-04-19 2012-10-29 삼성전자주식회사 다시점 비디오를 위한 단일화된 스케일러블 비디오 부호화 방법 및 그 장치, 다시점 비디오를 위한 단일화된 스케일러블 비디오 복호화 방법 및 그 장치
JPWO2012147621A1 (ja) * 2011-04-28 2014-07-28 ソニー株式会社 符号化装置および符号化方法、並びに、復号装置および復号方法
US9451284B2 (en) * 2011-10-10 2016-09-20 Qualcomm Incorporated Efficient signaling of reference picture sets
US10375405B2 (en) * 2012-10-05 2019-08-06 Qualcomm Incorporated Motion field upsampling for scalable coding based on high efficiency video coding
CN103813174B (zh) * 2012-11-12 2016-04-27 腾讯科技(深圳)有限公司 一种混合分辨率编解码方法和装置
CN104937941B (zh) * 2013-03-28 2019-04-26 华为技术有限公司 用于确定用于空间可缩放视频编解码器的预测块的方法
US9813723B2 (en) * 2013-05-03 2017-11-07 Qualcomm Incorporated Conditionally invoking a resampling process in SHVC
US10250902B2 (en) * 2013-05-24 2019-04-02 Kt Corporation Method for inducing motion information in multilayer structure and apparatus using same

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP0883299B1 (en) * 1997-06-06 2009-08-26 Fujitsu Limited Apparatus and method for coding and decoding video images
EP1775957A1 (en) * 2005-10-14 2007-04-18 Inria Institut National de Recherche en Informatique et en Automatique Improved multi-resolution image processing
CN101646084A (zh) * 2008-08-06 2010-02-10 联发科技股份有限公司 视频解码方法及系统
TW201023624A (en) * 2008-12-11 2010-06-16 Novatek Microelectronics Corp Apparatus for reference picture resampling generation and method thereof and video decoding system

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See also references of EP3139612A4 *

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
GB2551199A (en) * 2016-06-10 2017-12-13 Advanced Risc Mach Ltd Video data processing system
KR20170140084A (ko) * 2016-06-10 2017-12-20 에이알엠 리미티드 비디오 데이터 처리 시스템
GB2551199B (en) * 2016-06-10 2019-12-18 Advanced Risc Mach Ltd Video data processing system
KR102336179B1 (ko) 2016-06-10 2021-12-07 에이알엠 리미티드 비디오 데이터 처리 시스템
US11212540B2 (en) 2016-06-10 2021-12-28 Arm Limited Video data processing system

Also Published As

Publication number Publication date
EP3139612A1 (en) 2017-03-08
CN105187824A (zh) 2015-12-23
EP3139612A4 (en) 2018-01-03
US20170105018A1 (en) 2017-04-13
US10659800B2 (en) 2020-05-19

Similar Documents

Publication Publication Date Title
WO2015188585A1 (zh) 图像编码方法和装置以及图像解码方法和装置
TWI719542B (zh) 一種視訊編碼/解碼方法及裝置
KR101713354B1 (ko) 움직임 추정에 대한 검색 범위 선택 방법과 그의 시스템 및 컴퓨터 판독가능 저장 매체
TWI613910B (zh) 用於訊框序列之影像編碼的方法和編碼器
JP6207116B2 (ja) 監視ビデオをエンコードするための方法及び装置
KR20170083455A (ko) 참조 이미지 프로세싱을 위한 방법, 애플리케이션 프로세서 및 모바일 기기
TWI451766B (zh) 用於視頻編碼之電力效率高的運動估計技術
JP5306485B2 (ja) 動きベクトル予測符号化方法、動きベクトル予測復号方法、動画像符号化装置、動画像復号装置およびそれらのプログラム
CN111182308B (zh) 视频解码方法、装置、计算机设备及存储介质
JP5275810B2 (ja) 基準フレームの選択ルールを使用したビデオエラー隠蔽の方法及び装置
CN109151476B (zh) 一种基于双向预测的b帧图像的参考帧生成方法及装置
TW202145794A (zh) 幀間預測方法、編碼器、解碼器以及電腦儲存媒介
CN113068026A (zh) 解码预测方法、装置及计算机存储介质
JP5100572B2 (ja) 符号化装置
JP2006246277A (ja) 再符号化装置、再符号化方法、および再符号化用プログラム
JP7359653B2 (ja) 動画像符号化装置
TWI702836B (zh) 約束的序列資料頭的方法及裝置
JP5189618B2 (ja) 映像符号化方法,映像符号化装置および映像符号化プログラム
JP6887296B2 (ja) 符号化装置、復号装置及びプログラム
WO2020003583A1 (ja) 映像符号化又は映像復号装置、映像符号化又は映像復号方法、プログラム、及び記録媒体
WO2022110131A1 (zh) 帧间预测方法、装置、编码器、解码器和存储介质
JP2006295502A (ja) 再符号化装置、再符号化方法、および再符号化用プログラム
WO2023193260A1 (zh) 编解码方法、码流、编码器、解码器以及存储介质
TWI833327B (zh) 視訊編解碼方法及裝置
JP6874844B2 (ja) 動画像符号化装置、動画像符号化方法、及び、動画像符号化プログラム

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 14894440

Country of ref document: EP

Kind code of ref document: A1

REEP Request for entry into the european phase

Ref document number: 2014894440

Country of ref document: EP

WWE Wipo information: entry into national phase

Ref document number: 2014894440

Country of ref document: EP

WWE Wipo information: entry into national phase

Ref document number: 15317444

Country of ref document: US

NENP Non-entry into the national phase

Ref country code: DE