WO2018068264A1 - 图像编码/解码方法、装置以及图像处理设备 - Google Patents

图像编码/解码方法、装置以及图像处理设备 Download PDF

Info

Publication number
WO2018068264A1
WO2018068264A1 PCT/CN2016/102004 CN2016102004W WO2018068264A1 WO 2018068264 A1 WO2018068264 A1 WO 2018068264A1 CN 2016102004 W CN2016102004 W CN 2016102004W WO 2018068264 A1 WO2018068264 A1 WO 2018068264A1
Authority
WO
WIPO (PCT)
Prior art keywords
sub
unit
search
region
motion vector
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/CN2016/102004
Other languages
English (en)
French (fr)
Inventor
付轩
G· 巴罗
数井君彦
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Fujitsu Ltd
Original Assignee
Fujitsu Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Fujitsu Ltd filed Critical Fujitsu Ltd
Priority to PCT/CN2016/102004 priority Critical patent/WO2018068264A1/zh
Priority to JP2019509497A priority patent/JP2019530299A/ja
Priority to CN201680088080.8A priority patent/CN109496431A/zh
Publication of WO2018068264A1 publication Critical patent/WO2018068264A1/zh
Priority to US16/287,705 priority patent/US20190200033A1/en
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • H04N19/503Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal prediction
    • H04N19/51Motion estimation or motion compensation
    • H04N19/513Processing of motion vectors
    • H04N19/517Processing of motion vectors by encoding
    • H04N19/52Processing of motion vectors by encoding by predictive encoding
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/103Selection of coding mode or of prediction mode
    • H04N19/105Selection of the reference unit for prediction within a chosen coding or prediction mode, e.g. adaptive choice of position and number of pixels used for prediction
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/119Adaptive subdivision aspects, e.g. subdivision of a picture into rectangular or non-rectangular coding blocks
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/134Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
    • H04N19/136Incoming video signal characteristics or properties
    • H04N19/137Motion inside a coding unit, e.g. average field, frame or block difference
    • H04N19/139Analysis of motion vectors, e.g. their magnitude, direction, variance or reliability
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/169Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
    • H04N19/17Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/169Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
    • H04N19/17Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object
    • H04N19/176Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a block, e.g. a macroblock
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • H04N19/503Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal prediction
    • H04N19/51Motion estimation or motion compensation
    • H04N19/53Multi-resolution motion estimation; Hierarchical motion estimation
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • H04N19/503Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal prediction
    • H04N19/51Motion estimation or motion compensation
    • H04N19/537Motion estimation other than block-based
    • H04N19/543Motion estimation other than block-based using regions
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • H04N19/503Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal prediction
    • H04N19/51Motion estimation or motion compensation
    • H04N19/57Motion estimation characterised by a search window with variable size or shape

Definitions

  • the present invention relates to the field of graphic image technology, and in particular, to an image encoding/decoding method, apparatus, and image processing apparatus.
  • intra coding also referred to as intra prediction coding
  • the reconstructed neighboring pixels are used to predict the current block to be encoded.
  • MV Motion Vector
  • the decoder can obtain the reference block from the reference image, plus the slave bit stream (or The residual data decoded by the code stream is also obtained, and the decoded value of the current block is obtained.
  • the MVs are compressed and programmed into the bitstream so that the decoder knows where to fetch the reference data.
  • the MV represents, for example, a displacement (eg, including direction and size) of a current coding unit (CU, Coding Unit) relative to a reference CU.
  • the MV may include Motion Vector Difference (MVD) and Motion Vector Prediction (MVP).
  • MVD Motion Vector Difference
  • MVP Motion Vector Prediction
  • PMMVD Pattern Matched Motion Vector Derivation
  • the decoder first performs a first stage search in the search area, and the search area may be predetermined.
  • the first stage for example, a rough search is performed at intervals of 4 pixels, and the best candidate for the first stage result can be obtained.
  • the second stage search is performed around the area corresponding to the best candidate of the first stage result, for example, the fine search is performed at intervals of 2 pixels, and the best candidate of the second stage result can be obtained, and the candidate is used as the candidate.
  • the current CU's MV for example, a rough search is performed at intervals of 4 pixels, and the best candidate for the first stage result can be obtained.
  • the motion estimation search can be used.
  • the current 4 columns of the CU and the 4 rows of the upper CU reconstruct the data, both the encoding end and the decoding end, which ensures that the search result of the decoding end is consistent with the encoding end.
  • Embodiments of the present invention provide an image encoding/decoding method, apparatus, and image processing apparatus, and it is desirable to shorten the encoding/decoding time of PMMVD.
  • an image encoding method which performs encoding using a pattern matching motion vector derivation method, the image encoding method comprising:
  • the residual information of the current coding unit is programmed into a bitstream.
  • an image encoding apparatus that performs encoding using a pattern matching motion vector derivation method, the image encoding apparatus comprising:
  • Searching a sub-region determining portion that determines a search sub-region of the current coding unit from a plurality of sub-regions of the search region according to a motion vector of the encoded unit;
  • a motion vector obtaining section that obtains a motion vector of the current coding unit based on the search sub-region
  • a residual calculation unit that calculates residual information of the current coding unit according to the motion vector
  • a bit stream encoding unit that encodes residual information of the current coding unit into a bit stream.
  • an image decoding method which performs decoding using a pattern matching motion vector derivation method, where the image decoding method includes:
  • the current decoding unit is decoded according to a motion vector of the current decoding unit and residual information obtained from the bitstream.
  • an image decoding apparatus which performs decoding using a pattern matching motion vector derivation method, the image decoding apparatus comprising:
  • Searching a sub-area determining unit that determines a search sub-area of the current decoding unit from a plurality of sub-areas of the search area according to a motion vector of the decoded unit;
  • a motion vector obtaining section that obtains a motion vector of the current decoding unit based on the search sub-region
  • An image decoding unit that decodes the current decoding unit based on a motion vector of the current decoding unit and residual information obtained from the bitstream.
  • an image processing apparatus wherein the image processing apparatus comprises:
  • An encoder comprising the image encoding device as described above; and/or
  • a decoder comprising the image decoding device as described above.
  • a computer readable program wherein when the program is executed in an image encoding device or an image processing device, the program causes the image encoding device or the image processing device to perform the above The image encoding method described.
  • a storage medium storing a computer readable program, wherein the computer readable program causes an image encoding device or an image processing device to perform an image encoding method as described above.
  • a computer readable program wherein when the program is executed in an image decoding device or an image processing device, the program causes the image decoding device or the image processing device to perform the above The image decoding method described.
  • a storage medium storing a computer readable program, wherein the computer readable program causes an image decoding device or an image processing device to perform an image decoding method as described above.
  • An advantageous effect of an embodiment of the present invention is that a search area for obtaining a motion vector of a current coding unit Dividing into a plurality of sub-regions; determining a search sub-region of the current coding unit from the plurality of sub-regions according to a motion vector of the coded unit; obtaining a motion vector of the current coding unit based on the search sub-region.
  • the search area can be narrowed down, and the number of search points can be reduced, so that the encoding/decoding time of the PMMVD can be shortened.
  • FIG. 1 is a schematic diagram of motion vectors in video encoding/decoding
  • FIG. 2 is a schematic diagram of acquiring a MV using a decoding end of a PMMVD method
  • FIG. 3 is a schematic diagram of an image encoding method according to Embodiment 1 of the present invention.
  • FIG. 4 is a schematic diagram of determining a search sub-area according to Embodiment 1 of the present invention.
  • FIG. 5 is a schematic diagram of an image decoding method according to Embodiment 2 of the present invention.
  • Figure 6 is a schematic diagram of an image coding apparatus according to Embodiment 3 of the present invention.
  • FIG. 7 is a schematic diagram of an image decoding apparatus according to Embodiment 4 of the present invention.
  • Figure 8 is a diagram showing an encoder/decoder of Embodiment 5 of the present invention.
  • FIG. 3 is a schematic diagram of an image encoding method according to an embodiment of the present invention. As shown in FIG. 3, the image encoding method includes:
  • Step 301 Determine a search sub-area of a current coding unit from a plurality of sub-areas of the search area according to a motion vector of the coded unit.
  • Step 302 Obtain a motion vector of a current coding unit based on the search sub-region
  • Step 303 Calculate residual information of the current coding unit according to the motion vector
  • Step 304 Program the residual information of the current coding unit into a bitstream.
  • the search area for obtaining the motion vector of the current coding unit may be determined in advance, for example, the search area of the PMMVD is still used, and how to determine can refer to the related art.
  • the search area may be divided into a plurality of sub-areas in advance, for example, divided into two groups or three groups, and the like; the present invention is not limited thereto, and may be other numbers.
  • the plurality of sub-areas of the search area may also be dynamically determined. For example, after determining that the MV of the left CU corresponds to a certain sub-area, the sub-area may be used as the first sub-area, and other searches except the first sub-area may be used. The area is the second sub-area; and so on.
  • the search sub-area of the current coding unit may be determined according to the MV of the coded unit. For example, in a case where the MV of the coded unit corresponds to a certain one of the plurality of sub-regions (for example, region 1), the certain sub-region (for example, region 1) is used as the current coding unit. Search for sub-areas.
  • the MV of the current CU can be obtained based on the search sub-area.
  • a two-stage search method may be used.
  • the first stage performs a coarse search at intervals of 4 pixels, and the second stage searches at intervals of 2 pixels.
  • the first stage performs a coarse search at intervals of 4 pixels
  • the second stage searches at intervals of 2 pixels.
  • the search range of the current coding unit can be reduced according to the MV of the coded unit, and the number of search points can be reduced, so that the encoding/decoding time of the PMMVD can be shortened.
  • the coded unit may be one or more; for example, may be one or more of a left CU, an upper CU, an upper left CU, and an upper right CU of the current CU; however, the present invention is not limited thereto.
  • the coding unit in this embodiment may be a CU in a normal sense, or may be an LCU or the like, but the present invention is not limited thereto, and the size of the coding unit may be determined according to actual conditions.
  • the left coding unit, the upper coding unit, the upper left coding unit, and the upper right coding unit are considered as examples, and how the search sub-area is determined in the present invention will be described in detail.
  • the present invention is not limited thereto, and for example, only the left coding unit and the upper coding unit may be considered, or only the left coding unit may be considered, and the like.
  • FIG. 4 is a schematic diagram of determining a search sub-area according to an embodiment of the present invention. As shown in FIG. 4, the process of determining a search sub-area may include:
  • Step 401 Determine whether motion vectors of the plurality of coded units all correspond to a certain one of the plurality of sub-areas; if yes, execute step 402; otherwise, perform step 403.
  • Step 402 The certain sub-area is used as a search sub-area of the current coding unit.
  • the search area is divided into 2 sub-areas
  • the MV of the left CU, the MV of the upper CU, the MV of the upper left CU, and the MV of the upper right CU all correspond to (or may also be referred to as falling into) the first sub-area
  • This first sub-region serves as a search sub-region of the current CU.
  • Step 403 Compare whether the number of motion vectors corresponding to different sub-regions is the same; if not, execute step 404; otherwise, perform step 405.
  • Step 404 A sub-region with a larger number of motion vectors is used as a search sub-region of the current coding unit.
  • the first sub-area may be further compared.
  • the number of MVs corresponding to the region and the second sub-region For example, in the above example, the number of MVs corresponding to the first sub-region is large, and the first sub-region can be used as the search sub-region of the current CU.
  • Step 405 comparing the residuals of the respective encoded coding units.
  • Step 406 The sub-region corresponding to the smaller residual is used as the search sub-region of the current coding unit.
  • the MV of the left CU corresponds to the MV of the upper CU (or may also be referred to as falling into) the first sub-area
  • the MV of the upper left CU and the MV of the upper right CU correspond to the second sub-area, ie, the first sub-area and the
  • the residuals of the respective encoded CUs can be further compared. For example, if the residuals of the left CU and the upper CU are small, and the residuals of the upper left CU and the upper right CU are larger, the first sub-region corresponding to the left CU and the upper CU may be used as the search sub-region of the current CU.
  • the entire search area is still used to acquire the MV of the current CU, or arbitrarily select one from the first sub-area or the second sub-area, and the like.
  • the processing when the residuals are still the same is omitted.
  • the residual difference when the residual difference is not large, for example, less than a predetermined threshold, the residuals can be considered to be the same. Moreover, if the sizes of the respective CU blocks are not the same, it is also necessary to normalize the residuals according to the size of the CU block.
  • the above has only described various steps or processes related to the present invention, but the present invention is not limited thereto.
  • the image encoding method may also include other steps or processes, and the specific content of these steps or processes may refer to the prior art.
  • the search area for obtaining the motion vector of the current coding unit is divided into a plurality of sub-areas; and the search sub-area of the current coding unit is determined from the plurality of sub-areas according to the motion vector of the coded unit; Obtaining a motion vector of the current coding unit based on the search sub-region.
  • the search area can be narrowed down, and the number of search points can be reduced, so that the encoding/decoding time of the PMMVD can be shortened.
  • the embodiment of the present invention provides an image decoding method, which uses the PMMVD method for decoding.
  • the embodiment of the present invention is described from the side of the decoding end, and the same content as that of Embodiment 1 will not be described again.
  • FIG. 5 is a schematic diagram of an image decoding method according to an embodiment of the present invention. As shown in FIG. 5, the image decoding method includes:
  • Step 501 Determine a search sub-region of a current decoding unit from a plurality of sub-regions of the search region according to a motion vector of the decoded unit.
  • Step 502 Obtain a motion vector of the current decoding unit based on the search sub-region.
  • Step 503 decodes the current decoding unit according to the motion vector of the current decoding unit and the residual information obtained from the bitstream.
  • the search area may be divided into a plurality of sub-areas in advance, for example, divided into two groups or three groups, and the like; the present invention is not limited thereto, and may be other numbers.
  • multiple sub-areas of the search area may also be dynamically determined.
  • the MV of the current decoding unit can be obtained based on the search sub-region.
  • a two-stage search method may be used.
  • the first stage performs a coarse search at intervals of 4 pixels, and the second stage searches at intervals of 2 pixels.
  • the first stage performs a coarse search at intervals of 4 pixels
  • the second stage searches at intervals of 2 pixels.
  • the decoding unit in this embodiment and the coding unit in Embodiment 1 adopt the same size, and are respectively referred to as a coding unit and a decoding unit for the sake of distinction, and can also decode the decoding end without causing confusion.
  • the unit is called CU or LCU.
  • the decoded unit may include one or more of the following: a left decoding unit, an upper decoding unit, an upper left decoding unit, and an upper right decoding unit of the current decoding unit; however, the present invention is not limited thereto.
  • determining the search sub-region of the current decoding unit from the plurality of sub-regions according to the motion vector of the decoded unit may include: corresponding to the motion vector of one decoded unit in the multiple sub-regions In the case of a certain sub-area, the certain sub-area is used as the search sub-area of the current decoding unit.
  • determining the search sub-region of the current decoding unit from the plurality of sub-regions according to the motion vector of the decoded unit may further include: determining whether the motion vectors of the plurality of decoded units are corresponding to each other. Describe a sub-region of the plurality of sub-regions; if each of the plurality of sub-regions corresponds to a certain sub-region, the certain sub-region is used as the search sub-region of the current decoding unit.
  • the image decoding method may further include: comparing, when the motion vectors of the plurality of decoded units correspond to different ones of the plurality of sub-regions, comparing the number of motion vectors corresponding to the different sub-regions; A sub-region having a larger number of motion vectors is used as a search sub-region of the current decoding unit.
  • the image decoding method may further include: comparing the residuals of the plurality of decoded units when the number of motion vectors corresponding to the different sub-regions is the same; and using the sub-region corresponding to the smaller residual as The search sub-area of the current decoding unit.
  • the above has only described various steps or processes related to the present invention, but the present invention is not limited thereto.
  • the image decoding method may also include other steps or processes, and the specific content of these steps or processes may refer to the prior art.
  • the search area for obtaining the motion vector of the current decoding unit is divided into a plurality of sub-areas; the search sub-area of the current decoding unit is determined from the plurality of sub-areas according to the motion vector of the decoded unit; A motion vector of the current decoding unit is obtained based on the search sub-region.
  • the search area can be narrowed down, and the number of search points can be reduced, so that the encoding/decoding time of the PMMVD can be shortened.
  • An embodiment of the present invention provides an image encoding apparatus, which uses the PMMVD method for encoding.
  • the embodiment of the present invention corresponds to the image encoding method of Embodiment 1, and the same content is not described herein again.
  • FIG. 6 is a schematic diagram of an image encoding apparatus according to an embodiment of the present invention. As shown in FIG. 6, the image encoding apparatus 600 includes:
  • Search sub-area determining section 601 which determines a search sub-area of the current coding unit from a plurality of sub-areas of the search area according to a motion vector of the encoded unit;
  • a motion vector obtaining section 602 that obtains a motion vector of the current coding unit based on the search sub-region;
  • a residual calculation unit 603 that calculates residual information of the current coding unit according to the motion vector
  • the bit stream encoding unit 604 encodes the residual information of the current coding unit into a bit stream.
  • the image encoding device 600 may further include:
  • the sub-area dividing section 605 divides the search area for obtaining the motion vector of the current coding unit into a plurality of sub-areas.
  • the coded unit may include one or more of the following: a left coding unit, an upper coding unit, an upper left coding unit, and an upper right coding unit of the current coding unit; however, the present invention is not limited thereto.
  • the search sub-area determining unit 601 may be configured to: when a motion vector of one coded unit corresponds to a certain one of the plurality of sub-areas, the certain sub-area is used as the The search sub-area of the current coding unit.
  • the search sub-area determination unit 601 may be further configured to: determine whether a motion vector of the plurality of coded units corresponds to one of the plurality of sub-areas; and each of the plurality of sub-areas In the case of a region, the certain sub-region is used as the search sub-region of the current coding unit.
  • the search sub-region determining unit 601 may be further configured to: compare the motion vectors corresponding to the different sub-regions when the motion vectors of the plurality of encoded units correspond to different ones of the plurality of sub-regions And a sub-region having a larger number of motion vectors as a search sub-region of the current coding unit.
  • the search sub-area determination unit 601 may be further configured to: compare the residuals of the plurality of coded units when the number of motion vectors corresponding to the different sub-areas are the same; and correspond to the smaller residuals
  • the sub-region is used as the search sub-region of the current coding unit.
  • the image encoding device may also include other components or modules, and for the specific content of these components or modules, reference may be made to the prior art.
  • the search area for obtaining the motion vector of the current coding unit is divided into a plurality of sub-areas; and the search sub-area of the current coding unit is determined from the plurality of sub-areas according to the motion vector of the coded unit; Obtaining a motion vector of the current coding unit based on the search sub-region.
  • the search area can be narrowed down, and the number of search points can be reduced, so that the encoding/decoding time of the PMMVD can be shortened.
  • the embodiment of the present invention provides an image decoding apparatus, which uses the PMMVD method for encoding.
  • the embodiment of the present invention corresponds to the image decoding method of Embodiment 2, and the same content is not described herein again.
  • FIG. 7 is a schematic diagram of an image decoding apparatus according to an embodiment of the present invention. As shown in FIG. 7, the image decoding apparatus 700 includes:
  • Search sub-area determining section 701 which determines a search sub-area of the current decoding unit from a plurality of sub-areas of the search area according to a motion vector of the decoded unit;
  • a motion vector obtaining section 702 that obtains a motion vector of the current decoding unit based on the search sub-region
  • the image decoding section 703 decodes the current decoding unit based on the motion vector of the current decoding unit and the residual information obtained from the bitstream.
  • the image decoding apparatus 700 may further include:
  • the sub-area dividing section 704 divides the search area for obtaining the motion vector of the current decoding unit into a plurality of sub-areas.
  • the decoded unit may include one or more of the following: a left decoding unit, an upper decoding unit, an upper left decoding unit, and an upper right decoding unit of the current decoding unit; however, the present invention is not limited thereto.
  • the search sub-region determining unit 701 may be specifically configured to: when a motion vector of one decoded unit corresponds to a certain one of the plurality of sub-regions, use the certain sub-region as a Current The search sub-area of the decoding unit.
  • the search sub-area determining unit 701 may be further configured to: determine whether a motion vector of the plurality of decoded units corresponds to one of the plurality of sub-areas; and each of the plurality of sub-areas In the case of a region, the certain sub-region is used as the search sub-region of the current decoding unit.
  • the search sub-region determining unit 701 is further configured to: compare the motion vectors corresponding to the different sub-regions when the motion vectors of the plurality of decoded units correspond to different ones of the plurality of sub-regions And a sub-region having a larger number of motion vectors as a search sub-region of the current decoding unit.
  • the search sub-region determining unit 701 is further configured to: compare the residuals of the plurality of decoded units when the number of motion vectors corresponding to the different sub-regions is the same; and correspond to the smaller residuals The sub-region is used as the search sub-region of the current decoding unit.
  • the image decoding device may also include other components or modules, and the specific content of these components or modules may refer to the prior art.
  • the search area for obtaining the motion vector of the current decoding unit is divided into a plurality of sub-areas; the search sub-area of the current decoding unit is determined from the plurality of sub-areas according to the motion vector of the decoded unit; A motion vector of the current decoding unit is obtained based on the search sub-region.
  • the search area can be narrowed down, and the number of search points can be reduced, so that the encoding/decoding time of the PMMVD can be shortened.
  • Embodiments of the present invention provide an image processing apparatus including an encoder and/or a decoder.
  • the encoder comprises the image encoding device as described in embodiment 3; and the decoder comprises the image decoding device as described in embodiment 4.
  • FIG. 8 is a schematic diagram of an encoder according to an embodiment of the present invention.
  • the encoder 800 can include a central processing unit (CPU) 100 and a memory 110; the memory 110 is coupled to the central processing unit 100.
  • the memory 110 can store various data; in addition, a program for information processing is stored, and the program is executed under the control of the central processing unit 100.
  • the functionality of image encoding device 600 may be integrated into central processor 100.
  • the central processing unit 100 can be configured to implement the image encoding method as described in Embodiment 1.
  • image encoding device 600 can be configured separately from central processor 100, such as The image encoding device 600 can be configured as a chip connected to the central processing unit 100, and the functions of the image encoding device 600 can be realized by the control of the central processing unit 100.
  • the central processing unit 100 may be configured to perform control of determining a search sub-region of the current coding unit from a plurality of sub-regions of the search region according to a motion vector of the encoded unit; obtaining the based on the search sub-region a motion vector of a current coding unit; calculating residual information of the current coding unit according to the motion vector; and coding residual information of the current coding unit into a bitstream.
  • the encoder 800 may further include: an input/output (I/O) device 120, a display 130, and the like; wherein the functions of the above components are similar to those of the prior art, and are not described herein again. It should be noted that the encoder 800 does not necessarily have to include all of the components shown in FIG. 8; in addition, the encoder 800 may also include components not shown in FIG. 8, and reference may be made to the prior art.
  • I/O input/output
  • An embodiment of the present invention further provides a decoder, and the decoder may be configured as shown in FIG. 8.
  • the central processing unit 100 may be configured to perform control of determining a search sub-region of the current decoding unit from a plurality of sub-regions of the search region according to a motion vector of the decoded unit; obtaining the based on the search sub-region a motion vector of a current decoding unit; and decoding the current decoding unit according to a motion vector of the current decoding unit and residual information obtained from the bitstream.
  • An embodiment of the present invention provides a computer readable program, wherein when the program is executed in an image encoding device or an image processing device, the program causes the image encoding device or the image processing device to perform the method as described in Embodiment 1. Image coding method.
  • An embodiment of the present invention provides a storage medium storing a computer readable program, wherein the computer readable program causes an image encoding device or an image processing device to perform the image encoding method as described in Embodiment 1.
  • An embodiment of the present invention provides a computer readable program, wherein when the program is executed in an image decoding device or an image processing device, the program causes the image decoding device or the image processing device to perform the method as described in Embodiment 1. Image decoding method.
  • An embodiment of the present invention provides a storage medium storing a computer readable program, wherein the computer readable program causes an image decoding device or an image processing device to perform the image decoding method as described in Embodiment 1.
  • the above apparatus and method of the present invention may be implemented by hardware or by hardware in combination with software.
  • the present invention relates to a computer readable program that, when executed by a logic component, enables the logic component to implement the apparatus or components described above, or to cause the logic component to implement the various methods described above Or steps.
  • the present invention also relates to a storage medium for storing the above program, such as a hard disk, a magnetic disk, an optical disk, a DVD, a flash memory, or the like.
  • the method/apparatus described in connection with the embodiments of the invention may be embodied directly in hardware, a software module executed by a processor, or a combination of both.
  • one or more of the functional block diagrams shown in FIG. 6 and/or one or more combinations of functional block diagrams may correspond to a computer program.
  • Each software module of the process may also correspond to each hardware module.
  • These software modules may correspond to the respective steps shown in FIG. 3, respectively.
  • These hardware modules can be implemented, for example, by curing these software modules using a Field Programmable Gate Array (FPGA).
  • FPGA Field Programmable Gate Array
  • the software module can reside in RAM memory, flash memory, ROM memory, EPROM memory, EEPROM memory, registers, hard disk, removable disk, CD-ROM, or any other form of storage medium known in the art.
  • a storage medium can be coupled to the processor to enable the processor to read information from, and write information to, the storage medium; or the storage medium can be an integral part of the processor.
  • the processor and the storage medium can be located in an ASIC.
  • the software module can be stored in the memory of the mobile terminal or in a memory card that can be inserted into the mobile terminal.
  • the software module can be stored in the MEGA-SIM card or a large-capacity flash memory device.
  • One or more of the functional blocks described in the figures and/or one or more combinations of functional blocks may be implemented as a general purpose processor, digital signal processor (DSP) for performing the functions described herein.
  • DSP digital signal processor
  • ASIC application specific integrated circuit
  • FPGA field programmable gate array
  • One or more of the functional blocks described with respect to the figures and/or one or more combinations of functional blocks may also be implemented as a combination of computing devices, eg, a combination of a DSP and a microprocessor, multiple microprocessors One or more microprocessors in conjunction with DSP communication or any other such configuration.
  • An image encoding method for encoding using a pattern matching motion vector derivation method comprising:
  • the residual information of the current coding unit is programmed into a bitstream.
  • the image encoding method according to the supplementary note 1, wherein the image encoding method further comprises:
  • the search area for obtaining the motion vector of the current coding unit is divided into a plurality of sub-areas.
  • the encoded unit includes one or more of: a left coding unit, an upper coding unit, an upper left coding unit, and an upper right coding of the current coding unit. unit.
  • determining the search sub-region of the current coding unit from the plurality of sub-regions according to the motion vector of the encoded unit comprises:
  • the certain sub-region is used as a search sub-region of the current coding unit.
  • the image encoding method according to the supplementary note 1, wherein the selecting the search sub-region of the current coding unit from the plurality of sub-regions according to the motion vector of the encoded unit comprises:
  • the certain sub-region is used as a search sub-region of the current coding unit.
  • the image encoding method further comprises:
  • a sub-region having a large number of motion vectors is used as a search sub-region of the current coding unit.
  • the image encoding method according to the sixth aspect wherein the image encoding method further comprises:
  • the sub-region corresponding to the smaller residual is used as the search sub-region of the current coding unit.
  • an image decoding method is performed by using a pattern matching motion vector derivation method, the image decoding method comprising:
  • the current decoding unit is decoded according to a motion vector of the current decoding unit and residual information obtained from the bitstream.
  • image decoding method further comprises:
  • the search area for obtaining the motion vector of the current decoding unit is divided into a plurality of sub-areas.
  • the decoded unit comprises one or more of: a left decoding unit, an upper decoding unit, an upper left decoding unit, and an upper right decoding of the current decoding unit. unit.
  • determining the search sub-region of the current decoding unit from the plurality of sub-regions according to a motion vector of the decoded unit comprises:
  • the certain sub-region is used as a search sub-region of the current decoding unit.
  • the selecting the search sub-region of the current decoding unit from the plurality of sub-regions according to the motion vector of the decoded unit comprises:
  • the certain sub-region is used as a search sub-region of the current decoding unit.
  • a sub-region having a large number of motion vectors is used as a search sub-region of the current decoding unit.
  • the image decoding method according to the supplementary note 13, wherein the image decoding method further comprises:
  • the sub-region corresponding to the smaller residual is used as the search sub-region of the current decoding unit.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Compression Or Coding Systems Of Tv Signals (AREA)

Abstract

一种图像编码/解码方法、装置以及图像处理设备。所述图像编码方法包括:根据已编码单元的运动矢量从搜索区域的多个子区域中确定当前编码单元的搜索子区域;基于所述搜索子区域获得所述当前编码单元的运动矢量;根据所述运动矢量计算所述当前编码单元的残差信息;以及将所述当前编码单元的残差信息编入比特流。由此,可以缩小搜索区域,减少搜索点的数量,从而可以缩短PMMVD的编码/解码时间。

Description

图像编码/解码方法、装置以及图像处理设备 技术领域
本发明涉及图形图像技术领域,特别涉及一种图像编码/解码方法、装置以及图像处理设备。
背景技术
在视频编码/解码(也可称为图像编码/解码)标准(例如MPEG 2,H.264/AVC,H.265/HEVC)中,帧内编码(Intra coding,也可称为帧内预测编码)使用重建的相邻像素来预测当前的待编码块。
在视频编码/解码标准中,运动矢量(MV,Motion Vector)用来表示当前帧相对于参考帧的位移;根据这个位移,解码器可以从参考图像中取得参考块,加上从比特流(或者也称为码流)解码得到的残差数据,得到当前块的解码值。传统编码/解码标准中,MV都被压缩后编入比特流,以便解码器知道去哪里取参考数据。
图1是视频编码/解码中运动矢量的一示意图,如图1所示,MV例如表示当前编码单元(CU,Coding Unit)相对于参考CU的位移(例如包括方向和大小)。如图1所示,MV可以包括运动矢量差(MVD,Motion Vector Difference)和运动矢量预测(MVP,Motion Vector Prediction)。
在下一代视频编解码标准中引入了新工具,即模式匹配运动矢量导出(PMMVD,Pattern Matched Motion Vector Derivation)。PMMVD为了节约比特流中的比特数(或者也称为码率),在比特流当中不会编入MV;解码端根据编码端同样的搜索方法,在MV候选中选取代价(cost)最小的候选,作为当前解码单元(以下也可称为CU)最后的MV,然后根据该MV取参考数据。
图2是使用PMMVD方式的解码端获取MV的一示意图,如图2所示,解码器先在搜索区域进行第一阶段的搜索,该搜索区域可以是预先确定的。在第一阶段中,例如以4个像素为间隔进行粗搜索,可以得到第一阶段结果最好的候选。然后,在该第一阶段结果最好的候选所对应的区域周围进行第二阶段的搜索,例如以2个像素为间隔进行精搜索,可以得到第二阶段结果最好的候选,将该候选作为当前CU的MV。
因为当前CU的数据在解码端没有解码而无法得到,所以运动估计搜索可以使用 当前CU的左边4列和上边4行重建数据,编码端和解码端都是如此,这就可以保证解码端的搜索结果和编码端一致。
应该注意,上面对技术背景的介绍只是为了方便对本发明的技术方案进行清楚、完整的说明,并方便本领域技术人员的理解而阐述的。不能仅仅因为这些方案在本发明的背景技术部分进行了阐述而认为上述技术方案为本领域技术人员所公知。
发明内容
但是,发明人发现:传统编码/解码只需要简单运算即可得到MV,但是PMMVD需要在解码端通过和编码端同样的搜索过程才能得到MV,这个过程导致解码端的解码时间长达原来的300%,这对于实现实时解码是个很大的挑战。
本发明实施例提供一种图像编码/解码方法、装置以及图像处理设备,希望能够缩短PMMVD的编码/解码时间。
根据本发明实施例的第一个方面,提供一种图像编码方法,使用模式匹配运动矢量导出方式进行编码,所述图像编码方法包括:
根据已编码单元的运动矢量从搜索区域的多个子区域中确定所述当前编码单元的搜索子区域;
基于所述搜索子区域获得所述当前编码单元的运动矢量;
根据所述运动矢量计算所述当前编码单元的残差信息;以及
将所述当前编码单元的残差信息编入比特流。
根据本发明实施例的第二个方面,提供一种图像编码装置,使用模式匹配运动矢量导出方式进行编码,所述图像编码装置包括:
搜索子区域确定部,其根据已编码单元的运动矢量从搜索区域的多个子区域中确定所述当前编码单元的搜索子区域;
运动矢量获得部,其基于所述搜索子区域获得所述当前编码单元的运动矢量;
残差计算部,其根据所述运动矢量计算所述当前编码单元的残差信息;以及
比特流编码部,其将所述当前编码单元的残差信息编入比特流。
根据本发明实施例的第三个方面,提供一种图像解码方法,使用模式匹配运动矢量导出方式进行解码,所述图像解码方法包括:
根据已解码单元的运动矢量从搜索区域的多个子区域中确定所述当前解码单元 的搜索子区域;
基于所述搜索子区域获得所述当前解码单元的运动矢量;以及
根据所述当前解码单元的运动矢量以及从比特流中获得的残差信息对所述当前解码单元进行解码。
根据本发明实施例的第四个方面,提供一种图像解码装置,使用模式匹配运动矢量导出方式进行解码,所述图像解码装置包括:
搜索子区域确定部,其根据已解码单元的运动矢量从搜索区域的多个子区域中确定所述当前解码单元的搜索子区域;
运动矢量获得部,其基于所述搜索子区域获得所述当前解码单元的运动矢量;以及
图像解码部,其根据所述当前解码单元的运动矢量以及从比特流中获得的残差信息对所述当前解码单元进行解码。
根据本发明实施例的第五个方面,提供一种图像处理设备,其中,所述图像处理设备包括:
编码器,其包括如上所述的图像编码装置;和/或
解码器,其包括如上所述的图像解码装置。
根据本发明实施例的又一个方面,提供一种计算机可读程序,其中当在图像编码装置或者图像处理设备中执行所述程序时,所述程序使得所述图像编码装置或者图像处理设备执行如上所述的图像编码方法。
根据本发明实施例的又一个方面,提供一种存储有计算机可读程序的存储介质,其中所述计算机可读程序使得图像编码装置或者图像处理设备执行如上所述的图像编码方法。
根据本发明实施例的又一个方面,提供一种计算机可读程序,其中当在图像解码装置或者图像处理设备中执行所述程序时,所述程序使得所述图像解码装置或者图像处理设备执行如上所述的图像解码方法。
根据本发明实施例的又一个方面,提供一种存储有计算机可读程序的存储介质,其中所述计算机可读程序使得图像解码装置或者图像处理设备执行如上所述的图像解码方法。
本发明实施例的有益效果在于:将用于获得当前编码单元的运动矢量的搜索区域 划分为多个子区域;根据已编码单元的运动矢量从所述多个子区域中确定所述当前编码单元的搜索子区域;基于所述搜索子区域获得所述当前编码单元的运动矢量。由此,可以缩小搜索区域,减少搜索点的数量,从而可以缩短PMMVD的编码/解码时间。
参照后文的说明和附图,详细公开了本发明的特定实施方式,指明了本发明的原理可以被采用的方式。应该理解,本发明的实施方式在范围上并不因而受到限制。在所附权利要求的精神和条款的范围内,本发明的实施方式包括许多改变、修改和等同。
针对一种实施方式描述和/或示出的特征可以以相同或类似的方式在一个或更多个其它实施方式中使用,与其它实施方式中的特征相组合,或替代其它实施方式中的特征。
应该强调,术语“包括/包含”在本文使用时指特征、整件、步骤或组件的存在,但并不排除一个或更多个其它特征、整件、步骤或组件的存在或附加。
附图说明
参照以下的附图可以更好地理解本发明的很多方面。附图中的部件不是成比例绘制的,而只是为了示出本发明的原理。为了便于示出和描述本发明的一些部分,附图中对应部分可能被放大或缩小。
在本发明的一个附图或一种实施方式中描述的元素和特征可以与一个或更多个其它附图或实施方式中示出的元素和特征相结合。此外,在附图中,类似的标号表示几个附图中对应的部件,并可用于指示多于一种实施方式中使用的对应部件。
图1是视频编码/解码中运动矢量的一示意图;
图2是使用PMMVD方式的解码端获取MV的一示意图;
图3是本发明实施例1的图像编码方法的一示意图;
图4是本发明实施例1的确定搜索子区域的一示意图;
图5是本发明实施例2的图像解码方法的一示意图;
图6是本发明实施例3的图像编码装置的一示意图;
图7是本发明实施例4的图像解码装置的一示意图;
图8是本发明实施例5的编码器/解码器的一示意图。
具体实施方式
参照附图,通过下面的说明书,本发明的前述以及其它特征将变得明显。在说明书和附图中,具体公开了本发明的特定实施方式,其表明了其中可以采用本发明的原则的部分实施方式,应了解的是,本发明不限于所描述的实施方式,相反,本发明包括落入所附权利要求的范围内的全部修改、变型以及等同物。
实施例1
本发明实施例提供一种图像编码方法,使用PMMVD方式进行编码,从编码端一侧进行说明。图3是本发明实施例的图像编码方法的一示意图。如图3所示,所述图像编码方法包括:
步骤301,根据已编码单元的运动矢量从搜索区域的多个子区域中确定当前编码单元的搜索子区域;
步骤302,基于所述搜索子区域获得当前编码单元的运动矢量;
步骤303,根据所述运动矢量计算所述当前编码单元的残差信息;以及
步骤304,将所述当前编码单元的残差信息编入比特流。
在本实施例中,用于获得当前编码单元的运动矢量的搜索区域可以预先确定,例如仍然使用PMMVD的搜索区域,具体如何确定可以参考相关技术。
在本实施例中,可以预先将该搜索区域划分为多个子区域,例如划分为2组或者3组等;本发明不限于此,还可以是其他的数目。此外,搜索区域的多个子区域还可以是动态确定的,例如在确定左边CU的MV对应某个子区域后,可以将该子区域作为第1子区域,而将除了该第1子区域的其他搜索区域作为第2子区域;等等。
在本实施例中,可以根据已编码单元的MV确定当前编码单元的搜索子区域。例如,在所述已编码单元的MV对应所述多个子区域中的某一子区域(例如区域1)的情况下,将所述某一子区域(例如区域1)作为所述当前编码单元的搜索子区域。
在本实施例中,可以基于该搜索子区域获得当前CU的MV。具体地,仍然可以采用两阶段搜索的方法,例如第一阶段以4像素为间隔进行粗搜索,第二阶段以2像素为间隔进行搜索;具体内容可以参考相关技术。此外,具体如何计算残差信息以及如何进行比特流编码,可以参考相关技术,此处不再赘述。
由此,根据已编码单元的MV可以缩小当前编码单元的搜索范围,减少搜索点的数量,从而可以缩短PMMVD的编码/解码时间。
在本实施例中,已编码单元可以是一个或者多个;例如可以是当前CU的左边CU、上边CU、左上CU和右上CU中的一个或多个;但本发明不限于此。此外,在本实施例中的编码单元可以是通常意义下的CU,或者也可以是LCU等等,但本发明不限于此,可以根据实际情况确定编码单元的大小。
以下将以左边编码单元、上边编码单元、左上编码单元和右上编码单元均被考虑为例,对本发明如何确定搜索子区域进行详细说明。但本发明不限于此,例如也可以仅考虑左边编码单元和上边编码单元,或者仅考虑左边编码单元,等等。
图4是本发明实施例的确定搜索子区域的一示意图,如图4所示,确定搜索子区域的过程可以包括:
步骤401,确定多个已编码单元的运动矢量是否均对应多个子区域中的某一子区域;如果是则执行步骤402,否则执行步骤403。
步骤402,将所述某一子区域作为当前编码单元的搜索子区域;
例如,如果搜索区域被划分为2个子区域,左边CU的MV、上边CU的MV、左上CU的MV和右上CU的MV均对应(或者也可以称为落入)第1子区域,则可以将该第1子区域作为当前CU的搜索子区域。
步骤403,比较不同子区域分别对应的运动矢量的个数是否相同;如果不是则执行步骤404,否则执行步骤405。
步骤404,将运动矢量的个数较多的子区域作为当前编码单元的搜索子区域;
例如,如果左边CU的MV、上边CU的MV、左上CU的MV对应(或者也可以称为落入)第1子区域,而右上CU的MV对应第2子区域,则可以进一步比较第1子区域和第2子区域所对应的MV的个数。例如上述例子中第1子区域所对应的MV的个数较多,则可以将该第1子区域作为当前CU的搜索子区域。
步骤405,比较各个已编码编码单元的残差。
步骤406,将较小残差所对应的子区域作为当前编码单元的搜索子区域;
例如,如果左边CU的MV和上边CU的MV对应(或者也可以称为落入)第1子区域,而左上CU的MV和右上CU的MV对应第2子区域,即第1子区域和第2子区域所对应的MV的个数相同,则可以进一步比较各个已编码CU的残差。例如如果左边CU和上边CU的残差较小,而左上CU和右上CU的残差较大,则可以将左边CU和上边CU所对应的该第1子区域作为当前CU的搜索子区域。
在本实施例中,如果各个已编码CU的残差仍然相同,则可以进一步使用其他的规则确定当前CU的搜索子区域。例如在该情况下,仍然使用整个搜索区域来获取当前CU的MV,或者从第1子区域或第2子区域中任意选择一个,等等。图4中为了简单起见,省略了残差仍然相同时的处理。
值得注意的是,当残差差距不大,例如小于一个预设阈值时,可以认为残差是相同的。而且,如果各个CU块的大小并不相同,还需要将残差根据CU块的大小进行归一化处理。
以上仅对如何确定搜索子区域进行了示意性说明,但本发明不限于此。例如可以适当地调整各个步骤之间的执行顺序,此外还可以增加其他的一些步骤或者减少其中的某些步骤。本领域的技术人员可以根据上述内容进行适当地变型,而不仅限于上述附图的记载。
以上仅对与本发明相关的各步骤或过程进行了说明,但本发明不限于此。图像编码方法还可以包括其他步骤或者过程,关于这些步骤或者过程的具体内容,可以参考现有技术。
由上述实施例可知,将用于获得当前编码单元的运动矢量的搜索区域划分为多个子区域;根据已编码单元的运动矢量从所述多个子区域中确定所述当前编码单元的搜索子区域;基于所述搜索子区域获得所述当前编码单元的运动矢量。由此,可以缩小搜索区域,减少搜索点的数量,从而可以缩短PMMVD的编码/解码时间。
实施例2
本发明实施例提供一种图像解码方法,使用PMMVD方式进行解码;本发明实施例从解码端一侧进行说明,与实施例1相同的内容不再赘述。
图5是本发明实施例的图像解码方法的一示意图,如图5所示,所述图像解码方法包括:
步骤501,根据已解码单元的运动矢量从搜索区域的多个子区域中确定当前解码单元的搜索子区域;
步骤502,基于所述搜索子区域获得所述当前解码单元的运动矢量;以及
步骤503根据所述当前解码单元的运动矢量以及从比特流中获得的残差信息对所述当前解码单元进行解码。
在本实施例中,可以预先将该搜索区域划分为多个子区域,例如划分为2组或者3组等;本发明不限于此,还可以是其他的数目。此外,搜索区域的多个子区域还可以是动态确定的。
在本实施例中,可以基于该搜索子区域获得当前解码单元的MV。具体地,仍然可以采用两阶段搜索的方法,例如第一阶段以4像素为间隔进行粗搜索,第二阶段以2像素为间隔进行搜索;具体内容可以参考相关技术。此外,具体如何从比特流中获得残差信息以及如何对解码单元进行解码,可以参考相关技术,此处不再赘述。
值得注意的是,本实施例中解码单元和实施例1中的编码单元采用相同的大小,为了区别起见分别称为编码单元和解码单元,在不引起混淆的情况下,也可以将解码端的解码单元称为CU或LCU等。
在本实施例中,所述已解码单元可以包括如下的一个或多个:所述当前解码单元的左边解码单元、上边解码单元、左上解码单元和右上解码单元;但本发明不限于此。
在本实施例中,根据已解码单元的运动矢量从所述多个子区域中确定所述当前解码单元的搜索子区域,具体可以包括:在一个已解码单元的运动矢量对应所述多个子区域中的某一子区域的情况下,将所述某一子区域作为所述当前解码单元的搜索子区域。
在本实施例中,根据已解码单元的运动矢量从所述多个子区域中确定所述当前解码单元的搜索子区域,具体还可以包括::确定多个已解码单元的运动矢量是否均对应所述多个子区域中的某一子区域;在均对应所述多个子区域中的某一子区域的情况下,将所述某一子区域作为所述当前解码单元的搜索子区域。
图像解码方法还可以包括:在所述多个已解码单元的运动矢量对应所述多个子区域中的不同子区域的情况下,比较所述不同子区域分别对应的运动矢量的个数;以及将运动矢量的个数较多的子区域作为所述当前解码单元的搜索子区域。
图像解码方法还可以包括:在所述不同子区域分别对应的运动矢量的个数相同的情况下,比较所述多个已解码单元的残差;以及将较小残差所对应的子区域作为所述当前解码单元的搜索子区域。
以上仅对与本发明相关的各步骤或过程进行了说明,但本发明不限于此。图像解码方法还可以包括其他步骤或者过程,关于这些步骤或者过程的具体内容,可以参考现有技术。
由上述实施例可知,将用于获得当前解码单元的运动矢量的搜索区域划分为多个子区域;根据已解码单元的运动矢量从所述多个子区域中确定所述当前解码单元的搜索子区域;基于所述搜索子区域获得所述当前解码单元的运动矢量。由此,可以缩小搜索区域,减少搜索点的数量,从而可以缩短PMMVD的编码/解码时间。
实施例3
本发明实施例提供一种图像编码装置,使用PMMVD方式进行编码;本发明实施例对应于实施例1的图像编码方法,相同的内容不再赘述。
图6是本发明实施例的图像编码装置的一示意图,如图6所示,图像编码装置600包括:
搜索子区域确定部601,其根据已编码单元的运动矢量从搜索区域的多个子区域中确定所述当前编码单元的搜索子区域;
运动矢量获得部602,其基于所述搜索子区域获得所述当前编码单元的运动矢量;
残差计算部603,其根据所述运动矢量计算所述当前编码单元的残差信息;以及
比特流编码部604,其将所述当前编码单元的残差信息编入比特流。
如图6所示,图像编码装置600还可以包括:
子区域划分部605,其将用于获得当前编码单元的运动矢量的所述搜索区域划分为多个子区域。
在本实施例中,所述已编码单元可以包括如下的一个或多个:所述当前编码单元的左边编码单元、上边编码单元、左上编码单元和右上编码单元;但本发明不限于此。
在本实施例中,搜索子区域确定部601可以用于:在一个已编码单元的运动矢量对应所述多个子区域中的某一子区域的情况下,将所述某一子区域作为所述当前编码单元的搜索子区域。
搜索子区域确定部601具体还可以用于:确定多个已编码单元的运动矢量是否均对应所述多个子区域中的某一子区域;以及在均对应所述多个子区域中的某一子区域的情况下,将所述某一子区域作为所述当前编码单元的搜索子区域。
搜索子区域确定部601还可以用于:在所述多个已编码单元的运动矢量对应所述多个子区域中的不同子区域的情况下,比较所述不同子区域分别对应的运动矢量的个数;以及将运动矢量的个数较多的子区域作为所述当前编码单元的搜索子区域。
搜索子区域确定部601还可以用于:在所述不同子区域分别对应的运动矢量的个数相同的情况下,比较所述多个已编码单元的残差;以及将较小残差所对应的子区域作为所述当前编码单元的搜索子区域。
值得注意的是,以上仅对与本发明相关的各部件进行了说明,但本发明不限于此。图像编码装置还可以包括其他部件或者模块,关于这些部件或者模块的具体内容,可以参考现有技术。
由上述实施例可知,将用于获得当前编码单元的运动矢量的搜索区域划分为多个子区域;根据已编码单元的运动矢量从所述多个子区域中确定所述当前编码单元的搜索子区域;基于所述搜索子区域获得所述当前编码单元的运动矢量。由此,可以缩小搜索区域,减少搜索点的数量,从而可以缩短PMMVD的编码/解码时间。
实施例4
本发明实施例提供一种图像解码装置,使用PMMVD方式进行编码;本发明实施例对应于实施例2的图像解码方法,相同的内容不再赘述。
图7是本发明实施例的图像解码装置的一示意图,如图7所示,图像解码装置700包括:
搜索子区域确定部701,其根据已解码单元的运动矢量从搜索区域的多个子区域中确定所述当前解码单元的搜索子区域;
运动矢量获得部702,其基于所述搜索子区域获得所述当前解码单元的运动矢量;以及
图像解码部703,其根据所述当前解码单元的运动矢量以及从比特流中获得的残差信息对所述当前解码单元进行解码。
如图7所示,图像解码装置700还可以包括:
子区域划分部704,其将用于获得当前解码单元的运动矢量的所述搜索区域划分为多个子区域。
在本实施例中,所述已解码单元可以包括如下的一个或多个:所述当前解码单元的左边解码单元、上边解码单元、左上解码单元和右上解码单元;但本发明不限于此。
在本实施例中,搜索子区域确定部701具体可以用于:在一个已解码单元的运动矢量对应所述多个子区域中的某一子区域的情况下,将所述某一子区域作为所述当前 解码单元的搜索子区域。
搜索子区域确定部701具体还可以用于:确定多个已解码单元的运动矢量是否均对应所述多个子区域中的某一子区域;以及在均对应所述多个子区域中的某一子区域的情况下,将所述某一子区域作为所述当前解码单元的搜索子区域。
搜索子区域确定部701还可以用于:在所述多个已解码单元的运动矢量对应所述多个子区域中的不同子区域的情况下,比较所述不同子区域分别对应的运动矢量的个数;以及将运动矢量的个数较多的子区域作为所述当前解码单元的搜索子区域。
搜索子区域确定部701还可以用于:在所述不同子区域分别对应的运动矢量的个数相同的情况下,比较所述多个已解码单元的残差;以及将较小残差所对应的子区域作为所述当前解码单元的搜索子区域。
值得注意的是,以上仅对与本发明相关的各部件进行了说明,但本发明不限于此。图像解码装置还可以包括其他部件或者模块,关于这些部件或者模块的具体内容,可以参考现有技术。
由上述实施例可知,将用于获得当前解码单元的运动矢量的搜索区域划分为多个子区域;根据已解码单元的运动矢量从所述多个子区域中确定所述当前解码单元的搜索子区域;基于所述搜索子区域获得所述当前解码单元的运动矢量。由此,可以缩小搜索区域,减少搜索点的数量,从而可以缩短PMMVD的编码/解码时间。
实施例5
本发明实施例提供一种图像处理设备,该图像处理设备包括编码器和/或解码器。其中编码器包括如实施例3所述的图像编码装置;解码器包括如实施例4所述的图像解码装置。
图8是本发明实施例的编码器的一示意图。如图8所示,编码器800可以包括:中央处理器(CPU)100和存储器110;存储器110耦合到中央处理器100。其中该存储器110可存储各种数据;此外还存储信息处理的程序,并且在中央处理器100的控制下执行该程序。
在一个实施方式中,图像编码装置600的功能可以被集成到中央处理器100中。其中,中央处理器100可以被配置为实现如实施例1所述的图像编码方法。
在另一个实施方式中,图像编码装置600可以与中央处理器100分开配置,例如 可以将图像编码装置600配置为与中央处理器100连接的芯片,通过中央处理器100的控制来实现图像编码装置600的功能。
例如,中央处理器100可以被配置为进行如下的控制:根据已编码单元的运动矢量从搜索区域的多个子区域中确定所述当前编码单元的搜索子区域;基于所述搜索子区域获得所述当前编码单元的运动矢量;根据所述运动矢量计算所述当前编码单元的残差信息;以及将所述当前编码单元的残差信息编入比特流。
此外,如图8所示,编码器800还可以包括:输入输出(I/O)设备120和显示器130等;其中,上述部件的功能与现有技术类似,此处不再赘述。值得注意的是,编码器800也并不是必须要包括图8中所示的所有部件;此外,编码器800还可以包括图8中没有示出的部件,可以参考现有技术。
本发明实施例还提供一种解码器,该解码器的构成可以参考图8。
例如,中央处理器100可以被配置为进行如下的控制:根据已解码单元的运动矢量从搜索区域的多个子区域中确定所述当前解码单元的搜索子区域;基于所述搜索子区域获得所述当前解码单元的运动矢量;以及根据所述当前解码单元的运动矢量以及从比特流中获得的残差信息对所述当前解码单元进行解码。
本发明实施例提供一种计算机可读程序,其中当在图像编码装置或图像处理设备中执行所述程序时,所述程序使得所述图像编码装置或图像处理设备执行如实施例1所述的图像编码方法。
本发明实施例提供一种存储有计算机可读程序的存储介质,其中所述计算机可读程序使得图像编码装置或图像处理设备执行如实施例1所述的图像编码方法。
本发明实施例提供一种计算机可读程序,其中当在图像解码装置或图像处理设备中执行所述程序时,所述程序使得所述图像解码装置或图像处理设备执行如实施例1所述的图像解码方法。
本发明实施例提供一种存储有计算机可读程序的存储介质,其中所述计算机可读程序使得图像解码装置或图像处理设备执行如实施例1所述的图像解码方法。
本发明以上的装置和方法可以由硬件实现,也可以由硬件结合软件实现。本发明涉及这样的计算机可读程序,当该程序被逻辑部件所执行时,能够使该逻辑部件实现上文所述的装置或构成部件,或使该逻辑部件实现上文所述的各种方法或步骤。本发明还涉及用于存储以上程序的存储介质,如硬盘、磁盘、光盘、DVD、flash存储器等。
结合本发明实施例描述的方法/装置可直接体现为硬件、由处理器执行的软件模块或二者组合。例如,图6中所示的功能框图中的一个或多个和/或功能框图的一个或多个组合(例如,搜索子区域确定部、运动矢量获得部等等),既可以对应于计算机程序流程的各个软件模块,亦可以对应于各个硬件模块。这些软件模块,可以分别对应于图3所示的各个步骤。这些硬件模块例如可利用现场可编程门阵列(FPGA)将这些软件模块固化而实现。
软件模块可以位于RAM存储器、闪存、ROM存储器、EPROM存储器、EEPROM存储器、寄存器、硬盘、移动磁盘、CD-ROM或者本领域已知的任何其它形式的存储介质。可以将一种存储介质耦接至处理器,从而使处理器能够从该存储介质读取信息,且可向该存储介质写入信息;或者该存储介质可以是处理器的组成部分。处理器和存储介质可以位于ASIC中。该软件模块可以存储在移动终端的存储器中,也可以存储在可插入移动终端的存储卡中。例如,若设备(如移动终端)采用的是较大容量的MEGA-SIM卡或者大容量的闪存装置,则该软件模块可存储在该MEGA-SIM卡或者大容量的闪存装置中。
针对附图中描述的功能方框中的一个或多个和/或功能方框的一个或多个组合,可以实现为用于执行本申请所描述功能的通用处理器、数字信号处理器(DSP)、专用集成电路(ASIC)、现场可编程门阵列(FPGA)或者其它可编程逻辑器件、分立门或者晶体管逻辑器件、分立硬件组件或者其任意适当组合。针对附图描述的功能方框中的一个或多个和/或功能方框的一个或多个组合,还可以实现为计算设备的组合,例如,DSP和微处理器的组合、多个微处理器、与DSP通信结合的一个或多个微处理器或者任何其它这种配置。
以上结合具体的实施方式对本发明进行了描述,但本领域技术人员应该清楚,这些描述都是示例性的,并不是对本发明保护范围的限制。本领域技术人员可以根据本发明的精神和原理对本发明做出各种变型和修改,这些变型和修改也在本发明的范围内。
关于包括以上实施例的实施方式,还公开下述的附记:
附记1、一种图像编码方法,使用模式匹配运动矢量导出方式进行编码,所述图像编码方法包括:
根据已编码单元的运动矢量从搜索区域的多个子区域中确定当前编码单元的搜 索子区域;
基于所述搜索子区域获得所述当前编码单元的运动矢量;
根据所述运动矢量计算所述当前编码单元的残差信息;以及
将所述当前编码单元的残差信息编入比特流。
附记2、根据附记1所述的图像编码方法,其中,所述图像编码方法还包括:
将用于获得当前编码单元的运动矢量的所述搜索区域划分为多个子区域。
附记3、根据附记1所述的图像编码方法,其中,所述已编码单元包括如下的一个或多个:所述当前编码单元的左边编码单元、上边编码单元、左上编码单元和右上编码单元。
附记4、根据附记1所述的图像编码方法,其中,根据已编码单元的运动矢量从所述多个子区域中确定所述当前编码单元的搜索子区域,包括:
在一个已编码单元的运动矢量对应所述多个子区域中的某一子区域的情况下,将所述某一子区域作为所述当前编码单元的搜索子区域。
附记5、根据附记1所述的图像编码方法,其中,根据已编码单元的运动矢量从所述多个子区域中选择所述当前编码单元的搜索子区域,包括:
确定多个已编码单元的运动矢量是否均对应所述多个子区域中的某一子区域;
在均对应所述多个子区域中的某一子区域的情况下,将所述某一子区域作为所述当前编码单元的搜索子区域。
附记6、根据附记5所述的图像编码方法,其中,所述图像编码方法还包括:
在所述多个已编码单元的运动矢量对应所述多个子区域中的不同子区域的情况下,比较所述不同子区域分别对应的运动矢量的个数;以及
将运动矢量的个数较多的子区域作为所述当前编码单元的搜索子区域。
附记7、根据附记6所述的图像编码方法,其中,所述图像编码方法还包括:
在所述不同子区域分别对应的运动矢量的个数相同的情况下,比较所述多个已编码单元的残差;以及
将较小残差所对应的子区域作为所述当前编码单元的搜索子区域。
附记8、一种图像解码方法,使用模式匹配运动矢量导出方式进行解码,所述图像解码方法包括:
根据已解码单元的运动矢量从搜索区域的多个子区域中确定当前解码单元的搜 索子区域;
基于所述搜索子区域获得所述当前解码单元的运动矢量;以及
根据所述当前解码单元的运动矢量以及从比特流中获得的残差信息对所述当前解码单元进行解码。
附记9、根据附记8所述的图像解码方法,其中,所述图像解码方法还包括:
将用于获得当前解码单元的运动矢量的所述搜索区域划分为多个子区域。
附记10、根据附记8所述的图像解码方法,其中,所述已解码单元包括如下的一个或多个:所述当前解码单元的左边解码单元、上边解码单元、左上解码单元和右上解码单元。
附记11、根据附记8所述的图像解码方法,其中,根据已解码单元的运动矢量从所述多个子区域中确定所述当前解码单元的搜索子区域,包括:
在一个已解码单元的运动矢量对应所述多个子区域中的某一子区域的情况下,将所述某一子区域作为所述当前解码单元的搜索子区域。
附记12、根据附记8所述的图像解码方法,其中,根据已解码单元的运动矢量从所述多个子区域中选择所述当前解码单元的搜索子区域,包括:
确定多个已解码单元的运动矢量是否均对应所述多个子区域中的某一子区域;
在均对应所述多个子区域中的某一子区域的情况下,将所述某一子区域作为所述当前解码单元的搜索子区域。
附记13、根据附记12所述的图像解码方法,其中,所述图像解码方法还包括:
在所述多个已解码单元的运动矢量对应所述多个子区域中的不同子区域的情况下,比较所述不同子区域分别对应的运动矢量的个数;以及
将运动矢量的个数较多的子区域作为所述当前解码单元的搜索子区域。
附记14、根据附记13所述的图像解码方法,其中,所述图像解码方法还包括:
在所述不同子区域分别对应的运动矢量的个数相同的情况下,比较所述多个已解码单元的残差;以及
将较小残差所对应的子区域作为所述当前解码单元的搜索子区域。

Claims (15)

  1. 一种图像编码装置,使用模式匹配运动矢量导出方式进行编码,所述图像编码装置包括:
    搜索子区域确定部,其根据已编码单元的运动矢量从搜索区域的多个子区域中确定当前编码单元的搜索子区域;
    运动矢量获得部,其基于所述搜索子区域获得所述当前编码单元的运动矢量;
    残差计算部,其根据所述运动矢量计算所述当前编码单元的残差信息;以及
    比特流编码部,其将所述当前编码单元的残差信息编入比特流。
  2. 根据权利要求1所述的图像编码装置,其中,所述图像编码装置还包括:
    子区域划分部,其将用于获得所述当前编码单元的运动矢量的所述搜索区域划分为多个子区域。
  3. 根据权利要求1所述的图像编码装置,其中,所述已编码单元包括如下的一个或多个:所述当前编码单元的左边编码单元、上边编码单元、左上编码单元和右上编码单元。
  4. 根据权利要求1所述的图像编码装置,其中,所述搜索子区域确定部用于:在一个所述已编码单元的运动矢量对应所述多个子区域中的某一子区域的情况下,将所述某一子区域作为所述当前编码单元的搜索子区域。
  5. 根据权利要求1所述的图像编码装置,其中,所述搜索子区域确定部用于:确定多个已编码单元的运动矢量是否均对应所述多个子区域中的某一子区域;以及在均对应所述多个子区域中的某一子区域的情况下,将所述某一子区域作为所述当前编码单元的搜索子区域。
  6. 根据权利要求5所述的图像编码装置,其中,所述搜索子区域确定部还用于:在所述多个已编码单元的运动矢量对应所述多个子区域中的不同子区域的情况下,比较所述不同子区域分别对应的运动矢量的个数;以及将运动矢量的个数较多的子区域作为所述当前编码单元的搜索子区域。
  7. 根据权利要求6所述的图像编码装置,其中,所述搜索子区域确定部还用于:在所述不同子区域分别对应的运动矢量的个数相同的情况下,比较所述多个已编码单元的残差;以及将较小残差所对应的子区域作为所述当前编码单元的搜索子区域。
  8. 一种图像解码装置,使用模式匹配运动矢量导出方式进行解码,所述图像解码装置包括:
    搜索子区域确定部,其根据已解码单元的运动矢量从搜索区域的多个子区域中确定当前解码单元的搜索子区域;
    运动矢量获得部,其基于所述搜索子区域获得所述当前解码单元的运动矢量;以及
    图像解码部,其根据所述当前解码单元的运动矢量以及从比特流中获得的残差信息对所述当前解码单元进行解码。
  9. 根据权利要求8所述的图像解码装置,其中,所述图像解码装置还包括:
    子区域划分部,其将用于获得所述当前解码单元的运动矢量的所述搜索区域划分为多个子区域。
  10. 根据权利要求8所述的图像解码装置,其中,所述已解码单元包括如下的一个或多个:所述当前解码单元的左边解码单元、上边解码单元、左上解码单元和右上解码单元。
  11. 根据权利要求8所述的图像解码装置,其中,所述搜索子区域确定部用于:在一个已解码单元的运动矢量对应所述多个子区域中的某一子区域的情况下,将所述某一子区域作为所述当前解码单元的搜索子区域。
  12. 根据权利要求8所述的图像解码装置,其中,所述搜索子区域确定部用于:确定多个已解码单元的运动矢量是否均对应所述多个子区域中的某一子区域;以及在均对应所述多个子区域中的某一子区域的情况下,将所述某一子区域作为所述当前解码单元的搜索子区域。
  13. 根据权利要求12所述的图像解码装置,其中,所述搜索子区域确定部还用于:在所述多个已解码单元的运动矢量对应所述多个子区域中的不同子区域的情况下,比较所述不同子区域分别对应的运动矢量的个数;以及将运动矢量的个数较多的子区域作为所述当前解码单元的搜索子区域。
  14. 根据权利要求13所述的图像解码装置,其中,所述搜索子区域确定部还用于:在所述不同子区域分别对应的运动矢量的个数相同的情况下,比较所述多个已解码单元的残差;以及将较小残差所对应的子区域作为所述当前解码单元的搜索子区域。
  15. 一种图像处理设备,其中,所述图像处理设备包括:
    编码器,其包括如权利要求1所述的图像编码装置;和/或
    解码器,其包括如权利要求8所述的图像解码装置。
PCT/CN2016/102004 2016-10-13 2016-10-13 图像编码/解码方法、装置以及图像处理设备 Ceased WO2018068264A1 (zh)

Priority Applications (4)

Application Number Priority Date Filing Date Title
PCT/CN2016/102004 WO2018068264A1 (zh) 2016-10-13 2016-10-13 图像编码/解码方法、装置以及图像处理设备
JP2019509497A JP2019530299A (ja) 2016-10-13 2016-10-13 画像コーディング/デコーディング方法、装置及び画像処理機器
CN201680088080.8A CN109496431A (zh) 2016-10-13 2016-10-13 图像编码/解码方法、装置以及图像处理设备
US16/287,705 US20190200033A1 (en) 2016-10-13 2019-02-27 Image encoding/decoding methods and apparatuses and image processing equipment

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2016/102004 WO2018068264A1 (zh) 2016-10-13 2016-10-13 图像编码/解码方法、装置以及图像处理设备

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US16/287,705 Continuation US20190200033A1 (en) 2016-10-13 2019-02-27 Image encoding/decoding methods and apparatuses and image processing equipment

Publications (1)

Publication Number Publication Date
WO2018068264A1 true WO2018068264A1 (zh) 2018-04-19

Family

ID=61905105

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2016/102004 Ceased WO2018068264A1 (zh) 2016-10-13 2016-10-13 图像编码/解码方法、装置以及图像处理设备

Country Status (4)

Country Link
US (1) US20190200033A1 (zh)
JP (1) JP2019530299A (zh)
CN (1) CN109496431A (zh)
WO (1) WO2018068264A1 (zh)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2020182043A1 (en) * 2019-03-08 2020-09-17 Huawei Technologies Co., Ltd. Search region for motion vector refinement
WO2025188105A1 (ko) * 2024-03-08 2025-09-12 경희대학교 산학협력단 영상 부호화/복호화 방법 및 장치

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1436002A (zh) * 2002-01-26 2003-08-13 Lg电子株式会社 运动矢量搜索范围的自适应确定方法
CN1791224A (zh) * 2005-12-19 2006-06-21 宁波大学 一种基于h.264的自适应块搜索范围快速运动估计方法
CN101378504A (zh) * 2007-08-31 2009-03-04 上海杰得微电子有限公司 用于h.264编码的块匹配运动估计方法
US20130279762A1 (en) * 2012-04-24 2013-10-24 Stmicroelectronics S.R.I. Adaptive search window control for visual search
US20160037166A1 (en) * 2014-08-01 2016-02-04 Ati Technologies Ulc Adaptive search window positioning for video encoding

Family Cites Families (37)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP3994445B2 (ja) * 1995-12-05 2007-10-17 ソニー株式会社 動きベクトル検出装置及び動きベクトル検出方法
US6507618B1 (en) * 2000-04-25 2003-01-14 Hewlett-Packard Company Compressed video signal including independently coded regions
US6973130B1 (en) * 2000-04-25 2005-12-06 Wee Susie J Compressed video signal including information for independently coded regions
JP4410039B2 (ja) * 2004-06-11 2010-02-03 シャープ株式会社 動き検出装置および動き検出方法、画像処理装置
KR100714698B1 (ko) * 2005-08-29 2007-05-07 삼성전자주식회사 향상된 움직임 추정 방법, 상기 방법을 이용한 비디오인코딩 방법 및 장치
US9883202B2 (en) * 2006-10-06 2018-01-30 Nxp Usa, Inc. Scaling video processing complexity based on power savings factor
US7843462B2 (en) * 2007-09-07 2010-11-30 Seiko Epson Corporation System and method for displaying a digital video sequence modified to compensate for perceived blur
US20090245374A1 (en) * 2008-03-26 2009-10-01 Mediatek Inc. Video encoder and motion estimation method
WO2010057170A1 (en) * 2008-11-17 2010-05-20 Cernium Corporation Analytics-modulated coding of surveillance video
US9204157B2 (en) * 2011-11-18 2015-12-01 Texas Instruments Incorporated Video compression searching reference frame in hybrid growing-window and sliding-window
JP2011146980A (ja) * 2010-01-15 2011-07-28 Sony Corp 画像処理装置および方法
CN102263947B (zh) * 2010-05-27 2016-07-06 香港科技大学 图像运动估计的方法及系统
CN102447894B (zh) * 2010-09-30 2013-11-06 华为技术有限公司 视频图像编码方法、解码方法和装置
CN102647587B (zh) * 2011-02-16 2015-01-21 富士通株式会社 运动估计方法和装置
TWI461066B (zh) * 2011-11-03 2014-11-11 Ind Tech Res Inst 彈性調整估算搜尋範圍的移動估算方法及視差估算方法
US20150312575A1 (en) * 2012-04-16 2015-10-29 New Cinema, LLC Advanced video coding method, system, apparatus, and storage medium
US10356426B2 (en) * 2013-06-27 2019-07-16 Google Llc Advanced motion estimation
US10491916B2 (en) * 2013-10-01 2019-11-26 Advanced Micro Devices, Inc. Exploiting camera depth information for video encoding
US10531116B2 (en) * 2014-01-09 2020-01-07 Qualcomm Incorporated Adaptive motion vector resolution signaling for video coding
US10757437B2 (en) * 2014-07-17 2020-08-25 Apple Inc. Motion estimation in block processing pipelines
CN106537918B (zh) * 2014-08-12 2019-09-20 英特尔公司 用于视频编码的运动估计的系统和方法
US10462480B2 (en) * 2014-12-31 2019-10-29 Microsoft Technology Licensing, Llc Computationally efficient motion estimation
US10200711B2 (en) * 2015-03-27 2019-02-05 Qualcomm Incorporated Motion vector derivation in video coding
US10887597B2 (en) * 2015-06-09 2021-01-05 Qualcomm Incorporated Systems and methods of determining illumination compensation parameters for video coding
US10356416B2 (en) * 2015-06-09 2019-07-16 Qualcomm Incorporated Systems and methods of determining illumination compensation status for video coding
US20170272775A1 (en) * 2015-11-19 2017-09-21 Hua Zhong University Of Science Technology Optimization of interframe prediction algorithms based on heterogeneous computing
US20170214937A1 (en) * 2016-01-22 2017-07-27 Mediatek Inc. Apparatus of Inter Prediction for Spherical Images and Cubic Images
US10652572B2 (en) * 2016-04-29 2020-05-12 Ati Technologies Ulc Motion-adaptive intra-refresh for high-efficiency, low-delay video coding
US10574999B2 (en) * 2016-05-05 2020-02-25 Intel Corporation Method and system of video coding with a multi-pass prediction mode decision pipeline
WO2017210915A1 (en) * 2016-06-09 2017-12-14 Intel Corporation Method and system of motion estimation with neighbor block pattern for video coding
US10368087B2 (en) * 2016-09-20 2019-07-30 Ati Technologies Ulc Dynamic reload of video encoder motion estimation search window under performance/power constraints
US10462462B2 (en) * 2016-09-29 2019-10-29 Qualcomm Incorporated Motion vector difference coding technique for video coding
US10631002B2 (en) * 2016-09-30 2020-04-21 Qualcomm Incorporated Frame rate up-conversion coding mode
US10979732B2 (en) * 2016-10-04 2021-04-13 Qualcomm Incorporated Adaptive motion vector precision for video coding
US10951912B2 (en) * 2016-10-05 2021-03-16 Qualcomm Incorporated Systems and methods for adaptive selection of weights for video coding
CN110495177B (zh) * 2017-04-13 2023-10-20 松下电器(美国)知识产权公司 解码装置、解码方法及存储介质
US10595045B2 (en) * 2017-07-27 2020-03-17 Advanced Micro Devices, Inc. Device and method for compressing panoramic video images

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1436002A (zh) * 2002-01-26 2003-08-13 Lg电子株式会社 运动矢量搜索范围的自适应确定方法
CN1791224A (zh) * 2005-12-19 2006-06-21 宁波大学 一种基于h.264的自适应块搜索范围快速运动估计方法
CN101378504A (zh) * 2007-08-31 2009-03-04 上海杰得微电子有限公司 用于h.264编码的块匹配运动估计方法
US20130279762A1 (en) * 2012-04-24 2013-10-24 Stmicroelectronics S.R.I. Adaptive search window control for visual search
US20160037166A1 (en) * 2014-08-01 2016-02-04 Ati Technologies Ulc Adaptive search window positioning for video encoding

Also Published As

Publication number Publication date
JP2019530299A (ja) 2019-10-17
US20190200033A1 (en) 2019-06-27
CN109496431A (zh) 2019-03-19

Similar Documents

Publication Publication Date Title
CN110169073B (zh) 编码方法、编码装置、解码方法及解码装置
CN107809642B (zh) 用于视频图像编码和解码的方法、编码设备和解码设备
CN110557631B (zh) 图像预测方法和相关设备
CN110637462B (zh) 视频编解码的方法及装置
CN107046645B (zh) 图像编解码方法及装置
BR122017024393B1 (pt) Método e aparelho para codificar ou decodificar uma imagem com predição de informação de movimento inter-camada de acordo com esquema de compressão de informação de movimento
TW201904291A (zh) 用於簡化的合併候選發信的編解碼方法及裝置
CN104717510A (zh) 用于图像处理的方法和装置
CN108028939A (zh) 用于视频编解码的解码器侧的运动推导的方法和装置
JP6195576B2 (ja) 画像のブロックを符号化する方法及び装置、並びに対応する再構成方法及び装置
CN101605256A (zh) 一种视频编解码的方法及装置
CN104427345A (zh) 运动矢量的获取方法、获取装置、视频编解码器及其方法
JP5367097B2 (ja) 動きベクトル予測符号化方法、動きベクトル予測復号方法、動画像符号化装置、動画像復号装置およびそれらのプログラム
CN102611881B (zh) 参考运动矢量获取方法、模块及编、解码装置
JP7431752B2 (ja) ビデオ符号化、ビデオ復号化方法、装置、コンピュータ装置及びコンピュータプログラム
KR101892019B1 (ko) 이미지 컨텐츠에 기초한 검색 및 랭킹에 의한, 비디오 압축 시 레퍼런스 블록으로의 링크를 인코딩
CN113490953A (zh) 预测值的确定方法、解码器以及计算机存储介质
JP5238882B2 (ja) 画像符号化装置、方法、集積回路、プログラム
CN104104961B (zh) 一种视频编码方法、解码方法和装置
WO2018068264A1 (zh) 图像编码/解码方法、装置以及图像处理设备
JP2006517069A (ja) モーションベクトルの予測方法及びシステム
WO2020001591A1 (zh) 一种解码、编码方法及其设备
WO2022116574A1 (zh) 基于二次多项式的运动矢量预测方法、系统及计算机介质
CN111629207B (zh) 一种模板匹配帧内子划分方法
Jubran et al. Sequence-level reference frames in video coding

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 16918774

Country of ref document: EP

Kind code of ref document: A1

ENP Entry into the national phase

Ref document number: 2019509497

Country of ref document: JP

Kind code of ref document: A

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 16918774

Country of ref document: EP

Kind code of ref document: A1