WO2016172994A1 - 图像编码、解码方法及装置 - Google Patents

图像编码、解码方法及装置 Download PDF

Info

Publication number
WO2016172994A1
WO2016172994A1 PCT/CN2015/078420 CN2015078420W WO2016172994A1 WO 2016172994 A1 WO2016172994 A1 WO 2016172994A1 CN 2015078420 W CN2015078420 W CN 2015078420W WO 2016172994 A1 WO2016172994 A1 WO 2016172994A1
Authority
WO
WIPO (PCT)
Prior art keywords
value
mapping
matching relationship
matching
relationship parameter
Prior art date
Application number
PCT/CN2015/078420
Other languages
English (en)
French (fr)
Inventor
林涛
李明
尚国强
吴钊
Original Assignee
同济大学
中兴通讯股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 同济大学, 中兴通讯股份有限公司 filed Critical 同济大学
Priority to US15/507,249 priority Critical patent/US10834428B2/en
Priority to EP15890374.0A priority patent/EP3177021B1/en
Priority to KR1020177005728A priority patent/KR101946598B1/ko
Priority to JP2017511908A priority patent/JP6360969B2/ja
Publication of WO2016172994A1 publication Critical patent/WO2016172994A1/zh
Priority to US17/061,414 priority patent/US11451835B2/en

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/90Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using coding techniques not provided for in groups H04N19/10-H04N19/85, e.g. fractals
    • H04N19/91Entropy coding, e.g. variable length coding [VLC] or arithmetic coding
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/134Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/134Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
    • H04N19/157Assigned coding mode, i.e. the coding mode being predefined or preselected to be further used for selection of another element or parameter
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/169Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
    • H04N19/182Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being a pixel
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • H04N19/503Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal prediction
    • H04N19/51Motion estimation or motion compensation
    • H04N19/513Processing of motion vectors
    • H04N19/517Processing of motion vectors by encoding
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • H04N19/593Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving spatial prediction techniques
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/85Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using pre-processing or post-processing specially adapted for video compression

Definitions

  • the present invention relates to digital video compression coding and decoding, and in particular to an image coding and decoding method and apparatus.
  • the natural form of a digital video signal of an image is a sequence of images.
  • Encoding a digital video signal encodes an image.
  • HEVC High Efficiency Video Coding
  • MxM pixels which is called "Coding Unit (CU).”
  • the CU is used as the basic coding unit, and the sub-images are coded one by one.
  • the size of the commonly used M is 4, 8, 16, 32, 64. Therefore, encoding a video image sequence is to sequentially encode each coding unit of each frame. Similarly, in decoding, each coding unit of each frame is sequentially decoded in the same order, and finally the entire video image sequence is reconstructed.
  • HEVC encodes images using predictive coding.
  • a predicted value of a pixel in an input video image is constructed based on the encoded image information, and then a difference between the original value of the pixel in the input video image and the predicted value is encoded, and a parameter required to construct the predicted value needs to be encoded.
  • the decoding process first, the predicted value of the pixel in the image to be decoded is constructed according to the parameter obtained in the code stream and the decoded image information, and then the sum of the filtered predicted value and the difference obtained in the code stream is taken as the current value. The recovered value of the pixel in the image to be decoded. It should be noted that the encoding process itself also needs to construct a local decoding recovery value of the input video image using a method similar to the decoding process for constructing a prediction reference of the pixel prediction value in the subsequent input video image.
  • each CU in an image can be different, some are 8x8, some are 64x64, and so on.
  • LCUs Large Coding Units
  • NxN pixels NxN pixels
  • each LCU is further divided into multiple CUs that are not necessarily the same size.
  • One of the LCUs consists of three 32x32 pixel CUs and four 16x16 pixel CUs.
  • the other LCU consists of two 32x32 pixel CUs, three 16x16 pixel CUs, and 20 8x8 pixels.
  • CU composition. Encoding an image is to sequentially encode one CU in one LCU. At any one time, the CU being coded is referred to as the current coded CU. Similarly, decoding one frame of image also sequentially decodes one CU in one LCU in the same order. At any one time, the CU being decoded is referred to as the currently decoded CU.
  • the current coding CU or the current decoding CU are collectively referred to as the current CU.
  • a color pixel consists of three components.
  • the two most commonly used pixel color formats are the GBR color format consisting of a green component, a blue component, and a red component, and a generic term called YUV consisting of a luma component and two chroma components.
  • Color formats such as YCbCr color format. Therefore, when encoding a CU, a CU can be divided into three component planes (G plane, B plane, R plane or Y plane, U plane, V plane), and the three component planes are respectively coded; The three component bundles of one pixel are combined into one 3-tuple, and the CUs composed of these 3-tuples are encoded as a whole.
  • the arrangement of the former pixel and its components is called the planar format of the image (and its CU), and the arrangement of the latter pixel and its components is called the stacked format of the image (and its CU). Format).
  • the YUV color format can be subdivided into several seed formats according to whether the chroma component is downsampled: a YUV 4:4:4 pixel color format consisting of 1 Y component, 1 U component, and 1 V component.
  • the left and right adjacent pixels are composed of two Y components, one U component, and one V component in a YUV 4:2:2 pixel color format; four pixels arranged in a left and right adjacent position by 2x2 spatial position are composed of four pixels.
  • YUV4: 2:0 pixel color format consisting of Y component, 1 U component, and 1 V component.
  • a component is generally represented by a number of 8 to 16 bits.
  • the YUV4:2:2 pixel color format and the YUV4:2:0 pixel color format are all downsampled for the YUV4:4:4 pixel color format.
  • a pixel component is also referred to as a pixel sample or simply as a sample.
  • pixel and pixel samples are collectively referred to as pixel values, that is, "pixel values” refer to both “pixels” and “pixel samples.”
  • the reconstructed pixel values are generated, and are divided into different degrees of partially reconstructed pixel values generated during the encoding or decoding process and completely reconstructed after the encoding or decoding process is completed. Pixel values. If the fully reconstructed pixel value has an equal value to the original input pixel value prior to encoding, the encoding and decoding process that is experienced is referred to as lossless encoding and decoding. If the fully reconstructed pixel value has unequal values from the original input pixel value prior to encoding, the encoding and decoding process that is experienced is referred to as lossy encoding and decoding.
  • the generated reconstructed pixel values are usually saved as historical data for use as reference pixel values for subsequent CU encoding or decoding.
  • the storage space in which the reconstructed pixel history data is saved is referred to as a reference pixel value temporary storage space, which is also referred to as a reference pixel value set.
  • the reference pixel value temporary storage space is limited, and only a part of historical data can be saved.
  • the historical data in the reference pixel value temporary storage space may also include the reconstructed pixel value of the current CU.
  • a notable feature of computer screen images is that there are often many similar or even identical pixel patterns within the same frame of image.
  • Chinese or foreign text that often appears in computer screen images is composed of a few basic strokes, and many similar or identical strokes can be found in the same frame image.
  • Menus, icons, etc. which are common in computer screen images, also have many similar or identical patterns.
  • the intra prediction method used in the existing image and video compression technology only refers to adjacent pixel values, and cannot improve the compression efficiency by using similarity or identity in one frame image. Therefore, the HEVC Working Committee is studying and preparing to adopt several matching methods to fully exploit and utilize similar or identical patterns in computer screen images to greatly improve compression.
  • the several matching methods include intra block matching (also called intra block copy), microblock matching, fine partition matching, string matching, and microblock.
  • Matching method palette-index matching method, 2-dimensional conformal matching method, 4-fork tree (also called 4-point tree) matching method, arbitrary shape region copy matching method, and the like.
  • the most basic matching relationship parameters such as matching position and matching size, are used to represent the matching relationship.
  • the matching position indicates where in the set of reference pixel values composed of the reconstructed pixels, the matching reference pixel value that matches the pixel value in the current encoding (or decoding) (collectively referred to as matching the current pixel value), and the matching size Used to indicate the number of matching current pixel values.
  • the number of matching current pixel values is equal to the number of matching reference pixel values.
  • the matching position is the relative position between the matching reference pixel value and the matching current pixel value.
  • the position matching the reference pixel value can be represented by either a 2-dimensional coordinate or a linear address
  • the position matching the current pixel value can also be represented by either a 2-dimensional coordinate or a linear address. Therefore, the matching position can be used as the difference between the 2-dimensional coordinates matching the reference pixel value and the 2-dimensional coordinates matching the current pixel value, or the difference between the linear address matching the reference pixel value and the linear address matching the current pixel value, also called the displacement vector. To represent.
  • the matching position ie the displacement vector
  • two matching relationship parameters namely two vector components, such as a horizontal component and a vertical component.
  • the matching position ie the displacement vector
  • the difference of a matching relation parameter ie a linear address, which is also commonly referred to as the matching distance.
  • the match size indicates how much of the matching current pixel value has the same matching position. Since the number of matching current pixel values is equal to the number of matching reference pixel values, the matching size also indicates how much the matching reference pixel values have the same matching position.
  • the matching size is a matching relationship parameter, such as the length of the matching string, and several predetermined matching shapes and sizes (such as a square of 4x4 pixel value, a block of 4x8 pixel value, a square of 8x8 pixel value, The number of the 16x16 pixel value, etc.), etc.
  • the matching size is a few matching relationship parameters, such as the matching relationship between the height and the width of the matching rectangle, matching the height of the right-angled trapezoid and the width of the upper and lower bases or equivalent to the three.
  • the three matching relationship parameters are one matching relationship parameter indicating the length of each of the one horizontal line segments of one matching area composed of one horizontal line segments.
  • the range of values for a matching relationship parameter is a predetermined set of finite elements of a number arranged in a certain order, the most common being a set of integers arranged from small to large.
  • Two or three or more matching relationship parameters can also be combined into one matching relationship parameter through some operations.
  • the merged match relationship parameters have a larger range of values.
  • Entropy coding must be performed on the matching relationship parameters for data compression.
  • the input to the entropy code is an integer with a predetermined range of values.
  • Entropy coding is divided into two steps: 1) performing binaryization on the input integer, that is, converting the integer into a series of bits, each of which can take one of two values of 0 or 1; 2) for each The number of bits is subjected to context-based adaptive 2-value arithmetic coding.
  • the binarization method used in the related art has a characteristic, that is, an integer having a small value, and is converted into a shorter number of bits after binarization, so that less data is generated after entropy coding is written into the compression code.
  • the stream, and the larger integer is converted to a longer string of bits after binarization, so that more data is generated after the entropy coding is written into the compressed code stream.
  • the frequency of any integer in the range of the matching relationship parameter, which occurs throughout the encoding process does not always decrease as its value increases, a specific integer A , the frequency of its occurrence p(A), It may be much higher than the frequency p(B) of the occurrence of a much smaller integer B, that is, A is much larger than B and p(A) is much higher than p(B), and the presentation frequency becomes larger as the integer value becomes larger.
  • A is much larger than B
  • p(A) is much higher than p(B)
  • entropy coding is directly performed on the matching relationship parameter, and a situation often occurs in which a certain integer of the matching relationship parameter has a high frequency of occurrence, but its value is also large, and thus entropy is applied thereto. After encoding, a lot of compressed code stream data is generated.
  • the present invention provides an image encoding and decoding method and apparatus to solve at least the problems caused by directly performing entropy coding on matching relationship parameters in the related art.
  • an image encoding apparatus comprising the following modules: module 1)
  • a pixel pre-processing and matching encoding module configured to perform pixel pre-processing and matching encoding on pixel values of the input video image, generate and output one or more matching relationship parameters, and other than the one or more matching relationship parameters Matching the coding result; module 2) mapping module: configured to perform a one-to-one mapping on the value range of the matching relationship parameter, where the input of the mapping is the matching relationship parameter output by the module 1), The output of the mapping is a mapped matching relationship parameter; module 3) encoding and reconstruction module: configured to perform encoding and reconstruction operations on the input video image, the matching relationship parameters and variables; and module 4) a temporary storage module: Set to temporarily store the pixel values of the reconstructed reference pixel value set; module 5) entropy encoding module: set to all the outputs that need to be output to the compressed code stream including the mapped matching relationship parameters and the remaining encoding results Encoding the result to perform an entropy encoding operation; outputting a result of the entropy en
  • the value range is divided into K sub-value ranges
  • the mapping is correspondingly divided into mappings within K sub-value ranges.
  • the value range is divided into L group sub-value ranges, and each sub-value range in each group of sub-value ranges has equal finite elements, and the mapping is correspondingly divided into L Group mapping, each group mapping maps a complete sub-value range in each group of sub-value ranges to a complete sub-value range in the same group, and keeps the order of all elements in the sub-value range not Change, where L is a natural number.
  • one of the mapping ranges or the mapping within the sub-value range is synthesized by a plurality of consecutively executed partial mappings.
  • mapping range or the mapping relationship of the partial mapping or the partial mapping within the range of the value ranges is represented by one of the following: all represented by one or a set of calculation formulas; All are represented by a list; parts are represented by one or a set of calculations, and parts are represented by a list.
  • mapping range or the mapping relationship of the partial mapping or the partial mapping within the range of values of the sub-value changes with a change of a state or a parameter of the current encoding.
  • mapping range or the mapping relationship of the partial mapping or the partial mapping within the range of value ranges changes as the width of the current coding block changes.
  • one of the matching relationship parameters is a matching distance
  • the width W of the current coding block has four values: 64, 32, 16, and 8.
  • the mapping also has four mapping relationships correspondingly.
  • the device further includes: a real-time statistic module, configured to set the characteristics of each value in the range of values of the real-time statistical matching relationship parameter, and the real-time statistical result of each value of the matching relationship parameter to the mapping or the The mapping relationship of the partial mapping is dynamically adjusted.
  • a real-time statistic module configured to set the characteristics of each value in the range of values of the real-time statistical matching relationship parameter, and the real-time statistical result of each value of the matching relationship parameter to the mapping or the The mapping relationship of the partial mapping is dynamically adjusted.
  • an image decoding apparatus comprising the following module: module 1)
  • Entropy decoding module configured to perform entropy decoding on the input compressed data stream containing the matching relationship parameter and the other encoded result including the matching relationship parameter compressed data, and parse various data obtained by entropy decoding; 2) inverse mapping module: set to perform one-to-one inverse mapping on the value range of the mapping relationship parameter after mapping, the inverse mapping recovers and outputs the matching relationship parameter before mapping; module 3) matching decoding module: set to The matching relationship parameter performs matching decoding operation; module 4) decoding and reconstruction module: configured to perform decoding and reconstruction operations on various parameters and variables of the currently decoded matching region or the currently decoded decoding block; module 5) Memory Module: Set to temporarily store the pixel values of the reconstructed reference pixel value set.
  • the matching area is a matching string or a matching block.
  • the value range is divided into K sub-value ranges
  • the inverse mapping is correspondingly divided into inverse mappings within K sub-value ranges.
  • the value range is divided into L group sub-value ranges, and each sub-value range in each group of sub-value ranges has equal finite elements, and the inverse map is correspondingly divided into L group inverse mapping, each set of inverse mapping inversely maps a complete sub-value range within each group of sub-value ranges into a complete sub-value range within the same group, and keeps all values within the sub-value range The order of the elements is unchanged, where L is a natural number.
  • one of the mapping ranges or one of the inverse mappings in the range of values or the range of sub-values is synthesized by a plurality of consecutively executed partial mappings or partial inverse mappings.
  • the inverse mapping or the inverse mapping of the partial inverse mapping in the value range or the sub-value range is represented by one of the following: all using one or a set of calculation formulas To represent; all represented by a list; parts are represented by one or a set of calculations, and parts are represented by a list.
  • the inverse mapping or the inverse mapping of the partial inverse mapping in the value range or the sub-value range changes according to a state or a parameter of the current decoding.
  • the inverse mapping or the inverse mapping of the partial inverse mapping in the value range or the sub-value range changes as the width of the decoding block changes.
  • one of the matching relationship parameters is a matching distance
  • the width W of the decoding block has four values: 64, 32, 16, and 8, and the inverse mapping also has four inverse mapping relationships correspondingly.
  • the device further includes: a real-time statistic module configured to set a characteristic of each value in a range of values of the real-time statistical matching relationship parameter, and the inverse mapping or the real-time statistical result according to each value of the matching relationship parameter The inverse mapping relationship of the partial inverse mapping is dynamically adjusted.
  • a real-time statistic module configured to set a characteristic of each value in a range of values of the real-time statistical matching relationship parameter, and the inverse mapping or the real-time statistical result according to each value of the matching relationship parameter The inverse mapping relationship of the partial inverse mapping is dynamically adjusted.
  • an image encoding method comprising: performing pixel pre-processing and matching encoding on pixel values of an input video image, generating and outputting one or more matching relationship parameters; The value range of the parameter is mapped one-to-one, and the mapped matching relationship parameter is output; the input video image, the matching relationship parameter and the variable are subjected to encoding and reconstruction operations; and the reconstructed reference pixel is temporarily stored. a pixel value of the value set; performing entropy coding on the mapped matching relationship parameter, and outputting the entropy encoded result.
  • an image decoding method comprising: compressing data for input matching parameter-containing parameters and compressing code stream of other parameters than the matching relationship parameter compressed data Performing entropy decoding; performing one-to-one inverse mapping on the value range of the matching relationship parameter after mapping, restoring and outputting the matching relationship parameter before mapping; performing matching decoding according to the matching relationship parameter; matching region or current in current decoding
  • the decoding and reconstruction operations are performed on various parameters and variables of the decoded block in the decoding; the pixel values of the reconstructed reference pixel value set are temporarily stored.
  • an image encoding method comprising: performing matching encoding on pixels of an input video image to obtain one or more matching relationship parameters, wherein the matching relationship parameter is to construct the input video image And a parameter used in the process of predicting a value of the pixel and/or recovering the value; mapping the matching relationship parameter to obtain a mapping value of the matching relationship parameter; and entropy encoding the mapping value of the matching relationship parameter.
  • the mapping of the matching relationship parameter includes: converting a parameter to be matched according to an existing matching relationship parameter, and using the converted value as a mapping value of the parameter to be matched; and/or,
  • the matching relationship parameters of the same type are aggregated and/or rearranged according to a specified rule to form a matching relationship parameter group, and the matching relationship parameter group is mapped, and the matching relationship parameter group obtained after the mapping processing is used as the matching relationship.
  • the mapped value of the parameter includes: converting a parameter to be matched according to an existing matching relationship parameter, and using the converted value as a mapping value of the parameter to be matched; and/or,
  • the matching relationship parameters of the same type are aggregated and/or rearranged according to a specified rule to form a matching relationship parameter group, and the matching relationship parameter group is mapped, and the matching relationship parameter group obtained after the mapping processing is used as the matching relationship.
  • the mapped value of the parameter is
  • the specified rule includes at least one of the following: a preset rule; an operation step of aggregating and/or rearranging a plurality of to-be-matched relationship parameters according to an existing matching relationship parameter value setting.
  • performing mapping processing on the matching relationship parameter group includes: taking a value of a matching relationship parameter in the matching relationship parameter group as an output of a mapping process; and/or, in the matching relationship parameter group The value obtained by the matching relationship parameter is converted as the output of the mapping process.
  • an image decoding method including: performing entropy decoding on a received code stream, and acquiring a field value for indicating a matching relationship parameter, wherein the matching relationship parameter is configured to be a parameter used in the process of decoding the predicted value and/or the restored value of the pixel in the video image; mapping the value of the field to obtain a mapped matching relationship parameter; constructing the to-be-matched according to the mapped matching relationship parameter The predicted and/or recovered values of the pixels in the video image are decoded.
  • mapping the value of the field to obtain the mapped matching relationship parameter includes: converting, according to the obtained matching relationship parameter, a value of the field to be processed, and using the converted value as a Mapping the matching relationship parameters; and/or, the values of the same type of pending fields are aggregated and/or rearranged according to a specified rule to form an array, and the array is processed as the mapped match. Relationship parameters.
  • the specified rule includes at least one of the following: a preset rule; and the value of the field to be processed is aggregated and/or rearranged according to the obtained field value setting. Steps.
  • processing the array includes: taking a value of the to-be-processed field in the array as a processed output value; and/or, converting the value of the to-be-processed field in the array The obtained value is taken as the processed output value.
  • an image encoding apparatus comprising: a matching encoding module configured to perform matching encoding on pixels of an input video image to obtain one or more matching relationship parameters, wherein the matching The relationship parameter is a parameter used in the process of constructing the predicted value and/or the restored value of the pixel in the input video image; the mapping module is configured to map the matching relationship parameter to obtain a mapping value of the matching relationship parameter; the entropy encoding module And set to entropy encode the mapped value of the matching relationship parameter.
  • an image decoding apparatus comprising: an entropy decoding module, configured to perform entropy decoding on the received code stream, and obtain a field value for indicating a matching relationship parameter,
  • the matching relationship parameter is a parameter used in constructing a predicted value and/or a restored value of a pixel in a video image to be decoded;
  • the mapping module is configured to map the value of the field to obtain a mapped matching relationship parameter.
  • a constructing module configured to construct a predicted value and/or a restored value of the pixel in the video image to be decoded according to the mapped matching relationship parameter.
  • one or more matching relationship parameters are obtained by performing matching coding on pixels of the input video image, wherein the matching relationship parameter is a parameter used in constructing a predicted value and/or a restored value of a pixel in the image;
  • the matching relationship parameters are mapped to obtain a mapping value of the matching relationship parameter;
  • the mapping value of the matching relationship parameter is entropy encoded.
  • FIG. 1 is a block diagram showing the structure of an image encoding apparatus according to an embodiment of the present invention
  • FIG. 2 is a structural block diagram (1) of an image encoding apparatus according to an embodiment of the present invention.
  • FIG. 3 is a flowchart of an image encoding method according to an embodiment of the present invention.
  • FIG. 4 is a block diagram showing the structure of an image decoding apparatus according to an embodiment of the present invention.
  • FIG. 5 is a structural block diagram (1) of an image decoding apparatus according to an embodiment of the present invention.
  • FIG. 6 is a flowchart of an image decoding method according to an embodiment of the present invention.
  • FIG. 7 is a flowchart (1) of an image encoding method according to an embodiment of the present invention.
  • FIG. 8 is a structural block diagram (2) of an image encoding apparatus according to an embodiment of the present invention.
  • FIG. 9 is a flowchart (1) of an image decoding method according to an embodiment of the present invention.
  • FIG. 10 is a structural block diagram (2) of an image decoding apparatus according to an embodiment of the present invention.
  • FIG. 11 is a schematic diagram of a bidirectional single mapping of a value range of a matching relationship parameter according to an embodiment of the present invention.
  • FIG. 12 is a block diagram showing the composition of an encoding apparatus according to an embodiment of the present invention.
  • FIG. 13 is a block diagram showing the composition of a decoding apparatus according to an embodiment of the present invention.
  • the image encoding apparatus includes: a module 1) a pixel pre-processing and matching encoding module 22: configured to perform pixel values of an input video image.
  • mapping module 24 setting to take the matching relationship parameters The value range is one-to-one mapping, the input of the mapping is the matching relationship parameter output by the module 1), the output of the mapping is the mapped matching relationship parameter; module 3) encoding and reconstruction module 26: set to the input Video image, the matching relationship parameter and variable performing encoding and reconstruction operations; module 4) temporary storage module 28: set to temporarily store pixel values of the reconstructed reference pixel value set; module 5) entropy encoding module 30: set to Entropy coding operation is performed on all coding results that need to be output to the compressed code stream, including the mapped matching relationship parameters and the remaining coding results; output entropy coding Fruit, wherein the result of the entropy encoding parameter included in matching relation to the other, and the compressed data of the compressed stream encoding result.
  • the mapping relationship parameter is encoded.
  • the matching relationship parameter is directly encoded to cause a specific integer of the matching relationship parameter.
  • the frequency of occurrence is very high, but its value is also very large. Therefore, entropy coding is performed to generate a lot of compressed code stream data.
  • the above image coding device solves the problem that the correlation parameter directly performs entropy coding in the related art. The problem, in turn, achieves a better data compression effect of entropy coding.
  • the above value range is divided into K sub-value ranges, and the mapping is correspondingly divided into mappings within K sub-value ranges.
  • the value range is divided into L group sub-value ranges, and each sub-value range in each group of sub-value ranges has equal finite elements, and the mapping is correspondingly divided.
  • each group mapping maps a complete sub-value range within each group of sub-value ranges into a complete sub-value range within the same group, and maintains all elements within the sub-value range The order is unchanged, where L is a natural number.
  • the above-mentioned range of values or a mapping within the range of sub-values is synthesized by a plurality of consecutively executed partial mappings.
  • the above-mentioned value range or a mapping relationship of the mapping or the partial mapping in the sub-value range may be represented in various manners, which will be exemplified below. In an alternative embodiment, it is represented by one of the following: all represented by one or a set of calculation formulas; all represented by a list; partially represented by one or a set of calculation formulas, partially by a list Said.
  • mapping range or the mapping relationship of a partial mapping or the partial mapping within the above value range or the sub-value range changes as a state or parameter of the current encoding changes.
  • mapping range or the mapping relationship of the partial mapping within the value range or the sub-value range changes as the width of the current coding block changes.
  • the matching relationship parameter is a matching distance
  • the width W of the current coding block has four values: 64, 32, 16, and 8.
  • the mapping also has corresponding 4 mapping relationships.
  • the apparatus further includes: a real-time statistic module 32 configured to set values of values in a real-time statistical matching relationship parameter.
  • the feature dynamically adjusts the mapping relationship between the mapping or the partial mapping according to the real-time statistical result of each value of the matching relationship parameter.
  • FIG. 3 is a flowchart of an image encoding method according to an embodiment of the present invention. As shown in FIG. 3, the flow includes the following steps:
  • Step S302 performing pixel pre-processing and matching encoding on the pixel values of the input video image, generating and outputting one or more matching relationship parameters;
  • Step S304 performing a one-to-one mapping on the value range of the matching relationship parameter, and outputting the mapped matching relationship parameter;
  • Step S306 performing encoding and reconstruction operations on the input video image, the matching relationship parameter, and the variable
  • Step S308 temporarily storing pixel values of the reconstructed reference pixel value set
  • Step S310 performing entropy coding on the mapped matching relationship parameter, and outputting the entropy encoded result.
  • the mapping relationship parameter is encoded.
  • the matching relationship parameter is directly encoded to cause a specific integer of the matching relationship parameter to appear.
  • the frequency is very high, but its value is also very large, so entropy coding is performed to generate a lot of compressed code streams.
  • the above image coding device solves the problem caused by directly performing entropy coding on the matching relationship parameters in the related art, thereby achieving better data compression effect of entropy coding.
  • the apparatus includes the following modules: a module 1) an entropy decoding module 42: configured to compress data corresponding to an input matching relationship parameter and The compressed code stream containing the other coding result of the matching relationship parameter compression data is subjected to entropy decoding, and parsing various data obtained by entropy decoding; module 2) inverse mapping module 44: setting the value range of the matching relationship parameter after mapping Performing a one-to-one inverse mapping that restores and outputs the pre-map matching relationship parameters; module 3) matching decoding module 46: configured to perform a matching decoding operation based on the matching relationship parameters; module 4) decoding and reconstruction module 48 : setting to perform decoding and reconstruction operations on various parameters and variables of the currently decoded decoding region or the currently decoded decoding block; module 5) temporary storage module 50: set to temporarily store the reconstructed reference pixel value set pixel value.
  • the image decoding device performs inverse mapping on the range of the mapping matching relationship parameters obtained in the entropy encoding process, and outputs the matching relationship parameters before the mapping, thereby solving the direct entropy coding of the matching relationship parameters in the related art.
  • the problem in turn, achieves a better data compression effect of entropy coding.
  • the matching area is a matching string or a matching block.
  • the value range is divided into K sub-value ranges
  • the inverse map is correspondingly divided into inverse maps within K sub-value ranges.
  • the value range is divided into L group sub-value ranges, and each sub-value range in each group of sub-value ranges has equal finite elements
  • the inverse map is correspondingly Divided into L-group inverse mappings, each set of inverse mapping inversely maps a complete sub-value range within each group of sub-value ranges into a complete sub-value range within the same group, and maintains the sub-value range The order of all elements in the same is unchanged, where L is a natural number.
  • one of the mappings or one of the mappings within the range of values or sub-values is synthesized by a plurality of consecutively executed partial mappings or partial inverse mappings.
  • An inverse mapping of the inverse mapping or the partial inverse mapping in the range of value ranges or sub-values may have multiple representations. In an alternative embodiment, it is represented by one of the following: all using one or A set of calculations; all represented by a list; partially represented by one or a set of calculations, and partially represented by a list.
  • an inverse mapping within the range of values or sub-values or an inverse mapping of the partial inverse mapping changes as a state or parameter of the current decoding changes.
  • the inverse mapping of an inverse mapping or partial inverse mapping within a range of values or sub-values changes as the width of the decoding block changes.
  • the matching relationship parameter may be a plurality of information.
  • the matching relationship parameter is the matching distance
  • the width W of the decoding block has 4 values: 64, 32, 16, 8 and the inverse mapping also has corresponding 4 inverse mapping relationships.
  • FIG. 5 is a structural block diagram (1) of an image decoding apparatus according to an embodiment of the present invention.
  • the apparatus further includes: a real-time statistics module 52 configured to set values of values in a real-time statistical matching relationship parameter.
  • the feature dynamically adjusts the inverse mapping or the inverse mapping of the partial inverse mapping according to the real-time statistical result of each value of the matching relationship parameter.
  • FIG. 6 is a flowchart of an image decoding method according to an embodiment of the present invention. As shown in FIG. 6, the flow includes the following steps:
  • Step S602 performing entropy decoding on the input compressed code stream containing the matching relationship parameter and the other parameters except the matching relationship parameter compressed data
  • Step S604 performing one-to-one inverse mapping on the value range of the mapping relationship parameter after mapping, and restoring and outputting the matching relationship parameter before mapping;
  • Step S606 performing matching decoding according to the matching relationship parameter
  • Step S608 performing decoding and reconstruction operations on various parameters and variables of the currently decoded region or the currently decoded block in the decoding
  • Step S610 temporarily storing the pixel values of the reconstructed reference pixel value set.
  • the value range of the mapping matching relationship parameter obtained in the entropy coding process is inversely mapped, and the matching relationship parameter before the mapping is output, which solves the problem caused by directly performing entropy coding on the matching relationship parameter in the related art. In turn, a better data compression effect of entropy coding is achieved.
  • FIG. 7 is a flowchart (1) of an image encoding method according to an embodiment of the present invention. As shown in FIG. 7, the flow includes the following steps:
  • Step S702 performing matching coding on the pixels of the input video image to obtain one or more matching relationship parameters, wherein the matching relationship parameter is a parameter used in constructing a predicted value and/or a restored value of the pixel in the input video image;
  • Step S704 mapping the matching relationship parameters to obtain a mapping value of the matching relationship parameter
  • Step S706 entropy encoding the mapping value of the matching relationship parameter.
  • the mapping relationship parameter is encoded.
  • the matching relationship parameter is directly encoded to cause a specific integer of the matching relationship parameter to appear.
  • the frequency is very high, but its value is also very large. Therefore, entropy coding is performed to generate a lot of compressed code stream data. The above steps solve the problem caused by directly performing entropy coding on the matching relationship parameters in the related art, thereby achieving entropy. Better data compression for encoding.
  • the frequency of the mapping value of the matching relationship parameter becomes lower as the mapping value of the matching relationship parameter increases; wherein the frequency is that the value of the mapping value is larger, and the value actually appears. The smaller the probability, the fewer "numbers" that occur.
  • the matching relationship parameter is mapped.
  • the matching relationship parameter is converted according to the existing matching relationship parameter, and the converted value is used as the mapping value of the parameter to be matched.
  • the mapping operation here can be understood as a direct "copy operation", that is, no processing is performed on the input data.
  • the aggregation and/or rearrangement constitutes a matching relationship parameter group, and the matching relationship parameter group is mapped, and the matching relationship parameter group obtained after the mapping process is used as the Matches the mapped values of the relationship parameters. Thereby the mapping of the matching relationship parameters is completed.
  • the specified rule may be a preset rule, or may be an operation step of aggregating and/or rearranging a plurality of parameters to be matched according to the value of the existing matching relationship parameter.
  • mapping processing method for the matching relationship parameter group may include many types, which will be exemplified below.
  • the processing method may be: taking the value of the matching relationship parameter in the matching relationship parameter group as the output of the mapping process, or converting the value of the matching relationship parameter in the matching relationship parameter group, and converting The value is used as the output of the mapping process.
  • module may implement a combination of software and/or hardware of a predetermined function.
  • apparatus described in the following embodiments is preferably implemented in software, hardware, or a combination of software and hardware, is also possible and contemplated.
  • FIG. 8 is a structural block diagram (2) of an image encoding apparatus according to an embodiment of the present invention.
  • the apparatus includes: a matching encoding module 82 configured to perform matching encoding on pixels of an input video image to obtain one or a plurality of matching relationship parameters, wherein the matching relationship parameter is a parameter used in constructing a predicted value and/or a restored value of a pixel in the input video image; the mapping module 84 is configured to map the matching relationship parameter to obtain a matching relationship The mapped value of the parameter; the entropy encoding module 86 is configured to entropy encode the mapped value of the matching relationship parameter.
  • FIG. 9 is a flowchart (1) of an image decoding method according to an embodiment of the present invention. As shown in FIG. 9, the process includes the following steps:
  • Step S902 performing entropy decoding on the received code stream, and obtaining a field value for indicating a matching relationship parameter, where the matching relationship parameter is used in constructing a predicted value and/or a recovery value of a pixel in the video image to be decoded. parameter;
  • Step S904 mapping the value of the field to obtain a mapping relationship parameter
  • Step S906 constructing a predicted value and/or a restored value of a pixel in the video image to be decoded according to the mapped matching relationship parameter.
  • the value range of the mapping matching relationship parameter obtained in the entropy coding process is inversely mapped, and the matching relationship parameter before the mapping is output, which solves the problem caused by directly performing entropy coding on the matching relationship parameter in the related art. In turn, a better data compression effect of entropy coding is achieved.
  • the frequency of the mapping value of the matching relationship parameter becomes lower as the mapping value of the matching relationship parameter increases; wherein the frequency is that the value of the mapping value is larger, and the value actually appears. The smaller the probability, the fewer "numbers" that occur.
  • step S904 the value of the field is mapped, and the mapped matching relationship parameter is obtained.
  • the value of the field to be processed is converted according to the obtained matching relationship parameter, and The converted value is used as the matching relationship parameter of the mapping.
  • the same type of pending fields are aggregated and/or rearranged according to a specified rule to form an array, and the array is processed as the mapped matching relationship parameter.
  • the specified rule includes at least one of the following: a preset rule; and an operation step of aggregating and/or rearranging the value of the field to be processed according to the value obtained by the field.
  • the foregoing array is processed.
  • the processing method used may be to take the value of the to-be-processed field in the array as the processed output value, or to take the to-be-processed field in the array. The value is converted and the converted value is taken as the processed output value.
  • module may implement a combination of software and/or hardware of a predetermined function.
  • apparatus described in the following embodiments is preferably implemented in software, hardware, or a combination of software and hardware, is also possible and contemplated.
  • FIG. 10 is a structural block diagram (2) of an image decoding apparatus according to an embodiment of the present invention.
  • the apparatus includes: an entropy decoding module 102 configured to perform entropy decoding on a received code stream, and obtain an indication for obtaining The field of the matching relationship parameter takes a value, wherein the matching relationship parameter is a parameter used in constructing a predicted value and/or a restored value of a pixel in the image to be decoded; the mapping module 104 is configured to map the value of the field to obtain a mapping The matching relationship parameter; the constructing module 106 is configured to construct a predicted value and/or a restored value of the pixel in the image to be decoded according to the mapped matching relationship parameter.
  • the main technical feature of the optional embodiment is that before performing entropy coding on a matching relationship parameter, a two-way single mapping (referred to as bijection) is performed on the value range of the matching relationship parameter, and the frequency within the range is taken. Higher values are mapped to smaller values, while values with lower frequencies within the range of values are mapped to larger values. Bijection is also called a one-to-one full shot. Bijection has an inverse mapping and inverse mapping is also a one-to-one full shot.
  • FIG. 11 is a schematic diagram of a bidirectional single mapping of a value range of a matching relationship parameter according to an embodiment of the present invention.
  • a matching range of a matching relationship parameter is an integer interval between 1 and 12288, expressed as [ 1,12288].
  • the frequency characteristic of this matching relationship parameter is a multiple of 4, that is, the frequency of 4, 8, 12, ..., 6144, ..., 12288 is much higher than the frequency of a multiple of 4.
  • the multiple of 4 is mapped to an integer between 1 and 3072, and the multiple of 4 is mapped to an integer between 3073 and 12288.
  • the matching relationship parameter after mapping has a frequency that becomes lower as the value becomes larger.
  • the characteristics of the overall trend which greatly improves the compression efficiency of subsequent entropy coding.
  • the formula for mapping in Figure 11 is:
  • This mapping is a bijection from the integer interval [1,12288] of the range of values to the integer interval [1,12288].
  • the formula for the inverse mapping is:
  • the inverse mapping is also a bijection from the integer interval [1, 12288] of the range of values to the integer interval [1, 12288] itself.
  • the most basic characteristic feature is that the mapping of the matching relationship parameters generated by the matching coding is first performed, so that the matching relationship parameters after the mapping have a frequency change as the value becomes larger. The characteristics of the low overall trend are then entropy encoded by the mapped matching relationship parameters.
  • the entropy decoding obtains the matching relationship parameter (actually the mapping matching relationship parameter), and first performs inverse mapping of the value range to obtain a true matching relationship parameter. Then use the matching relationship parameters for matching decoding.
  • the matching relationship parameter actually the mapping matching relationship parameter
  • FIG. 12 is a schematic diagram of a module structure of an encoding apparatus according to an embodiment of the present invention.
  • FIG. 12 is a schematic diagram of an encoding apparatus according to an alternative embodiment of the present invention.
  • the entire coding device consists of the following modules:
  • pixel preprocessing and matching coding module performing pixel preprocessing and matching coding on pixel values of the input video image, generating and outputting one or several matching relationship parameters (labeled as matching relationship parameter 1, matching relationship parameter 2, ..., respectively) Match relationship parameters J) and other matching coding results.
  • Examples of the pixel preprocessing sample quantization, color quantization, and color-based pixel clustering, using a palette and an index to represent the color of the input original pixel;
  • examples of the matching encoding block matching mode, microblock matching Mode, microblock string matching method, fine division matching method, string matching method, palette-index matching method, 2-dimensional conformal matching method, 4-fork tree (also called 4-point tree) matching method, arbitrary shape region copy matching Method;
  • examples of the matching relationship parameter matching position, displacement vector, a component of the displacement vector, matching distance, matching size, matching length, height of the matching rectangle, width of the matching rectangle, and a set of parameters defining a specific matching area a number of pre-specified matching shapes and sizes;
  • a matching relationship parameter ranges from a predetermined finite element set of numbers in a certain order, such as a finite element of an integer arranged from small to large Set; examples of the other matching coding results: matching residuals, unmatched pixel values;
  • mapping module that matches the value range of the relationship parameter: a bidirectional single mapping of the value range of a matching relationship parameter, the input of the mapping is a matching relationship parameter output by the module 1), and the mapping generates And outputting the mapped matching relationship parameter; the purpose of the mapping is to map the value with higher frequency within the range of values A smaller value is formed, and a value with a lower frequency within the range of values is mapped to a larger value; a bidirectional single mapping is a one-to-one full shot, which is simply called bijection, and bijection has inverse mapping and inverse The mapping is also a one-to-one full shot; each matching relationship parameter has its own mapping, the matching relationship parameter 1, the matching relationship parameter 2, ..., the mapping parameter of the matching relationship parameter J are respectively marked as the mapping module of the value range 1.
  • mapping module 2 of value range mapping module J of value range
  • mapping of some matching relationship parameters can be an identity mapping (each value in the range of values is mapped to itself), but at least A mapping of matching relationship parameters is not an identity mapping
  • the mapping relationship of the mapping ie, the relationship between the input of the mapping and the output of the mapping, and what input value is mapped to what output value
  • the remaining matching methods and various common techniques of encoding and reconstruction modules performing other matching methods on input video images, various parameters and variables, and various commonly used techniques, such as intra prediction, inter prediction, transform, quantization, Inverse transform, inverse quantization, compensation corresponding to prediction residual and matching residual (ie inverse operation of residual operation), DPCM, first-order and higher-order difference, mapping, run, index, deblocking filtering, sample Adaptive compensation (Sample Adaptive Offset), encoding and reconstruction operation;
  • the other matching manner refers to a matching manner in the encoding device different from the matching manner performed by the module 1);
  • the input of the module is the module 1
  • the output of the module is the reconstructed pixel value and the remaining encoding result;
  • the reconstructed pixel value is placed in the reconstructed reference pixel value temporary storage module, Used as a reference matching pixel operation for subsequent matching coding operations, remaining matching methods, and various common techniques of
  • the reconstructed reference pixel value temporary storage module temporarily stores the pixel value of the reconstructed reference pixel value set, that is, the matching region in the CU or the current encoding in the current encoding during the encoding process (the matching region may also be a matching string)
  • the reconstructed pixel values up to the beginning of the matching block) are used as reference pixel values for current and subsequent matching encoding, and are also used as encoding and reconstruction operations for other matching methods and various common techniques for current and subsequent CUs.
  • the required reference pixel value is used as reference pixel values for current and subsequent matching encoding, and are also used as encoding and reconstruction operations for other matching methods and various common techniques for current and subsequent CUs.
  • an entropy coding module performing an entropy coding operation on all coding results that need to be outputted into the compressed code stream, including the mapped matching relationship parameter and the remaining coding result; the result of entropy coding, that is, the matching relationship parameter
  • the compressed stream of compressed data and other encoded results is also the final output of the encoding device.
  • FIG. 13 is a schematic diagram of a module structure of a decoding apparatus according to an embodiment of the present invention.
  • FIG. 13 is a schematic diagram of a decoding apparatus according to an alternative embodiment of the present invention.
  • the entire decoding device consists of the following modules:
  • Entropy decoding module performing entropy decoding on the input compressed stream containing the matching relationship parameter and other encoded results, and parsing the meaning of various data obtained by entropy decoding; and matching one or several mappings obtained after parsing Relationship parameters (marked as mapping matching relationship parameter 1, mapping matching relationship parameter 2, ..., respectively)
  • the mapping relationship parameter J) is sent to the inverse mapping module of the value range; the matching residuals, unmatched pixel values and other matching coding results and the rest of the data are sent to the remaining matching methods and various common techniques for decoding and Reconstruction module;
  • a mapping range of the matching relationship parameter is a predetermined finite element set of numbers arranged in a certain order, such as a finite element subset of integers arranged from small to large;
  • an inverse mapping module of the value range of the matching relationship parameter performing an inverse mapping of a bidirectional single mapping on the value range of the matching matching parameter, and the input of the inverse mapping is obtained by parsing the module 1)
  • the output maps the matching relationship parameters, and the inverse map restores and outputs the matching relationship parameters before the mapping (ie, the mapping performed in the unencoded device); each matching relationship parameter has its own inverse mapping, and the matching relationship parameter 1
  • the inverse mapping module of the matching relationship parameter 2 is respectively marked as the inverse mapping module of the value range, the inverse mapping module 2 of the value range, the inverse mapping module J of the value range;
  • the inverse mapping of some matching relationship parameters may be an identity mapping (each value in the range of values is mapped to itself), but the inverse mapping of at least one matching relation parameter is not an identity mapping; the inverse mapping relationship of the inverse mapping (ie, the relationship between the inverse mapped input and the inverse mapped output, what input value is inversely mapped to what output value
  • matching decoding module performing matching decoding operation according to the matching relationship parameter; the input of the module is the matching relationship parameter output by the module 2); the matching decoding example: block matching mode, microblock matching mode , microblock string matching method, fine division matching method, string matching method, palette-index matching method, 2-dimensional conformal matching method, 4-fork tree (also called 4-point tree) matching method, arbitrary shape region copy matching method
  • the matching decoding operation first determining the position of the matching reference pixel value in the reconstructed reference pixel value temporary storage module and determining the matching region composed of the matching reference pixel values (the matching region may also be a matching string or a matching block) a shape and size, then copying matching reference pixel values within the matching region of the shape and size from the location, and moving and pasting the matching reference pixel values to a location in the current decoding that matches the current pixel value , restoring the matching current pixel value; the output of the module is all the restored current pixel values of the restoration;
  • the remaining matching methods and various common techniques of decoding and reconstruction modules performing matching methods on the matching regions in the current decoding (the matching regions may also be matching strings or matching blocks) or various parameters and variables of the currently decoded CU. And various common techniques, such as intra prediction, inter prediction, inverse transform, inverse quantization, compensation corresponding to prediction residual and matching residual (ie, inverse operation of residual operation), DPCM, first order and higher order Decoding, reconstruction, run-length, indexing, deblocking filtering, sample adaptive offset (Sample Adaptive Offset), decoding and reconstruction operations;
  • the other matching manner refers to a matching manner of a matching manner performed by the module 3) in the decoding device; the output of the module is a reconstructed pixel value (including a completely reconstructed pixel value and a partially reconstructed partial reconstructed pixel value)
  • the reconstructed pixel value is placed in the reconstructed reference pixel value temporary storage module, and is used as a reference pixel value required for subsequent matching decoding operations, remaining
  • the reconstructed reference pixel value temporary storage module temporarily stores the pixel value of the reconstructed reference pixel value set, that is, the matching region in the CU or the current decoding in the current decoding process during the decoding process (the matching region may also be a matching string) Or the reconstructed pixel value up to the beginning of the matching block), used as the reference pixel value for the current and subsequent matching decoding, and also used as the decoding and reconstruction operation for the current and subsequent CUs to perform other matching methods and various common techniques.
  • the required reference pixel value is temporarily stores the pixel value of the reconstructed reference pixel value set, that is, the matching region in the CU or the current decoding in the current decoding process during the decoding process (the matching region may also be a matching string) Or the reconstructed pixel value up to the beginning of the matching block), used as the reference pixel value for the current and subsequent matching decoding, and also used as the decoding and reconstruction operation for the current and subsequent CUs to perform other matching methods and various common techniques.
  • Alternative embodiments of the present invention are applicable to the encoding and decoding of overlay format images or CUs.
  • Alternative embodiments of the invention are equally applicable to the encoding and decoding of component plane format images or CUs.
  • Alternative embodiments of the present invention are applicable to lossless matching encoding and decoding.
  • Embodiments of the invention are equally applicable to lossy matching coding and decoding.
  • Embodiments of the present invention are applicable to lossless encoding and decoding.
  • Embodiments of the invention are equally applicable to lossy encoding and decoding.
  • the optional embodiment of the present invention is also applicable to adopting multiple matching methods at the same time (for example, using the block matching method, the arbitrary shape region copy matching method, the palette-index matching method, or the block matching method, and adjusting at the same time. Encoding and decoding of the swatch-index matching method and the string matching method.
  • the above range of values is divided into K (usually 1 ⁇ K ⁇ 20) sub-value ranges, and the mapping or the inverse mapping is correspondingly divided into mappings or inverse mappings within K sub-value ranges.
  • the above range of values is divided into L (usually 1 ⁇ L ⁇ 40) sub-value range, and each sub-value range in each sub-value range has equal finite elements, and the above mapping or the inverse mapping described above is also Correspondingly, it is divided into an L group mapping or an L group inverse mapping, and each group mapping or each group inverse mapping completes one of each group of values.
  • the entire sub-value range maps or inversely maps to one (may be the other or the same) complete sub-value range within the same group, and keeps the order of all elements in the sub-value range unchanged, ie if The element A is arranged before the element B, then the mapped element A is also arranged before the mapped element B, or the inversely mapped element A is also arranged before the inverse mapping element B, and vice versa.
  • One of the above-mentioned mappings or one of the inverse mappings within the above range of values or the range of sub-values is a composite of a number of (typically less than 4) consecutively executed partial or partial inverse mappings.
  • mapping relationship of one of the above mappings (or the partial mappings) or the inverse mapping of one of the inverse mappings (or the partial inverse mappings) in the range of values or the range of the sub-values all using one or a set of calculation formulas To represent; or to use a list to represent; or to use a part or a set of calculations, and a part to use a list.
  • mapping relationship of one of the above mappings (or the partial mappings) or the inverse mapping of one of the inverse mappings (or the partial inverse mappings) in the range of values or the sub-value ranges along with the current encoding (solution) code Change in a state or parameter.
  • the mapping relationship of one of the mappings (or the partial mappings) or the inverse mapping of the inverse mappings (or the partial inverse mappings) in the range of values or ranges of the sub-values along with the width of the current CU Change or change, that is, when the width of the current CU is a value, a mapping relationship or an inverse mapping relationship is adopted, and when the width of the current CU is another value, another mapping relationship or inverse mapping relationship is adopted; for example, The width of the current CU is W, and the frequency of some or all multiples of the value W of a matching relationship parameter (such as the matching distance) is much higher than the frequency of some or all multiples of the non-W.
  • mapping relationship is related to W.
  • W is different
  • the mapping relationship is different.
  • the inverse mapping relationship is also different.
  • This embodiment is a special case of Embodiment 6.
  • One of the matching relationship parameters is a matching distance.
  • the width W of the current CU has four values: 64, 32, 16, 8.
  • the mapping or the inverse mapping also has corresponding 4 mapping relationships or 4 inverse mapping relationships.
  • a real-time statistical module for matching the values in the range of relationship parameters, real-time statistics of the characteristics of each value, such as the frequency of occurrence of each value up to the current time; according to the values of the matching relationship parameters
  • the real-time statistical result dynamically adjusts the mapping relationship of the mapping (or the partial mapping) or the inverse mapping of the inverse mapping (or the partial inverse mapping described above).
  • the image encoding and decoding method and apparatus proposed by the embodiments of the present invention improve image compression performance.
  • a storage medium is further provided, wherein the software includes the above-mentioned software, including but not limited to: an optical disk, a floppy disk, a hard disk, an erasable memory, and the like.
  • modules or steps of the present invention described above can be implemented by a general-purpose computing device that can be centralized on a single computing device or distributed across a network of multiple computing devices. Alternatively, they may be implemented by program code executable by the computing device such that they may be stored in the storage device by the computing device and, in some cases, may be different from the order herein.
  • the steps shown or described are performed, or they are separately fabricated into individual integrated circuit modules, or a plurality of modules or steps thereof are fabricated as a single integrated circuit module.
  • the invention is not limited to any specific combination of hardware and software.
  • the present invention relates to digital video compression encoding and decoding, and provides an image encoding and decoding method and apparatus, wherein the image encoding method comprises: performing matching coding on pixels of an input video image to obtain one or more matching relationship parameters, wherein The matching relationship parameter is a parameter used in constructing a predicted value and/or a restored value of a pixel in the image; mapping the matching relationship parameter to obtain a mapping value of the matching relationship parameter; The mapped values of the parameters are entropy encoded.
  • the invention solves the problem caused by directly performing entropy coding on the matching relationship parameter in the related art, thereby achieving better data compression effect of entropy coding.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Compression Or Coding Systems Of Tv Signals (AREA)

Abstract

本发明提供了一种图像编码、解码方法及装置,其中,该图像编码方法包括:对输入视频图像的像素进行匹配编码,得到一个或者多个匹配关系参数,其中,匹配关系参数是构造该图像中像素的预测值和/或恢复值过程中使用的参数;对匹配关系参数进行映射,得到匹配关系参数的映射值;对匹配关系参数的映射值进行熵编码。通过本发明解决了相关技术中对匹配关系参数直接施行熵编码导致的问题,进而达到了熵编码的较好的数据压缩效果。

Description

图像编码、解码方法及装置 技术领域
本发明涉及数字视频压缩编码及解码,具体而言,涉及一种图像编码、解码方法及装置。
背景技术
图像的数字视频信号的自然形式是图像的序列。一幅图像通常是由若干像素组成的矩形区域,如果一个数字视频信号每秒有50幅图像,那么一段30分钟的数字视频信号就是一个由30x60x50=90000幅图像组成的视频图像序列,有时也简称为视频序列或序列。对数字视频信号进行编码就是对一幅一幅图像进行编码。
最新国际视频压缩标准HEVC(High Efficiency Video Coding)中,对一幅图像进行编码时,把一幅图像划分成若干块MxM像素的子图像,称为“编码单元(Coding Unit,简称为CU)”,以CU为基本编码单位,对子图像一块一块进行编码。常用的M的大小是4,8,16,32,64。因此,对一个视频图像序列进行编码就是对各帧的各个编码单元依次进行编码。同样,解码时也是对各帧的各个编码单元按照同样的顺序依次进行解码,最终重构出整个视频图像序列。HEVC采用预测编码的方式对图像进行编码。首先,根据已编码图像信息构造输入视频图像中像素的预测值,然后对输入视频图像中像素的原始值与上述预测值之间的差值进行编码,同时需要编码构造预测值所需的参数。在解码过程中,首先根据码流中获得的参数和已解码图像信息构造待解码图像中像素的预测值,然后将经过滤波处理的上述预测值与码流中获取的差值的和值作为当前待解码图像中像素的恢复值。需要说明的是,编码过程本身也需要使用与解码过程相似的方法,构造输入视频图像的本地解码恢复值,用于构造后续输入视频图像中像素预测值的预测参考。
为适应一幅图像内各部分图像内容与性质的不同,有针对性地进行最有效的编码,一幅图像内各CU的大小可以是不同的,有的是8x8,有的是64x64,等等。为了使不同大小的CU能够无缝拼接起来,一幅图像总是先划分成大小完全相同具有NxN像素的“最大编码单元(Largest Coding Unit简称LCU)”,然后每个LCU再进一步划分成多个大小不一定相同的CU。例如,一幅图像先划分成大小完全相同的64x64像素的LCU(N=64)。其中某个LCU由3个32x32像素的CU和4个16x16像素的CU构成。而另一个LCU由2个32x32像素的CU、3个16x16像素的CU和20个8x8像素的 CU构成。对一幅图像进行编码,就是依次对一个一个LCU中的一个一个CU进行编码。在任一时刻,正在编码中的CU称为当前编码CU。同样,对一帧图像进行解码,也是按照同样的顺序依次对一个一个LCU中的一个一个CU进行解码。在任一时刻,正在解码中的CU称为当前解码CU。当前编码CU或当前解码CU都统称为当前CU。
一个彩色像素有3个分量(component)组成。最常用的两种像素色彩格式(pixel color format)是由绿色分量、蓝色分量、红色分量组成的GBR色彩格式和由一个亮度(luma)分量及两个色度(chroma)分量组成的通称YUV色彩格式如YCbCr色彩格式。因此,对一个CU进行编码时,可以把一个CU分成3个分量平面(G平面、B平面、R平面或Y平面、U平面、V平面),对3个分量平面分别进行编码;也可以把一个像素的3个分量捆绑组合成一个3元组,对由这些3元组组成的CU整体进行编码。前一种像素及其分量的排列方式称为图像(及其CU)的平面格式(planar format),而后一种像素及其分量的排列方式称为图像(及其CU)的叠包格式(packed format)。
YUV色彩格式又可根据是否对色度分量进行下采样再细分成若干种子格式:1个像素由1个Y分量、1个U分量、1个V分量组成的YUV4:4:4像素色彩格式;左右相邻的2个像素由2个Y分量、1个U分量、1个V分量组成的YUV4:2:2像素色彩格式;左右上下相邻按2x2空间位置排列的4个像素由4个Y分量、1个U分量、1个V分量组成的YUV4:2:0像素色彩格式。一个分量一般用1个8~16比特的数字来表示。YUV4:2:2像素色彩格式和YUV4:2:0像素色彩格式都是对YUV4:4:4像素色彩格式施行色度分量的下采样得到。一个像素分量也称为一个像素样值(pixel sample)或简单地称为一个样值(sample)。
在本发明专利申请中,像素和像素样值统称为像素值,即“像素值”既指“像素”也指“像素样值”。
在对任一个CU进行编码或解码时,都会产生重构像素值,又分为编码或解码过程之中产生的不同程度的部分重构像素值和编码或解码过程全部完成后产生的完全重构像素值。如果完全重构像素值与编码之前的原始输入像素值有相等的数值,则所经历的编码和解码过程称为无损编码和解码。如果完全重构像素值与编码之前的原始输入像素值有不相等的数值,则所经历的编码和解码过程称为有损编码和解码。在对一个一个CU依次进行编码或解码时,所产生的重构像素值通常都作为历史数据保存起来,用作后续CU编码或解码时的参考像素值。保存重构像素历史数据的存储空间称为参考像素值暂存空间,也称为参考像素值集。参考像素值暂存空间都是有限的,只能保存一部分历史数据。参考像素值暂存空间中的历史数据也可以包括当前CU的重构像素值。
随着以远程桌面为典型表现形式的新一代云计算与信息处理模式及平台的发展和普及,多台计算机之间、计算机主机与智能电视、智能手机、平板电脑等其他数字设备之间及各种各类数字设备之间的互联已经成为现实并日趋成为一种主流趋势。这使得服务器端(云)到用户端的实时屏幕传输成为当前的迫切需求。由于需要传输的屏幕视频数据量巨大,对计算机屏幕图像必须进行高效高质量的数据压缩。
充分利用计算机屏幕图像的特点,对计算机屏幕图像进行超高效率的压缩,也是最新国际视频压缩标准HEVC的一个主要目标。
计算机屏幕图像的一个显著特点是同一帧图像内通常会有很多相似甚至完全相同的像素图样(pixel pattern)。例如,计算机屏幕图像中常出现的中文或外文文字,都是由少数几种基本笔划所构成,同一帧图像内可以找到很多相似或相同的笔划。计算机屏幕图像中常见的菜单、图标等,也具有很多相似或相同的图样。现有的图像和视频压缩技术中采用的帧内预测(intra prediction)方式,仅参考相邻的像素值,无法利用一帧图像中的相似性或相同性来提高压缩效率。因此,HEVC工作委员会正在研究和准备采纳若干种匹配方式,充分发掘和利用计算机屏幕图像中存在的相似或相同图样,以大幅度提高压缩效果。这若干种匹配方式包括帧内块匹配(intra block matching)方式(也称为帧内块复制intra block copy),微块匹配方式、精细划分匹配方式、串匹配(string matching)方式、微块串匹配方式、调色板-索引匹配方式、2维保形匹配方式、4叉树(也称4分树)匹配方式、任意形状区域复制匹配方式等。不管是哪种匹配方式,都是用若干最基本的匹配关系参数,例如匹配位置和匹配大小,来表示匹配关系。其中匹配位置表示与当前编码(或解码)中像素值(统称为匹配当前像素值)相匹配的匹配参考像素值在由已重构像素构成的参考像素值集内的什么位置,而匹配大小则用来表示匹配当前像素值的数目。显然,匹配当前像素值的数目等于匹配参考像素值的数目。
匹配位置是匹配参考像素值与匹配当前像素值之间的相对位置。在一帧图像中,匹配参考像素值的位置既可用一个2维坐标也可用一个线性地址来表示,匹配当前像素值的位置也是既可用一个2维坐标也可用一个线性地址来表示。因此,匹配位置既可用匹配参考像素值的2维坐标与匹配当前像素值的2维坐标之差也可用匹配参考像素值的线性地址与匹配当前像素值的线性地址之差,也称为位移矢量来表示。在2维坐标的情形,匹配位置即位移矢量用两个匹配关系参数即两个矢量分量如一个水平分量和一个垂直分量来表示。在线性地址的情形,匹配位置即位移矢量用一个匹配关系参数即线性地址之差来表示,通常也称为匹配距离。
匹配大小表示具有同一匹配位置的匹配当前像素值一共有多少。因为匹配当前像素值的数目与匹配参考像素值的数目是相等的,匹配大小也表示了具有同一匹配位置的匹配参考像素值一共有多少。在某些匹配方式中,匹配大小是一个匹配关系参数,如匹配串的长度,若干种预先规定的匹配形状和尺寸(如4x4像素值的方块、4x8像素值的块、8x8像素值的方块、16x16像素值的方块等)的编号等。在某些匹配方式中,匹配大小是几个匹配关系参数,如匹配矩形的高度和宽度这两个匹配关系参数,匹配直角梯形的高度及上底和下底宽度或者与这三者等价的三个匹配关系参数,由I条水平线段组成的一个匹配区域的表示这I条水平线段各自的长度的I个匹配关系参数。
一个匹配关系参数的取值范围是一个预先规定的按一定顺序排列的数的有限元素集合,最常见的是由小到大排列的若干整数的集合。如表示作为匹配位置的线性地址之差(通常称为匹配距离)的匹配关系参数的取值范围是1到D=1048576,其中D是可能的匹配距离的最大值。又如表示匹配串长度的匹配关系参数的取值范围是1到L=12288,其中L是可能的匹配串长度的最大值。
两个或三个或更多个匹配关系参数也可以经过某些运算合并成一个匹配关系参数。合并后的匹配关系参数有更大的取值范围。
对匹配关系参数必须施行熵编码来进行数据压缩。熵编码的输入是具有预先规定的取值范围的整数。熵编码分为两个步骤:1)对输入的整数施行2值化,即把整数转换成一串比特数,每个比特数可以取值0或1这两个值中的一个;2)对每个比特数施行基于上下文的自适应2值算术编码。
相关技术中采用的2值化方法都有一个特性,就是取值较小的整数,2值化后转换成较短的一串比特数,因而熵编码后产生较少的数据被写入压缩码流,而取值较大的整数,2值化后转换成较长的一串比特数,因而熵编码后产生较多的数据被写入压缩码流。
由于2值化方法的这个特性,一个匹配关系参数,在取值范围内取的某个整数值的大小与该整数值在整个编码过程中出现的频度之间,如果具有随着整数值变大其频度变低的整体趋势的特性,那么熵编码就会有比较好的数据压缩效果。反之,如果具有随着整数值变大其频度呈有大有小持续反复振荡的特性,那么熵编码的数据压缩效果就会受到负面影响。
在不少情况下,匹配关系参数的取值范围内的任一个整数,其在整个编码过程中出现的频度,并不总是随着其值的增大而降低,某个特定的整数A,其出现的频度p(A), 可能比另一个小得多的整数B的出现的频度p(B)高得多,即A远大于B而p(A)远高于p(B),呈现频度随着整数值变大而有大有小持续反复振荡的特性。
在相关技术中,对匹配关系参数直接施行熵编码,常常发生这样的情况:匹配关系参数的某个特定的整数,其出现的频度很高,但其值也很大,因而对其施行熵编码后产生很多的压缩码流数据。
针对相关技术,对匹配关系参数直接施行熵编码导致的问题,还未提出有效的解决方案。
发明内容
本发明提供了一种图像编码、解码方法及装置,以至少解决相关技术中对匹配关系参数直接施行熵编码导致的问题。
根据本发明的一个方面,提出了一种图像编码装置,包括以下模块:模块1)
像素预处理和匹配编码模块:设置为对输入视频图像的像素值施行像素预处理和匹配编码,产生并输出一个或者多个匹配关系参数和除所述一个或者多个匹配关系参数之外的其他匹配编码结果;模块2)映射模块:设置为对所述匹配关系参数的取值范围进行一对一的映射,所述映射的输入是所述模块1)输出的所述匹配关系参数,所述映射的输出为映射后的匹配关系参数;模块3)编码和重构模块:设置为对所述输入视频图像、所述匹配关系参数和变量施行编码和重构运算;模块4)暂存模块:设置为暂存已重构的参考像素值集的像素值;模块5)熵编码模块:设置为对包括所述映射后匹配关系参数和其余编码结果在内的所有需要输出到压缩码流中的编码结果施行熵编码运算;输出熵编码的结果,其中,所述熵编码的结果中包括匹配关系参数压缩数据以及所述其他编码结果的压缩码流。
可选地,所述取值范围被划分成K个子取值范围,所述映射也相应地被划分成K个子取值范围内的映射。
可选地,所述取值范围被划分成L组子取值范围,每组子取值范围内的各个子取值范围都有互相相等的有限元素,所述映射也相应地被划分成L组映射,每一组映射把每一组子取值范围内的一个完整的子取值范围映射成同一组内的一个完整的子取值范围,并且保持子取值范围内所有元素的顺序不变,其中L为自然数。
可选地,所述取值范围或者所述子取值范围内的一个所述映射由多个连续执行的部分映射合成。
可选地,所述取值范围或者所述子取值范围内的一个所述映射或者所述部分映射的映射关系,通过以下之一的方式表示:全部用一个或者一组计算式来表示;全部用一个列表来表示;部分用一个或者一组计算式来表示,部分用一个列表来表示。
可选地,所述取值范围或者所述子取值范围内的一个所述映射或者所述部分映射的映射关系,随着当前编码的一个状态或者参数的改变而改变。
可选地,所述取值范围或者所述子取值范围内的一个所述映射或者所述部分映射的映射关系,随着当前编码块的宽度的改变而改变。
可选地,所述匹配关系参数之一是匹配距离,所述当前编码块的宽度W有4个值:64,32,16,8,所述映射也相应地有4种映射关系。
可选地,所述装置还包括:实时统计模块,设置为实时统计匹配关系参数的取值范围内各数值的特性,根据所述匹配关系参数的各数值的实时统计结果对所述映射或者所述部分映射的映射关系,进行动态调整。
根据本发明的另一个方面,还提供了一种图像解码装置,包括以下模块:模块1)
熵解码模块:设置为对输入的含匹配关系参数压缩数据以及除所述含匹配关系参数压缩数据的其他编码结果的压缩码流施行熵解码,并对熵解码得到的各种数据进行解析;模块2)逆映射模块:设置为对映射后匹配关系参数的取值范围进行一对一的逆映射,所述逆映射复原并输出映射前的匹配关系参数;模块3)匹配解码模块:设置为根据所述匹配关系参数施行匹配解码运算;模块4)解码和重构模块:设置为对当前解码中匹配区域或者当前解码中解码块的各种参数和变量施行解码和重构运算;模块5)暂存模块:设置为暂存已重构的参考像素值集的像素值。
可选地,所述匹配区域为匹配串或者匹配块。
可选地,所述取值范围被划分成K个子取值范围,所述逆映射也相应地被划分成K个子取值范围内的逆映射。
可选地,所述取值范围被划分成L组子取值范围,每组子取值范围内的各个子取值范围都有互相相等的有限元素,所述逆映射也相应地被划分成L组逆映射,每一组逆映射把每一组子取值范围内的一个完整的子取值范围逆映射成同一组内的一个完整的子取值范围,并且保持子取值范围内所有元素的顺序不变,其中L为自然数。
可选地,所述取值范围或者所述子取值范围内的一个所述映射或者一个所述逆映射由多个连续执行的部分映射或者部分逆映射合成。
可选地,所述取值范围或者所述子取值范围内的一个所述逆映射或者所述部分逆映射的逆映射关系,通过以下之一的方式表示:全部用一个或者一组计算式来表示;全部用一个列表来表示;部分用一个或者一组计算式来表示,部分用一个列表来表示。
可选地,所述取值范围或者所述子取值范围内的一个所述逆映射或者所述部分逆映射的逆映射关系随着当前解码的一个状态或者参数的改变而改变。
可选地,所述取值范围或者所述子取值范围内的一个所述逆映射或者所述部分逆映射的逆映射关系随着解码块的宽度的改变而改变。
可选地,所述匹配关系参数之一是匹配距离,所述解码块的宽度W有4个值:64,32,16,8,所述逆映射也相应地有4种逆映射关系。
可选地,所述装置还包括:实时统计模块,设置为实时统计匹配关系参数的取值范围内各数值的特性,根据所述匹配关系参数的各数值的实时统计结果对所述逆映射或者所述部分逆映射的逆映射关系进行动态调整。
根据本发明的一个方面,提供了一种图像编码方法,所述方法包括:对输入视频图像像素值施行像素预处理和匹配编码,产生并输出一个或者多个匹配关系参数;对所述匹配关系参数的取值范围进行一对一的映射,并输出映射后的匹配关系参数;对所述输入视频图像、所述匹配关系参数和变量施行编码和重构运算;暂存已重构的参考像素值集的像素值;对所述映射后匹配关系参数施行熵编码,输出熵编码后的结果。
根据本发明的另一个方面,还提供了一种图像解码方法,所述方法包括:对输入的含匹配关系参数压缩数据以及除所述含匹配关系参数压缩数据之外的其他参数的压缩码流施行熵解码;对映射后匹配关系参数的取值范围进行一对一的逆映射,复原并输出映射前的匹配关系参数;根据所述匹配关系参数施行匹配解码;对当前解码中匹配区域或者当前解码中解码块的各种参数和变量施行解码和重构运算;暂存已重构的参考像素值集的像素值。
根据本发明的一个方面,提供了一种图像编码方法,包括:对输入视频图像的像素进行匹配编码,得到一个或者多个匹配关系参数,其中,所述匹配关系参数是构造所述输入视频图像中像素的预测值和/或恢复值过程中使用的参数;对所述匹配关系参数进行映射,得到匹配关系参数的映射值;对所述匹配关系参数的映射值进行熵编码。
可选地,对所述匹配关系参数进行映射包括:根据已有匹配关系参数,对待匹配关系参数进行转换,将转换后得到的值作为所述待匹配关系参数的映射值;和/或,对 相同类型的匹配关系参数,按照指定规则进行聚集和/或重排列构成匹配关系参数组,对所述匹配关系参数组进行映射处理,将经过映射处理后得到的匹配关系参数组作为所述匹配关系参数的映射值。
可选地,所述指定规则包括以下至少之一:预先设定的规则;根据已有匹配关系参数取值设定的对多个待匹配关系参数进行聚集和/或重排列的操作步骤。
可选地,对所述匹配关系参数组进行映射处理,包括:将所述匹配关系参数组中的匹配关系参数取值作为映射处理的输出;和/或,对所述匹配关系参数组中的匹配关系参数取值进行转换后得到的值作为映射处理的输出。
根据本发明的另一个方面,提供了一种图像解码方法,包括:对接收到的码流进行熵解码,获取用于指示匹配关系参数的字段取值,其中,所述匹配关系参数是构造待解码视频图像中像素的预测值和/或恢复值过程中使用的参数;对所述字段取值进行映射,得到映射后的匹配关系参数;根据所述映射后的匹配关系参数,构造所述待解码视频图像中像素的预测值和/或恢复值。
可选地,对所述字段取值进行映射,得到映射后的匹配关系参数包括:根据已获得的所述匹配关系参数,对待处理的所述字段取值进行转换,将转换后的值作为所述映射后的匹配关系参数;和/或,将相同类型的待处理字段的取值,按照指定规则进行聚集和/或重排列构成数组,对所述数组进行处理后作为所述映射后的匹配关系参数。
可选地,所述指定规则包括以下至少之一:预先设定的规则;根据已获得所述字段取值设定的对所述待处理的所述字段取值进行聚集和/或重排列的操作步骤。
可选地,对所述数组进行处理,包括:将所述数组中的待处理字段取值作为处理后的输出值;和/或,对所述数组中所述待处理字段取值进行转换后得到的值作为处理后的输出值。
根据本发明的一个方面,提供了一种图像编码装置,所述装置包括:匹配编码模块,设置为对输入视频图像的像素进行匹配编码,得到一个或者多个匹配关系参数,其中,所述匹配关系参数是构造所述输入视频图像中像素的预测值和/或恢复值过程中使用的参数;映射模块,设置为对所述匹配关系参数进行映射,得到匹配关系参数的映射值;熵编码模块,设置为对所述匹配关系参数的映射值进行熵编码。
根据本发明的另一个方面,还提供了一种图像解码装置,所述装置包括:熵解码模块,设置为对接收到的码流进行熵解码,获取用于指示匹配关系参数的字段取值, 其中,所述匹配关系参数是构造待解码视频图像中像素的预测值和/或恢复值过程中使用的参数;映射模块,设置为对所述字段取值进行映射,得到映射后的匹配关系参数;构造模块,设置为根据所述映射后的匹配关系参数,构造所述待解码视频图像中像素的预测值和/或恢复值。
通过本发明,采用对输入视频图像的像素进行匹配编码,得到一个或者多个匹配关系参数,其中,匹配关系参数是构造该图像中像素的预测值和/或恢复值过程中使用的参数;对匹配关系参数进行映射,得到匹配关系参数的映射值;对匹配关系参数的映射值进行熵编码。解决了相关技术中对匹配关系参数直接施行熵编码导致的问题,进而达到了熵编码的较好的数据压缩效果。
附图说明
此处所说明的附图用来提供对本发明的进一步理解,构成本申请的一部分,本发明的示意性实施例及其说明用于解释本发明,并不构成对本发明的不当限定。在附图中:
图1是根据本发明实施例的图像编码装置的结构框图;
图2是根据本发明实施例的图像编码装置的结构框图(一);
图3是根据本发明实施例的图像编码方法的流程图;
图4是根据本发明实施例的图像解码装置的结构框图;
图5是根据本发明实施例的图像解码装置的结构框图(一);
图6是根据本发明实施例的图像解码方法的流程图;
图7是根据本发明实施例的图像编码方法的流程图(一);
图8是根据本发明实施例的图像编码装置的结构框图(二);
图9是根据本发明实施例的图像解码方法的流程图(一);
图10是根据本发明实施例的图像解码装置的结构框图(二);
图11是根据本发明实施例的匹配关系参数取值范围的双向单一映射的示意图;
图12是根据本发明实施例的编码装置的模块组成示意图;
图13是根据本发明实施例的解码装置的模块组成示意图。
具体实施方式
下文中将参考附图并结合实施例来详细说明本发明。需要说明的是,在不冲突的情况下,本申请中的实施例及实施例中的特征可以相互组合。
图1是根据本发明实施例的图像编码装置的结构框图,如图1所示,该图像编码装置包括:模块1)像素预处理和匹配编码模块22:设置为对输入视频图像的像素值施行像素预处理和匹配编码,产生并输出一个或者多个匹配关系参数和除该一个或者多个匹配关系参数之外的其他匹配编码结果;模块2)映射模块24:设置为对匹配关系参数的取值范围进行一对一的映射,该映射的输入是该模块1)输出的匹配关系参数,该映射的输出为映射后的匹配关系参数;模块3)编码和重构模块26:设置为对输入视频图像、该匹配关系参数和变量施行编码和重构运算;模块4)暂存模块28:设置为暂存已重构的参考像素值集的像素值;模块5)熵编码模块30:设置为对包括映射后匹配关系参数和其余编码结果在内的所有需要输出到压缩码流中的编码结果施行熵编码运算;输出熵编码的结果,其中,熵编码的结果中包括匹配关系参数压缩数据以及该其他编码结果的压缩码流。
通过上述的图像编码装置,对匹配关系参数进行映射后,对映射后的匹配关系参数进行编码,相比于相关技术中,对匹配关系参数直接进行编码导致匹配关系参数的某个特定的整数,其出现的频度很高,但其值也很大,因而对其施行熵编码后产生很多的压缩码流数据,上述的图像编码装置解决了相关技术中对匹配关系参数直接施行熵编码导致的问题,进而达到了熵编码的较好的数据压缩效果。
在一个可选实施例中,上述取值范围被划分成K个子取值范围,映射也相应地被划分成K个子取值范围内的映射。
在另一个可选实施例中,取值范围被划分成L组子取值范围,每组子取值范围内的各个子取值范围都有互相相等的有限元素,该映射也相应地被划分成L组映射,每一组映射把每一组子取值范围内的一个完整的子取值范围映射成同一组内的一个完整的子取值范围,并且保持子取值范围内所有元素的顺序不变,其中L为自然数。
在一个可选实施例中,上述取值范围或者上述子取值范围内的一个映射由多个连续执行的部分映射合成。
上述取值范围或者上述子取值范围内的一个该映射或者该部分映射的映射关系,可以通过多种方式进行表示,下面对此进行举例说明。在一个可选实施例中,通过以下之一的方式表示:全部用一个或者一组计算式来表示;全部用一个列表来表示;部分用一个或者一组计算式来表示,部分用一个列表来表示。
在一个可选实施例中,上述取值范围或者子取值范围内的一个映射或者部分映射的映射关系,随着当前编码的一个状态或者参数的改变而改变。
在另一个可选实施例中,取值范围或者子取值范围内的一个该映射或者该部分映射的映射关系,随着当前编码块的宽度的改变而改变。
匹配关系参数可以有很多种,在匹配关系参数为是匹配距离时,在一个可选实施例中,当前编码块的宽度W有4个值:64,32,16,8,映射也相应地有4种映射关系。
图2是根据本发明实施例的图像编码装置的结构框图(一),如图2所示,该装置还包括:实时统计模块32,设置为实时统计匹配关系参数的取值范围内各数值的特性,根据该匹配关系参数的各数值的实时统计结果对该映射或者该部分映射的映射关系,进行动态调整。
在另一个实施例中提供了一种图像编码方法,图3是根据本发明实施例的图像编码方法的流程图,如图3所示,该流程包括如下步骤:
步骤S302,对输入视频图像像素值施行像素预处理和匹配编码,产生并输出一个或者多个匹配关系参数;
步骤S304,对匹配关系参数的取值范围进行一对一的映射,并输出映射后的匹配关系参数;
步骤S306,对输入视频图像、匹配关系参数和变量施行编码和重构运算;
步骤S308,暂存已重构的参考像素值集的像素值;
步骤S310,对映射后匹配关系参数施行熵编码,输出熵编码后的结果。
通过上述步骤,对匹配关系参数进行映射后,对映射后的匹配关系参数进行编码,相比于相关技术中,对匹配关系参数直接进行编码导致匹配关系参数的某个特定的整数,其出现的频度很高,但其值也很大,因而对其施行熵编码后产生很多的压缩码流 数据,上述的图像编码装置解决了相关技术中对匹配关系参数直接施行熵编码导致的问题,进而达到了熵编码的较好的数据压缩效果。
图4是根据本发明实施例的图像解码装置的结构框图,如图4所示,该装置包括以下模块:模块1)熵解码模块42:设置为对输入的含匹配关系参数压缩数据以及除该含匹配关系参数压缩数据的其他编码结果的压缩码流施行熵解码,并对熵解码得到的各种数据进行解析;模块2)逆映射模块44:设置为对映射后匹配关系参数的取值范围进行一对一的逆映射,该逆映射复原并输出映射前的匹配关系参数;模块3)匹配解码模块46:设置为根据该匹配关系参数施行匹配解码运算;模块4)解码和重构模块48:设置为对当前解码中匹配区域或者当前解码中解码块的各种参数和变量施行解码和重构运算;模块5)暂存模块50:设置为暂存已重构的参考像素值集的像素值。
通过上述的图像解码装置,对在熵编码过程中得到的映射后匹配关系参数的取值范围进行逆映射,输出映射前的匹配关系参数,解决了相关技术中对匹配关系参数直接施行熵编码导致的问题,进而达到了熵编码的较好的数据压缩效果。
在一个可选实施例中,匹配区域为匹配串或者匹配块。
在一个可选实施例中,取值范围被划分成K个子取值范围,逆映射也相应地被划分成K个子取值范围内的逆映射。
在另一个可选实施例中,取值范围被划分成L组子取值范围,每组子取值范围内的各个子取值范围都有互相相等的有限元素,该逆映射也相应地被划分成L组逆映射,每一组逆映射把每一组子取值范围内的一个完整的子取值范围逆映射成同一组内的一个完整的子取值范围,并且保持子取值范围内所有元素的顺序不变,其中L为自然数。
在另一个可选实施例中,取值范围或者子取值范围内的一个该映射或者一个该逆映射由多个连续执行的部分映射或者部分逆映射合成。
取值范围或者子取值范围内的一个该逆映射或者该部分逆映射的逆映射关系可以有多种表现方式,在一个可选实施例中,通过以下之一的方式表示:全部用一个或者一组计算式来表示;全部用一个列表来表示;部分用一个或者一组计算式来表示,部分用一个列表来表示。
在一个可选实施例中,取值范围或者子取值范围内的一个逆映射或者该部分逆映射的逆映射关系随着当前解码的一个状态或者参数的改变而改变。
在另一个可选实施例中,取值范围或者子取值范围内的一个逆映射或者部分逆映射的逆映射关系随着解码块的宽度的改变而改变。
匹配关系参数可以是多种信息,在匹配关系参数是匹配距离时,在一个可选实施例中,解码块的宽度W有4个值:64,32,16,8,逆映射也相应地有4种逆映射关系。
图5是根据本发明实施例的图像解码装置的结构框图(一),如图5所示,该装置还包括:实时统计模块52,设置为实时统计匹配关系参数的取值范围内各数值的特性,根据该匹配关系参数的各数值的实时统计结果对该逆映射或者该部分逆映射的逆映射关系进行动态调整。
在另一个实施例中提供了一种图像编码方法,图6是根据本发明实施例的图像解码方法的流程图,如图6所示,该流程包括如下步骤:
步骤S602,对输入的含匹配关系参数压缩数据以及除该含匹配关系参数压缩数据之外的其他参数的压缩码流施行熵解码;
步骤S604,对映射后匹配关系参数的取值范围进行一对一的逆映射,复原并输出映射前的匹配关系参数;
步骤S606,根据匹配关系参数施行匹配解码;
步骤S608,对当前解码中匹配区域或者当前解码中解码块的各种参数和变量施行解码和重构运算;
步骤S610,暂存已重构的参考像素值集的像素值。
通过上述步骤,对在熵编码过程中得到的映射后匹配关系参数的取值范围进行逆映射,输出映射前的匹配关系参数,解决了相关技术中对匹配关系参数直接施行熵编码导致的问题,进而达到了熵编码的较好的数据压缩效果。
在另一个实施例中提供了一种图像编码方法,图7是根据本发明实施例的图像编码方法的流程图(一),如图7所示,该流程包括如下步骤:
步骤S702,对输入视频图像的像素进行匹配编码,得到一个或者多个匹配关系参数,其中,匹配关系参数是构造输入视频图像中像素的预测值和/或恢复值过程中使用的参数;
步骤S704,对匹配关系参数进行映射,得到匹配关系参数的映射值;
步骤S706,对匹配关系参数的映射值进行熵编码。
通过上述步骤,对匹配关系参数进行映射后,对映射后的匹配关系参数进行编码,相比于相关技术中,对匹配关系参数直接进行编码导致匹配关系参数的某个特定的整数,其出现的频度很高,但其值也很大,因而对其施行熵编码后产生很多的压缩码流数据,上述步骤解决了相关技术中对匹配关系参数直接施行熵编码导致的问题,进而达到了熵编码的较好的数据压缩效果。
在一个可选实施例中,随着匹配关系参数的映射值的增大匹配关系参数的映射值的频度变低;其中,该频度为认为映射值取值越大,该值实际出现的概率越小,即出现的“次数”越少。
上述步骤S704中涉及到对该匹配关系参数进行映射,在一个可选实施例中,根据已有匹配关系参数,对待匹配关系参数进行转换,将转换后得到的值作为待匹配关系参数的映射值;这里的映射操作可以理解为直接的“复制操作”,即不对输入数据做任何处理。和/或,对相同类型的匹配关系参数,按照指定规则进行聚集和/或重排列构成匹配关系参数组,对匹配关系参数组进行映射处理,将经过映射处理后得到的匹配关系参数组作为该匹配关系参数的映射值。从而完成了对匹配关系参数的映射。
上述的指定规则可以包含很多种,下面对此进行举例说明。在一个可选实施例中,指定规则可以是预先设定的规则,也可以是根据已有匹配关系参数取值设定的对多个待匹配关系参数进行聚集和/或重排列的操作步骤。
上述的对匹配关系参数组进行映射处理方法可以包含很多种,下面对此进行举例说明。在一个可选实施例中,处理方法可以是将匹配关系参数组中的匹配关系参数取值作为映射处理的输出,也可以是对匹配关系参数组中的匹配关系参数取值进行转换,将转换值作为映射处理的输出。
在本实施例中还提供了一种图像编码装置,该装置用于实现上述实施例及优选实施方式,已经进行过说明的不再赘述。如以下所使用的,术语“模块”可以实现预定功能的软件和/或硬件的组合。尽管以下实施例所描述的装置较佳地以软件来实现,但是硬件,或者软件和硬件的组合的实现也是可能并被构想的。
图8是根据本发明实施例的图像编码装置的结构框图(二),如图8所示,该装置包括:匹配编码模块82,设置为对输入视频图像的像素进行匹配编码,得到一个或者 多个匹配关系参数,其中,该匹配关系参数是构造输入视频图像中像素的预测值和/或恢复值过程中使用的参数;映射模块84,设置为对该匹配关系参数进行映射,得到匹配关系参数的映射值;熵编码模块86,设置为对该匹配关系参数的映射值进行熵编码。
在另一个实施例中提供了一种图像解码方法,图9是根据本发明实施例的图像解码方法的流程图(一),如图9所示,该流程包括如下步骤:
步骤S902,对接收到的码流进行熵解码,获取用于指示匹配关系参数的字段取值,其中,匹配关系参数是构造待解码视频图像中像素的预测值和/或恢复值过程中使用的参数;
步骤S904,对该字段取值进行映射,得到映射后的匹配关系参数;
步骤S906,根据该映射后的匹配关系参数,构造待解码视频图像中像素的预测值和/或恢复值。
通过上述步骤,对在熵编码过程中得到的映射后匹配关系参数的取值范围进行逆映射,输出映射前的匹配关系参数,解决了相关技术中对匹配关系参数直接施行熵编码导致的问题,进而达到了熵编码的较好的数据压缩效果。
在一个可选实施例中,随着匹配关系参数的映射值的增大匹配关系参数的映射值的频度变低;其中,该频度为认为映射值取值越大,该值实际出现的概率越小,即出现的“次数”越少。
上述步骤S904中涉及到对该字段取值进行映射,得到映射后的匹配关系参数,在一个可选实施例中,根据已获得的该匹配关系参数,对待处理的该字段取值进行转换,将转换后的值作为该映射后的匹配关系参数。在另一个可选实施例中,将相同类型的待处理字段,按照指定规则进行聚集和/或重排列构成数组,对该数组进行处理后作为该映射后的匹配关系参数。
可选地,该指定规则包括以下至少之一:预先设定的规则;根据已获得该字段取值设定的对该待处理的该字段取值进行聚集和/或重排列的操作步骤。
可选地,对上述数组进行处理,在一个可选实施例中,使用的处理方法可以是将数组中的待处理字段取值作为处理后的输出值,也可以是对数组中待处理字段取值进行转换,将转换值作为处理后的输出值。
在本实施例中还提供了一种图像解码装置,该装置用于实现上述实施例及优选实施方式,已经进行过说明的不再赘述。如以下所使用的,术语“模块”可以实现预定功能的软件和/或硬件的组合。尽管以下实施例所描述的装置较佳地以软件来实现,但是硬件,或者软件和硬件的组合的实现也是可能并被构想的。
图10是根据本发明实施例的图像解码装置的结构框图(二),如图10所示,该装置包括:熵解码模块102,设置为对接收到的码流进行熵解码,获取用于指示匹配关系参数的字段取值,其中,匹配关系参数是构造待解码图像中像素的预测值和/或恢复值过程中使用的参数;映射模块104,设置为对字段取值进行映射,得到映射后的匹配关系参数;构造模块106,设置为根据映射后的匹配关系参数,构造待解码图像中像素的预测值和/或恢复值。
针对相关技术中存在的上述问题,下面结合举例的可选实施例进行说明,在下述的可选实施例中结合了上述可选实施例及其可选实施方式。
本可选实施例的主要技术特征是在对一个匹配关系参数施行熵编码之前,对这个匹配关系参数的取值范围进行一个双向单一的映射(简称为双射),把取值范围内频度较高的值映射成较小的值,而把取值范围内频度较低的值映射成较大的值。双射也称为1对1的满射。双射存在逆映射并且逆映射也是1对1的满射。
图11是根据本发明实施例的匹配关系参数取值范围的双向单一映射的示意图,如图11所示,某个匹配关系参数的取值范围是1~12288之间的整数区间,表示为[1,12288]。这个匹配关系参数的频度的特性是4的倍数即4、8、12、……、6144、……、12288的频度远高于非4的倍数的频度。把4的倍数映射成1~3072之间的整数,而把非4的倍数映射成3073~12288之间的整数,这样,映射后匹配关系参数就具有随着数值变大其频度变低的整体趋势的特性,从而大大提高了后续熵编码的压缩效率。图11中映射的公式是:
4k映射成k,其中k=1、2、3、4、……、3072
4k+1映射成3072+3k+1,其中k=0、1、2、3、……、3071
4k+2映射成3072+3k+2,其中k=0、1、2、3、……、3071
4k+3映射成3072+3k+3,其中k=0、1、2、3、……、3071
这个映射是一个从取值范围的整数区间[1,12288]到整数区间[1,12288]本身的双射,其逆映射的公式是:
k映射成4k,其中k=1、2、3、4、……、3072
3072+3k+1映射成4k+1,其中k=0、1、2、3、……、3071
3072+3k+2映射成4k+2,其中k=0、1、2、3、……、3071
3072+3k+3映射成4k+3,其中k=0、1、2、3、……、3071
逆映射也是一个从取值范围的整数区间[1,12288]到整数区间[1,12288]本身的双射。
本发明可选实施例的编码装置中,最基本的特有技术特征就是首先对匹配编码产生的匹配关系参数进行取值范围的映射,使映射后匹配关系参数具有随着数值变大其频度变低的整体趋势的特性,然后再对映射后匹配关系参数施行熵编码。
本发明可选实施例的解码装置中,最基本的特有技术特征就是对熵解码得到匹配关系参数(实际是映射后匹配关系参数),首先进行取值范围的逆映射,得到真正的匹配关系参数,然后再使用匹配关系参数进行匹配解码。
图12是根据本发明实施例的编码装置的模块组成示意图,本发明可选实施例的编码装置示意图如图12所示。整个编码装置由以下模块组成:
1)像素预处理和匹配编码模块:对输入视频图像像素值施行像素预处理和匹配编码,产生并输出一个或若干匹配关系参数(分别标记为匹配关系参数1、匹配关系参数2、……、匹配关系参数J)和其他匹配编码结果。所述像素预处理的例:样值量化、颜色量化和基于颜色的像素聚类、用调色板和索引来表示输入原始像素的颜色;所述匹配编码的例:块匹配方式、微块匹配方式、微块串匹配方式、精细划分匹配方式、串匹配方式、调色板-索引匹配方式、2维保形匹配方式、4叉树(也称4分树)匹配方式、任意形状区域复制匹配方式;所述匹配关系参数的例:匹配位置、位移矢量、位移矢量的一个分量、匹配距离、匹配大小、匹配长度、匹配矩形的高度、匹配矩形的宽度、定义一个特定匹配区域的一组参数、若干种预先规定的匹配形状和尺寸的编号;一个匹配关系参数的取值范围是一个预先规定的按一定顺序排列的数的有限元素集合,如由小到大排列的整数的一个有限元素子集;所述其他匹配编码结果的例:匹配残差、未匹配像素值;
2)匹配关系参数的取值范围的映射模块:对一个匹配关系参数的取值范围进行一个双向单一的映射,所述映射的输入是所述模块1)输出的匹配关系参数,所述映射产生并输出映射后匹配关系参数;所述映射的目的是把取值范围内频度较高的值映射 成较小的值,而把取值范围内频度较低的值映射成较大的值;双向单一的映射也就是1对1的满射,简称为双射,双射存在逆映射并且逆映射也是1对1的满射;每一个匹配关系参数都有自己的一个映射,匹配关系参数1、匹配关系参数2、……、匹配关系参数J的映射模块分别标记为取值范围的映射模块1、取值范围的映射模块2、……、取值范围的映射模块J;有些匹配关系参数的映射可以是恒等映射(取值范围内的每个数值都映射到自己),但至少有一个匹配关系参数的映射不是恒等映射;所述映射的映射关系(即映射的输入与映射的输出之间的关系,什么输入数值映射到什么输出数值)可以是预先规定的静态的映射关系,也可以是根据输入匹配关系参数的各数值的实时统计特性(如到当前时刻为止出现的频度)进行动态调整;
3)其余的匹配方式和各种常用技术编码和重构模块:对输入视频图像、各种参数和变量施行其他匹配方式和各种常用技术,如帧内预测、帧间预测、变换、量化、逆变换、反量化、对应于预测残差和匹配残差的补偿(即取残差运算的逆运算)、DPCM、一阶和高阶差分、映射、游程、索引、去块效应滤波、样值自适应补偿(Sample Adaptive Offset),的编码和重构运算;所述其他匹配方式是指编码装置中不同于所述模块1)施行的匹配方式的匹配方式;本模块的输入是所述模块1)的输出、原始的所述输入视频图像像素值和参考像素;本模块的输出是重构像素值和其余编码结果;所述重构像素值放入已重构参考像素值暂存模块中,用作后续匹配编码运算、其余的匹配方式和各种常用技术编码和重构运算所需要的参考像素值;
4)已重构参考像素值暂存模块:暂存已重构的参考像素值集的像素值,即在编码过程中到当前编码中CU或当前编码中匹配区域(匹配区域也可以是匹配串或匹配块)的开始位置为止的已重构像素值,用作当前和后续匹配编码的参考像素值,也用作对当前和后续CU施行其他匹配方式和各种常用技术的编码和重构运算时所需要的参考像素值;
5)熵编码模块:对包括所述映射后匹配关系参数和所述其余编码结果在内的所有需要输出到压缩码流中的编码结果施行熵编码运算;熵编码的结果,即含匹配关系参数压缩数据以及其他编码结果的压缩码流,也是本编码装置的最后输出。
图13是根据本发明实施例的解码装置的模块组成示意图,本发明可选实施例的解码装置示意图如图13所示。整个解码装置由以下模块组成:
1)熵解码模块:对输入的含匹配关系参数压缩数据以及其他编码结果的压缩码流施行熵解码,并解析出熵解码得到的各种数据的意义;把解析得到的一个或若干映射后匹配关系参数(分别标记为映射后匹配关系参数1、映射后匹配关系参数2、……、 映射后匹配关系参数J)送往取值范围的逆映射模块;把解析得到的匹配残差、未匹配像素值等其他匹配编码结果和其余数据送往其余的匹配方式和各种常用技术解码和重构模块;一个映射后匹配关系参数的取值范围是一个预先规定的按一定顺序排列的数的有限元素集合,如由小到大排列的整数的一个有限元素子集;
2)匹配关系参数的取值范围的逆映射模块:对一个映射后匹配关系参数的取值范围进行一个双向单一的映射的逆映射,所述逆映射的输入是所述模块1)解析得到并输出的映射后匹配关系参数,所述逆映射复原并输出映射前(即未经编码装置中施行的映射)的匹配关系参数;每一个匹配关系参数都有自己的一个逆映射,匹配关系参数1、匹配关系参数2、……、匹配关系参数J的逆映射模块分别标记为取值范围的逆映射模块1、取值范围的逆映射模块2、……、取值范围的逆映射模块J;有些匹配关系参数的逆映射可以是恒等映射(取值范围内的每个数值都映射到自己),但至少有一个匹配关系参数的逆映射不是恒等映射;所述逆映射的逆映射关系(即逆映射的输入与逆映射的输出之间的关系,什么输入数值逆映射到什么输出数值)可以是预先规定的静态的逆映射关系,也可以是根据匹配关系参数的各数值的实时统计特性(如到当前时刻为止出现的频度)进行动态调整;所述匹配关系参数的例:匹配位置、位移矢量、位移矢量的一个分量、匹配距离、匹配大小、匹配长度、匹配矩形的高度、匹配矩形的宽度、定义一个特定匹配区域的一组参数、若干种预先规定的匹配形状和尺寸的编号;
3)匹配解码模块:根据所述匹配关系参数施行匹配解码运算;本模块的输入是所述模块2)输出的所述匹配关系参数;所述匹配解码的例:块匹配方式、微块匹配方式、微块串匹配方式、精细划分匹配方式、串匹配方式、调色板-索引匹配方式、2维保形匹配方式、4叉树(也称4分树)匹配方式、任意形状区域复制匹配方式;施行匹配解码运算时,首先确定匹配参考像素值在已重构参考像素值暂存模块中所处的位置以及确定由匹配参考像素值构成的匹配区域(匹配区域也可以是匹配串或匹配块)的形状和大小,然后从所述位置复制所述形状和大小的所述匹配区域内的匹配参考像素值,并将所述匹配参考像素值移动和粘贴到当前解码中匹配当前像素值的位置,复原出匹配当前像素值;本模块的输出是所有复原的所述匹配当前像素值;
4)其余的匹配方式和各种常用技术解码和重构模块:对当前解码中匹配区域(匹配区域也可以是匹配串或匹配块)或当前解码中CU的各种参数和变量施行其他匹配方式和各种常用技术,如帧内预测、帧间预测、逆变换、反量化、对应于预测残差和匹配残差的补偿(即取残差运算的逆运算)、DPCM、一阶和高阶差分、映射、游程、索引、去块效应滤波、样值自适应补偿(Sample Adaptive Offset),的解码和重构运算; 所述其他匹配方式是指解码装置中不同于所述模块3)施行的匹配方式的匹配方式;本模块的输出是重构像素值(包括完全重构像素值和不同程度的部分重构像素值);所述重构像素值放入已重构参考像素值暂存模块中,用作后续匹配解码运算、其余的匹配方式和各种常用技术解码和重构运算所需要的参考像素值;所述完全重构像素值也是本解码装置的最后输出;
5)已重构参考像素值暂存模块:暂存已重构的参考像素值集的像素值,即在解码过程中到当前解码中CU或当前解码中匹配区域(匹配区域也可以是匹配串或匹配块)的开始位置为止的已重构像素值,用作当前和后续匹配解码的参考像素值,也用作对当前和后续CU施行其他匹配方式和各种常用技术的解码和重构运算时所需要的参考像素值。
本发明可选实施例适用于叠包格式图像或CU的编码和解码。本发明可选实施例也同样适用于分量平面格式图像或CU的编码和解码。本发明可选实施例适用于无损匹配编码和解码。本发明实施例也同样适用于有损匹配编码和解码。本发明实施例适用于无损编码和解码。本发明实施例也同样适用于有损编码和解码。本发明可选实施例也适用于同时采用多种匹配方式(如同时采用块匹配方式、任意形状区域复制匹配方式、调色板-索引匹配方式这三种匹配方式或同时采用块匹配方式、调色板-索引匹配方式、串匹配方式这三种匹配方式)的编码和解码。
以上所提供的图示仅以示意方式说明本发明实施例的基本构想,图示中仅显示与本发明实施例直接有关的组件而非按照实际实施时的组件数目、形状及尺寸绘制,其实际实施时各组件的型态、数量及比例可为一种随意的改变,且其组件布局型态也可能更为复杂。
以下是本发明可选实施例的更多的实施细节和变体。
匹配关系参数的取值范围的映射的实施例1
上述取值范围被划分成K(通常1<K<20)个子取值范围,所述映射或所述逆映射也相应地被划分成K个子取值范围内的映射或逆映射。
匹配关系参数的取值范围的映射的实施例2
上述取值范围被划分成L(通常1<L<40)组子取值范围,每组子取值范围内的各个子取值范围都有互相相等的有限元素,上述映射或上述逆映射也相应地被划分成L组映射或L组逆映射,每一组映射或每一组逆映射把每一组子取值范围内的一个完 整的子取值范围映射或逆映射成同一组内的一个(可以是另一个也可以是同一个)完整的子取值范围,并且保持子取值范围内所有元素的顺序不变,即如果元素A排列在元素B之前,那么映射后元素A也排列在映射后元素B之前,或逆映射后元素A也排列在逆映射后元素B之前,反之亦然。
匹配关系参数的取值范围的映射的实施例3
上述取值范围或所述子取值范围内的一个上述映射或一个所述逆映射是若干个(通常少于4个)连续执行的部分映射或部分逆映射的合成。
匹配关系参数的取值范围的映射的实施例4
上述取值范围或所述子取值范围内的一个上述映射(或上述部分映射)的映射关系或一个上述逆映射(或上述部分逆映射)的逆映射关系,全部用一个或一组计算式来表示;或者全部用一个列表来表示;或者部分用一个或一组计算式来表示,部分用一个列表来表示。
匹配关系参数的取值范围的映射的实施例5
上述取值范围或所述子取值范围内的一个上述映射(或上述部分映射)的映射关系或一个所述逆映射(或上述部分逆映射)的逆映射关系随着当前编(解)码的一个状态或参数的改变而改变。
匹配关系参数的取值范围的映射的实施例6
上述取值范围或所述子取值范围内的一个所述映射(或上述部分映射)的映射关系或一个所述逆映射(或上述部分逆映射)的逆映射关系随着当前CU的宽度的改变而改变,即在当前CU的宽度为一个值时,采用一种映射关系或逆映射关系,在当前CU的宽度为另一个值时,采用另一种映射关系或逆映射关系;例如,设当前CU的宽度为W,某个匹配关系参数(如匹配距离)取值W的若干或全部倍数的频度远高于非W的若干或全部倍数的频度,因此,需要把W的若干或全部倍数映射成取值范围内较小的值而把非W的若干或全部倍数映射成取值范围内较大的值,这样,映射关系就与W有关,当W不同时,映射关系也不同,从而逆映射关系也不同。
匹配关系参数的取值范围的映射的实施例7
本实施例是实施例6的特例,上述匹配关系参数之一是匹配距离,上述当前CU的宽度W有4个值:64,32,16,8,上述映射或所述逆映射也相应地有4种映射关系或4种逆映射关系。
匹配关系参数的取值范围的映射的实施例8
除了上述各模块,还有一个匹配关系参数的取值范围内各数值的实时统计模块,实时统计各数值的特性,如到当前时刻为止各数值出现的频度;根据匹配关系参数的各数值的实时统计结果对所述映射(或上述部分映射)的映射关系或所述逆映射(或上述部分逆映射)的逆映射关系进行动态调整。
综上所述,通过本发明实施例提出的图像编码、解码方法及装置,提高了图像压缩性能。
在另外一个实施例中,还提供了一种软件,该软件用于执行上述实施例及优选实施方式中描述的技术方案。
在另外一个实施例中,还提供了一种存储介质,该存储介质中存储有上述软件,该存储介质包括但不限于:光盘、软盘、硬盘、可擦写存储器等。
显然,本领域的技术人员应该明白,上述的本发明的各模块或各步骤可以用通用的计算装置来实现,它们可以集中在单个的计算装置上,或者分布在多个计算装置所组成的网络上,可选地,它们可以用计算装置可执行的程序代码来实现,从而,可以将它们存储在存储装置中由计算装置来执行,并且在某些情况下,可以以不同于此处的顺序执行所示出或描述的步骤,或者将它们分别制作成各个集成电路模块,或者将它们中的多个模块或步骤制作成单个集成电路模块来实现。这样,本发明不限制于任何特定的硬件和软件结合。
以上所述仅为本发明的优选实施例而已,并不用于限制本发明,对于本领域的技术人员来说,本发明可以有各种更改和变化。凡在本发明的精神和原则之内,所作的任何修改、等同替换、改进等,均应包含在本发明的保护范围之内。
工业实用性:
本发明涉及数字视频压缩编码及解码,提供了一种图像编码、解码方法及装置,其中,该图像编码方法包括:对输入视频图像的像素进行匹配编码,得到一个或者多个匹配关系参数,其中,匹配关系参数是构造该图像中像素的预测值和/或恢复值过程中使用的参数;对匹配关系参数进行映射,得到匹配关系参数的映射值;对匹配关系 参数的映射值进行熵编码。通过本发明解决了相关技术中对匹配关系参数直接施行熵编码导致的问题,进而达到了熵编码的较好的数据压缩效果。

Claims (31)

  1. 一种图像编码装置,包括以下模块:
    模块1)像素预处理和匹配编码模块:设置为对输入视频图像的像素值施行像素预处理和匹配编码,产生并输出一个或者多个匹配关系参数和除所述一个或者多个匹配关系参数之外的其他匹配编码结果;
    模块2)映射模块:设置为对所述匹配关系参数的取值范围进行一对一的映射,所述映射的输入是所述模块1)输出的所述匹配关系参数,所述映射的输出为映射后的匹配关系参数;
    模块3)编码和重构模块:设置为对所述输入视频图像、所述匹配关系参数和变量施行编码和重构运算;
    模块4)暂存模块:设置为暂存已重构的参考像素值集的像素值;
    模块5)熵编码模块:设置为对包括所述映射后匹配关系参数和其余编码结果在内的所有需要输出到压缩码流中的编码结果施行熵编码运算;输出熵编码的结果,其中,所述熵编码的结果中包括匹配关系参数压缩数据以及其他编码结果的压缩码流。
  2. 根据权利要求1所述的装置,其中:所述取值范围被划分成K个子取值范围,所述映射也相应地被划分成K个子取值范围内的映射。
  3. 根据权利要求1或2所述的装置,其中:所述取值范围被划分成L组子取值范围,每组子取值范围内的各个子取值范围都有互相相等的有限元素,所述映射也相应地被划分成L组映射,每一组映射把每一组子取值范围内的一个完整的子取值范围映射成同一组内的一个完整的子取值范围,并且保持子取值范围内所有元素的顺序不变,其中L为自然数。
  4. 根据权利要求1至3中任一项所述的装置,其中:所述取值范围或者所述子取值范围内的一个所述映射由多个连续执行的部分映射合成。
  5. 根据权利要求1至4中任一项所述的装置,其中:所述取值范围或者所述子取值范围内的一个所述映射或者所述部分映射的映射关系,通过以下之一的方式表示:
    全部用一个或者一组计算式来表示;
    全部用一个列表来表示;
    部分用一个或者一组计算式来表示,部分用一个列表来表示。
  6. 根据权利要求1至4中任一项所述的装置,其中:所述取值范围或者所述子取值范围内的一个所述映射或者所述部分映射的映射关系,随着当前编码的一个状态或者参数的改变而改变。
  7. 根据权利要求1至4中任一项所述的装置,其中:所述取值范围或者所述子取值范围内的一个所述映射或者所述部分映射的映射关系,随着当前编码块的宽度的改变而改变。
  8. 根据权利要求7所述的装置,其中:所述匹配关系参数之一是匹配距离,所述当前编码块的宽度W有4个值:64,32,16,8,所述映射也相应地有4种映射关系。
  9. 根据权利要求1至4中任一项所述的装置,其中:所述装置还包括:
    实时统计模块,设置为实时统计匹配关系参数的取值范围内各数值的特性,根据所述匹配关系参数的各数值的实时统计结果对所述映射或者所述部分映射的映射关系,进行动态调整。
  10. 一种图像解码装置,包括以下模块:
    模块1)熵解码模块:设置为对输入的含匹配关系参数压缩数据以及除所述含匹配关系参数压缩数据的其他编码结果的压缩码流施行熵解码,并对熵解码得到的各种数据进行解析;
    模块2)逆映射模块:设置为对映射后匹配关系参数的取值范围进行一对一的逆映射,所述逆映射复原并输出映射前的匹配关系参数;
    模块3)匹配解码模块:设置为根据所述匹配关系参数施行匹配解码运算;
    模块4)解码和重构模块:设置为对当前解码中匹配区域或者当前解码中解码块的各种参数和变量施行解码和重构运算;
    模块5)暂存模块:设置为暂存已重构的参考像素值集的像素值。
  11. 根据权利要求10所述的装置,其中,所述匹配区域为匹配串或者匹配块。
  12. 根据权利要求10所述的装置,其中:所述取值范围被划分成K个子取值范围,所述逆映射也相应地被划分成K个子取值范围内的逆映射。
  13. 根据权利要求10或12所述的装置,其中:所述取值范围被划分成L组子取值范围,每组子取值范围内的各个子取值范围都有互相相等的有限元素,所述逆映射也相应地被划分成L组逆映射,每一组逆映射把每一组子取值范围内的一个完整的子取值范围逆映射成同一组内的一个完整的子取值范围,并且保持子取值范围内所有元素的顺序不变,其中L为自然数。
  14. 根据权利要求12或13所述的装置,其中:所述取值范围或者所述子取值范围内的一个所述映射或者一个所述逆映射由多个连续执行的部分映射或者部分逆映射合成。
  15. 根据权利要求10至14中任一项所述的装置,其中:所述取值范围或者所述子取值范围内的一个所述逆映射或者所述部分逆映射的逆映射关系,通过以下之一的方式表示:
    全部用一个或者一组计算式来表示;
    全部用一个列表来表示;
    部分用一个或者一组计算式来表示,部分用一个列表来表示。
  16. 根据权利要求10或14所述的装置,其中:所述取值范围或者所述子取值范围内的一个所述逆映射或者所述部分逆映射的逆映射关系随着当前解码的一个状态或者参数的改变而改变。
  17. 根据权利要求10至14中任一项所述的装置,其中:所述取值范围或者所述子取值范围内的一个所述逆映射或者所述部分逆映射的逆映射关系随着解码块的宽度的改变而改变。
  18. 根据权利要求17所述的装置,其中:所述匹配关系参数之一是匹配距离,所述解码块的宽度W有4个值:64,32,16,8,所述逆映射也相应地有4种逆映射关系。
  19. 根据权利要求10至14中任一项所述的装置,其中:所述装置还包括:
    实时统计模块,设置为实时统计匹配关系参数的取值范围内各数值的特性,根据所述匹配关系参数的各数值的实时统计结果对所述逆映射或者所述部分逆映射的逆映射关系进行动态调整。
  20. 一种图像编码方法,所述方法包括:
    对输入视频图像像素值施行像素预处理和匹配编码,产生并输出一个或者多个匹配关系参数;
    对所述匹配关系参数的取值范围进行一对一的映射,并输出映射后的匹配关系参数;
    对所述输入视频图像、所述匹配关系参数和变量施行编码和重构运算;
    暂存已重构的参考像素值集的像素值;
    对所述映射后匹配关系参数施行熵编码,输出熵编码后的结果。
  21. 一种图像解码方法,所述方法包括:
    对输入的含匹配关系参数压缩数据以及除所述含匹配关系参数压缩数据之外的其他参数的压缩码流施行熵解码;
    对映射后匹配关系参数的取值范围进行一对一的逆映射,复原并输出映射前的匹配关系参数;
    根据所述匹配关系参数施行匹配解码;
    对当前解码中匹配区域或者当前解码中解码块的各种参数和变量施行解码和重构运算;
    暂存已重构的参考像素值集的像素值。
  22. 一种图像编码方法,包括:
    对输入视频图像的像素进行匹配编码,得到一个或者多个匹配关系参数,其中,所述匹配关系参数是构造所述输入视频图像中像素的预测值和/或恢复值过程中使用的参数;
    对所述匹配关系参数进行映射,得到匹配关系参数的映射值;
    对所述匹配关系参数的映射值进行熵编码。
  23. 根据权利要求22所述的方法,其中,对所述匹配关系参数进行映射包括:
    根据已有匹配关系参数,对待匹配关系参数进行转换,将转换后得到的值作为所述待匹配关系参数的映射值;和/或,
    对相同类型的匹配关系参数,按照指定规则进行聚集和/或重排列构成匹配关系参数组,对所述匹配关系参数组进行映射处理,将经过映射处理后得到的匹配关系参数组作为所述匹配关系参数的映射值。
  24. 根据权利要求23所述的方法,其中,所述指定规则包括以下至少之一:
    预先设定的规则;
    根据已有匹配关系参数取值设定的对多个待匹配关系参数进行聚集和/或重排列的操作步骤。
  25. 根据权利要求23所述的方法,其中,对所述匹配关系参数组进行映射处理包括:
    将所述匹配关系参数组中的匹配关系参数取值作为映射处理的输出;和/或,
    对所述匹配关系参数组中的匹配关系参数取值进行转换后得到的值作为映射处理的输出。
  26. 一种图像解码方法,包括:
    对接收到的码流进行熵解码,获取用于指示匹配关系参数的字段取值,其中,所述匹配关系参数是构造待解码视频图像中像素的预测值和/或恢复值过程中使用的参数;
    对所述字段取值进行映射,得到映射后的匹配关系参数;
    根据所述映射后的匹配关系参数,构造所述待解码视频图像中像素的预测值和/或恢复值。
  27. 根据权利要求26所述的方法,其中,对所述字段取值进行映射,得到映射后的匹配关系参数包括:
    根据已获得的所述匹配关系参数,对待处理的所述字段取值进行转换,将转换后的值作为所述映射后的匹配关系参数;和/或,
    将相同类型的待处理字段的取值,按照指定规则进行聚集和/或重排列构成数组,对所述数组进行处理后作为所述映射后的匹配关系参数。
  28. 根据权利要求27所述解码方法,其中,所述指定规则包括以下至少之一:
    预先设定的规则;
    根据已获得所述字段取值设定的对所述待处理的所述字段取值进行聚集和/或重排列的操作步骤。
  29. 根据权利要求27所述方法,其中,对所述数组进行处理包括:
    将所述数组中的待处理字段取值作为处理后的输出值;和/或,
    对所述数组中的待处理字段取值进行转换后得到的值作为处理后的输出值。
  30. 一种图像编码装置,所述装置包括:
    匹配编码模块,设置为对输入视频图像的像素进行匹配编码,得到一个或者多个匹配关系参数,其中,所述匹配关系参数是构造所述输入视频图像中像素的预测值和/或恢复值过程中使用的参数;
    映射模块,设置为对所述匹配关系参数进行映射,得到匹配关系参数的映射值;
    熵编码模块,设置为对所述匹配关系参数的映射值进行熵编码。
  31. 一种图像解码装置,所述装置包括:
    熵解码模块,设置为对接收到的码流进行熵解码,获取用于指示匹配关系参数的字段取值,其中,所述匹配关系参数是构造待解码视频图像中像素的预测值和/或恢复值过程中使用的参数;
    映射模块,设置为对所述字段取值进行映射,得到映射后的匹配关系参数;
    构造模块,设置为根据所述映射后的匹配关系参数,构造所述待解码视频图像中像素的预测值和/或恢复值。
PCT/CN2015/078420 2014-05-06 2015-05-06 图像编码、解码方法及装置 WO2016172994A1 (zh)

Priority Applications (5)

Application Number Priority Date Filing Date Title
US15/507,249 US10834428B2 (en) 2015-04-30 2015-05-06 Image coding and decoding method and device
EP15890374.0A EP3177021B1 (en) 2015-04-30 2015-05-06 Image coding and decoding method and device
KR1020177005728A KR101946598B1 (ko) 2015-04-30 2015-05-06 이미지 코딩, 디코딩 방법 및 장치
JP2017511908A JP6360969B2 (ja) 2014-05-06 2015-05-06 画像符号化、復号化方法、及び装置
US17/061,414 US11451835B2 (en) 2014-05-06 2020-10-01 Method and device for entropy coding and decoding using mapping of matching relationship parameters

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201510219125.8A CN105100814B (zh) 2014-05-06 2015-04-30 图像编码、解码方法及装置
CN201510219125.8 2015-04-30

Related Child Applications (2)

Application Number Title Priority Date Filing Date
US15/507,249 A-371-Of-International US10834428B2 (en) 2015-04-30 2015-05-06 Image coding and decoding method and device
US17/061,414 Continuation US11451835B2 (en) 2014-05-06 2020-10-01 Method and device for entropy coding and decoding using mapping of matching relationship parameters

Publications (1)

Publication Number Publication Date
WO2016172994A1 true WO2016172994A1 (zh) 2016-11-03

Family

ID=57200721

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2015/078420 WO2016172994A1 (zh) 2014-05-06 2015-05-06 图像编码、解码方法及装置

Country Status (6)

Country Link
US (2) US10834428B2 (zh)
EP (1) EP3177021B1 (zh)
JP (1) JP6360969B2 (zh)
KR (1) KR101946598B1 (zh)
CN (1) CN105100814B (zh)
WO (1) WO2016172994A1 (zh)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113949867A (zh) * 2020-07-16 2022-01-18 武汉Tcl集团工业研究院有限公司 一种图像处理的方法及装置

Families Citing this family (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPWO2019065297A1 (ja) * 2017-09-29 2020-11-05 ソニー株式会社 情報処理装置および方法
CN110008478B (zh) * 2017-12-30 2023-10-31 中国移动通信集团贵州有限公司 语言转换方法、装置、计算设备及存储介质
US10649098B2 (en) 2018-01-29 2020-05-12 Samsung Electronics Co., Ltd. Light converting nanoparticle, method of making the light converting nanoparticle, and composition and optical film comprising the same
CN109151436B (zh) * 2018-09-30 2021-02-02 Oppo广东移动通信有限公司 数据处理方法及装置、电子设备及存储介质
EP3664017B1 (en) * 2018-12-06 2022-03-02 Robert Bosch GmbH Method and device for digital image or video data processing
CN111479116A (zh) * 2019-01-23 2020-07-31 上海天荷电子信息有限公司 等比特精度预测、映射和分段编码的数据压缩方法和装置
US11595694B2 (en) * 2020-04-01 2023-02-28 Tencent America LLC Method and apparatus for video coding
US11496731B2 (en) * 2020-06-08 2022-11-08 Tencent America LLC String matching with single color value
US20220066975A1 (en) * 2020-09-01 2022-03-03 Texas Instruments Incorporated Bit stream transformation in parallel data interfaces

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101557514A (zh) * 2008-04-11 2009-10-14 华为技术有限公司 一种帧间预测编解码方法、装置及系统
JP2010166552A (ja) * 2008-12-17 2010-07-29 Mitsubishi Electric Corp テーブル装置、符号化装置、復号装置および符号化/復号装置
US20110274169A1 (en) * 2010-05-05 2011-11-10 Paz Adar Device, system, and method for spatially encoding video data
CN102497546A (zh) * 2011-11-28 2012-06-13 同济大学 一种屏幕图像压缩装置及压缩方法

Family Cites Families (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP4769039B2 (ja) * 2005-07-26 2011-09-07 パナソニック株式会社 デジタル信号符号化および復号化装置ならびにその方法
CN102057678A (zh) * 2008-06-10 2011-05-11 松下电器产业株式会社 解码装置、解码方法及接收装置
US9554130B2 (en) * 2012-01-20 2017-01-24 Pantech Inc. Intra prediction mode mapping method and device using the method
CN103167289B (zh) * 2013-03-06 2015-10-28 硅谷数模半导体(北京)有限公司 图像的编码、解码方法及编码、解码装置
US10021419B2 (en) * 2013-07-12 2018-07-10 Qualcomm Incorported Rice parameter initialization for coefficient level coding in video coding process
WO2015054812A1 (en) * 2013-10-14 2015-04-23 Microsoft Technology Licensing, Llc Features of base color index map mode for video and image coding and decoding
US10542274B2 (en) * 2014-02-21 2020-01-21 Microsoft Technology Licensing, Llc Dictionary encoding and decoding of screen content
AU2014201583A1 (en) * 2014-03-14 2015-10-01 Canon Kabushiki Kaisha Method, apparatus and system for encoding and decoding video data using a block dictionary

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101557514A (zh) * 2008-04-11 2009-10-14 华为技术有限公司 一种帧间预测编解码方法、装置及系统
JP2010166552A (ja) * 2008-12-17 2010-07-29 Mitsubishi Electric Corp テーブル装置、符号化装置、復号装置および符号化/復号装置
US20110274169A1 (en) * 2010-05-05 2011-11-10 Paz Adar Device, system, and method for spatially encoding video data
CN102497546A (zh) * 2011-11-28 2012-06-13 同济大学 一种屏幕图像压缩装置及压缩方法

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See also references of EP3177021A4 *

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113949867A (zh) * 2020-07-16 2022-01-18 武汉Tcl集团工业研究院有限公司 一种图像处理的方法及装置
CN113949867B (zh) * 2020-07-16 2023-06-20 武汉Tcl集团工业研究院有限公司 一种图像处理的方法及装置

Also Published As

Publication number Publication date
EP3177021B1 (en) 2022-03-16
US20210021872A1 (en) 2021-01-21
EP3177021A4 (en) 2017-08-23
KR101946598B1 (ko) 2019-02-11
US20180242023A1 (en) 2018-08-23
CN105100814B (zh) 2020-07-14
KR20170038052A (ko) 2017-04-05
US10834428B2 (en) 2020-11-10
EP3177021A1 (en) 2017-06-07
CN105100814A (zh) 2015-11-25
US11451835B2 (en) 2022-09-20
JP2017529784A (ja) 2017-10-05
JP6360969B2 (ja) 2018-07-18

Similar Documents

Publication Publication Date Title
WO2016172994A1 (zh) 图像编码、解码方法及装置
US20230188736A1 (en) Methods and apparatuses for hierarchically encoding and decoding a bytestream
KR102071764B1 (ko) 영상 부호화, 복호화 방법 및 장치
CN109842803B (zh) 一种图像压缩的方法及装置
WO2015120823A1 (zh) 使用多种形式的参考像素存储空间的图像压缩方法和装置
KR101868247B1 (ko) 영상 부호화, 복호화 방법 및 장치
JP2017508415A (ja) 画像符号化/復号方法及び装置
WO2016054985A1 (zh) 图像编码、解码方法及装置
CN104581177B (zh) 一种结合块匹配和串匹配的图像压缩方法和装置
CN104754362B (zh) 使用精细划分块匹配的图像压缩方法
US20240080481A1 (en) Sparse matrix representation using a boundary of non-zero coefficients
EP4258671A1 (en) Point cloud attribute predicting method, encoder, decoder, and storage medium
CN104935945A (zh) 扩展参考像素样值集的图像压缩方法
WO2021197158A1 (zh) 一种图像处理方法和图像处理装置
WO2024065406A1 (zh) 编解码方法、码流、编码器、解码器以及存储介质
WO2023024842A1 (zh) 点云编解码方法、装置、设备及存储介质
CN117356092A (zh) 用于混合特征视频比特流和解码器的系统、方法和比特流结构

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 15890374

Country of ref document: EP

Kind code of ref document: A1

ENP Entry into the national phase

Ref document number: 20177005728

Country of ref document: KR

Kind code of ref document: A

Ref document number: 2017511908

Country of ref document: JP

Kind code of ref document: A

REEP Request for entry into the european phase

Ref document number: 2015890374

Country of ref document: EP

WWE Wipo information: entry into national phase

Ref document number: 15507249

Country of ref document: US

Ref document number: 2015890374

Country of ref document: EP

NENP Non-entry into the national phase

Ref country code: DE