WO2016172994A1 - 图像编码、解码方法及装置 - Google Patents
图像编码、解码方法及装置 Download PDFInfo
- Publication number
- WO2016172994A1 WO2016172994A1 PCT/CN2015/078420 CN2015078420W WO2016172994A1 WO 2016172994 A1 WO2016172994 A1 WO 2016172994A1 CN 2015078420 W CN2015078420 W CN 2015078420W WO 2016172994 A1 WO2016172994 A1 WO 2016172994A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- value
- mapping
- matching relationship
- matching
- relationship parameter
- Prior art date
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/90—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using coding techniques not provided for in groups H04N19/10-H04N19/85, e.g. fractals
- H04N19/91—Entropy coding, e.g. variable length coding [VLC] or arithmetic coding
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
- H04N19/157—Assigned coding mode, i.e. the coding mode being predefined or preselected to be further used for selection of another element or parameter
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
- H04N19/182—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being a pixel
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
- H04N19/503—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal prediction
- H04N19/51—Motion estimation or motion compensation
- H04N19/513—Processing of motion vectors
- H04N19/517—Processing of motion vectors by encoding
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
- H04N19/593—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving spatial prediction techniques
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/85—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using pre-processing or post-processing specially adapted for video compression
Definitions
- the present invention relates to digital video compression coding and decoding, and in particular to an image coding and decoding method and apparatus.
- the natural form of a digital video signal of an image is a sequence of images.
- Encoding a digital video signal encodes an image.
- HEVC High Efficiency Video Coding
- MxM pixels which is called "Coding Unit (CU).”
- the CU is used as the basic coding unit, and the sub-images are coded one by one.
- the size of the commonly used M is 4, 8, 16, 32, 64. Therefore, encoding a video image sequence is to sequentially encode each coding unit of each frame. Similarly, in decoding, each coding unit of each frame is sequentially decoded in the same order, and finally the entire video image sequence is reconstructed.
- HEVC encodes images using predictive coding.
- a predicted value of a pixel in an input video image is constructed based on the encoded image information, and then a difference between the original value of the pixel in the input video image and the predicted value is encoded, and a parameter required to construct the predicted value needs to be encoded.
- the decoding process first, the predicted value of the pixel in the image to be decoded is constructed according to the parameter obtained in the code stream and the decoded image information, and then the sum of the filtered predicted value and the difference obtained in the code stream is taken as the current value. The recovered value of the pixel in the image to be decoded. It should be noted that the encoding process itself also needs to construct a local decoding recovery value of the input video image using a method similar to the decoding process for constructing a prediction reference of the pixel prediction value in the subsequent input video image.
- each CU in an image can be different, some are 8x8, some are 64x64, and so on.
- LCUs Large Coding Units
- NxN pixels NxN pixels
- each LCU is further divided into multiple CUs that are not necessarily the same size.
- One of the LCUs consists of three 32x32 pixel CUs and four 16x16 pixel CUs.
- the other LCU consists of two 32x32 pixel CUs, three 16x16 pixel CUs, and 20 8x8 pixels.
- CU composition. Encoding an image is to sequentially encode one CU in one LCU. At any one time, the CU being coded is referred to as the current coded CU. Similarly, decoding one frame of image also sequentially decodes one CU in one LCU in the same order. At any one time, the CU being decoded is referred to as the currently decoded CU.
- the current coding CU or the current decoding CU are collectively referred to as the current CU.
- a color pixel consists of three components.
- the two most commonly used pixel color formats are the GBR color format consisting of a green component, a blue component, and a red component, and a generic term called YUV consisting of a luma component and two chroma components.
- Color formats such as YCbCr color format. Therefore, when encoding a CU, a CU can be divided into three component planes (G plane, B plane, R plane or Y plane, U plane, V plane), and the three component planes are respectively coded; The three component bundles of one pixel are combined into one 3-tuple, and the CUs composed of these 3-tuples are encoded as a whole.
- the arrangement of the former pixel and its components is called the planar format of the image (and its CU), and the arrangement of the latter pixel and its components is called the stacked format of the image (and its CU). Format).
- the YUV color format can be subdivided into several seed formats according to whether the chroma component is downsampled: a YUV 4:4:4 pixel color format consisting of 1 Y component, 1 U component, and 1 V component.
- the left and right adjacent pixels are composed of two Y components, one U component, and one V component in a YUV 4:2:2 pixel color format; four pixels arranged in a left and right adjacent position by 2x2 spatial position are composed of four pixels.
- YUV4: 2:0 pixel color format consisting of Y component, 1 U component, and 1 V component.
- a component is generally represented by a number of 8 to 16 bits.
- the YUV4:2:2 pixel color format and the YUV4:2:0 pixel color format are all downsampled for the YUV4:4:4 pixel color format.
- a pixel component is also referred to as a pixel sample or simply as a sample.
- pixel and pixel samples are collectively referred to as pixel values, that is, "pixel values” refer to both “pixels” and “pixel samples.”
- the reconstructed pixel values are generated, and are divided into different degrees of partially reconstructed pixel values generated during the encoding or decoding process and completely reconstructed after the encoding or decoding process is completed. Pixel values. If the fully reconstructed pixel value has an equal value to the original input pixel value prior to encoding, the encoding and decoding process that is experienced is referred to as lossless encoding and decoding. If the fully reconstructed pixel value has unequal values from the original input pixel value prior to encoding, the encoding and decoding process that is experienced is referred to as lossy encoding and decoding.
- the generated reconstructed pixel values are usually saved as historical data for use as reference pixel values for subsequent CU encoding or decoding.
- the storage space in which the reconstructed pixel history data is saved is referred to as a reference pixel value temporary storage space, which is also referred to as a reference pixel value set.
- the reference pixel value temporary storage space is limited, and only a part of historical data can be saved.
- the historical data in the reference pixel value temporary storage space may also include the reconstructed pixel value of the current CU.
- a notable feature of computer screen images is that there are often many similar or even identical pixel patterns within the same frame of image.
- Chinese or foreign text that often appears in computer screen images is composed of a few basic strokes, and many similar or identical strokes can be found in the same frame image.
- Menus, icons, etc. which are common in computer screen images, also have many similar or identical patterns.
- the intra prediction method used in the existing image and video compression technology only refers to adjacent pixel values, and cannot improve the compression efficiency by using similarity or identity in one frame image. Therefore, the HEVC Working Committee is studying and preparing to adopt several matching methods to fully exploit and utilize similar or identical patterns in computer screen images to greatly improve compression.
- the several matching methods include intra block matching (also called intra block copy), microblock matching, fine partition matching, string matching, and microblock.
- Matching method palette-index matching method, 2-dimensional conformal matching method, 4-fork tree (also called 4-point tree) matching method, arbitrary shape region copy matching method, and the like.
- the most basic matching relationship parameters such as matching position and matching size, are used to represent the matching relationship.
- the matching position indicates where in the set of reference pixel values composed of the reconstructed pixels, the matching reference pixel value that matches the pixel value in the current encoding (or decoding) (collectively referred to as matching the current pixel value), and the matching size Used to indicate the number of matching current pixel values.
- the number of matching current pixel values is equal to the number of matching reference pixel values.
- the matching position is the relative position between the matching reference pixel value and the matching current pixel value.
- the position matching the reference pixel value can be represented by either a 2-dimensional coordinate or a linear address
- the position matching the current pixel value can also be represented by either a 2-dimensional coordinate or a linear address. Therefore, the matching position can be used as the difference between the 2-dimensional coordinates matching the reference pixel value and the 2-dimensional coordinates matching the current pixel value, or the difference between the linear address matching the reference pixel value and the linear address matching the current pixel value, also called the displacement vector. To represent.
- the matching position ie the displacement vector
- two matching relationship parameters namely two vector components, such as a horizontal component and a vertical component.
- the matching position ie the displacement vector
- the difference of a matching relation parameter ie a linear address, which is also commonly referred to as the matching distance.
- the match size indicates how much of the matching current pixel value has the same matching position. Since the number of matching current pixel values is equal to the number of matching reference pixel values, the matching size also indicates how much the matching reference pixel values have the same matching position.
- the matching size is a matching relationship parameter, such as the length of the matching string, and several predetermined matching shapes and sizes (such as a square of 4x4 pixel value, a block of 4x8 pixel value, a square of 8x8 pixel value, The number of the 16x16 pixel value, etc.), etc.
- the matching size is a few matching relationship parameters, such as the matching relationship between the height and the width of the matching rectangle, matching the height of the right-angled trapezoid and the width of the upper and lower bases or equivalent to the three.
- the three matching relationship parameters are one matching relationship parameter indicating the length of each of the one horizontal line segments of one matching area composed of one horizontal line segments.
- the range of values for a matching relationship parameter is a predetermined set of finite elements of a number arranged in a certain order, the most common being a set of integers arranged from small to large.
- Two or three or more matching relationship parameters can also be combined into one matching relationship parameter through some operations.
- the merged match relationship parameters have a larger range of values.
- Entropy coding must be performed on the matching relationship parameters for data compression.
- the input to the entropy code is an integer with a predetermined range of values.
- Entropy coding is divided into two steps: 1) performing binaryization on the input integer, that is, converting the integer into a series of bits, each of which can take one of two values of 0 or 1; 2) for each The number of bits is subjected to context-based adaptive 2-value arithmetic coding.
- the binarization method used in the related art has a characteristic, that is, an integer having a small value, and is converted into a shorter number of bits after binarization, so that less data is generated after entropy coding is written into the compression code.
- the stream, and the larger integer is converted to a longer string of bits after binarization, so that more data is generated after the entropy coding is written into the compressed code stream.
- the frequency of any integer in the range of the matching relationship parameter, which occurs throughout the encoding process does not always decrease as its value increases, a specific integer A , the frequency of its occurrence p(A), It may be much higher than the frequency p(B) of the occurrence of a much smaller integer B, that is, A is much larger than B and p(A) is much higher than p(B), and the presentation frequency becomes larger as the integer value becomes larger.
- A is much larger than B
- p(A) is much higher than p(B)
- entropy coding is directly performed on the matching relationship parameter, and a situation often occurs in which a certain integer of the matching relationship parameter has a high frequency of occurrence, but its value is also large, and thus entropy is applied thereto. After encoding, a lot of compressed code stream data is generated.
- the present invention provides an image encoding and decoding method and apparatus to solve at least the problems caused by directly performing entropy coding on matching relationship parameters in the related art.
- an image encoding apparatus comprising the following modules: module 1)
- a pixel pre-processing and matching encoding module configured to perform pixel pre-processing and matching encoding on pixel values of the input video image, generate and output one or more matching relationship parameters, and other than the one or more matching relationship parameters Matching the coding result; module 2) mapping module: configured to perform a one-to-one mapping on the value range of the matching relationship parameter, where the input of the mapping is the matching relationship parameter output by the module 1), The output of the mapping is a mapped matching relationship parameter; module 3) encoding and reconstruction module: configured to perform encoding and reconstruction operations on the input video image, the matching relationship parameters and variables; and module 4) a temporary storage module: Set to temporarily store the pixel values of the reconstructed reference pixel value set; module 5) entropy encoding module: set to all the outputs that need to be output to the compressed code stream including the mapped matching relationship parameters and the remaining encoding results Encoding the result to perform an entropy encoding operation; outputting a result of the entropy en
- the value range is divided into K sub-value ranges
- the mapping is correspondingly divided into mappings within K sub-value ranges.
- the value range is divided into L group sub-value ranges, and each sub-value range in each group of sub-value ranges has equal finite elements, and the mapping is correspondingly divided into L Group mapping, each group mapping maps a complete sub-value range in each group of sub-value ranges to a complete sub-value range in the same group, and keeps the order of all elements in the sub-value range not Change, where L is a natural number.
- one of the mapping ranges or the mapping within the sub-value range is synthesized by a plurality of consecutively executed partial mappings.
- mapping range or the mapping relationship of the partial mapping or the partial mapping within the range of the value ranges is represented by one of the following: all represented by one or a set of calculation formulas; All are represented by a list; parts are represented by one or a set of calculations, and parts are represented by a list.
- mapping range or the mapping relationship of the partial mapping or the partial mapping within the range of values of the sub-value changes with a change of a state or a parameter of the current encoding.
- mapping range or the mapping relationship of the partial mapping or the partial mapping within the range of value ranges changes as the width of the current coding block changes.
- one of the matching relationship parameters is a matching distance
- the width W of the current coding block has four values: 64, 32, 16, and 8.
- the mapping also has four mapping relationships correspondingly.
- the device further includes: a real-time statistic module, configured to set the characteristics of each value in the range of values of the real-time statistical matching relationship parameter, and the real-time statistical result of each value of the matching relationship parameter to the mapping or the The mapping relationship of the partial mapping is dynamically adjusted.
- a real-time statistic module configured to set the characteristics of each value in the range of values of the real-time statistical matching relationship parameter, and the real-time statistical result of each value of the matching relationship parameter to the mapping or the The mapping relationship of the partial mapping is dynamically adjusted.
- an image decoding apparatus comprising the following module: module 1)
- Entropy decoding module configured to perform entropy decoding on the input compressed data stream containing the matching relationship parameter and the other encoded result including the matching relationship parameter compressed data, and parse various data obtained by entropy decoding; 2) inverse mapping module: set to perform one-to-one inverse mapping on the value range of the mapping relationship parameter after mapping, the inverse mapping recovers and outputs the matching relationship parameter before mapping; module 3) matching decoding module: set to The matching relationship parameter performs matching decoding operation; module 4) decoding and reconstruction module: configured to perform decoding and reconstruction operations on various parameters and variables of the currently decoded matching region or the currently decoded decoding block; module 5) Memory Module: Set to temporarily store the pixel values of the reconstructed reference pixel value set.
- the matching area is a matching string or a matching block.
- the value range is divided into K sub-value ranges
- the inverse mapping is correspondingly divided into inverse mappings within K sub-value ranges.
- the value range is divided into L group sub-value ranges, and each sub-value range in each group of sub-value ranges has equal finite elements, and the inverse map is correspondingly divided into L group inverse mapping, each set of inverse mapping inversely maps a complete sub-value range within each group of sub-value ranges into a complete sub-value range within the same group, and keeps all values within the sub-value range The order of the elements is unchanged, where L is a natural number.
- one of the mapping ranges or one of the inverse mappings in the range of values or the range of sub-values is synthesized by a plurality of consecutively executed partial mappings or partial inverse mappings.
- the inverse mapping or the inverse mapping of the partial inverse mapping in the value range or the sub-value range is represented by one of the following: all using one or a set of calculation formulas To represent; all represented by a list; parts are represented by one or a set of calculations, and parts are represented by a list.
- the inverse mapping or the inverse mapping of the partial inverse mapping in the value range or the sub-value range changes according to a state or a parameter of the current decoding.
- the inverse mapping or the inverse mapping of the partial inverse mapping in the value range or the sub-value range changes as the width of the decoding block changes.
- one of the matching relationship parameters is a matching distance
- the width W of the decoding block has four values: 64, 32, 16, and 8, and the inverse mapping also has four inverse mapping relationships correspondingly.
- the device further includes: a real-time statistic module configured to set a characteristic of each value in a range of values of the real-time statistical matching relationship parameter, and the inverse mapping or the real-time statistical result according to each value of the matching relationship parameter The inverse mapping relationship of the partial inverse mapping is dynamically adjusted.
- a real-time statistic module configured to set a characteristic of each value in a range of values of the real-time statistical matching relationship parameter, and the inverse mapping or the real-time statistical result according to each value of the matching relationship parameter The inverse mapping relationship of the partial inverse mapping is dynamically adjusted.
- an image encoding method comprising: performing pixel pre-processing and matching encoding on pixel values of an input video image, generating and outputting one or more matching relationship parameters; The value range of the parameter is mapped one-to-one, and the mapped matching relationship parameter is output; the input video image, the matching relationship parameter and the variable are subjected to encoding and reconstruction operations; and the reconstructed reference pixel is temporarily stored. a pixel value of the value set; performing entropy coding on the mapped matching relationship parameter, and outputting the entropy encoded result.
- an image decoding method comprising: compressing data for input matching parameter-containing parameters and compressing code stream of other parameters than the matching relationship parameter compressed data Performing entropy decoding; performing one-to-one inverse mapping on the value range of the matching relationship parameter after mapping, restoring and outputting the matching relationship parameter before mapping; performing matching decoding according to the matching relationship parameter; matching region or current in current decoding
- the decoding and reconstruction operations are performed on various parameters and variables of the decoded block in the decoding; the pixel values of the reconstructed reference pixel value set are temporarily stored.
- an image encoding method comprising: performing matching encoding on pixels of an input video image to obtain one or more matching relationship parameters, wherein the matching relationship parameter is to construct the input video image And a parameter used in the process of predicting a value of the pixel and/or recovering the value; mapping the matching relationship parameter to obtain a mapping value of the matching relationship parameter; and entropy encoding the mapping value of the matching relationship parameter.
- the mapping of the matching relationship parameter includes: converting a parameter to be matched according to an existing matching relationship parameter, and using the converted value as a mapping value of the parameter to be matched; and/or,
- the matching relationship parameters of the same type are aggregated and/or rearranged according to a specified rule to form a matching relationship parameter group, and the matching relationship parameter group is mapped, and the matching relationship parameter group obtained after the mapping processing is used as the matching relationship.
- the mapped value of the parameter includes: converting a parameter to be matched according to an existing matching relationship parameter, and using the converted value as a mapping value of the parameter to be matched; and/or,
- the matching relationship parameters of the same type are aggregated and/or rearranged according to a specified rule to form a matching relationship parameter group, and the matching relationship parameter group is mapped, and the matching relationship parameter group obtained after the mapping processing is used as the matching relationship.
- the mapped value of the parameter is
- the specified rule includes at least one of the following: a preset rule; an operation step of aggregating and/or rearranging a plurality of to-be-matched relationship parameters according to an existing matching relationship parameter value setting.
- performing mapping processing on the matching relationship parameter group includes: taking a value of a matching relationship parameter in the matching relationship parameter group as an output of a mapping process; and/or, in the matching relationship parameter group The value obtained by the matching relationship parameter is converted as the output of the mapping process.
- an image decoding method including: performing entropy decoding on a received code stream, and acquiring a field value for indicating a matching relationship parameter, wherein the matching relationship parameter is configured to be a parameter used in the process of decoding the predicted value and/or the restored value of the pixel in the video image; mapping the value of the field to obtain a mapped matching relationship parameter; constructing the to-be-matched according to the mapped matching relationship parameter The predicted and/or recovered values of the pixels in the video image are decoded.
- mapping the value of the field to obtain the mapped matching relationship parameter includes: converting, according to the obtained matching relationship parameter, a value of the field to be processed, and using the converted value as a Mapping the matching relationship parameters; and/or, the values of the same type of pending fields are aggregated and/or rearranged according to a specified rule to form an array, and the array is processed as the mapped match. Relationship parameters.
- the specified rule includes at least one of the following: a preset rule; and the value of the field to be processed is aggregated and/or rearranged according to the obtained field value setting. Steps.
- processing the array includes: taking a value of the to-be-processed field in the array as a processed output value; and/or, converting the value of the to-be-processed field in the array The obtained value is taken as the processed output value.
- an image encoding apparatus comprising: a matching encoding module configured to perform matching encoding on pixels of an input video image to obtain one or more matching relationship parameters, wherein the matching The relationship parameter is a parameter used in the process of constructing the predicted value and/or the restored value of the pixel in the input video image; the mapping module is configured to map the matching relationship parameter to obtain a mapping value of the matching relationship parameter; the entropy encoding module And set to entropy encode the mapped value of the matching relationship parameter.
- an image decoding apparatus comprising: an entropy decoding module, configured to perform entropy decoding on the received code stream, and obtain a field value for indicating a matching relationship parameter,
- the matching relationship parameter is a parameter used in constructing a predicted value and/or a restored value of a pixel in a video image to be decoded;
- the mapping module is configured to map the value of the field to obtain a mapped matching relationship parameter.
- a constructing module configured to construct a predicted value and/or a restored value of the pixel in the video image to be decoded according to the mapped matching relationship parameter.
- one or more matching relationship parameters are obtained by performing matching coding on pixels of the input video image, wherein the matching relationship parameter is a parameter used in constructing a predicted value and/or a restored value of a pixel in the image;
- the matching relationship parameters are mapped to obtain a mapping value of the matching relationship parameter;
- the mapping value of the matching relationship parameter is entropy encoded.
- FIG. 1 is a block diagram showing the structure of an image encoding apparatus according to an embodiment of the present invention
- FIG. 2 is a structural block diagram (1) of an image encoding apparatus according to an embodiment of the present invention.
- FIG. 3 is a flowchart of an image encoding method according to an embodiment of the present invention.
- FIG. 4 is a block diagram showing the structure of an image decoding apparatus according to an embodiment of the present invention.
- FIG. 5 is a structural block diagram (1) of an image decoding apparatus according to an embodiment of the present invention.
- FIG. 6 is a flowchart of an image decoding method according to an embodiment of the present invention.
- FIG. 7 is a flowchart (1) of an image encoding method according to an embodiment of the present invention.
- FIG. 8 is a structural block diagram (2) of an image encoding apparatus according to an embodiment of the present invention.
- FIG. 9 is a flowchart (1) of an image decoding method according to an embodiment of the present invention.
- FIG. 10 is a structural block diagram (2) of an image decoding apparatus according to an embodiment of the present invention.
- FIG. 11 is a schematic diagram of a bidirectional single mapping of a value range of a matching relationship parameter according to an embodiment of the present invention.
- FIG. 12 is a block diagram showing the composition of an encoding apparatus according to an embodiment of the present invention.
- FIG. 13 is a block diagram showing the composition of a decoding apparatus according to an embodiment of the present invention.
- the image encoding apparatus includes: a module 1) a pixel pre-processing and matching encoding module 22: configured to perform pixel values of an input video image.
- mapping module 24 setting to take the matching relationship parameters The value range is one-to-one mapping, the input of the mapping is the matching relationship parameter output by the module 1), the output of the mapping is the mapped matching relationship parameter; module 3) encoding and reconstruction module 26: set to the input Video image, the matching relationship parameter and variable performing encoding and reconstruction operations; module 4) temporary storage module 28: set to temporarily store pixel values of the reconstructed reference pixel value set; module 5) entropy encoding module 30: set to Entropy coding operation is performed on all coding results that need to be output to the compressed code stream, including the mapped matching relationship parameters and the remaining coding results; output entropy coding Fruit, wherein the result of the entropy encoding parameter included in matching relation to the other, and the compressed data of the compressed stream encoding result.
- the mapping relationship parameter is encoded.
- the matching relationship parameter is directly encoded to cause a specific integer of the matching relationship parameter.
- the frequency of occurrence is very high, but its value is also very large. Therefore, entropy coding is performed to generate a lot of compressed code stream data.
- the above image coding device solves the problem that the correlation parameter directly performs entropy coding in the related art. The problem, in turn, achieves a better data compression effect of entropy coding.
- the above value range is divided into K sub-value ranges, and the mapping is correspondingly divided into mappings within K sub-value ranges.
- the value range is divided into L group sub-value ranges, and each sub-value range in each group of sub-value ranges has equal finite elements, and the mapping is correspondingly divided.
- each group mapping maps a complete sub-value range within each group of sub-value ranges into a complete sub-value range within the same group, and maintains all elements within the sub-value range The order is unchanged, where L is a natural number.
- the above-mentioned range of values or a mapping within the range of sub-values is synthesized by a plurality of consecutively executed partial mappings.
- the above-mentioned value range or a mapping relationship of the mapping or the partial mapping in the sub-value range may be represented in various manners, which will be exemplified below. In an alternative embodiment, it is represented by one of the following: all represented by one or a set of calculation formulas; all represented by a list; partially represented by one or a set of calculation formulas, partially by a list Said.
- mapping range or the mapping relationship of a partial mapping or the partial mapping within the above value range or the sub-value range changes as a state or parameter of the current encoding changes.
- mapping range or the mapping relationship of the partial mapping within the value range or the sub-value range changes as the width of the current coding block changes.
- the matching relationship parameter is a matching distance
- the width W of the current coding block has four values: 64, 32, 16, and 8.
- the mapping also has corresponding 4 mapping relationships.
- the apparatus further includes: a real-time statistic module 32 configured to set values of values in a real-time statistical matching relationship parameter.
- the feature dynamically adjusts the mapping relationship between the mapping or the partial mapping according to the real-time statistical result of each value of the matching relationship parameter.
- FIG. 3 is a flowchart of an image encoding method according to an embodiment of the present invention. As shown in FIG. 3, the flow includes the following steps:
- Step S302 performing pixel pre-processing and matching encoding on the pixel values of the input video image, generating and outputting one or more matching relationship parameters;
- Step S304 performing a one-to-one mapping on the value range of the matching relationship parameter, and outputting the mapped matching relationship parameter;
- Step S306 performing encoding and reconstruction operations on the input video image, the matching relationship parameter, and the variable
- Step S308 temporarily storing pixel values of the reconstructed reference pixel value set
- Step S310 performing entropy coding on the mapped matching relationship parameter, and outputting the entropy encoded result.
- the mapping relationship parameter is encoded.
- the matching relationship parameter is directly encoded to cause a specific integer of the matching relationship parameter to appear.
- the frequency is very high, but its value is also very large, so entropy coding is performed to generate a lot of compressed code streams.
- the above image coding device solves the problem caused by directly performing entropy coding on the matching relationship parameters in the related art, thereby achieving better data compression effect of entropy coding.
- the apparatus includes the following modules: a module 1) an entropy decoding module 42: configured to compress data corresponding to an input matching relationship parameter and The compressed code stream containing the other coding result of the matching relationship parameter compression data is subjected to entropy decoding, and parsing various data obtained by entropy decoding; module 2) inverse mapping module 44: setting the value range of the matching relationship parameter after mapping Performing a one-to-one inverse mapping that restores and outputs the pre-map matching relationship parameters; module 3) matching decoding module 46: configured to perform a matching decoding operation based on the matching relationship parameters; module 4) decoding and reconstruction module 48 : setting to perform decoding and reconstruction operations on various parameters and variables of the currently decoded decoding region or the currently decoded decoding block; module 5) temporary storage module 50: set to temporarily store the reconstructed reference pixel value set pixel value.
- the image decoding device performs inverse mapping on the range of the mapping matching relationship parameters obtained in the entropy encoding process, and outputs the matching relationship parameters before the mapping, thereby solving the direct entropy coding of the matching relationship parameters in the related art.
- the problem in turn, achieves a better data compression effect of entropy coding.
- the matching area is a matching string or a matching block.
- the value range is divided into K sub-value ranges
- the inverse map is correspondingly divided into inverse maps within K sub-value ranges.
- the value range is divided into L group sub-value ranges, and each sub-value range in each group of sub-value ranges has equal finite elements
- the inverse map is correspondingly Divided into L-group inverse mappings, each set of inverse mapping inversely maps a complete sub-value range within each group of sub-value ranges into a complete sub-value range within the same group, and maintains the sub-value range The order of all elements in the same is unchanged, where L is a natural number.
- one of the mappings or one of the mappings within the range of values or sub-values is synthesized by a plurality of consecutively executed partial mappings or partial inverse mappings.
- An inverse mapping of the inverse mapping or the partial inverse mapping in the range of value ranges or sub-values may have multiple representations. In an alternative embodiment, it is represented by one of the following: all using one or A set of calculations; all represented by a list; partially represented by one or a set of calculations, and partially represented by a list.
- an inverse mapping within the range of values or sub-values or an inverse mapping of the partial inverse mapping changes as a state or parameter of the current decoding changes.
- the inverse mapping of an inverse mapping or partial inverse mapping within a range of values or sub-values changes as the width of the decoding block changes.
- the matching relationship parameter may be a plurality of information.
- the matching relationship parameter is the matching distance
- the width W of the decoding block has 4 values: 64, 32, 16, 8 and the inverse mapping also has corresponding 4 inverse mapping relationships.
- FIG. 5 is a structural block diagram (1) of an image decoding apparatus according to an embodiment of the present invention.
- the apparatus further includes: a real-time statistics module 52 configured to set values of values in a real-time statistical matching relationship parameter.
- the feature dynamically adjusts the inverse mapping or the inverse mapping of the partial inverse mapping according to the real-time statistical result of each value of the matching relationship parameter.
- FIG. 6 is a flowchart of an image decoding method according to an embodiment of the present invention. As shown in FIG. 6, the flow includes the following steps:
- Step S602 performing entropy decoding on the input compressed code stream containing the matching relationship parameter and the other parameters except the matching relationship parameter compressed data
- Step S604 performing one-to-one inverse mapping on the value range of the mapping relationship parameter after mapping, and restoring and outputting the matching relationship parameter before mapping;
- Step S606 performing matching decoding according to the matching relationship parameter
- Step S608 performing decoding and reconstruction operations on various parameters and variables of the currently decoded region or the currently decoded block in the decoding
- Step S610 temporarily storing the pixel values of the reconstructed reference pixel value set.
- the value range of the mapping matching relationship parameter obtained in the entropy coding process is inversely mapped, and the matching relationship parameter before the mapping is output, which solves the problem caused by directly performing entropy coding on the matching relationship parameter in the related art. In turn, a better data compression effect of entropy coding is achieved.
- FIG. 7 is a flowchart (1) of an image encoding method according to an embodiment of the present invention. As shown in FIG. 7, the flow includes the following steps:
- Step S702 performing matching coding on the pixels of the input video image to obtain one or more matching relationship parameters, wherein the matching relationship parameter is a parameter used in constructing a predicted value and/or a restored value of the pixel in the input video image;
- Step S704 mapping the matching relationship parameters to obtain a mapping value of the matching relationship parameter
- Step S706 entropy encoding the mapping value of the matching relationship parameter.
- the mapping relationship parameter is encoded.
- the matching relationship parameter is directly encoded to cause a specific integer of the matching relationship parameter to appear.
- the frequency is very high, but its value is also very large. Therefore, entropy coding is performed to generate a lot of compressed code stream data. The above steps solve the problem caused by directly performing entropy coding on the matching relationship parameters in the related art, thereby achieving entropy. Better data compression for encoding.
- the frequency of the mapping value of the matching relationship parameter becomes lower as the mapping value of the matching relationship parameter increases; wherein the frequency is that the value of the mapping value is larger, and the value actually appears. The smaller the probability, the fewer "numbers" that occur.
- the matching relationship parameter is mapped.
- the matching relationship parameter is converted according to the existing matching relationship parameter, and the converted value is used as the mapping value of the parameter to be matched.
- the mapping operation here can be understood as a direct "copy operation", that is, no processing is performed on the input data.
- the aggregation and/or rearrangement constitutes a matching relationship parameter group, and the matching relationship parameter group is mapped, and the matching relationship parameter group obtained after the mapping process is used as the Matches the mapped values of the relationship parameters. Thereby the mapping of the matching relationship parameters is completed.
- the specified rule may be a preset rule, or may be an operation step of aggregating and/or rearranging a plurality of parameters to be matched according to the value of the existing matching relationship parameter.
- mapping processing method for the matching relationship parameter group may include many types, which will be exemplified below.
- the processing method may be: taking the value of the matching relationship parameter in the matching relationship parameter group as the output of the mapping process, or converting the value of the matching relationship parameter in the matching relationship parameter group, and converting The value is used as the output of the mapping process.
- module may implement a combination of software and/or hardware of a predetermined function.
- apparatus described in the following embodiments is preferably implemented in software, hardware, or a combination of software and hardware, is also possible and contemplated.
- FIG. 8 is a structural block diagram (2) of an image encoding apparatus according to an embodiment of the present invention.
- the apparatus includes: a matching encoding module 82 configured to perform matching encoding on pixels of an input video image to obtain one or a plurality of matching relationship parameters, wherein the matching relationship parameter is a parameter used in constructing a predicted value and/or a restored value of a pixel in the input video image; the mapping module 84 is configured to map the matching relationship parameter to obtain a matching relationship The mapped value of the parameter; the entropy encoding module 86 is configured to entropy encode the mapped value of the matching relationship parameter.
- FIG. 9 is a flowchart (1) of an image decoding method according to an embodiment of the present invention. As shown in FIG. 9, the process includes the following steps:
- Step S902 performing entropy decoding on the received code stream, and obtaining a field value for indicating a matching relationship parameter, where the matching relationship parameter is used in constructing a predicted value and/or a recovery value of a pixel in the video image to be decoded. parameter;
- Step S904 mapping the value of the field to obtain a mapping relationship parameter
- Step S906 constructing a predicted value and/or a restored value of a pixel in the video image to be decoded according to the mapped matching relationship parameter.
- the value range of the mapping matching relationship parameter obtained in the entropy coding process is inversely mapped, and the matching relationship parameter before the mapping is output, which solves the problem caused by directly performing entropy coding on the matching relationship parameter in the related art. In turn, a better data compression effect of entropy coding is achieved.
- the frequency of the mapping value of the matching relationship parameter becomes lower as the mapping value of the matching relationship parameter increases; wherein the frequency is that the value of the mapping value is larger, and the value actually appears. The smaller the probability, the fewer "numbers" that occur.
- step S904 the value of the field is mapped, and the mapped matching relationship parameter is obtained.
- the value of the field to be processed is converted according to the obtained matching relationship parameter, and The converted value is used as the matching relationship parameter of the mapping.
- the same type of pending fields are aggregated and/or rearranged according to a specified rule to form an array, and the array is processed as the mapped matching relationship parameter.
- the specified rule includes at least one of the following: a preset rule; and an operation step of aggregating and/or rearranging the value of the field to be processed according to the value obtained by the field.
- the foregoing array is processed.
- the processing method used may be to take the value of the to-be-processed field in the array as the processed output value, or to take the to-be-processed field in the array. The value is converted and the converted value is taken as the processed output value.
- module may implement a combination of software and/or hardware of a predetermined function.
- apparatus described in the following embodiments is preferably implemented in software, hardware, or a combination of software and hardware, is also possible and contemplated.
- FIG. 10 is a structural block diagram (2) of an image decoding apparatus according to an embodiment of the present invention.
- the apparatus includes: an entropy decoding module 102 configured to perform entropy decoding on a received code stream, and obtain an indication for obtaining The field of the matching relationship parameter takes a value, wherein the matching relationship parameter is a parameter used in constructing a predicted value and/or a restored value of a pixel in the image to be decoded; the mapping module 104 is configured to map the value of the field to obtain a mapping The matching relationship parameter; the constructing module 106 is configured to construct a predicted value and/or a restored value of the pixel in the image to be decoded according to the mapped matching relationship parameter.
- the main technical feature of the optional embodiment is that before performing entropy coding on a matching relationship parameter, a two-way single mapping (referred to as bijection) is performed on the value range of the matching relationship parameter, and the frequency within the range is taken. Higher values are mapped to smaller values, while values with lower frequencies within the range of values are mapped to larger values. Bijection is also called a one-to-one full shot. Bijection has an inverse mapping and inverse mapping is also a one-to-one full shot.
- FIG. 11 is a schematic diagram of a bidirectional single mapping of a value range of a matching relationship parameter according to an embodiment of the present invention.
- a matching range of a matching relationship parameter is an integer interval between 1 and 12288, expressed as [ 1,12288].
- the frequency characteristic of this matching relationship parameter is a multiple of 4, that is, the frequency of 4, 8, 12, ..., 6144, ..., 12288 is much higher than the frequency of a multiple of 4.
- the multiple of 4 is mapped to an integer between 1 and 3072, and the multiple of 4 is mapped to an integer between 3073 and 12288.
- the matching relationship parameter after mapping has a frequency that becomes lower as the value becomes larger.
- the characteristics of the overall trend which greatly improves the compression efficiency of subsequent entropy coding.
- the formula for mapping in Figure 11 is:
- This mapping is a bijection from the integer interval [1,12288] of the range of values to the integer interval [1,12288].
- the formula for the inverse mapping is:
- the inverse mapping is also a bijection from the integer interval [1, 12288] of the range of values to the integer interval [1, 12288] itself.
- the most basic characteristic feature is that the mapping of the matching relationship parameters generated by the matching coding is first performed, so that the matching relationship parameters after the mapping have a frequency change as the value becomes larger. The characteristics of the low overall trend are then entropy encoded by the mapped matching relationship parameters.
- the entropy decoding obtains the matching relationship parameter (actually the mapping matching relationship parameter), and first performs inverse mapping of the value range to obtain a true matching relationship parameter. Then use the matching relationship parameters for matching decoding.
- the matching relationship parameter actually the mapping matching relationship parameter
- FIG. 12 is a schematic diagram of a module structure of an encoding apparatus according to an embodiment of the present invention.
- FIG. 12 is a schematic diagram of an encoding apparatus according to an alternative embodiment of the present invention.
- the entire coding device consists of the following modules:
- pixel preprocessing and matching coding module performing pixel preprocessing and matching coding on pixel values of the input video image, generating and outputting one or several matching relationship parameters (labeled as matching relationship parameter 1, matching relationship parameter 2, ..., respectively) Match relationship parameters J) and other matching coding results.
- Examples of the pixel preprocessing sample quantization, color quantization, and color-based pixel clustering, using a palette and an index to represent the color of the input original pixel;
- examples of the matching encoding block matching mode, microblock matching Mode, microblock string matching method, fine division matching method, string matching method, palette-index matching method, 2-dimensional conformal matching method, 4-fork tree (also called 4-point tree) matching method, arbitrary shape region copy matching Method;
- examples of the matching relationship parameter matching position, displacement vector, a component of the displacement vector, matching distance, matching size, matching length, height of the matching rectangle, width of the matching rectangle, and a set of parameters defining a specific matching area a number of pre-specified matching shapes and sizes;
- a matching relationship parameter ranges from a predetermined finite element set of numbers in a certain order, such as a finite element of an integer arranged from small to large Set; examples of the other matching coding results: matching residuals, unmatched pixel values;
- mapping module that matches the value range of the relationship parameter: a bidirectional single mapping of the value range of a matching relationship parameter, the input of the mapping is a matching relationship parameter output by the module 1), and the mapping generates And outputting the mapped matching relationship parameter; the purpose of the mapping is to map the value with higher frequency within the range of values A smaller value is formed, and a value with a lower frequency within the range of values is mapped to a larger value; a bidirectional single mapping is a one-to-one full shot, which is simply called bijection, and bijection has inverse mapping and inverse The mapping is also a one-to-one full shot; each matching relationship parameter has its own mapping, the matching relationship parameter 1, the matching relationship parameter 2, ..., the mapping parameter of the matching relationship parameter J are respectively marked as the mapping module of the value range 1.
- mapping module 2 of value range mapping module J of value range
- mapping of some matching relationship parameters can be an identity mapping (each value in the range of values is mapped to itself), but at least A mapping of matching relationship parameters is not an identity mapping
- the mapping relationship of the mapping ie, the relationship between the input of the mapping and the output of the mapping, and what input value is mapped to what output value
- the remaining matching methods and various common techniques of encoding and reconstruction modules performing other matching methods on input video images, various parameters and variables, and various commonly used techniques, such as intra prediction, inter prediction, transform, quantization, Inverse transform, inverse quantization, compensation corresponding to prediction residual and matching residual (ie inverse operation of residual operation), DPCM, first-order and higher-order difference, mapping, run, index, deblocking filtering, sample Adaptive compensation (Sample Adaptive Offset), encoding and reconstruction operation;
- the other matching manner refers to a matching manner in the encoding device different from the matching manner performed by the module 1);
- the input of the module is the module 1
- the output of the module is the reconstructed pixel value and the remaining encoding result;
- the reconstructed pixel value is placed in the reconstructed reference pixel value temporary storage module, Used as a reference matching pixel operation for subsequent matching coding operations, remaining matching methods, and various common techniques of
- the reconstructed reference pixel value temporary storage module temporarily stores the pixel value of the reconstructed reference pixel value set, that is, the matching region in the CU or the current encoding in the current encoding during the encoding process (the matching region may also be a matching string)
- the reconstructed pixel values up to the beginning of the matching block) are used as reference pixel values for current and subsequent matching encoding, and are also used as encoding and reconstruction operations for other matching methods and various common techniques for current and subsequent CUs.
- the required reference pixel value is used as reference pixel values for current and subsequent matching encoding, and are also used as encoding and reconstruction operations for other matching methods and various common techniques for current and subsequent CUs.
- an entropy coding module performing an entropy coding operation on all coding results that need to be outputted into the compressed code stream, including the mapped matching relationship parameter and the remaining coding result; the result of entropy coding, that is, the matching relationship parameter
- the compressed stream of compressed data and other encoded results is also the final output of the encoding device.
- FIG. 13 is a schematic diagram of a module structure of a decoding apparatus according to an embodiment of the present invention.
- FIG. 13 is a schematic diagram of a decoding apparatus according to an alternative embodiment of the present invention.
- the entire decoding device consists of the following modules:
- Entropy decoding module performing entropy decoding on the input compressed stream containing the matching relationship parameter and other encoded results, and parsing the meaning of various data obtained by entropy decoding; and matching one or several mappings obtained after parsing Relationship parameters (marked as mapping matching relationship parameter 1, mapping matching relationship parameter 2, ..., respectively)
- the mapping relationship parameter J) is sent to the inverse mapping module of the value range; the matching residuals, unmatched pixel values and other matching coding results and the rest of the data are sent to the remaining matching methods and various common techniques for decoding and Reconstruction module;
- a mapping range of the matching relationship parameter is a predetermined finite element set of numbers arranged in a certain order, such as a finite element subset of integers arranged from small to large;
- an inverse mapping module of the value range of the matching relationship parameter performing an inverse mapping of a bidirectional single mapping on the value range of the matching matching parameter, and the input of the inverse mapping is obtained by parsing the module 1)
- the output maps the matching relationship parameters, and the inverse map restores and outputs the matching relationship parameters before the mapping (ie, the mapping performed in the unencoded device); each matching relationship parameter has its own inverse mapping, and the matching relationship parameter 1
- the inverse mapping module of the matching relationship parameter 2 is respectively marked as the inverse mapping module of the value range, the inverse mapping module 2 of the value range, the inverse mapping module J of the value range;
- the inverse mapping of some matching relationship parameters may be an identity mapping (each value in the range of values is mapped to itself), but the inverse mapping of at least one matching relation parameter is not an identity mapping; the inverse mapping relationship of the inverse mapping (ie, the relationship between the inverse mapped input and the inverse mapped output, what input value is inversely mapped to what output value
- matching decoding module performing matching decoding operation according to the matching relationship parameter; the input of the module is the matching relationship parameter output by the module 2); the matching decoding example: block matching mode, microblock matching mode , microblock string matching method, fine division matching method, string matching method, palette-index matching method, 2-dimensional conformal matching method, 4-fork tree (also called 4-point tree) matching method, arbitrary shape region copy matching method
- the matching decoding operation first determining the position of the matching reference pixel value in the reconstructed reference pixel value temporary storage module and determining the matching region composed of the matching reference pixel values (the matching region may also be a matching string or a matching block) a shape and size, then copying matching reference pixel values within the matching region of the shape and size from the location, and moving and pasting the matching reference pixel values to a location in the current decoding that matches the current pixel value , restoring the matching current pixel value; the output of the module is all the restored current pixel values of the restoration;
- the remaining matching methods and various common techniques of decoding and reconstruction modules performing matching methods on the matching regions in the current decoding (the matching regions may also be matching strings or matching blocks) or various parameters and variables of the currently decoded CU. And various common techniques, such as intra prediction, inter prediction, inverse transform, inverse quantization, compensation corresponding to prediction residual and matching residual (ie, inverse operation of residual operation), DPCM, first order and higher order Decoding, reconstruction, run-length, indexing, deblocking filtering, sample adaptive offset (Sample Adaptive Offset), decoding and reconstruction operations;
- the other matching manner refers to a matching manner of a matching manner performed by the module 3) in the decoding device; the output of the module is a reconstructed pixel value (including a completely reconstructed pixel value and a partially reconstructed partial reconstructed pixel value)
- the reconstructed pixel value is placed in the reconstructed reference pixel value temporary storage module, and is used as a reference pixel value required for subsequent matching decoding operations, remaining
- the reconstructed reference pixel value temporary storage module temporarily stores the pixel value of the reconstructed reference pixel value set, that is, the matching region in the CU or the current decoding in the current decoding process during the decoding process (the matching region may also be a matching string) Or the reconstructed pixel value up to the beginning of the matching block), used as the reference pixel value for the current and subsequent matching decoding, and also used as the decoding and reconstruction operation for the current and subsequent CUs to perform other matching methods and various common techniques.
- the required reference pixel value is temporarily stores the pixel value of the reconstructed reference pixel value set, that is, the matching region in the CU or the current decoding in the current decoding process during the decoding process (the matching region may also be a matching string) Or the reconstructed pixel value up to the beginning of the matching block), used as the reference pixel value for the current and subsequent matching decoding, and also used as the decoding and reconstruction operation for the current and subsequent CUs to perform other matching methods and various common techniques.
- Alternative embodiments of the present invention are applicable to the encoding and decoding of overlay format images or CUs.
- Alternative embodiments of the invention are equally applicable to the encoding and decoding of component plane format images or CUs.
- Alternative embodiments of the present invention are applicable to lossless matching encoding and decoding.
- Embodiments of the invention are equally applicable to lossy matching coding and decoding.
- Embodiments of the present invention are applicable to lossless encoding and decoding.
- Embodiments of the invention are equally applicable to lossy encoding and decoding.
- the optional embodiment of the present invention is also applicable to adopting multiple matching methods at the same time (for example, using the block matching method, the arbitrary shape region copy matching method, the palette-index matching method, or the block matching method, and adjusting at the same time. Encoding and decoding of the swatch-index matching method and the string matching method.
- the above range of values is divided into K (usually 1 ⁇ K ⁇ 20) sub-value ranges, and the mapping or the inverse mapping is correspondingly divided into mappings or inverse mappings within K sub-value ranges.
- the above range of values is divided into L (usually 1 ⁇ L ⁇ 40) sub-value range, and each sub-value range in each sub-value range has equal finite elements, and the above mapping or the inverse mapping described above is also Correspondingly, it is divided into an L group mapping or an L group inverse mapping, and each group mapping or each group inverse mapping completes one of each group of values.
- the entire sub-value range maps or inversely maps to one (may be the other or the same) complete sub-value range within the same group, and keeps the order of all elements in the sub-value range unchanged, ie if The element A is arranged before the element B, then the mapped element A is also arranged before the mapped element B, or the inversely mapped element A is also arranged before the inverse mapping element B, and vice versa.
- One of the above-mentioned mappings or one of the inverse mappings within the above range of values or the range of sub-values is a composite of a number of (typically less than 4) consecutively executed partial or partial inverse mappings.
- mapping relationship of one of the above mappings (or the partial mappings) or the inverse mapping of one of the inverse mappings (or the partial inverse mappings) in the range of values or the range of the sub-values all using one or a set of calculation formulas To represent; or to use a list to represent; or to use a part or a set of calculations, and a part to use a list.
- mapping relationship of one of the above mappings (or the partial mappings) or the inverse mapping of one of the inverse mappings (or the partial inverse mappings) in the range of values or the sub-value ranges along with the current encoding (solution) code Change in a state or parameter.
- the mapping relationship of one of the mappings (or the partial mappings) or the inverse mapping of the inverse mappings (or the partial inverse mappings) in the range of values or ranges of the sub-values along with the width of the current CU Change or change, that is, when the width of the current CU is a value, a mapping relationship or an inverse mapping relationship is adopted, and when the width of the current CU is another value, another mapping relationship or inverse mapping relationship is adopted; for example, The width of the current CU is W, and the frequency of some or all multiples of the value W of a matching relationship parameter (such as the matching distance) is much higher than the frequency of some or all multiples of the non-W.
- mapping relationship is related to W.
- W is different
- the mapping relationship is different.
- the inverse mapping relationship is also different.
- This embodiment is a special case of Embodiment 6.
- One of the matching relationship parameters is a matching distance.
- the width W of the current CU has four values: 64, 32, 16, 8.
- the mapping or the inverse mapping also has corresponding 4 mapping relationships or 4 inverse mapping relationships.
- a real-time statistical module for matching the values in the range of relationship parameters, real-time statistics of the characteristics of each value, such as the frequency of occurrence of each value up to the current time; according to the values of the matching relationship parameters
- the real-time statistical result dynamically adjusts the mapping relationship of the mapping (or the partial mapping) or the inverse mapping of the inverse mapping (or the partial inverse mapping described above).
- the image encoding and decoding method and apparatus proposed by the embodiments of the present invention improve image compression performance.
- a storage medium is further provided, wherein the software includes the above-mentioned software, including but not limited to: an optical disk, a floppy disk, a hard disk, an erasable memory, and the like.
- modules or steps of the present invention described above can be implemented by a general-purpose computing device that can be centralized on a single computing device or distributed across a network of multiple computing devices. Alternatively, they may be implemented by program code executable by the computing device such that they may be stored in the storage device by the computing device and, in some cases, may be different from the order herein.
- the steps shown or described are performed, or they are separately fabricated into individual integrated circuit modules, or a plurality of modules or steps thereof are fabricated as a single integrated circuit module.
- the invention is not limited to any specific combination of hardware and software.
- the present invention relates to digital video compression encoding and decoding, and provides an image encoding and decoding method and apparatus, wherein the image encoding method comprises: performing matching coding on pixels of an input video image to obtain one or more matching relationship parameters, wherein The matching relationship parameter is a parameter used in constructing a predicted value and/or a restored value of a pixel in the image; mapping the matching relationship parameter to obtain a mapping value of the matching relationship parameter; The mapped values of the parameters are entropy encoded.
- the invention solves the problem caused by directly performing entropy coding on the matching relationship parameter in the related art, thereby achieving better data compression effect of entropy coding.
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Compression Or Coding Systems Of Tv Signals (AREA)
Abstract
Description
Claims (31)
- 一种图像编码装置,包括以下模块:模块1)像素预处理和匹配编码模块:设置为对输入视频图像的像素值施行像素预处理和匹配编码,产生并输出一个或者多个匹配关系参数和除所述一个或者多个匹配关系参数之外的其他匹配编码结果;模块2)映射模块:设置为对所述匹配关系参数的取值范围进行一对一的映射,所述映射的输入是所述模块1)输出的所述匹配关系参数,所述映射的输出为映射后的匹配关系参数;模块3)编码和重构模块:设置为对所述输入视频图像、所述匹配关系参数和变量施行编码和重构运算;模块4)暂存模块:设置为暂存已重构的参考像素值集的像素值;模块5)熵编码模块:设置为对包括所述映射后匹配关系参数和其余编码结果在内的所有需要输出到压缩码流中的编码结果施行熵编码运算;输出熵编码的结果,其中,所述熵编码的结果中包括匹配关系参数压缩数据以及其他编码结果的压缩码流。
- 根据权利要求1所述的装置,其中:所述取值范围被划分成K个子取值范围,所述映射也相应地被划分成K个子取值范围内的映射。
- 根据权利要求1或2所述的装置,其中:所述取值范围被划分成L组子取值范围,每组子取值范围内的各个子取值范围都有互相相等的有限元素,所述映射也相应地被划分成L组映射,每一组映射把每一组子取值范围内的一个完整的子取值范围映射成同一组内的一个完整的子取值范围,并且保持子取值范围内所有元素的顺序不变,其中L为自然数。
- 根据权利要求1至3中任一项所述的装置,其中:所述取值范围或者所述子取值范围内的一个所述映射由多个连续执行的部分映射合成。
- 根据权利要求1至4中任一项所述的装置,其中:所述取值范围或者所述子取值范围内的一个所述映射或者所述部分映射的映射关系,通过以下之一的方式表示:全部用一个或者一组计算式来表示;全部用一个列表来表示;部分用一个或者一组计算式来表示,部分用一个列表来表示。
- 根据权利要求1至4中任一项所述的装置,其中:所述取值范围或者所述子取值范围内的一个所述映射或者所述部分映射的映射关系,随着当前编码的一个状态或者参数的改变而改变。
- 根据权利要求1至4中任一项所述的装置,其中:所述取值范围或者所述子取值范围内的一个所述映射或者所述部分映射的映射关系,随着当前编码块的宽度的改变而改变。
- 根据权利要求7所述的装置,其中:所述匹配关系参数之一是匹配距离,所述当前编码块的宽度W有4个值:64,32,16,8,所述映射也相应地有4种映射关系。
- 根据权利要求1至4中任一项所述的装置,其中:所述装置还包括:实时统计模块,设置为实时统计匹配关系参数的取值范围内各数值的特性,根据所述匹配关系参数的各数值的实时统计结果对所述映射或者所述部分映射的映射关系,进行动态调整。
- 一种图像解码装置,包括以下模块:模块1)熵解码模块:设置为对输入的含匹配关系参数压缩数据以及除所述含匹配关系参数压缩数据的其他编码结果的压缩码流施行熵解码,并对熵解码得到的各种数据进行解析;模块2)逆映射模块:设置为对映射后匹配关系参数的取值范围进行一对一的逆映射,所述逆映射复原并输出映射前的匹配关系参数;模块3)匹配解码模块:设置为根据所述匹配关系参数施行匹配解码运算;模块4)解码和重构模块:设置为对当前解码中匹配区域或者当前解码中解码块的各种参数和变量施行解码和重构运算;模块5)暂存模块:设置为暂存已重构的参考像素值集的像素值。
- 根据权利要求10所述的装置,其中,所述匹配区域为匹配串或者匹配块。
- 根据权利要求10所述的装置,其中:所述取值范围被划分成K个子取值范围,所述逆映射也相应地被划分成K个子取值范围内的逆映射。
- 根据权利要求10或12所述的装置,其中:所述取值范围被划分成L组子取值范围,每组子取值范围内的各个子取值范围都有互相相等的有限元素,所述逆映射也相应地被划分成L组逆映射,每一组逆映射把每一组子取值范围内的一个完整的子取值范围逆映射成同一组内的一个完整的子取值范围,并且保持子取值范围内所有元素的顺序不变,其中L为自然数。
- 根据权利要求12或13所述的装置,其中:所述取值范围或者所述子取值范围内的一个所述映射或者一个所述逆映射由多个连续执行的部分映射或者部分逆映射合成。
- 根据权利要求10至14中任一项所述的装置,其中:所述取值范围或者所述子取值范围内的一个所述逆映射或者所述部分逆映射的逆映射关系,通过以下之一的方式表示:全部用一个或者一组计算式来表示;全部用一个列表来表示;部分用一个或者一组计算式来表示,部分用一个列表来表示。
- 根据权利要求10或14所述的装置,其中:所述取值范围或者所述子取值范围内的一个所述逆映射或者所述部分逆映射的逆映射关系随着当前解码的一个状态或者参数的改变而改变。
- 根据权利要求10至14中任一项所述的装置,其中:所述取值范围或者所述子取值范围内的一个所述逆映射或者所述部分逆映射的逆映射关系随着解码块的宽度的改变而改变。
- 根据权利要求17所述的装置,其中:所述匹配关系参数之一是匹配距离,所述解码块的宽度W有4个值:64,32,16,8,所述逆映射也相应地有4种逆映射关系。
- 根据权利要求10至14中任一项所述的装置,其中:所述装置还包括:实时统计模块,设置为实时统计匹配关系参数的取值范围内各数值的特性,根据所述匹配关系参数的各数值的实时统计结果对所述逆映射或者所述部分逆映射的逆映射关系进行动态调整。
- 一种图像编码方法,所述方法包括:对输入视频图像像素值施行像素预处理和匹配编码,产生并输出一个或者多个匹配关系参数;对所述匹配关系参数的取值范围进行一对一的映射,并输出映射后的匹配关系参数;对所述输入视频图像、所述匹配关系参数和变量施行编码和重构运算;暂存已重构的参考像素值集的像素值;对所述映射后匹配关系参数施行熵编码,输出熵编码后的结果。
- 一种图像解码方法,所述方法包括:对输入的含匹配关系参数压缩数据以及除所述含匹配关系参数压缩数据之外的其他参数的压缩码流施行熵解码;对映射后匹配关系参数的取值范围进行一对一的逆映射,复原并输出映射前的匹配关系参数;根据所述匹配关系参数施行匹配解码;对当前解码中匹配区域或者当前解码中解码块的各种参数和变量施行解码和重构运算;暂存已重构的参考像素值集的像素值。
- 一种图像编码方法,包括:对输入视频图像的像素进行匹配编码,得到一个或者多个匹配关系参数,其中,所述匹配关系参数是构造所述输入视频图像中像素的预测值和/或恢复值过程中使用的参数;对所述匹配关系参数进行映射,得到匹配关系参数的映射值;对所述匹配关系参数的映射值进行熵编码。
- 根据权利要求22所述的方法,其中,对所述匹配关系参数进行映射包括:根据已有匹配关系参数,对待匹配关系参数进行转换,将转换后得到的值作为所述待匹配关系参数的映射值;和/或,对相同类型的匹配关系参数,按照指定规则进行聚集和/或重排列构成匹配关系参数组,对所述匹配关系参数组进行映射处理,将经过映射处理后得到的匹配关系参数组作为所述匹配关系参数的映射值。
- 根据权利要求23所述的方法,其中,所述指定规则包括以下至少之一:预先设定的规则;根据已有匹配关系参数取值设定的对多个待匹配关系参数进行聚集和/或重排列的操作步骤。
- 根据权利要求23所述的方法,其中,对所述匹配关系参数组进行映射处理包括:将所述匹配关系参数组中的匹配关系参数取值作为映射处理的输出;和/或,对所述匹配关系参数组中的匹配关系参数取值进行转换后得到的值作为映射处理的输出。
- 一种图像解码方法,包括:对接收到的码流进行熵解码,获取用于指示匹配关系参数的字段取值,其中,所述匹配关系参数是构造待解码视频图像中像素的预测值和/或恢复值过程中使用的参数;对所述字段取值进行映射,得到映射后的匹配关系参数;根据所述映射后的匹配关系参数,构造所述待解码视频图像中像素的预测值和/或恢复值。
- 根据权利要求26所述的方法,其中,对所述字段取值进行映射,得到映射后的匹配关系参数包括:根据已获得的所述匹配关系参数,对待处理的所述字段取值进行转换,将转换后的值作为所述映射后的匹配关系参数;和/或,将相同类型的待处理字段的取值,按照指定规则进行聚集和/或重排列构成数组,对所述数组进行处理后作为所述映射后的匹配关系参数。
- 根据权利要求27所述解码方法,其中,所述指定规则包括以下至少之一:预先设定的规则;根据已获得所述字段取值设定的对所述待处理的所述字段取值进行聚集和/或重排列的操作步骤。
- 根据权利要求27所述方法,其中,对所述数组进行处理包括:将所述数组中的待处理字段取值作为处理后的输出值;和/或,对所述数组中的待处理字段取值进行转换后得到的值作为处理后的输出值。
- 一种图像编码装置,所述装置包括:匹配编码模块,设置为对输入视频图像的像素进行匹配编码,得到一个或者多个匹配关系参数,其中,所述匹配关系参数是构造所述输入视频图像中像素的预测值和/或恢复值过程中使用的参数;映射模块,设置为对所述匹配关系参数进行映射,得到匹配关系参数的映射值;熵编码模块,设置为对所述匹配关系参数的映射值进行熵编码。
- 一种图像解码装置,所述装置包括:熵解码模块,设置为对接收到的码流进行熵解码,获取用于指示匹配关系参数的字段取值,其中,所述匹配关系参数是构造待解码视频图像中像素的预测值和/或恢复值过程中使用的参数;映射模块,设置为对所述字段取值进行映射,得到映射后的匹配关系参数;构造模块,设置为根据所述映射后的匹配关系参数,构造所述待解码视频图像中像素的预测值和/或恢复值。
Priority Applications (5)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US15/507,249 US10834428B2 (en) | 2015-04-30 | 2015-05-06 | Image coding and decoding method and device |
EP15890374.0A EP3177021B1 (en) | 2015-04-30 | 2015-05-06 | Image coding and decoding method and device |
KR1020177005728A KR101946598B1 (ko) | 2015-04-30 | 2015-05-06 | 이미지 코딩, 디코딩 방법 및 장치 |
JP2017511908A JP6360969B2 (ja) | 2014-05-06 | 2015-05-06 | 画像符号化、復号化方法、及び装置 |
US17/061,414 US11451835B2 (en) | 2014-05-06 | 2020-10-01 | Method and device for entropy coding and decoding using mapping of matching relationship parameters |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201510219125.8A CN105100814B (zh) | 2014-05-06 | 2015-04-30 | 图像编码、解码方法及装置 |
CN201510219125.8 | 2015-04-30 |
Related Child Applications (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US15/507,249 A-371-Of-International US10834428B2 (en) | 2015-04-30 | 2015-05-06 | Image coding and decoding method and device |
US17/061,414 Continuation US11451835B2 (en) | 2014-05-06 | 2020-10-01 | Method and device for entropy coding and decoding using mapping of matching relationship parameters |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2016172994A1 true WO2016172994A1 (zh) | 2016-11-03 |
Family
ID=57200721
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/CN2015/078420 WO2016172994A1 (zh) | 2014-05-06 | 2015-05-06 | 图像编码、解码方法及装置 |
Country Status (6)
Country | Link |
---|---|
US (2) | US10834428B2 (zh) |
EP (1) | EP3177021B1 (zh) |
JP (1) | JP6360969B2 (zh) |
KR (1) | KR101946598B1 (zh) |
CN (1) | CN105100814B (zh) |
WO (1) | WO2016172994A1 (zh) |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN113949867A (zh) * | 2020-07-16 | 2022-01-18 | 武汉Tcl集团工业研究院有限公司 | 一种图像处理的方法及装置 |
Families Citing this family (9)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JPWO2019065297A1 (ja) * | 2017-09-29 | 2020-11-05 | ソニー株式会社 | 情報処理装置および方法 |
CN110008478B (zh) * | 2017-12-30 | 2023-10-31 | 中国移动通信集团贵州有限公司 | 语言转换方法、装置、计算设备及存储介质 |
US10649098B2 (en) | 2018-01-29 | 2020-05-12 | Samsung Electronics Co., Ltd. | Light converting nanoparticle, method of making the light converting nanoparticle, and composition and optical film comprising the same |
CN109151436B (zh) * | 2018-09-30 | 2021-02-02 | Oppo广东移动通信有限公司 | 数据处理方法及装置、电子设备及存储介质 |
EP3664017B1 (en) * | 2018-12-06 | 2022-03-02 | Robert Bosch GmbH | Method and device for digital image or video data processing |
CN111479116A (zh) * | 2019-01-23 | 2020-07-31 | 上海天荷电子信息有限公司 | 等比特精度预测、映射和分段编码的数据压缩方法和装置 |
US11595694B2 (en) * | 2020-04-01 | 2023-02-28 | Tencent America LLC | Method and apparatus for video coding |
US11496731B2 (en) * | 2020-06-08 | 2022-11-08 | Tencent America LLC | String matching with single color value |
US20220066975A1 (en) * | 2020-09-01 | 2022-03-03 | Texas Instruments Incorporated | Bit stream transformation in parallel data interfaces |
Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN101557514A (zh) * | 2008-04-11 | 2009-10-14 | 华为技术有限公司 | 一种帧间预测编解码方法、装置及系统 |
JP2010166552A (ja) * | 2008-12-17 | 2010-07-29 | Mitsubishi Electric Corp | テーブル装置、符号化装置、復号装置および符号化/復号装置 |
US20110274169A1 (en) * | 2010-05-05 | 2011-11-10 | Paz Adar | Device, system, and method for spatially encoding video data |
CN102497546A (zh) * | 2011-11-28 | 2012-06-13 | 同济大学 | 一种屏幕图像压缩装置及压缩方法 |
Family Cites Families (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP4769039B2 (ja) * | 2005-07-26 | 2011-09-07 | パナソニック株式会社 | デジタル信号符号化および復号化装置ならびにその方法 |
CN102057678A (zh) * | 2008-06-10 | 2011-05-11 | 松下电器产业株式会社 | 解码装置、解码方法及接收装置 |
US9554130B2 (en) * | 2012-01-20 | 2017-01-24 | Pantech Inc. | Intra prediction mode mapping method and device using the method |
CN103167289B (zh) * | 2013-03-06 | 2015-10-28 | 硅谷数模半导体(北京)有限公司 | 图像的编码、解码方法及编码、解码装置 |
US10021419B2 (en) * | 2013-07-12 | 2018-07-10 | Qualcomm Incorported | Rice parameter initialization for coefficient level coding in video coding process |
WO2015054812A1 (en) * | 2013-10-14 | 2015-04-23 | Microsoft Technology Licensing, Llc | Features of base color index map mode for video and image coding and decoding |
US10542274B2 (en) * | 2014-02-21 | 2020-01-21 | Microsoft Technology Licensing, Llc | Dictionary encoding and decoding of screen content |
AU2014201583A1 (en) * | 2014-03-14 | 2015-10-01 | Canon Kabushiki Kaisha | Method, apparatus and system for encoding and decoding video data using a block dictionary |
-
2015
- 2015-04-30 CN CN201510219125.8A patent/CN105100814B/zh active Active
- 2015-05-06 KR KR1020177005728A patent/KR101946598B1/ko active IP Right Grant
- 2015-05-06 EP EP15890374.0A patent/EP3177021B1/en active Active
- 2015-05-06 US US15/507,249 patent/US10834428B2/en active Active
- 2015-05-06 JP JP2017511908A patent/JP6360969B2/ja active Active
- 2015-05-06 WO PCT/CN2015/078420 patent/WO2016172994A1/zh active Application Filing
-
2020
- 2020-10-01 US US17/061,414 patent/US11451835B2/en active Active
Patent Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN101557514A (zh) * | 2008-04-11 | 2009-10-14 | 华为技术有限公司 | 一种帧间预测编解码方法、装置及系统 |
JP2010166552A (ja) * | 2008-12-17 | 2010-07-29 | Mitsubishi Electric Corp | テーブル装置、符号化装置、復号装置および符号化/復号装置 |
US20110274169A1 (en) * | 2010-05-05 | 2011-11-10 | Paz Adar | Device, system, and method for spatially encoding video data |
CN102497546A (zh) * | 2011-11-28 | 2012-06-13 | 同济大学 | 一种屏幕图像压缩装置及压缩方法 |
Non-Patent Citations (1)
Title |
---|
See also references of EP3177021A4 * |
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN113949867A (zh) * | 2020-07-16 | 2022-01-18 | 武汉Tcl集团工业研究院有限公司 | 一种图像处理的方法及装置 |
CN113949867B (zh) * | 2020-07-16 | 2023-06-20 | 武汉Tcl集团工业研究院有限公司 | 一种图像处理的方法及装置 |
Also Published As
Publication number | Publication date |
---|---|
EP3177021B1 (en) | 2022-03-16 |
US20210021872A1 (en) | 2021-01-21 |
EP3177021A4 (en) | 2017-08-23 |
KR101946598B1 (ko) | 2019-02-11 |
US20180242023A1 (en) | 2018-08-23 |
CN105100814B (zh) | 2020-07-14 |
KR20170038052A (ko) | 2017-04-05 |
US10834428B2 (en) | 2020-11-10 |
EP3177021A1 (en) | 2017-06-07 |
CN105100814A (zh) | 2015-11-25 |
US11451835B2 (en) | 2022-09-20 |
JP2017529784A (ja) | 2017-10-05 |
JP6360969B2 (ja) | 2018-07-18 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
WO2016172994A1 (zh) | 图像编码、解码方法及装置 | |
US20230188736A1 (en) | Methods and apparatuses for hierarchically encoding and decoding a bytestream | |
KR102071764B1 (ko) | 영상 부호화, 복호화 방법 및 장치 | |
CN109842803B (zh) | 一种图像压缩的方法及装置 | |
WO2015120823A1 (zh) | 使用多种形式的参考像素存储空间的图像压缩方法和装置 | |
KR101868247B1 (ko) | 영상 부호화, 복호화 방법 및 장치 | |
JP2017508415A (ja) | 画像符号化/復号方法及び装置 | |
WO2016054985A1 (zh) | 图像编码、解码方法及装置 | |
CN104581177B (zh) | 一种结合块匹配和串匹配的图像压缩方法和装置 | |
CN104754362B (zh) | 使用精细划分块匹配的图像压缩方法 | |
US20240080481A1 (en) | Sparse matrix representation using a boundary of non-zero coefficients | |
EP4258671A1 (en) | Point cloud attribute predicting method, encoder, decoder, and storage medium | |
CN104935945A (zh) | 扩展参考像素样值集的图像压缩方法 | |
WO2021197158A1 (zh) | 一种图像处理方法和图像处理装置 | |
WO2024065406A1 (zh) | 编解码方法、码流、编码器、解码器以及存储介质 | |
WO2023024842A1 (zh) | 点云编解码方法、装置、设备及存储介质 | |
CN117356092A (zh) | 用于混合特征视频比特流和解码器的系统、方法和比特流结构 |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 15890374 Country of ref document: EP Kind code of ref document: A1 |
|
ENP | Entry into the national phase |
Ref document number: 20177005728 Country of ref document: KR Kind code of ref document: A Ref document number: 2017511908 Country of ref document: JP Kind code of ref document: A |
|
REEP | Request for entry into the european phase |
Ref document number: 2015890374 Country of ref document: EP |
|
WWE | Wipo information: entry into national phase |
Ref document number: 15507249 Country of ref document: US Ref document number: 2015890374 Country of ref document: EP |
|
NENP | Non-entry into the national phase |
Ref country code: DE |