WO2016197893A1 - Procédé de codage et de décodage d'image, dispositif de traitement d'image et support de stockage informatique - Google Patents

Procédé de codage et de décodage d'image, dispositif de traitement d'image et support de stockage informatique Download PDF

Info

Publication number
WO2016197893A1
WO2016197893A1 PCT/CN2016/084992 CN2016084992W WO2016197893A1 WO 2016197893 A1 WO2016197893 A1 WO 2016197893A1 CN 2016084992 W CN2016084992 W CN 2016084992W WO 2016197893 A1 WO2016197893 A1 WO 2016197893A1
Authority
WO
WIPO (PCT)
Prior art keywords
palette
color
copy
pixel
block
Prior art date
Application number
PCT/CN2016/084992
Other languages
English (en)
Chinese (zh)
Inventor
林涛
李明
吴平
尚国强
吴钊
Original Assignee
同济大学
中兴通讯股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from CN201610364374.0A external-priority patent/CN106254865B/zh
Application filed by 同济大学, 中兴通讯股份有限公司 filed Critical 同济大学
Priority to EP22191754.5A priority Critical patent/EP4114000A1/fr
Priority to US15/580,893 priority patent/US20180167623A1/en
Priority to EP16806791.6A priority patent/EP3306931A4/fr
Publication of WO2016197893A1 publication Critical patent/WO2016197893A1/fr
Priority to US17/902,022 priority patent/US11917168B2/en

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
    • H04N19/182—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being a pixel

Definitions

  • the present invention relates to digital video coding and decoding technologies, and in particular, to an image coding and decoding method, an image processing device, and a computer storage medium.
  • HEVC High Efficiency Video Coding
  • a notable feature of computer screen images is that there are often many similar or even identical pixel patterns (pi ⁇ el pattern) within the same frame image.
  • pixel patterns pi ⁇ el pattern
  • Chinese or foreign text that often appears in computer screen images is composed of a few basic strokes, and many similar or identical strokes can be found in the same frame image.
  • Menus, icons, etc., which are common in computer screen images, also have many similar or identical patterns. Therefore, the existing image and video compression technologies usually adopt various copying methods, including at least the following copying methods:
  • Intra block copying means intraframe block matching or intraframe motion compensation or block matching or block copying.
  • Intra-frame micro-block copying means intra-frame micro-block matching or micro-block matching or micro-block copying.
  • Intra-frame lines are copied, that is, intra-frame matching or strip matching or strip copying.
  • Intra-frame string replication means intra-frame string matching or string matching or string copying or pixel string copying.
  • Palette index string copy is a palette or index string copy.
  • index-pixel string fusion copy mode also called palette-pixel string fusion copy mode or merged pixel string copy palette mode or fusion palette Pixel string copy mode or palette with pixel string copy mode.
  • each palette and pixel string copying method has separate palette color candidate sets, if the codec block does not adopt a palette and a pixel.
  • the palette color candidate set corresponding to the pixel string copy mode is not updated, and no new more suitable palette color is added to the corresponding palette color candidate set. This approach greatly reduces the compression efficiency of multiple palettes and pixel string replication.
  • an embodiment of the present invention provides an image encoding and decoding method, an image processing device, and a computer storage medium.
  • Palette and pixel string copy coding is performed using the palette of the current coded block, and a video code stream including a copy mode and a copy parameter is generated.
  • the coding block is an coding region of an image, and the coding block includes at least one of: a maximum coding unit (LCU), a coding tree unit (CTU), a coding unit (CU), and a sub-region of a CU. , prediction unit (PU), transform unit (TU).
  • LCU maximum coding unit
  • CTU coding tree unit
  • CU coding unit
  • TU sub-region of a CU.
  • prediction unit PU
  • transform unit TU
  • the video code stream further includes the new palette color.
  • the maximum number of palette colors that the maximum space of the palette color candidate set can accommodate is a predetermined constant.
  • the method further includes: the palette color candidate set performs one or more of the following operations according to a predetermined rule:
  • the palette color candidate set adds a new palette color and/or deletes an existing palette color according to a first-in, first-out rule.
  • the method further includes:
  • some or all of the new palette color of the encoded block is added to the shared palette color candidate set.
  • Palette and pixel string copy decoding is performed using the palette of the current decoded block.
  • the decoding block is a decoding area of an image, and the decoding block includes at least one of the following: an LCU, a CTU, a CU, a sub-area of the CU, a PU, and a TU.
  • the maximum number of palette colors that the maximum space of the palette color candidate set can accommodate is a predetermined constant.
  • the method further includes: the palette color candidate set performs one or more of the following operations according to a predetermined rule:
  • the palette color candidate set adds a new palette color and/or deletes an existing palette color according to a first-in, first-out rule.
  • the method further includes:
  • some or all of the new palette color of the decoded block is added to the shared palette color candidate set.
  • a first generating unit configured to generate a new palette color according to the pixel of the current encoding block when copying and encoding the current encoding block by using one of a color palette and a pixel string copy encoding method
  • a second generating unit configured to generate a palette of the current encoding block according to the palette color candidate set shared by the new palette color and/or color palette and the pixel string copy encoding manner
  • a coding unit configured to perform palette and pixel string copy coding using a palette of the current coded block, and generate a video code stream including a copy mode and a copy parameter.
  • a parsing unit configured to parse the video stream to obtain at least one of the following: a copy mode of the palette and the pixel string copy decoding, a copy parameter, and a new palette color;
  • a third generating unit configured to generate the copy to the current decoded block according to the palette color candidate set shared by the new palette color and/or color palette and the pixel string copy decoding mode The color palette used for palette and pixel string copy decoding;
  • a decoding unit configured to perform palette and pixel string copy decoding using a palette of the current decoded block.
  • the computer storage medium provided by the embodiment of the present invention stores a computer program for performing the above image encoding and/or image decoding method.
  • encoding the image includes: when copying and encoding the current coding block by using one of a palette and a pixel string copy coding mode, generating a new color palette according to the pixel of the current coding block. Color; generating a palette of the current encoded block according to the palette color candidate set shared by the new palette color and/or palette and pixel string copy encoding; using the current encoding block
  • the palette performs palette and pixel string copy encoding and generates a video stream that includes copy mode and copy parameters.
  • Decoding the image includes parsing the video stream, and obtaining at least one of the following: a copy mode of the palette and the pixel string copy decoding, a copy parameter, and a new palette color; according to the new palette color and/or Or a palette color candidate set shared by the palette and the pixel string copy decoding method, generating a palette used for the current decoded block to perform palette and pixel string copy decoding using the copy mode; using the current decoding
  • the palette of the block performs a palette and pixel string copy decoding. It can be seen that the embodiment of the present invention implements image compression of a plurality of copy mode sharing palette color candidate sets, and improves compression efficiency of multiple color palettes and pixel string copy modes.
  • FIG. 1 is a schematic flowchart 1 of an image encoding method according to an embodiment of the present invention.
  • FIG. 2 is a schematic flowchart 1 of an image decoding method according to an embodiment of the present invention.
  • FIG. 3 is a second schematic flowchart of an image encoding method according to an embodiment of the present invention.
  • FIG. 4 is a second schematic flowchart of an image decoding method according to an embodiment of the present invention.
  • FIG. 5 is a first schematic structural diagram of an image processing apparatus according to an embodiment of the present invention.
  • FIG. 6 is a second schematic structural diagram of an image processing apparatus according to an embodiment of the present invention.
  • FIG. 7 is a third schematic structural diagram of an image processing apparatus according to an embodiment of the present invention.
  • the natural form of a digital video signal of an image is a sequence of images.
  • a frame of image is usually a rectangular area composed of several pixels, and a digital video signal is a sequence of video images composed of tens of frames to thousands of frames of images, sometimes simply referred to as a video sequence or sequence.
  • Encoding a digital video signal encodes a frame by frame image. At any one time, the image of the frame being encoded is referred to as the current encoded image.
  • decoding a compressed video stream (also referred to as a bit stream) of a digital video signal is decoding a stream of one frame by one compressed image.
  • the image of the frame being decoded is referred to as the current decoded image.
  • the current encoded image or the currently decoded image is collectively referred to as the current image.
  • one frame of image is divided into blocks M.
  • the sub-image of the M pixel is called a coding block (from the perspective of decoding, that is, a decoding block, collectively referred to as a codec block) or a coding unit (CU, Coding Unit), and the sub-image is performed one by one with the CU as a basic coding unit.
  • the size of the commonly used M is 4, 8, 16, 32, 64. Therefore, encoding the video image sequence is to encode one CU for each coding unit of each frame image, that is, CU.
  • the CU being coded is referred to as the current coded CU.
  • decoding the code stream of the video image sequence is also one by one for each CU of each frame image.
  • the CUs decode and finally reconstruct the entire video image sequence.
  • the CU being decoded is referred to as the currently decoded CU.
  • the current coding CU or the current decoding CU is collectively referred to as the current CU.
  • each CU in one frame of image can be different, some are 8 ⁇ 8, some are 64 ⁇ 64, etc. .
  • LCUs Longer Coding Units
  • each LCU is further divided into a tree structure. Multiple CUs of different sizes are not necessarily the same. Therefore, the LCU is also called a Coding Tree Unit (CTU).
  • CTU Coding Tree Unit
  • One of the LCUs is composed of three 32 ⁇ 32 pixel CUs and four 16 ⁇ 16 pixel CUs, so that seven CUs in a tree structure constitute one CTU.
  • the other LCU is composed of two 32 ⁇ 32 pixel CUs, three 16 ⁇ 16 pixel CUs, and 20 8 ⁇ 8 pixel CUs.
  • Such 25 CUs in a tree structure constitute another CTU.
  • Encoding one frame of image is to sequentially encode one CU in one CTU.
  • LCU is synonymous with CTU.
  • a CU whose size is equal to the CTU is called a CU with a depth of zero.
  • a CU obtained by dividing the CU up and down and left and right by a depth of 0 is called a CU having a depth of 1.
  • a CU with a depth of 1 and a CU divided into four equal parts is called a CU with a depth of 2.
  • a CU obtained by dividing the CU of the depth of 2 into four equal parts is called a CU having a depth of 3.
  • the CTU being coded is referred to as the current coded CTU.
  • the CTU being decoded is referred to as the current decoded CTU.
  • the current coding CTU or the current decoding CTU is collectively referred to as the current CTU.
  • the CU can also be further divided into sub-areas.
  • Sub-regions include, but are not limited to, prediction unit (PU), transform unit (TU), asymmetric partition (AMP) regions.
  • PU prediction unit
  • TU transform unit
  • AMP asymmetric partition
  • a color pixel usually consists of three components.
  • the two most commonly used pixel color formats are GBR color formats consisting of green, blue, and red components and consist of one luma component and two chroma components.
  • YUV color format The color format commonly known as YUV actually includes multiple color formats, such as the YCbCr color format. Therefore, when encoding a CU, a CU can be divided into three component planes (G plane, B plane, R plane or Y plane, U plane, V plane), and the three component planes are respectively coded; The three component bundles of one pixel are combined into one 3-tuple, and the CUs composed of these 3-tuples are encoded as a whole.
  • the arrangement of the former pixel and its components is called the planar format of the image (and its CU), and the arrangement of the latter pixel and its components is called the stacked format of the image (and its CU). Format).
  • the GBR color format and the YUV color format of the pixel are both 3-component representation formats of the pixel.
  • the palette index representation format In addition to the 3-component representation format of a pixel, another common representation format for a pixel is the palette index representation format.
  • the value of a pixel can also be represented by the index of the palette.
  • the palette space stores the value or approximate value of the three components of the color of the pixel to be represented, and the address of the palette is referred to as the index of the color of the pixel stored in this address.
  • An index can represent a component of a pixel's color, and an index can also represent three components of a pixel's color.
  • the palette can be one or more. In the case of multiple palettes, a complete index is actually composed of the palette number (which one of the multiple palettes) and the index of the palette of the sequence number.
  • the index representation format of a pixel is to represent this pixel with an index. If the pixels in an image region (such as a coded block or a decoded block) cannot all be represented by the palette color (ie, at least one pixel in the image region, the value of no three components is equal or approximately equal to the pixel)
  • the palette color and its index there is usually a special index called escape color in the palette, which is used to represent pixels that cannot be represented by normal palette colors. Therefore, if the index of one pixel is an index of the escape color, the pixel needs to express its color with another dedicated 3 components.
  • the normal color and escape color in the palette are called palette colors, but the escape color is a virtual color. There is no physical space in the palette to store this color.
  • the index of the escape color is usually the last index of the palette.
  • the index representation format of the pixel is also It is called the index color of the pixel (inde ⁇ ed color) or pseudo color, or often referred to directly as index pixel (inde ⁇ ed pi ⁇ el) or pseudo pixel (pseudo pi ⁇ el) or pixel index Or index. Indexes are sometimes referred to as indices.
  • the representation of a pixel in its index representation format is also referred to as indexing or indexing.
  • CMYK representation formats Other commonly used pixel representation formats include CMYK representation formats and grayscale representation formats.
  • the YUV color format can be subdivided into several seed formats according to whether the chroma component is downsampled: a YUV 4:4:4 pixel color format consisting of 1 Y component, 1 U component, and 1 V component.
  • the left and right adjacent pixels are composed of 2 Y components, 1 U component, and 1 V component in a YUV 4:2:2 pixel color format; the left and right adjacent 4 pixels arranged in a 2 ⁇ 2 spatial position are composed of YUV4:2:0 pixel color format consisting of 4 Y components, 1 U component, and 1 V component.
  • a component is generally represented by a number of 8 to 16 bits.
  • the YUV4:2:2 pixel color format and the YUV4:2:0 pixel color format are all downsampled for the YUV4:4:4 pixel color format.
  • a pixel component is also referred to as a pixel sample (pi x el sample) or simply as a sample.
  • the most basic element when encoding or decoding can be one pixel, one pixel component, or one pixel index (ie, index pixel).
  • a pixel or a pixel component or an index pixel, which is the most basic element of encoding or decoding, is collectively referred to as a pixel sample, sometimes referred to as a pixel value, or simply as a sample.
  • pixel sample value In the embodiment of the present invention, "pixel sample value”, “pixel value”, “sample value”, “index pixel”, and “pixel index” are synonyms, and depending on the context, whether “pixel” or “one pixel” is clearly indicated The “component” still means “index pixel” or both. If it is not clear from the context, then it means either of the three.
  • a coded block or a decoded block is an area consisting of a number of pixel values.
  • the shape of the codec block may be a rectangle, a square, a parallelogram, a trapezoid, a polygon, a circle, an ellipse, and the like.
  • the rectangle also includes the width or height A rectangle whose pixel value degenerates into a line (ie, a line segment or a line shape).
  • each codec block may have a different shape and size.
  • some or all of the codec blocks may overlap each other, or all codec blocks may not overlap each other.
  • a codec block may be composed of "pixels”, or may be composed of “components of pixels”, or may be composed of "index pixels”, or may be composed of a mixture of the three, or any of the three. Mixed composition.
  • a codec block refers to an area in which encoding or decoding is performed in a frame image, including but not limited to at least one of the following: a maximum coding unit LCU, a coding tree unit CTU, and a coding unit CU. a sub-region of the CU, a prediction unit PU, and a transform unit TU.
  • a notable feature of computer screen images is that there are often many similar or even identical pixel patterns (pi ⁇ el pattern) within the same frame image.
  • pixel patterns pi ⁇ el pattern
  • Chinese or foreign text that often appears in computer screen images is composed of a few basic strokes, and many similar or identical strokes can be found in the same frame image.
  • Menus, icons, etc., which are common in computer screen images, also have many similar or identical patterns. Therefore, the copying method adopted by image and video compression technology includes at least the following copying methods:
  • Intra block copying means intraframe block matching or intraframe motion compensation or block matching or block copying.
  • the basic operation of block copy coding or decoding is to copy a current code block or a current decoding block (referred to as the current block) from the reconstructed reference pixel sample set by the same size as the current block (the same number of pixel samples).
  • the reference block is referenced and the value of the reference block is assigned to the current block.
  • the copy parameter of the block copy mode includes the displacement vector of the current block, indicating the relative position between the reference block and the current block.
  • a current block has a displacement vector.
  • Intra-frame micro-block copying means intra-frame micro-block matching or micro-block matching or micro-block copying.
  • a current block such as 8 ⁇ 8 pixel samples
  • several microblocks such as microblocks of 4 ⁇ 2 pixel samples or microblocks of 8 ⁇ 2 pixel samples or 2 ⁇ 4 pixels
  • the basic operation of the microblock copy encoding or decoding is to encode each microblock in the current block or Decoding the microblock (referred to as the current microblock), copying a reference microblock from the reconstructed reference pixel sample set, and assigning the value of the reference microblock to the current microblock.
  • the copy parameter of the microblock copy mode includes a displacement vector of the current microblock, indicating a relative position between the reference microblock and the current microblock.
  • a current microblock has a displacement vector. How many displacement vectors are there in how many microblocks a current block is divided into.
  • Intra-frame lines are copied, that is, intra-frame matching or strip matching or strip copying.
  • a strip is a microblock having a height of 1 or a width of 1, such as a microblock of 4x1 or 8x1 or 1x4 or 1x8 pixel samples.
  • the basic operation of the strip copy encoding or decoding is to copy each reference strip or decoded strip (referred to as the current strip) in the current block from the reconstructed reference pixel sample set, and the value of the reference strip Assign to the current bar.
  • strip copying is a special case of microblock copying.
  • the copy parameter of the strip copy mode includes the displacement vector of the current strip, indicating the relative position between the reference strip and the current strip.
  • a current bar has a displacement vector. How many displacement vectors are there in how many bars a current block is divided into.
  • Intra-frame string replication means intra-frame string matching or string matching or string copying or pixel string copying.
  • a current coded block or a current decoded block (referred to as the current block) is divided into several variable-length pixel sample strings.
  • the string here refers to arranging the pixel samples in a two-dimensional area of an arbitrary shape into a string whose length is much larger than the width (for example, a string having a width of 1 pixel sample and a length of 37 pixel samples or a width of 2)
  • a string of pixel samples of length 111 pixels typically but not limited to a length that is an independent encoding or decoding parameter and a width that is a predetermined or derived parameter from other encoding or decoding parameters).
  • the basic operation of string copy encoding or decoding is to copy each reference string from the reconstructed reference pixel sample set to each encoded string or decoded string (referred to as the current string) in the current block, and the value of the reference string Assign to the current string.
  • the copy parameters of the string copy mode include the displacement vector and the copy length of the current string, that is, the copy size, which respectively represent the relative position between the reference string and the current string and the length of the current string, that is, the number of pixel samples.
  • the length of the current string is also the length of the reference string.
  • a current string has a displacement vector and a copy length. How many displacement vectors and how many copy lengths a current block is divided into. Displacement vector
  • the quantity is also called the copy position, and its representation forms are: 2D coordinates, linear address, distance, pointer, index, number, mode number, and so on.
  • Palette index string copy is a palette or index string copy.
  • first construct or acquire a palette and then use some or all of the pixels of the current encoding block or the current decoding block (referred to as the current block) with the palette in the palette.
  • the index of the color is expressed, and then the index is encoded and decoded, including but not limited to: dividing the index of a current block into several index strings of variable length, that is, performing index string copy encoding and decoding.
  • the basic operation of the index string copy encoding or decoding is to copy each reference index string or index decoding string (referred to as the current index string) in the current block, and copy a reference index string from the indexed reconstructed reference pixel sample set.
  • the copy parameter of the index string copy mode includes the displacement vector and the copy length of the current index string, that is, the copy size, respectively indicating the relative position between the reference index string and the current index string and the length of the current index string, that is, the number of corresponding pixel samples.
  • the length of the current index string is also the length of the reference index string.
  • a current index string has a displacement vector and a copy length. How many displacement vectors and how many copy lengths a current index is divided into.
  • the displacement vector is also called the copy position, and its representation forms are: 2D coordinates, linear address, distance, pointer, index, number, mode number, and so on.
  • the index string is also called a palette color string or a palette pixel string or a palette string
  • the index string copy mode is also called a palette copy mode or a palette mode.
  • strings are also called runs or strokes. Therefore, the index string is also called an index run or index run or simply a run or trip.
  • the palette color of the current block is derived from the pixel color and/or palette color candidate set of the current block, and the palette color candidate set is composed of a portion of the palette color of the codec block that has completed the codec.
  • index-pixel string fusion copy mode also called palette-pixel string fusion copy mode or merged pixel string copy palette mode or fusion palette Pixel string copy mode or palette with pixel string copy mode.
  • index-pixel string fusion copy mode also called palette-pixel string fusion copy mode or merged pixel string copy palette mode or fusion palette Pixel string copy mode or palette with pixel string copy mode.
  • Multiple palettes and pixel string copying methods combining multiple palettes and pixel string copying methods. Encoding and decoding are performed using at least two different color palettes and pixel string copying methods. Different color palettes and pixel string copying methods use different fusion schemes to fuse palette copying and pixel string copying. In one frame of image, part of the codec block adopts the palette and pixel string copy mode of the fusion scheme I, and part of the codec block adopts the palette and pixel string copy mode of the fusion scheme II, and some codec blocks adopt the fusion scheme III. The palette is copied with pixel strings, and so on.
  • Different fusion schemes may differ in the following aspects: 1) the number of types of strings, 2) the range of values of parameters, 3) the range of values of one or several replicated parameters, and 4) the location of the displacement vector Range of values, 5) current index or current pixel position, 6) position of the current sample segment, 7) position of the reference index or reference pixel, 8) position of the reference sample segment; 9) copy shape.
  • a pixel sample segment referred to as a sample segment.
  • the basic constituent elements of a sample segment are pixel or pixel components or pixel indices.
  • a sample segment has a copy parameter that represents the relationship between the current pixel sample segment and the reference pixel sample segment. Therefore, a sample segment is the smallest unit of a copy operation with the same replication relationship.
  • a copy parameter includes a plurality of copy parameter components, and the copy parameter components include at least: displacement vector horizontal component, displacement vector vertical component, 1 dimensional displacement vector, linear address, relative linear address, index, palette linear address, relative index, toning Board relative linear address, copy length, copy width, copy height, rectangle width, rectangle length, unmatched pixels (also known as no reference pixels, ie non-replicated pixels that are not copied from elsewhere).
  • pixel samples or indexes need to be arranged in a certain order.
  • the arrangement is also called the scanning method.
  • the scanning method can be divided into the following types according to its path shape:
  • A) Horizontal Z-scan mode is also called horizontal raster scan mode.
  • a pixel sample or index of a coded block or a decoded block (collectively referred to as a codec block) is arranged line by line and arranged in the same direction (all left to right or all right to left) in all rows. Rows and rows can be arranged from top to bottom or from bottom to top.
  • Vertical Z-scan mode is also called vertical raster scan mode.
  • a pixel sample or index of a coded block or a decoded block (collectively referred to as a codec block) is arranged in columns and columns, and is arranged in the same direction (all from top to bottom or all from bottom to top) in all columns. Columns and columns can be arranged from left to right or from right to left.
  • a pixel sample or index of a coded block or a decoded block (collectively referred to as a codec block), arranged line by line, arranged in one direction (eg, from left to right) in an odd line and in another (opposite) direction in an even line (eg, from right to left). Rows and rows can be arranged from top to bottom or from bottom to top.
  • a pixel sample or index of a coded block or a decoded block (collectively referred to as a codec block), arranged in columns and columns, arranged in one direction (eg, from top to bottom) in an odd column and in another in an even column (opposite ) Directions (eg, from bottom to top). Columns and columns can be arranged from left to right or from right to left.
  • the basic copy shape has the following two types:
  • the current string and the reference string are each a one-dimensional sample string formed in the order of a predetermined scanning manner in each codec block, and have equal lengths, but the two-dimensional regions formed by the two strings are not necessarily the same. Two-dimensional shape.
  • the current strings are arranged in the order of the predetermined scanning mode within the current codec block.
  • the reference string remains exactly the same two-dimensional shape as the current string, with equal length.
  • Each of the above basic replicated shapes can be subdivided into a plurality of replicated shapes according to a specific scanning manner, such as a vertical arcuate one-dimensional linear replica shape, a horizontal Z-shaped two-dimensional conformal replica shape, and the like.
  • copying is an operation of reconstruction and decoding, and the corresponding encoding operation is “matching”. Therefore, various copying methods such as block matching mode, microblock copying mode, line copying mode, pixel string copying mode, and index string copying mode are also called block matching mode, microblock matching mode, line matching mode, and pixel string matching mode. , index string matching method, and so on.
  • each palette and pixel string copy mode has separate palette color candidate sets, if one codec block does not adopt a palette and pixel string copy mode.
  • the palette color candidate set corresponding to the pixel string copy mode is not updated, and no new more suitable palette color is added to the corresponding palette color candidate set. This approach greatly reduces the compression efficiency of multiple palettes and pixel string replication.
  • an embodiment of the present invention provides an image encoding and decoding method and an image processing device.
  • a codec block some or all of the new palette color is placed in the shared palette color candidate set regardless of which palette and pixel string copying method is employed.
  • various palette and pixel string copy modes generate respective palettes from the pixels of the current codec block and/or the shared palette color candidate set.
  • the palette color candidate set is also known as the palette predictor or palette prediction set.
  • the maximum number of palette colors that can be accommodated in the maximum space of the palette color candidate set is a predetermined constant.
  • the palette color candidate set is updated according to a predetermined rule.
  • the palette color candidate set deletes an existing palette color according to a predetermined rule.
  • the palette color candidate set adjusts the position of the palette color according to a predetermined rule, that is, changes its address or pointer.
  • the palette color candidate set adds a new palette color according to a predetermined rule.
  • the palette color candidate set adds a new tone according to a first-in, first-out rule.
  • one of the plurality of palette and pixel string copying modes is a simple palette copying mode.
  • any codec block is encoded and decoded by using one of a palette and a pixel string copy mode, and part or all of the newly generated palette color of the codec block is added to the shared palette. Color candidate set.
  • FIG. 1 is a schematic flowchart 1 of an image encoding method according to an embodiment of the present invention.
  • a pixel from a current encoding block is used.
  • Generating a new palette color generating a palette of current coded blocks from the palette color candidate set shared by the new palette color and/or palette and pixel string copy encoding, using the tone
  • the swatch performs palette and pixel string copy coding and generates a video code stream containing at least a copy mode and a copy parameter; as shown in FIG. 1, the image coding method includes the following steps:
  • Step 101 When copying and encoding the current coding block by using one of a color palette and a pixel string copy coding mode, a new color palette color is generated according to the pixel of the current coding block.
  • Step 102 Generate a palette of the current coded block according to the palette color candidate set shared by the new palette color and/or color palette and the pixel string copy coding mode.
  • Step 103 Perform palette and pixel string copy coding using the palette of the current coding block, and generate a video code stream including a copy mode and a copy parameter.
  • the coding block is an coding region of an image, and the coding block includes at least one of: a maximum coding unit LCU, a coding tree unit CTU, a coding unit CU, a sub-region of a CU, and a prediction unit. PU, transform unit TU.
  • the video code stream further includes the new palette color.
  • the color palette and the pixel string copying manner have respective palettes.
  • the maximum number of palette colors that the maximum space of the palette color candidate set can accommodate is a predetermined constant.
  • the palette color candidate set performs one or more of the following operations according to a predetermined rule:
  • the palette color candidate set adds a new palette color and/or deletes an existing palette color according to a first in first out rule.
  • one of the plurality of palette and pixel string copying modes is a simple palette copying mode.
  • part or all of the new palette color of the coding block is added to the sharing for the coding block coded by using one of the palette and the pixel string copy mode. Palette color candidate set.
  • FIG. 2 is a schematic flowchart 1 of an image decoding method according to an embodiment of the present invention.
  • a video code stream is parsed, and at least one of the following information is obtained: a copy mode, a copy parameter, and a copying manner of a palette and a pixel string copy and decoding.
  • the palette used for the palette and pixel string copy decoding includes the following steps:
  • Step 201 Parse the video code stream, and obtain at least one of the following information: a copy mode of the palette and the pixel string copy decoding, a copy parameter, and a new palette color.
  • Step 202 Generate a palette and a pixel string using the copy mode for the current decoding block according to the palette color candidate set shared by the new palette color and/or color palette and the pixel string copy decoding mode. Copy the palette used for decoding.
  • Step 203 Perform a palette and pixel string copy solution using the palette of the current decoded block. code.
  • the decoding block is a decoding area of an image, and the decoding block includes at least one of the following: an LCU, a CTU, a CU, a sub-area of the CU, a PU, and a TU.
  • the color palette and the pixel string copying manner have respective palettes.
  • the maximum number of palette colors that the maximum space of the palette color candidate set can accommodate is a predetermined constant.
  • the palette color candidate set performs one or more of the following operations according to a predetermined rule:
  • the palette color candidate set adds a new palette color and/or deletes an existing palette color according to a first in first out rule.
  • one of the plurality of palette and pixel string copying modes is a simple palette copying mode.
  • part or all of the new palette color of the decoding block is added to the shared decoding block for decoding using one of the palette and the pixel string copying mode. Palette color candidate set.
  • the technical solution of the embodiment of the present invention is applicable to encoding and decoding of a stacked format image.
  • the technical solution of the embodiment of the present invention is also applicable to encoding and decoding of component plane format images.
  • FIG. 3 is a second schematic flowchart of an image encoding method according to an embodiment of the present invention. As shown in FIG. 3, in the process:
  • a new palette color is generated from the pixels of the current coded block, from the new palette color and/or color
  • the palette color candidate set shared by the board and the pixel string copy coding method generates the current coding block a palette that uses the palette to perform palette and pixel string copy encoding and to generate a video stream containing at least copy mode, copy parameters.
  • the video stream contains a new palette color.
  • the palette and pixel string copy encoding methods have separate palettes.
  • the maximum number of palette colors that the maximum space of the palette color candidate set can accommodate is a predetermined constant.
  • the palette color candidate set is updated according to a predetermined rule.
  • the palette color candidate set deletes an existing palette color according to a predetermined rule.
  • the palette color candidate set adjusts the position of the palette color according to a predetermined rule, ie, changes its address or pointer.
  • the palette color candidate set adds a new palette color according to a predetermined rule.
  • the palette color candidate set adds a new palette color and/or deletes an existing palette color according to a first in first out rule.
  • one of the plurality of palette and pixel string copy coding modes is a simple palette copy coding mode.
  • any one of the coding blocks is encoded by using one of a palette and a pixel string copy coding method, and part or all of the newly generated palette color of the coding block is added to the shared palette. Color candidate set.
  • FIG. 4 is a schematic flowchart 2 of an image decoding method according to an embodiment of the present invention. As shown in FIG. 4, in the process:
  • the palette color candidate set shared by the swatch and the pixel string copy decoding mode generates a palette used for the current decoded block to perform palette and pixel string copy decoding using the copy mode.
  • the video stream contains a new palette color.
  • the palette and pixel string copy decoding modes have separate palettes.
  • the maximum number of palette colors that the maximum space of the palette color candidate set can accommodate is a predetermined constant.
  • the palette color candidate set is performed according to a predetermined rule. Update.
  • the palette color candidate set deletes an existing palette color according to a predetermined rule.
  • the palette color candidate set adjusts the position of the palette color according to a predetermined rule, ie, changes its address or pointer.
  • the palette color candidate set adds a new palette color according to a predetermined rule.
  • the palette color candidate set adds a new palette color and/or deletes an existing palette color according to a first in first out rule.
  • one of the plurality of palette and pixel string copy decoding modes is a simple palette copy decoding mode.
  • the arbitrary decoding block is added to the shared palette color candidate by using one of the palette and the pixel string copy decoding mode, and adding part or all of the newly generated palette color of the decoded block. set.
  • FIG. 5 is a first schematic structural diagram of an image processing apparatus according to an embodiment of the present invention.
  • the image processing apparatus can encode an image. As shown in FIG. 5, the image processing apparatus includes:
  • the first generating unit 51 is configured to generate a new palette color according to the pixel of the current encoding block when copying and encoding the current encoding block by using one of a palette and a pixel string copy encoding method;
  • a second generating unit 52 configured to generate a palette of the current encoding block according to the palette color candidate set shared by the new palette color and/or color palette and the pixel string copy encoding manner;
  • the encoding unit 53 is configured to perform palette and pixel string copy encoding using the palette of the current encoding block, and generate a video code stream including a copy mode and a copy parameter.
  • the video stream contains a new palette color.
  • the palette and pixel string copy encoding methods have separate palettes.
  • the maximum number of palette colors that the maximum space of the palette color candidate set can accommodate is a predetermined constant.
  • the palette color candidate set is updated according to a predetermined rule.
  • the palette color candidate set deletes an existing palette color according to a predetermined rule.
  • the palette color candidate set adjusts the position of the palette color according to a predetermined rule, ie, changes its address or pointer.
  • the The palette color candidate set adds a new palette color according to a predetermined rule.
  • the palette color candidate set adds a new palette color and/or deletes an existing palette color according to a first in first out rule.
  • one of the plurality of palette and pixel string copy coding modes is a simple palette copy coding mode.
  • any coding block is encoded by using any one of a palette and a pixel string copy coding method, and part or all of the newly generated palette color of the coding block is added to the shared color. Board color candidate set.
  • the implementation functions of the units in the image processing apparatus shown in FIG. 5 can be understood by referring to the related description of the foregoing image encoding method.
  • the functions of the units in the image processing apparatus shown in FIG. 5 can be realized by a program running on a processor, or can be realized by a specific logic circuit.
  • each unit in the image processing device may be implemented by a central processing unit (CPU) or a microprocessor (Micro Processor Unit, MPU) located in the image processing device. Or a digital signal processor (DSP), or a Field Programmable Gate Array (FPGA).
  • CPU central processing unit
  • MPU Micro Processor Unit
  • DSP digital signal processor
  • FPGA Field Programmable Gate Array
  • FIG. 6 is a second schematic structural diagram of an image processing apparatus according to an embodiment of the present invention.
  • the image processing apparatus can decode an image. As shown in FIG. 6, the image processing apparatus includes:
  • the parsing unit 61 is configured to parse the video code stream, and obtain at least one of the following information: a copy mode of the palette and the pixel string copy decoding, a copy parameter, and a new palette color;
  • the third generating unit 62 is configured to generate, according to the new palette color and/or the palette color candidate set shared by the palette and the pixel string copy decoding mode, to generate the current decoding block by using the copy mode.
  • the decoding unit 63 is configured to perform palette and pixel string copy decoding using the palette of the current decoded block.
  • the video stream contains a new palette color.
  • the palette and pixel string copy decoding modes have separate palettes.
  • the maximum number of palette colors that the maximum space of the palette color candidate set can accommodate is a predetermined constant.
  • the palette color candidate set is updated according to a predetermined rule.
  • the palette color candidate set deletes an existing palette color according to a predetermined rule.
  • the palette color candidate set adjusts the position of the palette color according to a predetermined rule, ie, changes its address or pointer.
  • the palette color candidate set adds a new palette color according to a predetermined rule.
  • the palette color candidate set adds a new palette color and/or deletes an existing palette color according to a first in first out rule.
  • one of the palette and pixel string copy decoding modes is a simple palette copy decoding mode.
  • the arbitrary decoding block is added to the shared palette color candidate by using one of the palette and the pixel string copy decoding mode, and adding part or all of the newly generated palette color of the decoded block. set.
  • each unit in the image processing device may be implemented by a central processing unit (CPU) or a microprocessor (Micro Processor Unit, MPU) located in the image processing device. Or a digital signal processor (DSP), or a Field Programmable Gate Array (FPGA).
  • CPU central processing unit
  • MPU Micro Processor Unit
  • DSP digital signal processor
  • FPGA Field Programmable Gate Array
  • FIG. 7 is a third schematic structural diagram of an image processing apparatus according to an embodiment of the present invention.
  • the image processing apparatus can encode and decode an image. As shown in FIG. 7, the image processing apparatus includes:
  • the first generating unit 71 is configured to generate a new palette color according to the pixel of the current encoding block when copying and encoding the current encoding block by using one of a palette and a pixel string copy encoding method;
  • a second generating unit 72 configured to generate a palette of the current encoding block according to the palette color candidate set shared by the new palette color and/or color palette and the pixel string copy encoding manner;
  • the encoding unit 73 is configured to perform palette and pixel string copy encoding using the palette of the current encoding block, and generate a video code stream including a copy mode and a copy parameter.
  • the parsing unit 74 is configured to parse the video code stream, and obtain at least one of the following information: a copy mode of the palette and the pixel string copy decoding, a copy parameter, and a new palette color;
  • the third generating unit 75 is configured to generate, according to the new palette color and/or the palette color candidate set shared by the palette and the pixel string copy decoding mode, to generate the current decoding block by using the copy mode.
  • Decoding unit 76 is configured to perform palette and pixel string copy decoding using the palette of the current decoded block.
  • each unit in the image processing device may be implemented by a central processing unit (CPU) or a microprocessor (Micro Processor Unit, MPU) located in the image processing device. Or a digital signal processor (DSP), or a Field Programmable Gate Array (FPGA).
  • CPU central processing unit
  • MPU Micro Processor Unit
  • DSP digital signal processor
  • FPGA Field Programmable Gate Array
  • embodiments of the present invention can be provided as a method, system, or computer program product. Accordingly, the present invention can take the form of a hardware embodiment, a software embodiment, or a combination of software and hardware. Moreover, the invention can take the form of a computer program product embodied on one or more computer-usable storage media (including but not limited to disk storage and optical storage, etc.) including computer usable program code.
  • the image processing device is implemented in the form of a software function module. When sold or used as a standalone product, it can also be stored on a computer readable storage medium. Based on such understanding, the technical solution of the embodiments of the present invention may be embodied in the form of a software product in essence or in the form of a software product stored in a storage medium, including a plurality of instructions.
  • a computer device (which may be a personal computer, server, or network device, etc.) is caused to perform all or part of the methods described in various embodiments of the present invention.
  • the foregoing storage medium includes various media that can store program codes, such as a USB flash drive, a mobile hard disk, a read only memory (ROM), a magnetic disk, or an optical disk.
  • embodiments of the invention are not limited to any specific combination of hardware and software.
  • an embodiment of the present invention further provides a computer storage medium, wherein a computer program for executing an image encoding method and/or an image decoding method according to an embodiment of the present invention is stored.
  • the computer program instructions can also be stored in a computer readable memory that can direct a computer or other programmable data processing device to operate in a particular manner, such that the instructions stored in the computer readable memory produce an article of manufacture comprising the instruction device.
  • the apparatus implements the functions specified in one or more blocks of a flow or a flow and/or block diagram of the flowchart.
  • a new color palette color is generated according to the pixel of the current coding block; Palette color and/or palette color palette color candidate set shared with pixel string copy encoding, generating a palette of the current encoding block; coloring using the palette of the current encoding block
  • the board and the pixel string are copied and encoded, and a video stream including a copy mode and a copy parameter is generated.
  • the image compression of the palette color candidate set is realized by multiple copy modes, and the compression efficiency of the multi-palette and pixel string copy mode is improved.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Compression Or Coding Systems Of Tv Signals (AREA)

Abstract

L'invention concerne un procédé de codage et de décodage d'image, un dispositif de traitement d'image, et un support de stockage informatique, comprenant les étapes consistant : lors de l'utilisation d'une palette et d'un moyen de réplication de codage d'une série de pixels afin de répliquer le codage d'un bloc codé actuel, à générer une nouvelle couleur de palette selon les pixels dudit bloc codé actuel ; selon ladite nouvelle couleur de palette et/ou l'ensemble candidat de couleur de palette partagé par la palette et le moyen de réplication de codage d'une série de pixels, à générer la palette dudit bloc codé actuel ; à utiliser ladite palette afin de répliquer le codage de la palette et de la série de pixels, et de générer le flux de code vidéo comprenant le moyen de réplication et les paramètres de réplication. Le flux de code vidéo est analysé, et au moins une des informations suivantes est obtenue : le moyen de réplication, les paramètres de réplication, et une nouvelle couleur de palette de la palette et la réplication de décodage d'une série de pixels ; selon ladite nouvelle couleur de palette et/ou l'ensemble candidat de couleur de palette partagé par la palette et le moyen de réplication de décodage d'une série de pixels, générer une palette, utiliser ladite palette afin de répliquer le décodage de la palette et de la série de pixels.
PCT/CN2016/084992 2015-06-08 2016-06-06 Procédé de codage et de décodage d'image, dispositif de traitement d'image et support de stockage informatique WO2016197893A1 (fr)

Priority Applications (4)

Application Number Priority Date Filing Date Title
EP22191754.5A EP4114000A1 (fr) 2015-06-08 2016-06-06 Procédés de codage et de décodage d'image, dispositif de traitement d'image et support de stockage informatique
US15/580,893 US20180167623A1 (en) 2015-06-08 2016-06-06 Image encoding and decoding methods, image processing device, and computer storage medium
EP16806791.6A EP3306931A4 (fr) 2015-06-08 2016-06-06 Procédé de codage et de décodage d'image, dispositif de traitement d'image et support de stockage informatique
US17/902,022 US11917168B2 (en) 2015-06-08 2022-09-02 Image encoding and decoding methods, image processing device, and computer storage medium

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
CN201510308146 2015-06-08
CN201510308146.7 2015-06-08
CN201610364374.0A CN106254865B (zh) 2015-06-08 2016-05-27 一种图像编码及解码方法、图像处理设备
CN201610364374.0 2016-05-27

Related Child Applications (2)

Application Number Title Priority Date Filing Date
US15/580,893 A-371-Of-International US20180167623A1 (en) 2015-06-08 2016-06-06 Image encoding and decoding methods, image processing device, and computer storage medium
US17/902,022 Continuation US11917168B2 (en) 2015-06-08 2022-09-02 Image encoding and decoding methods, image processing device, and computer storage medium

Publications (1)

Publication Number Publication Date
WO2016197893A1 true WO2016197893A1 (fr) 2016-12-15

Family

ID=57502828

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2016/084992 WO2016197893A1 (fr) 2015-06-08 2016-06-06 Procédé de codage et de décodage d'image, dispositif de traitement d'image et support de stockage informatique

Country Status (1)

Country Link
WO (1) WO2016197893A1 (fr)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112532989A (zh) * 2020-06-02 2021-03-19 腾讯科技（深圳）有限公司 视频编码方法、视频解码方法及相关设备
CN112543333A (zh) * 2020-06-02 2021-03-23 腾讯科技（深圳）有限公司 视频解码方法、视频编码方法及相关设备

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101340587A (zh) * 2007-07-05 2009-01-07 联发科技股份有限公司 编码输入图像的方法以及播放已编码图像的方法及装置
US20090033670A1 (en) * 2007-07-31 2009-02-05 Hochmuth Roland M Providing pixels from an update buffer
US20100214315A1 (en) * 2009-02-23 2010-08-26 Nguyen Uoc H Encoding cmyk data for display using indexed rgb
CN102497546A (zh) * 2011-11-28 2012-06-13 同济大学 一种屏幕图像压缩装置及压缩方法
US20140064612A1 (en) * 2012-09-04 2014-03-06 Kabushiki Kaisha Toshiba Apparatus and a method for coding an image
CN104244007A (zh) * 2013-06-13 2014-12-24 上海天荷电子信息有限公司 基于任意形状匹配的图像压缩方法和装置
WO2015090219A1 (fr) * 2013-12-18 2015-06-25 Mediatek Inc. Procédé et appareil d'initialisation et de gestion de palettes

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101340587A (zh) * 2007-07-05 2009-01-07 联发科技股份有限公司 编码输入图像的方法以及播放已编码图像的方法及装置
US20090033670A1 (en) * 2007-07-31 2009-02-05 Hochmuth Roland M Providing pixels from an update buffer
US20100214315A1 (en) * 2009-02-23 2010-08-26 Nguyen Uoc H Encoding cmyk data for display using indexed rgb
CN102497546A (zh) * 2011-11-28 2012-06-13 同济大学 一种屏幕图像压缩装置及压缩方法
US20140064612A1 (en) * 2012-09-04 2014-03-06 Kabushiki Kaisha Toshiba Apparatus and a method for coding an image
CN104244007A (zh) * 2013-06-13 2014-12-24 上海天荷电子信息有限公司 基于任意形状匹配的图像压缩方法和装置
WO2015090219A1 (fr) * 2013-12-18 2015-06-25 Mediatek Inc. Procédé et appareil d'initialisation et de gestion de palettes

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
See also references of EP3306931A4 *
XIU, XIAOYU ET AL.: "Palette-based Coding in the Screen Content Coding Extension of the HEVC Standard", PROCEEDINGS OF THE 2015 DATA COMPRESSION CONFERENCE, 9 April 2015 (2015-04-09), pages 253 - 262, XP055281837, ISSN: 1068-0314 *

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112532989A (zh) * 2020-06-02 2021-03-19 腾讯科技（深圳）有限公司 视频编码方法、视频解码方法及相关设备
CN112543333A (zh) * 2020-06-02 2021-03-23 腾讯科技（深圳）有限公司 视频解码方法、视频编码方法及相关设备
CN112543333B (zh) * 2020-06-02 2021-08-24 腾讯科技（深圳）有限公司 视频解码方法、视频编码方法及相关设备

Similar Documents

Publication Publication Date Title
CN105704491B (zh) 图像编码方法、解码方法、编码装置和解码装置
CN112383780B (zh) 点匹配参考集和索引来回扫描串匹配的编解码方法和装置
CN105491376B (zh) 图像编码、解码方法及装置
CN106254865B (zh) 一种图像编码及解码方法、图像处理设备
CN106254888B (zh) 一种图像编码及解码方法、图像处理设备
CN105847842B (zh) 图像编码方法及装置、图像解码方法及装置
US10178405B2 (en) Enhanced coding and decoding using intra block copy mode
CN104754362B (zh) 使用精细划分块匹配的图像压缩方法
US11653019B2 (en) Image coding and decoding methods, image processing device and computer storage medium
US11431977B2 (en) Image coding method and apparatus, and image decoding method and apparatus
WO2016202189A1 (fr) Procédés de codage et de décodage d'image, dispositif de traitement d'image, et support de stockage informatique
CN105992003B (zh) 依据排序或频度对调色板颜色编号的图像压缩方法和装置
WO2016197893A1 (fr) Procédé de codage et de décodage d'image, dispositif de traitement d'image et support de stockage informatique
CN106303534B (zh) 多种索引串与像素串融合复制方式的图像压缩方法和装置
CN106303535B (zh) 参考像素取自不同程度重构像素的图像压缩方法和装置
WO2016119746A1 (fr) Procédé et appareil de codage d'image, et procédé et appareil de décodage d'image
WO2016197898A1 (fr) Procédé d'encodage et de décodage d'image, dispositif de traitement d'image, et support de stockage informatique
CN105828080B (zh) 图像编解码方法及装置
WO2016124154A1 (fr) Procédé et appareil de codage d'image ainsi que procédé et appareil de décodage d'image
CN105828079B (zh) 图像处理方法及装置
WO2016119666A1 (fr) Procédé et appareil de codage/décodage d'image

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 16806791

Country of ref document: EP

Kind code of ref document: A1

WWE Wipo information: entry into national phase

Ref document number: 15580893

Country of ref document: US

NENP Non-entry into the national phase

Ref country code: DE

WWE Wipo information: entry into national phase

Ref document number: 2016806791

Country of ref document: EP