CN106303534A - Multiple index string and pixel string merge method for compressing image and the device of copy mode - Google Patents
Multiple index string and pixel string merge method for compressing image and the device of copy mode Download PDFInfo
- Publication number
- CN106303534A CN106303534A CN201510308134.4A CN201510308134A CN106303534A CN 106303534 A CN106303534 A CN 106303534A CN 201510308134 A CN201510308134 A CN 201510308134A CN 106303534 A CN106303534 A CN 106303534A
- Authority
- CN
- China
- Prior art keywords
- string
- pixel
- copy mode
- index
- decoding
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Abstract
The invention provides a kind of index string-pixel string using at least two different and merge the picture coding of copy mode and the method or apparatus of decoding.In a two field picture, part encoding and decoding block uses the index string-pixel string of integration program I to merge copy mode, part encoding and decoding block uses the index string-pixel string of integration program II to merge copy mode, and part encoding and decoding block uses the index string-pixel string of integration program III to merge copy mode, etc..
Description
Technical field
The present invention relates to a kind of compression of digital video encoding and decoding system, particularly contain the combination picture of computer screen image and the method and apparatus of the encoding and decoding of video.
Background technology
Along with television set and display enter ultra high-definition (4K) and the resolution of special ultra high-definition (8K), and the cloud computing of new generation with remote desktop as classic manifestations and messaging model and the development of platform and universal, the demand of video image data compression is also moved towards higher resolution and comprised the combination picture of camera pickuping image and computer screen image.The data compression that video image carries out superelevation compression ratio and very high-quality becomes requisite technology.
Make full use of the feature of 4K/8K image and computer screen image, video image is carried out the compression of Ultra-High Efficiency, is also the up-to-date international video compression standards HEVC(High Efficiency Video Coding formulated) and some other international standards, domestic standard, a main target of industry standard.
The natural form of the digital video signal of image is the sequence of image.One two field picture is typically the rectangular area being made up of some pixels, and digital video signal is exactly the sequence of video images being made up of tens frames to thousands of two field pictures, the most also referred to as video sequence or sequence.Image one by one is encoded by numeral encoding video signal exactly.At any one time, that two field picture encoded is referred to as current encoded image.Equally, it is decoded exactly the code stream compressing image one by one being decoded to the video code flow (be called for short code stream and be also referred to as bit stream) after the compression of digital video signal.At any one time, that two field picture decoded is referred to as currently decoding image.Current encoded image or current decoding image are all referred to as present image.
International standard such as MPEG-1/2/4 at nearly all encoding video pictures, H.264/AVC and in HEVC, when one two field picture is encoded (and decoding accordingly), one two field picture is divided into the subimage of some pieces of MxM pixels, it is referred to as encoding block and (namely solves code block from the angle of decoding, it is referred to as encoding and decoding block) or " coding unit (Coding Unit is called for short CU) ", with CU for basic coding unit, subimage one piece a piece is encoded.The size of conventional M is 4,8,16,32,64.Therefore, a sequence of video images carries out coding exactly each coding unit i.e. CU CU the most one by one of each two field picture to be encoded.At any one time, the CU encoded is referred to as present encoding CU.Equally, it is decoded also being that each CU CU the most one by one to each two field picture is decoded to the code stream of a sequence of video images, finally reconstructs whole sequence of video images.At any one time, the CU decoded is referred to as currently decoding CU.Present encoding CU or current decoding CU are referred to as current CU.
Different from character for each several part picture material in adapting to a two field picture, carry out maximally effective coding targetedly, in a two field picture, the size of each CU can be different, has plenty of 8x8, has plenty of 64x64, etc..In order to enable different size of CU seamless spliced, one two field picture is the most first divided into identical " the maximum coding unit (Largest Coding Unit is called for short LCU) " with NxN pixel of size, and the most each LCU is further divided into the multiple not of uniform size fixed identical CU of tree.Therefore, LCU is also referred to as " code tree unit (Coding Tree Unit is called for short CTU) ".Such as, a two field picture is first divided into the LCU(N=64 of size identical 64x64 pixel).Wherein certain LCU is made up of the CU of 3 32x32 pixels and the CU of 4 16x16 pixels, and such 7 CU becoming tree constitute a CTU.And another LCU is made up of the CU of the CU of 2 32x32 pixels, the CU of 3 16x16 pixels and 20 8x8 pixels.Such 25 CU becoming tree constitute another CTU.One two field picture is encoded, it is simply that successively the CU one by one in CTU one by one is encoded.In HEVC international standard, LCU Yu CTU is synonym.The size CU referred to as degree of depth equal to CTU is the CU of 0.The degree of depth be the CU referred to as degree of depth that obtains of the CU quartering up and down of 0 be the CU of 1.The degree of depth be the CU referred to as degree of depth that obtains of the CU quartering up and down of 1 be the CU of 2.The degree of depth be the CU referred to as degree of depth that obtains of the CU quartering up and down of 2 be the CU of 3.At any one time, the CTU encoded is referred to as present encoding CTU.At any one time, the CTU decoded is referred to as currently decoding CTU.Present encoding CTU or current decoding CTU are referred to as current CTU.
CU can also further be divided into some subregions.Subregion includes but not limited to predicting unit (PU), converter unit (TU), the region of asymmetric division (AMP).
One colour element generally has 3 component (component) compositions.GBR color format that the most frequently used two kinds of pixel color forms (pixel color format) are made up of green component, blue component, red component and the YUV color format being made up of brightness (luma) component and two colourity (chroma) components.It is commonly referred to as that the color format of YUV is actual includes multicolour form, such as YCbCr color format.Therefore, when a CU is encoded, a CU can be divided into 3 component planes (G plane, B plane, R plane or Y plane, U plane, V plane), 3 component planes are encoded respectively；The 3 of one pixel component binding combination can also be become 3 tuples, the CU entirety being made up of these 3 tuples is encoded.The arrangement mode of former pixel and component thereof is referred to as the planar format (planar of image (and CU)
Format), and the arrangement mode of latter pixel and component thereof is referred to as the folded bag form (packed format) of image (and CU).The GBR color format of pixel and YUV color format are all 3 component representation formats of pixel.
Except 3 component representation formats of pixel, the representation formats of the prior art that the another kind of pixel is conventional is that palette indexes representation formats.In palette index representation formats, the numerical value of a pixel can also show with the index of palette.Storing numerical value or the numerical approximation of 3 components of the color of the pixel that needs are showed in palette space, the address of palette is referred to as in this address the index of the color of the pixel of storage.One index can show the one-component of the color of pixel, and index can also show 3 components of the color of pixel.Palette can be one, it is also possible to is multiple.In the situation of multiple palettes, complete index is actually made up of index two parts of palette sequence number (represent in multiple palette which) and the palette of this sequence number.The index representation formats of pixel is exactly that index of reference is to show this pixel.If the pixel in an image-region (such as encoding block or solution code block) can not all show (i.e. at least one pixel in this image-region by palette of colors, there is no palette of colors and index thereof that the numerical value of 3 components is equal or approximately equal with this pixel), palette then generally has a special index being referred to as escape color, is used for showing the pixel that can not show by normal palette of colors.Therefore, if the index of a pixel is the index of escape color, then this pixel needs to show its color with other special 3 component.Normal color and escape color in palette are referred to as palette of colors, but escape color is a false color, and in palette, a physical space does not deposits this color, the special virtual index that only one of which is special.The index of escape color is typically last index of palette.The index representation formats of pixel is also referred to as the indexed color (indexed of pixel in the prior art
Or imitative color (pseudo color) representation formats, or be usually directly referred to as indexing pixel (indexed pixel) or imitative pixel (pseudo pixel) or pixel index or index color).Index is also sometimes referred to as index.Pixel is showed also referred to as indexation or indexation by its index representation formats.
The pixel performance form of other conventional prior art includes CMYK representation formats and expressing gradation form.
YUV color format again can be according to whether carry out down-sampling to be subdivided into several subformat to chromatic component: the YUV4:4:4 pixel color form that 1 pixel is made up of 1 Y-component, 1 U component, 1 V component；The YUV4:2:2 pixel color form that adjacent 2 pixels in left and right are made up of 2 Y-component, 1 U component, 1 V component；The neighbouring YUV4:2:0 pixel color form being made up of 4 Y-component, 1 U component, 1 V component by 4 pixels of 2x2 spatial arrangements in left and right.One-component typically represents by the numeral of 18 ~ 16 bit.YUV4:2:2 pixel color form and YUV4:2:0 pixel color form are all that the down-sampling that YUV4:4:4 pixel color form is implemented chromatic component obtains.One pixel component is also referred to as a pixel sample value (pixel
Or be simply referred as a sample value (sample) sample).
Most basic element when coding or decoding can be a pixel, it is also possible to be a pixel component, it is also possible to be a pixel index (i.e. indexing pixel).It is referred to as a pixel sample value as coding or the pixel of most basic element of decoding or a pixel component or an index pixel, is the most also commonly referred to as a pixel value, or is simply referred as a sample value.
In the present invention and present patent application, " pixel sample value ", " pixel value ", " sample value ", " index pixel ", " pixel index " are synonyms, based on context, can clearly represent " pixel " or represent " pixel component " or represent " index pixel " or represent that three's is arbitrary simultaneously.If can not be clear and definite from context, then be exactly to represent that three's is arbitrary simultaneously.
In the present invention and present patent application, the region that encoding block or solution code block (being referred to as encoding and decoding block) are made up of some pixel values.The shape of encoding and decoding block can be rectangle, square, parallelogram, trapezoidal, polygon, circle, ellipse and other are variously-shaped.Rectangle also includes width or the rectangle deteriorating to line (i.e. line segment or linear) that height is a pixel value.In one two field picture, each encoding and decoding block can have different shapes and sizes.In one two field picture, some or all encoding and decoding block can overlap each other part, it is also possible to all encoding and decoding block all non-overlapping copies.One encoding and decoding block, can be made up of " pixel ", it is also possible to be made up of " component of pixel ", it is also possible to be made up of " index pixel ", it is also possible to be made up of this mixing, it is also possible to be made up of any 2 kinds of mixing in this.From encoding video pictures or the angle of decoding, encoding and decoding block refers to, in a two field picture, it is implemented coding or a region of decoding, include but not limited to following at least one: maximum coding unit LCU, code tree unit CTU, the subregion of coding unit CU, CU, predicting unit PU, converter unit TU.
One distinguishing feature of computer screen image is generally to have the most identical the most similar pixel pattern (pixel in same two field picture
Pattern).Such as, the Chinese often occurred in computer screen image or foreign language, it is all to be made up of a few basic strokes, the most similar or identical stroke in same two field picture, can be found.Menu common in computer screen image, icon etc., it may have the most similar or identical pattern.Therefore, existing image and video compression technology generally use various copy modes, at least include following copy mode:
1)
The i.e. intra block of intra block duplication mates or claims intra frame motion compensation or claims Block-matching or claim block to replicate.The elementary operation of block replica code or decoding is to a present encoding block or currently to solve code block (referred to as current block), from the reference block replicating onesize with current block the number of pixel sample value (as) in reconstructed reference pixel sample value collection, and the numerical value assignment of described reference block is given current block.The duplication parameter of block copy mode includes the displacement vector of current block, represents the relative position between reference block and current block.One current block has a displacement vector.
2)
In frame, in microlith duplication i.e. frame, microlith coupling or title microlith coupling or title microlith replicate.In microlith replicates, one current block (such as 8x8 pixel sample value) is divided into several microlith (such as the microlith of 4x2 pixel sample value or the microlith of 8x2 pixel sample value or the microlith of 2x4 pixel sample value or the microlith of 2x8 pixel sample value), the elementary operation of microlith replica code or decoding is to each the coding microlith in current block or decoding microlith (referred to as current microlith), in reconstructed reference pixel sample value collection, replicate a reference microlith, and the described numerical value assignment with reference to microlith is given current microlith.The duplication parameter of microlith copy mode includes the displacement vector of current microlith, represents with reference to the relative position between microlith with current microlith.One current microlith has a displacement vector.One current block is divided into how many microliths just how many displacement vectors.
3)
In frame, in lines (abbreviation bar) duplication i.e. frame, bar coupling or title bar coupling or title bar replicate.Bar is that height is 1 or width is the microlith of 1, such as 4x1 or 8x1 or the microlith of 1x4 or 1x8 pixel sample value.The elementary operation of bar replica code or decoding is to each encoding strip in current block or to solve code-bar (referred to as working as preceding article), replicates a reference bar, and the numerical value assignment of described reference bar given and work as preceding article in reconstructed reference pixel sample value collection.Obviously, bar duplication is a kind of special circumstances that microlith replicates.The duplication parameter of bar copy mode includes the displacement vector when preceding article, represents reference bar and the relative position between preceding article.One has a displacement vector when preceding article.One current block is divided into how many bars just how many displacement vectors.
4)
In frame, in string duplication i.e. frame, String matching or title String matching or title string replicate or claim the duplication of pixel string.In pixel string replicates, current to a present encoding block or one solution code block (referred to as current block) is divided into several adjustable length pixel sample value string.Here string refers to the pixel sample value in the 2 dimensional region of an arbitrary shape to be arranged in the length string (as width is 1 pixel sample value and the string of a length of 37 pixel sample values or width are 2 pixel sample values and the string of a length of 111 pixel sample values, be typically but not limited to that length is an absolute coding or decoding parametric and width is a parameter that is predetermined or that derived) much larger than width by other codings or decoding parametric.The elementary operation of string replica code or decoding is to each coded strings in current block or to solve sequence (the most currently string), replicates a reference strings, and the numerical value assignment of described reference strings is given current string in reconstructed reference pixel sample value collection.The duplication parameter of string copy mode includes that the displacement vector currently gone here and there and duplication length i.e. replicate size, represents the relative position between reference strings with current string and the current length i.e. number of pixel sample value gone here and there respectively.The length of current string is also the length of reference strings.One current string has a displacement vector and a duplication length.One current block is divided into how many strings just how many displacement vectors and how many duplication length.Displacement vector is also referred to as duplicating position, and its form of expression has: 2 dimension coordinates, linear address, distance, pointer, index, number, mode number etc..
5)
Palette index string duplication i.e. palette or title index string replicate.In palette coding and corresponding decoding process, first construct or obtain a palette, then the index of present encoding block or the part or all of pixel palette currently solving code block (referred to as current block) is showed, again index encoded and decode, include but not limited to: the index of a current block is divided into several adjustable length index string, is i.e. indexed string replica code and decoding.The elementary operation of index string replica code or decoding is that each the index coded strings in current block or index are solved sequence (the most currently indexing string), in the reconstructed reference pixel sample value collection of indexation, replicate a reference key string, and the index numerical value assignment of described reference key string is given currently index string.The duplications parameter of index string copy mode includes currently indexing the displacement vector of string and replicates length and i.e. replicate size, represents the number of pixel sample value corresponding to length that the relative position between reference key string and current index string and current index are gone here and there respectively.The length of current index string is also the length of reference key string.One current index string has a displacement vector and a duplication length.One current block is divided into how many index strings just how many displacement vectors and how many duplication length.Displacement vector is also referred to as duplicating position, and its form of expression has: 2 dimension coordinates, linear address, distance, pointer, index, number, mode number etc..In palette index string copy mode, the reference pixel of duplication takes from palette.So, index string also referred to as palette of colors string or palette pixel string or palette string, index string copy mode is also referred to as palette mode.In palette mode, the string also referred to as distance of swimming or stroke.Therefore, the index string also referred to as index distance of swimming or index stroke or the referred to as distance of swimming or stroke.
6)
Index string replicates and replicates the fusion copy mode mixed with pixel string, and abbreviation index-pixel string merges copy mode, also referred to as palette-pixel string and merges copy mode or merge palette mode or the pixel string copy mode of fusion palette that pixel string replicates.To a present encoding block or currently solve code block (referred to as current block) encode or decode time, part or all of pixel uses pixel string copy mode, and part or all of pixel uses index string copy mode i.e. reference pixel to take from the palette mode of palette.
Other copy mode also includes rectangle copy mode and the copy mode etc. of several copy mode mixing.
Block in block copy mode, the microlith in microlith copy mode, the bar in bar copy mode, the string in string copy mode, the rectangle in rectangle copy mode, the pixel index string in palette indexed mode, it is referred to as pixel sample value section, is called for short sample value section.The basic component of sample value section is pixel or pixel component or pixel index.One sample value Duan Youyi replicates parameter, is used for representing the relation between current pixel sample value section and reference pixel sample value section.Therefore, a sample value section is the least unit once replicating operation with same replication relation.One is replicated parameter and includes some duplication parametric component, replicate parametric component at least to include: displacement vector horizontal component, displacement vector vertical component, 1 dimension displacement vector, linear address, opposite linear address, index, palette linear address, relative indexing, palette opposite linear address, duplication length, duplication width, duplication height, rectangle width, rectangle length, non-matched pixel (also known as without reference pixel, be not the most from the not replicated pixel replicated elsewhere).
In various copy modes, pixel sample value or index need according to a definite sequence arrangement.Arrangement mode is also referred to as scan mode.Scan mode, according to its path shape, can be divided into following several:
A) horizontal zigzag scan mode is also known as horizontal raster scan mode.One encoding block or solve pixel sample value or the index of code block (being referred to as encoding and decoding block), a line a line arranges, all according to same direction (the most from left to right or all the most from right to left) arrangement in all of row.Can arrange from the top down between row and row, it is also possible to arrange from bottom to top.
B) vertical Z shape scan mode is also known as vertical raster scan mode.One encoding block or solve pixel sample value or the index of code block (being referred to as encoding and decoding block), string string arranges, all according to same direction (the most from the top down or all the most from bottom to top) arrangement in all of row.Can arrange from left to right between the column and the column, it is also possible to arrange from right to left.
C) horizontal arcuate scanning mode.One encoding block or solve code block (being referred to as encoding and decoding block) pixel sample value or index, a line a line arrange, in odd-numbered line according to a direction (such as: from left to right) arrangement and in even number line according to another (on the contrary) direction (such as: from right to left) arrange.Can arrange from the top down between row and row, it is also possible to arrange from bottom to top.
D) vertical arcuate scan mode.One encoding block or solve code block (being referred to as encoding and decoding block) pixel sample value or index, string string arrange, in odd column according to a direction (such as: from the top down) arrangement and in even column according to another (on the contrary) direction (such as: from bottom to top) arrange.Can arrange from left to right between the column and the column, it is also possible to arrange from right to left.
String replicates in (index string duplication or pixel string replicates or index string-pixel string fusion replicates) mode, and substantially replicating shape has following 2 kinds:
I) one-dimensional linear replicates shape.Current string and reference strings are all the one-dimensional sample value strings formed according to the order arrangement of predetermined scan mode in each encoding and decoding block, have equal length, but the 2 dimensional region of each self-forming of the two string not necessarily has identical two-dimensional shapes.
II) two-dimentional conformal duplication shape.Currently go here and there in current codec block according to predetermined scan mode order arrange.Reference strings keeps identical two-dimensional shapes with current string, has equal length.
Every kind of basic duplication shape can be subdivided into multiple duplication shape according to concrete scan mode again above, as vertical arcuate one-dimensional linear replicates shape, the Z-shaped two dimension of level conformal duplication shape, etc..
It should be noted that " duplication " is reconstruct and the operation of decoding, corresponding encoding operation is " coupling ".Therefore, also referred to as Block-matching mode, microlith matching way, lines matching way, pixel String matching mode, the index String matching mode etc. such as various copy modes such as Block-matching mode, microlith copy mode, lines copy mode, pixel string copy mode, index string copy mode.
In existing various copy mode, compression effectiveness most preferably indexes string-pixel string fusion copy mode and i.e. merges the pixel string copy mode of palette.But the index string-pixel string in prior art merges in copy mode, there is the problem that integration program is single, quite a few is had the image of abundant content, and compression efficiency is the highest.
Summary of the invention
In order to solve this problem of the prior art of image/video coding and decoding, the invention provides a kind of index string-pixel string using at least two different and merge the picture coding of copy mode and the method or apparatus of decoding.That is, in a two field picture, part encoding and decoding block uses the index string-pixel string of integration program I to merge copy mode, part encoding and decoding block uses the index string-pixel string of integration program II to merge copy mode, part encoding and decoding block uses the index string-pixel string of integration program III to merge copy mode, etc..Preferably, the difference of different integration programs is to index the difference of the character of the difference of the character of string and/or pixel string.Preferably, described character is one or a combination set of following properties: the 1) number of kind, 2) span of parameter, 3) span of one or several duplication parameters, 4) the duplicating position i.e. span of displacement vector, 5) current index or the position of current pixel, the 6) position of current sample section, 7) reference key or the position of reference pixel, 8) with reference to the position of sample value section；9) shape is replicated.Preferably, the described character of integration program I is one of described characteristic or a kind of combination, and the described character of integration program II is another or another kind of combination of described characteristic.Preferably, the described character of integration program I is the position of reference key or reference pixel, and the described character of integration program II is the span of displacement vector.Preferably, the position of the reference key indexing string in integration program I is location sets A1And the position of the reference pixel of pixel string is location sets B1, the span of the displacement vector indexing string in integration program II is displacement vector set C2And the span of the displacement vector of pixel string is displacement vector set D2.Preferably, the span of the displacement vector indexing string in integration program I is displacement vector set E1And the span of the displacement vector of pixel string is displacement vector set F1, the span of the displacement vector indexing string in integration program II is displacement vector set G2And the span of the displacement vector of pixel string is displacement vector set H2.Preferably, the number of the desirable duplicating position indexing string in integration program I is I1And the number of the desirable duplicating position of pixel string is J1, the number of the desirable duplicating position indexing string in integration program II is I2And the number of the desirable duplicating position of pixel string is J2.Preferably, multiple index string-pixel string fusion copy mode in a kind of be simple index string copy mode i.e. palette mode.According to the present invention, the two kinds of index string with different integration program-pixel strings are at least used to merge copy mode.According to the present invention, the most individual present encoding block using multiple index string-pixel string to merge copy mode adaptively carries out replica code and replicates decoding accordingly.
The primary technical characteristic of the present invention is to use multiple (i.e. two kinds or more than) index string-pixel string fusion copy mode.
In the present invention, it is preferable that described multiple index string-pixel string fusion copy mode in each of all there is integration program alone.
In the present invention, it is preferable that described multiple index string-pixel string fusion copy mode in a kind of be simple index string copy mode i.e. palette mode.
In the present invention, it is preferable that described multiple index string-pixel string fusion copy mode in a kind of be simple pixel string copy mode.
In the present invention, it is preferable that described multiple index string-pixel string merge in copy mode a kind of be index string-pixel string fusion copy mode of single pixel string kind.
In the present invention, it is preferable that described multiple index string-pixel string merge in copy mode a kind of be index string-pixel string fusion copy mode of single index string kind.
The coded method of the present invention or the most basic peculiar technical characteristic of device are that the most individual present encoding block being adaptive selected predetermined multiple index string-pixel string fusion copy mode carries out replica code, and generation at least merges the copy mode of copy mode and the video code flow of the information of duplication parameter thereof containing multiple index string-pixel string.Fig. 1 is coded method or a schematic diagram of device of the present invention.Preferably, described multiple index string-pixel string fusion copy mode in each of all there is integration program alone.Preferably, described multiple index string-pixel string fusion copy mode in a kind of be simple index string copy mode i.e. palette mode.Preferably, described multiple index string-pixel string fusion copy mode in a kind of be simple pixel string copy mode.Preferably, described multiple index string-pixel string merge in copy mode a kind of be index string-pixel string fusion copy mode of single pixel string kind.Preferably, described multiple index string-pixel string merge in copy mode a kind of be index string-pixel string fusion copy mode of single index string kind.
The coding/decoding method of the present invention or the most basic peculiar technical characteristic of device are to resolve video code flow, obtain the information of copy mode, carry out replicating decoding according to the most individual current solution code block that the information of described copy mode uses predetermined multiple index string-pixel string to merge copy mode.Fig. 2 is coding/decoding method or a schematic diagram of device of the present invention.Preferably, described multiple index string-pixel string fusion copy mode in each of all there is integration program alone.Preferably, described multiple index string-pixel string fusion copy mode in a kind of be simple index string copy mode i.e. palette mode.Preferably, described multiple index string-pixel string fusion copy mode in a kind of be simple pixel string copy mode.Preferably, described multiple index string-pixel string merge in copy mode a kind of be index string-pixel string fusion copy mode of single pixel string kind.Preferably, described multiple index string-pixel string merge in copy mode a kind of be index string-pixel string fusion copy mode of single index string kind.
According to an aspect of the invention, it is provided a kind of method for encoding images or device, at least include following function and the step of operation or module:
The most individual present encoding block being adaptive selected predetermined multiple index string-pixel string fusion copy mode carries out replica code, produces and at least merges the copy mode of copy mode and the video code flow of the information of duplication parameter thereof containing multiple index string-pixel string.
According to another aspect of the present invention, additionally provide a kind of picture decoding method or device, at least include following function and the step of operation or module:
Resolve video code flow, obtain the information of copy mode, carry out replicating decoding according to the most individual current solution code block that the information of described copy mode uses predetermined multiple index string-pixel string to merge copy mode.
The present invention is applicable to coding and the decoding of folded bag format-pattern.Present invention is equally applicable to coding and the decoding of component planar format image.
Technical characteristic above by some specific instantiations explanation present invention.Those skilled in the art can be understood other advantages and effect of the present invention easily by content disclosed in the present specification.The present invention can also be carried out by the most different detailed description of the invention or apply, and the every details in this specification can also carry out various modification or change based on different viewpoints and application under the spirit without departing substantially from the present invention.
The following is more implementation detail or the variant of the present invention.
Implement or variant example 1
In described coded method or device or coding/decoding method or device, described multiple index string-pixel string fusion copy mode is respectively adopted multiple different integration program.
Implement or variant example 2
In described coded method or device or coding/decoding method or device, at least use two kinds of index strings with different integration program-pixel strings fusion copy mode.
Implement or variant example 3
In described coded method or device or coding/decoding method or device, the most individual present encoding block of multiple index string-pixel string fusion copy mode is used to carry out replica code and replicate decoding accordingly adaptively.
Implement or variant example 4
In described coded method or device or coding/decoding method or device, the difference that described multiple index string-pixel string merges the different integration programs that copy mode is respectively adopted is the difference of the character that index goes here and there and/or the difference of the character of pixel string.
Implement or variant example 5
In described coded method or device or coding/decoding method or device, described multiple index string-pixel string merges the different integration programs that copy mode is respectively adopted and merges index string and pixel string according to the heterogeneity of string (index string and pixel string are referred to as string) respectively.
Implement or variant example 6
In described coded method or device or coding/decoding method or device, described multiple index string-pixel string merges the character of the string involved by different integration programs that copy mode is respectively adopted and/or index is gone here and there character and/or the character of pixel string are one or a combination set of following properties:
1) number of kind；
2) span of parameter；
3) span of one or several duplication parameters；
4) the duplicating position i.e. span of displacement vector；
5) current index or the position of current pixel；
6) position of current sample section；
7) reference key or the position of reference pixel；
8) with reference to the position of sample value section；
9) shape is replicated.
Implement or variant example 7
Implementing or in coded method or device described in variant example 3 or coding/decoding method or device, the described character of a kind of integration program I is one of described characteristic or a kind of combination, the described character of another kind of integration program II is another or another kind of combination of described characteristic.
Implement or variant example 8
In described coded method or device or coding/decoding method or device,
The integration program that described multiple index string-pixel string merges the employing of one of copy mode merges index according to the position of reference key or reference pixel goes here and there and pixel string:
The integration program of two employings that described multiple index string-pixel string merges copy mode merges index string and pixel string according to the span of displacement vector.
Implement or variant example 9
In described coded method or device or coding/decoding method or device,
Described multiple index string-pixel string merges in the integration program that one of copy mode uses, and the position of the reference key of index string is location sets A1And the position of the reference pixel of pixel string is location sets B1:
Described multiple index string-pixel string merges in the integration program of two employings of copy mode, and the span of the displacement vector of index string is displacement vector set C2And the span of the displacement vector of pixel string is displacement vector set D2。
Implement or variant example 10
In described coded method or device or coding/decoding method or device,
Described multiple index string-pixel string merges in the integration program that one of copy mode uses, and the span of the displacement vector of index string is displacement vector set E1And the span of the displacement vector of pixel string is displacement vector set F1:
Described multiple index string-pixel string merges in the integration program of two employings of copy mode, and the span of the displacement vector of index string is displacement vector set G2And the span of the displacement vector of pixel string is displacement vector set H2。
Implement or variant example 11
In described coded method or device or coding/decoding method or device,
Described multiple index string-pixel string merges in the integration program that one of copy mode uses, and the number of the desirable duplicating position of index string is I1And the number of the desirable duplicating position of pixel string is J1:
Described multiple index string-pixel string merges in the integration program of two employings of copy mode, and the number of the desirable duplicating position of index string is I2And the number of the desirable duplicating position of pixel string is J2。
Implement or variant example 12
In described coded method or device or coding/decoding method or device, all there is integration program alone each of in described multiple index string-pixel string fusion copy mode.
Implement or variant example 13
In described coded method or device or coding/decoding method or device, one of described multiple index string-pixel string fusion copy mode is simple index string copy mode i.e. palette mode.
Implement or variant example 14
In described coded method or device or coding/decoding method or device, one of described multiple index string-pixel string fusion copy mode is simple pixel string copy mode.
Implement or variant example 15
In described coded method or device or coding/decoding method or device, described multiple index string-pixel string merges index string-pixel string fusion copy mode that one of copy mode is single pixel string kind.
Implement or variant example 16
In described coded method or device or coding/decoding method or device, described multiple index string-pixel string merges index string-pixel string fusion copy mode that one of copy mode is single index string kind.
Implement or variant example 17
In described coded method or device or coding/decoding method or device,
Described multiple index string-pixel string merges in the integration program that one of copy mode uses, the inside that position is current codec block of the reference key that index is gone here and there and the outside that position is current codec block of the reference pixel of pixel string:
Described multiple index string-pixel string merges in the integration program of two employings of copy mode, the span of duplicating position of index string is predetermined some (typically less than five) duplicating position, and the span of the displacement vector of pixel string is all legal displacement vector in a predetermined region.
Implement or variant example 18
In described coded method or device or coding/decoding method or device,
Described multiple index string-pixel string merges in the integration program that one of copy mode uses, and the reference key of index string is positioned at that current codec block is internal and the reference pixel of pixel string is positioned at string or a line of current codec block outside direct neighbor:
Described multiple index string-pixel string merges in the integration programs of two employings of copy mode, and the span of duplicating position of index string is single to replicate that prior location also referred to as replicates left position and the span of the displacement vector of pixel string is the displacement vector meeting following condition: reference strings is integrally located at current CTU and usual 1≤K≤4 of left side K() in the region that forms of individual CTU.
Implement or variant example 19
In described coded method or device or coding/decoding method or device, the encoding and decoding build of the video code flow of described current codec block has a direct or indirect proprietary bit,
If described proprietary bit takes a value, then
{
Current codec block described in a pair of multiple index string-pixel string fusion copy mode is used to carry out encoding and decoding
}
Otherwise, described proprietary bit takes another value, then
{
Use multiple index string-pixel string to merge the two of copy mode and described current codec block is carried out encoding and decoding
}
The most proprietary described bit is the proprietary bit derived from other syntactic elements of other codec parameters and/or video code flow.
Implement or variant example 20
In described coded method or device or coding/decoding method or device, there are enabler flags positions of one or more index string-pixel strings fusion copy modes in one of following place of described video code flow or some places:
1) sequence parameter set；It is typically to be a direct existence of sequence parameter set or the implicit syntactic element derived；
2) picture parameter set；It is typically a direct existence of picture parameter set or the implicit syntactic element derived；
3) slice header；It is typically a direct existence of slice header or the implicit syntactic element derived；
4) CTU head；It is typically a direct existence of CTU head or the implicit syntactic element derived；
5) CU head；It is typically a direct existence of CU head or the implicit syntactic element derived；
6) encoding and decoding build；It is typically a direct existence of encoding and decoding build or the implicit syntactic element derived.
Implement or variant example 21
In described coded method or device or coding/decoding method or device, the video code flow of described current codec block contains the most following syntactic element:
Encoding and decoding build information, index string-pixel string merge copy mode flag bit, more encoding and decoding build information, encoding and decoding blocks of data；
Wherein, when index string-pixel string fusion copy mode flag bit takes a value, use integration program I that described current codec block carries out encoding and decoding, when index string-pixel string fusion copy mode flag bit takes another value, use integration program II that described current codec block is carried out encoding and decoding.
Accompanying drawing explanation
Fig. 1 is coded method or a schematic diagram of device of the present invention.
Fig. 2 is coding/decoding method or a schematic diagram of device of the present invention.
Claims (10)
1. a method for encoding images or device, it is characterised in that at least included following function and the step of operation or module:
The most individual present encoding block being adaptive selected predetermined multiple index string-pixel string fusion copy mode carries out replica code, produces and at least merges the copy mode of copy mode and the video code flow of the information of duplication parameter thereof containing multiple index string-pixel string.
2. a picture decoding method or device, it is characterised in that at least included following function and the step of operation or module:
Resolve video code flow, obtain the information of copy mode, carry out replicating decoding according to the most individual current solution code block that the information of described copy mode uses predetermined multiple index string-pixel string to merge copy mode.
Coded method the most according to claim 1 or device or coding/decoding method according to claim 2 or device, it is characterised in that:
Described encoding block or described solution code block are a coding region of image or a decoding region, including following at least one: maximum coding unit LCU, code tree unit CTU, the subregion of coding unit CU, CU, predicting unit PU, converter unit TU.
Coded method the most according to claim 1 or device or coding/decoding method according to claim 2 or device, it is characterised in that:
Described multiple index string-pixel string merges copy mode and is respectively adopted multiple different integration program；
Or
The two kinds of index string with different integration program-pixel strings are at least used to merge copy mode.
Coded method the most according to claim 1 or device or coding/decoding method according to claim 2 or device, it is characterised in that:
The different integration programs that described multiple index string-pixel string fusion copy mode is respectively adopted merge index string and pixel string according to the heterogeneity of string respectively.
Coded method the most according to claim 1 or device or coding/decoding method according to claim 2 or device, it is characterised in that:
Described multiple index string-pixel string merges the character of the string involved by different integration programs that copy mode is respectively adopted and/or the character of the character of index string and/or pixel string is one or a combination set of following properties:
The number of kind；
The span of parameter；
The span of one or several duplication parameters；
The duplicating position i.e. span of displacement vector；
Current index or the position of current pixel；
The position of current sample section；
Reference key or the position of reference pixel；
Position with reference to sample value section；
Replicate shape.
Coded method the most according to claim 1 or device or coding/decoding method according to claim 2 or device, it is characterised in that:
The integration program that described multiple index string-pixel string merges the employing of one of copy mode merges index according to the position of reference key or reference pixel goes here and there and pixel string:
The integration program of two employings that described multiple index string-pixel string merges copy mode merges index string and pixel string according to the span of displacement vector.
Coded method the most according to claim 1 or device or coding/decoding method according to claim 2 or device, it is characterised in that:
Described multiple index string-pixel string merges in the integration program that one of copy mode uses, and the reference key of index string is positioned at that current codec block is internal and the reference pixel of pixel string is positioned at string or a line of current codec block outside direct neighbor:
Described multiple index string-pixel string merges in the integration programs of two employings of copy mode, and the span of duplicating position of index string is single to replicate that prior location also referred to as replicates left position and the span of the displacement vector of pixel string is the displacement vector meeting following condition: reference strings is integrally located at current CTU and usual 1≤K≤4 of left side K() in the region that forms of individual CTU.
Coded method the most according to claim 1 or device or coding/decoding method according to claim 2 or device, it is characterised in that:
One of following place at described video code flow or some places exist one or more index string-pixel strings fusion copy modes enabler flags positions:
1) sequence parameter set；
2) picture parameter set；
3) slice header；
4) CTU head；
5) CU head；
6) encoding and decoding build.
Coded method the most according to claim 1 or device or coding/decoding method according to claim 2 or device, it is characterised in that:
The video code flow of described current codec block contains the most following syntactic element:
Encoding and decoding build information, index string-pixel string merge copy mode flag bit, more encoding and decoding build information, encoding and decoding blocks of data；
Wherein, when index string-pixel string fusion copy mode flag bit takes a value, use integration program I that described current codec block carries out encoding and decoding, when index string-pixel string fusion copy mode flag bit takes another value, use integration program II that described current codec block is carried out encoding and decoding.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510308134.4A CN106303534B (en) | 2015-06-08 | 2015-06-08 | Image compression method and device for multiple index string and pixel string fusion copy modes |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510308134.4A CN106303534B (en) | 2015-06-08 | 2015-06-08 | Image compression method and device for multiple index string and pixel string fusion copy modes |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN106303534A true CN106303534A (en) | 2017-01-04 |
| CN106303534B CN106303534B (en) | 2022-05-31 |
Family
ID=57659855
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201510308134.4A Active CN106303534B (en) | 2015-06-08 | 2015-06-08 | Image compression method and device for multiple index string and pixel string fusion copy modes |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106303534B (en) |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2020216294A1 (en) * | 2019-04-25 | 2020-10-29 | 华为技术有限公司 | Image prediction method and apparatus, and computer-readable storage medium |
| CN112204962A (en) * | 2019-04-25 | 2021-01-08 | 华为技术有限公司 | Image prediction method, apparatus and computer-readable storage medium |
| CN112672160A (en) * | 2020-12-17 | 2021-04-16 | 绍兴文理学院 | Coding and decoding method and device for fusing intra-frame block copy and string copy coding parameters |
| RU2810126C2 (en) * | 2019-04-25 | 2023-12-22 | Хуавэй Текнолоджиз Ко., Лтд. | Method and device for image prediction and computer readable data medium |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JPH08317384A (en) * | 1995-05-17 | 1996-11-29 | Hitachi Ltd | Information processing system |
| CN1859571A (en) * | 2006-06-01 | 2006-11-08 | 上海交通大学 | Screen coding method under low code rate |
| CN101645173A (en) * | 2008-12-16 | 2010-02-10 | 中国科学院声学研究所 | Random palette coding system and method |
| US20130028324A1 (en) * | 2011-07-29 | 2013-01-31 | National Chiao Tung University | Method and device for decoding a scalable video signal utilizing an inter-layer prediction |
| CN104301737A (en) * | 2013-07-15 | 2015-01-21 | 华为技术有限公司 | Decoding method and encoding method for target image block and decoder and encoder |
| CN104539949A (en) * | 2014-12-12 | 2015-04-22 | 北方工业大学 | HEVC screen coding quick slicing based on edge directions |
| CN105594211A (en) * | 2013-11-27 | 2016-05-18 | 联发科技（新加坡）私人有限公司 | Method of video coding using prediction based on intra picture block copy |
-
2015
- 2015-06-08 CN CN201510308134.4A patent/CN106303534B/en active Active
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JPH08317384A (en) * | 1995-05-17 | 1996-11-29 | Hitachi Ltd | Information processing system |
| CN1859571A (en) * | 2006-06-01 | 2006-11-08 | 上海交通大学 | Screen coding method under low code rate |
| CN101645173A (en) * | 2008-12-16 | 2010-02-10 | 中国科学院声学研究所 | Random palette coding system and method |
| US20130028324A1 (en) * | 2011-07-29 | 2013-01-31 | National Chiao Tung University | Method and device for decoding a scalable video signal utilizing an inter-layer prediction |
| CN104301737A (en) * | 2013-07-15 | 2015-01-21 | 华为技术有限公司 | Decoding method and encoding method for target image block and decoder and encoder |
| CN105594211A (en) * | 2013-11-27 | 2016-05-18 | 联发科技（新加坡）私人有限公司 | Method of video coding using prediction based on intra picture block copy |
| CN104539949A (en) * | 2014-12-12 | 2015-04-22 | 北方工业大学 | HEVC screen coding quick slicing based on edge directions |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2020216294A1 (en) * | 2019-04-25 | 2020-10-29 | 华为技术有限公司 | Image prediction method and apparatus, and computer-readable storage medium |
| CN112204962A (en) * | 2019-04-25 | 2021-01-08 | 华为技术有限公司 | Image prediction method, apparatus and computer-readable storage medium |
| CN112204962B (en) * | 2019-04-25 | 2021-10-22 | 华为技术有限公司 | Image prediction method, apparatus and computer-readable storage medium |
| RU2810126C2 (en) * | 2019-04-25 | 2023-12-22 | Хуавэй Текнолоджиз Ко., Лтд. | Method and device for image prediction and computer readable data medium |
| CN112672160A (en) * | 2020-12-17 | 2021-04-16 | 绍兴文理学院 | Coding and decoding method and device for fusing intra-frame block copy and string copy coding parameters |
| CN112672160B (en) * | 2020-12-17 | 2023-10-10 | 绍兴文理学院 | Encoding and decoding method and device for fusing intra-frame block copy and string copy encoding parameters |
Also Published As
| Publication number | Publication date |
|---|---|
| CN106303534B (en) | 2022-05-31 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN105704491B (en) | Image encoding method, decoding method, encoding device, and decoding device | |
| CN111800640B (en) | Method and device for encoding and decoding image by alternately changing direction and back-and-forth scanning string matching | |
| CN105491376B (en) | Image coding and decoding method and device | |
| CN106797468B (en) | Efficient video coding (HEVC) screen content encodes improved pallet mode in (SCC) | |
| CN105847842B (en) | Image encoding method and device, and image decoding method and device | |
| CN104853211A (en) | Image compression method and apparatus employing various forms of reference pixel storage spaces | |
| CN104427338A (en) | Image compression method and device with block matching | |
| KR101946598B1 (en) | Image coding and decoding method and device | |
| CN104754362A (en) | Image compression method using fine division block matching | |
| US11653019B2 (en) | Image coding and decoding methods, image processing device and computer storage medium | |
| CN106254865A (en) | A kind of picture coding and coding/decoding method, image processing equipment | |
| CN104581177A (en) | Image compression method and device combining block matching with string matching | |
| EP3310059A1 (en) | Image encoding and decoding method, image processing device, and computer storage medium | |
| KR102532391B1 (en) | Video encoding method and apparatus and video decoding method and apparatus | |
| CN104811731A (en) | Multilayer sub-block matching image compression method | |
| CN106303534A (en) | Multiple index string and pixel string merge method for compressing image and the device of copy mode | |
| CN105992003A (en) | Method and device for image compression of palette color number based on order or frequency | |
| WO2016202189A1 (en) | Image coding and decoding methods, image processing device, and computer storage medium | |
| CN106303535A (en) | Reference pixel takes from method for compressing image and the device of reconstructed pixel in various degree | |
| CN110505488B (en) | Image coding or decoding method for expanding prediction pixel array | |
| WO2016197893A1 (en) | Image encoding and decoding method, image processing device, and computer storage medium | |
| WO2016119746A1 (en) | Image coding method and apparatus, and image decoding method and apparatus | |
| CN105828080A (en) | Method and device for coding and decoding image | |
| CN104581186B (en) | Method for coding and decoding intra-frame motion vector in image compression | |
| CN115037927A (en) | Image coding and decoding method fusing full chroma and mixed chroma and application thereof |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |