CN104581177A - Image compression method and device combining block matching with string matching - Google Patents
Image compression method and device combining block matching with string matching Download PDFInfo
- Publication number
- CN104581177A CN104581177A CN201310475108.1A CN201310475108A CN104581177A CN 104581177 A CN104581177 A CN 104581177A CN 201310475108 A CN201310475108 A CN 201310475108A CN 104581177 A CN104581177 A CN 104581177A
- Authority
- CN
- China
- Prior art keywords
- microlith
- string
- sample value
- coupling
- pixel sample
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 28
- 238000007906 compression Methods 0.000 title abstract description 10
- 230000006835 compression Effects 0.000 title abstract description 10
- 230000008878 coupling Effects 0.000 claims description 105
- 238000010168 coupling process Methods 0.000 claims description 105
- 238000005859 coupling reaction Methods 0.000 claims description 105
- 239000013598 vector Substances 0.000 claims description 49
- 238000005516 engineering process Methods 0.000 claims description 20
- 230000003044 adaptive effect Effects 0.000 claims description 16
- 230000000694 effects Effects 0.000 claims description 9
- 238000001914 filtration Methods 0.000 claims description 8
- 238000013139 quantization Methods 0.000 claims description 8
- 230000009466 transformation Effects 0.000 claims description 8
- 238000004364 calculation method Methods 0.000 claims description 6
- 230000013011 mating Effects 0.000 claims description 5
- 238000006243 chemical reaction Methods 0.000 claims description 4
- 238000011002 quantification Methods 0.000 claims description 4
- 239000000523 sample Substances 0.000 description 84
- 239000000203 mixture Substances 0.000 description 7
- 238000010586 diagram Methods 0.000 description 6
- 230000005540 biological transmission Effects 0.000 description 4
- 239000013074 reference sample Substances 0.000 description 4
- 230000008859 change Effects 0.000 description 2
- 238000005070 sampling Methods 0.000 description 2
- 241000023320 Luma <angiosperm> Species 0.000 description 1
- 238000013144 data compression Methods 0.000 description 1
- 239000000463 material Substances 0.000 description 1
- OSWPMRLSEDHDFF-UHFFFAOYSA-N methyl salicylate Chemical compound COC(=O)C1=CC=CC=C1O OSWPMRLSEDHDFF-UHFFFAOYSA-N 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
Landscapes
- Compression Or Coding Systems Of Tv Signals (AREA)
Abstract
The invention provides an image compression method and device. When a coding unit is used for coding, one or more optimal micro-block matching strings are searched and obtained with micro blocks containing at least two pixel sample values as basic matching units according to a preset assessment criterion in a reconstructed reference pixel sample value set, and the relative positions of the micro-block matching strings and the number of the micro blocks are recorded in a compression code stream. The relative positions of the micro-block matching strings and the number of the micro blocks are read out from the code stream on by one during decoding, so a pixel sample value of the current encoding unit is obtained through restoration.
Description
Technical field
The present invention relates to a kind of compression of digital video coding and the coding of decode system, particularly computer screen image and video and the method and apparatus of decoding.
Background technology
Along with taking remote desktop as the cloud computing of new generation of classic manifestations and the development of messaging model and platform and universal, interconnected between multiple stage computer, between other digital devices such as main frame and intelligent television, smart mobile phone, panel computer and between various all kinds of digital device has become a reality and has increasingly become a kind of main trend.This makes server end (cloud) become current active demand to the real time screen transmission of user side.Owing to needing the screen video data volume of transmission very large, for panel computer 2048x1536 pixel resolution and 60 frames/second refresh rate 24 true color screen pictures, the data of transmission are needed to reach 2048x1536x60x24=4320 megabit per second, it is impossible that so many data want under the network condition of reality, realize real-time Transmission, and the effective data compression therefore for computer screen image is essential.
Making full use of the feature of computer screen image, computer screen image is carried out to the compression of Ultra-High Efficiency, is also up-to-date international video compression standards HEVC(High Efficiency Video Coding) a main target.
A distinguishing feature of computer screen image usually has much similar even identical pixel patterns (pixel pattern) in same two field picture.Such as, the Chinese of normal appearance in computer screen image or foreign language word, be all be made up of a few basic strokes, can find much similar or identical stroke in same two field picture.Menu common in computer screen image, icon etc., also have much similar or identical pattern.Infra-frame prediction (intra prediction) mode adopted in existing image and video compression technology, only with reference to adjacent pixel sample value, cannot utilize the similitude in a two field picture or homogeny to improve compression efficiency.Intra frame motion compensation of the prior art (intra motion compensation) mode copies (intra block copy) mode also referred to as intra block, by several fixed size (as 4x4,8x8,16x16,32x32,64x64 pixel) block carry out intra block coupling (intra block matching) coding, the coupling of various different size and shape can not be found.And another kind of String matching of the prior art (string matching) mode, although the coupling of various different size and shape effectively can be found, there is the problems such as complexity, amount of calculation, memory read/write bandwidth be all larger.Therefore, new coding tools must be sought, fully can excavate and utilize the similar or identical pattern existed in computer screen image, to increase substantially compression effectiveness, again complexity, amount of calculation, memory read/write bandwidth etc. all being controlled in less scope.
The natural form of the digital video signal of screen picture is the sequence of image.The rectangular area that piece image is normally made up of some pixels, if digital video signal is per second 50 width images, so one section of digital video signal of 30 minutes is exactly a sequence of video images be made up of 30x60x50=90000 width image, sometimes also referred to as video sequence or sequence.Digital encoding video signal is encoded to a width piece image exactly.
In up-to-date international video compression standards HEVC, when piece image is encoded, piece image is divided into the subgraph of some pieces of MxM pixels, is called " coding unit (Coding Unit is called for short CU) ", take CU as basic coding unit, subgraph one piece a piece is encoded.The size of conventional M is 4,8,16,32,64.Therefore, carry out coding to a sequence of video images to encode successively to each coding unit exactly.Equally, be also that each coding unit is decoded successively during decoding, finally reconstruct whole sequence of video images.
For adapting to the different of each several part picture material and character in piece image, carry out most efficient coding targetedly, in piece image, the size of each CU can be different, has plenty of 8x8, has plenty of 64x64, etc.In order to enable the CU of different size seamless spliced, piece image is always first divided into that size is identical to be had
nx
n" maximum coding unit (Largest Coding Unit is called for short LCU) " of pixel, then each LCU again Further Division become multiple phasing not of uniform size with CU.Such as, piece image is first divided into the LCU(of the identical 64x64 pixel of size
n=64).Wherein certain LCU is made up of the CU of CU and 4 16x16 pixel of 3 32x32 pixels.And another LCU is made up of the CU of CU and 20 8x8 pixel of the CU of 2 32x32 pixels, 3 16x16 pixels.Encoding to piece image, is exactly encode to CU one by one successively.
A color images have 3 component (component) compositions.The GBR color format that the most frequently used two kinds of pixel color forms (pixel color format) are made up of green component, blue component, red component and the YUV color format be made up of brightness (luma) component and two colourity (chroma) components also claim YCbCr color format.Therefore, when a CU is encoded, a CU can be divided into 3 component planes (G plane, B plane, R plane or Y plane, U plane, V plane), 3 component planes are encoded respectively; Also 3 of a pixel component binding combination can be become 3 tuples, the CU entirety be made up of these 3 tuples is encoded.The arrangement mode of front a kind of pixel and component thereof is called the planar format (planar format) of image (and CU), and then the arrangement mode of a kind of pixel and component thereof is called the stacked package form (packed format) of image (and CU).
YUV color format can be subdivided into several subformat according to whether carrying out down-sampling to chromatic component again: the YUV4:4:4 pixel color form that 1 pixel is made up of 1 Y-component, 1 U component, 1 V component; The YUV4:2:2 pixel color form that adjacent 2 pixels in left and right are made up of 2 Y-component, 1 U component, 1 V component; The YUV4:2:0 pixel color form that 4 pixels of the neighbouring 2x2 of the pressing spatial arrangements in left and right are made up of 4 Y-component, 1 U component, 1 V component.One-component generally represents by the numeral of 18 ~ 16 bit.YUV4:2:2 pixel color form and YUV4:2:0 pixel color form are all obtain the down-sampling of YUV4:4:4 pixel color form execution chromatic component.Pixel component is also referred to as a pixel sample value (pixel sample) or be called a sample value (sample) simply.
Intra block coupling (intra block matching, also claim intra frame motion compensation intra motion compensation or claim intra block to copy intra block copy) encoding is exactly when encoding to a CU, in certain predetermined hunting zone (search range) among the pixel of reconstructed reference sample value collection in same frame, search and described CU(are namely by match block) between the minimum match block (being called blocks and optimal matching blocks) of matching error, then write in compressed video stream by the relative position (calling that mobile vector and motion vector are called for short MV) between match block and blocks and optimal matching blocks.
Intra block matching and decoding is exactly when decoding to a CU, according to the MV parsed from compressed video stream, determine the position of the match block among the pixel of the reconstructed reference sample value collection in same frame, then described match block copy and paste to described CU(namely by match block) position.
In frame, String matching (intra string matching) coding is exactly when encoding to a CU, in certain predetermined hunting zone (search range) among the pixel of reconstructed reference sample value collection in same frame, search obtains the pixel sample value coupling string of the variable-length of one or more optimum, each coupling string a coupling relative position (being called that mobile vector and motion vector are called for short MV) and a matching length, namely a pair (mobile vector, matching length) characterizes.Then one or more pairs of (mobile vector, matching length) is write in compressed video stream.
In frame, String matching decoding is exactly when decoding to a CU, according to the one or more pairs of (mobile vectors parsed from compressed video stream, matching length), determine the position of the one or more pixel sample value coupling strings among the pixel of the reconstructed reference sample value collection in same frame, then the relative position (namely by the position of coupling string) of one or more described coupling string copy and paste to described CU.The pixel sample number of the coupling string of each copy and paste is exactly described matching length.Corresponding is also had identical described matching length by coupling string.
Technical characteristics of the present invention as shown in Figure 1.The coupling microlith string represented in Fig. 1 and by coupling microlith string can be stacked package form coupling microlith string and by coupling microlith string, also can be the one-component (sample value) of planar format coupling microlith string and by coupling microlith string.Thus method and apparatus of the present invention, had both gone for the Code And Decode of the pixel of LCU and CU to stacked package form, also went for the Code And Decode of the pixel sample value of a plane of LCU and CU to planar format.A microlith in Fig. 1 by width to be 2 be highly 2 2x2=4 pixel or pixel sample value form, be called 2x2 microlith.But the present invention also can with the microlith of other sizes, as width to be 2 be highly 2x1=2 the pixel of 1 or the 2x1 microlith of pixel sample value composition, or width to be 1 be highly 1x2=2 the pixel of 2 or the 1x2 microlith of pixel sample value composition, or width to be 4 be highly 4x1=4 the pixel of 1 or the 4x1 microlith of pixel sample value composition, or width to be 1 be highly 1x4=4 the pixel of 4 or the 1x4 microlith of pixel sample value composition, width to be 4 be highly 4 4x4=16 pixel or the 4x4 microlith that forms of pixel sample value.
In coding method of the present invention and device, the most basic peculiar technical characteristic is exactly when encoding to current C U, search in the history pixel collection of samples (also claiming reconstructed reference pixel sample value collection) completing coding, find one by one one or more match with the pixel sample value of present encoding CU with microlith be the optimum of basic matching unit mate microlith string.Each coupling microlith string two parameters: mobile vector (namely mating relative position or matching distance) and coupling microlith number (being called for short microlith number), namely a pair (mobile vector, microlith number) characterizes.Each coupling microlith string is containing an integer microlith, but the original position of coupling microlith string can be the position of pixel sample value arbitrarily among reconstructed reference pixel sample value collection, has nothing to do, be not also subject to the restriction of the size of microlith with the size of microlith.That is, mobile vector is in units of pixel sample value but not in units of microlith.That microlith string that those microliths current C U among corresponding with the Optimum Matching microlith string found among reconstructed reference pixel sample value collection form is called and is mated microlith string.Being mated the original position of microlith string among current C U always in units of microlith, can not be the position of arbitrary pixel sample value.
In coding/decoding method of the present invention and device, the most basic peculiar technical characteristic is exactly when the compressed bit stream decoding data to current decoding CU, reads successively one or more pairs of (mobile vector, microlith number) from bit stream data.Then, from current decoding calculated by the position of first microlith of coupling microlith string and mobile vector coupling microlith string among reconstructed reference pixel sample value collection the position of first microlith.Then, again according to the queueing discipline of predetermined microlith string, whole coupling microlith string (the microlith number containing being determined by described microlith number) is copied among reconstructed reference pixel sample value collection, that whole coupling microlith string is moved and pasted in current decoding is described by the position of coupling microlith string, restores whole by coupling microlith string.Copy so successively, move, paste and mate microlith string one by one, finally restore all pixel sample values of whole current decoding CU.The same with situation during coding, each coupling microlith string is containing an integer microlith, but the original position of coupling microlith string can be the position of pixel sample value arbitrarily among reconstructed reference pixel sample value collection, has nothing to do, also not by the restriction of the size of microlith with the size of microlith.That is, mobile vector is in units of pixel sample value but not in units of microlith.On the other hand, being mated the original position of microlith string among current C U always in units of microlith, can not be the position of arbitrary pixel sample value.
By some specific instantiations, technical characteristic of the present invention is described above.Those skilled in the art can understand other advantages of the present invention and effect easily by content disclosed in the present specification.The present invention can also be implemented or be applied by embodiments different in addition, and the every details in this specification also can based on different viewpoints and application, carries out various modification or change not deviating under spirit of the present invention.
The schematic flow sheet of coding method of the present invention as shown in Figure 2.Coding method of the present invention comprises the steps:
1) microlith String matching coding is carried out to the coding unit of an input and the original pixels of CU, produce the microlith number in units of microlith that namely (1) optimum mobile vector in units of pixel sample value mates relative position or matching distance and (2) Optimum Matching microlith string; Namely from the initial microlith of in described CU, in one among reconstructed reference pixel sample value collection predetermined hunting zone, according to the queueing discipline of predetermined assessment level and microlith string, search obtains the coupling microlith string of one or more optimum; Search for the described coupling microlith string obtained and have identical described microlith number with the corresponding microlith string that mated in described CU; Described mobile vector is exactly that the position coordinates of described coupling microlith string is mated the difference of the position coordinates of microlith string with described; The unit of described mobile vector is the min coordinates unit of pixel sample value (Integer Pel sample value or 1/2nd, 1/4th, 1/8th pixel sample values) but not microlith; The unit of described microlith number is then microlith but not the coordinate unit of pixel sample value; The output of microlith String matching coding is described mobile vector, described microlith number and coupling residual error; Described coupling residual error is exactly that the numerical value of the pixel sample value of described coupling microlith string is mated the difference of the numerical value of the pixel sample value of microlith string with described;
2) remaining conventional coding and reconstruction step, as infra-frame prediction, inter prediction, conversion, quantification, inverse transformation, inverse quantization, entropy code, block-eliminating effect filtering, sample value adaptive equalization (Sample Adaptive Offset); The input of this step is above-mentioned steps 1) output and input original pixels; The output of this step is reconstructed pixel and the compressed bit stream containing mobile vector, microlith number and other coding results; Described reconstructed pixel puts into reconstructed reference pixel sample value working area, as the reference pixel required for follow-up microlith String matching coding step, all the other conventional codings and reconstruction step; Described compressed bit stream is also the last output of this coding method.
The schematic flow sheet of coding/decoding method of the present invention as shown in Figure 3.Coding/decoding method of the present invention comprises the steps:
1) resolve containing the compressed bit stream of mobile vector, microlith number and other coding results, export 1) resolve mobile vector and the microlith number of the coupling microlith string obtained, 2) all the other resolve the data obtained;
2) mobile vector of input and microlith number is used to carry out the microlith String matching decoding of a current C U; Namely from reconstructed reference pixel sample value working area by the position of the coupling microlith string determined by the position calculation of coupling microlith string current in described mobile vector and described CU, according to the queueing discipline of known microlith string, all sample values of the whole coupling microlith string that to copy microlith quantity (length) be microlith number, and whole described coupling microlith string is moved and pastes current described by the position of coupling microlith string, restore whole described by coupling microlith string; Described had identical described microlith number by coupling microlith string with described coupling microlith string; The unit of described mobile vector is the min coordinates unit of pixel sample value (Integer Pel sample value or 1/2nd, 1/4th, 1/8th pixel sample values) but not microlith; The unit of described microlith number is then microlith but not the coordinate unit of pixel sample value; The output of microlith String matching decoding is that restore described is mated the pixel sample value of microlith string;
3) remaining conventional decoding and reconstruction step, as infra-frame prediction, inter prediction, inverse transformation, inverse quantization, entropy decoding, block-eliminating effect filtering, sample value adaptive equalization (Sample Adaptive Offset); The input of this step is above-mentioned steps 2) output and above-mentioned steps 1) output 2) namely all the other resolve the data that obtain; The output of this step is reconstructed pixel; Described reconstructed pixel puts into reconstructed reference pixel sample value working area, as the reference pixel required for follow-up microlith String matching decoding step, all the other conventional decodings and reconstruction step; Described reconstructed pixel is also the last output of this coding/decoding method.
Code device schematic diagram of the present invention as shown in Figure 4.Whole code device forms by with lower module:
1) microlith String matching search coding module: microlith String matching coding is implemented to inputted video image pixel sample value, in the coding unit and CU of each input, from an initial microlith, in one among reconstructed reference pixel sample value collection predetermined hunting zone, according to the queueing discipline of predetermined assessment level and microlith string, search obtains the coupling microlith string of one or more optimum; Search for the described coupling microlith string obtained and have identical microlith number with the corresponding microlith string that mated in described CU; The position coordinates of described coupling microlith string is called mobile vector with the described difference by the position coordinates mating microlith string; The unit of described mobile vector is the min coordinates unit of pixel sample value (Integer Pel sample value or 1/2nd, 1/4th, 1/8th pixel sample values) but not microlith; The unit of described microlith number is then microlith but not the coordinate unit of pixel sample value; The output of this module is described mobile vector, described microlith number and coupling residual error; Described coupling residual error is exactly that the numerical value of the pixel sample value of described coupling microlith string is mated the difference of the numerical value of the pixel sample value of microlith string with described;
2) remaining various common technology coding and reconstructed module: implement various common technology, as infra-frame prediction, inter prediction, conversion, quantification, inverse transformation, inverse quantization, block-eliminating effect filtering, sample value adaptive equalization (Sample Adaptive Offset), coding and restructing operation; The input of this module is above-mentioned module 1) output and original input video image pixel; The output of this module is reconstructed pixel and all the other coding results; Described reconstructed pixel puts into reconstructed reference pixel sample value temporary storage module, as the reference pixel required for follow-up microlith String matching coding, remaining various common technology coding and reconstruct;
3) reconstructed reference pixel sample value temporary storage module: keep in present encoding by till the position of coupling microlith string or to the position of CU in present encoding all before reconstructed pixel sample value, as in present encoding by the reference pixel sample value (i.e. the pixel sample value of the coupling microlith string of candidate) of coupling microlith string, reference pixel sample value required when being also used as coding and the restructing operation of the various common technology of execution;
4) entropy code module: to all coding results execution entropy code computings needing to output in compressed bit stream comprising mobile vector, microlith number, all the other coding results; The result of entropy code is also the last output of this code device.
Decoding device schematic diagram of the present invention as shown in Figure 5.Whole decoding device forms by with lower module:
1) entropy decoder module: entropy decoding is implemented to the compressed bit stream of input, and parse entropy and to decode the meaning of the various data obtained; The mobile vector that parsing is obtained and microlith number are sent to microlith String matching decoder module; Remaining various common technology decoding and reconstructed module is sent to resolving the remainder data obtained;
2) microlith String matching decoder module: the input of this module is mobile vector and microlith number; This module among reconstructed reference pixel sample value collection by the position of the coupling microlith string determined by the position calculation of coupling microlith string described mobile vector and current decoding, according to the queueing discipline of known microlith string, all sample values of the whole coupling microlith string that to copy microlith quantity (length) be microlith number, and whole described coupling microlith string to be moved and pastes described in current decoding by the position of coupling microlith string, restore whole described by coupling microlith string; Described had identical described microlith number by coupling microlith string with described coupling microlith string; The unit of described mobile vector is the min coordinates unit of pixel sample value (Integer Pel sample value or 1/2nd, 1/4th, 1/8th pixel sample values) but not microlith; The unit of described microlith number is then microlith but not the coordinate unit of pixel sample value; The output of microlith String matching decoder module is that restore described is mated the pixel sample value of microlith string;
3) remaining various common technology decoding and reconstructed module: implemented remaining various common technology by CU in coupling microlith string or current decoding in current decoding, as infra-frame prediction, inter prediction, inverse transformation, inverse quantization, block-eliminating effect filtering, sample value adaptive equalization (Sample Adaptive Offset), decoding and restructing operation; The output of this module is reconstructed pixel; Described reconstructed pixel is put among reconstructed reference pixel sample value collection, as the reference pixel required for follow-up microlith String matching decoding computing and remaining various common technology decoding and restructing operation; Described reconstructed pixel is also the last output of this decoding device;
4) reconstructed reference pixel sample value temporary storage module: the pixel sample value of temporary reconstructed reference pixel sample value collection, namely in current decoding by reconstructed pixel sample value before all the position of coupling microlith string or to the position of CU in current decoding, as in current decoding by the reference pixel sample value of coupling microlith string (namely mating the pixel sample value of microlith string), reference pixel sample value required when being also used as to implement coding and the restructing operation of various common technology to CU in current decoding.
Above provided diagram only illustrates basic conception of the present invention in a schematic way, only the assembly directly relevant with the present invention is shown but not component count, shape and size when implementing according to reality is drawn in diagram, it is actual when implementing, and the kenel of each assembly, quantity and ratio can be a kind of change arbitrarily, and its assembly layout kenel also may be more complicated.
Below more implementation detail of the present invention and variant.
In described microlith String matching Code And Decode method or device, the microlith number of microlith string only can get several predetermined numeral (as 2,4,6,8,12,16), therefore, for each coupling microlith string, write compressed bit stream or what read from code stream bit stream data is not microlith number itself, but the numbering of these predetermined microlith numbers.
Accompanying drawing explanation
Fig. 1 is microlith String matching Code And Decode, the size of microlith, coupling microlith string and the Pictorial examples by coupling microlith string
Fig. 2 is coding method schematic flow sheet of the present invention
Fig. 3 is coding/decoding method schematic flow sheet of the present invention
Fig. 4 is the module composition schematic diagram of code device of the present invention
Fig. 5 is the module composition schematic diagram of decoding device of the present invention.
Claims (8)
1. a method for encoding images, is characterized in that comprising the following steps:
Step 1) carries out microlith String matching coding to the coding unit of an input and the original pixels of CU, produces the microlith number in units of microlith that namely (1) optimum mobile vector in units of pixel sample value mates relative position or matching distance and (2) Optimum Matching microlith string; Namely from the initial microlith of in described CU, in one among reconstructed reference pixel sample value collection predetermined hunting zone, according to the queueing discipline of predetermined assessment level and microlith string, search obtains the coupling microlith string of one or more optimum; Search for the described coupling microlith string obtained and have identical described microlith number with the corresponding microlith string that mated in described CU; Described mobile vector is exactly that the position coordinates of described coupling microlith string is mated the difference of the position coordinates of microlith string with described; The unit of described mobile vector is the min coordinates unit of pixel sample value (Integer Pel sample value or 1/2nd, 1/4th, 1/8th pixel sample values) but not microlith; The unit of described microlith number is then microlith but not the coordinate unit of pixel sample value; The output of microlith String matching coding is described mobile vector, described microlith number and coupling residual error; Described coupling residual error is exactly that the numerical value of the pixel sample value of described coupling microlith string is mated the difference of the numerical value of the pixel sample value of microlith string with described;
Step 2) remaining conventional coding and reconstruction step, as infra-frame prediction, inter prediction, conversion, quantification, inverse transformation, inverse quantization, entropy code, block-eliminating effect filtering, sample value adaptive equalization (Sample Adaptive Offset); The input of this step is above-mentioned steps 1) output and input original pixels; The output of this step is reconstructed pixel and the compressed bit stream containing mobile vector, microlith number and other coding results; Described reconstructed pixel puts into reconstructed reference pixel sample value working area, as the reference pixel required for follow-up microlith String matching coding step, all the other conventional codings and reconstruction step; Described compressed bit stream is also the last output of this coding method.
2. a picture decoding method, is characterized in that comprising the following steps:
Step 1) is resolved containing the compressed bit stream of mobile vector, microlith number and other coding results, exports 1) resolve mobile vector and the microlith number of the coupling microlith string obtained, 2) all the other resolve the data obtained;
Step 2) use the mobile vector of input and microlith number to carry out the microlith String matching decoding of a current C U; Namely from reconstructed reference pixel sample value working area by the position of the coupling microlith string determined by the position calculation of coupling microlith string current in described mobile vector and described CU, according to the queueing discipline of known microlith string, all sample values of the whole coupling microlith string that to copy microlith quantity (length) be microlith number, and whole described coupling microlith string is moved and pastes current described by the position of coupling microlith string, restore whole described by coupling microlith string; Described had identical described microlith number by coupling microlith string with described coupling microlith string; The unit of described mobile vector is the min coordinates unit of pixel sample value (Integer Pel sample value or 1/2nd, 1/4th, 1/8th pixel sample values) but not microlith; The unit of described microlith number is then microlith but not the coordinate unit of pixel sample value; The output of microlith String matching decoding is that restore described is mated the pixel sample value of microlith string;
Step 3) remaining conventional decoding and reconstruction step, as infra-frame prediction, inter prediction, inverse transformation, inverse quantization, entropy decoding, block-eliminating effect filtering, sample value adaptive equalization (Sample Adaptive Offset); The input of this step is above-mentioned steps 2) output and above-mentioned steps 1) output 2) namely all the other resolve the data that obtain; The output of this step is reconstructed pixel; Described reconstructed pixel puts into reconstructed reference pixel sample value working area, as the reference pixel required for follow-up microlith String matching decoding step, all the other conventional decodings and reconstruction step; Described reconstructed pixel is also the last output of this coding/decoding method.
3. a picture coding device, is characterized in that comprising with lower module:
Module 1) microlith String matching search coding module: microlith String matching coding is implemented to inputted video image pixel sample value, in the coding unit and CU of each input, from an initial microlith, in one among reconstructed reference pixel sample value collection predetermined hunting zone, according to the queueing discipline of predetermined assessment level and microlith string, search obtains the coupling microlith string of one or more optimum; Search for the described coupling microlith string obtained and have identical microlith number with the corresponding microlith string that mated in described CU; The position coordinates of described coupling microlith string is called mobile vector with the described difference by the position coordinates mating microlith string; The unit of described mobile vector is the min coordinates unit of pixel sample value (Integer Pel sample value or 1/2nd, 1/4th, 1/8th pixel sample values) but not microlith; The unit of described microlith number is then microlith but not the coordinate unit of pixel sample value; The output of this module is described mobile vector, described microlith number and coupling residual error; Described coupling residual error is exactly that the numerical value of the pixel sample value of described coupling microlith string is mated the difference of the numerical value of the pixel sample value of microlith string with described;
Module 2) remaining various common technology coding and reconstructed module: implement various common technology, as infra-frame prediction, inter prediction, conversion, quantification, inverse transformation, inverse quantization, block-eliminating effect filtering, sample value adaptive equalization (Sample Adaptive Offset), coding and restructing operation; The input of this module is above-mentioned module 1) output and original input video image pixel; The output of this module is reconstructed pixel and all the other coding results; Described reconstructed pixel puts into reconstructed reference pixel sample value temporary storage module, as the reference pixel required for follow-up microlith String matching coding, remaining various common technology coding and reconstruct;
Module 3) reconstructed reference pixel sample value temporary storage module: keep in present encoding by till the position of coupling microlith string or to the position of CU in present encoding all before reconstructed pixel sample value, as in present encoding by the reference pixel sample value (i.e. the pixel sample value of the coupling microlith string of candidate) of coupling microlith string, reference pixel sample value required when being also used as coding and the restructing operation of the various common technology of execution;
Module 4) entropy code module: to all coding results execution entropy code computings needing to output in compressed bit stream comprising mobile vector, microlith number, all the other coding results; The result of entropy code is also the last output of this code device.
4. a picture decoding apparatus, is characterized in that comprising with lower module:
Module 1) entropy decoder module: entropy decoding is implemented to the compressed bit stream of input, and parses entropy and to decode the meaning of the various data obtained; The mobile vector that parsing is obtained and microlith number are sent to microlith String matching decoder module; Remaining various common technology decoding and reconstructed module is sent to resolving the remainder data obtained;
Module 2) microlith String matching decoder module: the input of this module is mobile vector and microlith number; This module among reconstructed reference pixel sample value collection by the position of the coupling microlith string determined by the position calculation of coupling microlith string described mobile vector and current decoding, according to the queueing discipline of known microlith string, all sample values of the whole coupling microlith string that to copy microlith quantity (length) be microlith number, and whole described coupling microlith string to be moved and pastes described in current decoding by the position of coupling microlith string, restore whole described by coupling microlith string; Described had identical described microlith number by coupling microlith string with described coupling microlith string; The unit of described mobile vector is the min coordinates unit of pixel sample value (Integer Pel sample value or 1/2nd, 1/4th, 1/8th pixel sample values) but not microlith; The unit of described microlith number is then microlith but not the coordinate unit of pixel sample value; The output of microlith String matching decoder module is that restore described is mated the pixel sample value of microlith string;
Module 3) remaining various common technology decoding and reconstructed module: implemented remaining various common technology in current decoding by CU in coupling microlith string or current decoding, as infra-frame prediction, inter prediction, inverse transformation, inverse quantization, block-eliminating effect filtering, sample value adaptive equalization (Sample Adaptive Offset), decoding and restructing operation; The output of this module is reconstructed pixel; Described reconstructed pixel is put among reconstructed reference pixel sample value collection, as the reference pixel required for follow-up microlith String matching decoding computing and remaining various common technology decoding and restructing operation; Described reconstructed pixel is also the last output of this decoding device;
Module 4) reconstructed reference pixel sample value temporary storage module: the pixel sample value of temporary reconstructed reference pixel sample value collection, namely in current decoding by reconstructed pixel sample value before all the position of coupling microlith string or to the position of CU in current decoding, as in current decoding by the reference pixel sample value of coupling microlith string (namely mating the pixel sample value of microlith string), reference pixel sample value required when being also used as to implement coding and the restructing operation of various common technology to CU in current decoding.
5. according to claim 1 or claim 2 or claim 3 or coding method according to claim 4 or coding/decoding method or code device or decoding device, it is characterized in that: described microlith is made up of MxN=L the pixel of width to be M be highly N or pixel sample value, be called MxN microlith, described M can value 1 or 2 or 3 or 4, described N can value 1 or 2 or 3 or 4, but M and N can not value 1 simultaneously.
6., according to claim 1 or claim 2 or claim 3 or coding method according to claim 4 or coding/decoding method or code device or decoding device, it is characterized in that: described microlith is the microlith of stacked package form.
7., according to claim 1 or claim 2 or claim 3 or coding method according to claim 4 or coding/decoding method or code device or decoding device, it is characterized in that: described microlith is the microlith of planar format.
8. according to claim 1 or claim 2 or claim 3 or coding method according to claim 4 or coding/decoding method or code device or decoding device, it is characterized in that: described microlith number only can get several predetermined numeral (as 2,4,6,8,12,16), therefore, for each coupling microlith string, write compressed bit stream or what read from code stream bit stream data is not microlith number itself, but the numbering of these predetermined microlith numbers.
Priority Applications (7)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911089009.3A CN110830803B (en) | 2013-10-12 | 2013-10-12 | Image compression method combining block matching and string matching |
| CN201911088984.2A CN110708543A (en) | 2013-10-12 | 2013-10-12 | Image compression apparatus combining block matching and string matching |
| CN201911088982.3A CN110691250B (en) | 2013-10-12 | 2013-10-12 | Image compression apparatus combining block matching and string matching |
| CN201911088985.7A CN110691252A (en) | 2013-10-12 | 2013-10-12 | Image compression apparatus combining block matching and string matching |
| CN201911088109.4A CN110913216A (en) | 2013-10-12 | 2013-10-12 | Image compression method combining block matching and string matching |
| CN201310475108.1A CN104581177B (en) | 2013-10-12 | 2013-10-12 | Image compression method and device combining block matching and string matching |
| CN201911088103.7A CN110913222A (en) | 2013-10-12 | 2013-10-12 | Image compression method combining block matching and string matching |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201310475108.1A CN104581177B (en) | 2013-10-12 | 2013-10-12 | Image compression method and device combining block matching and string matching |
Related Child Applications (6)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201911088984.2A Division CN110708543A (en) | 2013-10-12 | 2013-10-12 | Image compression apparatus combining block matching and string matching |
| CN201911088109.4A Division CN110913216A (en) | 2013-10-12 | 2013-10-12 | Image compression method combining block matching and string matching |
| CN201911088982.3A Division CN110691250B (en) | 2013-10-12 | 2013-10-12 | Image compression apparatus combining block matching and string matching |
| CN201911088985.7A Division CN110691252A (en) | 2013-10-12 | 2013-10-12 | Image compression apparatus combining block matching and string matching |
| CN201911088103.7A Division CN110913222A (en) | 2013-10-12 | 2013-10-12 | Image compression method combining block matching and string matching |
| CN201911089009.3A Division CN110830803B (en) | 2013-10-12 | 2013-10-12 | Image compression method combining block matching and string matching |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN104581177A true CN104581177A (en) | 2015-04-29 |
| CN104581177B CN104581177B (en) | 2020-03-31 |
Family
ID=53096236
Family Applications (7)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201911088103.7A Withdrawn CN110913222A (en) | 2013-10-12 | 2013-10-12 | Image compression method combining block matching and string matching |
| CN201911088109.4A Withdrawn CN110913216A (en) | 2013-10-12 | 2013-10-12 | Image compression method combining block matching and string matching |
| CN201911088982.3A Expired - Fee Related CN110691250B (en) | 2013-10-12 | 2013-10-12 | Image compression apparatus combining block matching and string matching |
| CN201911088984.2A Withdrawn CN110708543A (en) | 2013-10-12 | 2013-10-12 | Image compression apparatus combining block matching and string matching |
| CN201911089009.3A Active CN110830803B (en) | 2013-10-12 | 2013-10-12 | Image compression method combining block matching and string matching |
| CN201310475108.1A Active CN104581177B (en) | 2013-10-12 | 2013-10-12 | Image compression method and device combining block matching and string matching |
| CN201911088985.7A Withdrawn CN110691252A (en) | 2013-10-12 | 2013-10-12 | Image compression apparatus combining block matching and string matching |
Family Applications Before (5)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201911088103.7A Withdrawn CN110913222A (en) | 2013-10-12 | 2013-10-12 | Image compression method combining block matching and string matching |
| CN201911088109.4A Withdrawn CN110913216A (en) | 2013-10-12 | 2013-10-12 | Image compression method combining block matching and string matching |
| CN201911088982.3A Expired - Fee Related CN110691250B (en) | 2013-10-12 | 2013-10-12 | Image compression apparatus combining block matching and string matching |
| CN201911088984.2A Withdrawn CN110708543A (en) | 2013-10-12 | 2013-10-12 | Image compression apparatus combining block matching and string matching |
| CN201911089009.3A Active CN110830803B (en) | 2013-10-12 | 2013-10-12 | Image compression method combining block matching and string matching |
Family Applications After (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201911088985.7A Withdrawn CN110691252A (en) | 2013-10-12 | 2013-10-12 | Image compression apparatus combining block matching and string matching |
Country Status (1)
| Country | Link |
|---|---|
| CN (7) | CN110913222A (en) |
Cited By (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108235007A (en) * | 2016-12-12 | 2018-06-29 | 上海天荷电子信息有限公司 | Each pattern uses the data compression method and device of different accuracy coding parameter of the same race |
| CN111866512A (en) * | 2020-07-29 | 2020-10-30 | 腾讯科技（深圳）有限公司 | Video decoding method, video encoding method, video decoding apparatus, video encoding apparatus, and storage medium |
| CN112055219A (en) * | 2020-08-05 | 2020-12-08 | 浙江大华技术股份有限公司 | String matching prediction method and device and computer readable storage medium |
| CN112073719A (en) * | 2020-08-21 | 2020-12-11 | 浙江大华技术股份有限公司 | String matching prediction method, device and system and computer readable storage medium |
| CN112532989A (en) * | 2020-06-02 | 2021-03-19 | 腾讯科技（深圳）有限公司 | Video encoding method, video decoding method and related equipment |
| CN112532988A (en) * | 2020-06-02 | 2021-03-19 | 腾讯科技（深圳）有限公司 | Video encoding method, video decoding method and related equipment |
| CN112565767A (en) * | 2020-06-04 | 2021-03-26 | 腾讯科技（深圳）有限公司 | Video decoding method, video encoding method and related equipment |
| CN112672160A (en) * | 2020-12-17 | 2021-04-16 | 绍兴文理学院 | Coding and decoding method and device for fusing intra-frame block copy and string copy coding parameters |
Families Citing this family (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112543333B (en) * | 2020-06-02 | 2021-08-24 | 腾讯科技（深圳）有限公司 | Video decoding method, video encoding method and related equipment |
| CN114390289A (en) * | 2020-10-18 | 2022-04-22 | 腾讯科技（深圳）有限公司 | Reference pixel candidate list construction method, device, equipment and storage medium |
| CN114615498A (en) * | 2020-12-05 | 2022-06-10 | 腾讯科技（深圳）有限公司 | Video decoding method, video encoding method, related device and storage medium |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1260097A (en) * | 1997-05-07 | 2000-07-12 | 西门子公司 | Method and device for coding a digitized image |
| US20050078752A1 (en) * | 2003-10-13 | 2005-04-14 | Lg Electronics Inc. | Method for extracting macro block at high speed in mobile communication system |
| CN102497546A (en) * | 2011-11-28 | 2012-06-13 | 同济大学 | Screen image compression device and compression method thereof |
| CN102761738A (en) * | 2011-12-05 | 2012-10-31 | 上海天荷电子信息有限公司 | Image compression method and device on basis of mixed chromaticity sampling rate |
Family Cites Families (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6535642B1 (en) * | 1999-07-13 | 2003-03-18 | Microsoft Corporation | Approximate string matching system and process for lossless data compression |
| US6420979B1 (en) * | 2000-11-15 | 2002-07-16 | Nec Corporation | Method for compressing and decompressing image signals and apparatus for compressing and decompressing image signals |
| EP1578020B1 (en) * | 2002-12-26 | 2014-08-27 | Fujitsu Limited | Data compressing method, program and apparatus |
| CN1777283A (en) * | 2004-12-31 | 2006-05-24 | 上海广电（集团）有限公司 | Microblock based video signal coding/decoding method |
| CN100496126C (en) * | 2006-03-03 | 2009-06-03 | 凌阳科技股份有限公司 | Image coder and coding method |
| US20080279478A1 (en) * | 2007-05-09 | 2008-11-13 | Mikhail Tsoupko-Sitnikov | Image processing method and image processing apparatus |
| CN101420614B (en) * | 2008-11-28 | 2010-08-18 | 同济大学 | Image compression method and device integrating hybrid coding and wordbook coding |
| US20130243090A1 (en) * | 2012-03-13 | 2013-09-19 | Yan Xin Li | Block-matching Motion Estimation Method and Apparatus |
| CN103327340B (en) * | 2013-06-20 | 2016-06-15 | 华为技术有限公司 | A kind of integer searches method and device |
-
2013
- 2013-10-12 CN CN201911088103.7A patent/CN110913222A/en not_active Withdrawn
- 2013-10-12 CN CN201911088109.4A patent/CN110913216A/en not_active Withdrawn
- 2013-10-12 CN CN201911088982.3A patent/CN110691250B/en not_active Expired - Fee Related
- 2013-10-12 CN CN201911088984.2A patent/CN110708543A/en not_active Withdrawn
- 2013-10-12 CN CN201911089009.3A patent/CN110830803B/en active Active
- 2013-10-12 CN CN201310475108.1A patent/CN104581177B/en active Active
- 2013-10-12 CN CN201911088985.7A patent/CN110691252A/en not_active Withdrawn
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1260097A (en) * | 1997-05-07 | 2000-07-12 | 西门子公司 | Method and device for coding a digitized image |
| US20050078752A1 (en) * | 2003-10-13 | 2005-04-14 | Lg Electronics Inc. | Method for extracting macro block at high speed in mobile communication system |
| CN102497546A (en) * | 2011-11-28 | 2012-06-13 | 同济大学 | Screen image compression device and compression method thereof |
| CN102761738A (en) * | 2011-12-05 | 2012-10-31 | 上海天荷电子信息有限公司 | Image compression method and device on basis of mixed chromaticity sampling rate |
Cited By (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108235007A (en) * | 2016-12-12 | 2018-06-29 | 上海天荷电子信息有限公司 | Each pattern uses the data compression method and device of different accuracy coding parameter of the same race |
| CN112532989A (en) * | 2020-06-02 | 2021-03-19 | 腾讯科技（深圳）有限公司 | Video encoding method, video decoding method and related equipment |
| CN112532988A (en) * | 2020-06-02 | 2021-03-19 | 腾讯科技（深圳）有限公司 | Video encoding method, video decoding method and related equipment |
| CN112565767A (en) * | 2020-06-04 | 2021-03-26 | 腾讯科技（深圳）有限公司 | Video decoding method, video encoding method and related equipment |
| CN111866512A (en) * | 2020-07-29 | 2020-10-30 | 腾讯科技（深圳）有限公司 | Video decoding method, video encoding method, video decoding apparatus, video encoding apparatus, and storage medium |
| CN111866512B (en) * | 2020-07-29 | 2022-02-22 | 腾讯科技（深圳）有限公司 | Video decoding method, video encoding method, video decoding apparatus, video encoding apparatus, and storage medium |
| CN114900690A (en) * | 2020-07-29 | 2022-08-12 | 腾讯科技（深圳）有限公司 | Video decoding method, video encoding method, video decoding apparatus, video encoding apparatus, and storage medium |
| CN114900690B (en) * | 2020-07-29 | 2023-09-01 | 腾讯科技（深圳）有限公司 | Video decoding method, video encoding method, device, equipment and storage medium |
| CN112055219A (en) * | 2020-08-05 | 2020-12-08 | 浙江大华技术股份有限公司 | String matching prediction method and device and computer readable storage medium |
| CN112073719A (en) * | 2020-08-21 | 2020-12-11 | 浙江大华技术股份有限公司 | String matching prediction method, device and system and computer readable storage medium |
| CN112672160A (en) * | 2020-12-17 | 2021-04-16 | 绍兴文理学院 | Coding and decoding method and device for fusing intra-frame block copy and string copy coding parameters |
| CN112672160B (en) * | 2020-12-17 | 2023-10-10 | 绍兴文理学院 | Encoding and decoding method and device for fusing intra-frame block copy and string copy encoding parameters |
Also Published As
| Publication number | Publication date |
|---|---|
| CN110830803B (en) | 2022-04-19 |
| CN110691250B (en) | 2022-04-08 |
| CN110708543A (en) | 2020-01-17 |
| CN104581177B (en) | 2020-03-31 |
| CN110913216A (en) | 2020-03-24 |
| CN110913222A (en) | 2020-03-24 |
| CN110691252A (en) | 2020-01-14 |
| CN110691250A (en) | 2020-01-14 |
| CN110830803A (en) | 2020-02-21 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN104581177A (en) | Image compression method and device combining block matching with string matching | |
| US10038908B2 (en) | Palette mode in high efficiency video coding (HEVC) screen content coding (SCC) | |
| TWI536811B (en) | Method and system for image processing, decoding method, encoder and decoder | |
| CN110446041B (en) | Video encoding and decoding method, device, system and storage medium | |
| CN104683805A (en) | Image encoding method, image decoding method, image encoding device and image decoding device | |
| CN110198492B (en) | Video watermark adding method, device, equipment and storage medium | |
| CN105100814A (en) | Methods and devices for image encoding and decoding | |
| EP3089453A1 (en) | Image coding and decoding methods and devices | |
| CN104853211A (en) | Image compression method and apparatus employing various forms of reference pixel storage spaces | |
| CN104427338A (en) | Image compression method and device with block matching | |
| CN104853209A (en) | Image coding and decoding method and device | |
| CN113766249B (en) | Loop filtering method, device, equipment and storage medium in video coding and decoding | |
| WO2020103800A1 (en) | Video decoding method and video decoder | |
| CN104754362A (en) | Image compression method using fine division block matching | |
| CN111819856A (en) | Loop filtering apparatus and method for video encoding | |
| CN112400323B (en) | Image encoder, image decoder, and corresponding methods | |
| CN104811731A (en) | Multilayer sub-block matching image compression method | |
| CN115118964A (en) | Video encoding method, video encoding device, electronic equipment and computer-readable storage medium | |
| CN104935945A (en) | Image compression method of extended reference pixel sample value set | |
| CN104918050B (en) | Use the image coding/decoding method for the reference pixel sample value collection that dynamic arrangement recombinates | |
| CN104581186A (en) | Method for encoding and decoding intra-frame moving vector during image compression | |
| CN110944177B (en) | Video decoding method, video decoder, video encoding method and video encoder | |
| WO2020057537A1 (en) | Video decoding method and video decoder, and video encoding method and video encoder | |
| CN117856794A (en) | Self-adaptive optimization device and method under multi-compression algorithm mode | |
| CN114071148A (en) | Video coding method, device, equipment and product |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| TA01 | Transfer of patent application right |
Effective date of registration: 20191025 Address after: 430000 Hubei Province Wuhan Hongshan District Donghu New Technology Development Zone Laowu-Huanghe Highway 206 Huigu Space-time Building 705, 706A Applicant after: Hong Xuewen Address before: 200233 1-9A, 600 Liuzhou Road, Shanghai, Xuhui District Applicant before: Shanghai Tianhe Electronic Information Co.,Ltd. |
|
| TA01 | Transfer of patent application right | ||
| TA01 | Transfer of patent application right |
Effective date of registration: 20200310 Address after: 100070 1001, 10 / F, building 2, yard 8, Automobile Museum West Road, Fengtai District, Beijing Applicant after: CIC Guoxin (Beijing) Technology Development Co.,Ltd. Address before: 430000 Hubei Province Wuhan Hongshan District Donghu New Technology Development Zone Laowu-Huanghe Highway 206 Huigu Space-time Building 705, 706A Applicant before: Hong Xuewen |
|
| TA01 | Transfer of patent application right | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| PE01 | Entry into force of the registration of the contract for pledge of patent right |
Denomination of invention: A method and device for image compression combining block matching and string matching Granted publication date: 20200331 Pledgee: Haidian Beijing science and technology enterprise financing Company limited by guarantee Pledgor: CIC Guoxin (Beijing) Technology Development Co.,Ltd. Registration number: Y2024110000201 |