CN108989810A

CN108989810A - The data compression method and device of byte stream or bit stream is respectively adopted in different components

Info

Publication number: CN108989810A
Application number: CN201710410668.7A
Authority: CN
Inventors: 林涛
Original assignee: Shanghai Tianhe Electronic Information Co Ltd
Current assignee: Shanghai Tianhe Electronic Information Co Ltd
Priority date: 2017-06-03
Filing date: 2017-06-03
Publication date: 2018-12-11

Abstract

The present invention provides a kind of different components, and byte stream or bit stream is respectively adopted, i.e., several components use byte stream and remaining component uses bit stream to the data compression method and device of syntactic element progress encoding and decoding.In this method and device, a data flow includes the byte stream of several components and the bit stream of remaining component.In this way, can balance data flow well binary encoding efficiency and encoding and decoding speed.

Description

The data compression method and device of byte stream or bit stream is respectively adopted in different components

Technical field

It is damaged the present invention relates to a kind of pair of data or the encoding and decoding system of lossless compression, especially image and view The method and apparatus of the encoding and decoding of frequency evidence.

Background technique

As human society enters big data, cloud computing, mobile computing, cloud-mobile computing, ultra high-definition (4K) and special superelevation The epoch of (8K) video image resolution ratio, 4G/5G communication, virtual reality, artificial intelligence clearly, to various data, including big data, Image data, video data, the data compression for carrying out superelevation compression ratio and very high-quality become essential technology.

Data set be by data element (such as: byte, bit, pixel, pixel component, spatial sampling point, transform domain system Number) composition set.To be arranged in certain space (one-dimensional, two-dimentional or multidimensional) shape data set (such as: a dimension According to queue, a two-dimensional data files, a frame image, a video sequence, a transform domain, a transform block, multiple transformation The sequence of block, a three-dimensional scenic, three-dimensional scenic persistently changed), especially two dimension or above data collection carries out data When coding (and corresponding decoding) of compression, usually this data set is divided into several with predetermined shape and/or size Subset, referred to as encoding block (from decoded angle i.e. decoding block, are referred to as encoding and decoding block), as unit of encoding and decoding block, with Scheduled sequence, one piece one piece is encoded or is decoded.At any one time, the encoding block encoded is known as present encoding Block.At any one time, the decoding block decoded is known as current decoding block.Present encoding block or current decoding block are referred to as working as Preceding encoding and decoding block or referred to as current block.Data element (being also referred to as element sometimes) just in encoding or decoding is known as working as Preceding encoding data elements or current decoded data element, are referred to as current data element, referred to as currentElement.Element is by N A component (usual 1≤N≤5) composition has 1920(wide for example, element, that is, pixel arrangement of a frame image is in a rectangular shape Degree) x 1080(height) size (resolution ratio), be made of 3 components: G(green) component, B(blue) component, R(is red) point Amount or Y(brightness) component, U(coloration 1) component, V(coloration 2) component or Y(brightness) component, Cb(colour difference is blue) and component, Cr(color Degree difference is red) component or Y(brightness) component, Cg(coloration is green) and component, Co(coloration orange) component or H(form and aspect) component, S(saturation degree) Component, V(lightness) component or H(form and aspect) component, S(saturation degree) component, L(brightness) component；Or it is made of 4 components: (C, M, Y, K) i.e. (cyan, magenta, yellow, black) or (R, G, B, A) i.e. (red, green, blue, Alpha) or (Y, U, V, A) be i.e. (bright Degree, coloration 1, coloration 2, Alpha) or (Y, Cb, Cr, A) i.e. (brightness, colour difference indigo plant, colour difference is red, Alpha) or (Y, Cg, Co, A) i.e. (brightness, coloration is green, coloration orange, Alpha).

For one with certain shapes (being not necessarily limited to square or rectangle, can be any reasonable other shapes) A encoding and decoding block needs to be divided into many occasions finer primitive (basic unit), according to scheduled time sequencing, One primitive, one primitive is encoded or is decoded.To all sample values in a primitive, same type of coding is usually implemented Or decoding operate.At any one time, the primitive in encoding or decoding is known as current primitive.One primitive is encoded The result is that one or more coding parameters, finally generate the compressed data code stream containing these coding parameters.One primitive is carried out Decoding is exactly to parse the compressed data code stream to obtain one or more coding parameters, multiple from one or more of coding parameters Original goes out the sample value of the data of reconstruct.

The example of primitive include encoding and decoding block (entire block is as a primitive), sub-block, microlith, string, byte serial, alpha(Ah That method) string, pixel string, sample value string, index string, lines.

One distinguishing feature of many common data sets is the formula with many matchings (i.e. similar or even identical) Sample.For example, usually there is many matched pixel patterns in image and video sequence.Therefore, in available data compress technique usually By the way of matching (also referred to as predict or compensate), i.e., with " predicted value " (also referred to as " offset " or " referring to sample value ", such as " reference pixel ") come match (also referred to as predict, indicate, represent, compensation, it is approximate, approach) sample value in present encoding or decoding The mode of (referred to as " current sample ") achievees the effect that the lossless or lossy compressions of data.In many occasions, matching way Basic operation be exactly duplication with reference to sample value of the sample value i.e. on reference position to the position of current sample.Therefore, matching way Or prediction mode is also referred to as copy mode.In matching way, had been subjected at least partly encoding operation and at least partly solved Reconstruct (also referred to as rebuild or restore) sample value composition reference set (also referred to as reference set space or with reference to space or with reference to slow of code operation It deposits).The original samples and its position that reconstruct sample value and its position among reference set are concentrated with initial data are one-to-one.

When carrying out the encoding and decoding of a current block, current block is divided into several matchings and (also referred to as predicts) base by matching way Member, a Matching unit have one or more matching (coding) parameter (also referred to as matching relationship or duplication parameter or replication relations Or referring-to relation) indicate its feature.In match parameter a most important parameter be displacement vector (also referred to as motion vector, Positional shift, offset, relative position, position, relative address, address, relative coordinate, coordinate, relative indexing, index etc.).Position Move the current primitive of vector representation sample value and its with reference to the relative shift between sample value, be equivalent to data sample be arranged in it is one-dimensional One-dimensional offset after data.Obviously, it can be exported with reference to where the reference position of sample value from displacement vector.The displacement of current primitive Vector is known as current displacement vector.Other examples of match parameter: primitive mode, scan pattern, match-type, matching length, no (prediction) sample value can be matched, etc..

The example of Matching unit includes encoding and decoding block, sub-block, microlith, string, pixel string, sample value string, index string, lines.

In data compression, the compressed data (also commonly referred to as data flow) generated after compression is by syntactic element group one by one At, and each syntactic element is made of bit one by one (0 or 1, also commonly referred to as binary symbols or dual code).These bits One bit stream of all compositions be also referred to as code stream.The bit of the bit one of encoder one ratio specially generative grammar element is to form Code stream, and then bit one bit than the syntactic element in specially readout code stream is first to parse each grammer of acquisition for decoder Element.

On the other hand, each instruction of modern 64 general bit machines and each data are 64 (i.e. 64 ratios It is special), at least one byte (8 bits) of each computer clock period treatment, up to eight bytes (64 bits).It calculates The encoder or decoder realized on machine using software program, if can only the specially generation or parsing code of bit one ratio Stream, as soon as handling a bit with the processing capacity of 64 bits, computational efficiency is very low, and coding and decoding is caused all to expend very much The speed of time, coding and decoding are low.Therefore, another type of encoder and decoder, with byte (usually 8 ratios It is special) it is that syntactic element is placed in the referred to as data flow of byte stream by unit.Byte stream is characterized in if a syntactic element It occupies two or more bytes and is divided into corresponding two or more bit sections, then only allow the bit number of first bit section Less than the bit number (usually 8) of a byte, the bit number of remaining bit section is all necessarily equal to the bit number of a byte. The speed of coding and decoding can substantially be accelerated using byte stream.But the code efficiency of byte stream is usually less than bit stream, this It is the shortcoming of byte stream.

It is known as the occasion of multiple components in data element, institute is important to be all used uniformly bit stream or byte stream, will generate The problem of either encoding and decoding speed is low or coding inefficiency.

Summary of the invention

In order to solve the problems, such as this in data compression, the present invention provides a kind of different components be respectively adopted byte stream or Bit stream, i.e. several components use byte stream and remaining component uses bit stream to the data pressure of syntactic element progress encoding and decoding Contracting method and apparatus.In this method and device, a data flow includes the byte stream and remaining component of several components Bit stream.In this way, can balance data flow well binary encoding efficiency and encoding and decoding speed.

For example, in the compression of four component pixel of a frame (R, G, B, A) image, to the code efficiency of Alpha (A) component Requirement be not very high, but to the more demanding of encoding and decoding speed, and may require in decoding process, decoding first obtains Alpha components.Therefore, encoding and decoding are carried out using byte stream mode to alpha components, and is placed on the data of a frame image The forward position of stream, can better meet the requirement of practical application.

The most basic peculiar technical characteristic of coding method or device of the invention is in data element by more than one component group At occasion byte stream is used to the syntactic element of wherein scheduled several components according to the characteristic and requirement of each component itself Mode generate data flow, and data flow is generated by the way of bit stream to remaining syntactic element.One byte is equal to B Bit, B are generally equal to 8.Fig. 1 is in coding method or device of the invention, and the syntactic element of several intended components uses byte The mode of stream and an illustrated embodiment of remaining syntactic element by the way of bit stream, may wherein have at the ending of bit stream Several filling bits come aligned bytes boundary.

The most basic peculiar technical characteristic of coding/decoding method or device of the invention be have in parsed data flow it is scheduled several A component, syntactic element are present in data flow in a manner of byte stream, and remaining syntactic element is in a manner of bit stream It is present in data flow.Fig. 1 is also in coding/decoding method or device of the invention, and the syntactic element of several intended components is with byte stream Mode and remaining syntactic element is present in an illustrated embodiment in data flow in a manner of bit stream, the wherein knot of bit stream There may be several filling bits to come aligned bytes boundary at tail.

According to an aspect of the invention, there is provided coding method or the device of a kind of data compression, it is following to include at least completion The step of function and operation or module:

According to the characteristic and requirement of each component itself, to the syntactic elements of wherein scheduled several components by the way of byte stream The byte stream segment of data flow is generated, and generates the bit stream section of data flow by the way of bit stream to remaining syntactic element.

According to another aspect of the present invention, the coding/decoding method or device of a kind of data compression are additionally provided, includes at least and completes The step of following function and operation or module:

Parse the data flow with following features: scheduled several components, syntactic element are present in number in a manner of byte stream According in the byte stream segment of stream, and remaining syntactic element is present in the bit stream section of data flow in a manner of bit stream.

The present invention is suitable for carrying out data the coding and decoding of lossy compression, and present invention is equally applicable to carry out nothing to data Damage the coding and decoding of compression.The present invention is suitable for one-dimensional data such as string data or byte string data or one-dimensional pattern or divides The coding and decoding for tieing up figure, present invention is equally applicable to the reconciliation of the coding of two dimension or above data such as image or video data Code.

In the present invention, data involved in data compression include one or a combination set of data of following classes

1) one-dimensional data；

2) 2-D data；

3) multidimensional data；

4) figure；

5) divide dimension figure；

6) image；

7) sequence of image；

8) video；

9) three-dimensional scenic；

10) sequence of the three-dimensional scenic persistently changed；

11) scene of virtual reality；

12) sequence of the scene of the virtual reality persistently changed

13) image of pixel form；

14) the transformation numeric field data of image；

15) set of two dimension or the above byte of two dimension；

16) two dimension or the set of the above bit of two dimension；

17) set of pixel；

18) set of four component pixels (C, M, Y, K)；

19) set of four component pixels (R, G, B, A)；

20) set of four component pixels (Y, U, V, A)；

21) set of four component pixels (Y, Cb, Cr, A)；

22) set of four component pixels (Y, Cg, Co, A).

In the present invention, institute's syntax elements include one or a combination set of following coding parameter or coding parameter component or its prefix, Infix, suffix:

1) coding mode；

2) primitive mode；

3) scan pattern；

4) match-type；

5) string type；

6) displacement vector；

7) displacement vector type；

8) motion vector；

9) motion vector type；

10) offset；

11) offset minus constant；

12) offset type；

13) image coordinate；

14) number of pixels；

15) primitive number；

16) primitive length；

17) go here and there (including data element string, byte serial, alpha string, pixel string, sample value string, index string, unpredictable element string Deng) number；

18) go here and there (including data element string, byte serial, alpha string, pixel string, sample value string, index string, unpredictable element string Deng) length；

19) go here and there (including data element string, byte serial, alpha string, pixel string, sample value string, index string, unpredictable element string Deng) length subtracts constant；

20) go here and there (including data element string, byte serial, alpha string, pixel string, sample value string, index string, unpredictable element string Deng) length type；

21) unpredictable number of pixels；

22) unpredictable pixel string length.

It is the situation of image, the sequence of image, video etc. in data in the present invention, encoding block or decoding block are one of image Coding region or a decoding region, comprise at least one of the following: entire image, the subgraph of image, macro block, maximum coding are single First LCU, coding tree unit CTU, the subregion of coding unit CU, CU, predicting unit PU, converter unit TU.

In the present invention, the primitive of encoding and decoding block involved in data compression includes one or a combination set of following state: encoding and decoding block, Sub-block, microlith, string, byte serial, alpha(Alpha) string, pixel string, sample value string, index string, lines, match block, matching Block, matching string, matched pixel string, matching sample value string, match index string, matching item, matching lines, offset string, is sat matching microlith Mark string, unpredictable pixel, unpredictable pixel string, coordinate or unpredictable pixel string.

Illustrate technical characteristic of the invention above by several specific specific examples.Those skilled in the art can be by this specification Other advantages and efficacy of the present invention can be easily understood for revealed content.The present invention can also pass through in addition different specific realities The mode of applying is embodied or practiced, and the various details in this specification can also be based on different viewpoints and application, without departing substantially from this Various modifications or alterations are carried out under the spirit of invention.

It is more implementation details or variant of the invention below.

Implementation or variant example 1

In the coding method or device or coding/decoding method or device, the bit stream section and the byte stream segment staggered row It arranges, has filling bit with aligned bytes boundary at the ending of bit stream section.

Implementation or variant example 2

In the coding method or device or coding/decoding method or device, in the image layer data flow of a frame image, the ratio Spy's stream section and the byte stream segment are staggered with one of following three predetermined order:

Bit stream section, byte stream segment, bit stream section

Or

Bit stream section, byte stream segment

Or

Byte stream segment, bit stream section.

Implementation or variant example 3

In the coding method or device or coding/decoding method or device, scheduled several components are Alpha (alpha) Component.

Implementation or variant example 4

In coding method described in implementation or variant example 3 or device or coding/decoding method or device, the alpha components of a frame image Byte stream segment be present in one of following predetermined position in image layer data flow:

Among image head data

Or

After image head data, before image data

Or

Among image data, before strip data

Or

In first strip data of one frame image, before coding tree unit (CTU) data.

Detailed description of the invention

Fig. 1 is a schematic diagram of compressed data in coding method or device or coding/decoding method or device of the invention.

Claims

1. coding method or the device of a kind of data compression, which is characterized in that including at least the step for completing following function and operation Rapid or module:

2. the coding/decoding method or device of a kind of data compression, which is characterized in that including at least the step for completing following function and operation Rapid or module:

3. coding method according to claim 1 or device or coding/decoding method according to claim 2 or device, It is characterized in that data involved in the data compression include one or a combination set of data of following classes:

One-dimensional data；

2-D data；

Multidimensional data；

Figure；

Divide dimension figure；

Image；

The sequence of image；

Video；

Three-dimensional scenic；

The sequence of the three-dimensional scenic persistently changed；

The scene of virtual reality；

The sequence of the scene of the virtual reality persistently changed

The image of pixel form；

The transformation numeric field data of image；

The set of two dimension or the above byte of two dimension；

The set of two dimension or the above bit of two dimension；

The set of pixel；

The set of four component pixels (C, M, Y, K)；

The set of four component pixels (R, G, B, A)；

The set of four component pixels (Y, U, V, A)；

The set of four component pixels (Y, Cb, Cr, A)；

The set of four component pixels (Y, Cg, Co, A).

4. coding method according to claim 1 or device or coding/decoding method according to claim 2 or device, It is characterized in that institute's syntax elements include one or a combination set of following coding parameter or coding parameter component or its prefix, in Sew, suffix:

Coding mode；

Primitive mode；

Scan pattern；

Match-type；

String type；

Displacement vector；

Displacement vector type；

Motion vector；

Motion vector type；

Offset；

Offset minus constant；

Offset type；

Image coordinate；

Number of pixels；

Primitive number；

Primitive length；

String number；

String length；

String length subtracts constant；

String length type；

Unpredictable number of pixels；

Unpredictable pixel string length.

5. coding method according to claim 1 or device or coding/decoding method according to claim 2 or device, It is characterized by:

Data involved in the data compression are image data or image sequence data or video data；

Encoding and decoding block involved in the data compression be image a coding region or a decoding region, including with down toward Few one kind: entire image, the subgraph of image, macro block, maximum coding unit LCU, coding tree unit CTU, coding unit CU, CU Subregion, predicting unit PU, converter unit TU.

6. coding method according to claim 1 or device or coding/decoding method according to claim 2 or device, It is characterized in that the primitive of encoding and decoding block involved in data compression includes one or a combination set of following state: encoding and decoding block, son Block, microlith, string, byte serial, alpha(Alpha) string, pixel string, sample value string, index string, lines, match block, matched sub-block, Match microlith, matching string, matched pixel string, matching sample value string, match index string, matching item, matching lines, offset string, coordinate String, unpredictable pixel, unpredictable pixel string, coordinate or unpredictable pixel string.

7. coding method according to claim 1 or device or coding/decoding method according to claim 2 or device, It is characterized in that the bit stream section and the byte stream segment are staggered, there is filling bit to be aligned at the ending of bit stream section Byte boundary.

8. coding method according to claim 1 or device or coding/decoding method according to claim 2 or device, It is characterized in that, the bit stream section and the byte stream segment are pre- with following three in the image layer data flow of a frame image One of fixed sequence is staggered: