WO2016192053A1 - Copy information coding method and apparatus, and image processing device - Google Patents

Abstract

A copy information coding method and apparatus, and an image processing device. The coding method comprises: determining a pixel index, a copy type and a copy value corresponding to an image region to be coded; and performing bit stream coding on a plurality of copy types corresponding to the image region to be coded, then performing bit stream coding on a plurality of pixel indexes corresponding to the image region to be coded, and then performing bit stream coding on a plurality of copy values corresponding to the image region to be coded. Thus, not only can the coding throughput be improved, but the bit cost for coding can be further reduced.

Description

Coding method, device and image processing device for copying information Technical field

The present invention relates to the field of graphic image technology, and in particular, to a method and device for encoding copy information, and an image processing device.

Background technique

Palette-based coding is widely used in graphic image technology (especially video coding technology). In the encoding process, for the image area to be encoded, for example, a coding unit (CU), including a plurality of pixels having color values (for example, RGB mode, having 24 bits of true color); in order to reduce the storage bits The storage capacity of the image image, which can usually point the pixel to the data index of the palette. During the decoding process, the color value of each output pixel can be determined by looking up a palette with a corresponding data index.

The palette is a set of pixel values. For pixels whose pixel values are in the palette, only the pixel index corresponding to the pixel value in the palette is used. Thereby, only the palette and the index corresponding to the pixels in the coding unit can be bit-stream encoded, and the bit cost of the coding can be reduced.

In order to further reduce the bit cost, an index copy run can be employed when performing bit stream encoding. For example, if the palette copy type identifier (palette_run_type_flag) is COPY_LEFT_MODE, and the pixel value of one pixel is the same as the pixel value of the left pixel, the copy left mode may be used to generate the pixel index, the copy type, and The copy information of the copy value; if the palette copy type identifier (palette_run_type_flag) is COPY_ABOVE_MODE, in the case where the pixel value of one pixel is the same as the pixel value of the upper pixel, the copy above mode may be used to generate the copy type. And copy information of the copied value.

It should be noted that the above description of the technical background is only for the purpose of facilitating a clear and complete description of the technical solutions of the present invention, and is convenient for understanding by those skilled in the art. The above technical solutions are not considered to be well known to those skilled in the art simply because these aspects are set forth in the background section of the present invention.

Summary of the invention

However, the inventors have found that the encoding of the copy information is currently interleaved, thereby resulting in a low throughput of the encoding, and currently requires more bits for encoding the copy information, and the cost of encoding the bit stream is relatively large. Can not further reduce the bit cost of encoding.

Embodiments of the present invention provide a coding method, an apparatus, and an image processing apparatus for copying information. While increasing the encoding throughput, the bit cost of encoding is further reduced.

According to a first aspect of the embodiments of the present invention, a method for encoding copy information is provided, where the encoding method includes:

Determining a pixel index, a copy type, and a copy value corresponding to the image area to be encoded;

Performing bitstream encoding on a plurality of copy types corresponding to the image region to be encoded, and then performing bitstream encoding on a plurality of pixel indexes corresponding to the image region to be encoded, and then corresponding to the image region to be encoded Multiple copy values are bitstream encoded.

According to a second aspect of the embodiments of the present invention, there is provided an encoding apparatus for copying information, the encoding apparatus comprising:

An information determining unit that determines a pixel index, a copy type, and a copy value corresponding to the image region to be encoded;

a bitstream encoding unit that performs bitstream encoding on a plurality of copy types corresponding to the image region to be encoded, and then performs bitstream encoding on a plurality of pixel indexes corresponding to the image region to be encoded, and then corresponds to the The plurality of copy values of the image area to be encoded are subjected to bit stream encoding.

According to a third aspect of the embodiments of the present invention, an image processing apparatus is provided, including:

An image encoder comprising an encoding device that copies information as described above.

According to still another aspect of an embodiment of the present invention, a computer readable program is provided, wherein when the program is executed in an image processing apparatus, the program causes a computer to execute copy information as described above in the image processing apparatus The encoding method.

According to still another aspect of an embodiment of the present invention, a storage medium storing a computer readable program, wherein the computer readable program causes a computer to perform an encoding method of copy information as described above in an image processing apparatus.

An advantageous effect of the embodiment of the present invention is that bitstream encoding is performed on a plurality of copy types corresponding to an image region to be encoded, and then a plurality of pixel indexes are bit-stream encoded, and then the plurality of copy values are bit-stream encoded. Thereby, not only the encoding throughput can be improved, but also the bit cost of encoding can be further reduced.

Specific embodiments of the present invention are disclosed in detail with reference to the following description and drawings, indicating the The way that can be adopted. It should be understood that the embodiments of the invention are not limited in scope. The embodiments of the present invention include many variations, modifications, and equivalents within the scope of the appended claims.

Features described and/or illustrated with respect to one embodiment may be used in one or more other embodiments in the same or similar manner, in combination with, or in place of, features in other embodiments. .

It should be emphasized that the term "comprising" or "comprises" or "comprising" or "comprising" or "comprising" or "comprising" or "comprises"

DRAWINGS

Many aspects of the invention can be better understood with reference to the following drawings. The components in the figures are not drawn to scale, but only to illustrate the principles of the invention. In order to facilitate the illustration and description of some parts of the invention, the corresponding parts in the figures may be enlarged or reduced.

Elements and features described in one of the figures or one embodiment of the invention may be combined with elements and features illustrated in one or more other figures or embodiments. In the accompanying drawings, like reference numerals refer to the

1 is a schematic diagram of an example of a coding unit according to an embodiment of the present invention;

2 is a schematic diagram of current bitstream coding;

3 is a schematic flowchart of a method for encoding copy information according to Embodiment 1 of the present invention;

4 is another schematic flowchart of a method for encoding copy information according to Embodiment 1 of the present invention;

FIG. 5 is a schematic diagram of performing bit stream coding according to Embodiment 1 of the present invention; FIG.

6 is a schematic diagram of an apparatus for encoding copy information according to Embodiment 2 of the present invention;

Figure 7 is a block diagram showing the configuration of an image processing apparatus according to a third embodiment of the present invention.

detailed description

The foregoing and other features of the present invention will be apparent from the The specific embodiments of the present invention are disclosed in the specification and the drawings, which are illustrated in the embodiment of the invention The invention includes all modifications, variations and equivalents falling within the scope of the appended claims.

1 is a schematic diagram of an example of a coding unit according to an embodiment of the present invention, showing a coding unit (CU) Case. As shown in FIG. 1, the coding unit has 8 x 8 pixels; wherein the 8 x 8 pixels have different 7 pixel values (representing different colors). For the sake of simplicity, pixels having the same pixel value in FIG. 1 use the same symbol to represent pixel values, for example, C0, C1, ..., C6 are used to represent different pixel values.

Table 1 shows the palette determined by the CU shown in Fig. 1.

Table 1

Pixel index	0	1	2	3	4	5	6
								Pixel values	C0	C1	C2	C3	C4	C5	C6

When the index copy information is adopted, the index copy information generated according to the palette may be as shown in Table 2 below. Table 2 shows the index run information of the CU shown in Fig. 1 which is formed based on the palette of Table 1.

Table 2

Left(0,31)
	Left(2,0)
Above(3)
	Left(3,0)
Left(1,0)
	Left(2,0)
Left(1,0)
	Left(4,0)
Above(6)
	Left(5,0)
Left(6,0)
	Above(5)
Left(1,0)
	Left(2,0)
Above(4)

As shown in FIG. 1, there are pixels in the CU having 32 consecutive pixel values of C0 (the corresponding pixel index in the palette is 0), thus forming the index copy information Left(0, 31) in Table 2; There is one pixel in the CU having a pixel value of C2 (the corresponding pixel index in the palette is 2), thus forming the index copy information Left(2, 0) in Table 2; then having and above in the CU 4 pixels of the same pixel with the same pixel value (like The prime values are C0, C0, C0, C0), respectively, thus forming the index copy information Above(3);

After generating the index copy information as above, bit stream encoding may be performed. For example, for Left (0, 31), pixel index 0, copy type Left (for example, represented by 0), and copy value 31 may be encoded; (3) The copy type Above (for example, indicated by 1) and the copy value of 3 can be encoded.

2 is a schematic diagram of current bitstream encoding. As shown in FIG. 2, in the current SCM 4.0 version, palette related information (for example, palette entry related) and palette index bitmap may be sequentially used. Information, such as a palette index map, is used for bitstream encoding. Wherein, for the palette index bitmap information, the number of the index (number of index) is first encoded, then the pixel index (index) is encoded, and the run type and the run value are used. The encoding is performed interleaved, and then pixels in a non-palette mode (e.g., escape mode) can be encoded.

However, the inventors have found that since the copy type and the copy value are interleaved, the encoding throughput cannot be further improved when an encoding algorithm such as CABAC (Context Adaptive Binary Arithmatic Coding) is employed. The embodiments of the present invention are described in detail below.

Example 1

The embodiment of the present invention provides a method for encoding copy information, and FIG. 3 is a schematic flowchart of a method for encoding copy information according to an embodiment of the present invention. As shown in FIG. 3, the encoding method includes:

Step 301: Determine a pixel index, a copy type, and a copy value corresponding to the image area to be encoded.

Step 302: Perform bitstream encoding on multiple copy types corresponding to the image region to be encoded, and then perform bitstream encoding on a plurality of pixel indexes corresponding to the image region to be encoded, and then corresponding to the to-be-coded Multiple copy values of the image area are bitstream encoded.

In this embodiment, the image area to be encoded may be a coding unit CU or a maximum coding unit LCU (Largest Coding Unit); the following uses CU as an example for description. The embodiment of the present invention is applicable to the case of adopting the palette mode, and the embodiment of the present invention is equally applicable to the case of mixing the palette mode and the non-palette mode (for example, the ease mode).

FIG. 4 is another schematic flowchart of a method for encoding copy information according to an embodiment of the present invention. As shown in FIG. 4, the encoding method includes:

Step 401: Determine a color palette for a plurality of pixels adopting a palette mode in an image region to be encoded;

Step 402, determining, according to the color palette, a plurality of pixel indexes corresponding to the image area to be encoded, and copying Shell type and copy value;

Step 403, performing bitstream encoding on the palette related information.

Step 404: Perform bitstream encoding on the number of multiple pixel indexes corresponding to the image region to be encoded.

Step 405: Perform bitstream encoding on multiple copy types corresponding to the image region to be encoded.

Step 406: Perform bitstream encoding on a plurality of pixel indexes corresponding to the image region to be encoded.

Step 407: Perform bitstream encoding on a plurality of copy values corresponding to the image region to be encoded. as well as

In step 408, the pixels in the non-palette mode are used for bitstream encoding.

It should be noted that the bit stream encoding of the palette, the pixel index, and the like in the image region to be encoded may be implemented by any method in the prior art, which is not limited by the present invention. For the copy type and how the copy run is encoded, the following is schematically illustrated.

FIG. 5 is a schematic diagram of performing bitstream coding according to an embodiment of the present invention. As shown in FIG. 5, different from coding in the prior art in which the copy type and the copy value are interleaved, the copy type and the copy are in the embodiment of the present invention. The values are encoded separately. Wherein, the bit stream is encoded by putting together multiple copy types (ie, group), then the pixel index is bit-stream encoded, and then the multiple copy values are put together for bit stream encoding. This can increase the encoding throughput.

In this embodiment, before the bit stream encoding is performed on the plurality of copy types corresponding to the image region to be encoded, the sequence formed by the plurality of copy types may also be optimized. Taking 0 for the copy left mode and 1 for the copy above mode, in the binary sequence formed after putting multiple copy types together (ie, group), consecutive two 1s do not appear (if continuous copy above occurs) Modes can be combined to form a longer copy above, and the number of bits that appear after 1 can be omitted to save the number of bits.

For example, if a sequence formed by a plurality of copy types is "10001000001010010101010001", the sequence can be optimized to "100100001101111001".

In this embodiment, before the bit stream encoding is performed on the plurality of copy types corresponding to the image region to be encoded, the sequence formed by the multiple copy types corresponding to the image region to be encoded may be binarized. .

The performing a binarization mapping on the sequence formed by the multiple copy types of the image to be encoded may include: dividing the sequence into multiple segments, where each segment includes a 1 and Zero or more (zero, one or more) 0s before 1; and binarization mapping for each segment.

A certain binary sequence "10000000100000110001" is taken as an example for description. The sequence can be divided into The following paragraphs: "1", "00000001", "000001", "1" and "0001".

In this embodiment, for each segment, the specific binarization mapping may include: mapping "1" to "1", "01" to "01", and if a segment has n 0s and a 1 , in the case where n is an even number, the segment is mapped to: m 0 plus "10"; in the case where n is an odd number, the segment is mapped to: m 0 plus "11"; Wherein m is a value obtained by adding 1 to n/2, and n is greater than 1.

For example, for "0000001", 1 has 6 zeros before, n = 6 is even; then m = 4, whereby the segment can be mapped to "000010". For another example, for "00000001", 1 has 7 zeros before, n = 7 is an odd number; then m = 4, whereby the segment can be mapped to "000011".

Table 3 shows the above mapping manner of the embodiment of the present invention. As shown in Table 3, when there are a plurality of 0s before 1, the number of bits to be encoded can be greatly reduced.

table 3

Pre-map sequence	Number of 0 before 1	Binarized mapped sequence	Length after binarization mapping
				1	0	1	1
01	1	01	2
				001	2	0010	4
0001	3	0011	4
				00001	4	00010	5
000001	5	00011	5
				0000001	6	000010	6
00000001	7	000011	6
				000000001	8	0000010	7
0000000001	9	0000011	7
				00000000001	10	00000010	8
000000000001	11	00000011	8
				0000000000001	12	000000010	9
00000000000001	13	000000011	9
				000000000000001	14	0000000010	10
0000000000000001	15	0000000011	10
				...	...	...	...

For example, the binary sequence "10000000100000110001" is still used, and the sequence length is 20. According to the mapping method shown in Table 3, the five segments of the sequence: "1", "00000001", "000001", "1" and "0001" can be mapped to "1", "000011", respectively. 00011", "1" and "0011". Then, the mapped sequence is "10000110001110011" and the length is 17. This can further reduce the bit cost.

It should be noted that the foregoing only schematically illustrates the mapping manner of the embodiment of the present invention, but the present invention is not limited thereto, and the mapping manner may be adjusted or changed according to actual conditions, and the specific implementation may be determined according to the distribution of actual data. the way.

It can be seen from the above embodiment that the bit stream encoding is performed on a plurality of copy types corresponding to the image region to be encoded, and then the plurality of pixel indexes are bit-stream encoded, and then the plurality of copy values are bit-stream encoded. Thereby, not only the encoding throughput can be improved, but also the bit cost of encoding can be further reduced.

Example 2

The embodiment of the present invention provides an encoding apparatus for copying information, which corresponds to the encoding method of the copy information in Embodiment 1, and the same content is not described herein again.

FIG. 6 is a schematic diagram of an apparatus for encoding copy information according to an embodiment of the present invention. As shown in FIG. 6, the encoding apparatus 600 includes:

The information determining unit 601 determines a pixel index, a copy type, and a copy value corresponding to the image region to be encoded;

The bitstream encoding unit 602 performs bitstream encoding on a plurality of copy types corresponding to the image region to be encoded, and then performs bitstream encoding on a plurality of pixel indexes corresponding to the image region to be encoded, and then corresponds to the A plurality of copy values of the encoded image region are described for bitstream encoding.

In this embodiment, the bitstream encoding unit 602 is further configured to perform bitstream encoding on the number of the plurality of pixel indexes corresponding to the image region to be encoded.

As shown in FIG. 6, the encoding apparatus 600 may further include:

The optimizing unit 603 optimizes a sequence formed by a plurality of copy types corresponding to the image region to be encoded.

As shown in FIG. 6, the encoding apparatus 600 may further include:

The mapping unit 604 performs binarization mapping on a sequence formed by multiple copy types corresponding to the image region to be encoded.

In this embodiment, the mapping unit 604 may be specifically configured to: divide the sequence into multiple segments and perform a binarization mapping on each segment, where each segment includes a 1 and a zero before the 1 More than 0.

In addition, the mapping unit 604 may also map each segment as follows: mapping "1" to "1", "01" to "01", and if a segment has n 0s and a 1 In the case where n is an even number, the segment is mapped to: m zeros plus "10"; in the case where n is an odd number, the segments are mapped to: m 0 is added to "11"; wherein m is a value obtained by adding 1 to n/2, and n is greater than 1.

It can be seen from the above embodiment that the bit stream encoding is performed on a plurality of copy types corresponding to the image region to be encoded, and then the plurality of pixel indexes are bit-stream encoded, and then the plurality of copy values are bit-stream encoded. Thereby, not only the encoding throughput can be improved, but also the bit cost of encoding can be further reduced.

Example 3

An embodiment of the present invention provides an image processing apparatus, the image processing apparatus comprising: an image encoder including the encoding apparatus 600 as described in Embodiment 2.

Fig. 7 is a block diagram showing the configuration of an image processing apparatus according to an embodiment of the present invention. As shown in FIG. 7, the image processing apparatus 700 may include a central processing unit (CPU) 100 and a memory 110; the memory 110 is coupled to the central processing unit 100. The memory 110 can store various data; in addition, a program for information processing is stored, and the program is executed under the control of the central processing unit 100.

In one embodiment, the functionality of encoding device 600 may be integrated into central processor 100. The central processing unit 100 may be configured to implement the encoding method of the copy information as described in Embodiment 1. That is, the central processing unit 100 may perform control of: determining a pixel index, a copy type, and a copy value corresponding to the image region to be encoded; and performing bitstream encoding on the plurality of copy types corresponding to the image region to be encoded, and then corresponding to The plurality of pixel indexes of the image area to be encoded are subjected to bit stream encoding, and then the plurality of copy values corresponding to the image area to be encoded are subjected to bit stream encoding.

In another embodiment, the encoding device 600 can be configured separately from the central processing unit 100. For example, the encoding device 600 can be configured as a chip connected to the central processing unit 100, and the functions of the encoding device 600 can be implemented by control of the central processing unit.

In addition, as shown in FIG. 7, the image processing apparatus 700 may further include: an input and output unit 120, a display unit 130, and the like; wherein the functions of the above components are similar to those of the prior art, and are not described herein again. It is to be noted that the image processing apparatus 700 does not necessarily have to include all of the components shown in FIG. 7; in addition, the image processing apparatus 700 may further include components not shown in FIG. 7, and reference may be made to the related art.

In the present embodiment, the image processing apparatus 700 may further include an image decoder that can decode the bit stream accordingly. The image processing apparatus 700 can implement the functions of the image decoder by the control of the central processing unit 100 as described above.

The embodiment of the present invention further provides a computer readable program, wherein the program causes a computer to perform encoding of copy information as described in Embodiment 1 in the image processing device when the program is executed in an image processing device method.

The embodiment of the present invention further provides a storage medium storing a computer readable program, wherein the computer readable program causes the computer to execute the encoding method of the copy information as described in Embodiment 1 in the image processing device.

The above apparatus and method of the present invention may be implemented by hardware or by hardware in combination with software. The present invention relates to a computer readable program that, when executed by a logic component, enables the logic component to implement the apparatus or components described above, or to cause the logic component to implement the various methods described above Or steps. The present invention also relates to a storage medium for storing the above program, such as a hard disk, a magnetic disk, an optical disk, a DVD, a flash memory, or the like.

One or more of the functional blocks described in the figures and/or one or more combinations of functional blocks may be implemented as a general purpose processor, digital signal processor (DSP) for performing the functions described herein. An application specific integrated circuit (ASIC), field programmable gate array (FPGA) or other programmable logic device, discrete gate or transistor logic device, discrete hardware component, or any suitable combination thereof. One or more of the functional blocks described with respect to the figures and/or one or more combinations of functional blocks may also be implemented as a combination of computing devices, eg, a combination of a DSP and a microprocessor, multiple microprocessors One or more microprocessors in conjunction with DSP communication or any other such configuration.

The present invention has been described in connection with the specific embodiments thereof, and it should be understood by those skilled in the art that A person skilled in the art can make various modifications and changes to the present invention within the scope of the present invention.

Claims (14)

1. An encoding method for copying information, the encoding method comprising:

   Determining a pixel index, a copy type, and a copy value corresponding to the image area to be encoded;

   Performing bitstream encoding on a plurality of copy types corresponding to the image region to be encoded, and then performing bitstream encoding on a plurality of pixel indexes corresponding to the image region to be encoded, and then corresponding to the image region to be encoded Multiple copy values are bitstream encoded.
2. The encoding method according to claim 1, wherein the encoding method further comprises: before performing bitstream encoding on the plurality of copy types corresponding to the image region to be encoded, the encoding method further comprises:

   Bitstream encoding is performed on the number of the plurality of pixel indices corresponding to the image region to be encoded.
3. The encoding method according to claim 1, wherein the encoding method further comprises: before performing bitstream encoding on the plurality of copy types corresponding to the image region to be encoded, the encoding method further comprises:

   A sequence formed by a plurality of copy types corresponding to the image area to be encoded is optimized.
4. The encoding method according to claim 1, wherein the encoding method further comprises: before performing bitstream encoding on the plurality of copy types corresponding to the image region to be encoded, the encoding method further comprises:

   A sequence formed by a plurality of copy types corresponding to the image area to be encoded is subjected to binarization mapping.
5. The encoding method according to claim 4, wherein the binarizing mapping of the sequence formed by the plurality of copy types corresponding to the image region to be encoded comprises:

   Dividing the sequence into a plurality of segments, wherein each segment comprises a 1 and zero or more zeros before the 1;

   Binary mapping is performed separately for each segment.
6. The encoding method according to claim 5, wherein separately performing binarization mapping for each segment comprises:

   Map "1" to "1", "01" to "01", and

   If a segment has n zeros and one 1, then in the case where n is even, the segments are mapped to: m zeros plus "10"; where n is odd, the segments are mapped to : m 0 plus "11"; wherein m is a value obtained by adding 1 to n/2, and n is greater than 1.
7. An encoding device for copying information, the encoding device comprising:

   An information determining unit that determines a pixel index, a copy type, and a copy value corresponding to the image region to be encoded;

   a bitstream encoding unit that performs bitstream encoding on a plurality of copy types corresponding to the image region to be encoded, and then performs bitstream encoding on a plurality of pixel indexes corresponding to the image region to be encoded, and then correspondingly Bitstream encoding is performed on a plurality of copy values of the image area to be encoded.
8. The encoding method according to claim 7, wherein the bitstream encoding unit is further configured to perform bitstream encoding on a number of a plurality of pixel indexes corresponding to the image region to be encoded.
9. The encoding device according to claim 7, wherein the encoding device further comprises:

   And an optimization unit that optimizes a sequence formed by the plurality of copy types corresponding to the image region to be encoded.
10. The encoding device according to claim 7, wherein the encoding device further comprises:

    And a mapping unit that performs binarization mapping on a sequence formed by the plurality of copy types corresponding to the image region to be encoded.
11. The image encoding method according to claim 10, wherein the mapping unit is specifically configured to: divide the sequence into a plurality of segments and perform a binarization mapping on each segment, wherein each segment includes a 1 and a Zero or more zeros before 1 are described.
12. The encoding apparatus according to claim 11, wherein said mapping unit performs mapping as follows:

    Map "1" to "1", "01" to "01", and

    If a segment has n zeros and one 1, then in the case where n is even, the segments are mapped to: m zeros plus "10"; where n is odd, the segments are mapped to : m 0 plus "11"; wherein m is a value obtained by adding 1 to n/2, and n is greater than 1.
13. An image processing apparatus, the image processing apparatus comprising:

    An image encoder comprising the encoding device for copying information according to any one of claims 7 to 12.
14. The image processing device according to claim 13, wherein the image processing device further comprises:

    An image decoder that decodes the bitstream to obtain an image.

Images