CN100573656C - The drafting system of Real Time Compression and decompression - Google Patents

Abstract

The invention relates to the drafting system of a kind of Real Time Compression and decompression, comprise a storage device, a decompressing device, a computation engine, one first Real Time Compression device, a temporary storage buffer region, reach one first real-time decompressing device.The compressing image of storage device stores one an elvish compressing image and a background; Decompressing device is carried out decompression operation, and obtains an elfin's image and a background video; Computation engine is carried out image processing to the elfin's image and the background video that decompress, to produce portion of display video; The first Real Time Compression device is carried out Real Time Compression to the show image of part and is handled, and obtains a compressed portion show image; Temporary storage buffer region is kept in the compressed portion show image; The first real-time decompressing device is carried out real-time decompression to the compressed portion show image, and exports a signal of video signal, for demonstration.

Description

The drafting system of Real Time Compression and decompression

Technical field

The present invention relates to a kind of drafting system, the drafting system of particularly a kind of Real Time Compression and decompression.

Background technology

Fig. 1 is the block scheme of known games application platform.On the platform that General Two-Dimensional (two dimension, 2D) recreation is used,, normally elfin's (sprite) image and background (background) image are encoded in advance and be stored in the storage device 110 in order to save operand and bandwidth.And when computation engine (rendering engine, RE) 130 will read elfin's image and background video, a decompressing device 120 was decoded elfin's image and background video again.Computation engine (RE) 130 carries out image processing to elfin's image and background video again, for example carries out transparent processing (alpha blending).Then, computation engine (RE) 130 is stored in a temporary storage buffer region (framebuffer) 112 to the rgb value after the image processing.One display device 140 reads the data of temporary storage buffer region 112 again, and then shows elfin's image and background video.To elfin's image and background video coding the time, the most frequently used method, (variable length coding, VLC) coding can also utilize CLUT (color look-up table, CLUT) or Huffman (Huffman) coding etc. except utilizing variable-length.

When the data that are stored to temporary storage buffer region 112 when computation engine (RE) 130 have been rgb value, can further do coding again at this image.In the application of real-time drawing and imaging system (real-time renderingand display graphic image), known technology is to utilize CLUT (CLUT).That is to say that the data that computation engine (RE) 130 is write temporary storage buffer region 112 no longer are rgb values, but based on pointer (index).When for example an image only needs 256 kinds of colors, then writing temporary storage buffer region 112 required data as long as 8 pointer value.During show image, remove to inquire about a CLUT (CLUT) according to pointer value again and obtain real RGB data, these RGB data can be 16 or 24.Yet the shortcoming of this kind method maximum is to limit the kind of color.

The design of computation engine (RE) 130 at present all drives with command forms, so, after computation engine (RE) 130 must carry out one whole image image processing and finishes, the known coded method is again according to the mode of this image with the decision coding, so the known coded method all can't reach dynamic effect usually.For example work as computation engine (RE) 130 and receive that one will show that elvish order and this elvish position are { (20,20)-(39,39) in the time of }, computation engine (RE) 130 will go 110 to read this elvish data from device, then these elvish data are write { (20 of temporary storage buffer region 112,20)-(39,39) } in the block.When another showed another elvish order and this elvish position for { (10,10)-(49,49) }, so previous shown elfin's image will be capped over.From the above mentioned as can be known, if the rgb value of computation engine (RE) 130 outputs is done the words of compression, after just must waiting computation engine (RE) 130 to handle one whole image, could begin whole image carried out compressed encoding, the waste that therefore can produce many bandwidth also is not suitable for drawing in real time and the framework of imaging system.

And present known mpeg and jpeg code compression method owing to need a large amount of operand and bandwidth, also is not suitable for the application of drawing in real time and imaging system.Because the output of computation engine (RE) 130 is not compressed, so need bigger bandwidth to transmit data to this temporary storage buffer region 112.Therefore be difficult to and 110 be integrated in the same storage arrangement in temporary storage buffer region 112 and the storage device, and increase the system hardware cost.Therefore, known real-time drawing and imaging system still have many defectives and give improved necessity.

Summary of the invention

Fundamental purpose of the present invention provides the drafting system of a kind of Real Time Compression and decompression, to save the bandwidth of computation engine transmission data to a temporary storage buffer region, and can reach the effect of real-time imaging output, reduce the access time of temporary storage buffer region by this, to promote the usefulness of total system.

Another object of the present invention provides the drafting system of a kind of Real Time Compression and decompression, transmits the use amount of data to a temporary storage buffer region to save computation engine, and can reach the effect of real-time imaging output, thereby reduce hardware cost.

In order to achieve the above object, the present invention proposes the drafting system of a kind of Real Time Compression and decompression, comprises a storage device, a decompressing device, a computation engine, one first Real Time Compression device, a temporary storage buffer region and one first real-time decompressing device.The compressing image of at least one elvish compressing image of this storage device stores and at least one background, an and at least one elvish data structure, this data structure comprises a coordinate fields and a depth field at least, the degree of depth when coordinate figure when this coordinate fields writes down this at least one elfin's video picture, this depth field write down this at least one elfin's video picture; This decompressing device is coupled to this storage device, so that the compressing image of this at least one elvish compressing image and this at least one background is carried out decompression operation and obtained at least one elfin's image and at least one background video; This computation engine is coupled to this decompressing device, to carry out image processing to reaching this at least one background video through this at least one elfin's image after decompressing, to produce portion of display video, described computation engine is when the image data of a pixel of obtaining this part show image, coordinate figure during according to elfin's video picture of writing down in the data structure judges whether this pixel drops in elfin's image, if, then with the image data of elvish image as this pixel, if not, then with the image data of background video as this pixel; If this pixel drops in a plurality of elfin's images simultaneously, these elvish depth values relatively then are with the elvish image of the depth value minimum image data as this pixel; This first Real Time Compression device is coupled to this computation engine, handles so that the show image of this part is carried out Real Time Compression, and produces a compressed portion show image; This temporary storage buffer region is coupled to this first Real Time Compression device, with temporary this compressed portion show image; This first real-time decompressing device is coupled to this temporary storage buffer region, so that this compressed portion show image is carried out real-time decompression, and exports a signal of video signal, for demonstration.

In sum, a plurality of pixels after the present invention utilizes the first Real Time Compression device with image processing are carried out Real Time Compression, are sent to the data volume of temporary storage buffer region with saving, in order to access bandwidth that reduces temporary storage buffer region and the hsrdware requirements that reduce temporary storage buffer region.

Description of drawings

Fig. 1 is the block scheme of known games application platform;

Fig. 2 is the block scheme of the drafting system of Real Time Compression of the present invention and decompression;

Fig. 3 is an elvish data structure synoptic diagram of the present invention;

Fig. 4 is the synoptic diagram that computation engine of the present invention is carried out image processing;

Fig. 5 is the synoptic diagram of golomb-rice coding of the present invention computing;

Fig. 6 is the synoptic diagram of packed data form of the present invention;

Fig. 7 is the block scheme of another embodiment of drafting system of Real Time Compression of the present invention and decompression.

Embodiment

The present invention is the drafting system of a kind of Real Time Compression and decompression, when a computation engine executes image processing, a plurality of pixels after the image processing processing are carried out Real Time Compression, bandwidth with data to a temporary storage buffer region after the saving computation engine transmission image processing, and can reach the effect of real-time imaging output, thereby reduce the access time of temporary storage buffer region, to promote the usefulness of total system.

Fig. 2 is the block scheme of the drafting system of Real Time Compression of the present invention and decompression.This drafting system comprises a storage device 210, a decompressing device 220, a computation engine 230, one first Real Time Compression device 240, a temporary storage buffer region (frame buffer) 250,1 first real-time decompressing device 260, reaches a display device 270.

This storage device 210 stores the compressing image of at least one elvish compressing image and at least one background.This decompressing device 220 is coupled to this storage device 210, so that the compressing image of this at least one elvish compressing image and this at least one background is carried out decompression operation and obtained at least one elfin's image and at least one background video.

This computation engine 230 is coupled to this decompressing device 220, so that this at least one elfin's image and this at least one background video that decompress are carried out image processing, to produce portion of display video.This first Real Time Compression device 240 is coupled to this computation engine 230, handles so that the show image of this part is carried out Real Time Compression, and produces a compressed portion show image.

This temporary storage buffer region 250 is coupled to this first Real Time Compression device 240, with temporary this compressed portion show image.This first real-time decompressing device 260 is coupled to this temporary storage buffer region 250, so that this compressed portion show image is carried out real-time decompression, and exports a signal of video signal, for demonstration.This display device 270 is coupled to this first real-time decompressing device 260, to show the signal of video signal of this first real-time decompressing device output.

This storage device 210 is except the compressing image that stores at least one elvish compressing image and at least one background, and this storage device 210 also stores this at least one elvish data structure.Fig. 3 is elvish data structure synoptic diagram, and wherein, this data structure comprises a coordinate fields 310, a depth field 320, reaches a transparent processing field 330.

Position when this coordinate fields 310 is record elfin video picture.The degree of depth (depth) when this depth field 320 is this elfin's video picture of record.Whether carry out transparent processing (alpha blending) during these transparent processing field 330 these elfin's video pictures of record.

Fig. 4 is the synoptic diagram that this computation engine 230 is carried out image processing.In Fig. 4, this storage device 210 stores compressing image 410 and the data structure 420～440 of elfin A, and the compressing image 450 of elfin B and data structure 460～480.(i, in the time of j), this computation engine 230 detects pixel earlier, and (whether i j) drops in elfin's image the pixel of this computation engine 230 processing one show image 490.That is to say that (i is j) with the coordinate 420 of elfin A, the coordinate 460 of elfin B for these computation engine 230 compared pixels.For example, pixel (0,0) does not drop in the coordinate of the coordinate of elfin A and elfin B, so this computation engine 230 obtains the image of background, as pixel (0,0) image data.Pixel (1,3) drops in the coordinate of elfin A, but does not drop in the coordinate of elfin B, so this computation engine 230 obtains the image of elfin A, as pixel (1,3) image data.Pixel (3,5) drops in the coordinate of elfin A and in the coordinate of elfin B, but the degree of depth of elfin B be 1 and the degree of depth of elfin A be 2, so this computation engine 230 obtains the image of elfin B, as pixel (3,5) image data.

This computation engine 230 is when processed pixels (1,3), and the transparent processing of elfin A is 0, so this computation engine 230 obtains the image of the corresponding position of elfin A, as pixel (1,3) image data.If the transparent processing of elfin A is 1, after then this computation engine 230 is done transparent processing (alpha blending) with the image of elfin A corresponding position and background video, again with the image data after the transparent processing as pixel (1,3) image data.

This computation engine 230 then is one group with these 8 pixels and is sent to this first Real Time Compression device 240 after carrying out image processing at per 8 pixels.

240 pairs of these 8 pixel values of this first Real Time Compression device are carried out Hadamard conversion (HadamardTransform), to obtain the frequency domain value of these a plurality of pixels.This Hadamard conversion can use formula (1) to describe:

$\left[\begin{array}{cccccccc}1& 1& 1& 1& 1& 1& 1& 1\\ 1& 1& 1& 1& -1& -1& -1& -1\\ 1& 1& -1& -1& -1& -1& 1& 1\\ 1& 1& -1& -1& 1& 1& -1& -1\\ 1& -1& -1& 1& 1& -1& -1& 1\\ 1& -1& -1& 1& -1& 1& 1& -1\\ 1& -1& 1& -1& -1& 1& -1& 1\\ 1& -1& 1& -1& 1& -1& 1& -1\end{array}\right]\left[\begin{array}{c}p0\\ p1\\ p2\\ p3\\ p4\\ p5\\ p6\\ \mathrm{<figure-callout\; id="7"\; label="p"\; filenames="C2006100598260014H2.png"\; state="\{\{state\}\}">p</figure-callout>}7\end{array}\right]=\left[\begin{array}{c}h0\\ h1\\ h2\\ h3\\ h4\\ h5\\ h6\\ \mathrm{<figure-callout\; id="7"\; label="h"\; filenames="C2006100598260014H2.png"\; state="\{\{state\}\}">h</figure-callout>}7\end{array}\right],---\left(1\right)$

Wherein, p0～p7 is these 8 pixel values, and h0～h7 is the frequency domain value of these 8 pixel values.H0 can be considered D. C. value (DC term), and h1～h7 can be considered interchange value (AC term).When the form of this show image 490 was RGB, p0～p7 was R value, G value or the B value of these 8 pixels.When the form of this show image 490 was YUV, p0～p7 was Y value, U value or the V value of these 8 pixels.

This first Real Time Compression device 240 is carried out the computing of golomb-rice coding to h1～h7 again.Fig. 5 is the synoptic diagram of golomb-rice coding computing.For example, h1 is-6, and the computing of golomb-rice coding is earlier with 6 divided by 4, is 1 and obtain the merchant, and remainder is 2.Because remainder is that 2 event field B are 10.Because the merchant is that 1 event field A is 01.If the merchant is that 2 field A are 001,, analogize in regular turn if the merchant is that 3 field A are 0001.Because h1 is-6, so the sign field is 1.So h1 is, behind the golomb-rice coding, produce 01101 at-6 o'clock _b

Data after this first Real Time Compression device 240 is encoded according to h0 and golomb-rice produce a packed data corresponding to these 8 pixel p 0～p7.Fig. 6 is the synoptic diagram of the form of this packed data.Because h0 is a D. C. value (DC term), so with direct current field 620 record h0, wherein, direct current field 620 is 8.H1～h7 is interchange value (AC term), and its value approaches 0, so can be positioned over behind golomb-rice coding in 29 the interchange field 630.

If the figure place of h1～h7 behind golomb-rice coding is during greater than 29, just h1～h7 can't be positioned over behind golomb-rice coding in 29 the interchange field 630, then, again the h1 after the displacement～h7 is carried out the golomb-rice coding earlier with 1 of h1～h7 displacement to the right (just with the value of h1～h7 divided by 2).Simultaneously, in displacement field 610, write down 001 _b, with 1 of expression h1～h7 displacement to the right.If still can't be positioned in 29 the interchange field 630, then, again the h1 after the displacement～h7 is carried out the golomb-rice coding earlier with 2 of h1～h7 displacements to the right (just with the value of h1～h7 divided by 4).Simultaneously, in displacement field 610, write down 010 _b, with 2 of expression h1～h7 displacements to the right.The rest may be inferred, in the coded data behind the golomb-rice coding being positioned over 29 interchange field 630 till.

240 packed datas of inciting somebody to action as shown in Figure 6 of this first Real Time Compression device write in this temporary storage buffer region 250.When wanting show image, this first real-time decompressing device 260 reads packed data from this temporary storage buffer region 250, and after this packed data carried out anti-golomb-rice decoding computing, to obtain frequency domain value h1～h7 that should a plurality of pixels.

During decompression, please,, represent that corresponding hi (i=1～7) accounts for 4 in this packed data, and the size of hi is the summation of the product of " value of field B " and " value of displacement field " when field A is 1 in the lump with reference to this packed data form of Fig. 6.Field A is 01, and the corresponding hi (i=1～7) of expression accounts for 5 in this packed data, and the size of hi is the summation of the product of " value of 4+ field B " and " value of displacement field ".Field A is 001, and the corresponding hi (i=1～7) of expression accounts for 6 in this packed data, and the size of hi is the summation of the product of " value of 4 * 2+ field B " and " value of displacement field ".Analogize in regular turn, can obtain frequency domain value h1～h7 that should a plurality of pixels.

This first real-time decompressing device 260 can obtain should a plurality of pixel value p0～p7 after the frequency domain value h0～h7 to these a plurality of pixels carries out anti-Hadamard conversion (inverse Hadamard Transform) computing.This anti-Hadamard conversion can use formula (2) to describe:

$\frac{1}{8}\left[\begin{array}{cccccccc}1& 1& 1& 1& 1& 1& 1& 1\\ 1& 1& 1& 1& -1& -1& -1& -1\\ 1& 1& -1& -1& -1& -1& 1& 1\\ 1& 1& -1& -1& 1& 1& -1& -1\\ 1& -1& -1& 1& 1& -1& -1& 1\\ 1& -1& -1& 1& -1& 1& 1& -1\\ 1& -1& 1& -1& -1& 1& -1& 1\\ 1& -1& 1& -1& 1& -1& 1& -1\end{array}\right]\left[\begin{array}{c}h0\\ h1\\ h2\\ h3\\ h4\\ h5\\ h6\\ \mathrm{<figure-callout\; id="7"\; label="h"\; filenames="C2006100598260014H2.png"\; state="\{\{state\}\}">h</figure-callout>}7\end{array}\right]=\left[\begin{array}{c}p0\\ p1\\ p2\\ p3\\ p4\\ p5\\ p6\\ \mathrm{<figure-callout\; id="7"\; label="p"\; filenames="C2006100598260014H2.png"\; state="\{\{state\}\}">p</figure-callout>}7\end{array}\right].---\left(2\right)$

This first real-time decompressing device 260 is sent to this display device 270 with a plurality of pixel value p0～p7 again via a plurality of pixel value p0～p7 of anti-Hadamard conversion acquisition spatial domain (spatialdomain), to show corresponding image.

In present embodiment, this storage device 210 and this temporary storage buffer region 250 can be storer.When this storage device 210 and this temporary storage buffer region 250 were storer, this storage device 210 and this temporary storage buffer region 250 can be integrated in the same storer.

Fig. 7 is the block scheme of another embodiment of drafting system of Real Time Compression of the present invention and decompression.Itself and the main difference of Fig. 2 are newly-increased data supply device 710 among Fig. 7, one second Real Time Compression device 720, reach one second real-time decompressing device 730.

This data supply device 710 is in order to provide the image data of an object.This data supply device 710 can be a CCD image capture unit or a CMOS image capture unit.

This second Real Time Compression device 720 is coupled to this data supply device 710, handles so that this object image is carried out Real Time Compression, and the object image with compression is stored in this temporary storage buffer region 250 again.This second real-time decompressing device 730 is coupled to this temporary storage buffer region 250, carries out real-time decompression with the object image to this compression, to obtain this object image.This computation engine 230 is coupled to this second real-time decompressing device 730, so that this object image is stacked on this show image (superimposed).

In sum, the present invention utilizes the first Real Time Compression device 240 that a plurality of pixels after the image processing are carried out Real Time Compression after computation engine 230 executes image processing, be sent to the data volume of temporary storage buffer region 250 with saving, in order to access bandwidth that reduces temporary storage buffer region 250 and the hsrdware requirements that reduce temporary storage buffer region 250.Generally speaking, the main outstanding technical characterictic of the present invention has three: the first, because the output data of computation engine (RE) 230 is compressed, so compared to known technology, only need less bandwidth can transmit data to this temporary storage buffer region 250, and utilize the first real-time decompressing device 260 to carry out in real time and decompress, and reach the effect that real-time imaging is exported; The second, owing to be compressed through the output data of computation engine, data volume significantly reduces, and can reduce the access time of temporary storage buffer region 250 by this, to promote the usefulness of total system; At last, the minimizing of related data reduces the hsrdware requirements of temporary storage buffer region indirectly, therefore can will 210 be integrated in the same storage arrangement in temporary storage buffer region 250 and the storage device, more and then reduce the effect of system hardware cost.

The foregoing description only is to give an example for convenience of description, and the interest field that the present invention advocated should be as the criterion so that claim is described certainly, but not only limits to the foregoing description.

Claims (15)

1, the drafting system of a kind of Real Time Compression and decompression comprises:

One storage device, it stores at least one elvish compressing image and at least one background video, an and at least one elvish data structure, this data structure comprises a coordinate fields and a depth field at least, the degree of depth when coordinate figure when this coordinate fields writes down this at least one elfin's video picture, this depth field write down this at least one elfin's video picture;

One decompressing device is coupled to this storage device, so that the compressing image of this at least one elvish compressing image and this at least one background is carried out decompression operation and obtained at least one elfin's image and at least one background video;

One computation engine, be coupled to this decompressing device, so that this at least one elfin's image and this at least one background video that decompress are carried out image processing, to produce portion of display video, described computation engine is when the image data of a pixel of obtaining this part show image, coordinate figure during according to elfin's video picture of writing down in the data structure judges whether this pixel drops in elfin's image, if, then with the image data of elvish image as this pixel, if not, then with the image data of background video as this pixel; If this pixel drops in a plurality of elfin's images simultaneously, these elvish depth values relatively then are with the elvish image of the depth value minimum image data as this pixel;

One first Real Time Compression device is coupled to this computation engine, handles so that the show image of this part is carried out Real Time Compression, and obtains a compressed portion show image;

One temporary storage buffer region is coupled to this first Real Time Compression device, with temporary this compressed portion show image; And

One first real-time decompressing device is coupled to this temporary storage buffer region, so that this compressed portion show image is carried out real-time decompression, and exports a signal of video signal, for demonstration.

2, the drafting system of Real Time Compression as claimed in claim 1 and decompression also comprises a display device, and it is coupled to this first real-time decompressing device, to show the signal of video signal of this first real-time decompressing device output.

3, the drafting system of Real Time Compression as claimed in claim 1 and decompression, wherein, this data structure also comprises a transparent processing field, whether carries out transparent processing during this at least one elfin's video picture of this transparent processing field record.

4, the drafting system of Real Time Compression as claimed in claim 3 and decompression, wherein, this computation engine is that this at least one elfin's image and this at least one background video are done a transparent processing.

5, the drafting system of Real Time Compression as claimed in claim 1 and decompression, wherein, this first Real Time Compression device is that these a plurality of pixel values are carried out the Hadamard conversion, to obtain the frequency domain value of these a plurality of pixels.

6, the drafting system of Real Time Compression as claimed in claim 5 and decompression, wherein, this first Real Time Compression device is after these a plurality of frequency domain value are carried out the computing of golomb-rice coding, to obtain a packed data, again this packed data is stored to this temporary storage buffer region corresponding to these a plurality of pixels.

7, the drafting system of Real Time Compression as claimed in claim 6 and decompression, wherein, this first real-time decompressing device is after this packed data is carried out anti-golomb-rice decoding computing, to obtain frequency domain value that should a plurality of pixels.

8, the drafting system of Real Time Compression as claimed in claim 7 and decompression, wherein, this first real-time decompressing device is after the frequency domain value of these a plurality of pixels is carried out anti-Hadamard translation operation, to obtain should a plurality of pixel values.

9, the drafting system of Real Time Compression as claimed in claim 5 and decompression, wherein, these a plurality of pixels are 8 pixels.

10, the drafting system of Real Time Compression as claimed in claim 1 and decompression, wherein, this storage device and this temporary storage buffer region are storer.

11, the drafting system of Real Time Compression as claimed in claim 10 and decompression, wherein, this storage device and this temporary storage buffer region are to be integrated in the same storer.

12, the drafting system of Real Time Compression as claimed in claim 2 and decompression, it more comprises:

One data supply device, it is in order to provide the image data of an object;

One second Real Time Compression device is coupled to this data supply device, handles so that this object image is carried out Real Time Compression, and obtains an object image that compresses, and the object image that will compress again is stored in this temporary storage buffer region; And

One second real-time decompressing device is coupled to this temporary storage buffer region, carries out real-time decompression with the object image to this compression, to obtain this object image.

13, the drafting system of Real Time Compression as claimed in claim 12 and decompression, wherein, this computation engine is coupled to this second real-time decompressing device, so that this object image is stacked on this show image.

14, the drafting system of Real Time Compression as claimed in claim 13 and decompression, wherein, this data supply device is an image capture unit.

15, the drafting system of Real Time Compression as claimed in claim 14 and decompression, wherein, this image capture unit is a CCD image capture unit or a CMOS image capture unit.

Images