CN104168482A - Method and device for video coding and decoding - Google Patents

Abstract

The invention discloses a method and a device for video coding and decoding. Because in the process of decoding the, layer division can be performed on all original video images to be coded from the pixel level, the technical scheme the invention discloses can more flexibly support the layer level expression during the video coding process and can improve the accuracy of couture description of the video image during the video coding process. Furthermore, the invention can incorporate the pixel attribute identification value for reflecting video content hierarchy corresponding to all pixels in the original video images in an output video bit stream in order to decode the original video image while decoding the pixel attribute identification information of all pixels and to extract the objects of different hierarchies according to the pixel attribute identification information of all pixels, and can more flexibly support the expression of the hierarchy of the object in the process of video decoding and can improve the accuracy of expressing the couture of the video image in the process of video decoding.

Description

A kind of video coding-decoding method and device

Technical field

The present invention relates to video coding and decoding technology field, relate in particular to a kind of video coding-decoding method and device.

Background technology

In recent years, along with video system is in the extensive use of every field, the technology of various video encoding optimizations is all in fast development.The technology of wherein, carrying out targetedly video encoding optimization for the subjective implication of video more and more receives the concern of academia and industrial circle especially.This class technology is divided into background area and some foreground area (foreground area according to the subjective implication of video by picture conventionally, be called again area-of-interest (ROI, Region Of Interest), be that spectators are subjective to the more interested region of this video pictures), and by division prospect, background area, again in conjunction with coding techniques to reach in the situation that code check is certain, optimize the object of video quality of respective regions.

That is to say, in the prior art, in the time carrying out Video coding, normally treat video content according to ROI and carry out layering.Because the lumpiness of ROI is conventionally larger, thereby layering lumpiness can cause treating video content and carrying out layering based on ROI time is larger, makes to support neatly the layering of object in video encoding-decoding process; In addition, because the lumpiness of ROI is conventionally larger, also can make to a certain extent the profile of video image describe accurate not.Therefore, need badly and provide a kind of new coding and decoding video mode to address the above problem.

Summary of the invention

The embodiment of the present invention provides a kind of video coding-decoding method and device, larger in order to solve the layering lumpiness due to video content of current existence, make to support neatly the layering of object in video encoding-decoding process and the profile of video image is described to the problems such as accurate not.

The embodiment of the present invention provides a kind of method for video coding, comprising:

For the arbitrary raw video image in raw video image sequence to be encoded, determine the pixel property of the each pixel in described raw video image, and according to the pixel property of each pixel of determining, generate the pixel property image corresponding with described raw video image; Wherein, for arbitrary pixel, the pixel property of described pixel with corresponding with the pixel property of described pixel, represent for the pixel property ident value that reflects the corresponding video content level of described pixel;

Respectively described raw video image and described pixel property image are encoded, to obtain corresponding raw video image coding stream and pixel property Image Coding bit stream, and the raw video image coding stream obtaining and pixel property Image Coding bit stream are write to output video bit stream.

Correspondingly, the embodiment of the present invention also provides a kind of video encoding/decoding method, comprising:

Receive raw video image coding stream and the pixel property Image Coding bit stream of input; Wherein, described raw video image coding stream and described pixel property Image Coding bit stream are respectively to obtain after raw video image to be encoded and the pixel property image corresponding with described raw video image are encoded; Described pixel property image is to generate according to the pixel property of the each pixel in the described raw video image of determining; Wherein, for arbitrary pixel, the pixel property of described pixel with corresponding with the pixel property of described pixel, represent for the pixel property ident value that reflects the corresponding video content level of described pixel;

Described raw video image coding stream and/or described pixel property Image Coding bit stream are decoded, to obtain corresponding raw video image and/or pixel property image;

The raw video image and/or the pixel property image that obtain according to decoding, generate corresponding output video image.

Further, the embodiment of the present invention also provides a kind of video coding apparatus, comprising:

Attribute determination module, for the arbitrary raw video image for raw video image sequence to be encoded, determines the pixel property of the each pixel in described raw video image; Wherein, for arbitrary pixel, the pixel property of described pixel with corresponding with the pixel property of described pixel, represent for the pixel property ident value that reflects the corresponding video content level of described pixel;

Image generation module, for according to the pixel property of each pixel of the definite described raw video image of described attribute determination module, generates the pixel property image corresponding with described raw video image;

Image coding module, for respectively described raw video image and described pixel property image being encoded, to obtain corresponding raw video image coding stream and pixel property Image Coding bit stream;

Coding output module, writes output video bit stream for raw video image coding stream and the pixel property Image Coding bit stream obtaining that described image coding module is encoded.

Further, the embodiment of the present invention also provides a kind of video decoder, comprising:

Code stream receiver module, for receiving raw video image coding stream and the pixel property Image Coding bit stream of input; Wherein, described raw video image coding stream and described pixel property Image Coding bit stream are respectively to obtain after raw video image to be encoded and the pixel property image corresponding with described raw video image are encoded; Described pixel property image is to generate according to the pixel property of the each pixel in the described raw video image of determining; Wherein, for arbitrary pixel, the pixel property of described pixel with corresponding with the pixel property of described pixel, represent for the pixel property ident value that reflects the corresponding video content level of described pixel;

Code stream decoding module, decodes for described raw video image coding stream and/or described pixel property Image Coding bit stream that described code stream receiver module is received, to obtain corresponding raw video image and/or pixel property image;

Image generation module, for the raw video image and/or the pixel property image that obtain according to described code stream decoding module decoding, generates corresponding output video image.

Beneficial effect of the present invention is as follows:

The embodiment of the present invention provides a kind of video coding-decoding method, in technical scheme described in the embodiment of the present invention, due in cataloged procedure, can carry out layering to each raw video image to be encoded from Pixel-level, therefore can support more neatly the layering of object in video coding process, and, also can reach to a certain extent the effect that improves the accuracy of in video coding process, the profile of video image being described.Have again, due in cataloged procedure, also the pixel property ident value of the corresponding video content level of each pixel for reflecting raw video image also can be enrolled to output video bit stream, so that also decodable code goes out the pixel property identification information of the each pixel in raw video image in decoding raw video image, and then according to the pixel property identification information of each pixel, extract the object of different levels, thereby also can reach the layering of supporting more neatly object in video decoding process and the object that improves the accuracy of in video decoding process, the profile of video image being described.

Brief description of the drawings

In order to be illustrated more clearly in the technical scheme in the embodiment of the present invention, below the accompanying drawing of required use during embodiment is described is briefly introduced, apparently, accompanying drawing in the following describes is only some embodiments of the present invention, for those of ordinary skill in the art, do not paying under the prerequisite of creative work, can also obtain according to these accompanying drawings other accompanying drawing.

Figure 1 shows that the schematic flow sheet of method for video coding described in the embodiment of the present invention one;

Figure 2 shows that the schematic flow sheet of video encoding/decoding method described in the embodiment of the present invention two;

Fig. 3 (a) is depicted as the structural representation one of video coding apparatus described in the embodiment of the present invention three;

Fig. 3 (b) is depicted as the structural representation two of video coding apparatus described in the embodiment of the present invention three;

Fig. 4 (a) is depicted as the structural representation one of video decoder described in the embodiment of the present invention four;

Fig. 4 (b) is depicted as the structural representation two of video decoder described in the embodiment of the present invention four.

Embodiment

The embodiment of the present invention provides a kind of video coding-decoding method, in technical scheme described in the embodiment of the present invention, due in cataloged procedure, can carry out layering to each raw video image to be encoded from Pixel-level, therefore the layering of object in video coding process can be supported more neatly, and the effect that improves the accuracy of in video coding process, the profile of video image being described can be reached.Have again, due in cataloged procedure, also the pixel property ident value of the corresponding video content level of each pixel for reflecting raw video image also can be enrolled to output video bit stream, so that also decodable code goes out the pixel property identification information of the each pixel in raw video image in decoding raw video image, and then according to the pixel property identification information of each pixel, extract the object of different levels, thereby also can reach the layering of supporting more neatly object in video decoding process and the object that improves the accuracy of in video decoding process, the profile of video image being described.

In order to make the object, technical solutions and advantages of the present invention clearer, below in conjunction with accompanying drawing, the present invention is described in further detail, and obviously, described embodiment is only the present invention's part embodiment, instead of whole embodiment.Based on the embodiment in the present invention, those of ordinary skill in the art, not making all other embodiment that obtain under creative work prerequisite, belong to the scope of protection of the invention.

Embodiment mono-:

As shown in Figure 1, it is the schematic flow sheet of method for video coding described in the embodiment of the present invention one, and described method for video coding can comprise the following steps:

Step 101: for the arbitrary raw video image in raw video image sequence to be encoded, determine the pixel property of the each pixel in described raw video image, and according to the pixel property of each pixel of determining, generate the pixel property image corresponding with described raw video image; Wherein, for arbitrary pixel, the pixel property of described pixel with corresponding with the pixel property of described pixel, represent for the pixel property ident value that reflects the corresponding video content level of described pixel.

Particularly, in technical scheme described in the embodiment of the present invention, described pixel property at least can comprise in following attribute information any one or multiple: for representing that pixel is the scene properties information of foreground pixel or background pixel, scene depth, for representing that pixel is the sound state attribute information of static pixels or dynamic pixel, hiding relation, or, texture information etc., improve to reach the rich and accuracy that pixel property is determined, and and then improve follow-up alternative while each pixel being carried out to layering with corresponding pixel property and the object of flexibility, the embodiment of the present invention is not limited in any way this.

Further, for arbitrary pixel, for reflecting that the pixel property ident value of the corresponding video content level of described pixel can be the brightness value of setting or the chromatic value of setting conventionally.That is to say, in technical scheme described in the embodiment of the present invention, can adopt specific brightness value or specific chromatic value to represent the corresponding video content level of each pixel.Certainly it should be noted that, also can adopt the ident value of other settings to represent the corresponding video content level of each pixel, the embodiment of the present invention is not also limited in any way this.

Further, it should be noted that, in technical scheme described in the embodiment of the present invention, due to for arbitrary pixel, the pixel property of determined described pixel can be multiple, therefore, correspondingly, the pixel property ident value corresponding with the pixel property of described pixel also can be multiple (mode that can comprise the pixel property mark set of at least one pixel property ident value represents), and, each pixel property ident value is can be respectively unique corresponding with a pixel property in multiple pixel properties of described pixel, and can be used for reflecting while video content being carried out to layering with attribute information corresponding to described pixel property, the corresponding video content level of described pixel.For example, the pixel property of supposing determined described pixel comprises scene properties information, scene depth and texture information, correspondingly, the pixel property ident value corresponding with the pixel property of described pixel can be expressed as { A, B, the form of C}, wherein, described ident value A can be corresponding with described scene properties information, and described ident value B can be corresponding with described scene depth, described ident value C can be corresponding with described texture information, and the embodiment of the present invention does not repeat this.

Further, it should be noted that, in technical scheme described in the embodiment of the present invention, video content is carried out to layering and refer to and as required video content is divided into the different levels such as background or prospect.Wherein, video content is divided into the object that how many layer and every one deck refer to and all can sets according to actual conditions, the embodiment of the present invention is not limited in any way this.

Further, in technical scheme described in the embodiment of the present invention, due to for arbitrary pixel, the pixel property of described pixel can be corresponding with the pixel property of described pixel, represent for the pixel property ident value that reflects the corresponding video content level of described pixel, therefore, after determining the pixel property of the each pixel in raw video image, and before generating corresponding pixel property image according to the pixel property of each pixel of determining, also can determine the pixel property ident value of the each pixel in described raw video image.

Particularly, for arbitrary raw video image, can determine in the following manner the pixel property ident value of the each pixel in described raw video image:

Mode one: according to the pixel property of the each pixel in described raw video image, described raw video image is divided into multiple image-regions; For example, taking the pixel property of each pixel of determining as scene depth is as example, scene depth can be not more than to each pixel of setting the first depth threshold and be divided to the first image-region; Scene depth is greater than and sets the first depth threshold, and be not more than each pixel of setting the second depth threshold and be divided to the second image-region; And, scene depth is greater than to each pixel of setting the second depth threshold and is divided to the 3rd image-region; Wherein, described the first depth threshold is less than described the second depth threshold;

For arbitrary image-region, determine the corresponding video content level of described image-region; For example, according to preset rules, above-mentioned the first image-region is defined as to the first video content level; Above-mentioned the second image-region is defined as to the second video content level; And, above-mentioned the 3rd image-region is defined as to the 3rd video content level;

The pixel property ident value of the each pixel using the pixel property ident value corresponding with definite video content level in described image-region; For example, can be using the pixel property ident value " 0 " corresponding with described the first video content level the pixel property ident value of the each pixel in described the first image-region; The pixel property ident value of the each pixel using the pixel property ident value " 1 " corresponding with described the second video content level in described the second image-region; And, can be using the pixel property ident value " 2 " corresponding with described the 3rd video content level the pixel property ident value of the each pixel in described the 3rd image-region, the embodiment of the present invention does not repeat this.

Mode two: taking the multiple raw video images in described raw video image sequence to be encoded as training set, generating scene image; By described scene image image as a setting, determine the pixel property ident value of the each pixel in described raw video image.

Particularly, taking the multiple raw video images in described raw video image sequence to be encoded as training set, generating scene image, can comprise:

Taking the multiple raw video images in described raw video image sequence to be encoded as training set, use the slip Mean Method of slip Mean Method or sectionally weighting, generating scene image.Wherein, in the time using the slip Mean Method generating scene image of sectionally weighting, in the process of calculating slip average, can in real time the historical pixel value of each input pixel be divided into several data segments, afterwards, can, according to the average of each data segment and length, calculate the model value of current pixel position, thereby train scene image.It should be noted that, utilize the scene image that this kind of method generates relatively to adopt the scene image picture of common slip Mean Method generation more clean.

In addition, it should be noted that, in technical scheme described in the embodiment of the present invention, can carry out the generation of a scene image every some frames (being some raw video images), and newly-generated scene image is upgraded to old scene image, to realize the regular or real-time update of scene image and to ensure the accuracy that pixel property ident value is definite.

Further, in technical scheme described in the embodiment of the present invention, by described scene image image as a setting, determine the pixel property ident value of the each pixel in described raw video image, can comprise:

Described scene image and described raw video image are reduced (as, the brightness value of the each pixel in the brightness value of the each pixel in described scene image and described raw video image is carried out to phase reducing), obtain with pixel property ident value (particularly, in the time carrying out the subduction of image taking brightness value as basis, the pixel property ident value obtaining is conventionally also for corresponding brightness value) image; Afterwards, use the filling algorithm (as four connection filling algorithms or eight are communicated with filling algorithm) of setting, remove described with the noise pixel in the image of pixel property ident value, and according to the image obtaining after denoising, determine the pixel property ident value of the each pixel in described raw video image.

Further, after obtaining the pixel property ident value of the each pixel in described raw video image, can, according to the pixel property ident value of the each pixel in described raw video image, generate corresponding pixel property image.

Further, it should be noted that, because the corresponding interval range of pixel property ident value of the each pixel in described raw video image is too small, in the time of coded quantization, have more distortion; And, if the corresponding interval range of pixel property ident value of the each pixel in described raw video image is too large, can increase significantly the code check of coding stream.Therefore, in technical scheme described in the embodiment of the present invention, after obtaining the pixel property ident value of the each pixel in described raw video image, can carry out quantification treatment to pixel property ident value corresponding to the pixel property of the each pixel in described raw video image, the pixel property ident value of the each pixel in described raw video image is limited in an interval range of reasonably setting, afterwards, again according to the pixel property ident value of the each pixel in the described raw video image after quantification treatment, generate the pixel property image corresponding with described raw video image.

Wherein, the interval range of described setting can the layering number of plies when video content is carried out to layering determine, the layering number of plies is more, and the interval range of described setting can be larger, and the embodiment of the present invention is not limited in any way this.

Step 102: respectively described raw video image and described pixel property image are encoded, to obtain corresponding raw video image coding stream and pixel property Image Coding bit stream, and the raw video image coding stream obtaining and pixel property Image Coding bit stream are write to output video bit stream.

Particularly, in technical scheme described in the embodiment of the present invention, can adopt respectively applicable coded system to encode to described raw video image and described pixel property image.Wherein, the beneficial effect of coding is respectively, can choose corresponding coding stream according to corresponding solution code requirement and decode, to improve the flexibility of decoding when decoding.For example, if only need to obtain corresponding raw video image, the raw video image coding stream of can only decoding, obtain the information that raw video image is more detailed if also need, as pixel property information or the pixel property identification information etc. of the each pixel in raw video image, the corresponding pixel property Image Coding bit stream etc. of also can further decoding, the embodiment of the present invention does not repeat this.

Further, so that described raw video image is encoded to example, in technical scheme described in the embodiment of the present invention, can utilize existing method for video coding (or can be described as ordinary video coding method), as efficient video coding (High-Efficiency Video Coding, HEVC H.265) method etc. encodes to described raw video image, to obtain corresponding raw video image coding stream; Or, can utilize the method for video coding based on pixel property after optimization to encode to described raw video image, to obtain corresponding raw video image coding stream.

Wherein, the method for video coding based on pixel property after described optimization refers to, in the time of encode video image, according to the pixel property identification information of the each pixel in video image, the macro block of video image is classified, for different classes of macro block, use different coded system (as used different estimation, reference frame management, model selection, conversion, quantification and entropy coding strategy etc.) to encode.For example, so that described raw video image is encoded to example, described raw video image (or scene image) can be divided into constant macro block and change two kinds of macro blocks; And, for constant macro block, can be with reference to former frame raw video image (or scene image), adopt the mode of inter prediction to encode; And, for changing macro block, can adopt the mode of infra-frame prediction to encode, the embodiment of the present invention does not repeat this.

Similarly, so that described pixel property image is encoded to example, can utilize existing method for video coding, as HEVC H.26 method etc. to as described in pixel property image encode, to obtain corresponding pixel property Image Coding bit stream; Or, can utilize the method for video coding based on pixel property after optimization to encode to described pixel property image, to obtain corresponding pixel property Image Coding bit stream, the embodiment of the present invention does not repeat this.It should be noted that, when the method for video coding based on pixel property after utilization is optimized is encoded to described pixel property image, can limit the use of infra-frame prediction mode, to improve the usage ratio of SKIP pattern; And, in order to reduce coding distortion, also can be disabled for the loop filtering of removing blocking effect, the embodiment of the present invention does not repeat this.

Further, in order to realize the differentiation of coding stream, in technical scheme described in the embodiment of the present invention, the method for video coding adopting when described raw video image and described pixel property image are encoded can be different; Certainly, it should be noted that, the method for video coding adopting when described raw video image and described pixel property image are encoded also can be mutually identical, and the embodiment of the present invention is not limited in any way this.

Further, in technical scheme described in the embodiment of the present invention, respectively described raw video image and described pixel property image are being encoded, when obtaining corresponding raw video image coding stream and pixel property Image Coding bit stream, the identification information of the method for video coding that also can adopt when described raw video image and described pixel property image are encoded enrolls respectively corresponding raw video image coding stream and pixel property Image Coding bit stream; Or, also the identification information that for presentation code bit stream is described raw video image coding stream or described pixel property Image Coding bit stream can be enrolled respectively to corresponding raw video image coding stream and pixel property Image Coding bit stream, the embodiment of the present invention does not repeat this.

Further, in technical scheme described in the embodiment of the present invention, respectively described raw video image and described pixel property image are being encoded, after obtaining corresponding raw video image coding stream and pixel property Image Coding bit stream, the raw video image coding stream obtaining and pixel property Image Coding bit stream synchronously can be write to output video bit stream, to complete the video coding process for described raw video image.

Particularly, in the time that the raw video image coding stream obtaining and pixel property Image Coding bit stream are synchronously write to output video bit stream, can in coding stream, insert corresponding timestamp with synchronous raw video image coding stream and pixel property Image Coding bit stream, the embodiment of the present invention does not repeat this.

The embodiment of the present invention one provides a kind of method for video coding, in technical scheme described in the embodiment of the present invention one, due in cataloged procedure, can carry out layering to each raw video image to be encoded from Pixel-level, therefore compared to of the prior art based on ROI lumpiness concerning video image carries out layering, can support more neatly the layering of object in video coding process, and can reach the effect that improves the accuracy of in video coding process, the profile of video image being described.Have again, due in cataloged procedure, also the pixel property ident value of the corresponding video content level of each pixel for reflecting raw video image also can be enrolled to output video bit stream, so that also decodable code goes out the pixel property identification information of the each pixel in raw video image in decoding raw video image, and then according to the pixel property identification information of each pixel, extract the object of different levels, therefore, also can reach the layering of supporting more neatly object in video decoding process and the object that improves the accuracy of in video decoding process, the profile of video image being described.

Embodiment bis-:

As shown in Figure 2, it is the schematic flow sheet of video encoding/decoding method described in the embodiment of the present invention two, and described video encoding/decoding method can comprise the following steps:

Step 201: the raw video image coding stream and the pixel property Image Coding bit stream that receive input.

Wherein, described raw video image coding stream and described pixel property Image Coding bit stream are respectively to obtain after raw video image to be encoded and the pixel property image corresponding with described raw video image are encoded; Described pixel property image is to generate according to the pixel property of the each pixel in the described raw video image of determining; Wherein, for arbitrary pixel, the pixel property of described pixel with corresponding with the pixel property of described pixel, represent for the pixel property ident value that reflects the corresponding video content level of described pixel.

Particularly, in technical scheme described in the embodiment of the present invention, described pixel property at least can comprise in following attribute information any one or multiple: for representing that pixel is the scene properties information of foreground pixel or background pixel, scene depth, for representing that pixel is the sound state attribute information of static pixels or dynamic pixel, hiding relation, or, texture informations etc., the embodiment of the present invention is not limited in any way this.

Further, for arbitrary pixel, for reflecting that the pixel property ident value of the corresponding video content level of described pixel can be the brightness value of setting or the chromatic value of setting conventionally.That is to say, in technical scheme described in the embodiment of the present invention, can adopt specific brightness value or specific chromatic value to represent the corresponding video content level of each pixel.Certainly it should be noted that, also can adopt the ident value of other settings to represent the corresponding video content level of each pixel, the embodiment of the present invention is not also limited in any way this.

Step 202: described raw video image coding stream and/or described pixel property Image Coding bit stream are decoded, to obtain corresponding raw video image and/or pixel property image.

Particularly, described raw video image coding stream and/or described pixel property Image Coding bit stream are being decoded, when obtaining corresponding raw video image and/or pixel property image, can be according to the solution code requirement of setting, from described raw video image coding stream and described pixel property Image Coding bit stream, choose corresponding coding stream, and the coding stream of choosing is decoded, to obtain corresponding raw video image and/or pixel property image.For example, if only need to obtain corresponding raw video image, the raw video image coding stream of can only decoding, obtain the information that raw video image is more detailed if also need, as pixel property information or the pixel property identification information etc. of the each pixel in raw video image, the corresponding pixel property Image Coding bit stream etc. of also can further decoding, the embodiment of the present invention does not repeat this.

Further, because common portability in described raw video image coding stream or described pixel property coding stream has the identification information of corresponding method for video coding, therefore, in the time that the described raw video image coding stream of choosing is decoded, can be according to the identification information of the method for video coding carrying in described raw video image coding stream, determine the method for video coding that described raw video image coding stream adopts, and according to the video encoding/decoding method matching with the method for video coding that adopts of described raw video image coding stream of determining, described raw video image coding stream is decoded, or, in the time that the described pixel property Image Coding bit stream of choosing is decoded, can be according to the identification information of the method for video coding carrying in described pixel property Image Coding bit stream, determine the method for video coding that described pixel property Image Coding bit stream adopts, and according to the video encoding/decoding method matching with the method for video coding that adopts of described pixel property Image Coding bit stream of determining, described pixel property Image Coding bit stream is decoded.

For example, so that described raw video image coding stream is decoded as to example, if according to the identification information of the method for video coding carrying in described raw video image coding stream, determine that described raw video image is directly to use existing method for video coding to encode, use corresponding existing video encoding/decoding method (as infra-frame prediction coding/decoding method) to as described in raw video image coding stream decode, to obtain corresponding raw video image; If according to the identification information of the method for video coding carrying in described raw video image coding stream, determine that raw video image is to use the method for video coding based on pixel property of optimizing to encode, can be for different classes of macro block, take corresponding coding/decoding method to decode, the embodiment of the present invention does not repeat this.

Step 203: the raw video image and/or the pixel property image that obtain according to decoding, generate corresponding output video image.

Particularly, the raw video image and/or the pixel property image that obtain according to decoding, generate corresponding output video image, can comprise:

If according to the solution code requirement of setting, determine that the raw video image obtaining according to decoding, generates corresponding output video image without the described pixel property Image Coding bit stream of decoding; Or,

If according to the solution code requirement of setting, to determine and need the described pixel property Image Coding bit stream of decoding, the raw video image and the pixel property image that obtain according to decoding, generate corresponding output video image.Particularly, now, can to decoding obtain raw video image and pixel property image merge, with obtain comprising belong to particular video frequency content level pixel, corresponding to the video image of application-specific scene, the embodiment of the present invention does not repeat this.

It should be noted that, in technical scheme described in the embodiment of the present invention, due to after decoding, can be directly according to the pixel property identification information of the each pixel in video image, which video content level is the each pixel obtaining in video image belong to, such as, be foreground pixel or background pixel, whether be prospect area-of-interest etc., thereby, can be in decoding, directly extract the object of different levels according to different pixel property ident values, thereby can reduce some preprocessing process in video analysis, improve the efficiency of video decode.

The embodiment of the present invention two provides a kind of video encoding/decoding method, in decode procedure, can decode to the raw video image coding stream receiving and/or pixel property Image Coding bit stream, to obtain corresponding raw video image and/or pixel property image, and the raw video image and/or the pixel property image that obtain according to decoding, generate corresponding output video image, in decoding raw video image, also decodable code goes out the pixel property identification information of the each pixel in raw video image, and then according to the pixel property identification information of each pixel, extract the object of different levels, thereby can reach the layering of supporting more neatly object in video decoding process and the object that improves the accuracy of in video decoding process, the profile of video image being described.

Embodiment tri-:

The embodiment of the present invention three provides the video coding apparatus of method for video coding described in a kind of embodiment of can be used in the present invention, as shown in Fig. 3 (a), it is the structural representation one of video coding apparatus described in the embodiment of the present invention three, described video coding apparatus can comprise attribute determination module 31, image generation module 32, image coding module 33 and coding output module 34, wherein:

Described attribute determination module 31 can be used for, for the arbitrary raw video image in raw video image sequence to be encoded, determining the pixel property of the each pixel in described raw video image; Wherein, for arbitrary pixel, the pixel property of described pixel with corresponding with the pixel property of described pixel, represent for the pixel property ident value that reflects the corresponding video content level of described pixel.

Particularly, in technical scheme described in the embodiment of the present invention, described pixel property at least can comprise in following attribute information any one or multiple: for representing that pixel is the scene properties information of foreground pixel or background pixel, scene depth, for representing that pixel is the sound state attribute information of static pixels or dynamic pixel, hiding relation, or, texture informations etc., the embodiment of the present invention is not limited in any way this.And, for arbitrary pixel, for reflecting that the pixel property ident value of the corresponding video content level of described pixel can be the brightness value of setting or the chromatic value of setting conventionally.That is to say, in technical scheme described in the embodiment of the present invention, can adopt specific brightness value or specific chromatic value to represent the corresponding video content level of each pixel, the embodiment of the present invention does not repeat this.

The pixel property of the each pixel in the described raw video image that described image generation module 32 can be used for determining according to described attribute determination module 31, generates the pixel property image corresponding with described raw video image;

Described image coding module 33 can be used for respectively described raw video image and described pixel property image being encoded, to obtain corresponding raw video image coding stream and pixel property Image Coding bit stream;

Described coding output module 34 can be used for described image coding module 33 raw video image coding stream and the pixel property Image Coding bit stream obtaining of encoding to write output video bit stream.

Particularly, as shown in Fig. 3 (b) (Fig. 3 (b) is the structural representation two of video coding apparatus described in the embodiment of the present invention three), in technical scheme described in the embodiment of the present invention, described video coding apparatus also can comprise the first attribute-bit determination module 35 or the second attribute-bit determination module 36;

Wherein, described the first attribute-bit determination module 35 can comprise that submodule 351 is divided in region and the first mark is determined submodule 352: described region is divided submodule 351 and be can be used for, according to the pixel property of the each pixel in described raw video image, described raw video image being divided into multiple image-regions; Described the first mark determines that submodule 352 can be used for dividing for described region arbitrary image-region that submodule 351 is divided, determine the corresponding video content level of described image-region, and using the pixel property ident value corresponding with definite video content level the pixel property ident value of the each pixel in described image-region;

Described the second attribute-bit determination module 36 can comprise scene image training submodule 361 and the definite submodule 362 of the second mark, wherein: described scene image training submodule 361 can be used for taking the multiple raw video images in described raw video image sequence to be encoded as training set, generating scene image; Described the second mark determines that submodule 362 can be used for the described scene image image as a setting that described scene image training submodule 361 is generated, and determines the pixel property ident value of the each pixel in described raw video image.

Particularly, described the second mark determines that submodule 362 specifically can be used in the following manner by described scene image image as a setting, to determine the pixel property ident value of the each pixel in described raw video image:

Described scene image and described raw video image are reduced, obtain the image with pixel property ident value; Afterwards, use the filling algorithm (as four connection algorithms or eight are communicated with algorithm etc.) of setting, remove described with the noise pixel in the image of pixel property ident value, and according to the image obtaining after denoising, determine the pixel property ident value of the each pixel in described raw video image.

Further, as shown in Fig. 3 (b), described image generation module 32 can comprise that quantification treatment submodule 321 and image generate submodule 322, wherein:

Described quantification treatment submodule 321 can be used for pixel property ident value corresponding to the pixel property of the each pixel in described raw video image to carry out quantification treatment, so that the pixel property ident value of the each pixel in described raw video image is limited in the interval range of setting, wherein, the interval range of described setting can the layering number of plies when video content is carried out to layering be determined, the layering number of plies is more, the interval range of described setting can be larger, and the embodiment of the present invention is not limited in any way this;

Correspondingly, described image generation submodule 322 can be used for, according to the pixel property ident value of the each pixel in the described raw video image after described quantification treatment submodule 321 quantification treatment, generating the pixel property image corresponding with described raw video image.

It should be noted that, in technical scheme described in the embodiment of the present invention, due to can be by the mode of quantification treatment, the pixel property ident value of the each pixel in described raw video image is limited in the interval range of setting, thereby can reach the problem of the coded quantization distortion causing while avoiding the corresponding interval range of pixel property ident value when the each pixel in described raw video image too small, and, also can avoid the corresponding interval range of pixel property ident value when the each pixel in described raw video image too large time, can increase significantly the problem of the code check of coding stream.

Further, as shown in Fig. 3 (b), in technical scheme described in the embodiment of the present invention, described image coding module 33 can comprise raw video image coding submodule 331 and pixel property Image Coding submodule 332, wherein:

Described raw video image coding submodule 331 can be used for utilizing the method for video coding based on pixel property after existing method for video coding or optimization to encode to described raw video image, to obtain corresponding raw video image coding stream; Wherein, the method for video coding based on pixel property after described optimization refers to, in the time of encode video image, the macro block of video image is classified, and for different classes of macro block, uses different coded systems to encode;

Described pixel property Image Coding submodule 332 can be used for utilizing the method for video coding based on pixel property after existing method for video coding or optimization to encode to described pixel property image, to obtain corresponding pixel property Image Coding bit stream.

It should be noted that in addition, in technical scheme described in the embodiment of the present invention, owing to can adopting respectively applicable coded system, described raw video image and described pixel property image are encoded, thereby make can to choose corresponding coding stream according to corresponding solution code requirement in when decoding and decode, to improve the flexibility of decoding.For example, if only need to obtain corresponding raw video image, the raw video image coding stream of can only decoding, obtain the information that raw video image is more detailed if also need, as pixel property information or the pixel property identification information etc. of the each pixel in raw video image, the corresponding pixel property Image Coding bit stream etc. of also can further decoding, the embodiment of the present invention does not repeat this.

It should be noted that again, in order to realize the differentiation of coding stream, in technical scheme described in the embodiment of the present invention, the method for video coding that the method for video coding that described raw video image coding submodule 331 adopts when described raw video image is encoded and described pixel property Image Coding submodule 332 adopt when described pixel property image is encoded is different; Certainly, it should be noted that, the method for video coding that the method for video coding that described raw video image coding submodule 331 adopts when described raw video image is encoded adopts when described pixel property image coding with described pixel property Image Coding submodule 332 also can be mutually identical, and the embodiment of the present invention is not limited in any way this.

Further, as shown in Fig. 3 (b), in technical scheme described in the embodiment of the present invention, described image coding module 33 also can comprise that the first identification information adds submodule 333 or the second identification information adds submodule 334, wherein:

Described the first identification information adds the identification information that submodule 333 can be used for the method for video coding adopting when described raw video image and described pixel property image are encoded and enrolls respectively corresponding raw video image coding stream and pixel property Image Coding bit stream;

Described the second identification information adds submodule 334 and can be used for the identification information that for presentation code bit stream is described raw video image coding stream or described pixel property Image Coding bit stream to enroll respectively corresponding raw video image coding stream and pixel property Image Coding bit stream.

Further, in technical scheme described in the embodiment of the present invention, respectively described raw video image and described pixel property image are being encoded, after obtaining corresponding raw video image coding stream and pixel property Image Coding bit stream, described coding output module 34 can be used for the raw video image coding stream obtaining and pixel property Image Coding bit stream synchronously to write output video bit stream.

Particularly, described coding output module 34 is in the time synchronously writing output video bit stream by the raw video image coding stream obtaining and pixel property Image Coding bit stream, can in coding stream, insert corresponding timestamp with synchronous raw video image coding stream and pixel property Image Coding bit stream, the embodiment of the present invention does not repeat this.

The embodiment of the present invention three provides the video coding apparatus of method for video coding described in a kind of embodiment of can be used in the present invention, in technical scheme described in the embodiment of the present invention three, because described video coding apparatus is in cataloged procedure, can carry out layering to each raw video image to be encoded from Pixel-level, therefore compared to of the prior art based on ROI lumpiness concerning video image carries out layering, can support more neatly the layering of object in video coding process, and can reach the effect that improves the accuracy of in video coding process, the profile of video image being described.Have again, because described video coding apparatus is in cataloged procedure, also the pixel property ident value of the corresponding video content level of each pixel for reflecting raw video image also can be enrolled to output video bit stream, so that also decodable code goes out the pixel property identification information of the each pixel in raw video image in decoding raw video image, and then according to the pixel property identification information of each pixel, extract the object of different levels, thereby also can reach the layering of supporting more neatly object in video decoding process and the object that improves the accuracy of in video decoding process, the profile of video image being described.

Embodiment tetra-:

The embodiment of the present invention four provides the video decoder of video encoding/decoding method described in a kind of embodiment of can be used in the present invention bis-, as shown in Fig. 4 (a), it is the structural representation one of video decoder described in the embodiment of the present invention four, described video decoder can comprise code stream receiver module 41, code stream decoding module 42 and image generation module 43, wherein:

Described code stream receiver module 41 can be used for receiving raw video image coding stream and the pixel property Image Coding bit stream of input; Wherein, described raw video image coding stream and described pixel property Image Coding bit stream are respectively to obtain after raw video image to be encoded and the pixel property image corresponding with described raw video image are encoded; Described pixel property image is to generate according to the pixel property of the each pixel in the described raw video image of determining; Wherein, for arbitrary pixel, the pixel property of described pixel with corresponding with the pixel property of described pixel, represent for the pixel property ident value that reflects the corresponding video content level of described pixel;

Described raw video image coding stream and/or described pixel property Image Coding bit stream that described code stream decoding module 42 can be used for described code stream receiver module 41 to receive are decoded, to obtain corresponding raw video image and/or pixel property image;

Described image generation module 43 can be used for the raw video image and/or the pixel property image that obtain according to described code stream decoding module 42 decodings, generates corresponding output video image.

Particularly, as shown in Fig. 4 (b) (Fig. 4 (b) is the structural representation two of video decoder described in the embodiment of the present invention four), described code stream decoding module 42 can comprise that code stream chooses submodule 421 and code stream decoding submodule 422, wherein:

Described code stream is chosen submodule 421 and be can be used for, according to the solution code requirement of setting, from described raw video image coding stream and described pixel property Image Coding bit stream, choosing corresponding coding stream;

Described code stream decoding submodule 422 can be used for that described code stream is chosen to the coding stream that submodule 421 chooses decodes, to obtain corresponding raw video image and/or pixel property image.

For example, if only need to obtain corresponding raw video image, the raw video image coding stream of can only choosing and decode, obtain the information that raw video image is more detailed if also need, as pixel property information or the pixel property identification information etc. of the each pixel in raw video image, the corresponding pixel property Image Coding bit stream etc. of also can further choosing and decode, to improve the flexibility of decoding, the embodiment of the present invention does not repeat this.

Further, as shown in Fig. 4 (b), described code stream decoding submodule 422 can comprise raw video image coding stream decoding submodule 4221 and/or pixel property Image Coding bitstream decoding submodule 4222:

Described raw video image coding stream decoding submodule 4221 is used in raw video image coding stream to choosing while decoding, according to the identification information of the method for video coding carrying in described raw video image coding stream, determine the method for video coding that described raw video image coding stream adopts, and according to the video encoding/decoding method matching with the method for video coding that adopts of described raw video image coding stream of determining, described raw video image coding stream is decoded;

Described pixel property Image Coding bitstream decoding submodule 4222 is used in pixel property Image Coding bit stream to choosing while decoding, according to the identification information of the method for video coding carrying in described pixel property Image Coding bit stream, determine the method for video coding that described pixel property Image Coding bit stream adopts, and according to the video encoding/decoding method matching with the method for video coding that adopts of described pixel property Image Coding bit stream of determining, described pixel property Image Coding bit stream is decoded.

For example, so that described raw video image coding stream is decoded as to example, if according to the identification information of the method for video coding carrying in described raw video image coding stream, determine that described raw video image is directly to use existing method for video coding to encode, described raw video image coding stream decoding submodule 4221 can use corresponding existing video encoding/decoding method (as infra-frame prediction coding/decoding method) to as described in raw video image coding stream decode, to obtain corresponding raw video image; If according to the identification information of the method for video coding carrying in described raw video image coding stream, determine that raw video image is to use the method for video coding based on pixel property of optimizing to encode, described raw video image coding stream decoding submodule 4221 can be for different classes of macro block, take corresponding coding/decoding method to decode, the embodiment of the present invention does not repeat this.

Further, as shown in Fig. 4 (b), described image generation module 43 can comprise that the first image generates submodule 431 or the second image generates submodule 432, wherein:

Can be used for according to the solution code requirement of setting if described the first image generates submodule 431, determine that the raw video image obtaining according to decoding, generates corresponding output video image without the described pixel property Image Coding bit stream of decoding;

Can be used for according to the solution code requirement of setting if described the second image generates submodule 432, determine and need the described pixel property Image Coding bit stream of decoding, the raw video image and the pixel property image that obtain according to decoding, generate corresponding output video image; Particularly, now, described the second image generates submodule 432 and can merge raw video image and the pixel property image of decoding acquisition, with obtain comprising belong to particular video frequency content level pixel, corresponding to the video image of application-specific scene, the embodiment of the present invention does not repeat this.

The embodiment of the present invention four provides the video decoder of video encoding/decoding method described in a kind of embodiment of can be used in the present invention bis-, described video decoder is in decode procedure, can decode to the raw video image coding stream receiving and/or pixel property Image Coding bit stream, to obtain corresponding raw video image and/or pixel property image, and the raw video image and/or the pixel property image that obtain according to decoding, generate corresponding output video image, in decoding raw video image, also decodable code goes out the pixel property identification information of the each pixel in raw video image, and then according to the pixel property identification information of each pixel, extract the object of different levels, thereby can reach the layering of supporting more neatly object in video decoding process and the object that improves the accuracy of in video decoding process, the profile of video image being described.

It will be understood by those skilled in the art that embodiments of the invention can be provided as method, device (device) or computer program.Therefore, the present invention can adopt complete hardware implementation example, completely implement software example or the form in conjunction with the embodiment of software and hardware aspect.And the present invention can adopt the form at one or more upper computer programs of implementing of computer-usable storage medium (including but not limited to magnetic disc store, CD-ROM, optical memory etc.) that wherein include computer usable program code.

The present invention is with reference to describing according to flow chart and/or the block diagram of the method for the embodiment of the present invention, device (device) and computer program.Should understand can be by the flow process in each flow process in computer program instructions realization flow figure and/or block diagram and/or square frame and flow chart and/or block diagram and/or the combination of square frame.Can provide these computer program instructions to the processor of all-purpose computer, special-purpose computer, Embedded Processor or other programmable data processing unit to produce a machine, the instruction that makes to carry out by the processor of computer or other programmable data processing unit produces the device for realizing the function of specifying at flow process of flow chart or multiple flow process and/or square frame of block diagram or multiple square frame.

These computer program instructions also can be stored in energy vectoring computer or the computer-readable memory of other programmable data processing unit with ad hoc fashion work, the instruction that makes to be stored in this computer-readable memory produces the manufacture that comprises command device, and this command device is realized the function of specifying in flow process of flow chart or multiple flow process and/or square frame of block diagram or multiple square frame.

These computer program instructions also can be loaded on computer or other programmable data processing unit, make to carry out sequence of operations step to produce computer implemented processing on computer or other programmable devices, thereby the instruction of carrying out is provided for realizing the step of the function of specifying in flow process of flow chart or multiple flow process and/or square frame of block diagram or multiple square frame on computer or other programmable devices.

Although described the preferred embodiments of the present invention, once those skilled in the art obtain the basic creative concept of cicada, can make other change and amendment to these embodiment.So claims are intended to be interpreted as comprising preferred embodiment and fall into all changes and the amendment of the scope of the invention.

Obviously, those skilled in the art can carry out various changes and modification and not depart from the spirit and scope of the present invention the present invention.Like this, if these amendments of the present invention and within modification belongs to the scope of the claims in the present invention and equivalent technologies thereof, the present invention is also intended to comprise these changes and modification interior.

Claims (28)

1. a method for video coding, is characterized in that, comprising:

For the arbitrary raw video image in raw video image sequence to be encoded, determine the pixel property of the each pixel in described raw video image, and according to the pixel property of each pixel of determining, generate the pixel property image corresponding with described raw video image; Wherein, for arbitrary pixel, the pixel property of described pixel with corresponding with the pixel property of described pixel, represent for the pixel property ident value that reflects the corresponding video content level of described pixel;

Respectively described raw video image and described pixel property image are encoded, to obtain corresponding raw video image coding stream and pixel property Image Coding bit stream, and the raw video image coding stream obtaining and pixel property Image Coding bit stream are write to output video bit stream.

2. method for video coding as claimed in claim 1, is characterized in that, described pixel property at least comprise in following attribute information any one or multiple:

For representing that pixel is the scene properties information of foreground pixel or background pixel, scene depth, for representing that pixel is the sound state attribute information of static pixels or dynamic pixel, hiding relation, or, texture information.

3. method for video coding as claimed in claim 1 or 2, is characterized in that, described pixel property ident value is the brightness value of setting or the chromatic value of setting.

4. method for video coding as claimed in claim 3, is characterized in that, for arbitrary raw video image, determines in the following manner the pixel property ident value of the each pixel in described raw video image:

According to the pixel property of the each pixel in described raw video image, described raw video image is divided into multiple image-regions; For arbitrary image-region, determine the corresponding video content level of described image-region, and using the pixel property ident value corresponding with definite video content level the pixel property ident value of the each pixel in described image-region; Or,

Taking the multiple raw video images in described raw video image sequence to be encoded as training set, generating scene image; By described scene image image as a setting, determine the pixel property ident value of the each pixel in described raw video image.

5. method for video coding as claimed in claim 4, is characterized in that, by described scene image image as a setting, determines the pixel property ident value of the each pixel in described raw video image, comprising:

Described scene image and described raw video image are reduced, obtain the image with pixel property ident value; Afterwards, use the filling algorithm of setting, removal is described with the noise pixel in the image of pixel property ident value, and according to the image obtaining after denoising, determines the pixel property ident value of the each pixel in described raw video image.

6. method for video coding as claimed in claim 1 or 2, is characterized in that, according to the pixel property of each pixel of determining, generates the pixel property image corresponding with described raw video image, comprising:

The pixel property ident value corresponding to the pixel property of the each pixel in described raw video image carries out quantification treatment, so that the pixel property ident value of the each pixel in described raw video image is limited in the interval range of setting, and according to the pixel property ident value of the each pixel in the described raw video image after quantification treatment, generate the pixel property image corresponding with described raw video image.

7. method for video coding as claimed in claim 1 or 2, it is characterized in that, respectively described raw video image and described pixel property image are encoded, to obtain corresponding raw video image coding stream and pixel property Image Coding bit stream, comprising:

Utilize the method for video coding based on pixel property after existing method for video coding or optimization to encode to described raw video image, to obtain corresponding raw video image coding stream; And, utilize the method for video coding based on pixel property after existing method for video coding or optimization to encode to described pixel property image, to obtain corresponding pixel property Image Coding bit stream;

Wherein, the method for video coding based on pixel property after described optimization refers to, in the time of encode video image, the macro block of video image is classified, and for different classes of macro block, uses different coded systems to encode.

8. method for video coding as claimed in claim 7, is characterized in that, the method for video coding adopting when described raw video image and described pixel property image are encoded is different.

9. method for video coding as claimed in claim 7, is characterized in that, respectively described raw video image and described pixel property image is encoded, and to obtain corresponding raw video image coding stream and pixel property Image Coding bit stream, also comprises:

The identification information of the method for video coding adopting when described raw video image and described pixel property image are encoded enrolls respectively corresponding raw video image coding stream and pixel property Image Coding bit stream; Or,

The identification information that for presentation code bit stream is described raw video image coding stream or described pixel property Image Coding bit stream is enrolled respectively to corresponding raw video image coding stream and pixel property Image Coding bit stream.

10. method for video coding as claimed in claim 1 or 2, is characterized in that, the raw video image coding stream obtaining and pixel property Image Coding bit stream are write to output video bit stream, comprising:

The raw video image coding stream obtaining and pixel property Image Coding bit stream are synchronously write to output video bit stream.

11. 1 kinds of video encoding/decoding methods, is characterized in that, comprising:

Receive raw video image coding stream and the pixel property Image Coding bit stream of input; Wherein, described raw video image coding stream and described pixel property Image Coding bit stream are respectively to obtain after raw video image to be encoded and the pixel property image corresponding with described raw video image are encoded; Described pixel property image is to generate according to the pixel property of the each pixel in the described raw video image of determining; Wherein, for arbitrary pixel, the pixel property of described pixel with corresponding with the pixel property of described pixel, represent for the pixel property ident value that reflects the corresponding video content level of described pixel;

Described raw video image coding stream and/or described pixel property Image Coding bit stream are decoded, to obtain corresponding raw video image and/or pixel property image;

The raw video image and/or the pixel property image that obtain according to decoding, generate corresponding output video image.

12. video encoding/decoding methods as claimed in claim 11, is characterized in that, described raw video image coding stream and/or described pixel property Image Coding bit stream are decoded, and to obtain corresponding raw video image and/or pixel property image, comprising:

According to the solution code requirement of setting, from described raw video image coding stream and described pixel property Image Coding bit stream, choose corresponding coding stream, and the coding stream of choosing is decoded, to obtain corresponding raw video image and/or pixel property image.

13. video encoding/decoding methods as claimed in claim 12, is characterized in that, the coding stream of choosing is decoded, and to obtain corresponding raw video image and/or pixel property image, comprising:

In the time that the raw video image coding stream to choosing is decoded, according to the identification information of the method for video coding carrying in described raw video image coding stream, determine the method for video coding that described raw video image coding stream adopts, and according to the video encoding/decoding method matching with the method for video coding that adopts of described raw video image coding stream of determining, described raw video image coding stream is decoded;

Or, in the time that the pixel property Image Coding bit stream to choosing is decoded, according to the identification information of the method for video coding carrying in described pixel property Image Coding bit stream, determine the method for video coding that described pixel property Image Coding bit stream adopts, and according to the video encoding/decoding method matching with the method for video coding that adopts of described pixel property Image Coding bit stream of determining, described pixel property Image Coding bit stream is decoded.

14. video encoding/decoding methods as described in as arbitrary in claim 11～13, is characterized in that, the raw video image and/or the pixel property image that obtain according to decoding, generate corresponding output video image, comprising:

If according to the solution code requirement of setting, determine that the raw video image obtaining according to decoding, generates corresponding output video image without the described pixel property Image Coding bit stream of decoding; Or,

If according to the solution code requirement of setting, to determine and need the described pixel property Image Coding bit stream of decoding, the raw video image and the pixel property image that obtain according to decoding, generate corresponding output video image.

15. 1 kinds of video coding apparatus, is characterized in that, comprising:

Attribute determination module, for the arbitrary raw video image for raw video image sequence to be encoded, determines the pixel property of the each pixel in described raw video image; Wherein, for arbitrary pixel, the pixel property of described pixel with corresponding with the pixel property of described pixel, represent for the pixel property ident value that reflects the corresponding video content level of described pixel;

Image generation module, for according to the pixel property of each pixel of the definite described raw video image of described attribute determination module, generates the pixel property image corresponding with described raw video image;

Image coding module, for respectively described raw video image and described pixel property image being encoded, to obtain corresponding raw video image coding stream and pixel property Image Coding bit stream;

Coding output module, writes output video bit stream for raw video image coding stream and the pixel property Image Coding bit stream obtaining that described image coding module is encoded.

16. video coding apparatus as claimed in claim 15, is characterized in that, described pixel property at least comprise in following attribute information any one or multiple:

For representing that pixel is the scene properties information of foreground pixel or background pixel, scene depth, for representing that pixel is the sound state attribute information of static pixels or dynamic pixel, hiding relation, or, texture information.

17. video coding apparatus as described in claim 15 or 16, is characterized in that, described pixel property ident value is the brightness value set or the chromatic value of setting.

18. video coding apparatus as claimed in claim 17, is characterized in that, described video coding apparatus also comprises the first attribute-bit determination module or the second attribute-bit determination module;

Described the first attribute-bit determination module comprises that submodule is divided in region and the first mark is determined submodule, wherein:

Submodule is divided in described region, for according to the pixel property of each pixel of described raw video image, described raw video image is divided into multiple image-regions;

Described the first mark is determined submodule, for dividing for described region arbitrary image-region that submodule is divided, determine the corresponding video content level of described image-region, and using the pixel property ident value corresponding with definite video content level the pixel property ident value of the each pixel in described image-region;

Described the second attribute-bit determination module comprises scene image training submodule and the definite submodule of the second mark, wherein:

Described scene image training submodule, for the multiple raw video images taking described raw video image sequence to be encoded as training set, generating scene image;

Described the second mark is determined submodule, for the described scene image image as a setting that described scene image training submodule is generated, determines the pixel property ident value of the each pixel in described raw video image.

19. video coding apparatus as claimed in claim 18, is characterized in that,

Described the second mark is determined submodule, specifically for described scene image and described raw video image are reduced, obtains the image with pixel property ident value; Afterwards, use the filling algorithm of setting, removal is described with the noise pixel in the image of pixel property ident value, and according to the image obtaining after denoising, determines the pixel property ident value of the each pixel in described raw video image.

20. video coding apparatus as described in claim 15 or 16, is characterized in that, described image generation module comprises that quantification treatment submodule and image generate submodule:

Described quantification treatment submodule, pixel property ident value corresponding to pixel property for the each pixel to described raw video image carries out quantification treatment, so that the pixel property ident value of the each pixel in described raw video image is limited in the interval range of setting;

Described image generates submodule, for according to the pixel property ident value of each pixel of the described raw video image after described quantification treatment submodule quantification treatment, generates the pixel property image corresponding with described raw video image.

21. video coding apparatus as described in claim 15 or 16, is characterized in that, described image coding module comprises raw video image coding submodule and pixel property Image Coding submodule:

Described raw video image coding submodule, for utilizing the method for video coding based on pixel property after existing method for video coding or optimization to encode to described raw video image, to obtain corresponding raw video image coding stream;

Described pixel property Image Coding submodule, for utilizing the method for video coding based on pixel property after existing method for video coding or optimization to encode to described pixel property image, to obtain corresponding pixel property Image Coding bit stream;

Wherein, the method for video coding based on pixel property after described optimization refers to, in the time of encode video image, the macro block of video image is classified, and for different classes of macro block, uses different coded systems to encode.

22. video coding apparatus as claimed in claim 21, it is characterized in that, the method for video coding that the method for video coding that described raw video image coding submodule adopts when described raw video image is encoded and described pixel property Image Coding submodule adopt when described pixel property image is encoded is different.

23. video coding apparatus as claimed in claim 21, is characterized in that, described image coding module also comprises that the first identification information adds submodule or the second identification information adds submodule:

Described the first identification information adds submodule, enrolls respectively corresponding raw video image coding stream and pixel property Image Coding bit stream for the identification information of the method for video coding that adopts when described raw video image and described pixel property image are encoded;

Described the second identification information adds submodule, for the identification information that for presentation code bit stream is described raw video image coding stream or described pixel property Image Coding bit stream is enrolled respectively to corresponding raw video image coding stream and pixel property Image Coding bit stream.

24. video coding apparatus as described in claim 15 or 16, is characterized in that,

Described coding output module, specifically for synchronously writing output video bit stream by the raw video image coding stream obtaining and pixel property Image Coding bit stream.

25. 1 kinds of video decoders, is characterized in that, comprising:

Code stream receiver module, for receiving raw video image coding stream and the pixel property Image Coding bit stream of input; Wherein, described raw video image coding stream and described pixel property Image Coding bit stream are respectively to obtain after raw video image to be encoded and the pixel property image corresponding with described raw video image are encoded; Described pixel property image is to generate according to the pixel property of the each pixel in the described raw video image of determining; Wherein, for arbitrary pixel, the pixel property of described pixel with corresponding with the pixel property of described pixel, represent for the pixel property ident value that reflects the corresponding video content level of described pixel;

Code stream decoding module, decodes for described raw video image coding stream and/or described pixel property Image Coding bit stream that described code stream receiver module is received, to obtain corresponding raw video image and/or pixel property image;

Image generation module, for the raw video image and/or the pixel property image that obtain according to described code stream decoding module decoding, generates corresponding output video image.

26. video decoders as claimed in claim 25, is characterized in that, described code stream decoding module comprises that code stream chooses submodule and code stream decoding submodule:

Described code stream is chosen submodule, for according to the solution code requirement of setting, from described raw video image coding stream and described pixel property Image Coding bit stream, chooses corresponding coding stream;

Described code stream decoding submodule, decodes for described code stream being chosen to the coding stream that submodule chooses, to obtain corresponding raw video image and/or pixel property image.

27. video decoders as claimed in claim 26, is characterized in that, described code stream decoding submodule comprises raw video image coding stream decoding submodule and/or pixel property Image Coding bitstream decoding submodule:

Described raw video image coding stream decoding submodule, for in the time that the raw video image coding stream to choosing is decoded, according to the identification information of the method for video coding carrying in described raw video image coding stream, determine the method for video coding that described raw video image coding stream adopts, and according to the video encoding/decoding method matching with the method for video coding that adopts of described raw video image coding stream of determining, described raw video image coding stream is decoded;

Described pixel property Image Coding bitstream decoding submodule, for in the time that the described pixel property Image Coding bit stream of choosing is decoded, according to the identification information of the method for video coding carrying in described pixel property Image Coding bit stream, determine the method for video coding that described pixel property Image Coding bit stream adopts, and according to the video encoding/decoding method matching with the method for video coding that adopts of described pixel property Image Coding bit stream of determining, described pixel property Image Coding bit stream is decoded.

28. video decoders as described in as arbitrary in claim 25～27, is characterized in that, described image generation module comprises that the first image generates submodule or the second image generates submodule:

Described the first image generates submodule, if for according to the solution code requirement of setting, determine that the raw video image obtaining according to decoding, generates corresponding output video image without the described pixel property Image Coding bit stream of decoding;

Described the second image generates submodule, if for according to the solution code requirement of setting, determine and need the described pixel property Image Coding bit stream of decoding, the raw video image and the pixel property image that obtain according to decoding, generate corresponding output video image.