CN101895748B - Coding and decoding methods and coding and decoding devices - Google Patents
Coding and decoding methods and coding and decoding devices Download PDFInfo
- Publication number
- CN101895748B CN101895748B CN201010204321.5A CN201010204321A CN101895748B CN 101895748 B CN101895748 B CN 101895748B CN 201010204321 A CN201010204321 A CN 201010204321A CN 101895748 B CN101895748 B CN 101895748B
- Authority
- CN
- China
- Prior art keywords
- image
- enhancement layer
- code stream
- basic
- meeting
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related
Links
Images
Landscapes
- Compression Or Coding Systems Of Tv Signals (AREA)
Abstract
The embodiment of the invention discloses coding and decoding methods and coding and decoding devices, relating to image processing technology and aiming to improve the quality of the images displayed when multi-scene display in the meeting places is realized. The coding method comprises the following steps: respectively obtaining a basic layer image and at least a reinforcement layer image in the meeting place scene; and taking the basic layer image as the scaled video coding (SVC) basic layer and the reinforcement layer image as the SVC reinforcement layer to be coded to form coding stream. The embodiment of the invention is mainly applied to video conferences.
Description
Technical field
The present invention relates to image processing techniques, relate in particular to a kind of decoding method and coding and decoding device.
Background technology
In prior art, below general employing, several modes are emphasized some the local scene in meeting-place.
Mode one, utilize resampling technology to show a plurality of scenes in meeting-place.
In this mode, first will in meeting-place, need regional area to be processed to cut out, then utilize resample filter to amplify processing to the regional area cutting out, thereby realize to the emphasizing of the local scene in meeting-place, to show a plurality of scenes in meeting-place.
Mode two, gather respectively the image of different scenes in meeting-place, then adopt different codecs or same codec, process respectively the image of these different scenes.
Mode three, use single H.264 encoder to the zones of different in same meeting-place according to quality grade compartmentalization band (slice), and these bands are encoded.
Inventor finds, the image that these prior aries all can not provide high-quality many scenes to show efficiently simultaneously.For example, for mode one, due to the impact of resample filter performance, the quality of the local scene image in meeting-place obtain through resampling can decline to some extent compared to the picture quality before sampling, and needs in this manner extra resample filter resource.For mode two, because the multi-channel video code stream in same meeting-place is used respectively independently codec, so this encoding and decoding resource that causes which to take is many, and synchronously more difficult between the multi-path video stream in same meeting-place; If adopt codec encoding and decoding multi-path video stream in order, can make again multi-path video stream have order successively, cannot arrive, and the frame per second of every road video flowing will decline simultaneously.For mode three, important area cannot be realized and amplify the effect of emphasizing, the subjective effect of integral image declines.
Summary of the invention
The embodiment of the present invention provides a kind of decoding method and coding and decoding device, to improve the quality of image shown when realizing the many scenes demonstrations in meeting-place.
The embodiment of the present invention adopts following technical scheme:
A coding method, comprising:
Obtain respectively the basic tomographic image of a width and at least one width enhancement layer image in the scene of meeting-place;
Described basic tomographic image is encoded as basic layer that can layered video encoding and decoding SVC, the enhancement layer using described enhancement layer image as described SVC, form encoding code stream.
A code device, comprising:
Image acquisition unit, for obtaining respectively the basic tomographic image of a width and at least one width enhancement layer image of meeting-place scene;
Coding unit, for described basic tomographic image is encoded as basic layer that can layered video encoding and decoding SVC, the enhancement layer using described enhancement layer image as described SVC, forms encoding code stream.
The coding method of the embodiment of the present invention and device, in the process of coding, for basic tomographic image and enhancement layer image in the meeting-place scene obtaining, encode as basic layer, enhancement layer that can layered video encoding and decoding SVC respectively.The encoding code stream forming in this manner, takes full advantage of the characteristic of SVC coded system, can comprise the code stream corresponding to image of a plurality of different resolutions in the encoding code stream forming.Therefore, utilize coding method and the device of the embodiment of the present invention, can improve the quality of image shown when realizing the many scenes demonstrations in meeting-place.
A coding/decoding method, comprising:
Received code code stream, wherein said encoding code stream is to be encoded and obtained by the enhancement layer using the basic tomographic image in the scene of meeting-place as basic layer that can layered video encoding and decoding SVC, using the enhancement layer image in the scene of meeting-place as described SVC;
According to described encoding code stream, obtain respectively basic layer bit stream and enhancement layer bitstream;
Respectively described basic layer bit stream and enhancement layer bitstream are decoded, obtain described basic tomographic image and described enhancement layer image.
A decoding device, comprising:
Code stream receiving element, for received code code stream, wherein said encoding code stream is to be encoded and obtained by the enhancement layer using the basic tomographic image in the scene of meeting-place as basic layer that can layered video encoding and decoding SVC, using the enhancement layer image in the scene of meeting-place as described SVC;
Code stream acquiring unit, for obtaining respectively basic layer bit stream and enhancement layer bitstream according to described encoding code stream;
Decoding unit, for respectively described basic layer bit stream and enhancement layer bitstream being decoded, obtains described basic tomographic image and described enhancement layer image.
The coding/decoding method of the embodiment of the present invention and device, owing to being by basic tomographic image and the enhancement layer image of meeting-place scene in the process at coding, respectively as basic layer that can layered video encoding and decoding SVC, enhancement layer is encoded and form encoding code stream.That is to say the encoding code stream forming in this manner, take full advantage of the characteristic of SVC coded system, in the encoding code stream forming, can comprise the code stream corresponding to image of a plurality of different resolutions.Therefore, coding/decoding method that can the utility embodiment of the present invention and the basic tomographic image that device obtains and the quality of enhancement layer image, thus improve the quality of image shown when realizing the many scenes in meeting-place and show.
Accompanying drawing explanation
In order to be illustrated more clearly in the technical scheme of the embodiment of the present invention, below the accompanying drawing of required use during embodiment is described is briefly described, apparently, accompanying drawing in the following describes is only some embodiments of the present invention, for those of ordinary skills, do not paying under the prerequisite of creative work, can also obtain according to these accompanying drawings other accompanying drawing.
Fig. 1 is the flow chart of the embodiment of the present invention one coding method;
Fig. 2 is the flow chart of the embodiment of the present invention two coding/decoding methods;
Fig. 3 is the schematic diagram of embodiment of the present invention encoding-decoding process;
Fig. 4 is the flow chart of the embodiment of the present invention three coding methods;
Fig. 5 is the flow chart of the embodiment of the present invention four coding/decoding methods;
Fig. 6 is another schematic diagram of embodiment of the present invention encoding-decoding process;
Fig. 7 is another schematic diagram of embodiment of the present invention encoding-decoding process;
Fig. 8 is another schematic diagram of embodiment of the present invention encoding-decoding process;
Fig. 9 is the schematic diagram of the embodiment of the present invention nine code devices;
Figure 10 is the schematic diagram of the embodiment of the present invention ten decoding devices.
Embodiment
Below in conjunction with the accompanying drawing in the embodiment of the present invention, the technical scheme in the embodiment of the present invention is clearly and completely described, obviously, described embodiment is only the present invention's part embodiment, rather than whole embodiment.Embodiment based in the present invention, those of ordinary skills, not making the every other embodiment obtaining under creative work prerequisite, belong to the scope of protection of the invention.
First SVC technology being done to one simply introduces.SVC (Scalable Video Coding, can layered video encoding and decoding), being a kind ofly video flowing can be divided into the technology of a plurality of resolution, quality and frame rate layers, is the expansion of H.264 video encoding and decoding standard that current most of video conference devices are adopted.Video conference device employing SVC technology is received and dispatched the multi-layer video being comprised of a little basic layer and a plurality of other optional layer that improves resolution, frame rate and quality and is flowed.This layered mode of multi-layer video stream can improve error resilience and video quality greatly, and bandwidth is not had to very high requirement.
As shown in Figure 1, the embodiment of the present invention one provides a kind of coding method, comprising:
When realizing the many scenes demonstrations in meeting-place, often need to, when showing meeting-place panoramic picture, clearly show the image of the local scene in meeting-place.Therefore, when showing, the resolution of panoramic picture is relatively lower, and the resolution of the image of local scene is relatively high.Therefore, in embodiments of the present invention, according to the feature of SVC technology, the panoramic picture in the scene of meeting-place can be used as basic tomographic image, and the image of the local scene of meeting-place scene is as enhancement layer image.Or while not needing to show the panorama in meeting-place, described basic tomographic image, enhancement layer image all can be the image of the local scene of meeting-place scene, just the resolution of the two is different.
Description by the embodiment of the present invention one can find out, in the process of coding, for basic tomographic image and enhancement layer image in the meeting-place scene obtaining, encodes respectively as basic layer, enhancement layer that can layered video encoding and decoding SVC.The encoding code stream forming in this manner, takes full advantage of the characteristic of SVC coded system, can comprise the code stream corresponding to image of a plurality of different resolutions in the encoding code stream forming.Therefore, utilize the coding method of the embodiment of the present invention, can improve the quality of image shown when realizing the many scenes demonstrations in meeting-place.
Corresponding with the coding method of embodiment mono-, the embodiment of the present invention two provides a kind of coding/decoding method.As shown in Figure 2, the method for the embodiment of the present invention two comprises:
Description by the embodiment of the present invention two can find out, owing to being by basic tomographic image and the enhancement layer image of meeting-place scene in the process at coding, respectively as basic layer that can layered video encoding and decoding SVC, enhancement layer is encoded and form encoding code stream.That is to say the encoding code stream forming in this manner, take full advantage of the characteristic of SVC coded system, in the encoding code stream forming, can comprise the code stream corresponding to image of a plurality of different resolutions.Therefore, the basic tomographic image that coding/decoding method that can the utility embodiment of the present invention obtains and the quality of enhancement layer image, thus improve the quality of image shown when realizing the many scenes in meeting-place and show.
Below, in conjunction with different embodiment, describing is how to realize Code And Decode.
In conjunction with the coding method flow chart of the encoding-decoding process schematic diagram shown in Fig. 3 and Fig. 4, the coding method of the embodiment of the present invention three comprises:
Step 31, utilize one or more than one image collecting device, as video camera, obtain at least two same meeting-place scene Scene content is identical but image that resolution is different.In Fig. 3, be to utilize two image collecting devices to obtain respectively enhancement layer image.For example can be layer 1 enhancement layer image that call of image collecting device 1 acquisition, layer 2 enhancement layer image that call of image collecting device 2 acquisitions.
Step 32, in the described image obtaining, select the little image of resolution, for example layer 1 enhancement layer image, carries out down-sampling, obtains described basic tomographic image.At this, the object of selecting the less image of resolution to sample is damage picture quality being brought in order to reduce down-sampling.Meanwhile, using the described image obtaining as described enhancement layer image.
Whether step 33, definite enhancement layer image obtaining need to carry out panorama coding.If so, directly the enhancement layer using enhancement layer image as SVC is encoded.If not, utilize positioner or by the mode of manual appointment, obtain the cutting parameter of enhancement layer image regional area, according to described cutting parameter, determine the regional area of the enhancement layer image that need to encode.
For example, can be in meeting-place setting identification manually in advance, to identify the regional area requiring emphasis.Then, re-use the image collecting device collection meeting field picture such as video camera, the region of finding sign to define in the meeting field picture collecting.
Wherein, described cutting parameter comprises:
Frame_cropping_flag: whether will will export after image cropping for indicating to decoding device, whether sign has clipping region, 1 represents it is that 0 expression is no.
Frame_crop_left_offset: for indicate the crop left boundary parameter in image cropping region to decoding device, can calculate the distance of clipping region left margin and original image left margin by this parameter.
Frame_crop_right_offset: for indicate the crop right boundary parameter in image cropping region to decoding device, can calculate the distance of clipping region right margin and original image right margin by this parameter.
Frame_crop_top_offset: for indicate the cutting coboundary parameter in image cropping region to decoding device, can calculate the distance of coboundary, clipping region and original image coboundary by this parameter.
Frame_crop_bottom_offset: for indicate the cutting lower boundary parameter in image cropping region to decoding device, can calculate the distance of clipping region lower boundary and original image lower boundary by this parameter.
According to consensus standard H.264, above-mentioned cutting parameter can be documented in sequence parameter set (SequenceParameter Set, SPS).Wherein, H.264 can support maximum 32 SPS.And above-mentioned cutting parameter can send decoding device to together by the encoding code stream forming below.Wherein, according to the ID (sign) that has its picture parameter set (PictureParameter Set, PPS) of using in band (slice) code stream of every layer of consensus standard H.264.Which PPS that by this ID, can know current band code stream use is, then can from this PPS, obtain the ID (sign) of the SPS of this band code stream use.So just can know the SPS that this band code stream is used, thereby can obtain the cutting parameter of this tomographic image.Therefore, decoding device can be determined the local scene image that needs demonstration by the cutting parameter transmitting in rebuilding image, thereby reaches the object that obtains the local scene image in meeting-place, realizes the local scene in meeting-place and emphasizes or give prominence to texts.
The detailed process of below encoding, to form encoding code stream, comprising:
Step 34, for basic tomographic image, the basic layer using it as SVC, adopts H.264 agreement to encode.The process of this coding is same as the prior art, does not repeat them here.
Step 35, for enhancement layer image, first according to described basic tomographic image, obtain the coded reference image of described enhancement layer image, and then utilize the enhancement layer of described coded reference image using described enhancement layer image as described SVC to encode.
When forming the coded reference image of enhancement layer image, can utilize the up-sampling device of SVC agreement to carry out up-sampling to basic tomographic image, obtain having with each enhancement layer image the coded reference image of equal resolution.Wherein, coded reference image and described basic tomographic image are image in the same time, the similarity of enhancement layer image and its coded reference image can be very high so, this just makes the accuracy of the estimation in cataloged procedure also very high, thereby improve significantly code efficiency, reduce encoder bit rate, save video bandwidth.
In cataloged procedure, need to obtain the residual values between coded reference image and enhancement layer image, then this residual values is encoded as coded data.
According to step 33, if need to carry out regional area cutting to obtain the local scene image in meeting-place to the enhancement layer image of certain resolution, thereby reach, emphasize or outstanding display effect, this enhancement layer image also needs cutting parameter to encode and send to decoding device.These cutting parameters all with the form coding of syntactic element in the sequence parameter set SPS of encoding code stream.
As previously mentioned, H.264 can support altogether 32 SPS, each enhancement layer image can be specified corresponding SPS in the process of coding so.The corresponding relation of this enhancement layer image and SPS can be stored in PPS, by encoding code stream, sends to together decoding device.
Certainly, in this encoding code stream, also may include other syntactic element, such as for identifying code stream identification of basic layer bit stream or enhancement layer bitstream etc.
In conjunction with the encoding-decoding process schematic diagram shown in Fig. 3 and the flow chart of Fig. 5, the coding/decoding method of the embodiment of the present invention four comprises:
Wherein, described code stream identification, can be for identifying the syntactic element of basic layer bit stream and enhancement layer bitstream in SVC extension syntax.This syntactic element can be for carrying out the syntactic element dependency_id in syntax parsing process to nal_unit_header_svc_extension (), if it is basic layer bit stream that dependency_id=0 represents this code stream, if dependency_id > 0 represents that this code stream is enhancement layer bitstream.Wherein for representing that the dependency_id value of each enhancement layer bitstream can difference be the code stream which enhancement layer is corresponding to distinguish.
At this, NAL is done to simplicity of explanation.According to consensus standard H.264, H.264 algorithm conceptive can be divided into two-layer: Video coding layer (VCL:Video Coding Layer) is responsible for efficient video frequency content expressing, and network abstraction layer is responsible for data being packed and transmitting in the desired appropriate mode of network.
In detailed process, can carry out the decoded reference pictures that up-sampling obtains described enhancement layer bitstream to described basic tomographic image.
The decode slice header of described encoding code stream, obtains the ID syntactic element pic_parameter_set_id of the picture parameter set of described encoding code stream, the PPS that this syntactic element specifies current code stream to use.And then by described picture parameter set PPS, obtain the ID syntactic element seq_parameter_set_id of described sequence parameter set, the SPS that this syntactic element specifies current code stream to use.Finally, by described SPS, obtain corresponding cutting parameter, thereby according to described cutting parameter, determine the local scene image in meeting-place.
Wherein, the decoding basic tomographic image and the enhancement layer image that obtain can show or process in same demonstration or after-treatment device, take picture in turn switching mode carry out image demonstration or processing; Also can use respectively different demonstrations or after-treatment device show simultaneously or further process.
Fig. 6 is another schematic diagram of embodiment of the present invention encoding-decoding process, corresponding, in conjunction with Fig. 6 embodiment of the present invention five and six, also provides respectively a kind of decoding method, and what wherein the coding/decoding method of the embodiment of the present invention six was described with embodiment tetra-is identical.
For coding method, comparison diagram 3 and 6 can be found out, in the coding method of embodiment five, has changed the obtain manner of basic tomographic image and enhancement layer image.In Fig. 6, by an image collecting device, obtain, this can omit more image collecting device compared to the mode shown in Fig. 3.
In this embodiment, first utilize an image collecting device to gather the image of the resolution of actual needs.The resolution of described actual needs can be the highest resolution in the different resolution of display device needs.For example, suppose that the home court scape image resolution ratio that current meeting-place needs is 720x480, for to certain regional area of meeting-place, as rostrum and near region thereof, carry out feature or Special attention will be given to etc., the image in this part region need to be amplified to 4 times.So, the resolution that the resolution of the image of regional area is equivalent to main scene image need to be 1440x960 size.Then by the mode described in embodiment tri-above, utilize cutting parameter that the regional area needing is identified out.Like this, the image that need to be 1440x960 by resolution of this image collecting device collection, and then obtain the image that resolution is 720x480 after this image is processed.
For the image collecting in the manner described above, by downsampling device, carry out down-sampling, obtain the image of piece image or a plurality of resolution, as 720P (1280x720), the images of 800x640 etc., these images and the image collecting all can be encoded as enhancement layer image respectively.Or directly using the described image collecting as enhancement layer image, or using the described image collecting and image that the described image collecting is carried out obtaining after down-sampling as enhancement layer image.And any enhancement layer image can arrange the cutting parameter of oneself, make decoding device end can get the local scene image in meeting-place.
For the image collecting in the manner described above, by downsampling device, carry out down-sampling, obtain basic tomographic image.Wherein, the resolution of basic tomographic image can not be greater than the resolution of arbitrary enhancement layer image.Also be that the resolution of described basic tomographic image is all below the resolution of described enhancement layer image.
That in other processes in the present embodiment five and embodiment tri-, describes is identical.
Fig. 7 is another schematic diagram of embodiment of the present invention encoding-decoding process, corresponding, in conjunction with Fig. 7 embodiment of the present invention seven and eight, also provides respectively a kind of decoding method, and what wherein the coding/decoding method of the embodiment of the present invention eight was described with embodiment tetra-is identical.
For coding method, comparison diagram 3 and 7 can be found out, in the coding method of embodiment seven, has changed the obtain manner of basic tomographic image.According to shown in Fig. 7, utilize that image collecting device is special gathers image that resolution is less as basic tomographic image.Like this, basic tomographic image also comes from same meeting-place, can not introduce the damage of down-sampling, makes estimation more accurate.
That in other processes in the present embodiment seven and embodiment tri-, describes is identical.
Fig. 8 is another schematic diagram of embodiment of the present invention encoding-decoding process.As seen from Figure 8, it is expanding to n image collecting device, n layer enhancement layer image shown in Fig. 7.Basic tomographic image is to use the special collection of an image collecting device.Certainly, understandable, in distortion embodiment illustrated in fig. 8, also can to one of them enhancement layer image, carry out down-sampling by downsampling device and obtain described basic tomographic image.The enhancement layer image of a plurality of local scenes can all gather respectively with image collecting device, the enhancement layer image that also can have some local scenes is by some large image in different resolution, to carry out down-sampling to obtain, and the enhancement layer image of some local scenes gathers by image collecting device.The enhancement layer image of each local scene utilizes the enhancement layer of a SVC to encode, and basic tomographic image utilizes the basic layer of SVC to encode, thereby decoding device can obtain main scene image and a plurality of local scene image in a meeting-place.Utilize identical that the coding method of this Fig. 8 and embodiment tri-or seven describe, it is identical that coding/decoding method and embodiment tetra-describe.
Description by above-described embodiment can be found out, utilize the decoding method of the embodiment of the present invention, the quality of image in the time of not only can improving the many scenes demonstrations in meeting-place, and owing to realizing many scene images encoding and decoding simultaneously in meeting-place in same SVC coding and decoding device inside, can effectively avoid the different scene image absolute codings in same meeting-place, the dispersion treatment of decoding, take more than resource and the difficult problem of Synchronization Control.Meanwhile, the embodiment of the present invention has been utilized the characteristic of SVC, comprises the video code flow of the different scenes in same meeting-place in the code stream of Yi road, emphasizes the effect showing, and can reduce resource and the complexity of system to reach efficient, convenient and to take the many scenes in meeting-place that resource is few.
One of ordinary skill in the art will appreciate that all or part of flow process realizing in above-described embodiment method, to come the hardware that instruction is relevant to complete by computer program, described program can be stored in a computer read/write memory medium, this program, when carrying out, can comprise as the flow process of the embodiment of above-mentioned each side method.Wherein, described storage medium can be magnetic disc, CD, read-only store-memory body (Read-Only Memory, ROM) or random store-memory body (Random Access Memory, RAM) etc.
As shown in Figure 9, the embodiment of the present invention nine also provides a kind of code device, comprising:
Described in preceding method embodiment, described image acquisition unit 91 can comprise: the first image collection module, for obtaining the identical but image that resolution is different of at least two width meeting-place scene Scenes, and using the described image obtaining as described enhancement layer image; The second image collection module, for the described image obtaining, selects the little image of resolution to carry out down-sampling, obtains described basic tomographic image.
Or described image acquisition unit 91 can comprise: the 3rd image collection module, for obtaining at least one width meeting-place scene image; The 4th image collection module, for carrying out obtaining after down-sampling enhancement layer image or using described meeting-place scene image and image that described meeting-place scene image is carried out obtaining after down-sampling as enhancement layer image using described meeting-place scene image as enhancement layer image or to described meeting-place scene image; The 5th image collection module, for a width of described meeting-place scene image is carried out to down-sampling, obtains basic tomographic image, and the resolution of wherein said basic tomographic image is not more than the resolution of arbitrary described enhancement layer image.Wherein, described the 5th image collection module selects meeting-place scene image to carry out the principle of down-sampling, can be also to select the less image of resolution to sample, damage picture quality being brought to reduce down-sampling.Described enhancement layer image can be several, and the resolution between several is different.
Wherein, described coding unit 92 comprises: coded reference image collection module, for obtain the coded reference image of described enhancement layer image by up-sampling according to described basic tomographic image; Coding module, for the basic layer using described basic tomographic image as described SVC, adopt H.264 method to encode, utilize the enhancement layer of described coded reference image using described enhancement layer image as described SVC to encode, and be respectively basic layer bit stream and enhancement layer bitstream interpolation code stream identification corresponding to described enhancement layer image that described basic tomographic image is corresponding, form encoding code stream.
For the abundant local scene that shows meeting-place, better meet user's needs, described coding unit 92 also can comprise: parameter acquisition module, for obtaining the cutting parameter of described enhancement layer image; Described coding module, also for when forming encoding code stream, is concentrated described cutting Parameter storage in the sequential parameter of described encoding code stream.
Wherein, the operation principle of described code device can be with reference to the description in preceding method embodiment.
The code device of the embodiment of the present invention, in the process of coding, for basic tomographic image and enhancement layer image in the meeting-place scene obtaining, encodes as basic layer, enhancement layer that can layered video encoding and decoding SVC respectively.The encoding code stream forming in this manner, takes full advantage of the characteristic of SVC coded system, can comprise the code stream corresponding to image of a plurality of different resolutions in the encoding code stream forming.Therefore, utilize the code device of the embodiment of the present invention, can improve the quality of image shown when realizing the many scenes demonstrations in meeting-place.
As shown in figure 10, the embodiment of the present invention ten also provides a kind of decoding device, comprising:
Code stream receiving element 1001, for received code code stream, wherein said encoding code stream is to be encoded and obtained by the enhancement layer using the basic tomographic image in the scene of meeting-place as basic layer that can layered video encoding and decoding SVC, using the enhancement layer image in the scene of meeting-place as described SVC;
Code stream acquiring unit 1002, for obtaining respectively basic layer bit stream and enhancement layer bitstream according to described encoding code stream;
Decoding unit 1003, for respectively described basic layer bit stream and enhancement layer bitstream being decoded, obtains described basic tomographic image and described enhancement layer image.
Wherein, described code stream acquiring unit 1002 can comprise: identification (RNC-ID) analytic module, for reading the code stream identification of described encoding code stream; Code stream acquisition module, for obtaining respectively basic layer bit stream and the enhancement layer bitstream of described encoding code stream according to described code stream identification.
Wherein, described decoding unit 1003 can comprise: the 6th image collection module, for described basic tomographic image is carried out to the decoded reference pictures that up-sampling obtains described enhancement layer bitstream; The 7th image collection module, for utilizing described decoded reference pictures to decode to described enhancement layer bitstream, obtains enhancement layer image.
In order to save decode resources, described decoding unit 1003 also can comprise: judge module, for judging whether, need to decode to described enhancement layer bitstream.Described judge whether to decode to described enhancement layer bitstream according to being, whether the display terminal of decoding end supports the function that topography amplifies, and is the described enhancement layer bitstream of decoding, otherwise does not decode; Or, even if the display terminal of decoding end is supported the function that topography amplifies, also judge whether the demand that topography amplifies, the instruction that topography amplifies for example whether detected, if, decoding needs enhancement layer bitstream corresponding to topography amplifying, and for other enhancement layer bitstreams, does not decode.Certainly, also may there is other criterion, will not enumerate herein.
Described decoding unit also can comprise: Parameter analysis of electrochemical module, for the slice header of the described encoding code stream of decoding, obtains the picture parameter set of described encoding code stream, and obtain described sequence parameter set by described picture parameter set.Now, described code stream acquisition module 1002, specifically for utilizing described sequence parameter set, described decoded reference pictures to decode to described enhancement layer bitstream, obtains enhancement layer image.
In addition, in order to save decode resources, improve decoding efficiency, described several parsing modules are also concentrated the cutting parameter of storage for obtaining described sequential parameter; Described code stream acquisition module, specifically for utilizing described sequence parameter set, cutting parameter and described decoded reference pictures to decode to described enhancement layer bitstream, obtains the enhancement layer image in the determined region of described cutting parameter.
In addition, described decoding device also can comprise: display unit, and for showing described basic tomographic image and enhancement layer image.
Wherein, the operation principle of described decoding device can be with reference to the description in preceding method embodiment.
The decoding device of the embodiment of the present invention, owing to being by basic tomographic image and the enhancement layer image of meeting-place scene in the process at coding, respectively as basic layer that can layered video encoding and decoding SVC, enhancement layer is encoded and form encoding code stream.That is to say the encoding code stream forming in this manner, take full advantage of the characteristic of SVC coded system, in the encoding code stream forming, can comprise the code stream corresponding to image of a plurality of different resolutions.Therefore, the basic tomographic image that decoding device that can the utility embodiment of the present invention obtains and the quality of enhancement layer image, thus improve the quality of image shown when realizing the many scenes in meeting-place and show.
The above; be only the specific embodiment of the present invention, but protection scope of the present invention is not limited to this, is anyly familiar with those skilled in the art in the technical scope that the present invention discloses; can expect easily changing or replacing, within all should being encompassed in protection scope of the present invention.Therefore, protection scope of the present invention should be as the criterion with the protection range of described claim.
Claims (15)
1. a coding method, is characterized in that, comprising:
Obtain respectively the basic tomographic image of a width and at least one width enhancement layer image in the scene of meeting-place;
Described basic tomographic image is encoded as basic layer that can layered video encoding and decoding SVC, the enhancement layer using described enhancement layer image as described SVC, forms encoding code stream, comprising:
Described basic tomographic image is carried out to the coded reference image that up-sampling obtains described enhancement layer image; Basic layer using described basic tomographic image as described SVC adopts H.264 method to encode, and utilizes the enhancement layer of described coded reference image using described enhancement layer image as described SVC to encode, and forms encoding code stream;
Wherein, described coded reference image and described basic tomographic image are image in the same time, and described coded reference image and described enhancement layer image have equal resolution.
2. method according to claim 1, is characterized in that, the described basic tomographic image of a width and at least one width enhancement layer image obtaining respectively in the scene of meeting-place comprises:
Obtain the identical but image that resolution is different of meeting-place scene Scene described at least two width, using the described image obtaining respectively as described enhancement layer image;
In the described image obtaining, select the little image of resolution to carry out down-sampling, obtain described basic tomographic image.
3. method according to claim 1, is characterized in that, the described basic tomographic image of a width and at least one width enhancement layer image obtaining respectively in the scene of meeting-place comprises:
Obtain at least one width meeting-place scene image;
Using described meeting-place scene image as enhancement layer image or to described meeting-place scene image, carry out obtaining after down-sampling enhancement layer image or using described meeting-place scene image and image that described meeting-place scene image is carried out obtaining after down-sampling as enhancement layer image;
A width in the scene image of described meeting-place is carried out to down-sampling, obtain basic tomographic image, the resolution of wherein said basic tomographic image is not more than the resolution of arbitrary described enhancement layer image.
4. method according to claim 1, is characterized in that, described method also comprises:
Obtain the cutting parameter of described enhancement layer image;
Described cutting Parameter storage is concentrated in the sequential parameter of described encoding code stream.
5. method according to claim 1, is characterized in that, described described basic tomographic image is encoded as basic layer that can layered video encoding and decoding SVC, the enhancement layer using described enhancement layer image as described SVC, forms encoding code stream and comprises:
Described basic tomographic image is encoded as basic layer that can layered video encoding and decoding SVC, the enhancement layer using described enhancement layer image as described SVC, and be respectively basic layer bit stream and enhancement layer bitstream interpolation code stream identification corresponding to described enhancement layer image that described basic tomographic image is corresponding, form encoding code stream.
6. a coding/decoding method, is characterized in that, comprising:
Received code code stream, wherein said encoding code stream is to be encoded and obtained by the enhancement layer using the basic tomographic image in the scene of meeting-place as basic layer that can layered video encoding and decoding SVC, using the enhancement layer image in the scene of meeting-place as described SVC, comprising: described basic tomographic image is carried out to the coded reference image that up-sampling obtains described enhancement layer image; Basic layer using described basic tomographic image as described SVC adopts H.264 method to encode, and utilizes the enhancement layer of described coded reference image using described enhancement layer image as described SVC to encode, and forms encoding code stream;
Wherein, described coded reference image and described basic tomographic image are image in the same time, and described coded reference image and described enhancement layer image have equal resolution;
According to described encoding code stream, obtain respectively basic layer bit stream and enhancement layer bitstream;
Respectively described basic layer bit stream and enhancement layer bitstream are decoded, obtain described basic tomographic image and described enhancement layer image.
7. method according to claim 6, is characterized in that, describedly according to described encoding code stream, obtains respectively basic layer bit stream and enhancement layer bitstream comprises:
Read the code stream identification in described encoding code stream;
According to described code stream identification, obtain respectively basic layer bit stream and the enhancement layer bitstream in described encoding code stream.
8. method according to claim 6, is characterized in that, described enhancement layer bitstream is being decoded, and while obtaining enhancement layer image, comprises:
Described basic tomographic image is carried out to the decoded reference pictures that up-sampling obtains described enhancement layer bitstream;
Utilize described decoded reference pictures to decode to described enhancement layer bitstream, obtain described enhancement layer image.
9. method according to claim 8, is characterized in that, described, according to described basic tomographic image, obtains before the decoded reference pictures of described enhancement layer bitstream, and described method also comprises:
Judge whether to decode to described enhancement layer bitstream.
10. method according to claim 8 or claim 9, is characterized in that, when described encoding code stream comprises sequence parameter set, describedly utilizes described decoded reference pictures to decode to described enhancement layer bitstream, obtains enhancement layer image and comprises:
The decode slice header of described encoding code stream, obtains the picture parameter set of described encoding code stream;
By described picture parameter set, obtain described sequence parameter set;
Utilize described sequence parameter set, described decoded reference pictures to decode to described enhancement layer bitstream, obtain described enhancement layer image.
11. methods according to claim 10, is characterized in that, described, by described picture parameter set, obtain after described sequence parameter set, and described method also comprises:
According to described sequence parameter set, obtain the wherein cutting parameter of storage;
Described described sequence parameter set, the described decoded reference pictures utilized decoded to described enhancement layer bitstream, obtains described enhancement layer image and comprises:
Utilize described sequence parameter set, cutting parameter and described decoded reference pictures to decode to described enhancement layer bitstream, obtain the enhancement layer image in the determined region of described cutting parameter.
12. 1 kinds of code devices, is characterized in that, comprising:
Image acquisition unit, for obtaining respectively the basic tomographic image of a width and at least one width enhancement layer image of meeting-place scene;
Coding unit, for described basic tomographic image is encoded as basic layer that can layered video encoding and decoding SVC, the enhancement layer using described enhancement layer image as described SVC, forms encoding code stream;
Wherein, described coding unit comprises:
Coded reference image collection module, for carrying out to described basic tomographic image the coded reference image that up-sampling obtains described enhancement layer image;
Coding module, for the basic layer using described basic tomographic image as described SVC, adopt H.264 method to encode, utilize the enhancement layer of described coded reference image using described enhancement layer image as described SVC to encode, and be respectively basic layer bit stream and enhancement layer bitstream interpolation code stream identification corresponding to described enhancement layer image that described basic tomographic image is corresponding, form encoding code stream;
Wherein, described coded reference image and described basic tomographic image are image in the same time, and described coded reference image and described enhancement layer image have equal resolution.
13. devices according to claim 12, is characterized in that, described image acquisition unit comprises:
The first image collection module, for obtaining the identical but image that resolution is different of at least two width meeting-place scene Scenes, and using the described image obtaining as described enhancement layer image;
The second image collection module, for the described image obtaining, selects the little image of resolution to carry out down-sampling, obtains described basic tomographic image.
14. devices according to claim 12, is characterized in that, described image acquisition unit comprises:
The 3rd image collection module, for obtaining at least one width meeting-place scene image;
The 4th image collection module, for carrying out obtaining after down-sampling enhancement layer image or using described meeting-place scene image and image that described meeting-place scene image is carried out obtaining after down-sampling as enhancement layer image using described meeting-place scene image as enhancement layer image or to described meeting-place scene image;
The 5th image collection module, for a width of described meeting-place scene image is carried out to down-sampling, obtains basic tomographic image, and the resolution of wherein said basic tomographic image is not more than the resolution of arbitrary described enhancement layer image.
15. devices according to claim 12, is characterized in that, described coding unit also comprises:
Parameter acquisition module, for obtaining the cutting parameter of described enhancement layer image;
Described coding module, also for when forming encoding code stream, is concentrated described cutting Parameter storage in the sequential parameter of described encoding code stream.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201010204321.5A CN101895748B (en) | 2010-06-21 | 2010-06-21 | Coding and decoding methods and coding and decoding devices |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201010204321.5A CN101895748B (en) | 2010-06-21 | 2010-06-21 | Coding and decoding methods and coding and decoding devices |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN101895748A CN101895748A (en) | 2010-11-24 |
| CN101895748B true CN101895748B (en) | 2014-03-26 |
Family
ID=43104792
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201010204321.5A Expired - Fee Related CN101895748B (en) | 2010-06-21 | 2010-06-21 | Coding and decoding methods and coding and decoding devices |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN101895748B (en) |
Families Citing this family (19)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2012096186A1 (en) | 2011-01-14 | 2012-07-19 | パナソニック株式会社 | Image encoding method, image decoding method, memory management method, image encoding device, image decoding device, memory management device, and image encoding/decoding device |
| CN103391472A (en) * | 2012-05-09 | 2013-11-13 | 腾讯科技（深圳）有限公司 | Method and system for acquiring video resolution ratios |
| US9571827B2 (en) | 2012-06-08 | 2017-02-14 | Apple Inc. | Techniques for adaptive video streaming |
| KR20170075802A (en) * | 2012-06-26 | 2017-07-03 | 미쓰비시덴키 가부시키가이샤 | Moving image encoding and decoding devices and methods |
| US10448032B2 (en) | 2012-09-04 | 2019-10-15 | Qualcomm Incorporated | Signaling of down-sampling location information in scalable video coding |
| CN103686179B (en) * | 2012-09-26 | 2019-05-07 | 中兴通讯股份有限公司 | Use the coding of parameter set, coding/decoding method and device, electronic equipment |
| CN103716622B (en) * | 2012-09-29 | 2017-02-08 | 华为技术有限公司 | Image processing method and device |
| CN103716627B (en) * | 2012-09-29 | 2017-02-22 | 华为技术有限公司 | layered coding and decoding method and device |
| CN103716630B (en) * | 2012-09-29 | 2017-02-22 | 华为技术有限公司 | Upsampling filter generation method and device |
| CN103716633A (en) * | 2012-09-30 | 2014-04-09 | 华为技术有限公司 | Scaled code stream processing method, scaled code stream processing device and scaled code stream encoder |
| EP2949123A2 (en) * | 2013-02-27 | 2015-12-02 | Apple Inc. | Adaptive streaming techniques |
| JP6605789B2 (en) * | 2013-06-18 | 2019-11-13 | パナソニック インテレクチュアル プロパティ コーポレーション オブ アメリカ | Transmission method, reception method, transmission device, and reception device |
| WO2015053330A1 (en) * | 2013-10-10 | 2015-04-16 | シャープ株式会社 | Image decoding device |
| CN106341690B (en) * | 2015-07-06 | 2020-03-13 | 阿里巴巴集团控股有限公司 | Method, device and system for realizing layered video coding |
| TWI650994B (en) * | 2016-09-02 | 2019-02-11 | 聯發科技股份有限公司 | Incremental quality delivery and compositing processing |
| CN109933394A (en) * | 2019-02-20 | 2019-06-25 | 深圳威尔视觉传媒有限公司 | Single-screen multiwindow low latency coding method and relevant apparatus |
| BR112022005448A2 (en) | 2019-09-24 | 2022-06-21 | Huawei Tech Co Ltd | Methods implemented by encoder, decoder, video encoding devices, and computer product |
| CN114697658A (en) * | 2020-12-31 | 2022-07-01 | 华为技术有限公司 | Encoding and decoding method, electronic device, communication system, and storage medium |
| CN114051137B (en) * | 2021-10-13 | 2024-10-29 | 上海工程技术大学 | Spatial scalable video coding method and decoding method |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101366281A (en) * | 2006-01-06 | 2009-02-11 | 微软公司 | Resampling and picture resizing operations for multi-resolution video coding and decoding |
| CN101394555A (en) * | 2008-10-24 | 2009-03-25 | 清华大学 | High error tolerant low time delay video transmission method and device suitable for deep space communication |
| CN101601300A (en) * | 2006-12-14 | 2009-12-09 | 汤姆逊许可公司 | The method and apparatus of encoding and/or decoding with adaptive enhancement layer prediction contraposition depth scalable video data |
| CN101601299A (en) * | 2006-12-14 | 2009-12-09 | 汤姆逊许可公司 | With the method and apparatus of the enhancement layer residual of bit depth scalability prediction to coding video data and/or decoding |
| CN101742324A (en) * | 2008-11-14 | 2010-06-16 | 北京中星微电子有限公司 | Video encoding and decoding methods, video encoding and decoding systems and encoder-decoder |
Family Cites Families (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20090279602A1 (en) * | 2005-04-13 | 2009-11-12 | Ye-Kui Wang | Method, Device and System for Effective Fine Granularity Scalability (FGS) Coding and Decoding of Video Data |
| FR2906433B1 (en) * | 2006-09-22 | 2009-02-27 | Canon Kk | METHODS AND DEVICES FOR ENCODING AND DECODING IMAGES, COMPUTER PROGRAM USING THEM AND INFORMATION SUPPORT FOR IMPLEMENTING THEM |
| US8467449B2 (en) * | 2007-01-08 | 2013-06-18 | Qualcomm Incorporated | CAVLC enhancements for SVC CGS enhancement layer coding |
-
2010
- 2010-06-21 CN CN201010204321.5A patent/CN101895748B/en not_active Expired - Fee Related
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101366281A (en) * | 2006-01-06 | 2009-02-11 | 微软公司 | Resampling and picture resizing operations for multi-resolution video coding and decoding |
| CN101601300A (en) * | 2006-12-14 | 2009-12-09 | 汤姆逊许可公司 | The method and apparatus of encoding and/or decoding with adaptive enhancement layer prediction contraposition depth scalable video data |
| CN101601299A (en) * | 2006-12-14 | 2009-12-09 | 汤姆逊许可公司 | With the method and apparatus of the enhancement layer residual of bit depth scalability prediction to coding video data and/or decoding |
| CN101394555A (en) * | 2008-10-24 | 2009-03-25 | 清华大学 | High error tolerant low time delay video transmission method and device suitable for deep space communication |
| CN101742324A (en) * | 2008-11-14 | 2010-06-16 | 北京中星微电子有限公司 | Video encoding and decoding methods, video encoding and decoding systems and encoder-decoder |
Also Published As
| Publication number | Publication date |
|---|---|
| CN101895748A (en) | 2010-11-24 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN101895748B (en) | Coding and decoding methods and coding and decoding devices | |
| CN106937121B (en) | Image decoding and encoding method, decoding and encoding device, decoder and encoder | |
| CN102055966B (en) | Compression method and system for media file | |
| CN107231566B (en) | Video transcoding method, device and system | |
| TWI647946B (en) | Image encoding and decoding methods and devices thereof | |
| EP2544451A3 (en) | Method and system for digital decoding 3D stereoscopic video images | |
| KR20190015495A (en) | Method and apparatus for video image encoding, and method and apparatus for decoding video image | |
| JP2016226001A (en) | Decoder and decoding method | |
| CN105721876A (en) | Method For Image Coding And Decoding | |
| EP1936998A3 (en) | Decoding method and coding method | |
| EP1798984A3 (en) | Video encoding/decoding method and apparatus | |
| CN102075756B (en) | Video multiframe prediction encoding and decoding method and device | |
| WO2023005740A1 (en) | Image encoding, decoding, reconstruction, and analysis methods, system, and electronic device | |
| CN101478661A (en) | System and method for providing high quality subtitle adding in video stream | |
| WO2022011571A1 (en) | Video processing method and apparatus, and device, decoder, system and storage medium | |
| TW201540045A (en) | Adaptive processing of video streams with reduced color resolution | |
| CN101668206B (en) | Multichannel video decoding display method and system based on H.264 | |
| CN109525852B (en) | Live video stream processing method, device and system and computer readable storage medium | |
| CN116156172A (en) | Video processing method, device, storage medium and electronic equipment | |
| CN101695133A (en) | Video encoding and decoding method, system and encoder for backwards compatible simulcast of low-resolution/high-resolution programs | |
| CN102047662B (en) | Encoder | |
| US6526173B1 (en) | Method and system for compression encoding video signals representative of image frames | |
| CN115278226A (en) | Real-time compression and remote monitoring method and system based on 3D point cloud | |
| CN204131646U (en) | A kind of digital video signal decoder | |
| CN102769715B (en) | A kind of method and system of code stream editing |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| TR01 | Transfer of patent right | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20170822 Address after: 201, room 1, building A, No. 518053, front Bay Road, Qianhai, Shenzhen Shenzhen cooperation zone, Guangdong, China Patentee after: Shenzhen Zhitong World Technology Service Co. Ltd. Address before: 518129 Longgang District, Guangdong, Bantian HUAWEI base B District, building 2, building No. Patentee before: Huawei Device Co., Ltd. |
|
| TR01 | Transfer of patent right | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20171227 Address after: 518053 Guangdong city of Shenzhen province Qianhai Shenzhen Hong Kong cooperation area before Bay Street, Qianhai road at the Shenzhen Hong Kong Cooperation Area Management Bureau office building A Building Room 201 Patentee after: Shenzhen Qianhai TengXiang science and Technology Information Co., Ltd. Address before: 201, room 1, building A, No. 518053, front Bay Road, Qianhai, Shenzhen Shenzhen cooperation zone, Guangdong, China Patentee before: Shenzhen Zhitong World Technology Service Co. Ltd. |
|
| CF01 | Termination of patent right due to non-payment of annual fee | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20140326 Termination date: 20190621 |