CN103716622B - Image processing method and device - Google Patents

Image processing method and device Download PDF

Info

Publication number
CN103716622B
CN103716622B CN201210374978.5A CN201210374978A CN103716622B CN 103716622 B CN103716622 B CN 103716622B CN 201210374978 A CN201210374978 A CN 201210374978A CN 103716622 B CN103716622 B CN 103716622B
Authority
CN
China
Prior art keywords
filter
image block
wave filter
image
target
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201210374978.5A
Other languages
Chinese (zh)
Other versions
CN103716622A (en
Inventor
杨海涛
杨名远
张金雷
李斌
李厚强
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
University of Science and Technology of China USTC
Huawei Technologies Co Ltd
Original Assignee
University of Science and Technology of China USTC
Huawei Technologies Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by University of Science and Technology of China USTC, Huawei Technologies Co Ltd filed Critical University of Science and Technology of China USTC
Priority to CN201210374978.5A priority Critical patent/CN103716622B/en
Priority to PCT/CN2013/084531 priority patent/WO2014048374A1/en
Publication of CN103716622A publication Critical patent/CN103716622A/en
Application granted granted Critical
Publication of CN103716622B publication Critical patent/CN103716622B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/30—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using hierarchical techniques, e.g. scalability
    • H04N19/33—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using hierarchical techniques, e.g. scalability in the spatial domain
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/117—Filters, e.g. for pre-processing or post-processing
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
    • H04N19/17—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object
    • H04N19/176—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a block, e.g. a macroblock

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Compression Or Coding Systems Of Tv Signals (AREA)
  • Image Processing (AREA)

Abstract

Disclosed is an image processing method which includes: determining a first training filter according to a non-smooth-area image block of an reinforced-layer image and a non-smooth-area image block of a basic-layer image so as to make the first training filter satisfies: the similarity between first prediction information, which is determined according to the first training filter and the non-smooth-area image block of the basic-layer image, and first original information, which is determined according to the non-smooth-area image block of the reinforce-layer image meets a first preset condition, wherein the basic-layer image is corresponding to the reinforced-layer image; determining alternative upsampling filters according to the first training filter, wherein the alternative upsampling filters include the first training filter; determining a target upsampling filter from the alternative upsampling filters; determining prediction information according to the target upsampling filter and the basic-layer image block; and performing coding processing on a target image block according to the prediction information so as to generate a target code stream.

Description

Method and apparatus for image procossing
Technical field
The present invention relates to field of video processing, and more particularly, to a kind of for image procossing for image at The method and apparatus of reason.
Background technology
Fast development with internet and cultural the becoming increasingly abundant of people's material spirit, are directed to video in internet Application demand get more and more in particular for the application demand of HD video, and the data volume of HD video is very big, wants HD video can transmit in band-limited internet it is necessary to the problem of solution first is exactly HD video compressed encoding asks Topic.
In network environment（Such as internet）, because the network bandwidth is limited, the demand of terminal device and user It is all different, so for certain specific application, the code stream of first compression is not satisfactory and effective, to one A bit for specific user or equipment, even nonsensical.An effective method solving this problem is exactly to utilize Scalable video（SVC, scalable video coding）Technology.In this SVC technology, according to inclusion spatial discrimination Rate, temporal resolution or noise specific strength etc., in interior mass parameter, an image are divided into multiple images layer.The mesh of SVC Mark is exactly the information allowing the high image layer of quality as far as possible sufficiently utilize low-quality image layer, improves the efficiency of inter-layer prediction, Enable in hgher efficiency when coding quality high image.
When the image high to quality carries out hierarchical coding, because resolution ratio is different, need low-quality image is carried out Sampling, after the resolution ratio consistent to reach the image high with quality, recycles the information of low-quality image that enhancement layer is carried out Prediction.Therefore, the effect of up-sampling can produce on coding efficiency and directly affect, due to the difference of the characteristic such as texture of image, By using multiple wave filters, can effectively lift the effect of up-sampling.
At present it is known that a kind of technology being up-sampled using multiple wave filters, it is to each 4 × 4 image block meter Calculate position 1,2,3,4 the horizontal direction of four pixels and the second differnce of vertical direction, by four pixel level directions Second differnce is added, as level（horizontal）, the second differnce of four pixel vertical directions is added, as vertical （vertical）.It is thus possible to determination grain direction（direction）.For example, if vertical is more than horizontal's Twice is it is determined that direction is 1；If horizontal is more than the twice of vertical it is determined that direction is 2； If vertical is equal to the twice of horizontal it is determined that direction is 0.Thereafter, calculate vertical and The mean value of horizontal, to determine the affiliated type of this block of pixels, and is respectively trained a wave filter for each type, this Sample is so that training gained wave filter is consistent with corresponding classification very much, but the method needs in coding side to wave filter system The index of number and the often wave filter that class block is used（index）Encoded and be transferred to decoding end, so just can be in solution Code end is correctly decoded.If making in this way Primary layer reconstruction image to be up-sampled, the table transmitting can be resulted in the need for Show that the bit of filter coefficient and index is too many, thus affecting coding efficiency.
Content of the invention
The embodiment of the present invention provide a kind of method and apparatus for image procossing, it is possible to increase the effect of image procossing and Performance.
A kind of first aspect, there is provided method for image procossing, the method includes：Non-flat according to enhancement layer image Skating area area image block and the non-smooth areas image block of basic tomographic image, determine the first training wave filter, so that this first training Wave filter meets：The first prediction being determined according to the non-smooth areas image block of this first training wave filter and this basic tomographic image Similarity between information and the first raw information being determined according to the non-smooth areas image block of this enhancement layer image meets the One is pre-conditioned, and wherein, the basic tomographic image being somebody's turn to do is corresponding with this enhancement layer image；According to this first training wave filter, determine Alternative up-sampling filter, wherein, this alternative up-sampling filter includes this first training wave filter；From this alternative up-sampling filter In ripple device, determine target up-sampling filter；According to this target up-sampling filter and Primary layer image block, determine prediction letter Breath；According to this information of forecasting, coded treatment is carried out to target image block, to generate target code stream, wherein, this target image block position In this enhancement layer image, this Primary layer image block is located in this basic tomographic image, and this primary image block is in this Primary layer figure Locus in this enhancement layer image is corresponding with this target image block for locus in picture.
In a kind of possible embodiment, the method also includes：Smooth region image block according to this enhancement layer image With the smooth region image block of this basic tomographic image, determine the second training wave filter, so that this second training wave filter meets：Root According to the second information of forecasting of the smooth region image block determination of this second training wave filter and this basic tomographic image and according to this increasing Similarity satisfaction second between the second raw information that the smooth region image block of strong tomographic image determines is pre-conditioned, wherein, The basic tomographic image being somebody's turn to do is corresponding with this enhancement layer image；And this, according to this first training wave filter, determines alternative up-sampling Wave filter, further includes：According to this first training wave filter and this second training wave filter, determine alternative up-sampling filtering Device, wherein, this alternative up-sampling filter includes this first training wave filter and this second training wave filter.
In conjunction with first aspect and the first possible embodiment, in the possible embodiment of second, should be from alternative In up-sampling filter, determine target up-sampling filter, including：According to the characteristic information of this Primary layer image block, determining should The smoothness of target image, wherein, this feature information includes the encoding block label information or basic to this of this Primary layer image block The residual information of tomographic image block；According to the smoothness of this target image block, determine this target up-sampling filter.
In conjunction with first aspect, the first possible embodiment and the possible embodiment of second, may at the third Embodiment in, according to this first training wave filter and this second training wave filter, determine alternative up-sampling filter, enter one Step includes：According to this first training wave filter, this second training wave filter and conventional filter, determine alternative up-sampling filtering Device, wherein, this alternative up-sampling filter includes this first training wave filter, this second training wave filter and the filtering of this tradition Device；And this, according to this information of forecasting, carries out coded treatment to this target image block, to generate target code stream, including：According to this Information of forecasting, carries out coded treatment to this target image block, and to generate target code stream, this target code stream is included for indicating this mesh Put on the first configured information of sampling filter, this first configured information in order to decode above-mentioned coding after target image block when As the foundation obtaining this target up-sampling filter.
In conjunction with the possible embodiment of first aspect, the first possible embodiment, second with the third is possible Embodiment, in the 4th kind of possible embodiment, this, according to this first training wave filter, determines alternative up-sampling filtering Device, further includes：According to this first training wave filter and conventional filter, determine alternative up-sampling filter, wherein, this is standby Choose sampling filter and include this first training wave filter and this conventional filter；And this determines target up-sampling filter, Including：Determine the texture of this target image block；According to the texture of this target image block, determine this target up-sampling filtering Device.
A kind of second aspect, there is provided method for image procossing, the method includes：Non-flat according to enhancement layer image Skating area area image block and the non-smooth areas image block of basic tomographic image, determine the first training wave filter, so that this first training Wave filter meets：The first prediction being determined according to the non-smooth areas image block of this first training wave filter and this basic tomographic image Similarity between information and the first raw information being determined according to the non-smooth areas image block of this enhancement layer image meets the One is pre-conditioned, and wherein, the basic tomographic image being somebody's turn to do is corresponding with this enhancement layer image；According to this first training wave filter, determine Alternative up-sampling filter, wherein, this alternative up-sampling filter includes this first training wave filter；From alternative up-sampling filtering In device, determine target up-sampling filter, this alternative up-sampling filter includes this first training wave filter；According in this target Sampling filter and Primary layer image block, determine information of forecasting；The residual error obtaining according to this information of forecasting and from target code stream Information, carries out decoding process to this object code stream, and to obtain this target image block, wherein, this target image block is located at this enhancing In tomographic image, this Primary layer image block is located in this basic tomographic image, and sky in this basic tomographic image for this primary image block Between the locus in this enhancement layer image is corresponding with this target image block for position.
In a kind of possible embodiment, the method also includes：Smooth region image block according to this enhancement layer image With the smooth region image block of this basic tomographic image, determine the second training wave filter, so that this second training wave filter meets：Root According to the second information of forecasting of the smooth region image block determination of this second training wave filter and this basic tomographic image and according to this increasing Similarity satisfaction second between the second raw information that the smooth region image block of strong tomographic image determines is pre-conditioned, wherein, The basic tomographic image being somebody's turn to do is corresponding with this enhancement layer image；And this, according to this first training wave filter, determines alternative up-sampling Wave filter, further includes：According to this first training wave filter and this second training wave filter, determine alternative up-sampling filtering Device, wherein, this alternative up-sampling filter includes this first training wave filter and this second training wave filter.
In conjunction with second aspect and the first possible embodiment, in the possible embodiment of second, should be from alternative In up-sampling filter, target up-sampling filter should be determined from alternative up-sampling filter, including：According to this Primary layer The characteristic information of image block, determines the smoothness of this target image, and wherein, this feature information includes the volume of this Primary layer image block Code block label information or the residual information to this Primary layer image block；According to the smoothness of this target image block, determine this target Up-sampling filter.
In conjunction with second aspect, the first possible embodiment and the possible embodiment of second, may at the third Embodiment in, according to this first training wave filter and this second training wave filter, determine alternative up-sampling filter, enter one Step includes：According to this first training wave filter, this second training wave filter and conventional filter, determine alternative up-sampling filtering Device, wherein, this alternative up-sampling filter includes this first training wave filter, this second training wave filter and the filtering of this tradition Device；And target up-sampling filter should be determined from alternative up-sampling filter, including：From this target code stream, obtain and use In the first configured information indicating this target up-sampling filter, according to this first configured information, determine the up-sampling filter of this target Ripple device.
In conjunction with the possible embodiment of second aspect, the first possible embodiment, second with the third is possible Embodiment, in the 4th kind of possible embodiment, this, according to this first training wave filter, determines alternative up-sampling filtering Device, further includes：According to this first training wave filter and conventional filter, determine alternative up-sampling filter, wherein, this is standby Choose sampling filter and include this first training wave filter and this conventional filter；And this determines target up-sampling filter, Including：Determine the texture of this target image block；According to the texture of this target image block, determine this target up-sampling filtering Device.
A kind of third aspect, there is provided device for image procossing, this device includes：Acquiring unit, for according to increasing The strong non-smooth areas image block of tomographic image and the non-smooth areas image block of basic tomographic image, determine the first training wave filter, So that this first training wave filter meets：Non-smooth areas image block according to this first training wave filter and this basic tomographic image Between the first information of forecasting determining and the first raw information according to the non-smooth areas image block determination of this enhancement layer image Similarity meet first pre-conditioned, wherein, the basic tomographic image being somebody's turn to do is corresponding with this enhancement layer image；Determining unit, root According to this first training wave filter, determine alternative up-sampling filter, wherein, this alternative up-sampling filter includes this first training Wave filter；For, from this alternative up-sampling filter, determining target up-sampling filter；Coding unit, for from this determination Unit obtains this up-sampling filter, and according to this target up-sampling filter and Primary layer image block, determines information of forecasting；With According to this information of forecasting, coded treatment is carried out to target image block, to generate target code stream, wherein, this target image block position In this enhancement layer image, this Primary layer image block is located in this basic tomographic image, and this primary image block is in this Primary layer figure Locus in this enhancement layer image is corresponding with this target image block for locus in picture.
In a kind of possible embodiment, this acquiring unit is additionally operable to the smooth region image according to this enhancement layer image Block and the smooth region image block of this basic tomographic image, determine the second training wave filter, so that this second training wave filter meets： Should with basis according to the second information of forecasting that the smooth region image block of this second training wave filter and this basic tomographic image determines Similarity satisfaction second between the second raw information that the smooth region image block of enhancement layer image determines is pre-conditioned, its In, the basic tomographic image being somebody's turn to do is corresponding with this enhancement layer image；And this determining unit is further used for according to this first training Wave filter and this second training wave filter, determine alternative up-sampling filter, wherein, this alternative up-sampling filter include this One training wave filter and this second training wave filter.
In conjunction with the third aspect and the first possible embodiment, in the possible embodiment of second, this determination list Unit, specifically for the characteristic information according to this Primary layer image block, determines the smoothness of this target image, wherein, this feature information Encoding block label information including this Primary layer image block or the residual information to this Primary layer image block；For according to this target The smoothness of image block, determines this target up-sampling filter.
In conjunction with the third aspect, the first possible embodiment and the possible embodiment of second, may at the third Embodiment in, this determining unit is further used for according to this first training wave filter, this second training wave filter and tradition Wave filter, determines alternative up-sampling filter, wherein, this alternative up-sampling filter include this first training wave filter, this Two training wave filters and this conventional filter；And this coding unit is specifically for according to this information of forecasting, to this target image Block carries out coded treatment, to generate target code stream, this target code stream include for indicate this target up-sampling filter first Configured information, this first configured information in order to decode above-mentioned coding after target image block when as obtain this target up-sampling The foundation of wave filter.
In conjunction with the possible embodiment of the third aspect, the first possible embodiment, second with the third is possible Embodiment, in the 4th kind of possible embodiment, this determining unit be further used for according to this first training wave filter and Conventional filter, determines alternative up-sampling filter, wherein, this alternative up-sampling filter include this first training wave filter and This conventional filter；Specifically for determining the texture of this target image block；For the texture according to this target image block, really This target up-sampling filter fixed.
Fourth aspect, there is provided a kind of device for image procossing is it is characterised in that this device includes：Acquiring unit, For the non-smooth areas image block of the non-smooth areas image block according to enhancement layer image and basic tomographic image, determine the first instruction Practice wave filter, so that this first training wave filter meets：Smoothed according to this first training wave filter and the non-of this basic tomographic image The first information of forecasting that area image block determines is former with first being determined according to the non-smooth areas image block of this enhancement layer image Similarity satisfaction first between beginning information is pre-conditioned, and wherein, the basic tomographic image being somebody's turn to do is corresponding with this enhancement layer image；Really Order unit, for according to this first training wave filter, determining alternative up-sampling filter, wherein, this alternative up-sampling filter Including this first training wave filter；For, from alternative up-sampling filter, determining target up-sampling filter, adopt on this is alternative Sample wave filter includes this first training wave filter；Decoding unit, for obtaining this target up-sampling filter from this determining unit, And according to this target up-sampling filter and Primary layer image block, determine information of forecasting；For according to this information of forecasting with from mesh The residual information obtaining in coding stream, carries out decoding process to this object code stream, to obtain this target image block, wherein, this mesh Logo image block is located in this enhancement layer image, and this Primary layer image block is located in this basic tomographic image, and this primary image block exists Locus in this enhancement layer image is corresponding with this target image block for locus in this basic tomographic image.
In a kind of possible embodiment, this acquiring unit is additionally operable to the smooth region image according to this enhancement layer image Block and the smooth region image block of this basic tomographic image, determine the second training wave filter, so that this second training wave filter meets： Should with basis according to the second information of forecasting that the smooth region image block of this second training wave filter and this basic tomographic image determines Similarity satisfaction second between the second raw information that the smooth region image block of enhancement layer image determines is pre-conditioned, its In, the basic tomographic image being somebody's turn to do is corresponding with this enhancement layer image；And this determining unit is further used for according to this first training Wave filter and this second training wave filter, determine alternative up-sampling filter, wherein, this alternative up-sampling filter include this One training wave filter and this second training wave filter.
In conjunction with fourth aspect and the first possible embodiment, in the possible embodiment of second, this determination list Unit, specifically for the characteristic information according to this Primary layer image block, determines the smoothness of this target image, wherein, this feature information Encoding block label information including this Primary layer image block or the residual information to this Primary layer image block；According to this target image The smoothness of block, determines this target up-sampling filter.
In conjunction with fourth aspect, the first possible embodiment and the possible embodiment of second, may at the third Embodiment in, this determining unit is further used for according to this first training wave filter, this second training wave filter and tradition Wave filter, determines alternative up-sampling filter, wherein, this alternative up-sampling filter include this first training wave filter, this Two training wave filters and this conventional filter；For, from this target code stream, obtaining for indicating this target up-sampling filter The first configured information, for according to this first configured information, determining this target up-sampling filter.
In conjunction with the possible embodiment of fourth aspect, the first possible embodiment, second with the third is possible Embodiment, in the 4th kind of possible embodiment, this determining unit be further used for according to this first training wave filter and Conventional filter, determines alternative up-sampling filter, wherein, this alternative up-sampling filter include this first training wave filter and This conventional filter；For determining the texture of this target image block；For the texture according to this target image block, determining should Target up-sampling filter.
A kind of 5th aspect, there is provided encoder for image procossing, this encoder includes：Bus；With this bus phase Processor even；The memory being connected with this bus；Wherein, this processor passes through this bus, calls storage in this memory Program, for the non-smooth areas image block of the non-smooth areas image block according to enhancement layer image and basic tomographic image, really Fixed first training wave filter, so that this first training wave filter meets：According to this first training wave filter and this basic tomographic image The first information of forecasting of determining of non-smooth areas image blocks determine with the non-smooth areas image block according to this enhancement layer image The first raw information between similarity meet first pre-conditioned, wherein, basic tomographic image and this enhancement layer image of being somebody's turn to do Corresponding；According to this first training wave filter, determine alternative up-sampling filter, wherein, this alternative up-sampling filter includes This first training wave filter；From this alternative up-sampling filter, determine target up-sampling filter；Up-sampled according to this target Wave filter and Primary layer image block, determine information of forecasting；According to this information of forecasting, coded treatment is carried out to target image block, with Generate target code stream, wherein, this target image block is located in this enhancement layer image, and this Primary layer image block is located at this Primary layer figure In picture, and locus in this basic tomographic image for this primary image block and this target image block are in this enhancement layer image Locus is corresponding.
In a kind of possible embodiment, this processing unit is additionally operable to the smooth region image according to this enhancement layer image Block and the smooth region image block of this basic tomographic image, determine the second training wave filter, so that this second training wave filter meets： Should with basis according to the second information of forecasting that the smooth region image block of this second training wave filter and this basic tomographic image determines Similarity satisfaction second between the second raw information that the smooth region image block of enhancement layer image determines is pre-conditioned, its In, the basic tomographic image being somebody's turn to do is corresponding with this enhancement layer image；For according to this first training wave filter and this second training filter Ripple device, determines alternative up-sampling filter, wherein, this alternative up-sampling filter include this first training wave filter and this second Training wave filter.
In conjunction with the 5th aspect and the first possible embodiment, in the possible embodiment of second, this process list Unit, specifically for the characteristic information according to this Primary layer image block, determines the smoothness of this target image, wherein, this feature information Encoding block label information including this Primary layer image block or the residual information to this Primary layer image block；For according to this target The smoothness of image block, determines this target up-sampling filter.
In conjunction with the 5th aspect, the first possible embodiment and the possible embodiment of second, may at the third Embodiment in, this processor specifically for according to this first training wave filter, this second training wave filter and tradition filtering Device, determines alternative up-sampling filter, and wherein, this alternative up-sampling filter includes this first training wave filter, this second instruction Practice wave filter and this conventional filter；For according to this information of forecasting, coded treatment being carried out to this target image block, to generate mesh Coding stream, this target code stream includes the first configured information for indicating this target up-sampling filter, this first configured information In order to decode above-mentioned coding after target image block when as obtain this target up-sampling filter according to
In conjunction with the possible embodiment of the 5th aspect, the first possible embodiment, second with the third is possible Embodiment, in the 4th kind of possible embodiment, this processor is specifically for according to this first training wave filter and tradition Wave filter, determines alternative up-sampling filter, and wherein, this alternative up-sampling filter includes this first training wave filter and this biography System wave filter；Specifically for determining the texture of this target image block；For the texture according to this target image block, determining should Target up-sampling filter..
A kind of 6th aspect, there is provided decoder for image procossing, this decoder includes：Bus；With this bus phase Processor even；The memory being connected with this bus；Wherein, this processor passes through this bus, calls storage in this memory Program, for the non-smooth areas image block of the non-smooth areas image block according to enhancement layer image and basic tomographic image, really Fixed first training wave filter, so that this first training wave filter meets：According to this first training wave filter and this basic tomographic image The first information of forecasting of determining of non-smooth areas image blocks determine with the non-smooth areas image block according to this enhancement layer image The first raw information between similarity meet first pre-conditioned, wherein, basic tomographic image and this enhancement layer image of being somebody's turn to do Corresponding；According to this first training wave filter, determine alternative up-sampling filter, wherein, this alternative up-sampling filter includes This first training wave filter；From alternative up-sampling filter, determine target up-sampling filter, this alternative up-sampling filter Including this first training wave filter；According to this target up-sampling filter and Primary layer image block, determine information of forecasting；According to this Information of forecasting and the residual information obtaining from target code stream, carry out decoding process to this object code stream, to obtain this target figure As block, wherein, this target image block is located in this enhancement layer image, and this Primary layer image block is located in this basic tomographic image, and Locus in this basic tomographic image for this primary image block and space bit in this enhancement layer image for this target image block Put corresponding.
In a kind of possible embodiment, this processing unit is additionally operable to the smooth region image according to this enhancement layer image Block and the smooth region image block of this basic tomographic image, determine the second training wave filter, so that this second training wave filter meets： Should with basis according to the second information of forecasting that the smooth region image block of this second training wave filter and this basic tomographic image determines Similarity satisfaction second between the second raw information that the smooth region image block of enhancement layer image determines is pre-conditioned, its In, the basic tomographic image being somebody's turn to do is corresponding with this enhancement layer image；For according to this first training wave filter and this second training filter Ripple device, determines alternative up-sampling filter, wherein, this alternative up-sampling filter include this first training wave filter and this second Training wave filter.
In conjunction with the 6th aspect and the first possible embodiment, in the possible embodiment of second, this process list Unit, specifically for the characteristic information according to this Primary layer image block, determines the smoothness of this target image, wherein, this feature information Encoding block label information including this Primary layer image block or the residual information to this Primary layer image block；According to this target image The smoothness of block, determines this target up-sampling filter.
In conjunction with the 6th aspect, the first possible embodiment and the possible embodiment of second, may at the third Embodiment in, this processor be further used for according to this first training wave filter, this second training wave filter and tradition filter Ripple device, determines alternative up-sampling filter, wherein, this alternative up-sampling filter include this first training wave filter, this second Training wave filter and this conventional filter；For, from this target code stream, obtaining for indicating this target up-sampling filter First configured information, for according to this first configured information, determining this target up-sampling filter.
In conjunction with the possible embodiment of the 6th aspect, the first possible embodiment, second with the third is possible Embodiment, in the 4th kind of possible embodiment, this processor is further used for according to this first training wave filter and biography System wave filter, determines alternative up-sampling filter, and wherein, this alternative up-sampling filter includes this first training wave filter and is somebody's turn to do Conventional filter；For determining the texture of this target image block；For the texture according to this target image block, determine this mesh Put on sampling filter.
The method for image procossing according to embodiments of the present invention, device code device and decoder, by according to smooth Region and non-smooth areas, determine up-sampling filter, can reduce up-sampling filtering while improving the effect of up-sampling The quantity of device and without transmission filter coefficient and index such that it is able to improve coding efficiency, carry out improve image procossing Effect and performance.
Brief description
In order to be illustrated more clearly that the technical scheme of the embodiment of the present invention, will make to required in the embodiment of the present invention below Accompanying drawing be briefly described it should be apparent that, drawings described below is only some embodiments of the present invention, for For those of ordinary skill in the art, on the premise of not paying creative work, other can also be obtained according to these accompanying drawings Accompanying drawing.
Fig. 1 is the indicative flowchart of the method for image procossing according to an embodiment of the invention.
Fig. 2 is the schematic diagram of the method for determining training wave filter according to an embodiment of the invention.
Fig. 3 is another indicative flowchart of the method for image procossing according to an embodiment of the invention.
Fig. 4 is the schematic block diagram of the device for image procossing according to an embodiment of the invention.
Fig. 5 is the schematic block diagram of the device for image procossing according to another embodiment of the present invention.
Fig. 6 is the schematic block diagram of the encoder for image procossing according to an embodiment of the invention.
Fig. 7 is the schematic block diagram of the decoder for image procossing according to another embodiment of the present invention.
Specific embodiment
Below in conjunction with the accompanying drawing in the embodiment of the present invention, the technical scheme in the embodiment of the present invention is carried out clear, complete Site preparation description is it is clear that described embodiment a part of embodiment that is the present invention, rather than whole embodiments.Based on this Embodiment in bright, the every other enforcement that those of ordinary skill in the art are obtained under the premise of not making creative work Example, broadly falls into the scope of protection of the invention.
Fig. 1 shows the method 100 for image procossing according to embodiments of the present invention from the description of coding side angle Indicative flowchart.As shown in figure 1, the method 100 includes：
S110, the non-smooth areas image block according to enhancement layer image and the non-smooth areas image block of basic tomographic image, Determine the first training wave filter, so that this first training wave filter meets：According to this first training wave filter and this Primary layer figure The first information of forecasting that the non-smooth areas image block of picture determines is true with the non-smooth areas image block according to this enhancement layer image Similarity satisfaction first between the first fixed raw information is pre-conditioned, wherein, basic tomographic image and this enhancement layer figure of being somebody's turn to do As corresponding；
S120, according to this first training wave filter, determines alternative up-sampling filter, wherein, this alternative up-sampling filtering Device includes this first training wave filter；
S130, from this alternative up-sampling filter, determines target up-sampling filter；
S140, according to this target up-sampling filter and Primary layer image block, determines information of forecasting.
S150, according to this information of forecasting, carries out coded treatment to target image block, to generate target code stream, wherein, this mesh Logo image block is located in this enhancement layer image, and this Primary layer image block is located in this basic tomographic image, and this primary image block exists Locus in this enhancement layer image is corresponding with this target image block for locus in this basic tomographic image
Hierarchical coding is being carried out to image, for example, when spatial scalable encodes, image can entered be about at resolution ratio Reason obtains low-resolution image, as a comparison original image is referred to as high-definition picture, encoder is respectively to this low resolution figure Picture and this high-definition picture carry out coded treatment.For convenience of describing, image to be encoded high for quality is referred to as increases herein Strong tomographic image, by corresponding low-quality image to be encoded（For example described low-resolution image）It is referred to as basic tomographic image.
In embodiments of the present invention, target image is the image being processed using layered coding technique, and Primary layer refers to Quality in hierarchical coding（Including parameters such as frame rate, spatial resolution, temporal resolution, noise specific strength or credit ratings） Relatively low layer, enhancement layer refers to the quality in hierarchical coding（Strong including frame rate, spatial resolution, temporal resolution, signal to noise ratio The parameter such as degree or credit rating）Higher layer.It should be noted that in embodiments of the present invention, in embodiments of the present invention, right In a given enhancement layer, Primary layer corresponding thereto can be less than any layer of this enhancement layer for quality, for example, if There is currently five layers, coding quality improves successively（That is, ground floor quality is minimum, layer 5 quality highest）If enhancement layer is 4th layer, then Primary layer can be ground floor or the second layer, can also be third layer, can also be the 4th layer.With Reason, for a given Primary layer, enhancement layer corresponding thereto can for quality less than this Primary layer any layer.
Enhancement layer image is the image in currently processed enhancement layer, basic tomographic image be Primary layer in enhancement layer image Image in synchronization.
In sum, in embodiments of the present invention, the quality of this basic tomographic image is less than the quality of this enhancement layer image.
Target image block is the image block processing in this enhancement layer image.
Primary layer image block is the figure that there is corresponding relation in basic tomographic image with this target image block on locus As block.
In embodiments of the present invention, Primary layer image block can be according to basic tomographic image with the corresponding relation of target image block Resolution ratio proportionate relationship and enhancement layer image between is calculated.For example, in the system including x direction and y direction, if The resolution ratio in x direction and y direction for the enhancement layer image is 2 times of basic tomographic image respectively, then for the upper left corner in enhancement layer Pixel coordinate is（2x, 2y）And size is（2m）×（2n）Image block, the corresponding blocks in its basic tomographic image can be upper left The pixel coordinate at angle is（X, y）And size is the image block of m × n.
In embodiments of the present invention, by image（Including enhancement layer image and basic tomographic image）It is divided into simple Liang Lei area Domain, i.e. smooth region and non-smooth areas.In smooth region, accurate predicted value during coding, generally can be obtained, from And, the encoding block mark determining during final coding（CBF, CodedBlock Flag）For 0, that is, residual error is 0.In non-smooth areas, Because characteristics of signals correlation is less it is impossible to accurate predict during coding, therefore can not obtain accurate predicted value, lead to pre- After survey, residual error is larger or uneven, thus, the CBF of final coding is not 0.
Therefore, in embodiments of the present invention it may be determined that in basic tomographic image CBF be 0 image block（Basic tomographic image Smooth region image block）Positioned at smooth region, it is thus possible to the image in thinking the enhancement layer image corresponding with this image block Block（The smooth region image block of enhancement layer image）Positioned at smooth region.In the same manner it may be determined that in basic tomographic image CBF be not 0 Image block（The non-smooth areas image block of basic tomographic image）Positioned at non-smooth areas, it is thus possible to think and this image block Image block in corresponding enhancement layer image（The non-smooth areas image block of enhancement layer image）Positioned at non-smooth areas.As above Described it may be determined that the smooth region image block of the smooth region image block of enhancement layer image and this basic tomographic image, and, increase The non-smooth areas image block of strong tomographic image and the non-smooth areas image block of this basic tomographic image.
Thereafter, in S110, can be non-flat according to the non-smooth areas image block of enhancement layer image and this basic tomographic image Skating area area image block training the first training wave filter, non-limiting as an example, this first instruction can be trained by the following method Practice wave filter.
As shown in Fig. 2 y1 (n) represents enhancement layer image（Original image）Smooth region image block（Multiple images are fast Set, hereinafter referred to as original even area image block）, x (n) represents the smooth region image block of basic tomographic image, and H (n) represents Wave filter to be determined（First training wave filter）, the smooth region image of e (n) expression basic tomographic image later after filtering Block（It is denoted as prognostic chart picture block）With original even area image block.For example, so that original even area image block and prognostic chart picture The mean square error of the pixel value of block is minimum, as optimal conditions（First pre-conditioned one）, solve H (n).
The optimal solution of this H (n) can be expressed as with following formula（1）,
H = R xx - 1 × r yx - - - ( 1 )
Wherein, RxxRepresent the auto-correlation function of original even area image block, ryxRepresent the smooth region of basic tomographic image Image block and the cross-correlation function of original even area image block.
It should be understood that acquisition listed above trains the method for wave filter to be merely illustrative, the present invention is not limited to This, for example, it is possible to by changing above-mentioned optimal condition etc., the method training wave filter to this acquisition carries out various changes.
Alternatively, the method also includes：
The smooth region image block of the smooth region image block according to this enhancement layer image and this basic tomographic image, determines the Two training wave filters, so that this second training wave filter meets：Flat according to this second training wave filter and this basic tomographic image The second information of forecasting that skating area area image block determines is former with second of the smooth region image block determination according to this enhancement layer image Similarity satisfaction second between beginning information is pre-conditioned, and wherein, the basic tomographic image being somebody's turn to do is corresponding with this enhancement layer image；With And
This, according to this first training wave filter, determines alternative up-sampling filter, further includes：
According to this first training wave filter and this second training wave filter, determine alternative up-sampling filter, wherein, this is standby Choose sampling filter and include this first training wave filter and this second training wave filter.
In embodiments of the present invention, except the sample of training is different（First training wave filter is the non-smooth of enhancement layer image The non-smooth areas image block training of area image block and basic tomographic image obtains, and the second training wave filter is this enhancement layer image Smooth region image block and this basic tomographic image smooth region image block training obtain）, other similar process outward, here, In order to avoid repeating, the description thereof will be omitted.
By said method, the first training wave filter and the second training wave filter can be respectively obtained, therefore, in the present invention In embodiment, the coefficient of training wave filter is fixing, does not need in an encoding process to consume bit transfer filter coefficient, with When decoding end select wave filter when, for example, it is possible to the affiliated type of current block is judged according to the CBF value of Primary layer corresponding blocks（That is, For smooth region image block or non-smooth areas image block）, thus, the rope of the wave filter of each image block use need not be transmitted Draw, improve the performance of image procossing.
Thus, this first training wave filter and the second training wave filter can be included in alternative filter, i.e. situation 1.
Situation 1
Alternatively, target up-sampling filter should be determined from alternative up-sampling filter, including：
According to the characteristic information of this Primary layer image block, determine the smoothness of this target image, wherein, this feature packet Include encoding block label information or the residual information to this Primary layer image block of this Primary layer image block；
According to the smoothness of this target image block, determine this target up-sampling filter.
Specifically, the first training wave filter acquired as discussed above and the second instruction are included in this alternative up-sampling filter In the case of practicing wave filter, in S 130, can be according to the type of target image block（For smooth region image block or non-smooth Area image block）, selection target up-sampling filter.
In embodiments of the present invention, when the CBF of the Primary layer image block corresponding with this target image block is 0, permissible Determine that this target image block is located at smooth region.In the same manner, when the Primary layer image block corresponding with this target image block CBF not For when 0 it may be determined that this target image block be located at non-smooth areas.
It should be understood that the method for smoothness of the image block that really sets the goal listed above and the parameter of use are merely illustrative Bright, the present invention is not limited to this, and other can determine the smoothness of target image block, i.e. determine that target image block is in increasing The method of the smooth region in strong tomographic image or non-smooth areas and parameter, each fall within protection scope of the present invention.
In the case of this, in S140, can be determined as described above according to this target up-sampling filter, to basic tomographic image The reconstruction image of block is up-sampled, so that it is determined that the predicted value with respect to target image block.
Thus, in S150, the distortion rate cost of each predictive mode can be calculated, and determine this target image block is compiled The optimal prediction modes using during code.It should be noted that when the target image block after to this coding is decoded processing, can So that target up-sampling filter is determined using method similar to the above.
Alternatively, this alternative up-sampling filter also includes conventional filter, and
This, according to this information of forecasting, carries out coded treatment to this target image block, to generate target code stream, including：
According to this information of forecasting, coded treatment is carried out to this target image block, to generate target code stream, this target stream packet Include the first configured information for indicating this target up-sampling filter, this first configured information is in order to after decoding above-mentioned coding Target image block when as obtain this target up-sampling filter foundation.
In embodiments of the present invention, as conventional filter, for example, it is possible to include existing cosine interpolation filter.With In lower explanation, for convenience of description, so that this conventional filter is for cosine interpolation filter as a example, illustrate.
Specifically, in embodiments of the present invention, the method that wave filter is trained in above-mentioned acquisition（Training process）In pixel domain Carry out, and it is possible to for different down-sampling ratios（Resolution ratio between enhancement layer image and basic tomographic image）Carry out Different training, for example, exist the wave filter that whole location of pixels and half-pixel position are obtained different in the case of, therefore, can The prediction to whole location of pixels and half-pixel position can be led to unbalanced, thus affecting the stationarity of prediction residual, therefore, at this In inventive embodiments, can also can also add conventional filter, for example, cosine filtering interpolation in alternative up-sampling filter Device, the acquisition methods of this cosine interpolation filter can be same as the prior art, and here, in order to avoid repeating, the description thereof will be omitted.
Thus, this first training wave filter and the second training wave filter and the filter of cosine interpolation can be included in alternative filter Ripple device（One of conventional filter）, i.e. situation 2.
Situation 2
In S130, it is, for example possible to use rate-distortion optimization（RDO, Rate-Distortion Optimization）, choosing Select using cosine interpolation filter or the first training wave filter or the second training wave filter, as target up-sampling filter.
In the case of this, thereafter, in S140, can be according to this target up-sampling filter, the reconstruction to Primary layer image block Image is up-sampled, so that it is determined that the predicted value with respect to target image block.
Thus, in S150, the distortion rate cost of each predictive mode can be calculated, and determine this target image block is compiled The optimal prediction modes using during code.In the case that this optimal prediction modes is inter-layer texture prediction pattern, can be to being used for Indicate this target up-sampling filter（Specifically, indicate this target up-sampling filter be cosine interpolation filter, first instruction Practiced which wave filter in wave filter or the first training wave filter）The first configured information carry out coded treatment, and by coding The first configured information after reason adds code stream, adopts using in the target image block after the above-mentioned coding of decoding as this target of acquisition Sample wave filter foundation.It should be noted that alternative filter include this cosine interpolation filter or first training wave filter or Second training wave filter, during as target up-sampling filter, alternative filter is three, and, coding side as described above or Decoding end can determine and train wave filter using the first training wave filter or second according to the smoothness of target image block, therefore, This first configured information only can be carried with a bit identifier in code stream, to indicate this target up-sampling filter as tradition Wave filter（Cosine interpolation filter）Or training wave filter（First training wave filter or the second training wave filter）.Filter when alternative In ripple device, when the number of conventional filter is at least two, can realize indicating by increasing the digit of the first configured information The purpose of target image block.
When being up-sampled by cosine interpolation filter, it is always the direct respective pixel replicating basic tomographic image Point, but, for example, in scalable video coding method, the pixel of basic tomographic image is not the corresponding enhancing of direct duplication The pixel of tomographic image, now, if the whole pixel of target image is located at catastrophe point, directly replicates Primary layer pair when being up-sampled Answer pixel that very big error occurs.Therefore make to be up-sampled in this way, may be such that the whole picture of enhancement layer image There is larger error plain position, therefore, in embodiments of the present invention, by using the embodiment of the present invention to the pixel of above-mentioned catastrophe point The method training wave filter that obtains of training（First training wave filter or the second training wave filter）, it is possible to increase the effect of up-sampling Really, improve the performance of coding and image procossing.
Alternatively, this alternative up-sampling filter also includes conventional filter, and
This determines target up-sampling filter, including：
Determine the texture of this target image block；
According to the texture of this target image block, determine this target up-sampling filter.
As described above, in the present invention is implemented, including cosine interpolation filter, the first instruction in this alternative up-sampling filter In the case of practicing wave filter and the second training wave filter.As described above, after according to RDO selection target up-sampling filter, needing To transmit the marker bit for carrying the first configured information after coding in code stream, with the target figure after decoding above-mentioned coding Determine during as block which wave filter target up-sampling filter is.Therefore, two candidate can be adopted in this programme, But selected not by RDO, but selected according to the different characteristic of different wave filters, thus avoid transmitting one more Individual marker bit represents target up-sampling filter.That is, this alternative filter includes the first training wave filter and conventional filter, That is, situation 3
Situation 3
In S130, for example, it is possible to be inserted from the first training wave filter and cosine according to the characteristic information of Primary layer image block Value filter（One of conventional filter）Middle selection target up-sampling filter, thus avoid transmission marker bit to represent used Wave filter, it is for instance possible to use according to the texture strength of Primary layer image block determine select use wave filter, at this In bright embodiment, can adopt, for example, rim detection, the method such as texture strength analysis or Intra-codiog prediction mode, determine The texture of Primary layer image block, and for example, when texture is stronger, selecting training gained wave filter to be used as target Up-sampling filter, remaining is all using cosine interpolation filter.Listed above by rim detection, texture strength analysis or The methods such as Intra-codiog prediction mode determine that the method for the texture of Primary layer image block can be same as the prior art, here, In order to avoid repeating, the description thereof will be omitted.
In the case of this, thereafter, in S140, can be according to this target up-sampling filter, the reconstruction to Primary layer image block Image is up-sampled, so that it is determined that the predicted value with respect to target image block.
Thus, in S150, the distortion rate cost of each predictive mode can be calculated, and determine this target image block is compiled The optimal prediction modes using during code.And coded treatment is carried out to target image block.
When being up-sampled by cosine interpolation filter, it is always the direct respective pixel replicating basic tomographic image Point, but, for example, in scalable video coding method, the pixel of basic tomographic image is not the corresponding enhancing of direct duplication The pixel of tomographic image, now, if the whole pixel of target image is located at catastrophe point, directly replicates Primary layer pair when being up-sampled Answer pixel that very big error occurs.First training wave filter preferably can be recovered to the pixel of catastrophe point position, because This can be very good to make up the deficiency of cosine interpolation filter.
It should be noted that when the target image block after to this coding is decoded processing, can be using same with above-mentioned The method of sample determines target up-sampling filter.
The method for image procossing according to embodiments of the present invention, by according to smooth region and non-smooth areas, really Determine up-sampling filter, the quantity of up-sampling filter while improving the effect of up-sampling, can be reduced and need not pass Defeated filter coefficient and index, such that it is able to improve coding efficiency, carry out improving effect and the performance of image procossing.
Fig. 3 shows the method 200 for image procossing according to embodiments of the present invention from the description of coding side angle Indicative flowchart.As shown in figure 3, the method 200 includes：
S210, the non-smooth areas image block according to enhancement layer image and the non-smooth areas image block of basic tomographic image, Determine the first training wave filter, so that this first training wave filter meets：According to this first training wave filter and this Primary layer figure The first information of forecasting that the non-smooth areas image block of picture determines is true with the non-smooth areas image block according to this enhancement layer image Similarity satisfaction first between the first fixed raw information is pre-conditioned, wherein, basic tomographic image and this enhancement layer figure of being somebody's turn to do As corresponding；
S220, according to this first training wave filter, determines alternative up-sampling filter, wherein, this alternative up-sampling filtering Device includes this first training wave filter；
S230, from alternative up-sampling filter, determines target up-sampling filter, and this alternative up-sampling filter includes This first training wave filter；
S240, according to this target up-sampling filter and Primary layer image block, determines information of forecasting.
S250, the residual information obtaining according to this information of forecasting and from target code stream, this object code stream is decoded Process, to obtain this target image block, wherein, this target image block is located in this enhancement layer image, this Primary layer image block position In this basic tomographic image, and locus in this basic tomographic image for this primary image block and this target image block are in this increasing Locus in strong tomographic image is corresponding
Hierarchical coding is being carried out to image, for example, when spatial scalable encodes, image can entered be about at resolution ratio Reason obtains low-resolution image, as a comparison original image is referred to as high-definition picture, encoder is respectively to this low resolution figure Picture and this high-definition picture carry out coded treatment.For convenience of describing, image to be encoded high for quality is referred to as increases herein Strong tomographic image, by corresponding low-quality image to be encoded（For example described low-resolution image）It is referred to as basic tomographic image.
In embodiments of the present invention, target image is the image being processed using layered coding technique, and Primary layer refers to Quality in hierarchical coding（Including parameters such as frame rate, spatial resolution, temporal resolution, noise specific strength or credit ratings） Relatively low layer, enhancement layer refers to the quality in hierarchical coding（Strong including frame rate, spatial resolution, temporal resolution, signal to noise ratio The parameter such as degree or credit rating）Higher layer.It should be noted that in embodiments of the present invention, in embodiments of the present invention, right In a given enhancement layer, Primary layer corresponding thereto can be less than any layer of this enhancement layer for quality, for example, if There is currently five layers, coding quality improves successively（That is, ground floor quality is minimum, layer 5 quality highest）If enhancement layer is 4th layer, then Primary layer can be ground floor or the second layer, can also be third layer, can also be the 4th layer.With Reason, for a given Primary layer, enhancement layer corresponding thereto can for quality less than this Primary layer any layer.
Enhancement layer image is the image in currently processed enhancement layer, basic tomographic image be Primary layer in enhancement layer image Image in synchronization.
In sum, in embodiments of the present invention, the quality of this basic tomographic image is less than the quality of this enhancement layer image.
Target image block is the image block processing in this enhancement layer image.
Primary layer image block is the figure that there is corresponding relation in basic tomographic image with this target image block on locus As block.
In embodiments of the present invention, Primary layer image block can be according to basic tomographic image with the corresponding relation of target image block Resolution ratio proportionate relationship and enhancement layer image between is calculated.For example, in the system including x direction and y direction, if The resolution ratio in x direction and y direction for the enhancement layer image is 2 times of basic tomographic image respectively, then for the upper left corner in enhancement layer Pixel coordinate is（2x, 2y）And size is（2m）×（2n）Image block, the corresponding blocks in its basic tomographic image can be upper left The pixel coordinate at angle is（X, y）And size is the image block of m × n.
In embodiments of the present invention, by image（Including enhancement layer image and basic tomographic image）It is divided into simple Liang Lei area Domain, i.e. smooth region and non-smooth areas.In smooth region, accurate predicted value during coding, generally can be obtained, from And, the encoding block mark determining during final coding（CBF, Coded Block Flag）For 0, that is, residual error is 0.In non-smooth area Domain, because characteristics of signals correlation is less it is impossible to accurate predict during coding, therefore can not obtain accurate predicted value, lead After causing prediction, residual error is larger or uneven, thus, the CBF of final coding is not 0.
Therefore, in embodiments of the present invention it may be determined that in basic tomographic image CBF be 0 image block（Basic tomographic image Smooth region image block）Positioned at smooth region, it is thus possible to the image in thinking the enhancement layer image corresponding with this image block Block（The smooth region image block of enhancement layer image）Positioned at smooth region.In the same manner it may be determined that in basic tomographic image CBF be not 0 Image block（The non-smooth areas image block of basic tomographic image）Positioned at non-smooth areas, it is thus possible to think and this image block Image block in corresponding enhancement layer image（The non-smooth areas image block of enhancement layer image）Positioned at non-smooth areas.As above Described it may be determined that the smooth region image block of the smooth region image block of enhancement layer image and this basic tomographic image, and, increase The non-smooth areas image block of strong tomographic image and the non-smooth areas image block of this basic tomographic image.
Thereafter, in S210, can be non-flat according to the non-smooth areas image block of enhancement layer image and this basic tomographic image Skating area area image block training the first training wave filter, non-limiting as an example, this first instruction can be trained by the following method Practice wave filter.
As shown in Fig. 2 y1 (n) represents enhancement layer image（Original image）Smooth region image block（Multiple images are fast Set, hereinafter referred to as original even area image block）, x (n) represents the smooth region image block of basic tomographic image, and H (n) represents Wave filter to be determined（First training wave filter）, the smooth region image of e (n) expression basic tomographic image later after filtering Block（It is denoted as prognostic chart picture block）With original even area image block.For example, so that original even area image block and prognostic chart picture The mean square error of the pixel value of block is minimum, as optimal conditions（First pre-conditioned one）, solve H (n).
The optimal solution of this H (n) can be expressed as above formula（1）,
It should be understood that acquisition listed above trains the method for wave filter to be merely illustrative, the present invention is not limited to This, for example, it is possible to by changing above-mentioned optimal condition etc., the method training wave filter to this acquisition carries out various changes.
Alternatively, the method also includes：
The smooth region image block of the smooth region image block according to this enhancement layer image and this basic tomographic image, determines the Two training wave filters, so that this second training wave filter meets：Flat according to this second training wave filter and this basic tomographic image The second information of forecasting that skating area area image block determines is former with second of the smooth region image block determination according to this enhancement layer image Similarity satisfaction second between beginning information is pre-conditioned, and wherein, the basic tomographic image being somebody's turn to do is corresponding with this enhancement layer image；With And
This, according to this first training wave filter, determines alternative up-sampling filter, further includes：
According to this first training wave filter and this second training wave filter, determine alternative up-sampling filter, wherein, this is standby Choose sampling filter and include this first training wave filter and this second training wave filter.
In embodiments of the present invention, except the sample of training is different（First training wave filter is the non-smooth of enhancement layer image The non-smooth areas image block training of area image block and basic tomographic image obtains, and the second training wave filter is this enhancement layer image Smooth region image block and this basic tomographic image smooth region image block training obtain）, other similar process outward, here, In order to avoid repeating, the description thereof will be omitted.
By said method, the first training wave filter and the second training wave filter can be respectively obtained, therefore, in the present invention In embodiment, the coefficient of training wave filter is fixing, does not need in an encoding process to consume bit transfer filter coefficient, with When decoding end select wave filter when, for example, it is possible to the affiliated type of current block is judged according to the CBF value of Primary layer corresponding blocks（That is, For smooth region image block or non-smooth areas image block）, thus, the rope of the wave filter of each image block use need not be transmitted Draw, improve the performance of image procossing.
Thus, this first training wave filter and the second training wave filter can be included in alternative filter, i.e. situation 4.
Situation 4
Alternatively, target up-sampling filter should be determined from alternative up-sampling filter, including：
According to the characteristic information of this Primary layer image block, determine the smoothness of this target image, wherein, this feature packet Include encoding block label information or the residual information to this Primary layer image block of this Primary layer image block；
According to the smoothness of this target image block, determine this target up-sampling filter.
Specifically, the first training wave filter acquired as discussed above and the second instruction are included in this alternative up-sampling filter In the case of practicing wave filter, in S230, can be according to the type of target image block（For smooth region image block or non-smooth area Area image block）, selection target up-sampling filter.
In embodiments of the present invention, when the CBF of the Primary layer image block corresponding with this target image block is 0, permissible Determine that this target image block is located at smooth region.In the same manner, when the Primary layer image block corresponding with this target image block CBF not For when 0 it may be determined that this target image block be located at non-smooth areas.
It should be understood that the method for smoothness of the image block that really sets the goal listed above and the parameter of use are merely illustrative Bright, the present invention is not limited to this, and other can determine the smoothness of target image block, i.e. determine that target image block is in increasing The method of the smooth region in strong tomographic image or non-smooth areas and parameter, each fall within protection scope of the present invention.
In the case of this, in S240, can be determined as described above according to this target up-sampling filter, to basic tomographic image The reconstruction image of block is up-sampled, so that it is determined that the predicted value with respect to target image block.
Thus, in S250, can be according to this predicted value and the residual information obtaining from target code stream, to target image block It is decoded, in embodiments of the present invention, this process can be same as the prior art, herein for avoiding repeating, omit it and say Bright.
Alternatively, this alternative up-sampling filter also includes conventional filter, and
Target up-sampling filter should be determined from alternative up-sampling filter, including：
From this target code stream, obtain the first configured information for indicating this target up-sampling filter,
According to this first configured information, determine this target up-sampling filter.
In embodiments of the present invention, as conventional filter, for example, it is possible to include existing cosine interpolation filter.With In lower explanation, for convenience of description, so that this conventional filter is for cosine interpolation filter as a example, illustrate.
Specifically, in embodiments of the present invention, the method that wave filter is trained in above-mentioned acquisition（Training process）In pixel domain Carry out, and it is possible to for different down-sampling ratios（Resolution ratio between enhancement layer image and basic tomographic image）Carry out Different training, for example, exist the wave filter that whole location of pixels and half-pixel position are obtained different in the case of, therefore, can The prediction to whole location of pixels and half-pixel position can be led to unbalanced, thus affecting the stationarity of prediction residual, therefore, at this In inventive embodiments, can also can also add conventional filter, for example, cosine filtering interpolation in alternative up-sampling filter Device, the acquisition methods of this cosine interpolation filter can be same as the prior art, and here, in order to avoid repeating, the description thereof will be omitted.
Thus, this first training wave filter and the second training wave filter and the filter of cosine interpolation can be included in alternative filter Ripple device（One of conventional filter）, i.e. situation 5.
Situation 5
In S230, for example, it is possible to obtain the first configured information from target code stream, in embodiments of the present invention, standby Selecting filter includes this cosine interpolation filter or the first training wave filter or the second training wave filter, up-samples filter as target During ripple device, alternative filter is three, and, coding side as described above or decoding end can be smooth according to target image block Degree, determines using the first training wave filter or the second training wave filter, therefore, it can only be held with a bit identifier in code stream Carry this first configured information, to indicate this target up-sampling filter as conventional filter（Cosine interpolation filter）Or train Wave filter（First training wave filter or the second training wave filter）.For example, when configured information is 1, select training wave filter（Bag Include the first training wave filter or the second training wave filter）, and the smoothness according to this target image block, from this first training filtering Target up-sampling filter is determined in device or the second training wave filter.For example, when configured information is 0, select the filter of cosine interpolation Ripple device is as target up-sampling filter.
It should be understood that listed above is merely illustrative by the method that the first configured information indicates target up-sampling filter Illustrate, the present invention is not limited to this.
It should be noted that when the number of conventional filter in alternative filter is at least two, can be by increasing The digit of the first configured information, to realize indicating the purpose of target image block.
In the case of this, in S240, can be determined as described above according to this target up-sampling filter, to basic tomographic image The reconstruction image of block is up-sampled, so that it is determined that the predicted value with respect to target image block.
Thus, in S250, can be according to this predicted value and the residual information obtaining from target code stream, to target image block It is decoded, in embodiments of the present invention, this process can be same as the prior art, herein for avoiding repeating, omit it and say Bright.
When being up-sampled by cosine interpolation filter, it is always the direct respective pixel replicating basic tomographic image Point, but, for example, in scalable video coding method, the pixel of basic tomographic image is not the corresponding enhancing of direct duplication The pixel of tomographic image, now, if the whole pixel of target image is located at catastrophe point, directly replicates Primary layer pair when being up-sampled Answer pixel that very big error occurs.Therefore make to be up-sampled in this way, may be such that the whole picture of enhancement layer image There is larger error plain position, therefore, in embodiments of the present invention, by using the embodiment of the present invention to the pixel of above-mentioned catastrophe point The method training wave filter that obtains of training（First training wave filter or the second training wave filter）, it is possible to increase the effect of up-sampling Really, improve the performance of coding and image procossing.
Alternatively, this alternative up-sampling filter also includes conventional filter, and
This determines target up-sampling filter, including：
Determine the texture of this target image block；
According to the texture of this target image block, determine this target up-sampling filter.
As described above, in the present invention is implemented, including cosine interpolation filter, the first instruction in this alternative up-sampling filter In the case of practicing wave filter and the second training wave filter.As described above, after according to RDO selection target up-sampling filter, needing To transmit the marker bit for carrying the first configured information after coding in code stream, with the target figure after decoding above-mentioned coding Determine during as block which wave filter target up-sampling filter is.Therefore, two candidate can be adopted in this programme, But selected not by RDO, but selected according to the different characteristic of different wave filters, thus avoid transmitting one more Individual marker bit represents target up-sampling filter.That is, this alternative filter includes the first training wave filter and conventional filter, That is, situation 6
Situation 6
In S230, for example, it is possible to be inserted from the first training wave filter and cosine according to the characteristic information of Primary layer image block Value filter（One of conventional filter）Middle selection target up-sampling filter, thus avoid transmission marker bit to represent used Wave filter, it is for instance possible to use according to the texture strength of Primary layer image block determine select use wave filter, at this In bright embodiment, can adopt, for example, rim detection, the method such as texture strength analysis or Intra-codiog prediction mode, determine The texture of Primary layer image block, and for example, when texture is stronger, selecting training gained wave filter to be used as target Up-sampling filter, remaining is all using cosine interpolation filter.Listed above by rim detection, texture strength analysis or The methods such as Intra-codiog prediction mode determine that the method for the texture of Primary layer image block can be same as the prior art, here, In order to avoid repeating, the description thereof will be omitted.
In the case of this, in S240, can be determined as described above according to this target up-sampling filter, to basic tomographic image The reconstruction image of block is up-sampled, so that it is determined that the predicted value with respect to target image block.
Thus, in S250, can be according to this predicted value and the residual information obtaining from target code stream, to target image block It is decoded, in embodiments of the present invention, this process can be same as the prior art, herein for avoiding repeating, omit it and say Bright.
When being up-sampled by cosine interpolation filter, it is always the direct respective pixel replicating basic tomographic image Point, but, for example, in scalable video coding method, the pixel of basic tomographic image is not the corresponding enhancing of direct duplication The pixel of tomographic image, now, if the whole pixel of target image is located at catastrophe point, directly replicates Primary layer pair when being up-sampled Answer pixel that very big error occurs.First training wave filter preferably can be recovered to the pixel of catastrophe point position, because This can be very good to make up the deficiency of cosine interpolation filter.
The method for image procossing according to embodiments of the present invention, by according to smooth region and non-smooth areas, really Determine up-sampling filter, the quantity of up-sampling filter while improving the effect of up-sampling, can be reduced and need not pass Defeated filter coefficient and index, such that it is able to improve coding efficiency, carry out improving effect and the performance of image procossing.
Above, in conjunction with Fig. 1 to Fig. 3, describe the method for image procossing according to embodiments of the present invention in detail, under Face, will describe the device for image procossing according to embodiments of the present invention in detail in conjunction with Fig. 4 to Fig. 5.
Fig. 4 shows the schematic block diagram of the device 300 for image procossing according to embodiments of the present invention.As Fig. 7 institute Show, this device 300 includes：
Acquiring unit 310, smooths for the non-smooth areas image block according to enhancement layer image and the non-of basic tomographic image Area image block, determines the first training wave filter, so that this first training wave filter meets：According to this first training wave filter and The first information of forecasting that the non-smooth areas image block of this basic tomographic image determines and the non-smooth area according to this enhancement layer image Similarity between the first raw information that area image block determines meet first pre-conditioned, wherein, the basic tomographic image that is somebody's turn to do with This enhancement layer image is corresponding；
Determining unit 320, for according to this first training wave filter, determining alternative up-sampling filter, wherein, this is alternative Up-sampling filter includes this first training wave filter；
For, from this alternative up-sampling filter, determining target up-sampling filter, and should to coding unit 330 transmission Target up-sampling filter, this alternative up-sampling filter includes this first training wave filter of this acquiring unit 310 acquisition；
Coding unit 330, for obtaining this up-sampling filter from this determining unit, and according to this target up-sampling filtering Device and Primary layer image block, determine information of forecasting；
For according to this information of forecasting, coded treatment being carried out to target image block, to generate target code stream, wherein, this mesh Logo image block is located in this enhancement layer image, and this Primary layer image block is located in this basic tomographic image, and this primary image block exists Locus in this enhancement layer image is corresponding with this target image block for locus in this basic tomographic image.
Alternatively, this acquiring unit 310 is additionally operable to the smooth region image block according to this enhancement layer image and this Primary layer The smooth region image block of image, determines the second training wave filter, so that this second training wave filter meets：According to this second instruction Practice the second information of forecasting that the smooth region image block of wave filter and this basic tomographic image determines with according to this enhancement layer image Similarity between the second raw information that smooth region image block determines meet second pre-conditioned, wherein, the Primary layer that is somebody's turn to do Image is corresponding with this enhancement layer image；And
This determining unit 320 is further used for, according to this first training wave filter and this second training wave filter, determining standby Choose sampling filter, wherein, this alternative up-sampling filter includes this first training wave filter and this second training wave filter.
Alternatively, this determining unit 320, specifically for the characteristic information according to this Primary layer image block, determines this target figure The smoothness of picture, wherein, this feature information includes the encoding block label information of this Primary layer image block or to this basic tomographic image The residual information of block；
For the smoothness according to this target image block, determine this target up-sampling filter.
Alternatively, this determining unit 320 be further used for according to this first training wave filter, this second training wave filter and Conventional filter, determines alternative up-sampling filter, wherein, this alternative up-sampling filter include this first training wave filter, This second training wave filter and this conventional filter；And
This coding unit 330 specifically for according to this information of forecasting, coded treatment being carried out to this target image block, with generate Target code stream, this target code stream includes the first configured information for indicating this target up-sampling filter, this first instruction letter Breath in order to decode above-mentioned coding after target image block when as obtain this target up-sampling filter foundation.
Alternatively, this alternative up-sampling filter also includes conventional filter, and
This determining unit 320 is specifically for determining the texture of this target image block；
For the texture according to this target image block, determine this target up-sampling filter.
The device for image procossing according to embodiments of the present invention, by according to smooth region and non-smooth areas, really Determine up-sampling filter, the quantity of up-sampling filter while improving the effect of up-sampling, can be reduced and need not pass Defeated filter coefficient and index, such that it is able to improve coding efficiency, carry out improving effect and the performance of image procossing.
Device 300 for image procossing according to embodiments of the present invention may correspond in the method for the embodiment of the present invention Coding side, and, this each unit of being used in the device 300 of image procossing is module and other operations above-mentioned and/or function is divided Not in order to realize the corresponding flow process of the method 100 in Fig. 1, for sake of simplicity, will not be described here.
Fig. 5 shows the schematic block diagram of the device 400 for image procossing according to embodiments of the present invention.As Fig. 5 institute Show, this device 500 includes：
Acquiring unit 510, smooths for the non-smooth areas image block according to enhancement layer image and the non-of basic tomographic image Area image block, determines the first training wave filter, so that this first training wave filter meets：According to this first training wave filter and The first information of forecasting that the non-smooth areas image block of this basic tomographic image determines and the non-smooth area according to this enhancement layer image Similarity between the first raw information that area image block determines meet first pre-conditioned, wherein, the basic tomographic image that is somebody's turn to do with This enhancement layer image is corresponding；
Determining unit 520, for according to this first training wave filter, determining alternative up-sampling filter, wherein, this is alternative Up-sampling filter includes this first training wave filter；
For, from alternative up-sampling filter, determining target up-sampling filter, this alternative up-sampling filter includes This first training wave filter, and transmit this target up-sampling filter to decoding unit 530, this alternative up-sampling filter includes This acquiring unit obtains 510 this first training wave filter；
Decoding unit 530, for obtaining this target up-sampling filter from this determining unit 520, and according in this target Sampling filter and Primary layer image block, determine information of forecasting；
For according to this information of forecasting and from target code stream obtain residual information, target image block is decoded locate Reason, wherein, this target image block is located in this enhancement layer image, and this Primary layer image block is located in this basic tomographic image, and should Locus in this basic tomographic image for the primary image block and locus in this enhancement layer image for this target image block Corresponding.
Alternatively, this acquiring unit 510 is additionally operable to the smooth region image block according to this enhancement layer image and this Primary layer The smooth region image block of image, determines the second training wave filter, so that this second training wave filter meets：According to this second instruction Practice the second information of forecasting that the smooth region image block of wave filter and this basic tomographic image determines with according to this enhancement layer image Similarity between the second raw information that smooth region image block determines meet second pre-conditioned, wherein, the Primary layer that is somebody's turn to do Image is corresponding with this enhancement layer image；And
This determining unit 520 is further used for, according to this first training wave filter and this second training wave filter, determining standby Choose sampling filter, wherein, this alternative up-sampling filter includes this first training wave filter and this second training wave filter.
Alternatively, this determining unit 520, specifically for the characteristic information according to this Primary layer image block, determines this target figure The smoothness of picture, wherein, this feature information includes the encoding block label information of this Primary layer image block or to this basic tomographic image The residual information of block；
According to the smoothness of this target image block, determine this target up-sampling filter.
Alternatively, this alternative up-sampling filter also includes conventional filter, and
This determining unit 520 is specifically for, from this target code stream, obtaining for indicating this target up-sampling filter First configured information,
For according to this first configured information, determining this target up-sampling filter.
Alternatively, this alternative up-sampling filter also includes conventional filter, and
This determining unit 520 is specifically for determining the texture of this target image block；
For the texture according to this target image block, determine this target up-sampling filter.
The device for image procossing according to embodiments of the present invention, by according to smooth region and non-smooth areas, really Determine up-sampling filter, the quantity of up-sampling filter while improving the effect of up-sampling, can be reduced and need not pass Defeated filter coefficient and index, such that it is able to improve coding efficiency, carry out improving effect and the performance of image procossing.
Device 400 for image procossing according to embodiments of the present invention may correspond in the method for the embodiment of the present invention Coding side, and, this each unit of being used in the device 400 of image procossing is module and other operations above-mentioned and/or function is divided Not in order to realize the corresponding flow process of the method 200 in Fig. 3, for sake of simplicity, will not be described here.
Fig. 6 shows the schematic block diagram of the encoder 500 for image procossing according to embodiments of the present invention.As Fig. 6 Shown, this decoder 500 includes：
Bus 510；
The processor 520 being connected with this bus；
The memory 530 being connected with this bus；
Wherein, this processor 520 passes through this bus 510, calls the program of storage in this memory 530, with according to enhancing The non-smooth areas image block of tomographic image and the non-smooth areas image block of basic tomographic image, determine the first training wave filter, with This first training wave filter is made to meet：True according to the non-smooth areas image block of this first training wave filter and this basic tomographic image Between the first fixed information of forecasting and the first raw information according to the non-smooth areas image block determination of this enhancement layer image Similarity satisfaction first is pre-conditioned, and wherein, the basic tomographic image being somebody's turn to do is corresponding with this enhancement layer image；
According to this first training wave filter, determine alternative up-sampling filter, wherein, this alternative up-sampling filter includes This first training wave filter；
From this alternative up-sampling filter, determine target up-sampling filter；
According to this target up-sampling filter and Primary layer image block, determine information of forecasting；
According to this information of forecasting, coded treatment is carried out to target image block, to generate target code stream, wherein, this target figure As block is located in this enhancement layer image, this Primary layer image block is located in this basic tomographic image, and this primary image block is in this base Locus in this enhancement layer image is corresponding with this target image block for locus in this tomographic image
Alternatively, this processing unit 520 is additionally operable to the smooth region image block according to this enhancement layer image and this Primary layer The smooth region image block of image, determines the second training wave filter, so that this second training wave filter meets：According to this second instruction Practice the second information of forecasting that the smooth region image block of wave filter and this basic tomographic image determines with according to this enhancement layer image Similarity between the second raw information that smooth region image block determines meet second pre-conditioned, wherein, the Primary layer that is somebody's turn to do Image is corresponding with this enhancement layer image；
For according to this first training wave filter and this second training wave filter, determining alternative up-sampling filter, wherein, This alternative up-sampling filter includes this first training wave filter and this second training wave filter.
Alternatively, this processing unit 520, specifically for the characteristic information according to this Primary layer image block, determines this target figure The smoothness of picture, wherein, this feature information includes the encoding block label information of this Primary layer image block or to this basic tomographic image The residual information of block；
According to the smoothness of this target image block, determine this target up-sampling filter.
Alternatively, this processing unit 520 is specifically for according to this first training wave filter, this second training wave filter and biography System wave filter, determines alternative up-sampling filter, and wherein, this alternative up-sampling filter includes this first training wave filter, is somebody's turn to do Second training wave filter and this conventional filter；
For according to this information of forecasting, coded treatment being carried out to this target image block, to generate target code stream, this object code Stream includes the first configured information for indicating this target up-sampling filter, and this first configured information is in order to decode above-mentioned volume Code after target image block when as obtain this target up-sampling filter foundation.
Alternatively, this processing unit 520 is specifically for according to this first training wave filter and conventional filter, determining alternative Up-sampling filter, wherein, this alternative up-sampling filter includes this first training wave filter and this conventional filter；
For determining the texture of this target image block；
For the texture according to this target image block, determine this target up-sampling filter.
For the encoder for image procossing according to embodiments of the present invention, by according to smooth region and non-smooth area Domain, determines up-sampling filter, while improving the effect of up-sampling, can reduce quantity and the nothing of up-sampling filter Need transmission filter coefficient and index such that it is able to improve coding efficiency, carry out improving effect and the performance of image procossing.
Encoder 500 for image procossing according to embodiments of the present invention may correspond in the method for the embodiment of the present invention Coding side, and, this each unit of being used in the encoder 500 of image procossing is module and other operations above-mentioned and/or work( Can be respectively in order to realize the corresponding flow process of the method 100 in Fig. 1, for sake of simplicity, will not be described here.
Fig. 7 shows the schematic block diagram of the decoder 600 for image procossing according to embodiments of the present invention.As Fig. 7 Shown, this decoder 600 includes：
Bus 610；
The processor 620 being connected with this bus；
The memory 630 being connected with this bus；
Wherein, this processor 620 passes through this bus 610, calls the program of storage in this memory 630, for basis The non-smooth areas image block of enhancement layer image and the non-smooth areas image block of basic tomographic image, determine the first training filtering Device, so that this first training wave filter meets：Non-smooth areas figure according to this first training wave filter and this basic tomographic image As block the first information of forecasting determining and the first raw information being determined according to the non-smooth areas image block of this enhancement layer image Between similarity meet first pre-conditioned, wherein, the basic tomographic image being somebody's turn to do is corresponding with this enhancement layer image；
According to this first training wave filter, determine alternative up-sampling filter, wherein, this alternative up-sampling filter includes This first training wave filter；
From alternative up-sampling filter, determine target up-sampling filter, this alternative up-sampling filter include this One training wave filter；
According to this target up-sampling filter and Primary layer image block, determine information of forecasting；
The residual information obtaining according to this information of forecasting and from target code stream, carries out decoding process to this object code stream, To obtain this target image block, wherein, this target image block is located in this enhancement layer image, and this Primary layer image block is located at this base In this tomographic image, and locus in this basic tomographic image for this primary image block and this target image block are in this enhancement layer figure Locus in picture is corresponding.
Alternatively, this processing unit 620 is additionally operable to the smooth region image block according to this enhancement layer image and this Primary layer The smooth region image block of image, determines the second training wave filter, so that this second training wave filter meets：According to this second instruction Practice the second information of forecasting that the smooth region image block of wave filter and this basic tomographic image determines with according to this enhancement layer image Similarity between the second raw information that smooth region image block determines meet second pre-conditioned, wherein, the Primary layer that is somebody's turn to do Image is corresponding with this enhancement layer image；And
For according to this first training wave filter and this second training wave filter, determining alternative up-sampling filter, wherein, This alternative up-sampling filter includes this first training wave filter and this second training wave filter.
Alternatively, this processing unit 620, specifically for the characteristic information according to this Primary layer image block, determines this target figure The smoothness of picture, wherein, this feature information includes the encoding block label information of this Primary layer image block or to this basic tomographic image The residual information of block；
According to the smoothness of this target image block, determine this target up-sampling filter.
Alternatively, this processing unit 620 is specifically for according to this first training wave filter, this second training wave filter and biography System wave filter, determines alternative up-sampling filter, and wherein, this alternative up-sampling filter includes this first training wave filter, is somebody's turn to do Second training wave filter and this conventional filter；
For from this target code stream, obtaining the first configured information for indicating this target up-sampling filter, according to This first configured information, determines this target up-sampling filter..
Alternatively, this processing unit 620 is specifically for according to this first training wave filter and conventional filter, determining alternative Up-sampling filter, wherein, this alternative up-sampling filter includes this first training wave filter and this conventional filter；
For determining the texture of this target image block；
According to the texture of this target image block, determine this target up-sampling filter.
The decoder of image procossing according to embodiments of the present invention, by according to smooth region and non-smooth areas, determining Up-sampling filter, while improving the effect of up-sampling, can reduce the quantity of up-sampling filter and need not transmit Filter coefficient and index, such that it is able to improve coding efficiency, carry out improving effect and the performance of image procossing.
Decoder 600 for image procossing according to embodiments of the present invention may correspond in the method for the embodiment of the present invention Decoding end, and, this each unit of being used in the decoder 600 of image procossing is module and other operations above-mentioned and/or work( Can be respectively in order to realize the corresponding flow process of the method 200 in Fig. 3, for sake of simplicity, will not be described here.
It should be noted that in order that coding side and decoding end（Encoder, decoder）The target up-sampling filtering using Device is consistent, it requires that coding side is consistent with the method for decoding end selection target up-sampling filter.In other words, can be according to institute The coding side processing method of description is corresponding to determine decoding end processing method, or according to described decoding end processing method pair The determination coding side processing method answered.
It should be understood that the terms "and/or", a kind of only incidence relation of description affiliated partner, expression can be deposited In three kinds of relations, for example, A and/or B, can represent：, there are A and B, these three situations of individualism B in individualism A simultaneously. In addition, character "/" herein, typically represent forward-backward correlation to as if a kind of relation of "or".
It should be understood that in various embodiments of the present invention, the size of the sequence number of above-mentioned each process is not meant to execute suitable The priority of sequence, the execution sequence of each process should be determined with its function and internal logic, and should not be to the enforcement of the embodiment of the present invention Process constitutes any restriction.
Those of ordinary skill in the art are it is to be appreciated that combine the list of each example of the embodiments described herein description Unit and algorithm steps, being capable of being implemented in combination in electronic hardware or computer software and electronic hardware.These functions are actually To be executed with hardware or software mode, the application-specific depending on technical scheme and design constraint.Professional and technical personnel Each specific application can be used different methods to realize described function, but this realization is it is not considered that exceed The scope of the present invention.
Those skilled in the art can be understood that, for convenience and simplicity of description, the system of foregoing description, Device and the specific work process of unit, may be referred to the corresponding process in preceding method embodiment, will not be described here.
It should be understood that disclosed system, apparatus and method in several embodiments provided herein, permissible Realize by another way.For example, device embodiment described above is only schematically, for example, described unit Divide, only a kind of division of logic function, actual can have other dividing mode when realizing, for example multiple units or assembly Can in conjunction with or be desirably integrated into another system, or some features can be ignored, or does not execute.Another, shown or The coupling each other discussing or direct-coupling or communication connection can be by some interfaces, the indirect coupling of device or unit Close or communicate to connect, can be electrical, mechanical or other forms.
The described unit illustrating as separating component can be or may not be physically separate, show as unit The part showing can be or may not be physical location, you can with positioned at a place, or can also be distributed to multiple On NE.The mesh to realize this embodiment scheme for some or all of unit therein can be selected according to the actual needs 's.
In addition, can be integrated in a processing unit in each functional unit in each embodiment of the present invention it is also possible to It is that unit is individually physically present it is also possible to two or more units are integrated in a unit.
If described function realized using in the form of SFU software functional unit and as independent production marketing or use when, permissible It is stored in a computer read/write memory medium.Based on such understanding, technical scheme is substantially in other words Partly being embodied in the form of software product of part that prior art is contributed or this technical scheme, this meter Calculation machine software product is stored in a storage medium, including some instructions with so that a computer equipment（Can be individual People's computer, server, or network equipment etc.）The all or part of step of execution each embodiment methods described of the present invention. And aforesaid storage medium includes：USB flash disk, portable hard drive, read-only storage（ROM, Read-Only Memory）, arbitrary access deposits Reservoir（RAM, Random Access Memory）, magnetic disc or CD etc. are various can be with the medium of store program codes.
The above, the only specific embodiment of the present invention, but protection scope of the present invention is not limited thereto, and any Those familiar with the art the invention discloses technical scope in, change or replacement can be readily occurred in, all should contain Cover within protection scope of the present invention.Therefore, protection scope of the present invention should be defined by described scope of the claims.

Claims (20)

1. a kind of method for image procossing is it is characterised in that methods described includes：
Non-smooth areas image block according to enhancement layer image and the non-smooth areas image block of basic tomographic image, determine the first instruction Practice wave filter, so that described first training wave filter meets：According to the described first training wave filter and described basic tomographic image The first information of forecasting that non-smooth areas image block determines is determined with the non-smooth areas image block according to described enhancement layer image The first raw information between similarity meet first pre-conditioned, wherein, described basic tomographic image and described enhancement layer Image is corresponding；
According to the described first training wave filter, determine alternative up-sampling filter, wherein, described alternative up-sampling filter includes Described first training wave filter；
From described alternative up-sampling filter, determine target up-sampling filter；
According to described target up-sampling filter and Primary layer image block, determine information of forecasting；
According to described information of forecasting, coded treatment is carried out to target image block, to generate target code stream, wherein, described target figure As block is located in described enhancement layer image, described Primary layer image block is located in described basic tomographic image, and described primary image Locus in described basic tomographic image for block locus phase in described enhancement layer image with described target image block Corresponding.
2. method according to claim 1 is it is characterised in that methods described also includes：
Smooth region image block according to described enhancement layer image and the smooth region image block of described basic tomographic image, determine Two training wave filters, so that described second training wave filter meets：According to the described second training wave filter and described Primary layer figure The second information of forecasting that the smooth region image block of picture determines is determined with the smooth region image block according to described enhancement layer image The second raw information between similarity meet second pre-conditioned, wherein, described basic tomographic image and described enhancement layer Image is corresponding；And
Described according to described first training wave filter, determine alternative up-sampling filter, further include：
According to the described first training wave filter and described second training wave filter, determine alternative up-sampling filter, wherein, described Alternative up-sampling filter includes described first training wave filter and described second training wave filter.
3. method according to claim 2 it is characterised in that described from described alternative up-sampling filter, determine mesh Put on sampling filter, including：
According to the characteristic information of described Primary layer image block, determine the smoothness of described target image, wherein, described characteristic information Encoding block label information including described Primary layer image block or the residual information to described Primary layer image block；
According to the smoothness of described target image block, determine described target up-sampling filter.
4. method according to claim 2 is it is characterised in that train according to the described first training wave filter and described second Wave filter, determines alternative up-sampling filter, further includes：
According to the described first training wave filter, described second training wave filter and conventional filter, determine alternative up-sampling filtering Device, wherein, described alternative up-sampling filter includes described first training wave filter, described second training wave filter and described biography System wave filter；And
Described coded treatment is carried out to described target image block according to described information of forecasting, to generate target code stream, including：
According to described information of forecasting, coded treatment is carried out to described target image block, to generate target code stream, described target code stream Including the first configured information for indicating described target up-sampling filter, described first configured information is in order to above-mentioned in decoding As the foundation obtaining described target up-sampling filter during target image block after coding.
5. method according to claim 1, it is characterised in that described train wave filter according to described first, determines alternative Up-sampling filter, further includes：
According to the described first training wave filter and conventional filter, determine alternative up-sampling filter, wherein, described alternative on adopt Sample wave filter includes described first training wave filter and described conventional filter；And
Described determination target up-sampling filter, including：
Determine the texture of described target image block；
According to the texture of described target image block, determine described target up-sampling filter.
6. a kind of method for image procossing is it is characterised in that methods described includes：
Non-smooth areas image block according to enhancement layer image and the non-smooth areas image block of basic tomographic image, determine the first instruction Practice wave filter, so that described first training wave filter meets：According to the described first training wave filter and described basic tomographic image The first information of forecasting that non-smooth areas image block determines is determined with the non-smooth areas image block according to described enhancement layer image The first raw information between similarity meet first pre-conditioned, wherein, described basic tomographic image and described enhancement layer Image is corresponding；
According to the described first training wave filter, determine alternative up-sampling filter, wherein, described alternative up-sampling filter includes Described first training wave filter；
From described alternative up-sampling filter, determine target up-sampling filter, described alternative up-sampling filter includes institute State the first training wave filter；
According to described target up-sampling filter and Primary layer image block, determine information of forecasting；
The residual information obtaining according to described information of forecasting and from target code stream, carries out decoding process to described object code stream, To obtain described target image block, wherein, described target image block is located in described enhancement layer image, described Primary layer image block In described basic tomographic image, and locus in described basic tomographic image for the described primary image block and described target figure As locus in described enhancement layer image for the block is corresponding.
7. method according to claim 6 is it is characterised in that methods described also includes：
Smooth region image block according to described enhancement layer image and the smooth region image block of described basic tomographic image, determine Two training wave filters, so that described second training wave filter meets：According to the described second training wave filter and described Primary layer figure The second information of forecasting that the smooth region image block of picture determines is determined with the smooth region image block according to described enhancement layer image The second raw information between similarity meet second pre-conditioned, wherein, described basic tomographic image and described enhancement layer figure As corresponding；And described according to described first training wave filter, determine alternative up-sampling filter, further include：
According to the described first training wave filter and described second training wave filter, determine alternative up-sampling filter, wherein, described Alternative up-sampling filter includes described first training wave filter and described second training wave filter.
8. method according to claim 7 it is characterised in that described from described alternative up-sampling filter, determine mesh Put on sampling filter, including：
According to the characteristic information of described Primary layer image block, determine the smoothness of described target image, wherein, described characteristic information Encoding block label information including described Primary layer image block or the residual information to described Primary layer image block；
According to the smoothness of described target image block, determine described target up-sampling filter.
9. method according to claim 8 is it is characterised in that train according to the described first training wave filter and described second Wave filter, determines alternative up-sampling filter, further includes：
According to the described first training wave filter, described second training wave filter and conventional filter, determine alternative up-sampling filtering Device, wherein, described alternative up-sampling filter includes described first training wave filter, described second training wave filter and described biography System wave filter；And
Described determine target up-sampling filter from described alternative up-sampling filter, including：
From described target code stream, obtain the first configured information for indicating described target up-sampling filter,
According to described first configured information, determine described target up-sampling filter.
10. method according to claim 6, it is characterised in that described train wave filter according to described first, determines alternative Up-sampling filter, further includes：
According to the described first training wave filter and conventional filter, determine alternative up-sampling filter, wherein, described alternative on adopt Sample wave filter includes described first training wave filter and described conventional filter；And
Described determination target up-sampling filter, including：
Determine the texture of described target image block；
According to the texture of described target image block, determine described target up-sampling filter.
A kind of 11. devices for image procossing are it is characterised in that described device includes：
Acquiring unit, for the non-smooth areas image of the non-smooth areas image block according to enhancement layer image and basic tomographic image Block, determines the first training wave filter, so that described first training wave filter meets：According to the described first training wave filter and described The first information of forecasting that the non-smooth areas image block of basic tomographic image determines and the non-smooth area according to described enhancement layer image Similarity between the first raw information that area image block determines meet first pre-conditioned, wherein, described basic tomographic image with Described enhancement layer image is corresponding；
Determining unit, according to the described first training wave filter, determines alternative up-sampling filter, wherein, described alternative up-sampling Wave filter includes described first training wave filter；
For, from described alternative up-sampling filter, determining target up-sampling filter；
Coding unit, for obtaining described up-sampling filter from described determining unit, and according to described target up-sampling filtering Device and Primary layer image block, determine information of forecasting；
For according to described information of forecasting, coded treatment being carried out to target image block, to generate target code stream, wherein, described mesh Logo image block is located in described enhancement layer image, and described Primary layer image block is located in described basic tomographic image, and described basic Locus in described basic tomographic image for the image block and space bit in described enhancement layer image for the described target image block Put corresponding.
12. devices according to claim 11 are it is characterised in that described acquiring unit is additionally operable to according to described enhancement layer figure The smooth region image block of picture and the smooth region image block of described basic tomographic image, determine the second training wave filter, so that institute State the second training wave filter to meet：True according to the smooth region image block of the described second training wave filter and described basic tomographic image Between the second fixed information of forecasting and the second raw information according to the smooth region image block determination of described enhancement layer image Similarity satisfaction second is pre-conditioned, and wherein, described basic tomographic image is corresponding with described enhancement layer image；And
Described determining unit is further used for, according to the described first training wave filter and described second training wave filter, determining alternative Up-sampling filter, wherein, described alternative up-sampling filter includes described first training wave filter and described second training filter Ripple device.
13. devices according to claim 12 are it is characterised in that described determining unit is specifically for according to described Primary layer The characteristic information of image block, determines the smoothness of described target image, and wherein, described characteristic information includes described basic tomographic image The encoding block label information of block or the residual information to described Primary layer image block；
For the smoothness according to described target image block, determine described target up-sampling filter.
14. devices according to claim 12 are it is characterised in that described determining unit is further used for according to described first Training wave filter, described second training wave filter and conventional filter, determine alternative up-sampling filter, wherein, described alternative Up-sampling filter includes described first training wave filter, described second training wave filter and described conventional filter；And
Described coding unit specifically for according to described information of forecasting, coded treatment being carried out to described target image block, with generate Target code stream, described target code stream includes the first configured information for indicating described target up-sampling filter, and described first Configured information in order to decode above-mentioned coding after target image block when as obtain described target up-sampling filter foundation.
15. devices according to claim 11 are it is characterised in that described determining unit is further used for according to described first Training wave filter and conventional filter, determine alternative up-sampling filter, and wherein, described alternative up-sampling filter includes described First training wave filter and described conventional filter；
Specifically for determining the texture of described target image block；
For the texture according to described target image block, determine described target up-sampling filter.
A kind of 16. devices for image procossing are it is characterised in that described device includes：
Acquiring unit, for the non-smooth areas image of the non-smooth areas image block according to enhancement layer image and basic tomographic image Block, determines the first training wave filter, so that described first training wave filter meets：According to the described first training wave filter and described The first information of forecasting that the non-smooth areas image block of basic tomographic image determines and the non-smooth area according to described enhancement layer image Similarity between the first raw information that area image block determines meet first pre-conditioned, wherein, described basic tomographic image Corresponding with described enhancement layer image；
Determining unit, for according to the described first training wave filter, determining alternative up-sampling filter, wherein, described alternative on Sampling filter includes described first training wave filter；
For from alternative up-sampling filter, determining target up-sampling filter, described alternative up-sampling filter includes institute State the first training wave filter；
Decoding unit, for obtaining described target up-sampling filter from described determining unit, and up-samples according to described target Wave filter and Primary layer image block, determine information of forecasting；
For according to described information of forecasting and from target code stream obtain residual information, described object code stream is decoded locate Reason, to obtain described target image block, wherein, described target image block is located in described enhancement layer image, described Primary layer figure As block is located in described basic tomographic image, and locus in described basic tomographic image for the described primary image block and described mesh Locus in described enhancement layer image for the logo image block is corresponding.
17. devices according to claim 16 are it is characterised in that described acquiring unit is additionally operable to according to described enhancement layer figure The smooth region image block of picture and the smooth region image block of described basic tomographic image, determine the second training wave filter, so that institute State the second training wave filter to meet：True according to the smooth region image block of the described second training wave filter and described basic tomographic image Between the second fixed information of forecasting and the second raw information according to the smooth region image block determination of described enhancement layer image Similarity satisfaction second is pre-conditioned, and wherein, described basic tomographic image is corresponding with described enhancement layer image；And
Described determining unit is further used for, according to the described first training wave filter and described second training wave filter, determining alternative Up-sampling filter, wherein, described alternative up-sampling filter includes described first training wave filter and described second training filter Ripple device.
18. devices according to claim 17 are it is characterised in that described determining unit is specifically for according to described Primary layer The characteristic information of image block, determines the smoothness of described target image, and wherein, described characteristic information includes described basic tomographic image The encoding block label information of block or the residual information to described Primary layer image block；
According to the smoothness of described target image block, determine described target up-sampling filter.
19. devices according to claim 17 are it is characterised in that described determining unit is further used for according to described first Training wave filter, described second training wave filter and conventional filter, determine alternative up-sampling filter, wherein, described alternative Up-sampling filter includes described first training wave filter, described second training wave filter and described conventional filter；
For from described target code stream, obtaining the first configured information for indicating described target up-sampling filter,
For according to described first configured information, determining described target up-sampling filter.
20. devices according to claim 16 are it is characterised in that described determining unit is further used for according to described first Training wave filter and conventional filter, determine alternative up-sampling filter, and wherein, described alternative up-sampling filter includes described First training wave filter and described conventional filter；
For determining the texture of described target image block；
For the texture according to described target image block, determine described target up-sampling filter.
CN201210374978.5A 2012-09-29 2012-09-29 Image processing method and device Active CN103716622B (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN201210374978.5A CN103716622B (en) 2012-09-29 2012-09-29 Image processing method and device
PCT/CN2013/084531 WO2014048374A1 (en) 2012-09-29 2013-09-27 Method and device for image processing

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201210374978.5A CN103716622B (en) 2012-09-29 2012-09-29 Image processing method and device

Publications (2)

Publication Number Publication Date
CN103716622A CN103716622A (en) 2014-04-09
CN103716622B true CN103716622B (en) 2017-02-08

Family

ID=50387016

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201210374978.5A Active CN103716622B (en) 2012-09-29 2012-09-29 Image processing method and device

Country Status (2)

Country Link
CN (1) CN103716622B (en)
WO (1) WO2014048374A1 (en)

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2016192054A1 (en) * 2015-06-03 2016-12-08 富士通株式会社 Image coding method and apparatus using prediction information and image processing device
CN109257605B (en) * 2017-07-13 2021-11-19 华为技术有限公司 Image processing method, device and system
CN107800450A (en) * 2017-11-13 2018-03-13 韩劝劝 Radio plays intensity control system

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101478671A (en) * 2008-01-02 2009-07-08 中兴通讯股份有限公司 Video encoding apparatus applied on video monitoring and video encoding method thereof
CN101895748A (en) * 2010-06-21 2010-11-24 华为终端有限公司 Coding and decoding methods and coding and decoding devices
CN102084653A (en) * 2007-06-29 2011-06-01 弗劳恩霍夫应用研究促进协会 Scalable video coding supporting pixel value refinement scalability
CN102355583A (en) * 2011-09-29 2012-02-15 广西大学 Scalable video encoding (SVC) block-level interlayer intra prediction (ILIP) method
CN102387366A (en) * 2005-03-18 2012-03-21 夏普株式会社 Methods and systems for extended spatial scalability with picture-level adaptation
CN102598660A (en) * 2009-04-20 2012-07-18 杜比实验室特许公司 Adaptive interpolation filters for multi-layered video delivery

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2007080477A2 (en) * 2006-01-10 2007-07-19 Nokia Corporation Switched filter up-sampling mechanism for scalable video coding
US7535383B2 (en) * 2006-07-10 2009-05-19 Sharp Laboratories Of America Inc. Methods and systems for signaling multi-layer bitstream data
WO2008049446A1 (en) * 2006-10-25 2008-05-02 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. Quality scalable coding

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102387366A (en) * 2005-03-18 2012-03-21 夏普株式会社 Methods and systems for extended spatial scalability with picture-level adaptation
CN102084653A (en) * 2007-06-29 2011-06-01 弗劳恩霍夫应用研究促进协会 Scalable video coding supporting pixel value refinement scalability
CN101478671A (en) * 2008-01-02 2009-07-08 中兴通讯股份有限公司 Video encoding apparatus applied on video monitoring and video encoding method thereof
CN102598660A (en) * 2009-04-20 2012-07-18 杜比实验室特许公司 Adaptive interpolation filters for multi-layered video delivery
CN101895748A (en) * 2010-06-21 2010-11-24 华为终端有限公司 Coding and decoding methods and coding and decoding devices
CN102355583A (en) * 2011-09-29 2012-02-15 广西大学 Scalable video encoding (SVC) block-level interlayer intra prediction (ILIP) method

Also Published As

Publication number Publication date
CN103716622A (en) 2014-04-09
WO2014048374A1 (en) 2014-04-03

Similar Documents

Publication Publication Date Title
CN103220527B (en) Method for encoding images and device and its coding/decoding method and device
CN101681499B (en) Modifying a coded bitstream
CN103152577B (en) Method and apparatus to Video coding and the method and apparatus to video decode
CN104735454B (en) Method and apparatus for encoding and decoding image by using large transform unit
CN104967852A (en) Method and apparatus for encoding and decoding image through intra prediction
CN104954791A (en) Method for selecting key frame from wireless distributed video coding for mine in real time
CN103081463A (en) Apparatus for encoding and decoding image by skip encoding and method for same
CN102939752A (en) Method and apparatus for encoding video by performing in-loop filtering based on tree-structured data unit, and method and apparatus for decoding video by performing the same
RU2013140840A (en) DEVICE AND METHOD FOR PROCESSING IMAGES
CN103583045A (en) Image processing device and image processing method
CN102484699B (en) The method of Code And Decode, the corresponding intrument for Code And Decode are carried out to image
CN104620580A (en) Estimation, encoding and decoding of motion information in multidimensional signals through motion zones, and auxiliary information through auxiliary zones
CN104010193B (en) Video steganographic method based on macro block partition mode disturbance
CN103238321A (en) Video encoding method for encoding hierarchical-structure symbols and a device therefor, and video decoding method for decoding hierarchical-structure symbols and a device therefor
CN104811722A (en) Video data coding and decoding method and device
CN107580217A (en) Coding method and its device
CN103716622B (en) Image processing method and device
CN105120290A (en) Fast coding method for depth video
CN102324037A (en) Shot boundary detection method based on support vector machine and genetic algorithm
CN103716630B (en) Upsampling filter generation method and device
CN103716629A (en) Image processing method, device, coder and decoder
CN103716631B (en) For the method for image procossing, device, encoder
CN107566834B (en) Intraprediction unit division methods, device and electronic equipment
JP4537348B2 (en) MPEG image quality correction apparatus and MPEG image quality correction method
CN103391439A (en) H.264/AVC code rate control method based on active macroblock concealment

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant