CN102779335B - Processing device and processing method for digital image - Google Patents

Processing device and processing method for digital image Download PDF

Info

Publication number
CN102779335B
CN102779335B CN201110124754.4A CN201110124754A CN102779335B CN 102779335 B CN102779335 B CN 102779335B CN 201110124754 A CN201110124754 A CN 201110124754A CN 102779335 B CN102779335 B CN 102779335B
Authority
CN
China
Prior art keywords
image
those
resolution
pixel
displacement
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201110124754.4A
Other languages
Chinese (zh)
Other versions
CN102779335A (en
Inventor
庄哲纶
吴宗达
周宏隆
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Altek Corp
Original Assignee
Altek Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Altek Corp filed Critical Altek Corp
Priority to CN201110124754.4A priority Critical patent/CN102779335B/en
Publication of CN102779335A publication Critical patent/CN102779335A/en
Application granted granted Critical
Publication of CN102779335B publication Critical patent/CN102779335B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Landscapes

  • Image Processing (AREA)

Abstract

The invention provides a processing device and a processing method for a digital image. The processing device for the digital image comprises a digital image capturing module, an image amplifying module, an image correcting module and an image mixing module, wherein the digital image capturing module is used for capturing a plurality of first resolution images; the first resolution images are amplified by the image amplifying module, thereby generating a plurality of second resolution images; the image correcting module is used for selecting a target image and generating a corrected image; and the image mixing module is used for respectively performing directional gradient calculation on each pixel point of the target image and the corrected image, and performing weighted sum on each pixel point of the target image and the corrected image according to a gradient difference generated by the directional gradient calculation to output a third resolution image.

Description

Digital image processing apparatus and disposal route thereof
Technical field
The present invention relates to a kind of Digital Image Processing, and in particular to the digital image processing apparatus of one application super-resolution (super-resolution) Nonlinear magnify technology and disposal route thereof.
Background technology
High-definition picture can be applied to many different field, comprises digital camera, satellite image, medical image, supervision take the photograph figure machine and crime survey etc.For example, have high-resolution medical image and can improve the accuracy rate of diagnosis and the success ratio of operation, and in monitoring camera, the resolution strengthening video camera, to improve tracking discrimination power, more can effectively provide the police more to handle a case clue.
Therefore, low-resolution image is amplified to produce high-definition picture be an important research topic in Digital Image Processing always, image interpolation (image interpolation) is then a kind of method about Nonlinear magnify technology.General pattern interpolation only amplifies from single image, therefore picture quality is very restricted, for example, common at present single image amplification method comprises polynomial interpolation (polynomial interpolation), along edge direction interpolation method (edge-directedinterpolation) and the super-resolution technique based on sample (exampled-based forsuper-resolution).
Although the simple and fast operation of polynomial interpolation, for want of image high-frequency information and to cause after amplifying image blurring, and block effect (block effect) can be produced.It is the problem that cannot effectively present at high-frequency information to solve polynomial interpolation along edge direction interpolation rule, high-frequency information refer to texture and the fringe region of image, the method focuses on the reservation of image border, but operand that need be huge just can complete.Super-resolution techniques based on sample needs to set up huge low-and high-frequency correspondence database, and how from huge low-and high-frequency correspondence database, to find out the data matched rapidly, is also problem to be solved.
Summary of the invention
In view of this, the invention provides a kind of digital image processing apparatus, multiple low-resolution images can be amplified and produce high-definition picture, and mix the rear image of multiple corrections to export super-resolution image.
The present invention separately provides a kind of digital image processing method, adopts image magnification method to produce high-definition picture, and can mix the rear image of multiple corrections to produce super-resolution image.
A kind of digital image processing apparatus that the present invention proposes, it comprises digital picture acquisition module, image amplification module, image correction module and image blend module.Wherein, digital picture acquisition module is in order to capture multiple first resolution image.Image amplification module is coupled to digital picture acquisition module, and the resolution for first resolution image is amplified, and produces multiple second resolution image.Image correction module is coupled to image amplification module, select second resolution image one of them as target image, remaining second resolution image is multiple non-selected images, image correction module performs multiple displacement respectively for non-selected image and corrects, and image after using the multiple correction of generation.Image blend module couples is to image correction module, with each pixel correcting rear image, multiple directions gradient algorithm is performed respectively to each pixel of target image, image blend module is also according to multiple gradient difference value that direction gradient computing produces, to each pixel of target image with correct after each pixel of image be weighted and, to export the 3rd image in different resolution.Wherein, the resolution of the 3rd image in different resolution is higher than the resolution of second resolution image.
In one embodiment of this invention, described image blend module performs direction gradient computing in order to produce multiple directions Grad, and direction gradient value comprises horizontal direction Grad, vertical gradient value and diagonal Grad.
In one embodiment of this invention, above-mentioned horizontal direction Grad is the grey jump absolute value sum of pixel and adjacent level direction pixel.Above-mentioned vertical gradient value is the grey jump absolute value sum of pixel and neighboring vertical direction pixel.Above-mentioned diagonal Grad comprises the grey jump absolute value sum of pixel and adjacent first diagonal pixel and the grey jump absolute value sum of pixel and adjacent second diagonal pixel.
In one embodiment of this invention, described image blend module for target image each pixel with correct after each pixel of image more select numerical value the maximum in corresponding direction gradient value as greatest gradient value, and select numerical value reckling in corresponding direction gradient value as minimal gradient value, each gradient difference value is that greatest gradient value and minimal gradient value subtract each other gained.
In one embodiment of this invention, described image correction module comprises displacement estimation unit and displacement correcting unit.Displacement estimation unit is coupled to image amplification module, in order to produce multiple global displacement.Displacement correcting unit is coupled to displacement estimation unit, performs displacement correct according to corresponding global displacement to non-selected image, corrects rear image to produce.
In one embodiment of this invention, above-mentioned displacement estimation unit comprises block displacement estimator and global displacement estimator.Block displacement estimator is multiple block in order to segmentation object image and non-selected image, the block displacement between estimation target image and non-selected image.Global displacement estimator is coupled to block displacement estimator, performs the estimation of multiple global displacement to obtain global displacement according to block displacement.
In one embodiment of this invention, described displacement corrects and utilizes affine transformation matrix (Affinetransformation matrix) to correct the initial point position of non-selected image to identical with the initial point position of target image.
From another viewpoint, the present invention proposes a kind of digital image processing method, for having the digital image processing apparatus of multiple first resolution image, this digital image processing method comprises the following steps: to adopt the resolution of image magnification method to first resolution image to amplify, and produces multiple second resolution image.In addition, select second resolution image one of them as target image, remaining second resolution image is multiple non-selected images, performs multiple displacement respectively correct for non-selected image, and uses and produce image after multiple correction.Moreover, with each pixel correcting rear image, multiple directions gradient algorithm is performed respectively to each pixel of target image, according to multiple gradient difference value that direction gradient computing produces, to each pixel of target image with correct after each pixel of image be weighted and, to produce the 3rd image in different resolution.Wherein, the resolution of the 3rd image in different resolution is higher than the resolution of second resolution image.
In another embodiment of the invention, the described step producing multiple gradient difference value according to those direction gradient computings comprises numerical value the maximum in choice direction Grad as greatest gradient value, and the numerical value reckling in choice direction Grad is as minimal gradient value, and greatest gradient value and minimal gradient value are subtracted each other obtain gradient difference value one of them.
In another embodiment of the invention, the multiple image rectification of described execution comprises the multiple global displacement of generation in the step of non-selected image, and non-selected image performs displacement correction according to corresponding global displacement, uses to produce correcting rear image.
In another embodiment of the invention, the step of the multiple global displacement of described generation comprises: segmentation object image and non-selected image are multiple block, and the multiple block displacement estimated between target image and non-selected image, perform global displacement estimation according to block displacement again and use generation global displacement.
Based on above-mentioned, individual or multiple low-resolution images can be amplified generation high-definition picture by the present invention, more image information can be obtained than general single image amplification method, and utilize multiple image blend to have high-quality and the rich super-resolution image enriching detailed information to produce one, owing to adding the consideration of sharpness when doing image blend, make super-resolution image keep image sharpness and block effect can be removed simultaneously.
For above-mentioned feature and advantage of the present invention can be become apparent, special embodiment below, and coordinate accompanying drawing to be described in detail below.
Accompanying drawing explanation
Fig. 1 is the block scheme according to the digital image processing apparatus shown in one embodiment of the invention.
Fig. 2 is an embodiment of the image correction module 300 according to the embodiment of the present invention.
Fig. 3 is an embodiment of the displacement estimation unit 310 according to the embodiment of the present invention.
Fig. 4 is the block scheme according to the digital image processing apparatus shown in another embodiment of the present invention.
Fig. 5 is the schematic diagram according to the R × R shielding shown in one embodiment of the invention, and Fig. 5 (a) is the schematic diagram of 3 × 3 shieldings, and Fig. 5 (b) is the schematic diagram of 5 × 5 shieldings.
Fig. 6 is the process flow diagram according to the digital image processing method shown in one embodiment of the invention.
Reference numeral:
10: digital image processing apparatus;
100: digital picture acquisition module;
200: image amplification module;
300: image correction module;
310: displacement estimation unit;
312: block displacement estimator;
314: global displacement estimator;
320: displacement correcting unit;
400: image blend module;
Img1_LR ~ Img4_LR: low-resolution image;
Img1_HR ~ Img4_HR: high-definition picture;
CorrImg2_HR ~ CorrImg4_HR: image after correcting;
Img1_SR: super-resolution image.
Embodiment
First please refer to Fig. 1, Fig. 1 is the block scheme according to the digital image processing apparatus shown in one embodiment of the invention.Digital image processing apparatus 10 comprises digital picture acquisition module 100, image amplification module 200, image correction module 300 and image blend module 400.Wherein, digital picture acquisition module 100 is in order to capture multiple first resolution image, digital picture acquisition module 100 is such as digital camera, digital camera (Digital Video, etc. DV) there is the product of digital picture acquisition function, wherein, the present embodiment can use the digital image capture apparatus of CMOS inductor, because the feature of CMOS inductor is energy high speed continuous shooting, therefore can take multiple first resolution image continuously to a scene.
Image amplification module 200 is coupled to digital picture acquisition module 100.Image amplification module 200 amplifies for the resolution of first resolution image, and produces multiple second resolution image.The image magnification method that image amplification module 200 adopts comprises and utilizes polynomial interpolation method, reaches along edge direction interpolating method or the super resolution method based on sample etc.Wherein, above-mentioned image magnification method should be well known to those of ordinary skill in the art, and therefore, the image magnification method that the visual actual demand of those of ordinary skill in the art selects image amplification module 200 to adopt, is not limited at this.
Image correction module 300 is coupled to image amplification module 200.Image correction module 300 selects second resolution image wherein one as target image, and the remaining second resolution image not being chosen as target image is then non-selected image.Image correction module 300 also performs displacement correction respectively for non-selected image, and image after using generation correction.Image blend module 400 is coupled to image correction module 300, in order to perform direction gradient computing respectively for each pixel of image after each pixel of target image and above-mentioned correction.In addition, image blend module 400 is also according to the gradient difference value that direction gradient computing produces, and be weighted and (weighting sum), to export the 3rd image in different resolution with each pixel correcting rear image for each pixel of target image.Wherein, the resolution of the 3rd image in different resolution is higher than the resolution of second resolution image.
Below referring to Fig. 1 and Fig. 2, wherein, Fig. 2 is an embodiment of the image correction module 300 according to the embodiment of the present invention.Image correction module 300 can comprise displacement estimation unit 310 and displacement correcting unit 320.Displacement estimation unit 310 is coupled to image amplification module 200, in order to produce global displacement.Displacement correcting unit 320 is coupled to displacement estimation unit 310, performs displacement correct according to corresponding global displacement to non-selected image, corrects rear image to produce.
In addition, Fig. 3 is an embodiment of the displacement estimation unit 310 according to the embodiment of the present invention, referring to Fig. 2 and Fig. 3.Displacement estimation unit 310 can comprise block displacement estimator 312 and global displacement estimator 314.Block displacement estimator 312 is multiple block in order to segmentation object image and non-selected image, and estimates the block displacement between target image and non-selected image.Global displacement estimator 314 is coupled to block displacement estimator 312, performs global displacement estimation to obtain global displacement according to block displacement.
In order to make content of the present invention more clear, below especially exemplified by the example that another embodiment can be implemented really according to this as the present invention.Fig. 4 is the block scheme according to the digital image processing apparatus shown in another embodiment of the present invention, please refer to Fig. 4.
First, digital picture acquisition module 100 is in order to capture 4 first resolution (the present embodiment is exemplified as low resolution) images Img1_LR, Img2_LR, Img3_LR and Img4_LR, explain for 4 low-resolution images in this embodiment, but the present invention does not limit the number of acquire images.It should be noted that hand-held digital image capture apparatus 100 continuously multiple images of shooting, have hand phenomenon of shaking and produce, and hand shakes can cause between image and has secondary pixel (sub-pixel) movement.
Image amplification module 200 adopts the resolution of image magnification method to first resolution image to amplify, and produce multiple second resolution image, there are 4 second resolution (being exemplified as high resolving power) images Img1_HR, Img2_HR, Img3_HR and Img4_HR in the present embodiment.Then, image correction module 300 select second resolution image one of them as target image, remaining second resolution image is non-selected image, for non-selected image perform respectively displacement correct, and use produce correct after image.The selection of target image can be decided in its sole discretion by user, and at this, by 4 high-definition pictures, one of them is set as target image Img1_HR, and remaining high-definition picture is then set as non-selected image Img2_HR, Img3_HR and Img4_HR.
After selected target image Img1_HR, block displacement estimator 312 can estimate non-selected image Img2_HR, Img3_HR and Img4_HR displacement relative to target image Img1_HR.In detail, target image Img1_HR and non-selected image Img2_HR, Img3_HR and Img4_HR can be divided into multiple block by block displacement estimator 312 in the same way.For example, if target image and non-selected image size are P × Q, then target image can be become M × N number of block with non-selected Iamge Segmentation, wherein M, N, P, Q be greater than 1 integer, and M is less than or equal to P, and N is less than or equal to Q.Therefore, dividing method can set according to actual demand and do not limited.
Then, block displacement estimator 312 does block displacement estimation, each block of non-selected image Img2_HR, Img3_HR and Img4_HR is compared with target image Img1_HR respectively, such as with block alignments etc., each non-selected image Img2_HR, Img3_HR and Img4_HR multiple block displacement relative to target image Img1_HR therefore can be obtained.So global displacement estimator 314 just can utilize above-mentioned block displacement to carry out global displacement estimation.For example, the method of global displacement estimation can get mode to multiple block displacement, namely first block displacement is added up, select to occur that block displacement secondary is at most as global displacement, or all block displacement done average and obtain global displacement etc.Therefore, each non-selected image Img2_HR, Img3_HR and Img4_HR have respective global displacement.
Displacement correcting unit 320 performs shift calibrating according to above-mentioned global displacement, and shift calibrating system utilizes affine transformation matrix to correct the initial point position of non-selected image Img2_HR, Img3_HR and Img4_HR to the starting point same position with target image Imgl_HR.Affine transformation matrix can rotate and shift calibrating, and wherein the coefficient of matrix is by global displacement gained.Affine transformation matrix formula is as follows:
x ′ y ′ 1 = cos θ - sin θ d x sin θ cos θ d y 0 0 1 x y 1
Wherein, θ is the anglec of rotation of non-selected image and target image, d xfor the horizontal direction displacement of non-selected image and target image, d yfor the vertical direction displacement of non-selected image and target image, x and y is the coordinate figure on the level of preimage element and Z-axis, and x ' and y ' is then the coordinate figure in the level of pixel after correcting and Z-axis.
Rear image CorrImg2_HR, CorrImg3_HR and CorrImg4_HR is corrected based on above-mentioned obtaining.Next, target image Img1_HR carries out mixing (blend), to produce the 3rd resolution (the present embodiment is exemplified as super-resolution) image Img1_SR with each pixel corrected in rear image CorrImg2_HR, CorrImg3_HR and CorrImg4_HR by image blend module 400.
Target image Img1_HR all performs lower column operations with each pixel corrected in rear image CorrImg2_HR, CorrImg3_HR and CorrImg4_HR: shield with R × R and perform direction gradient computing respectively, R be greater than 1 integer, such as can be 3 × 3 or 5 × 5 shieldings, as shown in Figure 5, Fig. 5 is the schematic diagram according to the R × R shielding shown in one of the present invention embodiment, Fig. 5 (a) is the schematic diagram of 3 × 3 shieldings, the schematic diagram that Fig. 5 (b) 5 × 5 shields.Direction gradient computing is in order to produce multiple directions Grad, and it comprises horizontal direction Grad H_Gra, vertical gradient value V_Gra, and two diagonal Grad D-_Gra, D+_Gra, and direction gradient operational formula is as follows, please coordinate with reference to Fig. 5:
H_Gra=|SR[1][0]-SR[1][1]|+|SR[1][2]-SR[1][1]|
V_Gra=|SR[0][1]-SR[1][1]|+|SR[2][1]-SR[1][1]|
D-_Gra=|SR[0][0]-SR[1][1]|+|SR[2][2]-SR[1][1]|
D+_Gra=|SR[0][2]-SR[1][1]|+|SR[2][0]-SR[1][1]|
Wherein, numerical value SR [1] [0]-SR [2] [2] are as shown in Figure 5 the grey decision-making representing the image pixel shielded.
After obtaining above-mentioned direction gradient value, the numerical value the maximum then in choice direction Grad is as greatest gradient value, and the numerical value reckling in choice direction Grad is as minimal gradient value, by this greatest gradient value therewith minimal gradient value subtract each other and obtain gradient difference value.The physical significance of gradient difference value represents the existence whether having texture or image border around this pixel, when gradient difference value is larger, represents more may there is texture variations or image border around it, accordingly, we using gradient difference value as weighting.By target image Img1_HR and the pixel correcting same position in rear image CorrImg2_HR, CorrImg3_HR and CorrImg4_HR, do weighted sum according to this gradient difference value, therefore can obtain mixed image.The computing formula of weighted sum FV is wherein as follows:
FV = Σ n = 0 ( Weight [ n ] × img [ n ] ) Σ n = 0 Weight [ n ]
Wherein, n represents n-th image, and Weight [n] represents the gradient difference value of n-th one of them pixel of image, and img [n] represents the grey decision-making of n-th one of them pixel of image.
Image blend module 400 by target image Img1_HR with correct after each pixel in image CorrImg2_HR, CorrImg3_HR and CorrImg4_HR do above-mentioned direction gradient computing and after mixing, i.e. exportable super-resolution image Img1_SR.In image flat site, the gradient difference value that target image Img1_HR calculates with correction rear image CorrImg2_HR, CorrImg3_HR and CorrImg4_HR is all very little, and therefore mixing has average effect, also can reach the effect reducing noise.
Arrange above-mentioned and deduce can obtain a digital image processing method, as shown in Figure 6, it is applicable to the digital image processing apparatus with multiple first resolution image.Fig. 6 is the process flow diagram according to the digital image processing method shown in one of the present invention embodiment, please refer to Fig. 6.Step S610 adopts the resolution of image magnification method to first resolution image to amplify, and produces multiple second resolution image.Step S620 select second resolution image one of them as target image, remaining second resolution image is non-selected image, performs displacement respectively correct for non-selected image, and use produce correct after image.Step S630 performs direction gradient computing respectively to each pixel of target image and each pixel correcting rear image, according to the gradient difference value that direction gradient computing produces, conjunction is weighted, to produce the 3rd image in different resolution with each pixel correcting rear image to each pixel of target image.Other thin portion flow process as the present embodiment is included in the various embodiments described above, therefore does not repeat them here.
In sum, individual or multiple low-resolution images can be amplified generation high-definition picture by the present invention, more image information can be obtained than general single image amplification method, and utilize multiple image blend to have high-quality and the rich super-resolution image enriching detailed information to produce one.Owing to adding the method for direction gradient computing when doing image blend, therefore the sharpness often opening image can be judged, the higher image of sharpness do mix time shared weighting heavier, mixed super-resolution image so can be made to keep image sharpness, and effect that block effect reaches reduction noise can be removed simultaneously.
Although the present invention with embodiment disclose as above, so itself and be not used to limit the present invention, those of ordinary skill in any art, when doing a little change and retouching, and does not depart from the spirit and scope of the present invention.

Claims (12)

1. a digital image processing apparatus, comprising:
One digital picture acquisition module, in order to capture multiple first resolution image;
One image amplification module, be coupled to this digital picture acquisition module, the resolution for those first resolution images is amplified, and produces multiple second resolution image;
One image correction module, be coupled to this image amplification module, select those second resolution images one of them as a target image, those second resolution images remaining are multiple non-selected images, this image correction module performs multiple displacement respectively for those non-selected images and corrects, and image after using the multiple correction of generation; And
One image blend module, be coupled to this image correction module, after correcting each pixel of this target image and those, each pixel of image performs multiple directions gradient algorithm respectively, multiple gradient difference value that this image blend module produces according to those direction gradient computings, after each pixel of this target image and those are corrected each pixel of image be weighted and, to export one the 3rd image in different resolution;
Wherein, the resolution of the 3rd image in different resolution higher than the resolution of those second resolution images,
Wherein this image blend module performs those direction gradient computings in order to produce multiple directions Grad,
Wherein this image blend module correct for each pixel of this target image and those after each pixel of image, select numerical value the maximum in those direction gradient values as a greatest gradient value, and select numerical value reckling in those direction gradient values as a minimal gradient value, respectively this gradient difference value then subtracts each other gained for this greatest gradient value and this minimal gradient value, and using described gradient difference value as weighting.
2. digital image processing apparatus according to claim 1, wherein those direction gradient values comprise a horizontal direction Grad, a vertical gradient value and two diagonal Grad.
3. digital image processing apparatus according to claim 2, wherein this horizontal direction Grad is the grey jump absolute value sum of the adjacent horizontal direction pixel of each pixel and two-phase, this vertical gradient value is the grey jump absolute value sum of each pixel and two adjacent vertical directions vegetarian refreshments, and those diagonal Grad comprise the grey jump absolute value sum of each pixel and two adjacent first diagonal pixels and the grey jump absolute value sum of each pixel and two adjacent second diagonal pixels.
4. digital image processing apparatus according to claim 1, wherein this image correction module comprises:
One displacement estimation unit, is coupled to this image amplification module, in order to produce multiple global displacement; And
One displacement correcting unit, is coupled to this displacement estimation unit, performs those displacements correct according to those corresponding global displacement to those non-selected images, corrects rear image to produce those.
5. digital image processing apparatus according to claim 4, wherein this displacement estimation unit comprises:
One block displacement estimator, splits this target image and those non-selected images are multiple block, estimates the multiple block displacement between this target image and those non-selected images; And
One global displacement estimator, is coupled to this block displacement estimator, performs the estimation of multiple global displacement to obtain those global displacement according to those block displacement.
6. digital image processing apparatus according to claim 1, wherein those displacements correct and utilize affine transformation matrix to correct the initial point position of those non-selected images to identical with the initial point position of this target image.
7. a digital image processing method, for having a digital image processing apparatus of multiple first resolution image, this digital image processing method comprises:
Adopt the resolution of an image magnification method to those first resolution images to amplify, and produce multiple second resolution image;
Select those second resolution images one of them as a target image, those second resolution images remaining are multiple non-selected images, perform multiple displacement respectively correct for those non-selected images, and use and produce image after multiple correction; And
After correcting each pixel of this target image and those, each pixel of image performs multiple directions gradient algorithm respectively, according to multiple gradient difference value that those direction gradient computings produce, after each pixel of this target image and those are corrected each pixel of image be weighted and, to produce one the 3rd image in different resolution;
Wherein, the resolution of the 3rd image in different resolution higher than the resolution of those second resolution images,
Wherein those direction gradient computings are in order to produce multiple directions Grad,
The step wherein producing those gradient difference value according to those direction gradient computings comprises:
Select numerical value the maximum in those direction gradient values as a greatest gradient value;
Select numerical value reckling in those direction gradient values as a minimal gradient value;
This greatest gradient value and this minimal gradient value are subtracted each other and obtains respectively this gradient difference value; And
Using described gradient difference value as weighting.
8. digital image processing method according to claim 7, wherein those direction gradient values comprise a horizontal direction Grad, a vertical gradient value and two diagonal Grad.
9. digital image processing method according to claim 8, wherein this horizontal direction Grad is the grey jump absolute value sum of the adjacent horizontal direction pixel of each pixel and two-phase, this vertical gradient value is the grey jump absolute value sum of each pixel and two adjacent vertical directions vegetarian refreshments, and those diagonal Grad comprise the grey jump absolute value sum of each pixel and two adjacent first diagonal pixels and the grey jump absolute value sum of each pixel and two adjacent second diagonal pixels.
10. digital image processing method according to claim 7, wherein performs the step that those displacements correct in those non-selected images and comprises:
Produce multiple global displacement; And
Those non-selected images perform those displacements according to those corresponding global displacement and correct, and correct rear image to produce those.
11. digital image processing methods according to claim 10, the step wherein producing those global displacement comprises:
Split this target image and those non-selected images are multiple block;
Estimate the multiple block displacement between this target image and those non-selected images;
Perform the estimation of multiple global displacement according to those block displacement, and use those global displacement of generation.
12. digital image processing methods according to claim 7, wherein this displacement corrects and utilizes affine transformation matrix to correct the initial point position of those non-selected images to identical with the initial point position of this target image.
CN201110124754.4A 2011-05-13 2011-05-13 Processing device and processing method for digital image Active CN102779335B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201110124754.4A CN102779335B (en) 2011-05-13 2011-05-13 Processing device and processing method for digital image

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201110124754.4A CN102779335B (en) 2011-05-13 2011-05-13 Processing device and processing method for digital image

Publications (2)

Publication Number Publication Date
CN102779335A CN102779335A (en) 2012-11-14
CN102779335B true CN102779335B (en) 2015-07-08

Family

ID=47124245

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201110124754.4A Active CN102779335B (en) 2011-05-13 2011-05-13 Processing device and processing method for digital image

Country Status (1)

Country Link
CN (1) CN102779335B (en)

Families Citing this family (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103093418B (en) * 2013-02-21 2015-08-26 深圳市晶日盛科技有限公司 A kind of digital image scaling method of improvement
KR20140110428A (en) * 2013-03-07 2014-09-17 삼성전자주식회사 Method for generating scaled images simultaneously using an original image and devices performing the method
CN104853059B (en) * 2014-02-17 2018-12-18 台达电子工业股份有限公司 Super-resolution image processing method and its device
TWI554105B (en) * 2015-11-17 2016-10-11 緯創資通股份有限公司 Electronic device and image processing method thereof
CN110243757B (en) * 2019-06-14 2021-07-20 同济大学 High-precision testing method for composite section adhesive force
CN112399069B (en) * 2019-08-16 2022-06-07 RealMe重庆移动通信有限公司 Image encoding method and apparatus, storage medium, and electronic device

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101441765A (en) * 2008-11-19 2009-05-27 西安电子科技大学 Self-adapting regular super resolution image reconstruction method for maintaining edge clear
CN101674478A (en) * 2009-10-19 2010-03-17 浙江大学 Video super-resolution method based on compressed domain
CN101794440A (en) * 2010-03-12 2010-08-04 东南大学 Weighted adaptive super-resolution reconstructing method for image sequence

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101441765A (en) * 2008-11-19 2009-05-27 西安电子科技大学 Self-adapting regular super resolution image reconstruction method for maintaining edge clear
CN101674478A (en) * 2009-10-19 2010-03-17 浙江大学 Video super-resolution method based on compressed domain
CN101794440A (en) * 2010-03-12 2010-08-04 东南大学 Weighted adaptive super-resolution reconstructing method for image sequence

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
一种视频序列的超分辨率重建算法;韩玉兵等;《电子学报》;20050131;第33卷(第1期);第129页4.2节 *
电子稳像技术中核心算法的研究及实现;张欣宇;《哈尔滨工业大学硕士论文》;20051116;第6页第2段-最后1段 *

Also Published As

Publication number Publication date
CN102779335A (en) 2012-11-14

Similar Documents

Publication Publication Date Title
CN102779335B (en) Processing device and processing method for digital image
CN104935909B (en) Multi-image super-resolution method based on depth information
Zhao et al. Is super-resolution with optical flow feasible?
US9412151B2 (en) Image processing apparatus and image processing method
US8009933B2 (en) Fast method of super-resolution processing
TWI459325B (en) Digital image processing device and processing method thereof
CN106169173B (en) Image interpolation method
US8644645B2 (en) Image processing device and processing method thereof
RU2570506C2 (en) Method of preparing images in visually indistinguishable spectral regions and corresponding camera and measuring equipment
CN103632359A (en) Super-resolution processing method for videos
CN105069748A (en) Method for obtaining high-resolution image based on micro-satellite object scanning technique
CN102326183A (en) Image processing system, image processing method, and image processing program
CN103379255B (en) Image processor and its processing method
CN102800047B (en) Method for reconstructing super resolution of single-frame image
Cho et al. Temporal incoherence-free video retargeting using foreground aware extrapolation
WO1993019430A1 (en) A machine method for compensating for non-linear picture transformations, e.g. zoom and pan, in a video image motion compensation system
JP2012003503A (en) Image processing device, method for controlling the same, and program
CN102779329B (en) Image processing apparatus and image processing method
US9243935B2 (en) Distance information estimating apparatus
CN102769717B (en) Image processing method and device
CN115578260A (en) Attention method and system for direction decoupling for image super-resolution
EP2595393B1 (en) Rectified stereoscopic 3d panoramic picture
CN104103034A (en) Super-resolution image processing method and image processing device thereof
US8264601B2 (en) Video picture format conversion method and corresponding device
JP5435242B2 (en) Image processing method, image processing apparatus, and image processing program

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant