CN103914815A - Image fusion method and device - Google Patents

Abstract

The invention provides a method for image fusion and a corresponding device. The method comprises the following steps: to begin with, obtaining a plurality of images; and then, fusing the plurality of images based on a total variation-L1 norm energy function, wherein the total variation-L1 norm energy function comprises two components: one component is a total variation component which expresses detail information of high-definition images is retained, while the other component is an L1 norm component which expresses spectral information of low-resolution multispectral images is retained. According to the image fusion method and device, the detail information and spectral information of the images after fusion can be balanced.

Description

Image interfusion method and equipment

Technical field

The present invention relates to image processing techniques, more specifically, the present invention relates to image interfusion method and equipment.

Background technology

Image co-registration (Image Fusion) refers to by several source images about same target are carried out to image processing, retains to greatest extent the favourable information in source images separately, by comprehensive several source images become the process of high-quality single image.

The application of image co-registration comprises remote sense, medical imaging, quality and defects detection and bio-identification etc.Especially in mobile communication, exist and strong multiple image is merged to obtain about the better description of the scene of sensing and the demand of explanation.

Image co-registration should be followed some fusion rule, to build a composograph.Therefore, how fusion rule/algorithm being set, is a problem.Conventional algorithm can be categorized as 3 classes: 1) projection and alternative method, and for example brightness-tone-saturation degree (IHS) color integration and principal component analysis (PCA) (PCA) are merged; 2) band ratio and arithmetic combined method, for example, multiply each other with compositional variable than (SVR); 3) fusion method based on small echo.

in document " Multiresolution based image fusion with additive wavelet decomposition; IEEE Tran.Geosci.Rem.Sensing; 32 (3), 1204-1211 (1999) ", having proposed use additivity small echo (AW) algorithm Deng people merges a high-definition picture (SPOT) and a low resolution multispectral image (Landsat Thematic Mapper (TM) image) mutually.In this scheme, the Atrous small echo that is substituted SPOT image by the wave band of TM image is approximate.The people such as Li have proposed the MAXIMUM SELECTION rule (AMS) based on region based on wavelet transformation in document " Multisensor image fusion using the wavelet transform; Graphical Models and Image Processing; 57,235-245 (1995) ".The people such as Scheunders are at document " A Multivalued ImageWavelet Representation Based on Multiscale Fundamental Forms, IEEE Transactions on Image Processing, 10 (5), 568-575 (2002) " and document " Fusion and merging of multispectral images using multiscale fundamental forms, Journal of the Optical Society of America A, Optics, Image Science, and Vision.18 (10), 2468-2477 (2001) " in provided the novel algorithm based on multiple dimensioned first fundamental form (MFF) method, it carrys out fused images by multivalue image Wavelet representation for transient method.The people such as Chen have proposed the multiple dimensioned first fundamental form of improved weighting (WMFF) method and have avoided MFF method to amplify the problem of wavelet coefficient in document " Image fusion using weighted multiscale fundamental form; Proceedings of the2004International Conference on Image Processing; 5,3319-3322 (2004) ".

But these fusion methods based on small echo recited above have some common restrictions: a restriction is to select predefined small echo basis, and another restriction is how correctly to select wavelet decomposition level.And AW and AMS retain more spectral information and ignore some spaces or detailed information, and MFF and WMFF pay close attention to space or detailed information more, and distortion spectral information.

In order to address the above problem, the people such as Chen have proposed new image and have adapted to decomposition algorithm in document " Fusion of color microscopic images based on bidimensional empirical mode decomposition.OPTICS EXPRESS; 18,21757-21769 (2010) ".But these picture breakdown arithmetic result are also unstable.

Summary of the invention

According to a first aspect of the invention, propose a kind of method, having comprised: obtained multiple images; Based on total variation-L ₁norm energy function, merges described multiple image, wherein, and described total variation-L ₁norm energy function comprises two components, and one-component is total variation component, and it represents to retain the detailed information for the treatment of fused images, and another component is L ₁norm component, it represents to retain the spectral information for the treatment of fused images.

According to a second aspect of the invention, propose a kind of equipment, having comprised: acquiring unit, for obtaining multiple images; Integrated unit, for based on total variation-L ₁norm energy function, merges described multiple image, wherein, and described total variation-L ₁norm energy function comprises two components, and one-component is total variation component, and it represents to retain the detailed information for the treatment of fused images, and another component is L ₁norm component, it represents to retain the spectral information for the treatment of fused images.

According to a third aspect of the invention we, propose a kind of equipment, having comprised: for obtaining the device of multiple images; Be used for based on total variation-L ₁norm energy function, merges the device of described multiple images, wherein, and described total variation-L ₁norm energy function comprises two components, and one-component is total variation component, and it represents to retain the detailed information for the treatment of fused images, and another component is L ₁norm component, it represents to retain the spectral information for the treatment of fused images.

According to a forth aspect of the invention, propose a kind of equipment, having comprised: at least one processor and at least one storer that comprises computer program code; Described processor and described storer are configured to utilize described processor, described equipment are at least carried out: obtain multiple images; Based on total variation-L ₁norm energy function, merges described multiple image, wherein, and described total variation-L ₁norm energy function comprises two components, and one-component is total variation component, and it represents to retain the detailed information for the treatment of fused images, and another component is L ₁norm component, it represents to retain the spectral information for the treatment of fused images.

According to the present invention, can balance merge detailed information and the spectral information of gained image afterwards.

Brief description of the drawings

By below in conjunction with the description of the drawings, and along with understanding more comprehensively of the present invention, other objects of the present invention and effect will become to be known and easy to understand more, wherein:

Fig. 1 shows according to the process flow diagram/block diagram of the image interfusion method/equipment 100 of an embodiment of the invention;

Fig. 2 shows according to the process flow diagram of the numerical evaluation scheme of an embodiment of the invention.

Fig. 3 shows the fused images obtaining by the solution of the present invention with according to existing AW, AMS, MFF method;

Fig. 4 has schematically shown the block diagram of image co-registration equipment according to an embodiment of the invention.

In all above-mentioned accompanying drawings, identical label represents to have identical, similar or corresponding feature or function.

Embodiment

Preferred implementation of the present disclosure is described below with reference to accompanying drawings in more detail.Although shown preferred implementation of the present disclosure in accompanying drawing, but should be appreciated that, can realize the disclosure and the embodiment that should do not set forth limits here with various forms.On the contrary, it is in order to make the disclosure more thorough and complete that these embodiments are provided, and can be by the those skilled in the art that conveys to complete the scope of the present disclosure.

The present invention proposes a kind of new image co-registration scheme.Basic thought of the present invention is based on total variation-L ₁norm energy function, merges multiple images, detailed information and the spectral information of the image being obtained after merging with balance.Wherein, described total variation-L ₁norm energy function comprises two components, and one-component is total variation component, and it represents to retain the detailed information for the treatment of fused images, and another component is L ₁norm component, it represents to retain the spectral information for the treatment of fused images.

Fig. 1 shows according to the process flow diagram/block diagram of the image interfusion method/equipment 100 of an embodiment of the invention.

As shown in Figure 1, the method/equipment 100 comprises obtaining step/acquiring unit 110, for obtaining multiple images; And fusion steps/integrated unit 120, for based on total variation-L ₁norm energy function, merges described multiple image, wherein, and described total variation-L ₁norm energy function comprises two components, and one-component is total variation component, and it represents to retain the detailed information for the treatment of fused images, and another component is L ₁norm component, it represents to retain the spectral information for the treatment of fused images.

According to an embodiment of the invention, before fusion steps/integrated unit 120, also comprise step of registration/registration unit 115, for described multiple images are carried out to registration operation.

Same from different perspectives, diverse location take two width images, due to shooting condition difference, every width image only reflects the feature of some aspect.Will be by this two width image co-registration together, piece image wherein will be done to mobile and rotation, to make it and another width image alignment.This alignment procedure is exactly registration process.Keep motionless being called to make reference image, do the floating image that is called converting.Image after registration is merged to the fused images that just can obtain reflecting overall picture.

In the following description of embodiment of the present invention, the number of image to be merged is two, and one of them is the more rich high-definition picture of detailed information, and another is the more rich low resolution multispectral image of spectral information.

Certainly, it should be appreciated by those skilled in the art, the present invention is also applicable to the situation that the number of image to be merged is greater than two.

According to an embodiment of the invention, for the brightness part IM of high-definition picture G, multispectral image M, and the image R obtaining after merging, energy function adopts following form:

${\left|\right|\▿(R-G)\left|\right|}_{\mathrm{TV}}+\mathrm{\λ}{\left|\right|R-\mathrm{IM}\left|\right|}_1---\left(1\right)$

Wherein, represent total variation component, || R-IM|| ₁represent L ₁norm component, R is the image of gained after merging, λ is weight parameter, for example, be a positive constant, for gradient operator.

It will be appreciated that, G, IM, R are image (form with matrix in computation process occur).

Total variation component retains detailed information, and L ₁norm component retains spectral information.According to this energy function, by selecting suitable λ value, between detailed information and multispectral information, carry out balance.Wherein, can obtain suitable λ value by experience.

According to an embodiment of the invention, by being minimized, above-mentioned energy function (1) tries to achieve the image R that merges rear gained.

Can be expressed as:

${\min }_R\left(E\left(R\right)\right)={\min }_R\{{\left|\right|\▿(R-G)\left|\right|}_{\mathrm{TV}}+\mathrm{\λ}{\left|\right|R-\mathrm{IM}\left|\right|}_1\}---\left(2\right)$

In the present invention, total variation is as undefined isotropy total variation:

${\left|\right|\▿u\left|\right|}_{\mathrm{TV}}=\underset{i,j}{\mathrm{\Σ}}\sqrt{{\left(u_x(i,j)\right)}^2+{\left(u_y(i,j)\right)}^2}---\left(3\right)$

Wherein u is the image of L*Q, the line number of L presentation video pixel, and the columns of Q presentation video pixel, that is to say that u is a matrix.

U _x, u _yrepresent the partial derivative of u, (i, j) representative image pixel position.

Functional form shown in formula 1 can be reduced to:

${\min }_K\left(E\left(K\right)\right){=\min }_K\{{\left|\right|\▿\left(K\right)\left|\right|}_{\mathrm{TV}}+\mathrm{\λ}{\left|\right|K-(\mathrm{IM}-G)\left|\right|}_1\}---\left(6\right)$

Wherein K=R-G.Because K and R are linear relationships, therefore the energy function of K minimize minimizing corresponding to the energy function of R.

The function of equation (6) is rough, therefore solves K and has any problem, and need to carry out smoothing processing to it.

That is to say, according to an embodiment of the invention, image interfusion method/image co-registration equipment 100 also comprises level and smooth step/smooth unit 130, for equation (6) is carried out to smoothing processing, in the hope of K.

Propose some papers and solved this non-smoothing problasm.For example Brox, T. in people's such as grade document " High accuracy optical flow estimation based on a theoryfor warping; European Conference on Computer Vision, 2004 ", proposed to be similar to this unsmooth function with smooth function.And Zach, C. wait people's document " A duality based approachfor realtime TV-L1optical flow; The Annual Symposium of the German Associationfor Pattern Recognition, 2007. " to propose to use the Dual Method based on separating coupling process.

According to an embodiment of the invention, adopt solution coupling process and original Dual Method to calculate above-mentioned equation (6).

Here introducing a new variable N and a new parameter ρ, is write as formula 6 again:

${\min }_{K,N}\left(E(K,N)\right)={\min }_{K,N}\{{\left|\right|\▿\left(K\right)\left|\right|}_{\mathrm{TV}}+\mathrm{\λ}{\left|\right|N-(\mathrm{IM}-G)\left|\right|}_1+\mathrm{\ρ}{\left|\right|K-N\left|\right|}_2^2\}---\left(7\right)$

Wherein ρ is a large constant, thereby makes N can be in close proximity to k.Wherein represent 2 norms square.

The saddle point form of equation 7 can be as follows:

${\min }_K{\max }_p\{<p,\&dtri;K>+\mathrm{\&lambda;}{\left|\right|N-(\mathrm{IM}-G)\left|\right|}_1+\mathrm{\&rho;}{\left|\right|K-N\left|\right|}_2^2-{\mathrm{\&delta;}}_P\left(p\right)\}---\left(8\right)$

Wherein <, > is Hilbert inner product, p is dual variable, p ∈ P, p is by providing as follows P={||p|| in set _∞≤ 1}, it is Infinite Norm || || _∞the unit ball in space, wherein || p|| _∞be defined as:

${\left|\right|p\left|\right|}_{\&infin;}={\max }_{i,j}\sqrt{{\left(p_{i,j}^1\right)}^2+{\left(p_{i,j}^2\right)}^2}---\left(9\right)$

Wherein i, j representative image location of pixels, it is respectively the component of vectorial p.

Function δ _p(p) be the indicator function of set P, it is defined as follows

In order more clearly to express this algorithm, to represent like that numerical evaluation scheme, the antithesis step 210 that formula 8 is expressed as, original steps 220 and threshold step 230 shown in Fig. 2:

Antithesis step

If fixing K=K ⁱ, wherein i is iterations, solves so following formula

${\max }_p\{<p,{\&dtri;K}^i>-{\mathrm{\&delta;}}_p\left(p\right)\}---\left(11\right)$

Because: be that p is differentiated, therefore p be updated to:

$p^{i+1}={\mathrm{prox}}_{{\mathrm{\&tau;}}_i\&CenterDot;{\mathrm{\&delta;}}_p}(K^i+{\mathrm{\&tau;}}_i\&dtri;K^i)---\left(12\right)$

Wherein proximal operator, τ _iantithesis step-length, in this embodiment, ${\mathrm{prox}}_{{\mathrm{\&tau;}}_i\&CenterDot;{\mathrm{\&delta;}}_p}\left(x\right)=\frac{x}{\max \{{\left|\right|x\left|\right|}_{\&infin;},1\}}$

Original steps:

If fixing p=p ⁱ⁺¹, N=N ⁱ, solve so

${\min }_k\left(E\left(K\right)\right)={\min }_k\{<p,\&dtri;K>+\mathrm{\&rho;}{\left|\right|K-N\left|\right|}_2^2\}---\left(13\right)$

Then equation 13 is converted to

${\min }_k\left(E\left(K\right)\right)={\min }_k\{-<K,\mathrm{div}p>+\mathrm{\&rho;}{\left|\right|K-N\left|\right|}_2^2\}---\left(14\right)$

Wherein div is divergence operator, therefore K is updated to:

$K^{i+1}=K^i-{\mathrm{\&sigma;}}_i(\frac{-\mathrm{div}\left(p^{i+1}\right)}{\mathrm{\&rho;}}+K^i-N^i)---\left(15\right)$

Wherein σ _ifor original step-length.

Threshold step:

If fixing K=K ⁱ⁺¹, solve so following formula

${\min }_N\{\mathrm{\&lambda;}{\left|\right|N-(\mathrm{IM}-G)\left|\right|}_1+\mathrm{\&rho;}{\left|\right|K-N\left|\right|}_2^2\},---\left(16\right)$

Then N is updated to

After completing threshold step, judge whether the condition of convergence meets, if meet the condition of convergence, exits so iterative computation, if also do not meet the condition of convergence, turns back to so antithesis step.The order that it should be understood that antithesis step, original steps, threshold step can change, not necessarily order as shown in Figure 2.

τ _iand σ _ican be chosen as: τ _i=0.2+0.08i, the condition of convergence can be chosen as: wherein ε is little constant.

If obtain K, R solves by R=K+G so.

If the tone part HM of known image, saturation degree part SM, and as the R of intensity part, just can obtain the image after fusion.

Use the series of experiments of IKONOS (Yi Kenuosi) image is verified to the present invention.In order to assess quantitatively fusion results, use following 3 standards that propose.First, CM (correlated measure) (referring to in people document " Multiresolution based image fusion with additive wavelet decomposition; IEEE Transactions on Geoscience and Remote Sensing.; 1999; 32; (3); pp.1204-1211 ") calculate multispectral image and merge after the related coefficient of red, green, blue channel between the image of gained, its can be used for evaluating and merge after the reserving degree of spectral information of image of gained.The colour that the image of rear gained is merged in the larger expression of CM value distorts fewer.Secondly, (mutual information measure) (referring to document " Information measurefor performance of image fusion; Electronics Letters; 2002; 38; (7), pp.313-315 " of the people such as Qu) can reflect the total amount that the image of the rear gained of fusion comprises multispectral image and high-resolution image information.Mutual information measure is larger, and after instruction fusion, the image of gained comprises the more information of original image.The 3rd, parameter Q ^aB/F(referring to the people's such as Xydeas document " Objective Image Fusion Performance Measure; Electronics Letters; 2000; 36; (4), pp.308-309 ") instruction is from the amount to the marginal information of the image transfer that obtains after merging until fused images.Q ^aB/Fbe worth larger, instruction merge after the image of gained retain the more multiple edge information of fused images treated.

Inventor on IKONOS (Yi Kenuosi) satellite image, carry out proposition of the present invention method and deng people at document " Multiresolution based image fusion with additive wavelet decomposition, IEEE Transactions on Geoscience and Remote Sensing., 1999, 32, (3), pp.1204-1211 " the middle AW method proposing, the people such as Li are at document " Multisensor image fusion using the wavelet transform, Graphical Models and Image Processing, 1995, 57, pp.235-245 " in propose AMS method and Scheunders at document " A Multivalued Image Wavelet Representation Based on Multiscale Fundamental Forms, IEEE Transactions on Image Processing, 2002, 10, (5), pp.568-575 " the middle MFF method proposing, and come relatively to merge the rear image obtaining by distinct methods by above-mentioned 3 tolerance.

For the scheme proposing in the present invention, λ=1 and ρ=12.5.In addition, AW, the wavelet decomposition level of AMS and MFF scheme is 4.

Fig. 3 shows the fused images obtaining by the solution of the present invention and AW as above, AMS, MFF method.Wherein label 310 represents the fused images obtaining by the solution of the present invention and AW as above, AMS, MFF method, and label 320 represents multispectral image to be merged, and label 330 represents high-definition picture to be merged.Label 340 is indicated the comparison of spectral information in respective image, and label 350 is indicated the comparison of detailed information in respective image.

In form 1, provide the comparison of above-mentioned 3 tolerance of the fused images obtaining by the solution of the present invention and AW as above, AMS, MFF method.

Form 1

3 row above of form 1 have reflected that the solution of the present invention retains more spectral information than other three kinds of existing methods.The 4th row of form 1 have reflected that the solution of the present invention obtains more information than other three kinds of existing methods from original image.The 5th row of form 1 have reflected compares other three kinds of existing methods, and the image obtaining by the solution of the present invention has the marginal information of original image more accurately.

Fig. 4 has schematically shown the block diagram of image co-registration equipment according to an embodiment of the invention.As shown in Figure 4, the storer (MEM) 403 that image co-registration equipment 400 comprises data processor (DP) 401 and is coupled with data processor 401.Described storer 403 storage programs (PROG) 402.

Storer 403 can be any suitable type that is applicable to local technical environment, and can utilize any suitable data storage technology to realize, include but not limited to memory device, magnetic memory device and system, light storage device and the system of based semiconductor.Although only show a memory cell in Fig. 4, in image co-registration equipment 400, can there is the different memory cell of multiple physics.DP 401 can be any suitable type that is applicable to local technical environment, and can include but not limited to one or more multiple in multi-purpose computer, special purpose computer, microprocessor, digital signal processor (DSP) and the polycaryon processor framework based on processor.Image co-registration equipment 400 can comprise multiple processors.

As shown in Figure 4, data processor 401 and storer 403 are configured to utilize data processor 401, image co-registration equipment 400 are at least carried out: obtain multiple images; Based on total variation-L ₁norm energy function, merges described multiple image, wherein, and described total variation-L ₁norm energy function comprises two components, and one-component is total variation component, and it represents to retain the detailed information for the treatment of fused images, and another component is l ₁norm component, it represents to retain the spectral information for the treatment of fused images.

According to an embodiment of the invention, by making total variation-L ₁norm energy function minimizes, and merges described multiple image.

According to an embodiment of the invention, described energy function adopts following form:

${\left|\right|\&dtri;(R-G)\left|\right|}_{\mathrm{TV}}+\mathrm{\&lambda;}{\left|\right|R-\mathrm{IM}\left|\right|}_1$

Wherein, represent total variation component, || R-IM|| ₁represent L ₁norm component, R is the image of gained after merging, and G treats the abundantest image of detailed information in fused images, and IM is the brightness part for the treatment of the abundantest image of spectral information in fused images, and λ is a weight parameter, for gradient operator, by being minimized, above-mentioned energy function tries to achieve the image R that merges rear gained.

According to an embodiment of the invention, described data processor 401 and described storer 403 are also configured to utilize described data processor 401, described image co-registration equipment 400 is at least carried out: above-mentioned energy function is carried out to smoothing processing, in the hope of the image R of gained after described fusion.

According to an embodiment of the invention, adopt solution coupling process and original Dual Method to calculate above-mentioned energy function.

According to an embodiment of the invention, described data processor 401 and described storer 403 are also configured to utilize described data processor 401, described image co-registration equipment 400 is at least carried out: before merging described multiple images, described multiple images are carried out to registration operation.

According to an embodiment of the invention, the number of image to be merged is two, and one of them is the more rich high-definition picture of detailed information, and another is the more rich low resolution multispectral image of spectral information.

It should be noted that for the present invention is easier to understand, description has above been omitted to be known for a person skilled in the art and may to be essential some ins and outs more specifically for realization of the present invention.

Therefore; selecting and describing embodiment is in order to explain better principle of the present invention and practical application thereof; and those of ordinary skill in the art are understood, do not departing under the prerequisite of essence of the present invention, within all modifications and change all fall into protection scope of the present invention defined by the claims.

In addition, the step that those skilled in the art will appreciate that above-described the whole bag of tricks can realize by the computing machine of programming.Here, some embodiment is intended to overlay program memory device, and it is machine or computer-readable, and coding has machine can carry out or computer executable instructions program, and the some or all of steps of said method are carried out in wherein said instruction.This program storage device can be for example for example Disk and tape, hard disk drive or optical readable digital data storage medium of magnetic recording medium.Embodiment is also intended to cover the computing machine that is programmed for the described step of carrying out said method.

Claims (28)

1. a method, comprising:

Obtain multiple images;

Based on total variation-L ₁norm energy function, merges described multiple image,

Wherein, described total variation-L ₁norm energy function comprises two components, and one-component is total variation component, and it represents to retain the detailed information for the treatment of fused images, and another component is L ₁norm component, it represents to retain the spectral information for the treatment of fused images.

2. method according to claim 1,

Wherein by making total variation-L ₁norm energy function minimizes, and merges described multiple image.

3. method according to claim 2, wherein said energy function adopts following form:

${\left|\right|\&dtri;(R-G)\left|\right|}_{\mathrm{TV}}+\mathrm{\&lambda;}{\left|\right|R-\mathrm{IM}\left|\right|}_1$

Wherein, represent total variation component, || R-IM|| ₁represent L ₁norm component, R is the image of gained after merging, and G treats the abundantest image of detailed information in fused images, and IM is the brightness part for the treatment of the abundantest image of spectral information in fused images, and λ is weight parameter, for gradient operator, by above-mentioned energy function is minimized, try to achieve the image R of gained after merging.

4. method according to claim 3, also comprises above-mentioned energy function is carried out to smoothing processing, in the hope of the image R of gained after described fusion.

5. method according to claim 3, wherein adopts solution coupling process and original Dual Method to calculate above-mentioned energy function.

6. method according to claim 1, before being also included in the described multiple images of fusion, carries out registration operation to described multiple images.

7. according to the method described in any one in claim 1-6, wherein the number of image to be merged is two, and one of them is the high-definition picture that detailed information is abundant, and another is the abundant low resolution multispectral image of spectral information.

8. an equipment, comprising:

Acquiring unit, for obtaining multiple images;

Integrated unit, for based on total variation-L ₁norm energy function, merges described multiple image,

Wherein, described total variation-L ₁norm energy function comprises two components, and one-component is total variation component, and it represents to retain the detailed information for the treatment of fused images, and another component is L ₁norm component, it represents to retain the spectral information for the treatment of fused images.

9. equipment according to claim 8,

Wherein by making total variation-L ₁norm energy function minimizes, and merges described multiple image.

10. equipment according to claim 9, wherein said energy function adopts following form:

${\left|\right|\&dtri;(R-G)\left|\right|}_{\mathrm{TV}}+\mathrm{\&lambda;}{\left|\right|R-\mathrm{IM}\left|\right|}_1$

Wherein, represent total variation component, || R-IM|| ₁represent L ₁norm component, R is the image after merging, and G treats the abundantest image of detailed information in fused images, and IM is the brightness part for the treatment of the abundantest image of spectral information in fused images, and λ is weight parameter, for gradient operator, by making above-mentioned energy function minimize to try to achieve the image R after fusion.

11. equipment according to claim 10, also comprise:

Smooth unit, for above-mentioned energy function is carried out to smoothing processing, in the hope of the image R of gained after described fusion.

12. equipment according to claim 10, wherein adopt solution coupling process and original Dual Method to calculate above-mentioned energy function.

13. equipment according to claim 8, also comprise:

Registration unit, for before merging described multiple images, carries out registration operation to described multiple images.

Equipment in 14. according to Claim 8-13 described in any one, wherein the number of image to be merged is two, and one of them is the more rich high-definition picture of detailed information, and another is the more rich low resolution multispectral image of spectral information.

15. 1 kinds of equipment, comprising:

For obtaining the device of multiple images;

Be used for based on total variation-L ₁norm energy function, merges the device of described multiple images,

Wherein, described total variation-L ₁norm energy function comprises two components, and one-component is total variation component, and it represents to retain the detailed information for the treatment of fused images; Another component is L ₁norm component, it represents to retain the spectral information for the treatment of fused images.

16. equipment according to claim 15,

Wherein by making total variation-L ₁norm energy function minimizes, and merges described multiple image.

17. equipment according to claim 16, wherein said energy function adopts following form:

${\left|\right|\&dtri;(R-G)\left|\right|}_{\mathrm{TV}}+\mathrm{\&lambda;}{\left|\right|R-\mathrm{IM}\left|\right|}_1$

Wherein, represent total variation component, || R-IM|| ₁represent L ₁norm component, R is the image of gained after merging, and G treats the abundantest image of detailed information in fused images, and IM is the brightness part for the treatment of the abundantest image of spectral information in fused images, and λ is weight parameter, for gradient operator, by being minimized, above-mentioned energy function tries to achieve the image R that merges rear gained.

18. equipment according to claim 17, also comprise:

For above-mentioned energy function is carried out to smoothing processing, in the hope of the device of the image R of gained after described fusion.

19. equipment according to claim 17, wherein adopt solution coupling process and original Dual Method to calculate above-mentioned energy function.

20. equipment according to claim 15, also comprise:

For before merging described multiple images, described multiple images are carried out to the device of registration operation.

21. according to the equipment described in any one in claim 15-20, and wherein the number of image to be merged is two, and one of them is the more rich high-definition picture of detailed information, and another is the more rich low resolution multispectral image of spectral information.

22. 1 kinds of equipment, comprising:

At least one processor and at least one storer that comprises computer program code;

Described processor and described storer are configured to utilize described processor, and described equipment is at least carried out:

Obtain multiple images;

Based on total variation-L ₁norm energy function, merges described multiple image,

Wherein, described total variation-L ₁norm energy function comprises two components, and one-component is total variation component, and it represents to retain the detailed information for the treatment of fused images, and another component is L ₁norm component, it represents to retain the spectral information for the treatment of fused images.

23. equipment according to claim 22,

Wherein by making total variation-L ₁norm energy function minimizes, and merges described multiple image.

24. equipment according to claim 23, wherein said energy function adopts following form:

${\left|\right|\&dtri;(R-G)\left|\right|}_{\mathrm{TV}}+\mathrm{\&lambda;}{\left|\right|R-\mathrm{IM}\left|\right|}_1$

Wherein, represent total variation component, || R-IM|| ₁represent L ₁norm component, R is the image of gained after merging, and G treats the abundantest image of detailed information in fused images, and IM is the brightness part for the treatment of the abundantest image of spectral information in fused images, and λ is weight parameter, for gradient operator, by being minimized, above-mentioned energy function tries to achieve the image R that merges rear gained.

25. equipment according to claim 24, wherein said processor and described storer are also configured to utilize described processor, and described equipment is at least carried out:

Above-mentioned energy function is carried out to smoothing processing, in the hope of the image R of gained after described fusion.

26. equipment according to claim 24, wherein adopt solution coupling process and original Dual Method to calculate above-mentioned energy function.

27. equipment according to claim 22, wherein said processor and described storer are also configured to utilize described processor, and described equipment is at least carried out:

Before merging described multiple images, described multiple images are carried out to registration operation.

28. according to the equipment described in any one in claim 22-27, and wherein the number of image to be merged is two, and one of them is the more rich high-definition picture of detailed information, and another is the more rich low resolution multispectral image of spectral information.