CN103390272B - Realize the registration fusion method of multispectral pseudo color image - Google Patents

Abstract

The invention discloses a kind of registration fusion method realizing multispectral pseudo color image, belong to spectrum picture processing technology field.The method is realized by the image registration fusion software bag be arranged in multispectral imaging device.After multispectral imaging device powers on, first registration is carried out to the spectrum picture of identical wave band in four imaging bands and obtain registration centre coordinate, then four width different wave length spectrogram pictures in corresponding imaging band are carried out centered by registration centre coordinate translation process and obtain registering images, finally the fusion of RGB pseudo-colours carried out to the image after registration and send into ground control station.The invention solves the problem of multispectral image because of the large registration difficulty of gray difference, improve registration success ratio, achieve the rapid registering of multispectral image, there is real-time high, do not need manual intervention, be easy to the advantage of engineer applied.

Description

Realize the registration fusion method of multispectral pseudo color image

Technical field

The invention belongs to spectrum picture processing technology field, relate generally to a kind of registration method for amalgamation processing of spectrum picture, particularly relate to a kind of registration fusion method of multispectral pseudo color image.

Background technology

Spectrum picture be by optical light splitting technology obtain centered by a certain wavelength points, bandwidth is ± the narrow-band spectrum gray level image of below 10nm.At 0.4 ~ 1.0um visible ray within the scope of near-infrared band, the spectrum picture of multiple wavelength points can be obtained.Spectral distribution due to different target energy is not identical, utilizes this characteristic, can distinguish different target in spectrum picture.Thus in various fields extensive application such as biomedicine, the detection of agricultural geologic remote sensing, military target scoutings.

It is by the gray-scale map of different spectrum that multispectral image pseudo-colours merges, and be fused into the pseudocolour picture of width RGB tri-look, pseudocolour picture contains abundanter image information, and human eye more easily can identify camouflaged target.

The basis of Multispectral Image Fusion is the registration of multispectral image, the registration difficult point of multispectral image is, larger gray difference is there is in target between different spectrum gray level image, even there will be the situation of anti-contrast, method for registering based on gray scale can the failure because of the existence of anti-contrast, and the method for registering of feature based usually needs artificial participation, poor real, success ratio is low, is unfavorable for actual use.

SPIEVol.6946 has delivered the paper of a section " Spectraldetectionandmonitoringofmarinemammals ", the MANTIS-3 multispectral camera discussed in article, it is by a filter, four camera lenses and four cmos detector compositions, the spectrum picture of 4 width different wave length points can be gathered simultaneously, after this article carries out autoregistration for several spectrum pictures that the process of spectrum picture is Same Scene different sensors obtained under same field angle, three width image co-registration are wherein selected to become RGB pseudocolour picture again, but the method for registering of spectrum picture is not described in article, method for registering is not quite clear.

Chinese patent ZL2008100645595.5 discloses a kind of multi-spectrum image registration method based on small component and noise contribution, first the method carries out transformation of scale to multispectral image, regional choice, pre-service is selected at reference mark, then utilize traditional method based on gray scale and feature based using certain spectral coverage image as with reference to image to other images preliminary registration one by one, the analytical approach of small component and noise contribution is adopted to carry out repeated multiple times accuracy registration again, its accuracy of registration is obviously better than traditional method based on gray scale and feature, but its computation process is complicated, operand is large, poor real, be difficult to realize in engineering, the request for utilization of actual tactics can not be met.

Summary of the invention

The technical problem to be solved in the present invention is, for the deficiency that prior art exists, provide a kind of in real time, the registration fusion method of multispectral pseudo color image accurately and rapidly.

For solving the problems of the technologies described above, multispectral pseudo color image registration fusion method provided by the invention is realized by the multispectral imaging device with four imaging bands and computing machine, each imaging band comprises imaging lens 1-1, filtering assembly 1-2 and ccd detector 1-3, each filtering assembly 1-2 is made up of and w >=2 w the optical filter be embedded on runner, all with the optical filter that a wave band is identical in four imaging bands, all the other are the different optical filter of wavelength; Computing machine 2 is built-in with multispectral pseudo color image registration fusion software bag; After multispectral imaging device powers on, described multispectral pseudo color image registration fusion software bag performs following operation steps:

The first step: wait-receiving mode identical band image registration order, performs second step when receiving identical band image registration order;

Second step: send λ 0A to filtering assembly, λ 0B, λ 0C, λ 0D enter respective imaging band instruction;

Wherein: λ 0A, λ 0B, λ 0C and λ 0D are respectively the optical filter in first to fourth imaging band and the wave band of these four optical filters is identical;

3rd step: the two field picture that synchronous acquisition first to fourth imaging band CCD exports and image P _{λ 0A}(e, f), image P _{λ 0B}(e, f), image P _{λ 0C}(e, f) and image P _{λ 0D}(e, f) buffer memory, wherein, e=1,2,3 ..., E, f=1,2,3 ..., F;

4th step: make the first imaging band image P _{λ 0A}the centre coordinate of (e, f) for the registration centre coordinate of this image, with value respectively according to round, and with image P _{λ 0A}(e, f) is benchmark, adopts gray scale correlation registration method respectively to image P _{λ 0B}(e, f), image P _{λ 0C}(e, f) and image P _{λ 0D}(e, f) carries out registration, obtains the registration centre coordinate of the second to the 4th imaging band image and buffer memory;

5th step: wait-receiving mode different wave length image registration order, performs the 6th step when receiving different wave length image registration order;

6th step: send λ Ai to filtering assembly, λ Bj, λ Cm, λ Dn (i=1,2,3 ..., w-1; J=1,2,3 ..., w-1; M=1,2,3 ..., w-1; N=1,2,3 ..., w-1) and enter respective imaging band instruction;

Wherein: λ Ai, λ Bj, λ Cm and λ Dn are respectively the optical filter in first to fourth imaging band and the wavelength of these four optical filters is different;

7th step: the two field picture that synchronous acquisition first to fourth imaging band CCD exports and image P _{λ Ai}, image P _{λ Bj}, image P _{λ Cm}with image P _{λ Dn}and buffer memory;

8th step: judge image P respectively _{λ Ai}, image P _{λ Bj}, image P _{λ Cm}with image P _{λ Dn}the pixel corresponding to registration centre coordinate whether equal to the distance on the upper and lower limit of respective image individual pixel, if equaled then keep original image constant, if be greater than then cast out the row had more, if be less than then line number polishing is arrived compose gray-scale value 255 to each pixel of supplementing in row; Judge whether the pixel corresponding to registration centre coordinate equals to the distance on the left and right limit of respective image individual pixel, if equaled then keep original image constant, if be greater than then cast out the row had more, if be less than then columns polishing is arrived compose gray-scale value 255 to each pixel of supplementing in row, so obtain the registering images N that four width sizes are E × F _{λ Ai}, registering images N _{λ Bj}, registering images N _{λ Cm}with registering images N _{λ Dn}and buffer memory;

9th step: select the array mode of three to registering images N according to four _{λ Ai}, registering images N _{λ Bj}, registering images N _{λ Cm}with registering images N _{λ Dn}carry out the fusion of RGB pseudo-colours, obtain four width fused images N _rGB1, N _rGB2, N _rGB3and N _rGB4and be transferred to ground control station;

Tenth step: judged whether END instruction, returns the 5th step when not having END instruction, terminate multispectral pseudo color image registration merge program when there being END instruction.

Beneficial effect of the present invention is embodied in the following aspects:

(1) first optical filter is switched to identical wave band by the present invention, registration is carried out to four identical band spectrum images in four imaging bands, even the first imaging band picture centre coordinate is this image registration centre coordinate, respectively registration is carried out to the second to the 4th imaging band image, obtain each self registration centre coordinate of three width images; Then optical filter is switched to different wave length, for picture centre coordinate, translation process is carried out to four width different wave length spectrogram pictures in four imaging bands with registration centre coordinate, obtain four width registering images; Finally pseudo-colours fusion is carried out to any three width in four width registering images, finally obtain four multispectral pseudo-colours registration fusion figure and send into ground control station.Owing to adopting identical band spectrum image to carry out registration, avoid different wave length spectrogram picture and there is anti-contrast metric, solve the problem of multispectral image because of the large registration difficulty of gray difference, improve the success ratio of autoregistration.

(2) in the present invention, because each imaging band is when optical filter switches, what only change is the spectral information of image, and do not change the position relationship of each pixel in image, therefore be constant with the registration centre coordinate that identical band spectrum image obtains, so just the registration parameter of identical band spectrum Image Acquisition can be directly used in and registration is carried out to different wave length spectrogram picture.

(3) present invention employs gray scale correlation registration method and carry out registration, there is the advantage that computation process is simple, registration speed soon, does not need manual intervention, real-time is good, be easy to Project Realization.

(4) the present invention carries out pseudo-colours fusion to any three width images after four imaging band registrations, the pseudo-colours fusion figure of four width different-effects can be obtained at every turn, target recognition and tracking commander is carried out, for actual tactical reconnaissance application provides strong reconnaissance method for ground control personnel.

Accompanying drawing explanation

Fig. 1 is the composition schematic diagram of multispectral imaging device.

Fig. 2 is four imaging bands and optical filter numbering schematic layout pattern in Fig. 1.

Fig. 3 is the workflow diagram of multi-spectral image registration fusion method of the present invention.

Fig. 4 is benchmark window and search window relation schematic diagram in the present invention.

Embodiment

Below in conjunction with accompanying drawing and preferred embodiment, the present invention is described in further detail.

The excellent embodiment of selecting of multispectral pseudo color image registration fusion method provided by the invention is for the multispectral imaging device shown in Fig. 1.This multispectral imaging device is made up of multispectral video camera 1 and computing machine 2.Multispectral video camera 1 comprises four imaging bands, and the mode that these four imaging bands arrange with two row two arranges, and each imaging band comprises imaging lens 1-1, filtering assembly 1-2 and ccd detector 1-3.Each filtering assembly 1-2 is made up of and w >=2 w the optical filter be embedded on runner, and controlled by computing machine, each optical filter can enter imaging band in succession.All with the optical filter that a wave band is identical in four imaging bands, remaining is the different optical filter of wavelength.Come from the light of target after imaging lens 1-1 assembles, then focus on the target surface of ccd detector 1-3 after being filtered by filtering assembly 1-2, ccd detector 1-3 is sent in computing machine 2 after converting light signal to electric signal.Computing machine 2 is built-in with multispectral pseudo color image registration fusion software bag.Computing machine has picture synchronization collection, storage and wireless transmission function, and the registration that multispectral pseudo color image registration fusion software bag realizes image merges.

According to Fig. 2, in the preferred embodiment of the present invention, the optical filter of each filtering assembly is four, i.e. w=4.The thickness of 16 optical filters of four imaging bands is all identical.First imaging band is numbered A, optical filter numbering is respectively λ 0A, λ A1, λ A2, λ A3, second imaging band is numbered B, optical filter numbering is respectively λ 0B, λ B1, λ B2, λ B3,3rd imaging band is numbered C, optical filter numbering is respectively λ 0C, λ C1, λ C2, λ C3, and the 4th imaging band is numbered D, and optical filter numbering is respectively λ 0D, λ D1, λ D2, λ D3.Wherein, λ 0A, λ 0B, λ 0C, λ 0D are identical wave band optical filter, its centre wavelength span is 0.6 to 0.7um, λ A1, λ A2, λ A3, λ B1, λ B2, λ B3, λ C1, λ C2, λ C3, λ D1, λ D2, λ D3 are different wave length optical filter, centre wavelength all values in the scope of 0.4 to 1.0um of these 12 optical filters.

After multispectral imaging device powers on, the multispectral pseudo color image registration fusion software bag in computing machine performs following steps by according to the workflow shown in Fig. 3:

The first step: wait-receiving mode identical band image registration order.If receive the order of identical band image registration, perform second step.

Second step: send λ 0A to filtering assembly, λ 0B, λ 0C, λ 0D enter respective imaging band instruction.

3rd step: the two field picture that each imaging band CCD of synchronous acquisition exports and image P _{λ 0A}(e, f), image P _{λ 0B}(e, f), image P _{λ 0C}(e, f) and image P _{λ 0D}(e, f) buffer memory, wherein e and f is variable, e=1,2,3 ..., E, f=1,2,3 ..., F.

4th step: with the first imaging band image P _{λ 0A}(e, f) is benchmark, respectively by other each imaging band image P _{λ 0B}(e, f), image P _{λ 0C}(e, f) and image P _{λ 0D}(e, f) carries out registration, obtains registration centre coordinate ${\[\frac{E}{2}-(\frac{R}{2}-r),\frac{F}{2}-(\frac{S}{2}-s)\]}_{\mathrm{\λ}0\mathrm{AB}},{\[\frac{E}{2}-(\frac{R}{2}-r),\frac{F}{2}-(\frac{S}{2}-s)\]}_{\mathrm{\λ}0\mathrm{AC}}$ With ${\[\frac{E}{2}-(\frac{R}{2}-r),\frac{F}{2}-(\frac{S}{2}-s)\]}_{\mathrm{\λ}0\mathrm{AD}}$ And buffer memory.

The method of above-mentioned registration is as follows: with image P _{λ 0A}(e, f) and image P _{λ 0B}(e, f) illustrates method for registering for example.Image P _{λ 0A}( _e, f) be reference map, image P _{λ 0B}(e, f) is figure subject to registration, and the centre coordinate of two width images is with value is respectively according to round.At image P _{λ 0A}in (e, f) with centered by coordinate selection size be the benchmark window (see Fig. 4) of g × h pixel, wherein g and h is variable, g=1,3,5 ..., G, h=1,3,5 ..., H.At image P _{λ 0B}in (e, f) with centered by coordinate, select size to be the search window (see Fig. 4) of r × s pixel, wherein r and s is variable, r=1,3,5 ..., R, s=1,3,5 ..., the value of S, r × s is greater than the value of g × h, and two values are at least 2 times of relations.At image P _{λ 0B}the center of benchmark window is moved to search window the first row first pixel in (e, f), by image P _{λ 0B}pixel corresponding with the pixel in benchmark windows overlay region and benchmark window in (e, f) carries out the signed magnitude arithmetic(al) of gray scale difference, obtains the absolute value of g × h gray scale difference, to sue for peace acquisition gray-scale value I to the absolute value of g × h gray scale difference ₁₁.Again by image P _{λ 0B}in (e, f), the center of benchmark window moves to search window the first row second pixel, adopts same method to obtain gray-scale value I ₁₂.By that analogy, by image P _{λ 0B}in (e, f), the center of benchmark window moves to search window the 1st row S pixel and obtains gray-scale value I _1S.By image P _{λ 0B}the center of benchmark window each pixel line by line in traversal search window, finally obtains matrix I(R × S in (e, f)).Find out matrix I(R × S) in minimum value I _rs, obtain minimum value I _rscoordinate (r, s) in the search window, this position is the registration center of image subject to registration.Due to the centre coordinate of search window with image P subject to registration _{λ 0B}the centre coordinate of (e, f) overlap, so image P subject to registration _{λ 0B}the registration centre coordinate of (e, f) is by image P subject to registration _{λ 0B}the registration centre coordinate of (e, f) is designated as in like manner obtain image P subject to registration _{λ 0C}the registration centre coordinate of (e, f) image P subject to registration _{λ 0D}the registration centre coordinate of (e, f) ${\[\frac{E}{2}-(\frac{R}{2}-r),\frac{F}{2}-(\frac{S}{2}-s)\]}_{\mathrm{\λ}0\mathrm{AD}}.$

5th step: wait-receiving mode different wave length image registration order, if receive different wave length image registration order, performs the 6th step.

6th step: send λ Ai to filtering assembly, λ Bj, λ Cm, λ Dn (i=1,2,3; J=1,2,3; M=1,2,3; N=1,2,3) enter respective imaging band instruction.

7th step: the two field picture that each channel C CD of synchronous acquisition exports and image P _{λ Ai}, image P _{λ Bj}, image P _{λ Cm}with image P _{λ Dn}and buffer memory.

8th step: obtain four width registering images and registering images N _{λ Ai}, registering images N _{λ Bj}, registering images N _{λ Cm}with registering images N _{λ Dn}.

Because the image gathered using the first imaging band is as registering images, so image P _{λ Ai}registration centre coordinate be keep original image constant, directly by image P _{λ Ai}value be assigned to image N _{λ Ai}, and buffer memory.

By image middle coordinate figure is pixel as the central point of this image, judge that central point is to image whether the distance on upper and lower limit equals individual pixel, if be greater than then cast out the row had more, if be less than then line number polishing is arrived compose gray-scale value 255 to each pixel of supplementing in row; Judge that central point arrives whether the distance on the left and right limit of image equals individual pixel, if be greater than then cast out the row had more, if be less than then columns polishing is arrived compose gray-scale value 255 to each pixel of supplementing in row, finally obtain the registering images N that size is E × F _{λ Bj}and buffer memory.According to the method described above to image P _{λ Cm}, P _{λ Dn}carry out same operation and obtain registering images N _{λ Cm}with registering images N _{λ Dn}and buffer memory.

9th step: from registering images N _{λ Ai}, registering images N _{λ Bj}, registering images N _{λ Cm}with registering images N _{λ Dn}in select arbitrarily three width assignment be to three primary colours R component respectively, three primary colours G component and three primary colours B component, obtain a width pseudo-colours fusion figure.After so selecting the array mode of three to carry out three primary colours assignment according to four, finally can obtain four width RGB pseudo-colours fused images N _rGB1, N _rGB2, N _rGB3and N _rGB4and this four width pseudo-colours fused images is transferred to ground control station, the operating personnel of ground control station select the most obvious image of a width target from this four width image, by the reconnaissance equipment that is wirelessly transmitted to aircraft for the identification of target and tracking.

Tenth step: judged whether END instruction, if do not have END instruction, returns the 5th step, if there is END instruction, terminates multispectral pseudo color image registration and merges program.

Claims (1)

1. a multispectral pseudo color image registration fusion method, the method is realized by the multispectral imaging device with four imaging bands and computing machine, each imaging band comprises imaging lens 1-1, filtering assembly 1-2 and ccd detector 1-3, each filtering assembly 1-2 is made up of and w >=2 w the optical filter be embedded on runner, it is characterized in that: all with the optical filter that a wave band is identical in four imaging bands, all the other are the different optical filter of wavelength; Computing machine 2 is built-in with multispectral pseudo color image registration fusion software bag; After multispectral imaging device powers on, described multispectral pseudo color image registration fusion software bag performs following operation steps:

The first step: wait-receiving mode identical band image registration order, performs second step when receiving identical band image registration order;

Second step: send λ 0A to filtering assembly, λ 0B, λ 0C, λ 0D enter respective imaging band instruction;

Wherein: λ 0A, λ 0B, λ 0C and λ 0D are respectively the optical filter in first to fourth imaging band and the wave band of these four optical filters is identical;

3rd step: the two field picture that synchronous acquisition first to fourth imaging band CCD exports and image P _{λ 0A}(e, f), image P _{λ 0B}(e, f), image P _{λ 0C}(e, f) and image P _{λ 0D}(e, f) buffer memory, wherein, e=1,2,3 ..., E, f=1,2,3 ..., F;

4th step: make the first imaging band image P _{λ 0A}the centre coordinate of (e, f) for the registration centre coordinate of this image, with value respectively according to round, and with image P _{λ 0A}(e, f) is benchmark, adopts gray scale correlation registration method respectively to image P _{λ 0B}(e, f), image P _{λ 0C}(e, f) and image P _{λ 0D}(e, f) carries out registration, obtains the registration centre coordinate of the second to the 4th imaging band image and buffer memory;

5th step: wait-receiving mode different wave length image registration order, performs the 6th step when receiving different wave length image registration order;

6th step: send λ Ai to filtering assembly, λ Bj, λ Cm, λ Dn (i=1,2,3 ..., w-1; J=1,2,3 ..., w-1; M=1,2,3 ..., w-1; N=1,2,3 ..., w-1) and enter respective imaging band instruction;

Wherein: λ Ai, λ Bj, λ Cm and λ Dn are respectively the optical filter in first to fourth imaging band and the wavelength of these four optical filters is different;

7th step: the two field picture that synchronous acquisition first to fourth imaging band CCD exports and image P _{λ Ai}, image P _{λ Bj}, image P _{λ Cm}with image P _{λ Dn}and buffer memory;

8th step: judge image P respectively _{λ Ai}, image P _{λ Bj}, image P _{λ Cm}with image P _{λ Dn}the pixel corresponding to registration centre coordinate whether equal to the distance on the upper and lower limit of respective image individual pixel, if equaled then keep original image constant, if be greater than then cast out the row had more, if be less than then line number polishing is arrived compose gray-scale value 255 to each pixel of supplementing in row; Judge whether the pixel corresponding to registration centre coordinate equals to the distance on the left and right limit of respective image individual pixel, if equaled then keep original image constant, if be greater than then cast out the row had more, if be less than then columns polishing is arrived compose gray-scale value 255 to each pixel of supplementing in row, so obtain the registering images N that four width sizes are E × F _{λ Ai}, registering images N _{λ Bj}, registering images N _{λ Cm}with registering images N _{λ Dn}and buffer memory;

9th step: select the array mode of three to registering images N according to four _{λ Ai}, registering images N _{λ Bj}, registering images N _{λ Cm}with registering images N _{λ Dn}carry out the fusion of RGB pseudo-colours, obtain four width fused images N _rGB1, N _rGB2, N _rGB3and N _rGB4and be transferred to ground control station;

Tenth step: judged whether END instruction, returns the 5th step when not having END instruction, terminate multispectral pseudo color image registration merge program when there being END instruction.