CN109191368A - A kind of method, system equipment and storage medium for realizing Panoramagram montage fusion - Google Patents

A kind of method, system equipment and storage medium for realizing Panoramagram montage fusion Download PDF

Info

Publication number
CN109191368A
CN109191368A CN201810879507.7A CN201810879507A CN109191368A CN 109191368 A CN109191368 A CN 109191368A CN 201810879507 A CN201810879507 A CN 201810879507A CN 109191368 A CN109191368 A CN 109191368A
Authority
CN
China
Prior art keywords
image
fusion
color space
realizing
contourlet
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201810879507.7A
Other languages
Chinese (zh)
Other versions
CN109191368B (en
Inventor
张晓京
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shenzhen Supion Technology Corp
Original Assignee
Shenzhen Supion Technology Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shenzhen Supion Technology Corp filed Critical Shenzhen Supion Technology Corp
Priority to CN201810879507.7A priority Critical patent/CN109191368B/en
Publication of CN109191368A publication Critical patent/CN109191368A/en
Application granted granted Critical
Publication of CN109191368B publication Critical patent/CN109191368B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T3/00Geometric image transformations in the plane of the image
    • G06T3/14Transformations for image registration, e.g. adjusting or mapping for alignment of images
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T3/00Geometric image transformations in the plane of the image
    • G06T3/40Scaling of whole images or parts thereof, e.g. expanding or contracting
    • G06T3/4038Image mosaicing, e.g. composing plane images from plane sub-images

Landscapes

  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Image Processing (AREA)

Abstract

The invention discloses a kind of methods for realizing Panoramagram montage fusion, comprising the following steps: pre-processes respectively to each width image to be spliced, overlapping image is converted to HSI color space;HSI color space image degree of comparing contourlet transformation to obtaining;Using inverse contrast contourlet conversion process;Above-mentioned image is merged, and is converted to rgb color space;By gained rgb color space image superposition into spliced map, panorama sketch is obtained.And a kind of system for realizing Panoramagram montage fusion.The method and system provided by the invention for realizing Panoramagram montage fusion, convert by using contrast contourlet, using its profile characteristic, the minutia of image, good transition overlapping region are shown, so that image co-registration is more compact, consistent.Using this method, there is good syncretizing effect to realization scene image, meet very much the visual effect of human eye, be with a wide range of applications.

Description

A kind of method, system equipment and storage medium for realizing Panoramagram montage fusion
Technical field
The present invention relates to field of image processings, the specially method and system of realization Panoramagram montage fusion.
Background technique
Image co-registration is the research hotspot of information fusion and image processing field.Visual fusion is will be useful in two width pictures Information be integrated into a width picture, to obtain the more comprehensive information of Same Scene.The development of image fusion technology can chase after It traces back in the 1980s, being mainly used in the process fields such as remote sensing images, infrared image, medical image.
In order to realize smooth continuous Panoramagram montage syncretizing effect, the characteristics of for Panoramagram montage, spelled in panorama sketch In connecing (including image outfit, affine transformation, image co-registration etc.), visual fusion is a wherein important link, it is responsible for figure As the optimization processing that overlapping position is superimposed, the strengths and weaknesses of image co-registration directly influences the effect of panorama.Currently, panoramic picture Splicing has mean value fusion method, weighting smooth blend method, multi-definition fusion method etc..Wherein, mean value fusion method is to image Intersection is directly averaged.Algorithm, which is realized, to be easy, but can generate apparent splicing trace;Although weighting smooth blend method equal Improve many on the basis of value method, but processing situations such as image rotation, dislocation is unsatisfactory;Though multi-definition fusion method Preferable syncretizing effect can be so embodied, but realization is complex, and does not allow readily understood.
To sum up, technology needs improve.
Summary of the invention
The present invention is directed to solve at least some of the technical problems in related technologies.For this purpose, of the invention One purpose is to provide a kind of method and system for realizing Panoramagram montage fusion that splicing syncretizing effect is good.
The technical scheme adopted by the invention is that:
The present invention provides a kind of method for realizing Panoramagram montage fusion, comprising the following steps:
Each width image to be spliced is pre-processed respectively, overlapping image is converted into HSI color space;
HSI color space image degree of comparing contourlet transformation to obtaining;
Using inverse contrast contourlet conversion process;
Above-mentioned image is merged, and is converted to rgb color space;
By gained rgb color space image superposition into spliced map, panorama sketch is obtained.
Preferably, the pretreatment includes: and is registrated to each width image to be spliced, and carries out to overlapping region affine Transformation.
Preferably, described that affine transformation is carried out to overlapping region comprising to turn image by following formula from rgb color space Change to HSI color space;
Wherein, RGB respectively indicates the red, green, blue component of pel.
Preferably, degree of the comparing contourlet transformation, comprising:
Bandpass sampling is carried out to image, laplacian pyramid is established and carries out multi-resolution decomposition;
Continue Directional Decomposition, obtains directional subband.
Further, image obtains corresponding high fdrequency component and low frequency component after contourlet is converted;Wherein for height Frequency component carries out fusion treatment using Weighted Fusion method;Low frequency component, which is used, asks arithmetic mean method to carry out fusion treatment.
On the other hand, the present invention also provides a kind of systems for realizing Panoramagram montage fusion, comprising:
Image pre-processing module respectively pre-processes each width image to be spliced for executing step, by overlay chart As being converted to HSI color space;
Contrast variation's module, for executing step to obtained HSI color space image degree of comparing Contourlet transformation;Using inverse contrast contourlet conversion process;
Image fusion processing module merges above-mentioned image for executing step, and is converted to rgb color space;It will Gained rgb color space image superposition obtains panorama sketch into spliced map.
In another aspect, the present invention also provides a kind of equipment for realizing Panoramagram montage fusion, comprising:
At least one processor;And
The memory being connect at least one described processor communication;Wherein,
The memory is stored with the instruction that can be executed by least one described processor, and described instruction is by described at least one A processor executes, so that at least one described processor is able to carry out the method.
Fourth aspect, the present invention also provides a kind of computer readable storage medium, the computer readable storage medium is deposited Computer executable instructions are contained, the computer executable instructions are used to that computer to be made to execute the method.
The beneficial effects of the present invention are: the method and system provided by the invention for realizing Panoramagram montage fusion, by adopting It is converted with contrast contourlet, using its profile characteristic, shows the minutia of image, good transition overlapping region, So that image co-registration is more compact, consistent.Using this method, there is good syncretizing effect to realization scene image, very The visual effect for meeting human eye, is with a wide range of applications.
Detailed description of the invention
Fig. 1 is the control schematic diagram of one embodiment of the invention;
Fig. 2 is the control schematic diagram of another embodiment of the present invention;
Fig. 3 is the contourlet transition diagram of one embodiment of the invention;
Fig. 4 is the anisotropic filter composition schematic diagram of one embodiment of the invention.
Specific embodiment
It should be noted that in the absence of conflict, the features in the embodiments and the embodiments of the present application can phase Mutually combination.
The image co-registration that this programme combines contrast pyramid to decompose using color space transformation and contourlet transformation Algorithm.HSI colour space transformation is carried out first, is obtained the brightness of image, is then based on contrast pyramid Contourlet transformation carries out QMF compression to brightness, obtains different frequency band features, then merge to different frequency bands Processing.The profile characteristic that the algorithm that this programme proposes makes full use of contourlet to convert, illustrates the minutia of image, To realize the splicing syncretizing effect of panorama sketch well.
Referring to Fig.1-2, the present invention provides a kind of method for realizing Panoramagram montage fusion, comprising the following steps:
Each width image to be spliced is pre-processed respectively, overlapping image is converted into HSI color space;
HSI color space image degree of comparing contourlet transformation to obtaining;
Using inverse contrast contourlet conversion process;
Above-mentioned image is merged, and is converted to rgb color space;
By gained rgb color space image superposition into spliced map, panorama sketch is obtained.
The control method of the present embodiment include: image is pre-processed, HSI decompose, contrast contourlet transformation, Fusion, inverse transformation and HSI reconstruct.
For Panoramagram montage, first have to be registrated, the pretreatment operations such as affine transformation.This programme is calculated using SURF Method combines the matched method of secondary deflecting to carry out registration process to the image to be spliced, and then carries out the left side to the image after registration Unified transformation, i.e. affine transformation.Due to the two images with intersection captured in same place, due to Image Acquisition The coordinate of the rotation etc. of module such as camera, real image can change;Therefore it needs to carry out affine transformation to original image.
In addition to above-mentioned processing is complete, in order to improve the quality of blending image, it is also necessary to be exposed benefit to the image before fusion It repays, enhance, except the processing such as hot-tempered.
For the color image presented in the form of RGB is trichromatic, it is not well positioned to meet people but in terms of image processing The perception of eye.More meet the description color characteristic that human eye is received is the HSI color space for being called hue, saturation, intensity. Wherein, tone, saturation degree are collectively referred to as coloration again.Coloration and brightness directly characterize the color information of human eye perception.
For the image of RGB form, can be converted by following formula to HSI color space;
Wherein, RGB respectively indicates the red, green, blue component of pel.
Referring to Fig. 3, then degree of comparing contourlet is converted;Contourlet transformation can be very good capture image Direction character, and have lower redundancy.Contourlet transformation includes: to carry out bandpass sampling to image, and it is general to establish drawing Lars pyramid carries out multi-resolution decomposition;Directional Decomposition is continued using anisotropic filter group, obtains directional subband.Two processes Independently of each other, it is conducive to understand.
Contrast pyramid, also known as ratio low pass pyramid, recognition effect are more advantageous to human eye identification.Contrast gold word The building of tower is the process successively filtered by gauss low frequency filter.If the original image of input is I (x.y), it is defined as the 0th layer I0, each layer obtained through Gassian low-pass filter is In, then the process for filtering next layer of construction is Rd (), it can be obtained:
Wherein, 1≤n≤N.Since each layer generated during low-pass filtering is low resolution, so will be to this Low pass layer does interpolation processing, generates high-frequency data.Definition Interpolation Process is Ed () i, then:
Indicate InIt carries out k interpolation and obtains In,k, wherein w (m, n) is filter function.
This programme is the contourlet transformation based on contrast pyramid, defines the contrast of image are as follows:
Wherein g indicates the brightness of image point, g1Indicate the background luminance of the point.Define contrast pyramid are as follows:
Contrast pyramid is to use corresponding inverse process can be with restored image the complete reversible decomposable process of original image I (x.y), such as following formula:
Contourlet transformation includes low-pass filtering and trend pass filtering.This programme is using anisotropic filter/group progress direction Filtering.Anisotropic filter group (DFB) is the algorithm that a kind of pair of image carries out tree decomposition.One 4 is shown referring to Fig. 4 The first order and the second level are set to Q by the structure of direction DFB respectively0、Q1, for whole system, lower sampling matrix can be with table It is shown as Q0Q1=2E2, in which:
Replace contrast pyramid to decompose using laplace expansion process, enhance the contrast metric of blending image, Increase the recognition effect of image.
Image obtains corresponding high fdrequency component and low frequency component after contourlet is converted;High fdrequency component essentially describes The details of image, such as mutation, the contour edge of texture;Low frequency component essentially describes region more gentle in image, right The splicing effect of image is mainly reflected in background characteristics.Therefore, different fusion means need to be used.
Preferably, for low frequency component use direct Weighted Average Algorithm, i.e. F (x, y)={ A (x, y)+B (x, y) } × 50%;Fusion treatment is carried out using Weighted Fusion method for high fdrequency component;As two width are converted by contrast pyramid High fdrequency component is F1(x,y),F2(x, y), then high-frequency therapeutic treatment is obtained by following formula:
I.e. for high fdrequency component, the high fdrequency component of blending image is replaced in such a way that absolute value compares, it is very big in this way Reservation image details, avoiding fusion process leads to the blurring of image detail.
The above-mentioned intersection just for connection image then retains original image feature for non-coincidence part.
This programme is accurately registrated to from homologous or non-homogeneous multiple image first, and carries out coordinate as required Space conversion, finally carries out splicing fusion to image.
Color space variation is done to the overlapping region for the image to be spliced being registrated, image is turned from rgb color space It is changed to HSI color space;
The HSI spatial image being converted to converted based on contrast pyramid, that is, chooses the luminance component I of image It is converted.To coloration H and saturation degree S is based on, arithmetic mean calculating is carried out respectively, can reduce the two in this way in coloration and saturation Difference on degree increases the continuity of fusion;
To the low frequency component coefficient of above-mentioned acquisition, handled according to arithmetic mean method;
To high fdrequency component coefficient, calculated according to absolute value comparison method;
The data of acquisition are carried out to the brightness point that the fused space HSI is changed to based on the inversion that contrast pyramid converts Measure I;For low frequency component using asking arithmetic mean method to carry out fusion treatment, such arithmetic speed will not be reduced and is easily achieved, Operation duration can significantly be saved.
Finally, fused image is converted back rgb color space and is added in stitching image, to obtain final Panorama sketch.
On the other hand, the present invention also provides a kind of systems for realizing Panoramagram montage fusion, comprising:
Image pre-processing module respectively pre-processes each width image to be spliced for executing step, by overlay chart As being converted to HSI color space;
Contrast variation's module, for executing step to obtained HSI color space image degree of comparing Contourlet transformation;Using inverse contrast contourlet conversion process;
Image fusion processing module merges above-mentioned image for executing step, and is converted to rgb color space;It will Gained rgb color space image superposition obtains panorama sketch into spliced map.
In another aspect, the present invention also provides a kind of equipment for realizing Panoramagram montage fusion, comprising:
At least one processor;And
The memory being connect at least one described processor communication;Wherein,
The memory is stored with the instruction that can be executed by least one described processor, and described instruction is by described at least one A processor executes, so that at least one described processor is able to carry out the method.
Fourth aspect, the present invention also provides a kind of computer readable storage medium, the computer readable storage medium is deposited Computer executable instructions are contained, the computer executable instructions are used to that computer to be made to execute the method.
The method and system provided by the invention for realizing Panoramagram montage fusion, turn by using contrast contourlet It changes, using its profile characteristic, shows the minutia of image, good transition overlapping region, so that image co-registration is more stepped up It gathers, unanimously.Using this method, there is good syncretizing effect to realization scene image, meet very much the visual effect of human eye, have Have a wide range of applications.
It is to be illustrated to preferable implementation of the invention, but the invention is not limited to the implementation above Example, those skilled in the art can also make various equivalent variations on the premise of without prejudice to spirit of the invention or replace It changes, these equivalent deformations or replacement are all included in the scope defined by the claims of the present application.

Claims (8)

1. a kind of method for realizing Panoramagram montage fusion, which comprises the following steps:
Each width image to be spliced is pre-processed respectively, overlapping image is converted into HSI color space;
HSI color space image degree of comparing contourlet transformation to obtaining;
Using inverse contrast contourlet conversion process;
Above-mentioned image is merged, and is converted to rgb color space;
By gained rgb color space image superposition into spliced map, panorama sketch is obtained.
2. the method according to claim 1 for realizing Panoramagram montage fusion, which is characterized in that the pretreatment includes: Each width image to be spliced is registrated, and affine transformation is carried out to overlapping region.
3. it is according to claim 2 realize Panoramagram montage fusion method, which is characterized in that it is described to overlapping region into Row affine transformation comprising image is transformed into HSI color space by following formula from rgb color space;
Wherein, RGB respectively indicates the red, green, blue component of pel.
4. it is according to any one of claims 1 to 3 realize Panoramagram montage fusion method, which is characterized in that it is described into Row contrast contourlet transformation, comprising:
Bandpass sampling is carried out to image, laplacian pyramid is established and carries out multi-resolution decomposition;
Continue Directional Decomposition, obtains directional subband.
5. the method according to claim 4 for realizing Panoramagram montage fusion, which is characterized in that image is through contourlet Corresponding high fdrequency component and low frequency component are obtained after transformation;Wherein high fdrequency component is carried out at fusion using Weighted Fusion method Reason;Low frequency component, which is used, asks arithmetic mean method to carry out fusion treatment.
6. a kind of system for realizing Panoramagram montage fusion characterized by comprising
Image pre-processing module respectively pre-processes each width image to be spliced for executing step, and overlapping image is turned It is changed to HSI color space;
Contrast variation's module becomes obtained HSI color space image degree of comparing contourlet for executing step It changes;Using inverse contrast contourlet conversion process;
Image fusion processing module merges above-mentioned image for executing step, and is converted to rgb color space;By gained Rgb color space image superposition obtains panorama sketch into spliced map.
7. a kind of equipment for realizing Panoramagram montage fusion characterized by comprising
At least one processor;And
The memory being connect at least one described processor communication;Wherein,
The memory is stored with the instruction that can be executed by least one described processor, and described instruction is by described at least one It manages device to execute, so that at least one described processor is able to carry out such as method described in any one of claim 1 to 5.
8. a kind of computer readable storage medium, which is characterized in that the computer-readable recording medium storage has computer can It executes instruction, the computer executable instructions are for making computer execute such as method described in any one of claim 1 to 5.
CN201810879507.7A 2018-08-03 2018-08-03 Method, system equipment and storage medium for realizing splicing and fusion of panoramic pictures Active CN109191368B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201810879507.7A CN109191368B (en) 2018-08-03 2018-08-03 Method, system equipment and storage medium for realizing splicing and fusion of panoramic pictures

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201810879507.7A CN109191368B (en) 2018-08-03 2018-08-03 Method, system equipment and storage medium for realizing splicing and fusion of panoramic pictures

Publications (2)

Publication Number Publication Date
CN109191368A true CN109191368A (en) 2019-01-11
CN109191368B CN109191368B (en) 2023-04-14

Family

ID=64920089

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201810879507.7A Active CN109191368B (en) 2018-08-03 2018-08-03 Method, system equipment and storage medium for realizing splicing and fusion of panoramic pictures

Country Status (1)

Country Link
CN (1) CN109191368B (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111713095A (en) * 2019-08-14 2020-09-25 深圳市大疆创新科技有限公司 Image processing method and device, image shooting equipment and mobile terminal

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20110182509A1 (en) * 2010-01-25 2011-07-28 Apple Inc. Image Preprocessing
CN105469364A (en) * 2015-10-26 2016-04-06 厦门理工学院 Medical image fusion method combined with wavelet transformation domain and spatial domain
CN105761214A (en) * 2016-01-14 2016-07-13 西安电子科技大学 Remote sensing image fusion method based on contourlet transform and guided filter
CN105825491A (en) * 2016-03-17 2016-08-03 江苏科技大学 Image fusion method based on hybrid model
CN205707396U (en) * 2016-02-23 2016-11-23 普宙飞行器科技(深圳)有限公司 A kind of unmanned plane panned
CN106303296A (en) * 2016-08-30 2017-01-04 许昌学院 A kind of image mosaic emerging system
CN106570123A (en) * 2016-11-02 2017-04-19 中国科学院深圳先进技术研究院 Adjacent object association rule based remote sensing image retrieval method and system

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20110182509A1 (en) * 2010-01-25 2011-07-28 Apple Inc. Image Preprocessing
CN105469364A (en) * 2015-10-26 2016-04-06 厦门理工学院 Medical image fusion method combined with wavelet transformation domain and spatial domain
CN105761214A (en) * 2016-01-14 2016-07-13 西安电子科技大学 Remote sensing image fusion method based on contourlet transform and guided filter
CN205707396U (en) * 2016-02-23 2016-11-23 普宙飞行器科技(深圳)有限公司 A kind of unmanned plane panned
CN105825491A (en) * 2016-03-17 2016-08-03 江苏科技大学 Image fusion method based on hybrid model
CN106303296A (en) * 2016-08-30 2017-01-04 许昌学院 A kind of image mosaic emerging system
CN106570123A (en) * 2016-11-02 2017-04-19 中国科学院深圳先进技术研究院 Adjacent object association rule based remote sensing image retrieval method and system

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111713095A (en) * 2019-08-14 2020-09-25 深圳市大疆创新科技有限公司 Image processing method and device, image shooting equipment and mobile terminal

Also Published As

Publication number Publication date
CN109191368B (en) 2023-04-14

Similar Documents

Publication Publication Date Title
US20220292658A1 (en) Image fusion method and apparatus, storage medium, and electronic device
CN105915909B (en) A kind of high dynamic range images layered compression method
Xiong et al. Fast panorama stitching for high-quality panoramic images on mobile phones
DE102019213184A1 (en) METHOD AND SYSTEM FOR AUTOMATIC WHITE BALANCE BASED ON DEEP LEARNING
CN103226822B (en) Medical imaging joining method
CN105850114A (en) Method for inverse tone mapping of an image
CN106791623A (en) A kind of panoramic video joining method and device
US11763432B2 (en) Multi-exposure image fusion method based on feature distribution weight of multi-exposure image
JP2022524806A (en) Image fusion method and mobile terminal
CN109118463B (en) SAR image and optical image fusion method based on HSL and image entropy
CN110930341A (en) Low-illumination image enhancement method based on image fusion
CN110599418B (en) Global tone mapping method for transform domain fusion
CN111260580A (en) Image denoising method based on image pyramid, computer device and computer readable storage medium
CN103065282A (en) Image fusion method based on sparse linear system
CN111145290A (en) Image colorization method, system and computer readable storage medium
CN111105359A (en) Tone mapping method for high dynamic range image
Song et al. Multi-scale joint network based on Retinex theory for low-light enhancement
CN106709888B (en) A kind of high dynamic range images production method based on human vision model
CN109191368A (en) A kind of method, system equipment and storage medium for realizing Panoramagram montage fusion
CN110321452A (en) A kind of image search method based on direction selection mechanism
CN110232730A (en) A kind of three-dimensional face model textures fusion method and computer-processing equipment
CN112734679A (en) Fusion defogging method for medical operation video images
CN110246086A (en) The image processing method and its image processing system of color image enhancement
CN116801115A (en) Sparse array camera deployment method
Li et al. Image mosaic and hybrid fusion algorithm based on pyramid decomposition

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant
PE01 Entry into force of the registration of the contract for pledge of patent right
PE01 Entry into force of the registration of the contract for pledge of patent right

Denomination of invention: A method, system equipment, and storage medium for achieving panoramic image stitching and fusion

Effective date of registration: 20230728

Granted publication date: 20230414

Pledgee: CITIC Bank Limited by Share Ltd. Shenzhen branch

Pledgor: SHENZHEN SUPOIN TECHNOLOGY Corp.

Registration number: Y2023980050243

PP01 Preservation of patent right
PP01 Preservation of patent right

Effective date of registration: 20240201

Granted publication date: 20230414