CN208240087U - A kind of infrared and visible light emerging system and image fusion device - Google Patents
A kind of infrared and visible light emerging system and image fusion device Download PDFInfo
- Publication number
- CN208240087U CN208240087U CN201721929251.3U CN201721929251U CN208240087U CN 208240087 U CN208240087 U CN 208240087U CN 201721929251 U CN201721929251 U CN 201721929251U CN 208240087 U CN208240087 U CN 208240087U
- Authority
- CN
- China
- Prior art keywords
- image
- infrared
- visible
- visible light
- registration
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related
Links
Landscapes
- Studio Devices (AREA)
Abstract
The utility model discloses a kind of infrared and visible light emerging system and image fusion devices, and system includes: the infrared optics for obtaining the visible infrared image of measured target；For obtaining the visible light optical device of the visible images of measured target；For will be seen that infrared image and visible images carry out the image fusion device of image co-registration；Display device for showing the light blending image for carrying out the formation of image co-registration；Wherein, infrared optics and visible light optical device are connect with image fusion device respectively, and image fusion device is connect with display device.It is provided by the utility model it is infrared can be by the way that infrared visual picture be rationally merged with visible light with visible light emerging system and image fusion device, and take corresponding registration measure, so that fused image has the characteristics that clarity is high, precision is high, high reliablity and irredundant, user is made to obtain the image and user experience of better quality.
Description
Technical field
The utility model relates to a kind of image co-registration fields, more particularly to a kind of infrared and visible light emerging system and image
Fusing device.
Background technique
Currently, single infrared image resolution ratio is low, but no matter daytime can be used.Although single visible images image point
Resolution is high, however nighttime imaging effect is poor, and image information is smudgy.
In the prior art, exist the infrared the relevant technologies merged with visible light and device, image co-registration application is
Many fields are expanded to, requirements to be met is also more and more, such as by overlapping image reconstruction scene, holding image and middle equal part
The fusion of resolution imaging spectral instrument space-time and spectrum signature, the fusion of spectral preservation balance, the fusion for keeping information, using melting
It closes to enhance out-of-focus image etc..
Infrared merged with visible light at military aspect is mainly positioning, identification, tracking, the scouting of military target, hidden force
The detection of device, battlefield monitoring, night flying guidance have gradually been applied in scounting aeroplane, panzer, tank.With target detection
For, it is very universal using image fusion technology progress target detection in military affairs.Since military target often has concealment, become
Change is also very fast, therefore the image used should be able to show these features well.In this way, carry out target detection pass through frequently with
Image just includes the radar image that can be imaged under severe weather conditions, infrared image and visible light with counter camouflage ability
Image etc..Image co-registration has application to the fields such as security protection, monitoring, forest fire protection at civilian aspect.
But it is infrared between visible light image information there is redundancy and overlapping so that fused fogging image, than
It is relatively fuzzy, and precision, reliability and utilization rate be not also high.
It is existing infrared to be had the following deficiencies: with visible light integration technology
(1) blending image there are redundancy, overlapping phenomena such as；
(2) blending image is unintelligible, pixel is not high, relatively fuzzyyer；
(3) precision of blending image and reliability are insufficient.
Utility model content
In view of this, the present invention provides a kind of infrared and visible light emerging system and image fusion devices, can solve
Certainly blending image redundancy, easily overlapping, unintelligible, pixel is low, precision and reliability deficiency problem.
Infrared pass through with visible light emerging system and image fusion device of one kind provided by the utility model will be infrared visible
Image is rationally merged with visible light, and takes corresponding registration measure, so that fused image has clarity high, smart
Degree height, high reliablity and irredundant feature, make user obtain the image and user experience of better quality.
One kind provided by the utility model is infrared to include: with visible light emerging system
For obtaining the infrared optics of the visible infrared image of measured target；
For obtaining the visible light optical device of the visible images of measured target；
For will be seen that infrared image and visible images carry out the image fusion device of image co-registration；
The display device that light blending image for image fusion device to be carried out to the formation of image co-registration is shown；
Wherein, infrared optics and visible light optical device are connect with image fusion device respectively, image fusion device
It is connect with display device.
Preferably, infrared optics include infrared lens, outer red sensor, infrared signal converter and infrared output
Port, in which:
Infrared lens are used to receive and converge the infrared energy information of measured target；
Infrared sensor is used to the thermal radiation signal of infrared energy information being converted to infrared electric signal；
Infrared signal converter is used to infrared electric signal being converted into visible infrared image；
Infrared output port is for will be seen that infrared image delivery to image fusion device.
Preferably, it is seen that light Optical devices include visible light camera and visible optical output port, in which:
Visible light camera is used to shoot the visible images of measured target；
It can be seen that optical output port is for it will be seen that light image is transferred to image fusion device.
Preferably, image fusion device includes input port, fused controlling device, image stitcher and output port,
In:
Input port is for receiving visible infrared image and visible images；
Fused controlling device carries out image co-registration for controlling visible infrared image and visible images；
Image stitcher obtains light blending image for that will carry out image mosaic by the processed image of fused controlling device；
Input port is used to light blending image being transferred to display device.
Preferably, image stitcher is 4K image stitcher.
Preferably, infrared optics are thermal infrared imager.
Preferably, display device is display screen or display panel.
One kind provided by the utility model it is infrared with visible light emerging system by by infrared visual picture and visible light into
Row rationally fusion, and corresponding registration measure is taken, so that fused image has, clarity is high, precision is high, high reliablity
And irredundant feature, so that user is obtained the image and user experience of better quality.
In addition, a kind of image fusion device provided by the utility model includes:
Input port, fused controlling device, image stitcher and output port, wherein
Input port is for receiving visible infrared image and visible images；
Fused controlling device carries out image co-registration for controlling visible infrared image and visible images；
Image stitcher obtains light blending image for that will carry out image mosaic by the processed image of fused controlling device；
Input port is used to light blending image being transferred to display device.
Preferably, image stitcher is 4K image stitcher.
Preferably, display device is display screen or display panel.
A kind of image fusion device provided by the utility model is by rationally being melted infrared visual picture with visible light
It closes, and takes corresponding registration measure, so that fused image has high clarity height, precision, high reliablity and without superfluous
Remaining feature makes user obtain the image and user experience of better quality.
The utility model has the beneficial effects that: by rationally being merged infrared visual picture with visible light, and adopt
Corresponding registration measure is taken, so that fused image has high clarity, precision height, high reliablity and irredundant spy
Point makes user obtain the image and user experience of better quality.
Detailed description of the invention
Fig. 1 is the infrared structural schematic diagram with one embodiment of visible light emerging system of the utility model；
Fig. 2 is the infrared structural schematic diagram with another embodiment of visible light emerging system of the utility model；
Fig. 3 is the structural schematic diagram of one embodiment of the utility model image fusion device.
Specific embodiment
In the following, being described further in conjunction with attached drawing and specific embodiment to the utility model, it should be noted that
Under the premise of not colliding, it can be formed in any combination between various embodiments described below or between each technical characteristic new
Embodiment.
Refering to fig. 1, Fig. 1 is the infrared structural schematic diagram with one embodiment of visible light emerging system of the utility model.
In the present embodiment, infrared and visible light emerging system includes infrared optics 10, visible light optical device
20, image fusion device 30 and display device 40.Wherein, infrared optics 10 and visible light optical device 20 respectively with institute
The connection of image fusion device 30 is stated, described image fusing device 30 is connect with display device 40.
The infrared optics 10 can be but not limit thermal infrared imager, infrared sensor etc., the visible light light
Learning device can be but not limit video camera, camera or the intelligent apparatus with camera function etc., and image fusion device can be with
For but do not limit image co-registration device, image processor etc..
In the present embodiment, the infrared optics 10 are used to obtain the infrared energy information of measured target,
And visible infrared image is converted by the infrared energy information, and the infrared image delivery is merged to described image
Device 30.
The visible light optical device 20 is used to obtain the visible images of measured target, and the visible images are passed
It is defeated by described image fusing device 30.
Described image fusing device 30 is by image fusion technology by the visible infrared image and the visible light figure
It carries out image co-registration and generates light blending image, and the smooth blending image is transferred to the display device 40.
The display device 40 is for showing the smooth blending image.
It should be noted that the infrared energy information of measured target through reception after, can be by energy profile shape
Reflect on the light-sensitive element of infrared detector, so that Infrared Thermogram is obtained, the heat of this Infrared Thermogram and body surface
It is distributed corresponding, and the different colours above Infrared Thermogram represent the different temperatures of measured target.
Visible light be human eye it can be seen that, therefore obtain visible light approach it is very much, than being shot if any camera,
It can obtain visible images, i.e., common normal image.
Image fusion technology is generally by the way of Image Feature Detection, characteristic matching, model estimation and image transformation
Carry out image co-registration.
Image fusion device can be but be not limited to image co-registration device, such as AGT image co-registration device.
Display device 40 can be but be not limited to display screen or display panel etc..
The use of the new type provide it is infrared with visible light emerging system by the way that infrared visual picture is closed with visible light
Reason fusion, and takes corresponding registration measure so that fused image has, clarity is high, precision is high, high reliablity and
Irredundant feature makes user obtain the image and user experience of better quality.
Referring to Fig.2, Fig. 2 is the infrared structural schematic diagram with another embodiment of visible light emerging system of the utility model.
In the present embodiment, infrared and visible light emerging system includes 10 ' of infrared optics, visible light optical device
40 ' of 20 ', 30 ' of image fusion device and display device.Wherein, 10 ' of infrared optics and 20 ' of visible light optical device points
It is not connect with 30 ' of described image fusing device, 30 ' of described image fusing device is connect with 40 ' of display device.
The infrared optics 10 can be but not limit thermal infrared imager, infrared sensor etc., the visible light light
Learning device can be but not limit video camera, camera or the intelligent apparatus with camera function etc., and image fusion device can be with
For but do not limit image co-registration device, image processor etc..
In the present embodiment, 10 ' of infrared optics include infrared lens 110, it is outer red sensor 120, infrared
Signal adapter 130 and infrared output port 140.The infrared lens 110 are for receiving and converging the measured target
Infrared energy information.The infrared sensor 120 is used to convert the thermal radiation signal of the infrared energy information
For infrared electric signal.The infrared signal converter 130 is used to the infrared electric signal being converted into the visible infrared image.
The infrared output port 140 is used to give the visible infrared image delivery to described image fusing device.
It is understood that the infrared energy information of measured target through reception after, can be by energy profile shape
Reflect on the light-sensitive element of infrared detector, so that Infrared Thermogram is obtained, the heat of this Infrared Thermogram and body surface
It is distributed corresponding, and the different colours above Infrared Thermogram represent the different temperatures of measured target.
In the present embodiment, 20 ' of visible light optical device includes visible light camera 210 and visible light output
Port 220.The visible light camera 210 is used to shoot the visible images of the measured target.The visible light output end
Mouth 220 is for being transferred to described image fusing device for the visible images.
It is understood that visible light be human eye it can be seen that, therefore obtain visible light approach it is very much, such as
There is camera shooting, visible images, i.e., common normal image can be obtained.
In the present embodiment, 30 ' of described image fusing device includes input port 310, fused controlling device 320, image
Splicer 330 and output port 340.The input port 310 is for receiving the visible infrared image and described visible
Light image.The fused controlling device 320 carries out image and melts for controlling the visible infrared image and the visible images
It closes.Described image splicer 330 melts for that will obtain the light by the processed image progress image mosaic of fused controlling device
Close image.The input port 340 is used to the smooth blending image being transferred to the display device.Wherein, image stitcher
For 4K image stitcher, display device is display screen or display panel.
It is worth one to say that 30 ' of image fusion device can be but be not limited to image co-registration device, such as AGT image co-registration
Device.
It is to be appreciated that needing to complete some preparation works before carrying out image co-registration, wherein will use many
The technology of image procossing.All Image Fusions can be generally divided into following three step and complete, and the first step is image first
Pretreatment work is obtained since the image of image co-registration is shot under different sensor or different condition, so can
Can there are resolution ratio, tonal range etc. difference, the preliminary pretreatment work such as need to normalize；The followed by registration of image
Work, this step is an essential step in image co-registration, and registration levels of precision directly affects last image co-registration effect
Fruit, the general one-to-one correspondence for requiring to accomplish the pixel between image, even needs sub-pixel precision sometimes, is finally according to difference
Fusion PCR, synthesize blending image or extract Fusion Features or make decision fusion to algorithms of different result.
It being further understood that, image registration is a project of difference between the image for solving to obtain under different scenes,
It is an essential step in many high-level image processing process, directly affects the effect of subsequent algorithm.Due to
The influence that the diversity and various interference for being registrated image are degenerated, it is very unrealistic that design, which is suitable for the algorithm of all registration tasks,
's.Every kind of registration Algorithm not only needs to consider the geometric transformation model being registrated between image, also to take influence of noise, registration essence into account
The factors such as degree and application data characteristics.
Above-mentioned Image Fusion and image registration are existing image fusion technologies, are illustrated herein, and in not sheet
Utility model protection range.
The use of the new type provide it is infrared with visible light emerging system by the way that infrared visual picture is closed with visible light
Reason fusion, and takes corresponding registration measure so that fused image has, clarity is high, precision is high, high reliablity and
Irredundant feature makes user obtain the image and user experience of better quality.
It is the structural schematic diagram of one embodiment of the utility model image fusion device refering to Fig. 3, Fig. 3.
In the present embodiment, image fusion device 30 " includes 310 ' of input port, 320 ' of fused controlling device, image spelling
Meet 340 ' of 330 ' of device and output port.310 ' of input port is for receiving the visible infrared image and described visible
Light image.320 ' of fused controlling device carries out image and melts for controlling the visible infrared image and the visible images
It closes.330 ' of described image splicer melts for that will obtain the light by the processed image progress image mosaic of fused controlling device
Close image.340 ' of input port is used to the smooth blending image being transferred to the display device.Wherein, image stitcher
For 4K image stitcher, display device is display screen or display panel.
It is to be appreciated that needing to complete some preparation works before carrying out image co-registration, wherein will use many
The technology of image procossing.All Image Fusions can be generally divided into following three step and complete, and the first step is image first
Pretreatment work is obtained since the image of image co-registration is shot under different sensor or different condition, so can
Can there are resolution ratio, tonal range etc. difference, the preliminary pretreatment work such as need to normalize；The followed by registration of image
Work, this step is an essential step in image co-registration, and registration levels of precision directly affects last image co-registration effect
Fruit, the general one-to-one correspondence for requiring to accomplish the pixel between image, even needs sub-pixel precision sometimes, is finally according to difference
Fusion PCR, synthesize blending image or extract Fusion Features or make decision fusion to algorithms of different result.
It being further understood that, image registration is a project of difference between the image for solving to obtain under different scenes,
It is an essential step in many high-level image processing process, directly affects the effect of subsequent algorithm.Due to
The influence that the diversity and various interference for being registrated image are degenerated, it is very unrealistic that design, which is suitable for the algorithm of all registration tasks,
's.Every kind of registration Algorithm not only needs to consider the geometric transformation model being registrated between image, also to take influence of noise, registration essence into account
The factors such as degree and application data characteristics.
Above-mentioned Image Fusion and image registration are existing image fusion technologies, are illustrated herein, and in not sheet
Utility model protection range.
The use of the new type provide it is infrared with visible light emerging system by the way that infrared visual picture is closed with visible light
Reason fusion, and takes corresponding registration measure so that fused image has, clarity is high, precision is high, high reliablity and
Irredundant feature makes user obtain the image and user experience of better quality.
Above embodiment is only preferred embodiments of the present invention, cannot be protected with this to limit the utility model
Range, the variation of any unsubstantiality that those skilled in the art is done on the basis of the utility model and replacement belong to
In the utility model range claimed.
Claims (10)
1. a kind of infrared and visible light emerging system, which is characterized in that the system comprises:
For obtaining the infrared optics of the visible infrared image of measured target；
For obtaining the visible light optical device of the visible images of the measured target；
For the visible infrared image and visible images to be carried out to the image fusion device of image co-registration；
The display device that light blending image for described image fusing device to be carried out to the formation of image co-registration is shown；
Wherein, the infrared optics and the visible light optical device are connect with described image fusing device respectively, described
Image fusion device is connect with the display device.
2. infrared and visible light emerging system as described in claim 1, which is characterized in that the infrared optics include red
Outer camera lens, infrared sensor, infrared signal converter and infrared output port, in which:
The infrared lens are used to receive and converge the infrared energy information of the measured target；
The infrared sensor is used to the thermal radiation signal of the infrared energy information being converted to infrared electric signal；
The infrared signal converter is used to the infrared electric signal being converted into the visible infrared image；
The infrared output port is used to give the visible infrared image delivery to described image fusing device.
3. as described in claim 1 infrared with visible light emerging system, which is characterized in that the visible light optical device includes
Visible light camera and visible optical output port, in which:
The visible light camera is used to shoot the visible images of the measured target；
The visible optical output port is used to the visible images being transferred to described image fusing device.
4. as described in any one of claims 1-3 infrared and visible light emerging system, which is characterized in that described image fusion dress
It sets including input port, fused controlling device, image stitcher and output port, in which:
The input port is for receiving the visible infrared image and the visible images；
The fused controlling device carries out image co-registration for controlling the visible infrared image and the visible images；
Described image splicer obtains the light fusion for that will carry out image mosaic by the processed image of fused controlling device
Image；
The input port is used to the smooth blending image being transferred to the display device.
5. infrared and visible light emerging system as claimed in claim 4, which is characterized in that described image splicer is 4K image
Splicer.
6. as claim 1-2 is described in any item infrared and visible light emerging system, which is characterized in that the infrared optics dress
It is set to thermal infrared imager.
7. as described in claim 1 infrared with visible light emerging system, which is characterized in that the display device be display screen or
Person's display panel.
8. a kind of image fusion device, which is characterized in that described device includes input port, fused controlling device, image stitcher
And output port, in which:
The input port is for receiving visible infrared image and visible images；
The fused controlling device carries out image co-registration for controlling the visible infrared image and the visible images；
Described image splicer obtains light blending image for that will carry out image mosaic by the processed image of fused controlling device；
The input port is used to the smooth blending image being transferred to display device.
9. image fusion device as claimed in claim 8, which is characterized in that described image splicer is 4K image stitcher.
10. image fusion device as claimed in claim 8, which is characterized in that the display device is display screen or display
Panel.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201721929251.3U CN208240087U (en) | 2017-12-30 | 2017-12-30 | A kind of infrared and visible light emerging system and image fusion device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201721929251.3U CN208240087U (en) | 2017-12-30 | 2017-12-30 | A kind of infrared and visible light emerging system and image fusion device |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN208240087U true CN208240087U (en) | 2018-12-14 |
Family
ID=64578828
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201721929251.3U Expired - Fee Related CN208240087U (en) | 2017-12-30 | 2017-12-30 | A kind of infrared and visible light emerging system and image fusion device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN208240087U (en) |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110913116A (en) * | 2019-12-31 | 2020-03-24 | 黑龙江大学 | Small-sized infrared visible light multifunctional fusion camera |
| CN111402134A (en) * | 2020-03-15 | 2020-07-10 | 国科天成（北京）科技有限公司 | Visible/infrared double-light fusion system |
| CN111523401A (en) * | 2020-03-31 | 2020-08-11 | 河北工业大学 | Method for recognizing vehicle type |
| CN111861951A (en) * | 2020-06-01 | 2020-10-30 | 浙江双视红外科技股份有限公司 | Infrared light and visible light based dual-waveband monitoring method, device and system |
| CN112017207A (en) * | 2020-08-31 | 2020-12-01 | 浙江水晶光电科技股份有限公司 | Optical filter counting method and counting device |
| US11830222B2 (en) | 2019-12-17 | 2023-11-28 | Dalian University Of Technology | Bi-level optimization-based infrared and visible light fusion method |
-
2017
- 2017-12-30 CN CN201721929251.3U patent/CN208240087U/en not_active Expired - Fee Related
Cited By (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US11830222B2 (en) | 2019-12-17 | 2023-11-28 | Dalian University Of Technology | Bi-level optimization-based infrared and visible light fusion method |
| CN110913116A (en) * | 2019-12-31 | 2020-03-24 | 黑龙江大学 | Small-sized infrared visible light multifunctional fusion camera |
| CN111402134A (en) * | 2020-03-15 | 2020-07-10 | 国科天成（北京）科技有限公司 | Visible/infrared double-light fusion system |
| CN111402134B (en) * | 2020-03-15 | 2020-12-22 | 国科天成（北京）科技有限公司 | Visible/infrared double-light fusion system |
| CN111523401A (en) * | 2020-03-31 | 2020-08-11 | 河北工业大学 | Method for recognizing vehicle type |
| CN111523401B (en) * | 2020-03-31 | 2022-10-04 | 河北工业大学 | Method for recognizing vehicle type |
| CN111861951A (en) * | 2020-06-01 | 2020-10-30 | 浙江双视红外科技股份有限公司 | Infrared light and visible light based dual-waveband monitoring method, device and system |
| CN111861951B (en) * | 2020-06-01 | 2024-01-23 | 浙江双视科技股份有限公司 | Dual-band monitoring method, device and system based on infrared light and visible light |
| CN112017207A (en) * | 2020-08-31 | 2020-12-01 | 浙江水晶光电科技股份有限公司 | Optical filter counting method and counting device |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN208240087U (en) | A kind of infrared and visible light emerging system and image fusion device | |
| AU2010236651B2 (en) | Vehicle-mountable imaging systems and methods | |
| US11092796B2 (en) | Long range infrared imager systems and methods | |
| US9973692B2 (en) | Situational awareness by compressed display of panoramic views | |
| US6781127B1 (en) | Common aperture fused reflective/thermal emitted sensor and system | |
| Waxman et al. | Solid-state color night vision: fusion of low-light visible and thermal infrared imagery | |
| US7138619B1 (en) | Method and apparatus for coincident viewing at a plurality of wavelengths | |
| Coffey | Multispectral imaging moves into the mainstream | |
| US8824828B1 (en) | Thermal V-curve for fusion image declutter | |
| Krebs et al. | Beyond third generation: a sensor-fusion targeting FLIR pod for the F/A-18 | |
| CN105070204A (en) | Miniature AMOLED optical display | |
| CN113627385A (en) | Method and device for detecting sight direction, detection system and readable storage medium thereof | |
| Toet et al. | Augmenting full colour-fused multi-band night vision imagery with synthetic imagery in real-time | |
| CN107347133A (en) | A kind of dual sensor camera | |
| Toet et al. | The TRICLOBS dynamic multi-band image data set for the development and evaluation of image fusion methods | |
| CN205693765U (en) | It is applied to the panorama infrared viewing device of augmented reality system | |
| US11204508B2 (en) | Multiple band multiple polarizer optical device | |
| CN105872328A (en) | Shooting system | |
| Toet et al. | Portable real-time color night vision | |
| CN207099194U (en) | A kind of dual sensor camera | |
| Hogervorst et al. | Presenting nighttime imagery in daytime colours | |
| KR20230101974A (en) | integrated image providing device for micro-unmanned aerial vehicles | |
| CN205622773U (en) | Portable infrared night -vision appearance | |
| CN205728280U (en) | A kind of helmet-type IR night vision apparatus | |
| Toet et al. | INVIS: integrated night vision surveillance and observation system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| CF01 | Termination of patent right due to non-payment of annual fee | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20181214 Termination date: 20191230 |