CN111161197A - Image registration fusion method of handheld observation instrument - Google Patents
Image registration fusion method of handheld observation instrument Download PDFInfo
- Publication number
- CN111161197A CN111161197A CN201911243731.8A CN201911243731A CN111161197A CN 111161197 A CN111161197 A CN 111161197A CN 201911243731 A CN201911243731 A CN 201911243731A CN 111161197 A CN111161197 A CN 111161197A
- Authority
- CN
- China
- Prior art keywords
- image
- visible light
- observation instrument
- infrared
- handheld
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000007500 overflow downdraw method Methods 0.000 title claims abstract description 11
- 230000004927 fusion Effects 0.000 claims abstract description 5
- 238000003384 imaging method Methods 0.000 claims description 26
- 238000003331 infrared imaging Methods 0.000 claims description 19
- 238000000034 method Methods 0.000 claims description 7
- 238000003672 processing method Methods 0.000 claims description 5
- 230000007246 mechanism Effects 0.000 claims description 4
- 230000008569 process Effects 0.000 claims description 4
- 238000013519 translation Methods 0.000 claims description 2
- 230000003287 optical effect Effects 0.000 abstract description 13
- 238000001514 detection method Methods 0.000 description 2
- 238000010586 diagram Methods 0.000 description 1
- 230000007613 environmental effect Effects 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 238000005259 measurement Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000035515 penetration Effects 0.000 description 1
- 239000000779 smoke Substances 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T5/00—Image enhancement or restoration
- G06T5/50—Image enhancement or restoration using two or more images, e.g. averaging or subtraction
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/80—Analysis of captured images to determine intrinsic or extrinsic camera parameters, i.e. camera calibration
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10048—Infrared image
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Studio Devices (AREA)
- Camera Bodies And Camera Details Or Accessories (AREA)
Abstract
The invention discloses an image registration and fusion method of a handheld observation instrument, which is characterized in that the handheld observation instrument with a combination of two optical devices is fixed on a two-dimensional rotary table, the mechanical structure of an optical path is adjusted, the stability of the optical axes of an infrared optical device and a visible light zooming device is ensured, the optical axis of the visible light zooming device is adjusted to be parallel to the optical axis of the infrared device and not coaxial with the optical axis of the infrared device, and then the image fusion is carried out after the sizes of the images are adjusted to be consistent.
Description
Technical Field
The invention belongs to the technical field of photoelectric observation and measurement, and particularly relates to an image registration and fusion method of a handheld observation instrument.
Background
The existing handheld observation instrument is used for infrared and visible light double-light-path imaging, and different light paths are selected for observation in different scenes. However, under many environmental conditions, the observation by using one optical path alone cannot meet the use requirements of special environments. The visible light imaging resolution is high, the detail information such as the edge texture of the target is clear, the anti-interference capability is strong, and the influence of natural conditions such as weather is easy to happen; the infrared imaging system has the characteristics of smoke penetration, clear main target, capability of working day and night and the like, so that the reliability of tasks such as detection, reconnaissance, identification and the like of the target can be improved by adding a method for registering and fusing visible light and infrared images in the handheld observation instrument.
Disclosure of Invention
In view of this, the invention provides an image registration and fusion method for a handheld viewer, which can perform matching and fusion on a visible light image and an infrared image.
The technical scheme for realizing the invention is as follows:
an image registration and fusion method of a handheld observation instrument comprises the following steps:
firstly, fixing a handheld observation instrument on a two-dimensional turntable, externally connecting the handheld observation instrument with a monitor, and displaying an infrared imaging device image or a visible light imaging device image of the handheld observation instrument by switching the monitor;
placing a collimator in front of the handheld observation instrument, and simulating a target at infinite distance by using a cross cursor in the collimator;
observing a cross cursor of the collimator by using infrared imaging equipment of the handheld observation instrument, and controlling a monitor to display an image of the cross cursor; adjusting the two-dimensional turntable to display the image of the cross cursor observed by the infrared imaging equipment in the center of the monitor screen;
step four, keeping the two-dimensional turntable still, adjusting a zero setting mechanism of the visible light imaging equipment, displaying the image of the cross cursor observed by the visible light imaging equipment in the center of a monitor screen, and finishing mechanical registration of the infrared imaging equipment and the visible light imaging equipment at infinity;
and step five, respectively acquiring an infrared image and a visible light image for the close-range target by using an infrared imaging device and a visible light imaging device, enabling the display sizes of the two images to be consistent through an image processing method, and then carrying out image fusion.
Furthermore, a close-range cross target is arranged right in front of the handheld observation instrument, the focal length of the visible light imaging equipment is sequentially adjusted from small to large, in the focal length adjusting process, the display proportion of the visible light image and the infrared image is recorded, and a lookup table of the proportion relation between the image and the infrared image of the visible light imaging equipment under different focal lengths is obtained, so that the sizes of the two images can be rapidly adjusted to be consistent.
Further, the image processing method includes an image scaling, translation or rotation algorithm.
Has the advantages that:
the invention can match and fuse the visible light image and the infrared image, and can improve the reliability of tasks such as detection, reconnaissance, identification and the like of the target.
Drawings
FIG. 1 is a schematic diagram of the structure of the equipment for implementing the method of the present invention.
Detailed Description
The invention is described in detail below by way of example with reference to the accompanying drawings.
The invention provides an image registration and fusion method of a handheld observation instrument, wherein the handheld observation instrument comprises visible light imaging equipment and infrared imaging equipment, the image registration and fusion method is realized through parallel non-coaxial light paths, the structure is simple, the light energy utilization rate is high, and the image registration is completed through a visible light and infrared optical axis fine adjustment mechanism. The visible light imaging device adopts a zoom lens; the infrared imaging device adopts a fixed-focus lens; a schematic of a handheld viewer device is shown in fig. 1.
The image registration method of the handheld observation instrument combining the visible light equipment and the infrared equipment is characterized in that the double-light equipment is fixed on a two-dimensional debugging rotary table, the mechanical structure of a light path is adjusted, the stability of the optical axes of an infrared optical system and a visible light zooming system is ensured, and the optical axis of the visible light zooming equipment and the optical axis of the infrared equipment are adjusted to be parallel and non-coaxial.
The specific process of the invention is as follows:
firstly, fixing a handheld observation instrument on a two-dimensional turntable, externally connecting the handheld observation instrument with a monitor, and displaying an infrared imaging device image or a visible light imaging device image of the handheld observation instrument by switching the monitor; the focal length of the infrared imaging device is 50mm, and the focal length of the visible light imaging device is 35 mm-80 mm.
Placing a collimator in front of the handheld observation instrument, and simulating a target at infinite distance by using a cross cursor in the collimator;
observing a cross cursor of the collimator by using infrared imaging equipment of the handheld observation instrument, and displaying an image of the cross cursor on a monitor; adjusting the two-dimensional turntable upwards, downwards, leftwards or rightwards to display the image of the cross cursor observed by the infrared imaging equipment in the center of the monitor screen;
step four, keeping the two-dimensional turntable still, adjusting a zero setting mechanism of the visible light imaging equipment, displaying the image of the cross cursor observed by the visible light imaging equipment in the center of a monitor screen, and finishing mechanical registration of the infrared imaging equipment and the visible light imaging equipment at infinity;
and step five, respectively acquiring an infrared image and a visible light image for the close-range target by using an infrared imaging device and a visible light imaging device, enabling the display sizes of the two images to be consistent through an image processing method, and then carrying out image fusion.
A cross target is arranged 20 meters in front of a handheld observation instrument, the focal length of visible light imaging equipment is sequentially adjusted from small to large according to the division value of the focal length of each 5mm, in the focal length adjusting process, the display proportion of a visible light image and an infrared image is recorded, and a lookup table of the proportion relation between the image and the infrared image of the visible light imaging equipment under different focal lengths is obtained, so that the sizes of the two images can be rapidly adjusted to be consistent.
In summary, the above description is only a preferred embodiment of the present invention, and is not intended to limit the scope of the present invention. Any modification, equivalent replacement, or improvement made within the spirit and principle of the present invention should be included in the protection scope of the present invention.
Claims (3)
1. An image registration and fusion method of a handheld observation instrument is characterized by comprising the following steps:
firstly, fixing a handheld observation instrument on a two-dimensional turntable, externally connecting the handheld observation instrument with a monitor, and displaying an infrared imaging device image or a visible light imaging device image of the handheld observation instrument by switching the monitor;
placing a collimator in front of the handheld observation instrument, and simulating a target at infinite distance by using a cross cursor in the collimator;
observing a cross cursor of the collimator by using infrared imaging equipment of the handheld observation instrument, and controlling a monitor to display an image of the cross cursor; adjusting the two-dimensional turntable to display the image of the cross cursor observed by the infrared imaging equipment in the center of the monitor screen;
step four, keeping the two-dimensional turntable still, adjusting a zero setting mechanism of the visible light imaging equipment, displaying the image of the cross cursor observed by the visible light imaging equipment in the center of a monitor screen, and finishing mechanical registration of the infrared imaging equipment and the visible light imaging equipment at infinity;
and step five, respectively acquiring an infrared image and a visible light image for the close-range target by using an infrared imaging device and a visible light imaging device, enabling the display sizes of the two images to be consistent through an image processing method, and then carrying out image fusion.
2. The image registration and fusion method of the handheld observation instrument as claimed in claim 1, wherein a close-range cross target is arranged right in front of the handheld observation instrument, the focal length of the visible light imaging device is adjusted from small to large in sequence, in the process of adjusting the focal length, the display ratio of the visible light image and the infrared image is recorded, and a lookup table of the proportional relationship between the image and the infrared image of the visible light imaging device under different focal lengths is obtained, so as to adjust the sizes of the two images to be consistent.
3. The image registration fusion method of a handheld viewer of claim 1, wherein the image processing method comprises an image scaling, translation or rotation algorithm.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911243731.8A CN111161197A (en) | 2019-12-06 | 2019-12-06 | Image registration fusion method of handheld observation instrument |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911243731.8A CN111161197A (en) | 2019-12-06 | 2019-12-06 | Image registration fusion method of handheld observation instrument |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN111161197A true CN111161197A (en) | 2020-05-15 |
Family
ID=70555698
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201911243731.8A Pending CN111161197A (en) | 2019-12-06 | 2019-12-06 | Image registration fusion method of handheld observation instrument |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111161197A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112367472A (en) * | 2020-11-09 | 2021-02-12 | 杭州视辉科技有限公司 | Method for fusion correction of visible light image and infrared thermal imaging image |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US7652251B1 (en) * | 2008-11-17 | 2010-01-26 | Fluke Corporation | Registration methods for fusing corresponding infrared and visible light images |
| CN102175188A (en) * | 2011-01-24 | 2011-09-07 | 上海理工大学 | Embedded photoelectric auto-collimator based on planar array CMOS (Complementary Metal-Oxide-Semiconductor Transistor) image sensor and operation method thereof |
| CN105423958A (en) * | 2015-12-08 | 2016-03-23 | 中国航空工业集团公司洛阳电光设备研究所 | Multi-optical-axis parallelism detection apparatus and method |
| CN106327424A (en) * | 2016-08-30 | 2017-01-11 | 南京邮电大学 | Correction device and correction method of infrared and visible image registration parameters |
| CN207570500U (en) * | 2017-12-25 | 2018-07-03 | 无锡市星迪仪器有限公司 | Multi-light axis consistency detector |
-
2019
- 2019-12-06 CN CN201911243731.8A patent/CN111161197A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US7652251B1 (en) * | 2008-11-17 | 2010-01-26 | Fluke Corporation | Registration methods for fusing corresponding infrared and visible light images |
| CN102175188A (en) * | 2011-01-24 | 2011-09-07 | 上海理工大学 | Embedded photoelectric auto-collimator based on planar array CMOS (Complementary Metal-Oxide-Semiconductor Transistor) image sensor and operation method thereof |
| CN105423958A (en) * | 2015-12-08 | 2016-03-23 | 中国航空工业集团公司洛阳电光设备研究所 | Multi-optical-axis parallelism detection apparatus and method |
| CN106327424A (en) * | 2016-08-30 | 2017-01-11 | 南京邮电大学 | Correction device and correction method of infrared and visible image registration parameters |
| CN207570500U (en) * | 2017-12-25 | 2018-07-03 | 无锡市星迪仪器有限公司 | Multi-light axis consistency detector |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112367472A (en) * | 2020-11-09 | 2021-02-12 | 杭州视辉科技有限公司 | Method for fusion correction of visible light image and infrared thermal imaging image |
| CN112367472B (en) * | 2020-11-09 | 2022-04-05 | 杭州视辉科技有限公司 | Method for fusion correction of visible light image and infrared thermal imaging image |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106500852B (en) | It is infrared with visible light image registration with the System and method for that merges | |
| CN109238235B (en) | Method for realizing rigid body pose parameter continuity measurement by monocular sequence image | |
| Zhang et al. | Sky light polarization detection with linear polarizer triplet in light field camera inspired by insect vision | |
| CN109348119A (en) | A kind of overall view monitoring system | |
| CN101581874B (en) | Tele-immersion teamwork device based on multi-camera acquisition | |
| JPH06233330A (en) | Display device | |
| CN107274341A (en) | Quick binocular flake Panorama Mosaic method based on fixed splicing parameter | |
| US11972596B2 (en) | Intelligent smog-penetrating optical imaging detection device and use method thereof | |
| CN102681183A (en) | Two-way three-dimensional imaging and naked-eye three-dimensional display system based on lens array | |
| CN107589551A (en) | A kind of multiple aperture polarization imaging device and system | |
| CN103115685A (en) | Infrared multi-detector combined detecting device and infrared detecting method | |
| JP2018033133A (en) | Method and apparatus for generating data representative of bokeh associated with light-field data | |
| CN106842542A (en) | A kind of telescopic system of pure optics and digital seamless switching | |
| Penczek et al. | 31‐2: Measuring Interocular Geometric Distortion of Near‐Eye Displays | |
| CN110376725B (en) | Fisheye lens system | |
| CN111161197A (en) | Image registration fusion method of handheld observation instrument | |
| CN103983608A (en) | Method for measuring glass bead refractive index through imaging process | |
| CN205176477U (en) | 3D looks around imaging system | |
| CN116381903A (en) | AR detects camera lens | |
| CN110086969A (en) | A kind of multi-angle image imaging device and imaging method for three-dimensionalreconstruction | |
| CN107764244A (en) | A kind of black light localization method based on video image | |
| CN103744165B (en) | special underwater imaging wide-angle lens | |
| CN109884776A (en) | Big visual field, low distortion EO-1 hyperion optical system based on Pixel-level optical filter | |
| CN207868716U (en) | A kind of laser block removing equipment | |
| CN107222689B (en) | Real scene switching method and device based on VR (virtual reality) lens |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WD01 | Invention patent application deemed withdrawn after publication | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20200515 |