CN101144740A - High-altitude infrared imaging method based on multi-element surface array splicing - Google Patents

High-altitude infrared imaging method based on multi-element surface array splicing Download PDF

Info

Publication number
CN101144740A
CN101144740A CNA2007100403996A CN200710040399A CN101144740A CN 101144740 A CN101144740 A CN 101144740A CN A2007100403996 A CNA2007100403996 A CN A2007100403996A CN 200710040399 A CN200710040399 A CN 200710040399A CN 101144740 A CN101144740 A CN 101144740A
Authority
CN
China
Prior art keywords
image
splicing
int
imaging
infrared
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CNA2007100403996A
Other languages
Chinese (zh)
Other versions
CN100498248C (en
Inventor
于龙
王建宇
舒嵘
毛闵军
毛洁娜
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shanghai Institute of Technical Physics of CAS
Original Assignee
Shanghai Institute of Technical Physics of CAS
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shanghai Institute of Technical Physics of CAS filed Critical Shanghai Institute of Technical Physics of CAS
Priority to CNB2007100403996A priority Critical patent/CN100498248C/en
Publication of CN101144740A publication Critical patent/CN101144740A/en
Application granted granted Critical
Publication of CN100498248C publication Critical patent/CN100498248C/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Landscapes

  • Radiation Pyrometers (AREA)
  • Transforming Light Signals Into Electric Signals (AREA)

Abstract

The invention discloses an altitude infrared imaging method based on a multi-element area array splicing. An area array picture frame type imaging is adopted, a large breadth is gained through the object space scan on the passing rail direction of a swing mirror, the swing mirror works in a scanning and gazing imaging mode, the infrared area array detector images by exposure when the swing mirror is at the gazing position, the overlapping ratio between two adjacent images is kept 10 percent and above, the splicing of the adjacent images adopts the measure algorithm of the correlation function in image matching, and the seamless splicing of the images is ensured. The imaging method improves the integration time of the system, and efficiently improves the sensibility of the infrared system, and the picture frame type imaging solves the severe distortion of the image caused by the posture affection of a plane. The invention solves the technological problems of the high resolution, the large breadth, and the high sensitivity of an altitude on-board infrared camera.

Description

High-altitude infrared imaging method based on multi-element surface array splicing
Technical field
The present invention relates to high-altitude Airborne IR camera remotely sensed image method, specifically be meant the formation method that adopts multi-element surface array splicing.
Background technology
Infrared camera mainly contains three kinds of imaging modes, as shown in Figure 1:
Shake the mode of sweeping: detector adopts unit component, and the imaging of wearing the rail direction is realized that by scanning mechanism the motion of aircraft then realizes along the imaging of rail direction.This mode can realize big view field imaging, detector pixel minimum number.But owing to adopt object space mechanical scanning, volume is big, and the pixel residence time is short, is unfavorable for improving the detection sensitivity of system.
Push away the mode of sweeping: detector adopts multicomponent device (face battle array or linear array), wears the rail direction by the imaging simultaneously of a plurality of pixels, is finished by moving of aircraft along the imaging of rail direction.Owing to adopt the scanning of picture side, there is not mechanical scanning mechanism, system bulk is little, in light weight, and the pixel residence time is long, helps improving the detection sensitivity of system.Shortcoming is to cut secondary width and spatial resolution when higher, needs the optical system of high-resolution sensitive detection parts and big visual field, and system is difficult to realize.
Polynary and the formula of sweeping claims mixed type scanning again: be between a kind of light spectrum image-forming mode of shaking between the formula of sweeping and the push-broom type.Detector adopts multicomponent device, what be different from push-broom type is that the multiunit detector imaging is not to wear the rail direction but along the imaging simultaneously of rail direction, it is once inswept to be that the rail direction is worn on the every edge of scanning mechanism, and detector n pixel will be simultaneously along wearing the parallel inswept n band of rail direction.Its advantage is in the big detection sensitivity that can effectively improve system under the secondary width of cutting.Shortcoming is to be subjected to aspect to influence image to produce distortion.
These three kinds of imaging modes are ripe technically, can satisfy the needs of infrared system design in certain application, but under high-altitude high sensitivity and the requirement of wide visual field, can not satisfy the requirement of system design.
Summary of the invention
The purpose of this invention is to provide a kind of high-altitude Airborne IR camera imaging method based on multi-element surface array splicing, the scanning form of this method adopts oscillatory scanning, detector adopts the multi-element surface array infrared focal plane detector, solved by multi-element surface array and surveyed the seamless spliced of imaging, reached the requirement of high sensitivity, high spatial resolution and the big fabric width of high-altitude infrared imaging.
A kind of high-altitude Airborne IR camera imaging method based on multi-element surface array splicing, its step comprises: wearing the rail direction, adopt the scanning of 45 ° of pendulum mirrors, system optics observation visual field covers a sweep trace from left to right, when motor-driven pendulum mirror swings to when staring the position, face battle array infrared focal plane detector begins exposure image, end exposure is read and is write down frame data by electronic system, finish an imaging cycle, wait for that motor movement restarts to expose and signal is read to frame position down, overlapping 10% between the consecutive frame, to guarantee the seamless spliced of under the unstable condition of aspect ground image.
The splicing of consecutive frame image is adopted the related function in the image coupling to estimate algorithm, mutual select target point and point to be matched and is discerned same place.Same place is the same unique point in adjacent two width of cloth doubling of the image zones.Concrete grammar is as follows:
A. determine earlier in preceding piece image that a point to be located is an impact point, with this put be the center select the individual pixel of m * n (getting m=n) the gray scale array as target area D, gray matrix is G (g I, j) (i=1,2 ..., m; J=1,2 ..., n), m and n are odd number, the gray scale function corresponding with G is g (x, y) ((x, y) ∈ D);
B. estimate the scope that same place may exist, to be the center with the mutual point of selecting to be matched of mouse, the gray scale array of setting up the individual pixel in k * 1 (k〉m, 1〉n) is as field of search D ' in the piece image of back, gray matrix be G ' (g ' I, j) (i=1,2 ..., k; J=1,2 ..., 1), k and 1 also is an odd number, the gray scale function corresponding with G ' is g ' (x ', y ') ((x ', y ') ∈ D '); The sub-piece of the capable n row of any one m among the G ', promptly search window is designated as: G ' R, c=(g ' I+r, j+c) (i=1,2 ..., m; J=1,2 ..., n;
r=int(m/2)+1,int(m/2)+2,…,k-int(m/2);c=int(n/2)+1,int(n/2)+2,…,1-int(n/2))。
C. the estimation formulas of discrete gradation data pair correlation function is:
R ( c , r ) = Σ i = 1 m Σ j = 1 n g i , j g i + r , j + c ′ , - - - ( 3 )
If R (c 0, r 0) R (c, r) (r ≠ r 0, c ≠ c 0), c then 0And r 0Be the row, column parameter of field of search image with respect to the target area blurring, the center pixel of search window is considered to same place.
Image rectification and the splicing of location, overlapping region:
Right simplification is closed and is based on adjacent two width of cloth image slices of affined transformation:
X 2 = a 0 + a 1 x 1 + a 2 y 1 y 2 = b 0 + b 1 X 1 + b 2 y 1 , - - ( 4 )
The relative position orientation of adjacent two width of cloth images is determined by 6 parameters in the formula (4), by discerning 3 unique points of the same name of two width of cloth images, tries to achieve this 6 transformation parameters, just can transform to the back piece image in the image space coordinate system of preceding piece image.Weave into software according to above-mentioned consecutive frame image split-joint method and be stored in the computing machine, carry out the later stage pre-service and the correction of image, finish the splicing of each two field picture by software.
The invention has the advantages that: employing face battle array staring imaging, improved the detector integrates time, system guarantees high-temperature sensitivity in high spatial resolution; It is minimum that the scalloping that the imaging of picture formula is introduced aspect reaches; Make system can reach big observation visual field more than 45 ° by pendulum mirror scanning; Overlapping 10% between the consecutive frame, to guarantee the seamless spliced of under the unstable condition of aspect ground image.
Description of drawings
Fig. 1 is existing three kinds of imaging mode synoptic diagram;
Fig. 2 is an imaging mode principle schematic of the present invention;
Fig. 3 is pendulum mirror motion angular velocity curve map;
Fig. 4 is pendulum mirror movement position curve map;
Fig. 5 is a camera optics system equivalence index path;
Fig. 6 is the image mosaic software flow pattern.
Embodiment
Below in conjunction with drawings and Examples a kind of high-altitude Airborne IR camera imaging method based on multi-element surface array splicing of the present invention is described in further detail:
The concrete parameter of infrared camera is as follows:
Total visual field: 45 °;
Flying height: 12,000~20,000 meter high-altitude;
Pixel number: 320 * 256 yuan;
Instantaneous field of view: 0.1mrad;
Wave band: 3~5um;
Temperature control: be better than 0.1K;
Optical system bore: 100mm.
1. pendulum mirror 1 adopts the almag metallic mirror, is driven by high-precision motor, finishes the spacescan of camera instantaneous field of view.Angular scanning speed curve such as Fig. 3 of pendulum mirror, position curve such as Fig. 4 of pendulum mirror.Pendulum mirror drive motor adopts brush DC swing angle electric (Cambridge Technology, the Model 6900 of Inc), and pendulum angle is ± 11.25 °.
2. optical system adopts the Cassegrain telescope mode, and optical system as shown in Figure 5.Primary mirror 3 and secondary mirror 2 are non-spherical reflector, and the silver-plated reflectance coating of minute surface is to improve the optical efficiency of system.
3. detector is selected SOFRADIR company 320 * 256 focal plane HgCdTe devices in the detector assembly 4, and response wave length is 3~5 μ m, and the pixel number is 320 * 256 yuan, and photosensitive elemental size is 30 μ m * 30 μ m, and detectivity is greater than 1 * 10 11CmHz 1/2W -1, working temperature is 77K~90K, the supporting IDTL061 sterlin refrigerator of sterlin refrigerator apolegamy SOFRADIR company.Above-mentioned infrared camera parameter is to be used for illustrating feature of the present invention, technical feature and functional characteristics, but not is used for limiting the scope of the invention.
Adopt the inventive method in the laboratory simulation imaging, to obtain test findings preferably.

Claims (2)

1. the high-altitude infrared imaging method based on multi-element surface array splicing is characterized in that comprising the steps:
Wearing the rail direction, adopt the scanning of 45 ° of pendulum mirrors, system optics observation visual field covers a sweep trace from left to right, when motor-driven pendulum mirror swings to when staring the position, face battle array infrared focal plane detector begins exposure image, and end exposure is read and write down frame data by electronic system, finish an imaging cycle, wait for that motor movement restarts exposure and signal is read to frame position down, overlapping 10% between the consecutive frame image, to guarantee the seamless spliced of under aspect shakiness condition ground image.
2. according to a kind of high-altitude infrared imaging method based on multi-element surface array splicing of claim 1, it is characterized in that: the splicing of said consecutive frame image is adopted the related function in the image coupling to estimate algorithm, mutual select target point and point to be matched and is discerned same place; Same place is the same unique point in adjacent two width of cloth doubling of the image zones, and concrete grammar is as follows:
A. determine earlier in preceding piece image that a point to be located is an impact point, with this put be the center select the individual pixel of m * n (getting m=n) the gray scale array as target area D, gray matrix is G (g I, j) (i=1,2 ..., m; J=1,2 ..., n), m and n are odd number, the gray scale function corresponding with G is g (x, y) ((x, y) ∈ D);
B. estimate the scope that same place may exist, in the piece image of back to be the center with the mutual point of selecting to be matched of mouse, set up a k * l (k>m, the gray scale array of the individual pixel of l>n) be as field of search D ', gray matrix be G ' (g ' I, j) (i=1,2 ..., k; J=1,2 ..., l), k and l also are odd number, the gray scale function corresponding with G ' is g ' (x ', y ') ((x ', y ') ∈ D '); The sub-piece of the capable n row of any one m among the G ', promptly search window is designated as: G ' R, c=(g ' I+r, j+c) (i=1,2 ..., m; J=1,2 ..., n; R=int (m/2)+1, int (m/2)+2 ..., k-int (m/2); C=int (n/2)+1, int (n/2)+2 ..., l-int (n/2));
C. the estimation formulas of discrete gradation data pair correlation function is:
R ( c , r ) = Σ i = 1 m Σ j = 1 n g i , j g ′ i + r , j + c - - - ( 3 )
If R (c 0, r 0)>R (c, r) (r ≠ r 0, c ≠ c 0), c then 0And r 0Be the row, column parameter of field of search image with respect to the target area blurring, the center pixel of search window is considered to same place;
Image rectification and the splicing of location, overlapping region:
Right simplification is closed and is based on adjacent two width of cloth image slices of affined transformation:
x 2 = a 0 + a 1 x 1 + a 2 y 1 y 2 = b 0 + b 1 x 1 + b 2 y 1 , - - - ( 4 )
The relative position orientation of adjacent two width of cloth images is determined by 6 parameters in the formula (4), by discerning 3 unique points of the same name of two width of cloth images, tries to achieve this 6 transformation parameters, just can transform to the back piece image in the image space coordinate system of preceding piece image;
Above-mentioned consecutive frame image split-joint method is weaved into software and is stored in the computing machine, carries out the later stage pre-service and the correction of image by software, finishes the splicing of each two field picture.
CNB2007100403996A 2007-05-08 2007-05-08 High-altitude infrared imaging method based on multi-element surface array splicing Expired - Fee Related CN100498248C (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CNB2007100403996A CN100498248C (en) 2007-05-08 2007-05-08 High-altitude infrared imaging method based on multi-element surface array splicing

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CNB2007100403996A CN100498248C (en) 2007-05-08 2007-05-08 High-altitude infrared imaging method based on multi-element surface array splicing

Publications (2)

Publication Number Publication Date
CN101144740A true CN101144740A (en) 2008-03-19
CN100498248C CN100498248C (en) 2009-06-10

Family

ID=39207379

Family Applications (1)

Application Number Title Priority Date Filing Date
CNB2007100403996A Expired - Fee Related CN100498248C (en) 2007-05-08 2007-05-08 High-altitude infrared imaging method based on multi-element surface array splicing

Country Status (1)

Country Link
CN (1) CN100498248C (en)

Cited By (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101846752A (en) * 2010-06-03 2010-09-29 北京理工大学 Single wave beam scanning imaging method of passive THz wave imaging system
CN102096274A (en) * 2010-11-26 2011-06-15 中国科学院上海技术物理研究所 High-precision fine tuning method for large-scale planar array spliced focal plane
CN102710905A (en) * 2012-05-31 2012-10-03 中国科学院长春光学精密机械与物理研究所 Adjusting method of drift angles of plurality of TDI (Time Delayed and Integration)-CCD (Charge Coupled Device) cameras spliced in staggered manner
CN102708546A (en) * 2012-05-09 2012-10-03 中国科学院上海技术物理研究所 Common-light path multi-module spliced focal plane image non-uniformity correction method
CN103455992A (en) * 2013-09-11 2013-12-18 中国科学院电子学研究所 Method for splicing aviation multi-pixel parallel scanning images
CN104331872A (en) * 2014-11-26 2015-02-04 中测新图(北京)遥感技术有限责任公司 Image splicing method
CN106097249A (en) * 2016-06-21 2016-11-09 中国科学院电子学研究所 A kind of diameter radar image anastomosing and splicing method and device
CN106291583A (en) * 2016-10-11 2017-01-04 中国人民解放军陆军军官学院 A kind of transversal scanning synthetic method of big angular distance strobed laser imaging
CN107356338A (en) * 2017-05-27 2017-11-17 中国科学院上海技术物理研究所 A kind of the infrared remote sensing imaging device and method of big breadth high temperature sensitivity
CN108007578A (en) * 2017-12-06 2018-05-08 中国科学院上海技术物理研究所 A kind of infrared large area array multimode automatic Mosaic mechanism
CN110192845A (en) * 2019-05-09 2019-09-03 广州番禺职业技术学院 A kind of live pig apparatus for testing body temperature and system

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN2452013Y (en) * 2000-12-08 2001-10-03 北京市光电子技术应用研究所王奇志 Infrared thermal imaging instrument optical apparatus
JP4206978B2 (en) * 2004-07-07 2009-01-14 日産自動車株式会社 Infrared imaging device and vehicle

Cited By (18)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101846752B (en) * 2010-06-03 2013-10-16 北京理工大学 Single wave beam scanning imaging method of passive THz wave imaging system
CN101846752A (en) * 2010-06-03 2010-09-29 北京理工大学 Single wave beam scanning imaging method of passive THz wave imaging system
CN102096274A (en) * 2010-11-26 2011-06-15 中国科学院上海技术物理研究所 High-precision fine tuning method for large-scale planar array spliced focal plane
CN102708546A (en) * 2012-05-09 2012-10-03 中国科学院上海技术物理研究所 Common-light path multi-module spliced focal plane image non-uniformity correction method
CN102710905A (en) * 2012-05-31 2012-10-03 中国科学院长春光学精密机械与物理研究所 Adjusting method of drift angles of plurality of TDI (Time Delayed and Integration)-CCD (Charge Coupled Device) cameras spliced in staggered manner
CN103455992A (en) * 2013-09-11 2013-12-18 中国科学院电子学研究所 Method for splicing aviation multi-pixel parallel scanning images
CN103455992B (en) * 2013-09-11 2015-12-23 中国科学院电子学研究所 The method of splicing aviation multi-element scanning image
CN104331872B (en) * 2014-11-26 2017-06-30 中测新图(北京)遥感技术有限责任公司 Image split-joint method
CN104331872A (en) * 2014-11-26 2015-02-04 中测新图(北京)遥感技术有限责任公司 Image splicing method
CN106097249A (en) * 2016-06-21 2016-11-09 中国科学院电子学研究所 A kind of diameter radar image anastomosing and splicing method and device
CN106097249B (en) * 2016-06-21 2019-09-17 中国科学院电子学研究所 A kind of diameter radar image anastomosing and splicing method and device
CN106291583A (en) * 2016-10-11 2017-01-04 中国人民解放军陆军军官学院 A kind of transversal scanning synthetic method of big angular distance strobed laser imaging
CN106291583B (en) * 2016-10-11 2020-04-07 中国人民解放军陆军军官学院 Transverse scanning synthesis method for large-visual-angle distance gating laser imaging
CN107356338A (en) * 2017-05-27 2017-11-17 中国科学院上海技术物理研究所 A kind of the infrared remote sensing imaging device and method of big breadth high temperature sensitivity
CN108007578A (en) * 2017-12-06 2018-05-08 中国科学院上海技术物理研究所 A kind of infrared large area array multimode automatic Mosaic mechanism
CN108007578B (en) * 2017-12-06 2023-07-04 中国科学院上海技术物理研究所 Automatic splicing mechanism for infrared large-area array multi-module
CN110192845A (en) * 2019-05-09 2019-09-03 广州番禺职业技术学院 A kind of live pig apparatus for testing body temperature and system
CN110192845B (en) * 2019-05-09 2021-10-01 广州番禺职业技术学院 Live pig body temperature detection device and system

Also Published As

Publication number Publication date
CN100498248C (en) 2009-06-10

Similar Documents

Publication Publication Date Title
CN100498248C (en) High-altitude infrared imaging method based on multi-element surface array splicing
AU2009200781B2 (en) Airborne reconnaissance system
CN102564589B (en) Spectral characteristic detection identification method for multi-wave-band moving objects and device thereof
US10401872B2 (en) Method and system for collision avoidance
EP2375755B1 (en) Apparatus for detecting direction of image pickup device and moving body comprising same
US7308342B2 (en) Airborne reconnaissance system
US20140320607A1 (en) Multifunctional Sky Camera System for Total Sky Imaging and Spectral Radiance Measurement
US20030081952A1 (en) Method and apparatus for omnidirectional three dimensional imaging
US8937639B2 (en) Interlaced focal plane array for wide-area surveillance
CN105045275B (en) A kind of IMC method of the IMC structure based on the tracking of the real-time optical axis
CN108037499A (en) A kind of photoelectricity millimeter wave three-dimensional search tracks of device and method
CN108008375A (en) A kind of photoelectricity millimeter wave searching/tracking apparatus and method
CN109559293A (en) A kind of step-by-step movement whole day domain scanning searcher and method
CN102053475A (en) Single camera based omnibearing stereo vision system
CN107741273B (en) Wide-width wide-spectrum long-wave infrared hyperspectral imaging system based on line detector
CN205563715U (en) Miniaturized panorama optical search tracking means
US8928750B2 (en) Method for reducing the number of scanning steps in an airborne reconnaissance system, and a reconnaissance system operating according to said method
EP2948808A1 (en) Environment monitoring device
CN207280595U (en) Wide cut wide range LONG WAVE INFRARED Hyperspectral imager based on detector array
CN1458535A (en) Active laser scanning far distance coordinate detecting method
CN214334007U (en) Staring type hyperspectral camera based on scanning galvanometer
CN108917928A (en) A kind of 360 degree of panorama multi-spectral imagers
Serruys et al. Linear variable filters—A camera system requirement analysis for hyperspectral imaging sensors onboard small Remotely Piloted Aircraft Systems
RU2729516C1 (en) Method for increasing permeable force of astronomical observations of meteors and device for its implementation on a meteoric camera
Habib et al. Quality Assurance and Quality Control of Remote Sensing Systems

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant
C17 Cessation of patent right
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20090610

Termination date: 20140508