CN113610695A - Infrared telescope full-frame imaging output method and system - Google Patents
Infrared telescope full-frame imaging output method and system Download PDFInfo
- Publication number
- CN113610695A CN113610695A CN202110792408.7A CN202110792408A CN113610695A CN 113610695 A CN113610695 A CN 113610695A CN 202110792408 A CN202110792408 A CN 202110792408A CN 113610695 A CN113610695 A CN 113610695A
- Authority
- CN
- China
- Prior art keywords
- infrared
- target
- full
- image
- imaging
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000003384 imaging method Methods 0.000 title claims abstract description 89
- 238000000034 method Methods 0.000 title claims abstract description 40
- 238000012937 correction Methods 0.000 claims abstract description 47
- 238000003331 infrared imaging Methods 0.000 claims abstract description 22
- 230000004927 fusion Effects 0.000 claims abstract description 13
- 239000011521 glass Substances 0.000 claims abstract description 10
- 238000013136 deep learning model Methods 0.000 claims description 20
- 230000003595 spectral effect Effects 0.000 claims description 19
- 238000004891 communication Methods 0.000 claims description 15
- 230000004044 response Effects 0.000 claims description 14
- 230000013016 learning Effects 0.000 claims description 12
- 238000007499 fusion processing Methods 0.000 claims description 10
- 238000004458 analytical method Methods 0.000 claims description 9
- 238000002372 labelling Methods 0.000 claims description 7
- 238000012545 processing Methods 0.000 claims description 6
- 238000005057 refrigeration Methods 0.000 claims description 6
- 238000013528 artificial neural network Methods 0.000 claims description 4
- 238000001914 filtration Methods 0.000 claims description 4
- 238000013527 convolutional neural network Methods 0.000 claims description 2
- 238000005259 measurement Methods 0.000 claims description 2
- 230000000694 effects Effects 0.000 description 4
- 239000004973 liquid crystal related substance Substances 0.000 description 3
- 239000000463 material Substances 0.000 description 3
- 241001465754 Metazoa Species 0.000 description 2
- 238000013135 deep learning Methods 0.000 description 2
- 238000012549 training Methods 0.000 description 2
- 206010070834 Sensitisation Diseases 0.000 description 1
- 238000004026 adhesive bonding Methods 0.000 description 1
- 230000003321 amplification Effects 0.000 description 1
- 239000003086 colorant Substances 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 230000008030 elimination Effects 0.000 description 1
- 238000003379 elimination reaction Methods 0.000 description 1
- 238000013507 mapping Methods 0.000 description 1
- 238000003199 nucleic acid amplification method Methods 0.000 description 1
- 230000008707 rearrangement Effects 0.000 description 1
- 230000008313 sensitization Effects 0.000 description 1
- 238000001228 spectrum Methods 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T1/00—General purpose image data processing
- G06T1/0007—Image acquisition
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01V—GEOPHYSICS; GRAVITATIONAL MEASUREMENTS; DETECTING MASSES OR OBJECTS; TAGS
- G01V8/00—Prospecting or detecting by optical means
- G01V8/10—Detecting, e.g. by using light barriers
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T5/00—Image enhancement or restoration
- G06T5/50—Image enhancement or restoration using two or more images, e.g. averaging or subtraction
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T5/00—Image enhancement or restoration
- G06T5/80—Geometric correction
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T5/00—Image enhancement or restoration
- G06T5/90—Dynamic range modification of images or parts thereof
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01J—MEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
- G01J5/00—Radiation pyrometry, e.g. infrared or optical thermometry
- G01J2005/0077—Imaging
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10048—Infrared image
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/20—Special algorithmic details
- G06T2207/20212—Image combination
- G06T2207/20221—Image fusion; Image merging
Landscapes
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Life Sciences & Earth Sciences (AREA)
- General Life Sciences & Earth Sciences (AREA)
- Geophysics (AREA)
- Transforming Light Signals Into Electric Signals (AREA)
Abstract
The invention relates to a full-frame imaging output method and a full-frame imaging output system of an infrared telescope, wherein infrared glass lenses with different curvatures and different refractive indexes are arranged on the same axis in the infrared telescope to form an infrared imaging lens, an infrared photosensitive unit is arranged into an uncooled infrared focal plane array to form an infrared detector in the infrared telescope, and the full-frame imaging output method comprises the following steps: the method comprises the steps of infrared ray acquisition, non-uniform correction, target category identification, target ranging, image identification and image fusion. The invention relates to a full-frame imaging output method and a full-frame imaging output system of an infrared telescope.
Description
Technical Field
The invention relates to a full-frame imaging output method and a full-frame imaging output system, in particular to a full-frame imaging output method and a full-frame imaging output system of an infrared telescope.
Background
An infrared telescope is a device for imaging and displaying scenery by using infrared light emitted or reflected by the scenery. Because the object that has the temperature can both outwards radiate infrared light, consequently, infrared telescope can not only be used daytime, also can obtain clear image through the infrared light that the scenery sent at dark night. The portable infrared telescope integrates the infrared telescope and the power supply equipment thereof into a small-volume space, is convenient for a user to carry, can flexibly select an observation target without depending on an external support, and is commonly used in the fields of outdoor outing, field hunting, police reconnaissance and the like. The existing infrared telescope can not analyze and understand the target of the full-width image in the visual field of the telescope and can not analyze and label the target in real time. Meanwhile, the endurance of the existing infrared telescope equipment is also a key factor influencing user experience, how to reduce the power consumption of the product and increase the use endurance of the equipment is also a design difficulty of the portable infrared telescope.
Disclosure of Invention
The technical problem solved by the invention is as follows: an infrared telescope full-frame imaging output method and system are constructed, and the technical problems that the infrared telescope in the prior art cannot analyze and label a target in real time and the target can be analyzed and understood are solved.
The technical scheme of the invention is as follows: the method for constructing the full-frame imaging output of the infrared telescope comprises the following steps of:
acquiring infrared light: the infrared imaging lens converges infrared rays in a spectral region onto an uncooled infrared focal plane array of the infrared detector;
generating a digital signal: the infrared light sensing unit absorbs light rays converged on the uncooled infrared focal plane array so as to generate a changed voltage signal, and a signal circuit in the infrared detector converts the array voltage signal of the uncooled infrared focal plane array into a digital signal;
non-uniformity correction: adopting an ARM processor module to carry out non-uniform correction on the array digital signals of the infrared detector so as to correct the temperature response rate of the photosensitive unit of the infrared detector;
identifying a target class: carrying out full-frame analysis on a scene in a spectral region, and identifying the target type of an imaging target in the scene;
target ranging: calculating the distance between the current imaging target and an observer according to the size of the pixel occupied by the target category in the scene;
image identification: forming a target distance identifier from the acquired target distance of the current imaging target;
image fusion: and fusing the target distance identifier with an imaging target in the infrared image, wherein in the fusion process, the imaging target and the target distance identifier are correspondingly fused to form a fused infrared video image.
The further technical scheme of the invention is as follows: in the step of identifying the target category, a deep learning model of a full convolution neural network is established through supervised learning of the infrared image label sample, and the deep learning model is applied to realize identification of the category of the target in the full-width infrared image.
The further technical scheme of the invention is as follows: the method comprises the steps of acquiring infrared images of various target objects, manually labeling the types and regression frames of the targets in the infrared images, using the labeled samples as label samples for supervised learning, so as to construct a deep learning model of the infrared image targets, and distinguishing target areas and target types in a full-width image through the deep learning model of the infrared image targets.
The further technical scheme of the invention is as follows: labeling the target category.
The further technical scheme of the invention is as follows: and performing infrared image enhancement processing on one or more processing modes of gamma correction, dynamic histogram stretching, filtering and the like on the image signal after the non-uniformity correction.
The further technical scheme of the invention is as follows: and the non-uniformity correction adopts one or more algorithms of single-point correction, two-point correction and multi-point correction to carry out non-uniformity correction on the array digital signals of the infrared detector.
The technical scheme of the invention is as follows: the full-frame imaging output system of the infrared telescope is constructed and comprises an infrared imaging lens, an infrared detector and an ARM processor unit, wherein the ARM processor unit comprises a non-uniform correction module, a target category identification module, a target distance measurement module, an image identification module and an image fusion module, the infrared imaging lens is formed by arranging infrared glass lenses with different curvatures and different refractive indexes on the same axis in the infrared telescope, the infrared detector is formed by arranging an infrared photosensitive unit into a non-refrigeration infrared focal plane array in the infrared telescope, and the infrared imaging lens converges infrared rays in a spectral region onto the non-refrigeration infrared focal plane array of the infrared detector; an infrared light sensing unit of the infrared detector absorbs light rays converged on the uncooled infrared focal plane array so as to generate a changed voltage signal, and a signal circuit in the infrared detector converts the array voltage signal of the uncooled infrared focal plane array into a digital signal; the non-uniformity correction module adopts an ARM processor unit to carry out non-uniformity correction on the array digital signals of the infrared detector so as to correct the temperature response rate of the photosensitive unit of the infrared detector; the target type identification module performs full-frame analysis on a scene in a spectral region to identify the target type of an imaging target in the scene; the target ranging module calculates the distance between the current imaging target and an observer according to the size of the pixel occupied by the target category in the scene; the image identification module forms an object distance identification by the acquired object distance of the current imaging object; and the image fusion module fuses the target distance identifier and an imaging target in the infrared image, and in the fusion process, the imaging target and the target distance identifier are correspondingly fused to form a fused infrared video image.
The further technical scheme of the invention is as follows: the display output unit is used for outputting infrared video images.
The further technical scheme of the invention is as follows: the display device further comprises an interface management unit, wherein the interface management unit is used for managing the receiving of the infrared detector signals, the receiving of the I/O signals of the key module and the data output to the display output unit.
The further technical scheme of the invention is as follows: and the target category identification module carries out supervised learning on the acquired full-width infrared image through a deep learning model of a full convolutional neural network, and labels the category of the target in the image.
The further technical scheme of the invention is as follows: the mobile terminal further comprises a near field communication module, and the near field communication module is in near field wireless communication with the mobile terminal.
The further technical scheme of the invention is as follows: the device also comprises one or more of a GPS positioning module and a Beidou positioning module.
The invention has the technical effects that: the method and the system for constructing the full-frame imaging output of the infrared telescope are characterized in that infrared glass lenses with different curvatures and different refractive indexes are arranged on the same axis in the infrared telescope to form an infrared imaging lens, an infrared photosensitive unit is arranged into an uncooled infrared focal plane array to form an infrared detector in the infrared telescope, and the method comprises the following steps: acquiring infrared light: the infrared imaging lens converges infrared rays in a spectral region onto an uncooled infrared focal plane array of the infrared detector; generating a digital signal: the infrared light sensing unit absorbs light rays converged on the uncooled infrared focal plane array so as to generate a changed voltage signal, and a signal circuit in the infrared detector converts the array voltage signal of the uncooled infrared focal plane array into a digital signal; non-uniformity correction: adopting an ARM processor module to carry out non-uniform correction on the array digital signals of the infrared detector so as to correct the temperature response rate of the photosensitive unit of the infrared detector; identifying a target class: carrying out full-frame analysis on a scene in a spectral region, and identifying the target type of an imaging target in the scene; target ranging: calculating the distance between the current imaging target and an observer according to the size of the pixel occupied by the target category in the scene; image identification: forming a target distance identifier from the acquired target distance of the current imaging target; image fusion: and fusing the target distance identifier with an imaging target in the infrared image, wherein in the fusion process, the imaging target and the target distance identifier are correspondingly fused to form a fused infrared video image. The invention relates to a full-frame imaging output method and a full-frame imaging output system of an infrared telescope.
Drawings
FIG. 1 is a schematic structural diagram of the present invention.
Detailed Description
The technical solution of the present invention is further illustrated below with reference to specific examples.
The specific implementation mode of the invention is as follows: the full-frame imaging output method of the infrared telescope is constructed, and the infrared telescope comprises an infrared imaging lens, an infrared detector, an ARM processor unit, a display output unit, a key module and a battery module. The infrared imaging lens is characterized in that infrared glass lenses with different curvatures and different refractive indexes are arranged on the same axis, and infrared rays in a spectrum region are converged on a focal plane simultaneously in an independent or gluing assembly mode. The photosensitive unit of the infrared detector is an uncooled infrared focal plane array, a microbridge structure formed by thermosensitive materials is distributed on the uncooled infrared focal plane array, light converged on the uncooled infrared focal plane can be absorbed to cause the change of self resistance value, so that a changed voltage signal is generated, and the array signal is converted into a digital signal with 8-16 bit depth through an integral amplification circuit and a reading circuit which are arranged in the infrared detector. The ARM processor unit comprises a low-power ARM processor module, the low-power ARM processor module is a hardware circuit module developed based on the low-power ARM processor, is provided with an electrical interface connected with the infrared detector, can receive digital signals of the infrared detector, obtains high-image-quality infrared video images through image processing software, and outputs the high-image-quality infrared video images to an electrical interface of the display output module.
An infrared telescope full-frame imaging output method comprises the following steps:
acquiring infrared light: the infrared imaging lens converges infrared light in a spectral region onto an uncooled infrared focal plane array of the infrared detector.
The specific implementation process is as follows: the infrared imaging lens converges infrared rays in a spectral region onto an uncooled infrared focal plane array of the infrared detector through infrared glass lenses with different curvatures and different refractive indexes.
Generating a digital signal: thereby infrared sensitization unit absorbs the light that assembles on the uncooled infrared focal plane array and produces the voltage signal of change, signal circuit among the infrared detector converts uncooled infrared focal plane array's array voltage signal into digital signal.
The specific implementation process is as follows: a microbridge structure formed by thermosensitive materials is distributed on the uncooled infrared focal plane array, the infrared photosensitive unit absorbs light converged on the uncooled infrared focal plane to cause the change of the resistance value of the infrared photosensitive unit, so that a changed voltage signal is generated, and the array signal is converted into a digital signal with the bit depth of 8-16 through an integral amplifying circuit and a reading circuit which are arranged in the infrared detector.
Non-uniformity correction: and carrying out non-uniform correction on the array digital signals of the infrared detector by adopting an ARM processor module so as to correct the temperature response rate of the photosensitive unit of the infrared detector.
The specific implementation process is as follows: the method comprises the following steps of carrying out non-uniform correction on array digital signals of the infrared detector by adopting an ARM processor module so as to correct the temperature response rate of a photosensitive unit of the infrared detector, wherein the non-uniform correction is carried out on the array digital signals of the infrared detector by adopting one or more algorithms in single-point correction, two-point correction and multi-point correction.
Identifying a target class: and carrying out full-frame analysis on the scene in a spectral region, and identifying the target type of the imaging target in the scene.
The specific implementation process is as follows: acquiring infrared images of various target objects, manually labeling the categories and regression frames of the targets in the infrared images, and using the infrared images as label samples for supervised learning to construct a deep learning model of the infrared image targets; preferably, in the process of supervised learning, the target object is subjected to abundant multi-type infrared image acquisition, and the category and the regression frame of the target in the infrared image are manually labeled to be used as the label sample of the supervised learning. The deep learning model after training can obtain different responses to a foreground target area and a background area in the picture so as to distinguish the target area, and can obtain different responses to different target categories in the picture so as to distinguish the target categories. In the invention, the target category in the full-width infrared image is labeled, the collected infrared image is supervised and learned through a deep learning model of a full-convolution neural network, and a target area and the target category are distinguished in the full-width image through the deep learning model of the infrared image target.
Target ranging: and calculating the distance between the current imaging target and an observer according to the size of the pixel occupied by the target category in the scene.
The specific implementation process is as follows: firstly, presetting the height h of each target class, wherein the preset height h0 is 1.7 m by taking human as an example; secondly, when the deep learning model judges that the target type is a person, calculating the pixel height q of the target person in the picture, namely q is the number of pixels of the target person in the height direction; knowing the focal length f of the lens of the infrared telescope and the pixel size d of the detector, the distance L between the current target person and the observer can be calculated by the following formula:
image identification: and forming a target distance identifier by using the acquired target distance of the current imaging target.
The specific implementation process is as follows: and after the distance between the current imaging target and an observer is acquired, the distance corresponds to the current imaging target, and the distance between the current imaging target and the observer forms a target distance identifier which is identified on the corresponding imaging target.
Image fusion: and fusing the target distance identifier with an imaging target in the infrared image, wherein in the fusion process, the imaging target and the target distance identifier are correspondingly fused to form a fused infrared video image.
The specific implementation process is as follows: and in the generated full-frame infrared image, fusing the target distance identifier with an imaging target in the infrared image, wherein in the fusion process, the imaging target and the target distance identifier are correspondingly fused to form a fused infrared video image.
Preferred embodiments of the present invention are: the method also comprises labeling the target category, wherein the labeling can adopt the category of the word description target, such as 'people' and 'bears', and can also be labeled through patterns, such as human patterns and bear patterns.
Preferred embodiments of the present invention are: the target category identification object selected in the invention mainly includes but is not limited to identification of people and animals with vehicles. For example, for a person as an object in the imaged scene, the category identified by the deep learning module is a person, for a vehicle as an object in the imaged scene, the category identified by the deep learning module is a vehicle.
Preferred embodiments of the present invention are: and performing infrared image enhancement processing on one or more processing modes of gamma correction, dynamic histogram stretching, filtering and the like on the image signal after the non-uniformity correction. Gamma correction and dynamic histogram stretching are two ways of carrying out nonlinear mapping on infrared image pixel values to achieve the effect of pixel gray level rearrangement, and a target with low contrast can be clearer; the filtering algorithm is a commonly used numerical processing algorithm, convolution operation is carried out on the image by setting convolution kernels with different sizes, and therefore the effects of noise elimination, edge enhancement and the like are achieved.
As shown in fig. 1, the specific embodiment of the present invention is: the infrared telescope full-frame imaging output system comprises an infrared imaging lens 1, an infrared detector 2 and an ARM processor unit 3, wherein the ARM processor unit 3 comprises a non-uniform correction module 31, a target type identification module 32, a target ranging module 33, an image identification module 34 and an image fusion module 35, the infrared imaging lens 1 is formed by arranging infrared glass lenses with different curvatures and different refractive indexes on the same axis in an infrared telescope, the infrared detector 2 is formed by arranging an infrared photosensitive unit into a non-refrigeration infrared focal plane array in the infrared telescope, and the infrared imaging lens converges infrared rays in a spectral region onto the non-refrigeration infrared focal plane array of the infrared detector; the infrared light sensing unit of the infrared detector 2 absorbs light rays converged on the uncooled infrared focal plane array so as to generate a changed voltage signal, and a signal circuit in the infrared detector converts the array voltage signal of the uncooled infrared focal plane array into a digital signal; the non-uniformity correction module 31 adopts an ARM processor unit to perform non-uniformity correction on the array digital signal of the infrared detector so as to correct the temperature response rate of the photosensitive unit of the infrared detector; the target type identification module 32 performs full-frame analysis on a scene in a spectral region to identify the target type of a human or animal or vehicle imaging target in the scene; the target ranging module 33 calculates the distance between the current imaging target and the observer according to the size of the pixel occupied by the target category in the scene; the image identification module 34 forms the acquired target distance of the current imaging target into a target distance identification; the image fusion module 35 fuses the target distance identifier with the imaging target in the infrared image, and in the fusion process, the imaging target and the target distance identifier are correspondingly fused to form a fused infrared video image.
The specific implementation process is as follows: the infrared imaging lens 1 converges infrared light in a spectral region onto an uncooled infrared focal plane array of the infrared detector 2 through infrared glass lenses with different curvatures and different refractive indexes. A microbridge structure formed by thermosensitive materials is distributed on the uncooled infrared focal plane array, the infrared photosensitive unit absorbs light converged on the uncooled infrared focal plane to cause the change of the resistance value of the infrared photosensitive unit, so that a changed voltage signal is generated, and the array signal is converted into a digital signal with the bit depth of 8-16 through an integral amplifying circuit and a reading circuit which are arranged in the infrared detector 2. The non-uniformity correction module 31 is used for performing non-uniformity correction on the array digital signal of the infrared detector to correct the temperature response rate of the photosensitive unit of the infrared detector 2, and specifically, the non-uniformity correction is performed on the array digital signal of the infrared detector 2 by using one or more algorithms of single-point correction, two-point correction and multi-point correction.
The object class identification module 32 performs a full frame analysis of the scene in a spectral region to identify the object class of the imaged object in the scene. The specific implementation process is as follows: acquiring infrared images of various target objects, manually labeling the categories and regression frames of the targets in the infrared images, and using the infrared images as label samples for supervised learning to construct a deep learning model of the infrared image targets; preferably, in the process of supervised learning, the target object is subjected to abundant multi-type infrared image acquisition, and the category and the regression frame of the target in the infrared image are manually labeled to be used as the label sample of the supervised learning. The deep learning model after training can obtain different responses to a foreground target area and a background area in the picture so as to distinguish the target area, and can obtain different responses to different target categories in the picture so as to distinguish the target categories. In the invention, the target category in the full-width infrared image is labeled, the collected infrared image is supervised and learned through a deep learning model of a full-convolution neural network, and a target area and the target category are distinguished in the full-width image through the deep learning model of the infrared image target. The object ranging module 33 calculates the distance between the current imaging object and the observer according to the size of the pixels occupied by the object type in the scene.
The specific implementation process is as follows: first, the height h of each target category is preset, and the height h is preset by taking human example01.7 m; secondly, when the deep learning model judges that the target type is a person, calculating the pixel height q of the target person in the picture, namely q is the number of pixels of the target person in the height direction; knowing the focal length f of the lens of the infrared telescope and the pixel size d of the detector, the distance L between the current target person and the observer can be calculated by the following formula:
after the distance between the current imaging target and the observer is obtained, the distance is corresponding to the current imaging target, and the image identification module 34 forms a target distance identification from the distance between the current imaging target and the observer, and identifies the target distance identification on the corresponding imaging target. The image fusion module 35 fuses the target distance identifier with the imaging target in the infrared image in the generated full-frame infrared image, and in the fusion process, the imaging target and the target distance identifier are correspondingly fused to form a fused infrared video image.
The preferred embodiments of the present invention are: the system also comprises a display output unit, wherein the display output unit is used for outputting the infrared video image and outputting the fused infrared video image. The display output unit comprises a liquid crystal display array and a liquid crystal driving circuit, the digital signals output by the low-power ARM processor module are analyzed into voltage control signals corresponding to time sequences, the arrangement direction of liquid crystal molecules is adjusted through different control voltages, and the display ratio of three primary colors of red, green and blue is changed, so that video contents are truly displayed.
The preferred embodiments of the present invention are: the display device further comprises an interface management unit, wherein the interface management unit is used for managing the receiving of the infrared detector signals, the receiving of the I/O signals of the key module and the data output to the display output unit.
The preferred embodiments of the present invention are: the mobile terminal further comprises a near field communication module, and the near field communication module is in near field wireless communication with the mobile terminal. The near field communication module comprises one or more of a WIFI communication module, a Bluetooth communication module and a 2.4G communication module, and network connection with a mobile terminal or a computer and the like can be established through the near field communication module, so that communication with external equipment is realized.
The preferred embodiments of the present invention are: the system also comprises a GPS module or a Beidou module, and longitude and latitude and time information of the observation point can be obtained through the GPS module or the Beidou module.
The invention has the technical effects that: the method and the system for constructing the full-frame imaging output of the infrared telescope are characterized in that infrared glass lenses with different curvatures and different refractive indexes are arranged on the same axis in the infrared telescope to form an infrared imaging lens, an infrared photosensitive unit is arranged into an uncooled infrared focal plane array to form an infrared detector in the infrared telescope, and the method comprises the following steps: acquiring infrared light: the infrared imaging lens converges infrared rays in a spectral region onto an uncooled infrared focal plane array of the infrared detector; generating a digital signal: the infrared light sensing unit absorbs light rays converged on the uncooled infrared focal plane array to cause the change of the resistance value of the uncooled infrared focal plane array, so that a changed voltage signal is generated, and a signal circuit in the infrared detector converts the array voltage signal of the uncooled infrared focal plane array into a digital signal; non-uniformity correction: adopting an ARM processor module to carry out non-uniform correction on the array digital signals of the infrared detector so as to correct the temperature response rate of the photosensitive unit of the infrared detector; identifying a target class: carrying out full-frame analysis on a scene in a spectral region, and identifying the target type of an imaging target in the scene; target ranging: calculating the distance between the current imaging target and an observer according to the size of the pixel occupied by the target category in the scene; image identification: forming a target distance identifier from the acquired target distance of the current imaging target; image fusion: and fusing the target distance identifier with an imaging target in the infrared image, wherein in the fusion process, the imaging target and the target distance identifier are correspondingly fused to form a fused infrared video image. The invention relates to a full-frame imaging output method and a full-frame imaging output system of an infrared telescope.
The foregoing is a more detailed description of the invention in connection with specific preferred embodiments and it is not intended that the invention be limited to these specific details. For those skilled in the art to which the invention pertains, several simple deductions or substitutions can be made without departing from the spirit of the invention, and all shall be considered as belonging to the protection scope of the invention.
Claims (12)
1. The full-frame imaging output method of the infrared telescope is characterized in that infrared glass lenses with different curvatures and different refractive indexes are arranged on the same axis in the infrared telescope to form an infrared imaging lens, an infrared photosensitive unit is arranged into an uncooled infrared focal plane array to form an infrared detector in the infrared telescope, and the full-frame imaging output method comprises the following steps:
acquiring infrared light: the infrared imaging lens converges infrared rays in a spectral region onto an uncooled infrared focal plane array of the infrared detector;
generating a digital signal: the infrared light sensing unit absorbs light rays converged on the uncooled infrared focal plane array to generate a changed voltage signal, and a signal circuit in the infrared detector converts the array voltage signal of the uncooled infrared focal plane array into a digital signal;
non-uniformity correction: adopting an ARM processor module to carry out non-uniform correction on the array digital signals of the infrared detector so as to correct the temperature response rate of the photosensitive unit of the infrared detector;
identifying a target class: carrying out full-frame analysis on a scene in a spectral region, and identifying the target type of an imaging target in the scene;
target ranging: calculating the distance between the current imaging target and an observer according to the size of the pixel occupied by the target category in the scene;
image identification: forming a target distance identifier from the acquired target distance of the current imaging target;
image fusion: and fusing the target distance identifier with an imaging target in the infrared image, wherein in the fusion process, the imaging target and the target distance identifier are correspondingly fused to form a fused infrared video image.
2. The infrared telescope full-format imaging output method according to claim 1, wherein in the step of identifying the target class, a deep learning model of a full convolutional neural network is established through supervised learning of infrared image label samples, and the deep learning model is applied to realize identification of the class of the target in the full-format infrared image.
3. The infrared telescope full-width imaging output method according to claim 2, wherein the infrared images of various target objects are collected, the types and regression frames of the targets in the infrared images are manually labeled and used as label samples for supervised learning, so that a deep learning model of the infrared image targets is constructed, and the target areas and the target types are distinguished in the full-width image through the deep learning model of the infrared image targets.
4. The infrared telescope full format imaging output method of claim 1, further comprising labeling target classes.
5. The infrared telescope full-width imaging output method according to claim 1, further comprising performing infrared image enhancement processing on the image signal after non-uniformity correction in one or more of gamma correction, dynamic histogram stretching, filtering and the like.
6. The infrared telescope full-format image output method according to claim 1, wherein the non-uniformity correction is performed on the array digital signals of the infrared detectors by using one or more of single-point correction, two-point correction and multi-point correction.
7. An infrared telescope full-frame imaging output system is characterized by comprising an infrared imaging lens, an infrared detector and an ARM processor unit, wherein the ARM processor unit comprises a non-uniform correction module, a target category identification module, a target distance measurement module, an image identification module and an image fusion module, the infrared imaging lens is formed by arranging infrared glass lenses with different curvatures and different refractive indexes on the same axis in an infrared telescope, the infrared detector is formed by arranging an infrared photosensitive unit into a non-refrigeration infrared focal plane array in the infrared telescope, and the infrared imaging lens converges infrared rays in a spectral region onto the non-refrigeration infrared focal plane array of the infrared detector; an infrared light sensing unit of the infrared detector absorbs light rays converged on the uncooled infrared focal plane array so as to generate a changed voltage signal, and a signal circuit in the infrared detector converts the array voltage signal of the uncooled infrared focal plane array into a digital signal; the non-uniformity correction module adopts an ARM processor unit to carry out non-uniformity correction on the array digital signals of the infrared detector so as to correct the temperature response rate of the photosensitive unit of the infrared detector; the target type identification module performs full-frame analysis on a scene in a spectral region to identify the target type of an imaging target in the scene; the target ranging module calculates the distance between the current imaging target and an observer according to the size of the pixel occupied by the target category in the scene; the image identification module forms an object distance identification by the acquired object distance of the current imaging object; and the image fusion module fuses the target distance identifier and an imaging target in the infrared image, and in the fusion process, the imaging target and the target distance identifier are correspondingly fused to form a fused infrared video image.
8. The infrared telescope full-frame imaging output system of claim 7, further comprising a display output unit for outputting infrared video images.
9. The infrared telescope full-frame imaging output system according to claim 8, further comprising an interface management unit, a key module, said interface management unit managing reception of said infrared detector signal, reception of said key module I/O signal, and data output to said display output unit.
10. The infrared telescope full-frame imaging output system of claim 7, wherein the target class identification module labels classes of targets in the full-width infrared image, and performs supervised learning on the acquired infrared image through a deep learning model of a full-convolution neural network.
11. The infrared telescope full-frame imaging output system according to claim 7, further comprising a near-field communication module, wherein the near-field communication module is in near-field wireless communication with the mobile terminal.
12. The infrared telescope full frame imaging output system of claim 7, further comprising one or more of a GPS positioning module, a Beidou positioning module.
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110498376X | 2021-05-07 | ||
| CN202110498376 | 2021-05-07 |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN113610695A true CN113610695A (en) | 2021-11-05 |
Family
ID=78337512
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110792408.7A Pending CN113610695A (en) | 2021-05-07 | 2021-07-13 | Infrared telescope full-frame imaging output method and system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113610695A (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114295108A (en) * | 2021-12-17 | 2022-04-08 | 浙江兆晟科技股份有限公司 | Distance measurement method and system for external equipment and infrared telescope |
| CN114373355A (en) * | 2021-12-31 | 2022-04-19 | 重庆平戎科技有限公司 | Investigation simulator, simulation system and simulation method for simulation training |
| CN117152027A (en) * | 2023-10-31 | 2023-12-01 | 广东中科凯泽信息科技有限公司 | Intelligent telescope based on image processing and artificial intelligent recognition |
Citations (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2003107067A2 (en) * | 2002-06-18 | 2003-12-24 | Bayerische Motoren Werke | Method and device for visualising the environment of a vehicle by merging an infrared image and a visual image according to distance |
| US20050110621A1 (en) * | 2002-06-18 | 2005-05-26 | Bayerische Motoren Werke Aktiengesellschaft | Method and system for visualizing the environment of a vehicle with a distance-dependent merging of an infrared and a visual image |
| CN103390281A (en) * | 2013-07-29 | 2013-11-13 | 西安科技大学 | Double-spectrum night vision instrument vehicle-mounted system and double-spectrum fusion design method |
| CN105354851A (en) * | 2015-11-20 | 2016-02-24 | 中国安全生产科学研究院 | Infrared and visible light video fusion method and fusion system adaptive to distance |
| CN106485274A (en) * | 2016-10-09 | 2017-03-08 | 湖南穗富眼电子科技有限公司 | A kind of object classification method based on target property figure |
| CN106570852A (en) * | 2016-11-07 | 2017-04-19 | 中国航空无线电电子研究所 | Real-time 3D image situation perception method |
| US20170350758A1 (en) * | 2012-05-18 | 2017-12-07 | Rebellion Photonics, Inc. | Divided-aperture infra-red spectral imaging system |
| CN108226949A (en) * | 2018-04-08 | 2018-06-29 | 广州市盛光微电子有限公司 | The information fuse device and method of a kind of visible ray and the more camera lens multisensors of mid-infrared and far-infrared light |
| CN109341864A (en) * | 2018-10-24 | 2019-02-15 | 北京航天长征飞行器研究所 | A kind of small-sized wide dynamic space infrared quantitative measuring device |
| CN109724703A (en) * | 2018-12-29 | 2019-05-07 | 哈工大机器人（山东）智能装备研究院 | Temperature correction method under complex scene based on pattern-recognition |
| CN110428008A (en) * | 2019-08-02 | 2019-11-08 | 深圳市唯特视科技有限公司 | A kind of target detection and identification device and method based on more merge sensors |
| CN111623776A (en) * | 2020-06-08 | 2020-09-04 | 昆山星际舟智能科技有限公司 | Method for measuring distance of target by using near infrared vision sensor and gyroscope |
| CN112053314A (en) * | 2020-09-04 | 2020-12-08 | 深圳市迈测科技股份有限公司 | Image fusion method and device, computer equipment, medium and thermal infrared imager |
-
2021
- 2021-07-13 CN CN202110792408.7A patent/CN113610695A/en active Pending
Patent Citations (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20050110621A1 (en) * | 2002-06-18 | 2005-05-26 | Bayerische Motoren Werke Aktiengesellschaft | Method and system for visualizing the environment of a vehicle with a distance-dependent merging of an infrared and a visual image |
| WO2003107067A2 (en) * | 2002-06-18 | 2003-12-24 | Bayerische Motoren Werke | Method and device for visualising the environment of a vehicle by merging an infrared image and a visual image according to distance |
| US20170350758A1 (en) * | 2012-05-18 | 2017-12-07 | Rebellion Photonics, Inc. | Divided-aperture infra-red spectral imaging system |
| CN103390281A (en) * | 2013-07-29 | 2013-11-13 | 西安科技大学 | Double-spectrum night vision instrument vehicle-mounted system and double-spectrum fusion design method |
| CN105354851A (en) * | 2015-11-20 | 2016-02-24 | 中国安全生产科学研究院 | Infrared and visible light video fusion method and fusion system adaptive to distance |
| CN106485274A (en) * | 2016-10-09 | 2017-03-08 | 湖南穗富眼电子科技有限公司 | A kind of object classification method based on target property figure |
| CN106570852A (en) * | 2016-11-07 | 2017-04-19 | 中国航空无线电电子研究所 | Real-time 3D image situation perception method |
| CN108226949A (en) * | 2018-04-08 | 2018-06-29 | 广州市盛光微电子有限公司 | The information fuse device and method of a kind of visible ray and the more camera lens multisensors of mid-infrared and far-infrared light |
| CN109341864A (en) * | 2018-10-24 | 2019-02-15 | 北京航天长征飞行器研究所 | A kind of small-sized wide dynamic space infrared quantitative measuring device |
| CN109724703A (en) * | 2018-12-29 | 2019-05-07 | 哈工大机器人（山东）智能装备研究院 | Temperature correction method under complex scene based on pattern-recognition |
| CN110428008A (en) * | 2019-08-02 | 2019-11-08 | 深圳市唯特视科技有限公司 | A kind of target detection and identification device and method based on more merge sensors |
| CN111623776A (en) * | 2020-06-08 | 2020-09-04 | 昆山星际舟智能科技有限公司 | Method for measuring distance of target by using near infrared vision sensor and gyroscope |
| CN112053314A (en) * | 2020-09-04 | 2020-12-08 | 深圳市迈测科技股份有限公司 | Image fusion method and device, computer equipment, medium and thermal infrared imager |
Non-Patent Citations (1)
| Title |
|---|
| 王凯;韦宏利;陈超波;曹凯;: "基于红外和可见光融合的目标跟踪", 计算机系统应用, no. 01, 15 January 2018 (2018-01-15) * |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114295108A (en) * | 2021-12-17 | 2022-04-08 | 浙江兆晟科技股份有限公司 | Distance measurement method and system for external equipment and infrared telescope |
| CN114373355A (en) * | 2021-12-31 | 2022-04-19 | 重庆平戎科技有限公司 | Investigation simulator, simulation system and simulation method for simulation training |
| CN114373355B (en) * | 2021-12-31 | 2023-11-24 | 重庆平戎科技有限公司 | Scout simulator, simulation system and simulation method for simulation training |
| CN117152027A (en) * | 2023-10-31 | 2023-12-01 | 广东中科凯泽信息科技有限公司 | Intelligent telescope based on image processing and artificial intelligent recognition |
| CN117152027B (en) * | 2023-10-31 | 2024-02-09 | 广东中科凯泽信息科技有限公司 | Intelligent telescope based on image processing and artificial intelligent recognition |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN113610695A (en) | Infrared telescope full-frame imaging output method and system | |
| US20230360254A1 (en) | Pose estimation method and related apparatus | |
| CN107113408B (en) | Image processing apparatus, image processing method, program, and system | |
| CN107547892A (en) | Heat anomaly detects | |
| CN109788170A (en) | It is a kind of based on infrared with video image processing system and method for visible light | |
| US20140267768A1 (en) | Thermographic Camera Accessory for Personal Electronics | |
| US8903957B2 (en) | Communication system, information terminal, communication method and recording medium | |
| CN107424117B (en) | Image beautifying method and device, computer readable storage medium and computer equipment | |
| CN107707789A (en) | Monochromatic color mapping is carried out using monochromatic imager and color mapped sensors | |
| CN109712177A (en) | Image processing method, device, electronic equipment and computer readable storage medium | |
| CN110675448A (en) | Ground light remote sensing monitoring method, system and storage medium based on civil aircraft | |
| WO2018233692A1 (en) | Positioning method, storage medium, and positioning system | |
| CN108061600B (en) | A kind of miniaturization spectrum imaging system and imaging method | |
| KR20130126532A (en) | A method providing source information of a subject according to photographing the subject, and a server and a hand-held terminal therefor | |
| WO2013169080A2 (en) | Method for providing source information of object by photographing object, and server and portable terminal for method | |
| CN108052883A (en) | User's photographic method, device and equipment | |
| Li et al. | Lighting measurement with a 360° panoramic camera: Part 2–Applications | |
| CN112149707A (en) | Image acquisition control method, device, medium and equipment | |
| CN109738961A (en) | Detection system and detection method | |
| Toet et al. | The TRICLOBS dynamic multi-band image data set for the development and evaluation of image fusion methods | |
| Lamphar et al. | A microcontroller-based system for automated and continuous sky glow measurements with the use of digital single-lens reflex cameras | |
| WO2023055753A1 (en) | Image setting determination and associated machine learning in infrared imaging systems and methods | |
| CN109710567A (en) | A kind of library's room for individual study is anti-to account for an information processing system and method | |
| US10893388B2 (en) | Map generation device, map generation system, map generation method, and non-transitory storage medium including instructions for map generation | |
| CN112771568A (en) | Infrared image processing method, device, movable platform and computer readable medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |