CN111524057B - Infrared image generation method, device, equipment and infrared thermal imaging system - Google Patents
Infrared image generation method, device, equipment and infrared thermal imaging system Download PDFInfo
- Publication number
- CN111524057B CN111524057B CN202010290717.XA CN202010290717A CN111524057B CN 111524057 B CN111524057 B CN 111524057B CN 202010290717 A CN202010290717 A CN 202010290717A CN 111524057 B CN111524057 B CN 111524057B
- Authority
- CN
- China
- Prior art keywords
- pixel data
- processed
- matrix
- determining
- average
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 58
- 238000001931 thermography Methods 0.000 title claims description 20
- 239000011159 matrix material Substances 0.000 claims abstract description 154
- 230000008569 process Effects 0.000 claims description 24
- 238000012545 processing Methods 0.000 claims description 17
- 230000002159 abnormal effect Effects 0.000 claims description 13
- 238000004590 computer program Methods 0.000 claims description 6
- 230000000694 effects Effects 0.000 abstract description 8
- 238000012937 correction Methods 0.000 abstract description 7
- 238000010586 diagram Methods 0.000 description 7
- 230000005855 radiation Effects 0.000 description 4
- 238000003384 imaging method Methods 0.000 description 3
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000003672 processing method Methods 0.000 description 2
- 238000006243 chemical reaction Methods 0.000 description 1
- 230000003750 conditioning effect Effects 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 230000005693 optoelectronics Effects 0.000 description 1
- 230000000750 progressive effect Effects 0.000 description 1
- 230000004044 response Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T1/00—General purpose image data processing
- G06T1/0007—Image acquisition
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01J—MEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
- G01J5/00—Radiation pyrometry, e.g. infrared or optical thermometry
- G01J5/10—Radiation pyrometry, e.g. infrared or optical thermometry using electric radiation detectors
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
- Y02D10/00—Energy efficient computing, e.g. low power processors, power management or thermal management
Landscapes
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Spectroscopy & Molecular Physics (AREA)
- Photometry And Measurement Of Optical Pulse Characteristics (AREA)
- Transforming Light Signals Into Electric Signals (AREA)
- Studio Devices (AREA)
Abstract
The application discloses an infrared image generation method, which comprises the steps of obtaining processed pixel data output by an infrared focal plane detector; determining a first average value matrix of the processed pixel data in the row direction and a second average value matrix of the processed pixel data in the column direction; acquiring processed Dummy pixel data output by an infrared focal plane detector; determining a third average value matrix of the processed Dummy pixel data in the row direction and a fourth average value matrix in the column direction; and generating an infrared image according to the processed pixel data, the first array data determined by the first average matrix and the third average matrix, and the second array data determined by the processed pixel data, the second average matrix and the fourth average matrix. The method is convenient to realize, occupies little logic resource and has low power consumption, thereby improving the quality of infrared images; the horizontal and column noise with larger amplitude can be removed; the data delay is small, and the pixel data output by the infrared detector is directly processed, so that the effect of non-uniformity correction is not relied on.
Description
Technical Field
The present disclosure relates to the field of optoelectronic technologies, and in particular, to a method, an apparatus, a device, and an infrared thermal imaging system for generating an infrared image.
Background
The infrared thermal imaging device system obtains an infrared image by receiving an infrared signal radiated from the surface of the object and performing a series of processes on the signal. The focal plane detector is a key core device of the infrared thermal imaging equipment system, and the readout circuit of the focal plane detector is usually the same column of pixels or the same row of pixels and shares the same output circuit. Due to the influence of the process, the output circuits of the rows or columns are not completely consistent, so that the bias voltages are not completely consistent, and non-uniform noise which is mainly characterized by transverse stripes or column stripes, called transverse stripe noise or column stripe noise, is finally contained in the infrared image.
In order to eliminate non-uniformity noise when generating infrared images, the correlation between adjacent rows or columns of the infrared images is utilized to eliminate noise according to the difference between the pixel values of the adjacent rows or columns and the pixel values of the current row or column. The following drawbacks exist: the algorithm is complex, and more logic resources are occupied, so that the infrared thermal imaging equipment system consumes large power, and the quality of an infrared image is affected; for the effect of processing random cross grain noise and column grain noise is poor, cross grain noise and column grain noise with larger amplitude generated in the impact vibration process cannot be removed at all, and the infrared image quality is greatly influenced; the infrared thermal imaging system has poor real-time performance due to large data delay, so that the target tracking efficiency of the infrared thermal imaging system is influenced, and the application range of the infrared thermal imaging equipment system is greatly limited; the data after the non-uniformity correction is processed, and the processing effect of the non-uniformity correction is excessively depended.
Therefore, how to solve the above technical problems should be of great interest to those skilled in the art.
Disclosure of Invention
The invention aims to provide an infrared image generation method, an infrared image generation device and an infrared thermal imaging system, so as to solve the problems of poor infrared image quality, large data delay and excessive dependence on the processing effect of non-uniformity correction in the prior art.
In order to solve the above technical problems, the present application provides an infrared image generating method, including:
acquiring processed pixel data output by an infrared focal plane detector;
determining a first average value matrix of the processed pixel data in the row direction and a second average value matrix in the column direction;
acquiring processed Dummy pixel data output by the infrared focal plane detector;
determining a third average value matrix of the processed Dummy pixel data in the row direction and a fourth average value matrix in the column direction;
determining first array data according to the processed pixel data, the first average value matrix and the third average value matrix, determining second array data according to the processed pixel data, the second average value matrix and the fourth average value matrix, and generating an infrared image according to the first array data and the second array data.
Optionally, after obtaining the processed Dummy pixel data output by the infrared focal plane detector, the method further includes:
acquiring the difference value of the processed Dummy pixel data in the Dummy pixels of two adjacent frames;
judging whether the difference value is larger than a preset threshold value or not;
when the difference value is larger than the preset threshold value, marking the processed Dummy pixel data as abnormal pixel data, and eliminating the abnormal pixel data;
correspondingly, determining the third average value matrix of the processed Dummy pixel data in the row direction and the fourth average value matrix in the column direction comprises:
and determining a third average value matrix in the row direction and a fourth average value matrix in the column direction of the processed Dummy pixel data after the abnormal pixel data is removed.
Optionally, the processed pixel data is obtained by processing the original pixel data of the infrared focal plane detector by correct power supply, correct configuration and adjustment of a working balance point.
Optionally, the determining the first average matrix in the row direction and the second average matrix in the column direction of the processed pixel data includes:
determining the first mean matrix according to the following formula;
determining the second mean matrix according to the following formula;
wherein, X (i, j) is processed pixel data, i is the array coordinate of the processed pixel data, j is the row coordinate of the processed pixel data, M is the number of rows of the infrared focal plane detector array scale, N is the number of columns of the infrared focal plane detector array scale, avr_X (j) is the first average matrix, avr_X (i) is the second average matrix.
Optionally, the determining the third average matrix in the row direction and the fourth average matrix in the column direction of the processed Dummy pixel data includes:
determining the third mean matrix according to the following formula;
determining the fourth mean matrix according to the following formula;
where D (a, b) is the processed Dummy pixel data, a is the column coordinates of the processed Dummy pixel data, b is the row coordinates of the processed Dummy pixel data, p is the number of the processed Dummy pixel data per row, c is the number of the processed Dummy pixel data per column, avr_d (b) is the third average matrix, avr_d (a) is the fourth average matrix.
Optionally, determining the first array data according to the processed pixel data, the first average matrix, and the third average matrix, and determining the second array data according to the processed pixel data, the second average matrix, and the fourth average matrix includes:
determining the first array data according to the following formula;
H＝X(i,j)-Avr_D(b)+Avr_X(j),j∈[0,M-1],b∈[0,M-1]；
determining the second array data according to the following formula;
L＝X(i,j)-Avr_D(a)+Avr_X(i),i∈[0,N-1],a∈[0,N-1]；
wherein H is the first array data and L is the second array data.
Optionally, the processed Dummy pixel data is obtained by adjusting a Dummy pixel balance point and adjusting a Dummy pixel bias voltage of the original Dummy pixel data of the infrared focal plane detector.
The application also provides an infrared image generation device, comprising:
the first acquisition module is used for acquiring processed pixel data output by the infrared focal plane detector;
a first determining module, configured to determine a first average matrix of the processed pixel data in a row direction and a second average matrix of the processed pixel data in a column direction;
the second acquisition module is used for acquiring the processed Dummy pixel data output by the infrared focal plane detector;
a second determining module, configured to determine a third average matrix in a row direction and a fourth average matrix in a column direction of the processed Dummy pixel data;
the generating module is used for determining first array data according to the processed pixel data, the first average value matrix and the third average value matrix, determining second array data according to the processed pixel data, the second average value matrix and the fourth average value matrix, and generating an infrared image according to the first array data and the second array data.
The present application also provides an infrared image generation apparatus including:
a memory for storing a computer program;
and the processor is used for realizing the steps of any one of the cursor moving methods when executing the computer program.
The application also provides an infrared thermal imaging system, which comprises an infrared lens assembly, an infrared focal plane detector, a circuit processor, signal processing equipment and display equipment, wherein the signal processing equipment comprises the infrared image generation equipment.
The infrared image generation method comprises the steps of obtaining processed pixel data output by an infrared focal plane detector; determining a first average value matrix of the processed pixel data in the row direction and a second average value matrix in the column direction; acquiring processed Dummy pixel data output by the infrared focal plane detector; determining a third average value matrix of the processed Dummy pixel data in the row direction and a fourth average value matrix in the column direction; and generating an infrared image according to the processed pixel data, the first array data determined by the first average value matrix and the third average value matrix, and the second array data determined by the processed pixel data, the second average value matrix and the fourth average value matrix.
Therefore, the image processing method in the application generates the infrared image by acquiring the processed pixel data output by the infrared focal plane detector, the first average matrix in the row direction and the second average matrix in the column direction, calculating the third average matrix in the row direction and the fourth average matrix in the column direction of the processed Dummy pixel data, and then generating the first array data determined according to the processed pixel data, the first average matrix and the third average matrix and the second array data determined according to the processed pixel data, the second average matrix and the fourth average matrix. The whole process is convenient to implement and easy to implement, occupies little logic resource, thereby reducing the power consumption of the infrared thermal imaging system and improving the infrared image quality; the cross grain noise and the column grain noise with larger amplitude, which are introduced by other reasons such as impact vibration, can be removed, and the infrared image quality is further improved; the data delay in the whole process is small, and the target tracking efficiency of the infrared thermal imaging system is improved; in addition, the method directly processes the pixel data output by the infrared focal plane detector end, and does not depend on the effect of non-uniformity correction. In addition, the application also provides a device, equipment and an infrared thermal imaging system with the advantages.
Drawings
For a clearer description of embodiments of the present application or of the prior art, the drawings that are used in the description of the embodiments or of the prior art will be briefly described, it being apparent that the drawings in the description that follow are only some embodiments of the present application, and that other drawings may be obtained from these drawings by a person of ordinary skill in the art without inventive effort.
FIG. 1 is a flowchart of an infrared image generation method according to an embodiment of the present application;
FIG. 2 is a schematic diagram of a Dummy pixel and an infrared focal plane detector imaging region;
FIG. 3 is a flowchart of another method for generating an infrared image according to an embodiment of the present application;
fig. 4 is a block diagram of an infrared image generating apparatus according to an embodiment of the present application;
fig. 5 is a block diagram of an infrared image generation device according to an embodiment of the present application;
fig. 6 is a schematic structural diagram of an infrared thermal imaging system according to an embodiment of the present application.
Detailed Description
In order to provide a better understanding of the present application, those skilled in the art will now make further details of the present application with reference to the drawings and detailed description. It will be apparent that the described embodiments are only some, but not all, of the embodiments of the present application. All other embodiments, which can be made by one of ordinary skill in the art without undue burden from the present disclosure, are within the scope of the present disclosure.
In the following description, numerous specific details are set forth in order to provide a thorough understanding of the present invention, but the present invention may be practiced in other ways other than those described herein, and persons skilled in the art will readily appreciate that the present invention is not limited to the specific embodiments disclosed below.
As described in the background section, the prior art eliminates noise of the infrared image according to the difference between the pixel value of the adjacent row or column and the pixel value of the current row or column, and has the disadvantages of complex algorithm, incapability of processing random cross grain noise and column grain noise, large data delay and excessive dependence on the processing effect of non-uniformity correction.
In view of this, the present application provides an infrared image generation method, please refer to fig. 1, fig. 1 is a flowchart of an infrared image generation method provided in an embodiment of the present application, the method includes:
step S101: and acquiring processed pixel data output by the infrared focal plane detector.
Step S102: a first mean matrix of the processed pixel data in a row direction and a second mean matrix in a column direction are determined.
Specifically, the first mean matrix is determined according to the following formula,
determining the second mean matrix according to the following equation,
wherein, X (i, j) is processed pixel data, i is the array coordinate of the processed pixel data, j is the row coordinate of the processed pixel data, M is the number of rows of the infrared focal plane detector array scale, N is the number of columns of the infrared focal plane detector array scale, avr_X (j) is the first average matrix, avr_X (i) is the second average matrix.
It should be noted that the infrared focal plane detector array size (N columns×m rows) in this embodiment includes, but is not limited to, 720×576, 768×576, 256×192, 384×288, 640×512, 1024×768, 1280×1024, 1920×1280, 2048×1920.
Step S103: and acquiring processed Dummy pixel data output by the infrared focal plane detector.
Step S104: and determining a third average value matrix in the row direction and a fourth average value matrix in the column direction of the processed Dummy pixel data.
Specifically, the third mean matrix is determined according to the following formula,
determining the fourth mean matrix according to the following formula;
where D (a, b) is the processed Dummy pixel data, a is the column coordinates of the processed Dummy pixel data, b is the row coordinates of the processed Dummy pixel data, p is the number of the processed Dummy pixel data per row, c is the number of the processed Dummy pixel data per column, avr_d (b) is the third average matrix, avr_d (a) is the fourth average matrix.
Note that the number of Dummy pixel data after processing is not particularly limited in this embodiment. P (p is generally in the range of 2-20, and can exceed 20) Dummy pixel data D (a, b) before each row of valid data starts, and p-q Dummy pixel data can be selectively read, q < p, and preferably 3<p-q <10. The infrared focal plane detector has c rows (c is typically in the range of 2-10) of Dummy pixels before the active row output. A schematic diagram of the Dummy pixels and infrared focal plane detector imaging area is shown in fig. 2.
The effective data is the data of the infrared focal plane detector array scale.
Step S105: determining first array data according to the processed pixel data, the first average value matrix and the third average value matrix, determining second array data according to the processed pixel data, the second average value matrix and the fourth average value matrix, and generating an infrared image according to the first array data and the second array data.
Specifically, the first array data is determined according to the following equation,
H＝X(i,j)-Avr_D(b)+Avr_X(j),j∈[0,M-1],b∈[0,M-1] (5)
determining the second array data according to the following equation,
L＝X(i,j)-Avr_D(a)+Avr_X(i),i∈[0,N-1],a∈[0,N-1] (6)
wherein H is the first array data and L is the second array data.
The formula (5) and the formula (6) are used for removing the cross grain noise and the column grain noise of the generated infrared image, respectively.
The image processing method in this embodiment generates an infrared image by acquiring processed pixel data output by the infrared focal plane detector, and a first average matrix in a row direction and a second average matrix in a column direction of the processed pixel data, calculating a third average matrix in the row direction and a fourth average matrix in the column direction of the processed pixel data, and then generating first array data determined according to the processed pixel data, the first average matrix and the third average matrix, and second array data determined according to the processed pixel data, the second average matrix and the fourth average matrix. The whole process is simple and easy to realize, and occupies little logic resource, so that the power consumption of an infrared thermal imaging system can be reduced, and the infrared image quality is improved; the cross grain noise and the column grain noise with larger amplitude, which are introduced by other reasons such as impact vibration, can be removed, and the infrared image quality is further improved; the data delay in the whole process is small, and the target tracking efficiency of the infrared thermal imaging system is improved; in addition, the method directly processes the pixel data output by the infrared focal plane detector end, and does not depend on the effect of non-uniformity correction.
Referring to fig. 3, fig. 3 is a flowchart of another infrared image generation method according to an embodiment of the present application.
Step S201: and acquiring processed pixel data output by the infrared focal plane detector.
Step S202: a first mean matrix of the processed pixel data in a row direction and a second mean matrix in a column direction are determined.
Step S203: and acquiring processed Dummy pixel data output by the infrared focal plane detector.
Step S204: and obtaining the difference value of the processed Dummy pixel data in the Dummy pixels of two adjacent frames.
Step S205: and judging whether the difference value is larger than a preset threshold value or not.
It should be noted that, in this embodiment, the preset threshold is not specifically limited, and may be set by itself.
Step S206: and when the difference value is larger than the preset threshold value, marking the processed Dummy pixel data as abnormal pixel data, and eliminating the abnormal pixel data.
It is understood that when the difference is less than or equal to the preset threshold, the abnormal pixel data is not marked.
Step S207: and determining a third average value matrix in the row direction and a fourth average value matrix in the column direction of the processed Dummy pixel data after the abnormal pixel data is removed.
Step S208: determining first array data according to the processed pixel data, the first average value matrix and the third average value matrix, determining second array data according to the processed pixel data, the second average value matrix and the fourth average value matrix, and generating an infrared image according to the first array data and the second array data.
In this embodiment, the processed Dummy pixel data with the difference value of the processed Dummy pixel data exceeding the preset threshold value in the two adjacent frames of Dummy pixels is removed, so as to further improve the non-uniformity removal effect, that is, further remove constant temperature noise and column noise, so that the infrared image quality is better.
Optionally, in an embodiment of the present application, the processed pixel data is obtained by performing a correct power supply process, a correct configuration process, and a process of adjusting a working balance point on raw pixel data of the infrared focal plane detector.
It should be noted that the raw pixel data is the thermal response of the infrared radiation of the object sensed by the infrared lens assembly.
It should be noted that, the three specific processes of the correct power supply process of the infrared focal plane detector, the correct configuration process of the writing infrared focal plane detector, and the process of adjusting the working balance point of the infrared focal plane detector are well known to those skilled in the art, and will not be described in detail herein.
On the basis of any one of the above embodiments, in one embodiment of the present application, the processed Dummy pixel data is obtained by adjusting a Dummy pixel balance point and a Dummy pixel bias voltage of original Dummy pixel data of the infrared focal plane detector.
It should be noted that, the data of at least 2 shielded pixels which do not respond to infrared radiation are reserved before each row of effective pixels in the non-acquisition imaging area of the infrared focal plane detector are started, namely the original Dummy pixel data.
It should be noted that, the processes of adjusting the Dummy pixel balance point process and adjusting the Dummy pixel bias voltage process are well known to those skilled in the art, and will not be described in detail herein.
The following describes an infrared image generation device provided in an embodiment of the present invention, and the following description of the infrared image generation device and the above-described infrared image generation method may be referred to correspondingly.
Referring to fig. 4, fig. 4 is a block diagram of an infrared image generation apparatus according to an embodiment of the present application, where the apparatus includes:
a first acquisition module 100, configured to acquire processed pixel data output by the infrared focal plane detector;
a first determining module 200, configured to determine a first average matrix of the processed pixel data in a row direction and a second average matrix of the processed pixel data in a column direction;
a second obtaining module 300, configured to obtain processed Dummy pixel data output by the infrared focal plane detector;
a second determining module 400, configured to determine a third average matrix in a row direction and a fourth average matrix in a column direction of the processed Dummy pixel data;
the generating module 500 is configured to determine first array data according to the processed pixel data, the first average matrix, and the third average matrix, determine second array data according to the processed pixel data, the second average matrix, and the fourth average matrix, and generate an infrared image according to the first array data and the second array data.
The infrared image generating apparatus of the present embodiment is used to implement the foregoing infrared image generating method, so that the detailed description of the specific embodiment in the infrared image generating apparatus may be found in the foregoing example portions of the infrared image generating method, for example, the first acquisition module 100, the first determination module 200, the second acquisition module 300, the second determination module 400, and the generation module 500, which are respectively used to implement steps S101, S102, S103, S104, and S105 in the foregoing infrared image generating method, so that the detailed description thereof will be omitted herein with reference to the corresponding examples of the respective portions.
Optionally, the infrared image generation device further includes:
a third obtaining module, configured to obtain a difference value of the processed Dummy pixel data in the Dummy pixels of two adjacent frames;
the judging module is used for judging whether the difference value is larger than a preset threshold value or not;
the rejecting module is used for marking the processed Dummy pixel data as abnormal pixel data and rejecting the abnormal pixel data when the difference value is larger than the preset threshold value;
accordingly, the second determining module 400 is specifically configured to: and determining a third average value matrix in the row direction and a fourth average value matrix in the column direction of the processed Dummy pixel data after the abnormal pixel data is removed.
Optionally, the first determining module 200 is specifically configured to:
determining the first mean matrix according to the following formula;
determining the second mean matrix according to the following formula;
wherein, X (i, j) is processed pixel data, i is the array coordinate of the processed pixel data, j is the row coordinate of the processed pixel data, M is the number of rows of the infrared focal plane detector array scale, N is the number of columns of the infrared focal plane detector array scale, avr_X (j) is the first average matrix, avr_X (i) is the second average matrix.
Optionally, the second determining module 400 is specifically configured to:
determining the third mean matrix according to the following formula;
determining the fourth mean matrix according to the following formula;
where D (a, b) is the processed Dummy pixel data, a is the column coordinates of the processed Dummy pixel data, b is the row coordinates of the processed Dummy pixel data, p is the number of the processed Dummy pixel data per row, c is the number of the processed Dummy pixel data per column, avr_d (b) is the third average matrix, avr_d (a) is the fourth average matrix.
Optionally, the generating module 500 is specifically configured to:
determining the first array data according to the following formula;
H＝X(i,j)-Avr_D(b)+Avr_X(j),j∈[0,M-1],b∈[0,M-1] (11)
determining the second array data according to the following formula;
L＝X(i,j)-Avr_D(a)+Avr_X(i),i∈[0,N-1],a∈[0,N-1] (12)
wherein H is the first array data and L is the second array data.
The following describes an infrared image generation apparatus provided in an embodiment of the present invention, and the following description of the infrared image generation apparatus and the above-described infrared image generation method may be referred to correspondingly to each other.
Referring to fig. 5, fig. 5 is a block diagram of an infrared image generation apparatus according to an embodiment of the present application, the apparatus includes a memory 11 for storing a computer program; a processor 12 for implementing the steps of any one of the cursor movement methods described above when executing the computer program.
The application also provides an infrared thermal imaging system, please refer to fig. 6, which includes an infrared lens assembly 1, an infrared focal plane detector 2, a circuit processor 3, a signal processing device 4, and a display device 5, wherein the signal processing device 4 includes the above-mentioned infrared image generating device.
It should be noted that the signal processing device 4 further includes some other digital signal processing devices, which are well known to those skilled in the art, and will not be described in detail herein.
The infrared lens component 1 gathers infrared radiation signals of an object onto the infrared focal plane detector 2, the infrared focal plane detector 2 converts the infrared radiation signals with different intensity into electric signals which are convenient to process, the circuit processor 3 carries out hardware conditioning, analog-to-digital conversion and other processes on output signals of the infrared focal plane detector 2, then sends the signals to the signal processing equipment 4 at the rear end to carry out a series of digital signal processing, and finally encodes the processed digital signals according to a certain encoding format and then sends the encoded digital signals to the display equipment 5 for infrared image display.
In this specification, each embodiment is described in a progressive manner, and each embodiment is mainly described in a different point from other embodiments, so that the same or similar parts between the embodiments are referred to each other. For the device disclosed in the embodiment, since it corresponds to the method disclosed in the embodiment, the description is relatively simple, and the relevant points refer to the description of the method section.
Those of skill would further appreciate that the various illustrative elements and algorithm steps described in connection with the embodiments disclosed herein may be implemented as electronic hardware, computer software, or combinations of both, and that the various illustrative elements and steps are described above generally in terms of functionality in order to clearly illustrate the interchangeability of hardware and software. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the solution. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present invention.
The steps of a method or algorithm described in connection with the embodiments disclosed herein may be embodied directly in hardware, in a software module executed by a processor, or in a combination of the two. The software modules may be disposed in Random Access Memory (RAM), memory, read Only Memory (ROM), electrically programmable ROM, electrically erasable programmable ROM, registers, hard disk, a removable disk, a CD-ROM, or any other form of storage medium known in the art.
The method, the device, the equipment and the infrared thermal imaging system for generating the infrared image provided by the application are described in detail above. Specific examples are set forth herein to illustrate the principles and embodiments of the present application, and the description of the examples above is only intended to assist in understanding the methods of the present application and their core ideas. It should be noted that it would be obvious to those skilled in the art that various improvements and modifications can be made to the present application without departing from the principles of the present application, and such improvements and modifications fall within the scope of the claims of the present application.
Claims (7)
1. A method of generating an infrared image, comprising:
acquiring processed pixel data output by an infrared focal plane detector;
determining a first average value matrix of the processed pixel data in the row direction and a second average value matrix in the column direction;
acquiring processed Dummy pixel data output by the infrared focal plane detector;
determining a third average matrix of the processed Dummy pixel data in the row direction and a fourth average matrix in the column direction;
determining first array data according to the processed pixel data, the first average value matrix and the third average value matrix, determining second array data according to the processed pixel data, the second average value matrix and the fourth average value matrix, and generating an infrared image according to the first array data and the second array data;
wherein the determining the first average matrix in the row direction and the second average matrix in the column direction of the processed pixel data includes:
determining the first mean matrix according to the following formula;
determining the second mean matrix according to the following formula;
wherein X (i, j) is processed pixel data, i is the array coordinate of the processed pixel data, j is the row coordinate of the processed pixel data, M is the number of rows of the infrared focal plane detector array scale, N is the number of columns of the infrared focal plane detector array scale, avr_X (j) is a first average matrix, avr_X (i) is a second average matrix;
the determining the third average value matrix of the processed Dummy pixel data in the row direction and the fourth average value matrix in the column direction comprises:
determining the third mean matrix according to the following formula;
determining the fourth mean matrix according to the following formula;
wherein D (a, b) is the processed Dummy pixel data, a is the column coordinates of the processed Dummy pixel data, b is the row coordinates of the processed Dummy pixel data, p is the number of the processed Dummy pixel data in each row, c is the number of the processed Dummy pixel data in each column, avr_d (b) is the third average matrix, avr_d (a) is the fourth average matrix;
determining first array data according to the processed pixel data, the first average matrix and the third average matrix, and determining second array data according to the processed pixel data, the second average matrix and the fourth average matrix comprises:
determining the first array data according to the following formula;
H＝X(i,j)-Avr_D(b)+Avr_X(j),j∈[0,M-1],b∈[0,M-1]；
determining the second array data according to the following formula;
L＝X(i,j)-Avr_D(a)+Avr_X(i),i∈[0,N-1],a∈[0,N-1]；
wherein H is the first array data and L is the second array data.
2. The method of generating an infrared image as defined in claim 1, further comprising, after obtaining the processed Dummy pixel data output by the infrared focal plane detector:
acquiring the difference value of the processed Dummy pixel data in the Dummy pixels of two adjacent frames;
judging whether the difference value is larger than a preset threshold value or not;
when the difference value is larger than the preset threshold value, marking the processed Dummy pixel data as abnormal pixel data, and eliminating the abnormal pixel data;
accordingly, determining the third average matrix of the processed Dummy pixel data in the row direction and the fourth average matrix in the column direction includes:
and determining a third average value matrix of the processed Dummy pixel data in the row direction and a fourth average value matrix in the column direction after the abnormal pixel data are removed.
3. The method for generating an infrared image according to claim 2, wherein the processed pixel data is obtained by performing a correct power supply process, a correct configuration process, and a process of adjusting a working balance point on the raw pixel data of the infrared focal plane detector.
4. A method according to any one of claims 1 to 3, wherein the processed Dummy pixel data is obtained by adjusting a Dummy pixel balance point and a Dummy pixel bias voltage of the original Dummy pixel data of the infrared focal plane detector.
5. An infrared image generation apparatus, comprising:
the first acquisition module is used for acquiring processed pixel data output by the infrared focal plane detector;
a first determining module, configured to determine a first average matrix of the processed pixel data in a row direction and a second average matrix of the processed pixel data in a column direction;
the second acquisition module is used for acquiring the processed Dummy pixel data output by the infrared focal plane detector;
a second determining module, configured to determine a third average matrix in a row direction and a fourth average matrix in a column direction of the processed Dummy pixel data;
the generation module is used for determining first array data according to the processed pixel data, the first average value matrix and the third average value matrix, determining second array data according to the processed pixel data, the second average value matrix and the fourth average value matrix, and generating an infrared image according to the first array data and the second array data;
the first determining module is specifically configured to:
determining the first mean matrix according to the following formula;
determining the second mean matrix according to the following formula;
wherein X (i, j) is processed pixel data, i is the array coordinate of the processed pixel data, j is the row coordinate of the processed pixel data, M is the number of rows of the infrared focal plane detector array scale, N is the number of columns of the infrared focal plane detector array scale, avr_X (j) is a first average matrix, avr_X (i) is a second average matrix;
the second determining module is specifically configured to:
determining the third mean matrix according to the following formula;
determining the fourth mean matrix according to the following formula;
wherein D (a, b) is the processed Dummy pixel data, a is the column coordinates of the processed Dummy pixel data, b is the row coordinates of the processed Dummy pixel data, p is the number of the processed Dummy pixel data in each row, c is the number of the processed Dummy pixel data in each column, avr_d (b) is the third average matrix, avr_d (a) is the fourth average matrix;
the generating module is specifically configured to:
determining the first array data according to the following formula;
H＝X(i,j)-Avr_D(b)+Avr_X(j),j∈[0,M-1],b∈[0,M-1]
determining the second array data according to the following formula;
L＝X(i,j)-Avr_D(a)+Avr_X(i),i∈[0,N-1],a∈[0,N-1]
wherein H is the first array data and L is the second array data.
6. An infrared image generation apparatus, comprising:
a memory for storing a computer program;
a processor for implementing the steps of the infrared image generation method as claimed in any one of claims 1 to 4 when executing the computer program.
7. An infrared thermal imaging system comprising an infrared lens assembly, an infrared focal plane detector, a circuit processor, a signal processing device, a display device, the signal processing device comprising the infrared image generation device of claim 6.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010290717.XA CN111524057B (en) | 2020-04-14 | 2020-04-14 | Infrared image generation method, device, equipment and infrared thermal imaging system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010290717.XA CN111524057B (en) | 2020-04-14 | 2020-04-14 | Infrared image generation method, device, equipment and infrared thermal imaging system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN111524057A CN111524057A (en) | 2020-08-11 |
| CN111524057B true CN111524057B (en) | 2023-06-02 |
Family
ID=71901763
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010290717.XA Active CN111524057B (en) | 2020-04-14 | 2020-04-14 | Infrared image generation method, device, equipment and infrared thermal imaging system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111524057B (en) |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104657958A (en) * | 2015-03-18 | 2015-05-27 | 西安科技大学 | Infrared image stripe noise elimination method |
| CN105869129A (en) * | 2015-12-01 | 2016-08-17 | 中国科学院上海技术物理研究所 | Residual heterogeneous noise elimination method for aiming at thermal infrared image after heterogeneous correction |
| CN109903235A (en) * | 2019-01-21 | 2019-06-18 | 天津大学 | A kind of removing method of infrared image fringes noise |
-
2020
- 2020-04-14 CN CN202010290717.XA patent/CN111524057B/en active Active
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104657958A (en) * | 2015-03-18 | 2015-05-27 | 西安科技大学 | Infrared image stripe noise elimination method |
| CN105869129A (en) * | 2015-12-01 | 2016-08-17 | 中国科学院上海技术物理研究所 | Residual heterogeneous noise elimination method for aiming at thermal infrared image after heterogeneous correction |
| CN109903235A (en) * | 2019-01-21 | 2019-06-18 | 天津大学 | A kind of removing method of infrared image fringes noise |
Non-Patent Citations (2)
| Title |
|---|
| 曹扬 ; 金伟其 ; 刘崇亮 ; 刘秀 ; .红外焦平面阵列的自适应非均匀性校正及硬件实现.光学精密工程.2011,(12),全文. * |
| 蔡建荣 ; 严高师 ; 刘昌松 ; 张博 ; .红外焦平面阵列响应度非均匀性的校正算法.红外.2007,(02),全文. * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN111524057A (en) | 2020-08-11 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| JP4798400B2 (en) | Method and apparatus for setting black level of imaging device using optical black pixel and voltage fixed pixel | |
| US8160381B2 (en) | Method and apparatus for image noise reduction using noise models | |
| CN112837303A (en) | Defect detection method, device, equipment and medium for mold monitoring | |
| US8471928B2 (en) | Apparatus and method for generating high ISO image | |
| US8463068B2 (en) | Methods, systems and apparatuses for pixel value correction using multiple vertical and/or horizontal correction curves | |
| US8902336B2 (en) | Dynamic, local edge preserving defect pixel correction for image sensors with spatially arranged exposures | |
| CN110738707A (en) | Distortion correction method, device, equipment and storage medium for cameras | |
| US10186022B2 (en) | System and method for adaptive pixel filtering | |
| CN111161172A (en) | Infrared image column direction stripe eliminating method, system and computer storage medium | |
| CN102870404A (en) | Imaging device and dark current correction method of same | |
| WO2017185441A1 (en) | Infrared image stripe filtering method based on statistical relative stripe removal method | |
| CN103686104A (en) | Image processing apparatus | |
| US10535126B2 (en) | Method of correcting color fringe and method of processing image data using the same | |
| CN110363714B (en) | Non-uniformity correction method based on scene interframe registration of self-adaptive learning rate | |
| CN111383196A (en) | Infrared image stripe eliminating method, infrared detector and storage device | |
| CN111524057B (en) | Infrared image generation method, device, equipment and infrared thermal imaging system | |
| Toczek et al. | Scene-based non-uniformity correction: from algorithm to implementation on a smart camera | |
| CN105005967A (en) | Method and apparatus for correcting non-uniformity of infrared imaging based on combined space-time filtering | |
| US10742914B2 (en) | Head-wearable imaging apparatus with two imaging elements corresponding to a user left eye and right eye, method, and computer readable storage medium for correcting a defective pixel among plural pixels forming each image captured by the two imaging elements based on defective-pixel related position information | |
| KR101418524B1 (en) | Hardware apparatus and method for generating integral image thereof | |
| JP5860298B2 (en) | Image processing apparatus and program | |
| KR20140028938A (en) | Image sensor and method for processing noise thereof | |
| Becker | Low-Cost Spatio-Temporal Algorithm for Defective Pixel Identification and Correction | |
| CN112862708B (en) | Adaptive recognition method of image noise, sensor chip and electronic equipment | |
| CN114205533B (en) | Video frame correction method, electronic device, and computer-readable storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| EE01 | Entry into force of recordation of patent licensing contract | ||
| EE01 | Entry into force of recordation of patent licensing contract |
Application publication date: 20200811 Assignee: INFIRAY TECHNOLOGIES CO.,LTD. Assignor: Yantai Airui Photo-Electric Technology Co.,Ltd. Contract record no.: X2024980006380 Denomination of invention: A method, device, device, and infrared thermal imaging system for generating infrared images Granted publication date: 20230602 License type: Common License Record date: 20240530 |