CN105333960A - Non-uniformity correction and blind pixel replacement method and device of infrared focal plane detector - Google Patents
Non-uniformity correction and blind pixel replacement method and device of infrared focal plane detector Download PDFInfo
- Publication number
- CN105333960A CN105333960A CN201510817449.1A CN201510817449A CN105333960A CN 105333960 A CN105333960 A CN 105333960A CN 201510817449 A CN201510817449 A CN 201510817449A CN 105333960 A CN105333960 A CN 105333960A
- Authority
- CN
- China
- Prior art keywords
- sram
- blind element
- blind
- nonuniformity correction
- fpga controller
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Abstract
The invention discloses a non-uniformity correction and blind pixel replacement method and device of an infrared focal plane detector. The method comprises the following steps that an FPGA controller receives original image data and caches the original image data to a first SRAM; and the FPGA controller reads a blind pixel bitmap and a correction coefficient from a second SRAM, extracts the pixel points of the original image data from the first SRAM, sequentially performs blind pixel judgment and non-uniformity correction on the extracted pixel points, and performs four-point blind pixel replacement after every three pixel points are cached so as to obtain data after non-uniformity correction and blind pixel replacement. According to the invention, excellent parallel processing capability of the FPGA controller and large storage space and high-speed sequential reading and writing functions of the SRAM are combined, so that the real-time property of non-uniformity correction and blind pixel replacement processing is enhanced; and the four-point blind pixel replacement is performed after three pixel points are cached so as to obtain the data after non-uniformity correction and blind pixel replacement, and caching of three lines of data is not needed, so that large-area array image processing can be realized.
Description
Technical field
The present invention relates to infrared acquisition field, especially, relate to a kind of infrared focal plane detector Nonuniformity Correction and blind element replacement method and device.
Background technology
Along with the raising of semiconductor fabrication techniques and the lifting to investigative range, refreshing frequency demand, single-point infrared focal plane detector can not meet application demand.Infrared focal plane array seeker all obtains widespread use in military and civilian field.But by the restriction of the conditions such as the semiconductor material of making devices and technique, there is larger heterogeneity in infrared focal plane detector, its source mainly contains the following aspects:
(1), the nonuniformity of the response characteristic of each array elements in detector.When array has higher stability, this heterogeneity is being fixing as the pattern in plane.
(2), 1/f noise.
(3), electric signal transmission and amplification path is inconsistent.
(4), the impact of infrared optical system, the impact of especially cold screen makes image appearance for centre is bright and surrounding is dark.
The heterogeneity of the image information obtained directly has influence on detection range and image resolution ratio, but this heterogeneity also cannot be eliminated, and can only be reduced by successive image disposal route.But the shortcomings such as existing subsequent treatment algorithm all exists, and calculated amount is large, speed of convergence is slow, rely on the motion of scene and hardware implementing difficulty is large, are especially difficult to the demand meeting real time correction.
Summary of the invention
The invention provides a kind of infrared focal plane detector Nonuniformity Correction and blind element replacement method and device, to solve the technical matters of the not strong and large face system of battle formations of existing infrared focal plane detector heterogeneity image processing algorithm multi-point calibration calculation of complex, real-time as difficult treatment.
The technical solution used in the present invention is as follows:
According to an aspect of the present invention, provide a kind of infrared focal plane detector Nonuniformity Correction and blind element replacement method, based on on-site programmable gate array FPGA controller and two static RAM SRAM, the inventive method comprises:
FPGA controller receives raw image data by raw image data buffer memory to a SRAM;
FPGA controller reads blind element bitmap and correction coefficient from the 2nd SRAM, the pixel of raw image data is extracted from a SRAM, successively blind element judgement and Nonuniformity Correction are carried out to the pixel extracted, and carries out 4 blind elements after every buffer memory three pixels and replace the data obtained after Nonuniformity Correction and blind element are replaced.
Further, the present invention carries out blind element judgement and Nonuniformity Correction successively to the pixel extracted, and carries out 4 blind elements after every buffer memory three pixels and replace the data obtained after Nonuniformity Correction and blind element are replaced and comprise:
Judge whether current pixel point is blind element, if then extract this row pixel of next line and judge whether it is blind element, until the current pixel point extracted is not blind element, as the lower pixel value that 4 blind elements are replaced;
Select between correction coefficient location according to pixel value size, read correction coefficient and one by one Nonuniformity Correction carried out to pixel;
Topmost pixel value, left pixel value and right pixel value that buffer memory 4 blind elements are replaced;
Adopt 4 blind elements to replace and obtain the data after Nonuniformity Correction and blind element are replaced.
Further, the updating formula of Nonuniformity Correction is:
Wherein x (i, j) is the i-th row jth row pixel value, and y (i, j) is the pixel value after nonuniformity correction, k
mand b
mbe respectively m interval and take advantage of correction coefficient and correction factor.
Further, the replacement formula of 4 blind element replacements is:
Wherein i, j represent line number residing for blind element pixel and row number.
Further, the read/write address of buffer memory the one SRAM in FPGA controller, with the raw image data in batch extracting the one SRAM.
Further, the Nonuniformity Correction obtained after treatment in FPGA controller and blind element replace after data buffer storage after pass interface through number and be passed to next terminal.
According to a further aspect in the invention, a kind of infrared focal plane detector Nonuniformity Correction and blind element alternative are provided, it is characterized in that, comprising: on-site programmable gate array FPGA controller, a SRAM, the 2nd SRAM;
2nd SRAM stores blind element bitmap and correction coefficient and is connected confession FPGA controller with FPGA controller and reads;
FPGA controller is connected with the image input interface for importing raw image data; FPGA controller comprises:
Image buffer storage module, connection layout as input interface and a SRAM, for will receive raw image data buffer memory the one SRAM;
Image processing module, for reading blind element bitmap and correction coefficient from the 2nd SRAM, the pixel of raw image data is extracted from a SRAM, successively blind element judgement and Nonuniformity Correction are carried out to the pixel extracted, and carries out 4 blind elements after every buffer memory three pixels and replace the data obtained after Nonuniformity Correction and blind element are replaced.
Further, FPGA controller also comprises:
Address caching module, for the read/write address of buffer memory the one SRAM, with the raw image data in batch extracting the one SRAM.
Further, infrared focal plane detector Nonuniformity Correction of the present invention and blind element alternative also comprise:
Number passes interface, connects FPGA controller, for being passed to next terminal by after the data buffer storage after the Nonuniformity Correction obtained after treatment in FPGA controller and blind element replacement.
The present invention has following beneficial effect:
Infrared focal plane detector Nonuniformity Correction of the present invention and blind element replacement method and device, in conjunction with the parallel processing capability of FPGA controller excellence and the large storage space of SRAM and high-speed sequential read-write capability, enhance the real-time of Nonuniformity Correction and blind element replacement process, and after buffer memory three pixels, carry out 4 blind elements replace the data obtained after Nonuniformity Correction and blind element are replaced, do not need buffer memory three row data, large face battle array image procossing can be realized, and multi-point calibration is only relevant with the number of resources of SRAM and FPGA controller, increase and demarcate the count time complexity and space complexity that can not increase algorithm process, and then real-time multi-point calibration large battle array infrared focal plane detector Nonuniformity Correction and blind element replacement can be realized.
Except object described above, feature and advantage, the present invention also has other object, feature and advantage.Below with reference to figure, the present invention is further detailed explanation.
Accompanying drawing explanation
The accompanying drawing forming a application's part is used to provide a further understanding of the present invention, and schematic description and description of the present invention, for explaining the present invention, does not form inappropriate limitation of the present invention.In the accompanying drawings:
Fig. 1 is the structural representation of preferred embodiment of the present invention infrared focal plane detector Nonuniformity Correction and blind element alternative;
Fig. 2 is the schematic flow sheet of preferred embodiment of the present invention infrared focal plane detector Nonuniformity Correction and blind element replacement method;
Fig. 3 is that preferred embodiment of the present invention blind element replaces schematic diagram.
Description of reference numerals:
100, FPGA controller; 110, image buffer storage module; 120, image processing module; 130, address caching module;
200, a SRAM;
300, the 2nd SRAM;
400, image input interface;
500, number passes interface.
Embodiment
It should be noted that, when not conflicting, the embodiment in the application and the feature in embodiment can combine mutually.Below with reference to the accompanying drawings and describe the present invention in detail in conjunction with the embodiments.
The preferred embodiments of the present invention provide a kind of infrared focal plane detector Nonuniformity Correction and blind element replacement method, with reference to Fig. 1 and Fig. 2, the inventive method is based on on-site programmable gate array FPGA controller 100 and two static RAM SRAM, an i.e. SRAM200 and the 2nd SRAM300, to realize real-time multi-point calibration large battle array infrared focal plane detector Nonuniformity Correction and blind element replacement.
With reference to Fig. 2, the inventive method comprises the following steps:
Data stream 1, raw image data after FPGA controller 100 buffer memory in a SRAM200.In the present embodiment, FPGA controller 100 receives raw image data through image input interface 400, and the raw image data received is stored in a SRAM200 by FPGA controller 100 after multiway images exports integration and data bit is spliced.
Data stream 2, FPGA controller 100 reads blind element bitmap and correction coefficient from the 2nd SRAM300, the pixel of raw image data is extracted from a SRAM200, successively blind element judgement and Nonuniformity Correction are carried out to the pixel extracted, and carries out 4 blind elements after every buffer memory three pixels and replace the data obtained after Nonuniformity Correction and blind element are replaced.Detailed process is as follows:
FPGA controller 100 reads a line blind element data bitmap from the 2nd SRAM300.
Whether FPGA controller 100 judges that current line works as prostatitis pixel is blind element, then from a SRAM200, reads this row pixel value of next line in this way, as otherwise from a SRAM200, read this row pixel value of current line.Preferably, because SRAM reads and writes speed higher than image input rate, the read/write address of buffer memory SRAM in FPGA, realizes batch data operation, realizes storage and the output of image in same a slice SRAM.
Select between correction coefficient location according to pixel value size, need equally to judge whether current pixel is blind element, then read next line this row pixel value in this way, as otherwise read this row pixel value of current line, object is the lower pixel value that acquisition 4 blind elements are replaced.
Individual element corrects its heterogeneity, and updating formula is:
Wherein x (i, j) is the i-th row jth row pixel value, and y (i, j) is the pixel value after nonuniformity correction, k
mand b
mbe respectively m interval and take advantage of correction coefficient and correction factor.
Judge whether next line is blind element pixel, then store this row pixel value of current line in this way, object is the topmost pixel value that acquisition 4 blind elements are replaced.
Topmost pixel value, left pixel value and right pixel value that buffer memory 4 blind elements are replaced.
Due to top, left and right pixel buffer memory, lower pixel is stored in current pixel, and can complete 4 blind elements and replace, as shown in Figure 3, replacement formula is:
Wherein i, j represent line number residing for blind element pixel and row number.
Preferably, the Nonuniformity Correction obtained after treatment in FPGA controller 100 and blind element replace after data buffer storage after pass interface 500 through number and be passed to next terminal, for subsequent applications.
According to a further aspect in the invention, provide a kind of infrared focal plane detector Nonuniformity Correction and blind element alternative, with reference to Fig. 1, the present embodiment device comprises: on-site programmable gate array FPGA controller 100, a SRAM200, the 2nd SRAM300;
2nd SRAM300 stores blind element bitmap and correction coefficient and is connected confession FPGA controller 100 with FPGA controller 100 and reads;
FPGA controller 100 is connected with the image input interface 400 for importing raw image data; FPGA controller 100 comprises:
Image buffer storage module 110, connection layout as input interface 400 and a SRAM200, for will receive raw image data buffer memory the one SRAM200;
Image processing module 120, for reading blind element bitmap and correction coefficient from the 2nd SRAM300, the pixel of raw image data is extracted from a SRAM200, successively blind element judgement and Nonuniformity Correction are carried out to the pixel extracted, and carries out 4 blind elements after every buffer memory three pixels and replace the data obtained after Nonuniformity Correction and blind element are replaced.
Preferably, FPGA controller 100 also comprises:
Address caching module 130, for the read/write address of buffer memory the one SRAM200, with the raw image data in batch extracting the one SRAM200.
Preferably, infrared focal plane detector Nonuniformity Correction of the present invention and blind element alternative also comprise:
Number passes interface 500, connects FPGA controller 100, for being passed to next terminal by after the data buffer storage after the Nonuniformity Correction obtained after treatment in FPGA controller 100 and blind element replacement.
Can learn from above description, the present embodiment is in conjunction with the parallel processing capability of FPGA controller excellence and the large storage space of SRAM and high-speed sequential read-write capability, enhance the real-time of Nonuniformity Correction and blind element replacement process, and after buffer memory three pixels, carry out 4 blind elements replace the data obtained after Nonuniformity Correction and blind element are replaced, do not need buffer memory three row data, large face battle array image procossing can be realized, and multi-point calibration is only relevant with the number of resources of SRAM and FPGA controller, increase and demarcate the count time complexity and space complexity that can not increase algorithm process, and then real-time multi-point calibration large battle array infrared focal plane detector Nonuniformity Correction and blind element replacement can be realized.
The foregoing is only the preferred embodiments of the present invention, be not limited to the present invention, for a person skilled in the art, the present invention can have various modifications and variations.Within the spirit and principles in the present invention all, any amendment done, equivalent replacement, improvement etc., all should be included within protection scope of the present invention.
Claims (9)
1. infrared focal plane detector Nonuniformity Correction and a blind element replacement method, is characterized in that, based on on-site programmable gate array FPGA controller (100) and two static RAM SRAM, described method comprises:
FPGA controller (100) receive raw image data and by described raw image data buffer memory to a SRAM(200);
FPGA controller (100) is from the 2nd SRAM(300) read blind element bitmap and correction coefficient, from a described SRAM(200) extract the pixel of raw image data, successively blind element judgement and Nonuniformity Correction are carried out to the pixel extracted, and carries out 4 blind elements after every buffer memory three pixels and replace the data obtained after Nonuniformity Correction and blind element are replaced.
2. infrared focal plane detector Nonuniformity Correction according to claim 1 and blind element replacement method, it is characterized in that, the described pixel to extracting carries out blind element judgement and Nonuniformity Correction successively, and carries out 4 blind elements after every buffer memory three pixels and replace the data obtained after Nonuniformity Correction and blind element are replaced and comprise:
Judge whether current pixel point is blind element, if then extract this row pixel of next line and judge whether it is blind element, until the current pixel point extracted is not blind element, as the lower pixel value that 4 blind elements are replaced;
Select between correction coefficient location according to pixel value size, read correction coefficient and one by one Nonuniformity Correction carried out to pixel;
Topmost pixel value, left pixel value and right pixel value that buffer memory 4 blind elements are replaced;
Adopt 4 blind elements to replace and obtain the data after Nonuniformity Correction and blind element are replaced.
3. infrared focal plane detector Nonuniformity Correction according to claim 2 and blind element replacement method, is characterized in that, the updating formula of described Nonuniformity Correction is:
Wherein x (i, j) is the i-th row jth row pixel value, and y (i, j) is the pixel value after nonuniformity correction, k
mand b
mbe respectively m interval and take advantage of correction coefficient and correction factor.
4. infrared focal plane detector Nonuniformity Correction according to claim 2 and blind element replacement method, is characterized in that, the replacement formula that described 4 blind elements are replaced is:
Wherein i, j represent line number residing for blind element pixel and row number.
5. infrared focal plane detector Nonuniformity Correction according to claim 1 and blind element replacement method, is characterized in that,
A SRAM(200 described in described FPGA controller (100) interior buffer memory) read/write address, with a SRAM(200 described in batch extracting) in raw image data.
6. infrared focal plane detector Nonuniformity Correction according to claim 1 and blind element replacement method, is characterized in that,
The Nonuniformity Correction obtained after treatment in described FPGA controller (100) and blind element replace after data buffer storage after pass interface (500) through number and be passed to next terminal.
7. infrared focal plane detector Nonuniformity Correction and a blind element alternative, is characterized in that, comprising: on-site programmable gate array FPGA controller (100), a SRAM(200), the 2nd SRAM(300);
Described 2nd SRAM(300) store blind element bitmap and correction coefficient and be connected with described FPGA controller (100) and read for described FPGA controller (100);
Described FPGA controller (100) is connected with the image input interface (400) for importing raw image data; Described FPGA controller (100) comprising:
Image buffer storage module (110), connects described image input interface (400) and a described SRAM(200), for will receive raw image data buffer memory described in a SRAM(200);
Image processing module (120), for from the 2nd SRAM(300) read blind element bitmap and correction coefficient, from a described SRAM(200) extract the pixel of raw image data, successively blind element judgement and Nonuniformity Correction are carried out to the pixel extracted, and carries out 4 blind elements after every buffer memory three pixels and replace the data obtained after Nonuniformity Correction and blind element are replaced.
8. infrared focal plane detector Nonuniformity Correction according to claim 7 and blind element alternative, is characterized in that,
Described FPGA controller (100) also comprises:
Address caching module (130), for a SRAM(200 described in buffer memory) read/write address, with a SRAM(200 described in batch extracting) in raw image data.
9. infrared focal plane detector Nonuniformity Correction according to claim 7 and blind element alternative, is characterized in that, also comprise:
Number passes interface (500), connects described FPGA controller (100), for being passed to next terminal by after the data buffer storage after the Nonuniformity Correction obtained after treatment in described FPGA controller (100) and blind element replacement.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510817449.1A CN105333960A (en) | 2015-11-23 | 2015-11-23 | Non-uniformity correction and blind pixel replacement method and device of infrared focal plane detector |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510817449.1A CN105333960A (en) | 2015-11-23 | 2015-11-23 | Non-uniformity correction and blind pixel replacement method and device of infrared focal plane detector |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN105333960A true CN105333960A (en) | 2016-02-17 |
Family
ID=55284615
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201510817449.1A Pending CN105333960A (en) | 2015-11-23 | 2015-11-23 | Non-uniformity correction and blind pixel replacement method and device of infrared focal plane detector |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN105333960A (en) |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109974857A (en) * | 2017-12-27 | 2019-07-05 | 上海德运光电技术有限公司 | A kind of extensive infrared focus plane Real-time Nonuniformity Correction system and method |
| CN110852976A (en) * | 2019-11-22 | 2020-02-28 | 昆明物理研究所 | Infrared image brightness unevenness correction method and computer program product |
| CN114913096A (en) * | 2022-06-10 | 2022-08-16 | 中国科学院长春光学精密机械与物理研究所 | Non-uniform correction method and system for characteristic initialization |
| CN117221747A (en) * | 2023-11-09 | 2023-12-12 | 海豚乐智科技(成都)有限责任公司 | SOPC-based single-period dead pixel compensation and non-uniform correction method |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101666682A (en) * | 2009-08-06 | 2010-03-10 | 重庆邮电大学 | Neural network nonuniformity correction method based on scene statistics |
| US20100158407A1 (en) * | 2008-12-19 | 2010-06-24 | L3 Communications Integrated Systems, L.P. | System for non-uniformity correction for image processing |
| CN101957982A (en) * | 2010-10-11 | 2011-01-26 | 华中科技大学 | Real-time infrared image processing system suitable for high frame rate and large array infrared detector |
-
2015
- 2015-11-23 CN CN201510817449.1A patent/CN105333960A/en active Pending
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20100158407A1 (en) * | 2008-12-19 | 2010-06-24 | L3 Communications Integrated Systems, L.P. | System for non-uniformity correction for image processing |
| CN101666682A (en) * | 2009-08-06 | 2010-03-10 | 重庆邮电大学 | Neural network nonuniformity correction method based on scene statistics |
| CN101957982A (en) * | 2010-10-11 | 2011-01-26 | 华中科技大学 | Real-time infrared image processing system suitable for high frame rate and large array infrared detector |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109974857A (en) * | 2017-12-27 | 2019-07-05 | 上海德运光电技术有限公司 | A kind of extensive infrared focus plane Real-time Nonuniformity Correction system and method |
| CN110852976A (en) * | 2019-11-22 | 2020-02-28 | 昆明物理研究所 | Infrared image brightness unevenness correction method and computer program product |
| CN114913096A (en) * | 2022-06-10 | 2022-08-16 | 中国科学院长春光学精密机械与物理研究所 | Non-uniform correction method and system for characteristic initialization |
| CN114913096B (en) * | 2022-06-10 | 2024-04-23 | 中国科学院长春光学精密机械与物理研究所 | Feature initialization non-uniform correction method and system thereof |
| CN117221747A (en) * | 2023-11-09 | 2023-12-12 | 海豚乐智科技(成都)有限责任公司 | SOPC-based single-period dead pixel compensation and non-uniform correction method |
| CN117221747B (en) * | 2023-11-09 | 2024-01-26 | 海豚乐智科技(成都)有限责任公司 | SOPC-based single-period dead pixel compensation and non-uniform correction method |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN112329658B (en) | Detection algorithm improvement method for YOLOV3 network | |
| Shi et al. | Normalised gamma transformation‐based contrast‐limited adaptive histogram equalisation with colour correction for sand–dust image enhancement | |
| CN109934153B (en) | Building extraction method based on gating depth residual error optimization network | |
| CN108510451B (en) | Method for reconstructing license plate based on double-layer convolutional neural network | |
| CN111553929A (en) | Mobile phone screen defect segmentation method, device and equipment based on converged network | |
| CN105333960A (en) | Non-uniformity correction and blind pixel replacement method and device of infrared focal plane detector | |
| CN112288008B (en) | Mosaic multispectral image disguised target detection method based on deep learning | |
| Kim et al. | High-speed drone detection based on yolo-v8 | |
| CN106529517A (en) | Image processing method and image processing device | |
| CN108304821A (en) | Image-recognizing method and device, image acquiring method and equipment, computer equipment and non-volatile computer readable storage medium storing program for executing | |
| CN110349087B (en) | RGB-D image high-quality grid generation method based on adaptive convolution | |
| CN110097106A (en) | The low-light-level imaging algorithm and device of U-net network based on deep learning | |
| CN109255758A (en) | Image enchancing method based on full 1*1 convolutional neural networks | |
| CN108875820A (en) | Information processing method and device, electronic equipment, computer readable storage medium | |
| CN105825219A (en) | Machine vision detection system | |
| Cui et al. | Improved swin transformer-based semantic segmentation of postearthquake dense buildings in urban areas using remote sensing images | |
| CN111582074A (en) | Monitoring video leaf occlusion detection method based on scene depth information perception | |
| CN110599455A (en) | Display screen defect detection network model, method and device, electronic equipment and storage medium | |
| CN111294520B (en) | FPGA-based real-time lucky imaging method and system | |
| CN109919832A (en) | One kind being used for unpiloted traffic image joining method | |
| Liu et al. | Large size single image fast defogging and the real time video defogging FPGA architecture | |
| CN106469440B (en) | Dark defogging parallel optimization method based on OpenCL | |
| Zhou et al. | An underwater target recognition method based on improved YOLOv4 in complex marine environment | |
| CN111027542A (en) | Target detection method improved based on fast RCNN algorithm | |
| CN110533608A (en) | Image band noise suppressing method and its device, electronic equipment, storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20160217 |
|
| RJ01 | Rejection of invention patent application after publication |