CN103198462B - Intense radiation resistant visual sensing device based on information fusion - Google Patents
Intense radiation resistant visual sensing device based on information fusion Download PDFInfo
- Publication number
- CN103198462B CN103198462B CN201310117891.4A CN201310117891A CN103198462B CN 103198462 B CN103198462 B CN 103198462B CN 201310117891 A CN201310117891 A CN 201310117891A CN 103198462 B CN103198462 B CN 103198462B
- Authority
- CN
- China
- Prior art keywords
- image
- image information
- information
- spectroscope
- module
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 230000005855 radiation Effects 0.000 title claims abstract description 65
- 230000000007 visual effect Effects 0.000 title claims abstract description 28
- 230000004927 fusion Effects 0.000 title claims abstract description 21
- 230000010365 information processing Effects 0.000 claims abstract description 34
- 238000012545 processing Methods 0.000 claims abstract description 22
- 238000012937 correction Methods 0.000 claims abstract description 13
- 238000007500 overflow downdraw method Methods 0.000 claims abstract description 12
- 238000003709 image segmentation Methods 0.000 claims abstract description 11
- 238000004364 calculation method Methods 0.000 claims abstract description 7
- 238000004891 communication Methods 0.000 claims description 13
- 238000003384 imaging method Methods 0.000 claims description 12
- 230000003014 reinforcing effect Effects 0.000 claims 4
- 238000011084 recovery Methods 0.000 claims 2
- 230000005540 biological transmission Effects 0.000 claims 1
- 230000015572 biosynthetic process Effects 0.000 claims 1
- 238000000605 extraction Methods 0.000 claims 1
- 230000014509 gene expression Effects 0.000 claims 1
- 238000000034 method Methods 0.000 abstract description 7
- 230000003287 optical effect Effects 0.000 description 14
- 230000000694 effects Effects 0.000 description 7
- 238000010219 correlation analysis Methods 0.000 description 6
- 238000005314 correlation function Methods 0.000 description 6
- 230000010354 integration Effects 0.000 description 5
- 230000003471 anti-radiation Effects 0.000 description 4
- 238000010586 diagram Methods 0.000 description 4
- 238000006243 chemical reaction Methods 0.000 description 3
- 230000002787 reinforcement Effects 0.000 description 3
- 238000004458 analytical method Methods 0.000 description 2
- 238000011161 development Methods 0.000 description 2
- 230000018109 developmental process Effects 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 230000005865 ionizing radiation Effects 0.000 description 2
- 230000005693 optoelectronics Effects 0.000 description 2
- 230000003321 amplification Effects 0.000 description 1
- 230000002596 correlated effect Effects 0.000 description 1
- 230000007812 deficiency Effects 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 238000002955 isolation Methods 0.000 description 1
- 238000005259 measurement Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000003199 nucleic acid amplification method Methods 0.000 description 1
- 230000001737 promoting effect Effects 0.000 description 1
- 230000000191 radiation effect Effects 0.000 description 1
- 238000012360 testing method Methods 0.000 description 1
Landscapes
- Image Processing (AREA)
- Transforming Light Signals Into Electric Signals (AREA)
Abstract
本发明公开了一种基于信息融合的抗强辐射视觉传感装置，其包括图像信息获取装置(1)和图像信息处理装置(3)；图像信息获取装置(1)包括聚焦镜头(11)、分光镜(12)和两个图像传感器（13、14）；图像信息处理装置(3)包括数字处理装置和图像信息还原模块；图像信息还原模块包括图像分割模块、图像亮度几何校正模块和信息融合法噪点剔除模块；信息融合法噪点剔除模块对经过图像亮度几何校正模块处理的图像对进行相关性建模，执行运算操作得到干扰前的图像信息。其可以有效地降低强辐射对视觉传感器的影响，大大提高强辐射环境视觉传感的鲁棒性，保证高质量目标场景图像信息获取。
The invention discloses an anti-strong radiation visual sensing device based on information fusion, which includes an image information acquisition device (1) and an image information processing device (3); the image information acquisition device (1) includes a focusing lens (11), The spectroscope (12) and two image sensors (13, 14); the image information processing device (3) includes a digital processing device and an image information restoration module; the image information restoration module includes an image segmentation module, an image brightness geometric correction module and information fusion The method noise removal module; the information fusion method noise removal module performs correlation modeling on the image pairs processed by the image brightness geometric correction module, and performs calculation operations to obtain image information before interference. It can effectively reduce the impact of strong radiation on visual sensors, greatly improve the robustness of visual sensing in strong radiation environments, and ensure the acquisition of high-quality target scene image information.
Description
技术领域technical field
本发明涉及精密测量领域，其是一种视觉传感装置，其特别是一种基于信息融合的抗强辐射视觉传感装置。The invention relates to the field of precision measurement, which is a visual sensing device, in particular, an anti-strong radiation visual sensing device based on information fusion.
背景技术Background technique
视觉传感器（也可以叫图像传感器，或者叫电荷耦合元件，英文Charge-coupledDevice，简称CCD）属于光电产业里的光电元件，其核心为有源像元构成的光敏元阵列，此外还包括时序和控制电路、功能电路、模拟信号的处理与输出接口等，CCD能够把光学影像转化为数字信号，即把图像像素转换成数字信号，就像胶片一样。空间辐射环境中辐射作用会对光电元器件性能造成损坏，严重降低获取视觉信息的质量，降低传感器使用寿命。目前，视觉传感器抗辐射主要措施是采取像元电子电路内部结构加固和辐射隔离。像元电子电路内部结构加固主要有两种方式，一是，为了避免单粒子翻转效应而采取了锁存器的冗余锁存结构，即将数据锁存在两个以上不同的地方，采取适当反馈的形式，在单粒子事件之后，将被破坏的数据恢复过来；二是，为了增强抗总剂量辐射能力和减轻单粒子闩锁效应的影响，采取了环型栅和保护环结构达到加固的目的。目前采取的这些抗辐射方法，虽然可以达到一定的抗辐射效果，但这些方法技术复杂，处理成本高，并且这些措施抗辐射效果不明显，噪音(图像噪点)高，难以达到消除辐射所产生的信号噪音的理想效果。Visual sensors (also called image sensors, or charge-coupled devices, English Charge-coupled Device, referred to as CCD) are optoelectronic components in the optoelectronic industry. Circuits, functional circuits, analog signal processing and output interfaces, etc., CCD can convert optical images into digital signals, that is, convert image pixels into digital signals, just like film. The radiation effect in the space radiation environment will cause damage to the performance of photoelectric components, seriously reduce the quality of visual information obtained, and reduce the service life of sensors. At present, the main anti-radiation measures of visual sensors are to adopt the internal structure reinforcement and radiation isolation of the electronic circuit of the pixel. There are two main ways to strengthen the internal structure of the electronic circuit of the pixel. One is to adopt the redundant latch structure of the latch in order to avoid the single event flipping effect, that is, to lock the data in two or more different places, and adopt appropriate feedback The form, after the single event event, restores the destroyed data; the second is, in order to enhance the anti-total dose radiation ability and reduce the impact of single event latch-up effect, the ring gate and guard ring structure are adopted to achieve the purpose of reinforcement. Although the anti-radiation methods currently adopted can achieve a certain anti-radiation effect, these methods are complex in technology and high in processing costs, and the anti-radiation effect of these measures is not obvious, and the noise (image noise) is high, so it is difficult to eliminate the effects of radiation. Ideal for signal-to-noise effects.
发明内容Contents of the invention
本发明的目的是克服现有技术的上述不足而提供一种基于信息融合的抗强辐射视觉传感装置，其可以有效地降低强辐射对视觉传感器的影响，大大提高强辐射环境视觉传感的鲁棒性，保证高质量目标场景图像信息的获取。The purpose of the present invention is to overcome the above-mentioned deficiencies of the prior art and provide a kind of anti-strong radiation visual sensing device based on information fusion, which can effectively reduce the influence of strong radiation on the visual sensor, and greatly improve the performance of strong radiation environment visual sensing. Robustness ensures the acquisition of high-quality target scene image information.
本发明的技术方案是：一种基于信息融合的抗强辐射视觉传感装置，其包括图像信息获取装置和图像信息处理装置；图像信息获取装置包括聚焦镜头、分光镜和两个图像传感器，聚焦镜头为凸透镜，分光镜位于聚焦镜头聚焦的光路上，一个图像传感器位于分光镜的一条光路上，另一个图像传感器位于分光镜的另一条光路上；图像信息获取装置与图像信息处理装置之间通过通讯系统连接，其可以将图像信息获取装置采集的图像信息传送给图像信息处理装置；图像信息处理装置包括数字处理装置和图像信息还原模块；数字处理装置包括输入接口、存贮器、处理器和输出接口；图像信息还原模块置于数字处理装置中，其包括图像分割模块、图像亮度几何校正模块和信息融合法噪点剔除模块，图像分割模块可以分别将从图像信息获取装置传送来的两路图像信息进行分割，选取两路图像的同一图像画面区域，以保证图像画面区域的一致性；图像亮度几何校正模块可以分别对经过图像分割模块提取的同一区域同一时刻的两路图像信息的几何差异和亮度差异进行校正，得到同一场景区域同一时刻的两路图像信息的几何关系和亮度信息一致，形成图像对；信息融合法噪点剔除模块对经过图像亮度几何校正模块处理的图像对进行相关性建模，执行运算操作得到干扰前的图像信息，即可剔除辐射干扰产生的图像噪点，还原出辐射干扰前的图像信息。The technical solution of the present invention is: an anti-strong radiation visual sensing device based on information fusion, which includes an image information acquisition device and an image information processing device; the image information acquisition device includes a focusing lens, a beam splitter and two image sensors, focusing The lens is a convex lens, the beam splitter is located on the optical path focused by the focusing lens, one image sensor is located on one optical path of the beam splitter, and the other image sensor is located on the other optical path of the beam splitter; the image information acquisition device and the image information processing device pass through The communication system is connected, and it can transmit the image information collected by the image information acquisition device to the image information processing device; the image information processing device includes a digital processing device and an image information restoration module; the digital processing device includes an input interface, a memory, a processor and Output interface; the image information restoration module is placed in the digital processing device, which includes an image segmentation module, an image brightness geometric correction module and an information fusion method noise removal module. The information is segmented, and the same image frame area of the two images is selected to ensure the consistency of the image frame area; the image brightness geometric correction module can separately analyze the geometric difference and The brightness difference is corrected, and the geometric relationship and the brightness information of the two image information in the same scene area at the same time are consistent to form an image pair; the noise removal module of the information fusion method performs correlation modeling on the image pair processed by the image brightness geometric correction module , execute the calculation operation to obtain the image information before the interference, then the image noise caused by the radiation interference can be eliminated, and the image information before the radiation interference can be restored.
本发明进一步的技术方案是：所述的另一个图像传感器与分光镜之间设有另一个分光镜，另一分光镜位于前一分光镜的另一条光路上，另一个图像传感器位于另一分光镜的一条光路上。A further technical solution of the present invention is: another beam splitter is arranged between the other image sensor and the beam splitter, the other beam splitter is located on another optical path of the previous beam splitter, and the other image sensor is located on another beam splitter. A light path of the mirror.
本发明更进一步的技术方案是：所述的通讯系统为电缆及其接口或者为无线通讯系统。A further technical solution of the present invention is: the communication system is a cable and its interface or a wireless communication system.
本发明再进一步的技术方案是：所述的图像传感器、通讯系统上还设有加固硬件，加固硬件可以减少辐射干扰的影响，以减少图像噪点。A further technical solution of the present invention is: the image sensor and the communication system are further provided with hardening hardware, which can reduce the influence of radiation interference to reduce image noise.
本发明还进一步的技术方案是：所述的分光镜还级联一个以上的分光镜，每个分光镜多分出的一条光路上均设有一个图像传感器，即分光镜形成级联，多个图像传感器采集的多路图像信息分别传送给图像信息处理装置，图像信息处理装置将多路图像信息进行两两组合，得到多对图像对，每一对图像对通过图像信息处理装置还原出一组辐射干扰前的图像信息，图像信息处理装置可将这些还原出的多组辐射干扰前的图像信息进行综合，得到更精确的辐射干扰前的图像信息。A further technical solution of the present invention is: the beam splitter is also cascaded with more than one beam splitter, and an image sensor is arranged on one more optical path of each beam splitter, that is, the beam splitter forms a cascade, and multiple images The multiple image information collected by the sensor is sent to the image information processing device respectively, and the image information processing device combines the multiple image information in pairs to obtain multiple image pairs, and each image pair restores a set of radiation through the image information processing device. For the image information before the interference, the image information processing device can synthesize the multiple sets of restored image information before the radiation interference to obtain more accurate image information before the radiation interference.
本发明还进一步的技术方案是：所述的聚焦镜头的焦距可调；数字处理装置为能进行数字信号处理的计算机。A further technical solution of the present invention is: the focal length of the focusing lens is adjustable; the digital processing device is a computer capable of digital signal processing.
本发明与现有技术相比具有如下特点：Compared with the prior art, the present invention has the following characteristics:
1.同一成像区域的双源视觉传感器（即双图像传感器）同时受到污染概率很小，采用双视觉信息融合，构建强辐射环境下多视觉传感信息融合框架(即调用信息融合法噪点剔除模块对两路图像信息进行相关性建模，运算后，剔除辐射干扰产生的图像噪点信息，得到辐射干扰前的图像信息，即还原出辐射干扰前的图像信息)，有效地降低强辐射对视觉传感器的影响，大大提高了强辐射环境视觉传感的鲁棒性，保证高质量目标场景图像信息获取。1. Dual-source visual sensors (i.e., dual-image sensors) in the same imaging area have a low probability of being polluted at the same time. Dual-visual information fusion is used to build a multi-visual sensing information fusion framework in a strong radiation environment (that is, call the information fusion method to remove noise. Correlation modeling is carried out on the two-way image information, and after calculation, the image noise information caused by radiation interference is eliminated, and the image information before radiation interference is obtained, that is, the image information before radiation interference is restored), effectively reducing the impact of strong radiation on the visual sensor The impact of this method greatly improves the robustness of visual sensing in strong radiation environments and ensures the acquisition of high-quality target scene image information.
2.其体积小、集成度高、精度高，可以广泛用于航空航天、核资源开发，对推动航空航天、核资源开发可产生积极的意义。2. Its small size, high integration and high precision can be widely used in the development of aerospace and nuclear resources, and can have positive significance in promoting the development of aerospace and nuclear resources.
3.分光镜与图像传感器可构成多级级联，能进一步提高图像信息还原的精确度。3. The beam splitter and the image sensor can form a multi-level cascade, which can further improve the accuracy of image information restoration.
为了更清楚地说明本发明，列举以下实施例，但其对发明的范围无任何限制。In order to illustrate the present invention more clearly, the following examples are cited, but they do not limit the scope of the invention in any way.
附图说明Description of drawings
图1为本发明的结构框图；Fig. 1 is a structural block diagram of the present invention;
图2为发明的图像信息获取装置的结构框图；Fig. 2 is the structural block diagram of the image information acquiring device of the invention;
图3为发明的图像信息处理装置的数字处理装置的结构框图；Fig. 3 is a structural block diagram of the digital processing device of the image information processing device of the invention;
图4为发明的工作流程原理示意图。Fig. 4 is a schematic diagram of the workflow principle of the invention.
具体实施方式detailed description
实施例1Example 1
如图1所示，一种基于信息融合的抗强辐射视觉传感装置，其包括图像信息获取装置1和图像信息处理装置3；如图2所示，图像信息获取装置1包括聚焦镜头11、分光镜12和两个图像传感器（13、14），聚焦镜头11为凸透镜，其焦距可调，分光镜12可以将单一光路（来自场景光源）分成两路光路，即分光镜12可以将同一图像画面分成相同的两路图像画面，分光镜12位于聚焦镜头11聚焦的光路上，一个图像传感器13位于分光镜12的一条光路上，另一个图像传感器14位于分光镜12的另一条光路上，图像传感器14与分光镜12还可以增加一个分光镜15，分光镜15将前一级分光镜（即分光镜12）的一条光路又分成两路光路，这样就可以形成多级级联关系（附图中没有示出），可为两个以上的图像传感器同时采集同一光源图像提供条件，总之，多个分光镜可实现多个图像传感器同时采集同一图像；分光镜可以解决不同图像传感器同一时刻处于不同视角采集同一场景图像不相同从而无法进行图像比较的问题，即若不采用分光镜，不同图像传感器处于不同位置，采集的图像不会完全一样，难以进行图像比较分析，难以实现本发明的目的；同时，同一聚焦镜头11也保证了不同图像传感器（即CCD）采集图像的一致性，如果两路图像传感器分别通过聚焦镜头对场景进行信号采集，由于各聚焦镜头镜头的焦距与取景角度有差别，所以两幅图像也无法完全重合，同样难以进行图像比较分析，难以实现本发明的目的；当在电离辐射环境下，图像传感器（即CCD）在电离辐射环境下会产生随机分布的噪点（即由辐射干扰在图像的某个位置产生的图像斑点），这些噪点信息的分布是随机的，即两路图像传感器由电离辐射引入的噪点是不相关的，发明人通过试验照片也清楚地看到，在辐照环境下，图像传感器传回的画面产生了噪点，噪点出现的位置是随机的，不同图像传感器传送来的两幅图像中的噪点完全一样的概率也几乎为零。As shown in Figure 1, a kind of anti-strong radiation visual sensing device based on information fusion, it comprises image information acquiring device 1 and image information processing device 3; As shown in Figure 2, image information acquiring device 1 comprises focusing lens 11, The beam splitter 12 and two image sensors (13, 14), the focusing lens 11 is a convex lens with adjustable focal length, the beam splitter 12 can divide a single optical path (from the scene light source) into two optical paths, that is, the beam splitter 12 can divide the same image The picture is divided into the same two-way image picture, the beam splitter 12 is located on the optical path focused by the focusing lens 11, an image sensor 13 is located on one optical path of the beam splitter 12, and the other image sensor 14 is located on another optical path of the beam splitter 12, the image The sensor 14 and the beam splitter 12 can also add a beam splitter 15. The beam splitter 15 divides an optical path of the previous stage beam splitter (that is, the beam splitter 12) into two optical paths, so that a multi-level cascade relationship can be formed. not shown in ), which can provide conditions for more than two image sensors to simultaneously capture images of the same light source. In short, multiple beam splitters can enable multiple image sensors to capture the same image at the same time; The problem that the images of the same scene collected by the angle of view are not the same so that image comparison cannot be performed, that is, if the beam splitter is not used, different image sensors are in different positions, the collected images will not be exactly the same, it is difficult to perform image comparison and analysis, and it is difficult to achieve the purpose of the present invention; At the same time, the same focusing lens 11 also ensures the consistency of images collected by different image sensors (i.e. CCD). Therefore, the two images cannot be completely overlapped, and it is also difficult to perform image comparison and analysis, and it is difficult to achieve the purpose of the present invention; when in an ionizing radiation environment, the image sensor (i.e. CCD) will generate random distribution noise points (i.e. by The image spots generated by radiation interference at a certain position of the image), the distribution of these noise information is random, that is, the noise introduced by the ionizing radiation of the two image sensors is irrelevant, the inventor also clearly sees through the test photos, In the irradiation environment, the picture returned by the image sensor produces noise, and the location of the noise is random, and the probability of the same noise in two images transmitted by different image sensors is almost zero.
图像信息获取装置1与图像信息处理装置3之间通过通讯系统连接，通讯系统连接可以为电缆及其接口电路，也可以为无线通讯系统，无线通讯系统包括无线收发器、接口电路等部件；通讯系统连接还应该包括电平转换、I/V转换、信号放大、A/D转换等电路。The image information acquisition device 1 and the image information processing device 3 are connected through a communication system. The communication system connection can be a cable and its interface circuit, or a wireless communication system. The wireless communication system includes components such as a wireless transceiver and an interface circuit; The system connection should also include circuits such as level conversion, I/V conversion, signal amplification, and A/D conversion.
图像传感器、通讯系统等部件还可以采用硬件加固技术，降低辐射干扰产生的影响，以减少图像噪点。Components such as image sensors and communication systems can also use hardware reinforcement technology to reduce the impact of radiation interference and reduce image noise.
图像信息处理装置3包括数字处理装置和图像信息还原模块；如图3所示，数字处理装置包括输入接口、存贮器、处理器和输出接口，数字处理装置也可以为一台能进行数字信号处理的普通计算机；图像信息还原模块置于数字处理装置中，其包括图像分割模块、图像亮度几何校正模块和信息融合法噪点剔除模块，图像分割模块可以分别将从图像信息获取装置1传送来的两路图像信息进行分割，选取两路图像的同一图像画面区域，使得采用的两路图像信息为采集场景的同一区域，以保证图像画面区域的一致性，同时可以保证处理速度的同步，即对同一时刻的同一区域的两路图像信息进行成对分割；图像亮度几何校正模块可以分别对经过图像分割模块提取的同一区域同一时刻的两路图像信息的几何差异和亮度差异进行校正，得到同一场景区域同一时刻的两路图像信息的几何关系和亮度信息一致，形成图像对（即经过两个图像传感器在同一时刻对同一场景同一区域采集的两路图像，经过像分割模块、图像亮度几何校正模块处理后的两路图像叫图像对）。Image information processing device 3 comprises digital processing device and image information reduction module; As shown in Figure 3, digital processing device comprises input interface, memory, processor and output interface, and digital processing device can also be a digital signal An ordinary computer for processing; the image information restoration module is placed in the digital processing device, which includes an image segmentation module, an image brightness geometric correction module and an information fusion method noise removal module, and the image segmentation module can respectively transmit the images from the image information acquisition device 1 The two-way image information is divided, and the same image frame area of the two-way image is selected, so that the two-way image information used is the same area of the acquisition scene, so as to ensure the consistency of the image frame area, and at the same time, the synchronization of the processing speed can be guaranteed. Two channels of image information in the same area at the same time are segmented in pairs; the image brightness geometric correction module can respectively correct the geometric difference and brightness difference of the two channels of image information in the same area and at the same time extracted by the image segmentation module to obtain the same scene The geometric relationship and brightness information of the two image information at the same moment in the area are consistent, forming an image pair (that is, two images collected by two image sensors at the same time in the same area of the same scene, through the image segmentation module and the image brightness geometric correction module The processed two images are called image pairs).
信息融合法噪点剔除模块可以对图像对（为上述所述的“图像对”）进行相关性建模（即建立相关函数，也即相关性分析，通常理解为融合法），执行运算操作后可得到干扰前的图像信息，即可剔除辐射干扰产生的图像噪点，还原出辐射干扰前的图像信息。The noise removal module of the information fusion method can carry out correlation modeling (that is, establish a correlation function, that is, a correlation analysis, which is generally understood as a fusion method) on image pairs (the above-mentioned "image pairs"), and perform calculation operations. By obtaining the image information before the interference, the image noise caused by the radiation interference can be eliminated, and the image information before the radiation interference can be restored.
信息融合法噪点剔除模块的结构原理及具体算法如下：The structural principle and specific algorithm of the noise removal module of the information fusion method are as follows:
用互相关函数表示两个不同的随机信息和在不同时刻和取值的相关程度（即图像信息处理装置3接收到的两个图像传感器的信息，分别经过图像分割模块、图像亮度几何校正模块处理后，得到包含随机噪点信息在内的两路图像信息和，函数表示两路图像信息和的相关性），其定义为：cross-correlation function represent two different random messages with at different times with The degree of correlation of the values (that is, the information of the two image sensors received by the image information processing device 3, after being processed by the image segmentation module and the image brightness geometric correction module respectively, two channels of image information including random noise information are obtained with ,function Represents two-way image information with correlation), which is defined as:
其中表示数学期望算子,若和完全不相关，则为零；对于平稳的随机信息，其统计特征量与时间起点无关；令，，则，简记为，即：in represents the mathematical expectation operator, if with completely irrelevant, then is zero; for stationary random information, its statistical characteristic quantity has nothing to do with the time starting point; let , ,but , abbreviated as ,which is:
用时间平均来表示统计平均，互相关函数也可表示为：The time average is used to represent the statistical average, and the cross-correlation function can also be expressed as:
在实际应用中，积分时间T不可能无限大，常常是在有限的积分时间T内计算相关函数的估计值，即In practical applications, the integration time T cannot be infinite, and the estimated value of the correlation function is usually calculated within the finite integration time T, that is,
式中，表示和的互相关函数的估计值；因为积分时间有限，所以估计值结果会有偏差，但只要积分时间足够长，这种偏差就可以控制在可以允许的范围内；In the formula, express with cross-correlation function The estimated value; because the integration time is limited, the estimated value will be biased, but as long as the integration time is long enough, this deviation can be controlled within the allowable range;
本具体实施方案中待处理的图像信息为数字信息，进行相关处理时采用相关分析的离散运算式，其计算式为：The image information to be processed in this specific embodiment is digital information, and the discrete calculation formula of correlation analysis is adopted when performing correlation processing, and its calculation formula is:
如图4所示，假设场景光源为，图像传感器13输出信息为（没有辐射干扰时），由于辐射的引入了干扰，即产生的图像噪点信息；图像传感器14输出信息为，由于辐射的引入了干扰，即产生的图像噪点信息，得：As shown in Figure 4, suppose the scene light source is , the output information of the image sensor 13 is (when there is no radiation interference), due to the introduction of radiation interference , that is, the generated image noise information; the image sensor 14 output information is , due to the interference introduced by the radiation , that is, the generated image noise information, we get:
图像传感器13的输出信息与图像传感器14的输出信息进行相关性分析，得：The output information of image sensor 13 and the output information of image sensor 14 carry out correlation analysis, get:
由于随机噪点、与信息源（场景光源）两两互不相关，则上式后三项为零，即：due to random noise , and information sources (scene light sources) are not correlated with each other, then the last three terms of the above formula are zero, namely:
这样就把噪点信息声从场景光源形成的图像信息中剔除出去了，可以根据各种值的判断信息源（即场景光源形成的图像信息）的特征。In this way, the noise information sound is eliminated from the image information formed by the scene light source, which can be based on various worth it Judging the source of information (that is, the characteristics of the image information formed by the scene light source).
本发明的使用方法及基本工作原理：使用时，将图像信息获取装置1安装在需要采集图像信息的强辐射环境下，使聚焦镜头11对准需要采集图像信息的场景，图像信息处理装置3放于图像信息接收的地方，这时两个图像传感器（13、14）同时采集来自聚焦镜头11的场景图像信息（一个聚焦镜头11与分光镜12保证了两个图像传感器采集场景的一致性，是后续相关性分析的前提，否则无法进行相关性分析，即无法进行信息融合），通过通讯系统分别传送给图像信息处理装置3，图像信息处理装置3分别调用图像分割模块和图像亮度几何校正模块对两路图像信息进行初步处理，然后调用信息融合法噪点剔除模块对两路图像信息进行相关性建模（即建立相关函数，进行相关性分析，通常理解为信息融合），运算后，剔除辐射干扰产生的图像噪点信息，得到辐射干扰前的图像信息，即还原出辐射干扰前的图像信息。The use method and basic working principle of the present invention: when in use, the image information acquisition device 1 is installed in a strong radiation environment where image information needs to be collected, the focusing lens 11 is aligned with the scene where image information needs to be collected, and the image information processing device 3 is placed At the place where the image information is received, at this time, two image sensors (13, 14) collect scene image information from the focusing lens 11 at the same time (one focusing lens 11 and the beam splitter 12 ensure the consistency of the scenes collected by the two image sensors, which is The premise of the follow-up correlation analysis, otherwise the correlation analysis cannot be performed, that is, the information fusion cannot be carried out), and the information is transmitted to the image information processing device 3 through the communication system, and the image information processing device 3 calls the image segmentation module and the image brightness geometric correction module respectively. The two-way image information is preliminarily processed, and then the noise removal module of the information fusion method is called to perform correlation modeling on the two-way image information (that is, to establish a correlation function and perform correlation analysis, which is generally understood as information fusion). After the operation, the radiation interference is eliminated The generated image noise information is used to obtain the image information before the radiation interference, that is, to restore the image information before the radiation interference.
如上所述，还可以采用两个以上的分光镜，每个分光镜多分出的一条光路再配置一个图像传感器，即分光镜形成级联，多个图像传感器采集的多路图像信息分别传送给图像信息处理装置3，图像信息处理装置3将多路图像信息进行两两组合，得到多对图像对，每一对图像对通过图像信息处理装置3还原出一组辐射干扰前的图像信息，然后将这些还原出的多组辐射干扰前的图像信息进行综合（一般是取平均值），可以得到更精确的辐射干扰前的图像信息；这种简易的变通也同样属于本发明的构思。As mentioned above, more than two beam splitters can also be used, and one more optical path split by each beam splitter is equipped with an image sensor, that is, the beam splitters form a cascade, and the multiple image information collected by multiple image sensors is transmitted to the image sensor respectively. The information processing device 3, the image information processing device 3 combines the multi-channel image information in pairs to obtain multiple pairs of images, and each pair of image pairs restores a group of image information before radiation interference through the image information processing device 3, and then These multiple restored image information before radiation interference are combined (generally averaged) to obtain more accurate image information before radiation interference; this simple modification also belongs to the idea of the present invention.
本发明不局限于上述的具体结构及工作过程，只要采用与本发明基本相同的结构、使用与本发明基本相同的工作原理、达到与本发明基本相同的效果的抗强辐射视觉传感装置就落在发明的保护范围之内。The present invention is not limited to the above-mentioned specific structure and working process, as long as the anti-strong radiation visual sensor device with basically the same structure as the present invention is adopted, the operating principle is basically the same as the present invention, and the effect of the present invention is basically the same as that of the present invention. fall within the scope of protection of the invention.
Claims (10)
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201310117891.4A CN103198462B (en) | 2013-04-08 | 2013-04-08 | Intense radiation resistant visual sensing device based on information fusion |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201310117891.4A CN103198462B (en) | 2013-04-08 | 2013-04-08 | Intense radiation resistant visual sensing device based on information fusion |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN103198462A CN103198462A (en) | 2013-07-10 |
| CN103198462B true CN103198462B (en) | 2017-12-22 |
Family
ID=48720971
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201310117891.4A Active CN103198462B (en) | 2013-04-08 | 2013-04-08 | Intense radiation resistant visual sensing device based on information fusion |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN103198462B (en) |
Families Citing this family (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111327810A (en) * | 2020-04-16 | 2020-06-23 | 上海易清智觉自动化科技有限公司 | Industrial camera and video camera with large depth of field |
| CN114786041A (en) * | 2022-03-04 | 2022-07-22 | 杭州未名信科科技有限公司 | Visual signal processing method, device and electronic device based on integrated chip |
| CN114926379B (en) * | 2022-04-20 | 2025-02-07 | 浙江大华技术股份有限公司 | Image fusion method, computer readable storage medium and device |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1251142C (en) * | 2003-11-20 | 2006-04-12 | 上海交通大学 | Multi-source image registering method on the basis of contour under rigid body transformation |
| CN101510007A (en) * | 2009-03-20 | 2009-08-19 | 北京科技大学 | Real time shooting and self-adapting fusing device for infrared light image and visible light image |
| WO2010116368A1 (en) * | 2009-04-07 | 2010-10-14 | Nextvision Stabilized Systems Ltd | Methods for compensating for light distortions related noise in a camera system having multiple image sensors |
| CN101866054A (en) * | 2010-06-03 | 2010-10-20 | 中国科学院长春光学精密机械与物理研究所 | Optical system of multi-spectral array CCD imager |
| CN102103265A (en) * | 2010-12-21 | 2011-06-22 | 北京理工大学 | Single lens multispectral imaging optical system |
-
2013
- 2013-04-08 CN CN201310117891.4A patent/CN103198462B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1251142C (en) * | 2003-11-20 | 2006-04-12 | 上海交通大学 | Multi-source image registering method on the basis of contour under rigid body transformation |
| CN101510007A (en) * | 2009-03-20 | 2009-08-19 | 北京科技大学 | Real time shooting and self-adapting fusing device for infrared light image and visible light image |
| WO2010116368A1 (en) * | 2009-04-07 | 2010-10-14 | Nextvision Stabilized Systems Ltd | Methods for compensating for light distortions related noise in a camera system having multiple image sensors |
| CN101866054A (en) * | 2010-06-03 | 2010-10-20 | 中国科学院长春光学精密机械与物理研究所 | Optical system of multi-spectral array CCD imager |
| CN102103265A (en) * | 2010-12-21 | 2011-06-22 | 北京理工大学 | Single lens multispectral imaging optical system |
Non-Patent Citations (2)
| Title |
|---|
| 图像融合技术在图像去噪中的应用研究;王海松;《中国优秀硕士学位论文全文数据库 信息科技辑》;20100415(第04期);第31-32页、第72-75页 * |
| 面向遥感应用的图像融合的原理和方法;刘哲 等;《航空计算技术》;20011230(第04期);全文 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN103198462A (en) | 2013-07-10 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US20180262744A1 (en) | Systems, methods and apparatuses for stereo vision | |
| US10297034B2 (en) | Systems and methods for fusing images | |
| EP3067746B1 (en) | Photographing method for dual-camera device and dual-camera device | |
| US10027947B2 (en) | Image processing apparatus and image processing method | |
| US9048153B2 (en) | Three-dimensional image sensor | |
| CN107071291B (en) | Image processing method and device and electronic equipment | |
| US20200162719A1 (en) | Systems, methods and apparatuses for stereo vision | |
| TWI720516B (en) | Application processor | |
| CN103198462B (en) | Intense radiation resistant visual sensing device based on information fusion | |
| US20110149100A1 (en) | Image apparatus and imaging method | |
| JP2015508584A (en) | Method for 3D reconstruction of scenes that rely on asynchronous sensors | |
| CN114286024B (en) | Optical polarization information model construction method and device based on dynamic vision sensor | |
| CN104601954A (en) | Panoramic image splicing device and method and panoramic image monitoring system | |
| CN113837979B (en) | Live image synthesis method, device, terminal equipment and readable storage medium | |
| CN109309784B (en) | Mobile terminal | |
| JP2017229067A (en) | Method and apparatus for generating a pair of stereoscopic images by at least one light field camera | |
| US20200286246A1 (en) | Fingertip detection method, fingertip detection device, and medium | |
| CN103400381B (en) | A kind of Method for Underwater Target Tracking based on optical imagery | |
| CN116597086A (en) | Image processing method and device | |
| Choi et al. | Implementation of Real‐Time Post‐Processing for High‐Quality Stereo Vision | |
| CN116884051A (en) | Face detection method based on self-calibrated lighting and improved Retinaface | |
| CN113329194B (en) | An image sensor and method for extracting real-time motion | |
| CN112911091B (en) | Parameter adjusting method and device of multipoint laser and electronic equipment | |
| WO2022022136A1 (en) | Depth image generation method and apparatus, reference image generation method and apparatus, electronic device, and computer readable storage medium | |
| WO2022241333A2 (en) | System and methods for depth sensing with auxiliary information by a monocular camera |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |