CN115103198B - Intensity coding type dual-channel compression imaging method and system with real exit pupil - Google Patents
Intensity coding type dual-channel compression imaging method and system with real exit pupil Download PDFInfo
- Publication number
- CN115103198B CN115103198B CN202210671525.2A CN202210671525A CN115103198B CN 115103198 B CN115103198 B CN 115103198B CN 202210671525 A CN202210671525 A CN 202210671525A CN 115103198 B CN115103198 B CN 115103198B
- Authority
- CN
- China
- Prior art keywords
- imaging
- channel
- exit pupil
- image
- real exit
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000003384 imaging method Methods 0.000 title claims abstract description 152
- 210000001747 pupil Anatomy 0.000 title claims abstract description 82
- 230000006835 compression Effects 0.000 title claims abstract description 70
- 238000007906 compression Methods 0.000 title claims abstract description 70
- 238000005057 refrigeration Methods 0.000 claims abstract description 23
- 238000001228 spectrum Methods 0.000 claims abstract description 8
- 230000003287 optical effect Effects 0.000 claims description 53
- 238000004422 calculation algorithm Methods 0.000 claims description 21
- 230000004075 alteration Effects 0.000 claims description 19
- 238000000926 separation method Methods 0.000 claims description 18
- 238000000034 method Methods 0.000 claims description 15
- 238000013461 design Methods 0.000 claims description 11
- 230000009977 dual effect Effects 0.000 claims description 8
- 230000000007 visual effect Effects 0.000 claims description 7
- 238000012634 optical imaging Methods 0.000 claims description 4
- 238000011084 recovery Methods 0.000 claims description 4
- 230000008901 benefit Effects 0.000 abstract description 6
- 238000012544 monitoring process Methods 0.000 description 9
- 230000009286 beneficial effect Effects 0.000 description 3
- 238000004364 calculation method Methods 0.000 description 3
- 230000007246 mechanism Effects 0.000 description 3
- 230000000295 complement effect Effects 0.000 description 2
- 150000001875 compounds Chemical class 0.000 description 2
- 238000013135 deep learning Methods 0.000 description 2
- 230000007547 defect Effects 0.000 description 2
- 238000010586 diagram Methods 0.000 description 2
- 230000000694 effects Effects 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 230000006870 function Effects 0.000 description 2
- 229910044991 metal oxide Inorganic materials 0.000 description 2
- 150000004706 metal oxides Chemical class 0.000 description 2
- 238000005457 optimization Methods 0.000 description 2
- 239000004065 semiconductor Substances 0.000 description 2
- 230000005540 biological transmission Effects 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 230000008094 contradictory effect Effects 0.000 description 1
- 238000001514 detection method Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 210000000887 face Anatomy 0.000 description 1
- 238000007667 floating Methods 0.000 description 1
- 238000005286 illumination Methods 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 238000009776 industrial production Methods 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 238000004088 simulation Methods 0.000 description 1
- 238000003860 storage Methods 0.000 description 1
- 230000009466 transformation Effects 0.000 description 1
Abstract
The invention discloses an intensity coding type dual-channel compression imaging method and system with a real exit pupil, and belongs to the technical field of computational imaging. According to the invention, through the intensity coding type double-channel compression imaging with the real exit pupil, single exposure is realized, and simultaneously, double-channel images are captured. The invention separates the mixed images acquired by the two-channel shared image plane in a coding compression mode, and enlarges the imaging field of view without adding a scanning device. The invention adopts total reflection imaging to realize the imaging of the double-channel wide spectrum; the real exit pupil can be generated by the front of the diaphragm in front of the image. The invention realizes the concurrent imaging of a large field of view and a long focal length through the intensity coding type reflective double-channel compression imaging with a real exit pupil, can be applied to ultraviolet, visible and infrared full-band imaging and refrigeration and non-refrigeration imaging systems, and has the advantages of high resolution, narrow bandwidth, simple adjustment, low computational complexity, wide imaging spectrum, compact structure, high stability and good economy of an imaging system.
Description
Technical Field
The invention belongs to the technical field of computational imaging, and relates to an intensity coding type dual-channel compression imaging method and system with a real exit pupil.
Background
At present, the scientific technology is continuously developed, the times of high-speed development bring new requirements to the optical system, but the design of the traditional optical system faces serious bottlenecks, the needs of the times cannot be completely solved, and the computational imaging is generated. The computational imaging fully utilizes the advantages of high communication bandwidth and high floating point computational efficiency at present, relieves the pressure of an optical system, and has great application value in reducing the cost of the optical system and improving the performance and index of the optical system. Currently, the optical system has great application in the monitoring field and has wide prospect in various fields such as industrial production, smart cities, intelligent manufacturing, automation, sports games, urban public security and the like. These fields of application also continually place new demands and indices on the design of optical systems.
At present, an optical lens for monitoring is continuously pursued with a larger and larger field of view and a longer and longer focal length, wherein the larger and larger field of view means that a larger range can be monitored to acquire more abundant object information, and the longer and longer focal length improves the working distance and the spatial resolution of an optical system. But is limited by the theory of traditional optical design, the field of view and focal length are always a pair of contradictory quantities, and cannot be effectively improved at the same time. The traditional methods for solving the problems include detector splicing, compound eye, scanning and the like. However, the geometric multiple of the information amount is inevitably increased due to the splicing of the detectors, and in addition, the fields of view are lost due to the spliced parts of the detectors, so that the monitoring is not facilitated; the compound eye is difficult to design, and the tooling adjustment has great difficulty, so that the information quantity is greatly increased, and the cost is increased; the optical scanning can be carried out by adding an optical scanning mechanism, a steering engine and the like into an optical system, the reliability of the system can be greatly reduced by a complex motor system and a rotating mechanism, the volume and the weight of the system are obviously improved, and the time resolution is reduced. Therefore, there is a need for an optical solution that can properly solve the contradiction between the field of view and the focal length without introducing other contradictions.
In 2016, cheng Dewen et al at the university of Beijing university of technology, design ofall-REFLECTIVE DUAL-channel foveated IMAGING SYSTEMS based on freeform optics, propose a reflective dual-channel concave imaging optical system, which uses one channel for imaging in a large field of view and the other channel for a long focal length, so that both the large field of view and the long focal length are achieved, but the dual detectors are adopted, so that the system bandwidth is greatly increased, and the overall high resolution cannot be realized. In 2021, zhu Jun et al, university of Qinghai, in Simultaneous improvement offield-of-view andresolution IN AN IMAGING optical system, proposed a design method that simultaneously increased the field of view and focal length of the optical system, but that expanded the field of view by reducing the focal length of the fringe field of view, the resolution of the reduced fringe field of view more similar to that of the field of view by design distortion, and the resulting image was therefore not visually observable to the human eye. In addition, in the field of recompression imaging, patents similar to the patent are CN201210172731.5 and CN201210193244.7, but the method is mainly applied to the field of spectrum and is realized through two area array detectors, so that the system volume, weight, calculation burden and system bandwidth are increased.
In order to solve the problem and make up for the defects of the method, the invention provides a compression imaging method adopting a double-channel shared image surface, breaks through the limitation of a view field and a focal length in the traditional optical design, realizes coexistence of a large view field and high resolution, does not adopt a scanning mechanism, improves the stability and time resolution of the system, and reduces the data volume.
Disclosure of Invention
In order to solve the contradiction problem of optical imaging view field and focal length, the invention discloses an intensity coding type double-channel compression imaging method with a real exit pupil and a system thereof, which aims to solve the technical problems that: through the intensity coding type double-channel compression imaging with a real exit pupil, single exposure is realized, simultaneously, images without chromatic aberration and double-channel wide spectrum are captured, the contradiction between an optical imaging view field and a focal length is solved, simultaneous imaging with a large view field and a long focal length is realized, the cold-stop matching requirement of an infrared refrigeration optical system can be met, and the infrared refrigeration optical system has the advantages of high resolution, narrow bandwidth, wide imaging spectrum, compact structure, high stability and good economy.
The aim of the invention is achieved by the following technical scheme.
According to the intensity coding type double-channel compression imaging method with the real exit pupil, single exposure is achieved, double-channel images are captured simultaneously through the intensity coding type double-channel compression imaging with the real exit pupil, and under the condition of the same detector, compared with a traditional alternately-operated double-channel imaging system, the time resolution of the compression imaging system is doubled, and the data size is doubled under the same imaging time resolution precision requirement. The mixed images acquired by the two-channel shared image surface are separated in a coding compression mode, and the imaging view field is enlarged without adding a scanning device, so that the structural compactness, stability and economical efficiency of an imaging system are improved. And realizing double-channel wide-spectrum imaging by adopting total reflection imaging. The intensity coding type double-channel compression imaging method with the real exit pupil can generate the real exit pupil in front of an image by leading the diaphragm, and the real exit pupil is matched with the size and the position of the cold stop of the detector to be used by matching the cold stop, so that the method is convenient to apply in infrared refrigeration imaging. In summary, the invention solves the contradiction between the optical imaging field of view and the focal length by the intensity coding type dual-channel compression imaging with the real exit pupil, realizes concurrent imaging with large field of view and long focal length, can be applied to ultraviolet, visible and infrared full-band imaging and refrigeration and non-refrigeration imaging systems, and has the advantages of high resolution, narrow bandwidth, simple adjustment, low computational complexity, wide imaging spectrum, compact structure, high stability and good economy of an imaging system.
The invention discloses an intensity code type double-channel compression imaging method with a real exit pupil, which expands the intensity code type double-channel compression imaging with the real exit pupil into the intensity code type multi-channel compression imaging with the real exit pupil, further expands the imaging field of view, improves the structural compactness, economy and resolution of an imaging system and compresses the bandwidth of the imaging system.
The realization method adopts an intensity coding type dual-channel compression mode separation imaging with a real exit pupil, and comprises the following steps:
Step one: the imaging light beam obtained by the intensity coding type double-channel compression imaging light path with the real exit pupil is coded on the intermediate image plane, coding modulation is realized by a coding plate arranged on the intermediate image plane, and the two intermediate image planes in the intensity coding type double-channel compression imaging light path with the real exit pupil are required to be coplanar and can not be completely overlapped, so that the coded imaging light beam is obtained.
Step two: and (3) exposing the coded imaging light beam obtained in the step one through a double-channel shared image plane to obtain a double-channel shared image plane mixed image.
The dual-channel shared image plane refers to that the dual channels share one area array photoelectric detector to capture a mixed image.
The intensity information i (x, y) of the mixed image captured by the area array photodetector is simplified as follows:
i(x,y)＝f1(x,y)·coding1(x,y)+f2(x,y)·coding2(x,y) (1)
Where, represents a point multiplication, f 1(x,y)、f2 (x, y) represents object space information captured by two channels of the intensity-coded dual-channel compression imaging optical system with a real exit pupil, coding 1(x,y)、coding2 (x, y) represents a region binary model of the code plate passed by the two channels of the intensity-coded dual-channel compression imaging optical system with a real exit pupil.
Step three: denoising the two-channel shared image surface mixed image obtained in the step two, carrying out image restoration on the shared image surface mixed image through a compressed sensing restoration algorithm, and respectively restoring object side images of two imaging channels from one image, namely realizing coding compression separation imaging.
The inverse problem of intensity coded dual channel compression imaging with real exit pupil is converted into a compressed sensing recovery problem:
And (3) taking the compressed sensing restoration problem shown in the formula (2) as an objective function of image restoration, carrying out image restoration on the mixed image of the common image plane through a compressed sensing restoration algorithm, and respectively restoring object side images of two imaging channels from one image, namely realizing coding compression separation imaging.
By adopting the intensity coding type dual-channel compression mode separation imaging with a real exit pupil, two separation images can be obtained, and preferably, the two separation images are spliced according to the dual-channel view field relation, so that the visual effect of imaging is improved on the basis of expanding the view field.
The invention also discloses an intensity coding type double-channel compression imaging system with the real exit pupil, which is used for realizing the intensity coding type double-channel compression imaging method with the real exit pupil. The intensity coding type double-channel compression imaging system with the real exit pupil comprises a diaphragm 1, a diaphragm 2, a main mirror 1, a main mirror 2, a secondary mirror, a three mirror, a coding plate, four mirrors, five mirrors, a real exit pupil, a photoelectric detector and an image restoration system. The individual components are arranged in sequence in the direction of propagation of the light.
The diaphragm 1 is positioned at the forefront end of the system in the light path, is an aperture diaphragm of a first channel, and limits the caliber of an imaging light beam.
The diaphragm 2 is positioned at the forefront end of the system in the light path, is an aperture diaphragm of a second channel, and limits the caliber of an imaging beam.
The primary mirror 1, which is located behind the diaphragm 1 in the optical path, provides a predetermined optical power and corrects aberrations, reflecting the imaging light beam passing through the first channel onto the secondary mirror.
The primary mirror 2, which is located behind the diaphragm 2 in the optical path, provides a predetermined optical power and corrects aberrations, reflecting the imaging light beam passing through the second channel onto the secondary mirror.
The secondary mirror is located behind the primary mirror in the optical path, provides a predetermined optical power, and corrects aberrations, reflecting the imaging light beams passing through the first and second channels to the three mirrors.
The three mirrors are positioned behind the secondary mirror in the light path, provide predetermined optical power, correct aberration, and focus imaging light beams of the first channel and the second channel onto an intermediate image plane.
The coding plate is positioned behind the three mirrors in the light path and is overlapped with the middle image surface of the front three-mirror system, the middle image surfaces of the first channel and the second channel are coplanar but are not completely overlapped, certain position deviation exists, and the coding plate is overlapped with the middle image surfaces of the two channels. The code plate may be a binary random code plate.
The four mirrors are positioned behind the coding plate in the light path, provide preset focal power, correct aberration and form a reflective relay lens together with the five mirrors, and image the intermediate image surfaces of the first channel and the second channel on the final image surface.
The five mirrors are positioned behind the four mirrors in the light path, provide certain optical power, correct aberration and form a reflective relay lens together with the four mirrors, and image the intermediate image surfaces of the first channel and the second channel on the final image surface.
The real exit pupil is positioned behind the five mirrors and in front of the final image plane in the light path, and the reasonable positions of the diaphragm 1 and the diaphragm 2 and the good optical system design can only obtain the better position and shape of the real exit pupil. The real exit pupil is matched with the cold stop of the rear infrared refrigeration detector.
The photoelectric detector is positioned behind the real exit pupil in the light path, and if a refrigeration detector is adopted, the refrigeration stop of the refrigeration CCD in the system needs to be customized and is matched with the real exit pupil. The optical image formed in the front is mainly converted into electronic information and transmitted to the image restoration module at the rear.
The image restoration module is a single-chip microcomputer, a notebook computer and other computing terminals comprising an image restoration algorithm, can restore digital images transmitted by photoelectric detectors such as CCD (charge coupled device) or CMOS (complementary metal oxide semiconductor) and the like through a compressed sensing restoration algorithm, respectively restore object side images of two imaging channels from one image, adopts an algorithm to be matched with the coding mode, and adopts a compressed sensing restoration algorithm, convex optimization, deep learning and the like.
The beneficial effects are that:
1. The intensity coding type dual-channel compression imaging method and system with the real exit pupil disclosed by the invention adopt the common use of two channel image planes, can simultaneously improve the focal length and the view field of an optical system under the condition of limited detector area array, realize wide-area high-resolution monitoring of a target scene, capture more target details with high resolution, greatly improve the target recognition probability, greatly improve the monitoring range with wide area, be beneficial to target tracking, and especially aim at targets with high maneuvering performance, so that the method and system have the effect of obviously improving the target recognition probability of the monitoring tracking system.
2. According to the intensity coding type double-channel compression imaging method and system with the real exit pupil, provided by the invention, the compressed sensing theory is adopted, and the object side images of the two channels are separated from the single Zhang Gongyong image plane mixed image through the compressed sensing restoration algorithm, so that the simultaneous promotion of the view field and the focal length can be realized, and the time resolution of the system is not reduced. In addition, as the two-channel image surfaces are shared, the detector can obtain double light energy in the traditional imaging, the loss of the illumination of the image surface caused by intensity coding in the traditional compression coding imaging is compensated, and the high signal-to-noise ratio image with lower exposure time can be realized, so that the method has great benefit for tracking the target with high maneuvering performance. The target tracking efficiency of the monitoring tracking system is remarkably improved.
3. The invention discloses an intensity coding type dual-channel compression imaging method and system with a real exit pupil, which share one image plane through dual channels, work simultaneously, combine with compressed sensing algorithm restoration, separate respective object side images of two channels at the same moment from a mixed image of the shared image plane, and realize the effect of reducing the data volume by half. The method can effectively solve the defects of high bandwidth requirement of the existing high-definition lens and short storage time of the monitoring video, and provides a new solution for a video transmission scheme of large-view-field high-definition monitoring.
4. The intensity coding type dual-channel compression imaging method and system with the real exit pupil, disclosed by the invention, adopt to carry out intensity coding on the middle image plane, can obtain a clear image plane at the image plane compared with frequency domain coding, are convenient for providing accurate guidance for the adjustment of the system, and are beneficial to the adjustment. In addition, because intensity coding is adopted, image restoration completely occurs in a spatial domain, fourier transformation and convolution operation with high complexity are not needed, the algorithm calculation complexity is low, and the calculation force requirement is low.
5. The invention discloses an intensity coding type double-channel compression imaging method and system with a real exit pupil, which adopt the front diaphragm to enable the real exit pupil to be arranged in a system light path, so that the real exit pupil can be conveniently matched with the cold diaphragm of a used refrigeration detector. Therefore, the invention can be widely applied to ultraviolet, visible, infrared and refrigeration type and non-refrigeration type all-band multisystem detection imaging applications.
Drawings
FIG. 1 is a flow chart of a dual-channel compression imaging method with an intensity coding mode and a real exit pupil, which is disclosed by the invention;
FIG. 2 is a flowchart of an image restoration algorithm for implementing the method of the present invention;
FIG. 3 is a schematic diagram of a system structure according to an embodiment of the present invention;
FIG. 4 is an image for algorithm simulation in an embodiment of the present invention, which represents object information collected by two channels, respectively;
FIG. 5 is a diagram of a binary code plate through which two channels pass in an embodiment of the present invention, the two images being different portions of the same code plate;
FIG. 6 is a blended image obtained by two channels operating simultaneously in which information collected by the two channels is blended together in an embodiment of the present invention;
fig. 7 illustrates object information captured by the two channels recovered from fig. 6 by the image recovery system in accordance with an embodiment of the present invention.
Wherein: 1-diaphragm 1, 2-diaphragm 2, 3-primary mirror 1, 4-primary mirror 2, 5-secondary mirror, 6-triple mirror, 7-coding plate, 8-quad mirror, 9-penta mirror, 10-real exit pupil, 11-photodetector, 12-image restoration system
Detailed Description
For a better description of the objects and advantages of the present invention, the following description will be given with reference to the accompanying drawings and examples.
Example 1:
As shown in fig. 1, the embodiment discloses an intensity coding type dual-channel compression imaging method with a real exit pupil, which comprises the following specific implementation steps:
Step one: the imaging light beam obtained by the intensity coding type double-channel compression imaging light path with the real exit pupil is coded on the intermediate image plane, coding modulation is realized by a coding plate arranged on the intermediate image plane, and the two intermediate image planes in the intensity coding type double-channel compression imaging light path with the real exit pupil are required to be coplanar and can not be completely overlapped, so that the coded imaging light beam is obtained. The object information carried by the two-channel imaging beam is shown in fig. 4. The coding plate used for the intermediate image plane is shown in fig. 5.
Step two: and (3) exposing the coded imaging light beam obtained in the step one through a double-channel shared image plane to obtain a double-channel shared image plane mixed image. The dual channel common image plane blended image is shown in fig. 6.
The dual-channel shared image plane refers to that the dual channels share one area array photoelectric detector to capture a mixed image.
The intensity information i (x, y) of the mixed image captured by the area array photodetector is simplified as follows:
i(x,y)＝f1(x,y)·coding1(x,y)+f2(x,y)·coding2(x,y) (3)
Where, represents a point multiplication, f 1(x,y)、f2 (x, y) represents object space information captured by two channels of the intensity-coded dual-channel compression imaging optical system with a real exit pupil, coding 1(x,y)、coding2 (x, y) represents a region binary model of the code plate passed by the two channels of the intensity-coded dual-channel compression imaging optical system with a real exit pupil.
Step three: denoising the two-channel shared image surface mixed image obtained in the step two, carrying out image restoration on the shared image surface mixed image through a compressed sensing restoration algorithm, and respectively restoring object side images of two imaging channels from one image, namely realizing coding compression separation imaging. The restoration algorithm flow is shown in FIG. 2
The inverse problem of intensity coded dual channel compression imaging with real exit pupil is converted into a compressed sensing recovery problem:
And (3) taking the compressed sensing restoration problem shown in the formula (4) as an objective function of image restoration, carrying out image restoration on the common image plane mixed image through a compressed sensing restoration algorithm, and respectively restoring object side images of two imaging channels from one image, namely realizing coding compression separation imaging.
By adopting the intensity coding type dual-channel compression mode separation imaging with a real exit pupil, two separation images can be obtained, and preferably, the two separation images are spliced according to the dual-channel view field relation, so that the visual effect of imaging is improved on the basis of expanding the view field. The results of the two-pass compression separation are shown in fig. 7. In this embodiment, the two images have no adjacent relation between the fields of view, so no image stitching is performed.
The invention also discloses an intensity coding type double-channel compression imaging system with the real exit pupil, which is used for realizing the intensity coding type double-channel compression imaging method with the real exit pupil. The intensity coding type double-channel compression imaging system with the real exit pupil comprises a diaphragm 1, a diaphragm 2, a main mirror 1, a main mirror 2, a secondary mirror, a three mirror, a coding plate, four mirrors, five mirrors, a real exit pupil, a photoelectric detector and an image restoration system. The individual components are arranged in sequence in the direction of propagation of the light. The system architecture is shown in fig. 3.
The diaphragm 1 is positioned at the forefront end of the system in the light path, is an aperture diaphragm of a first channel, and limits the caliber of an imaging light beam.
The diaphragm 2 is positioned at the forefront end of the system in the light path, is an aperture diaphragm of a second channel, and limits the caliber of an imaging beam.
The primary mirror 1, which is located behind the diaphragm 1 in the optical path, provides a predetermined optical power and corrects aberrations, reflecting the imaging light beam passing through the first channel onto the secondary mirror.
The primary mirror 2, which is located behind the diaphragm 2 in the optical path, provides a predetermined optical power and corrects aberrations, reflecting the imaging light beam passing through the second channel onto the secondary mirror.
The secondary mirror is located behind the primary mirror in the optical path, provides a predetermined optical power, and corrects aberrations, reflecting the imaging light beams passing through the first and second channels to the three mirrors.
The three mirrors are positioned behind the secondary mirror in the light path, provide predetermined optical power, correct aberration, and focus imaging light beams of the first channel and the second channel onto an intermediate image plane.
The coding plate is positioned behind the three mirrors in the light path and is overlapped with the middle image surface of the front three-mirror system, the middle image surfaces of the first channel and the second channel are coplanar but are not completely overlapped, certain position deviation exists, and the coding plate is overlapped with the middle image surfaces of the two channels. The code plate can be a binary random code plate, and the code plate is specifically shown in fig. 5.
The four mirrors are positioned behind the coding plate in the light path, provide preset focal power, correct aberration and form a reflective relay lens together with the five mirrors, and image the intermediate image surfaces of the first channel and the second channel on the final image surface.
The five mirrors are positioned behind the four mirrors in the light path, provide certain optical power, correct aberration and form a reflective relay lens together with the four mirrors, and image the intermediate image surfaces of the first channel and the second channel on the final image surface.
The real exit pupil is positioned behind the five mirrors and in front of the final image plane in the light path, and the reasonable positions of the diaphragm 1 and the diaphragm 2 and the good optical system design can only obtain the better position and shape of the real exit pupil. The real exit pupil is matched with the cold stop of the rear infrared refrigeration detector.
The photoelectric detector is positioned behind the real exit pupil in the light path, and if a refrigeration detector is adopted, the refrigeration stop of the refrigeration CCD in the system needs to be customized and is matched with the real exit pupil. The optical image formed in the front is mainly converted into electronic information and transmitted to the image restoration module at the rear.
The image restoration module is a single-chip microcomputer, a notebook computer and other computing terminals comprising an image restoration algorithm, can restore digital images transmitted by photoelectric detectors such as CCD (charge coupled device) or CMOS (complementary metal oxide semiconductor) and the like through a compressed sensing restoration algorithm, respectively restore object side images of two imaging channels from one image, adopts an algorithm to be matched with the coding mode, and adopts a compressed sensing restoration algorithm, convex optimization, deep learning and the like.
The specific optical surface parameters of the system used in this example are shown in table 1:
Table 1 optical system parameter table
Units: mm (mm)
| Radius of radius | Conic coefficients | Phase plate coefficient | |
| First phase plate | 0 | 0 | 9×10-8 |
| Second phase plate | 0 | 0 | 9×10-8 |
| First main mirror | -301.4371 | -0.2355 | - |
| Second main mirror | -301.4371 | -0.2355 | - |
| Secondary mirror | -82.6697 | -3.1181 | - |
| Three mirrors | -127.8005 | -0.5247 | - |
| Four mirrors | 100 | 0.2254 | - |
| Five mirrors | -100 | -0.1374 | - |
The global coordinates of the optical surface in this embodiment are shown in table 2:
Units: mm (mm)
While the foregoing is directed to embodiments of the present invention, other and further embodiments of the invention may be devised without departing from the basic scope thereof, and the scope thereof is determined by the claims that follow.
Claims (4)
1. An intensity coding type double-channel compression imaging method with a real exit pupil is characterized by comprising the following steps of: through the intensity coding type double-channel compression imaging with a real exit pupil, single exposure is realized, double-channel images are captured at the same time, and under the condition of the same detector, compared with a traditional double-channel imaging system working in a rotating way, the time resolution of the compression imaging system is doubled, and under the requirement of the same imaging time resolution precision, the data volume is doubled; the mixed images acquired by the two-channel shared image surface are separated in a coding compression mode, and the imaging view field is enlarged without adding a scanning device, so that the structural compactness, stability and economy of an imaging system are improved; realizing double-channel wide-spectrum imaging by adopting total reflection imaging; the intensity coding type double-channel compression imaging method with the real exit pupil can generate the real exit pupil in front of an image by leading the diaphragm, and the real exit pupil is matched with the size and the position of the cold stop of the detector to be used by matching the cold stop, so that the method is convenient to apply in infrared refrigeration imaging;
Adopts an intensity coding type dual-channel compression mode with a real exit pupil for separation imaging, and the implementation method is as follows,
Step one: encoding imaging light beams acquired by an intensity encoding type double-channel compression imaging light path with a real exit pupil on an intermediate image plane, wherein encoding modulation is realized through an encoding plate arranged on the intermediate image plane, and the two intermediate image planes in the intensity encoding type double-channel compression imaging light path with the real exit pupil are required to be coplanar and cannot be completely overlapped, so that encoded imaging light beams are acquired;
Step two: exposing the coded imaging light beam obtained in the step one through a double-channel shared image plane to obtain a double-channel shared image plane mixed image;
The dual-channel shared image plane refers to a dual-channel shared area array photoelectric detector for capturing a mixed image;
the intensity information i (x, y) of the mixed image captured by the area array photodetector is simplified as follows:
i(x,y)＝f1(x,y)·coding1(x,y)+f2(x,y)·coding2(x,y) (1)
Where, representing convolution, f 1(x,y)、f2 (x, y) represents object space information captured by two channels of the intensity-coded dual-channel compression imaging optical system with a real exit pupil, coding 1(x,y)、coding2 (x, y) represents a region binary model of the passed code plate of the two channels of the intensity-coded dual-channel compression imaging optical system with a real exit pupil;
Step three: denoising the two-channel shared image surface mixed image obtained in the step two, carrying out image restoration on the shared image surface mixed image through a compressed sensing restoration algorithm, and respectively restoring object side images of two imaging channels from one image to realize coding compression separation imaging;
the implementation method of the third step is that,
The inverse problem of intensity coded dual channel compression imaging with real exit pupil is converted into a compressed sensing recovery problem:
And (3) taking the compressed sensing restoration problem shown in the formula (2) as an objective function of image restoration, carrying out image restoration on the mixed image of the common image plane through a compressed sensing restoration algorithm, and respectively restoring object side images of two imaging channels from one image, namely realizing coding compression separation imaging.
2. The method of intensity-coded dual-channel compression imaging with a real exit pupil of claim 1, wherein: the contradiction between the optical imaging visual field and the focal length is solved by the intensity coding type double-channel compression imaging with the real exit pupil, the concurrent imaging of the large visual field and the long focal length is realized, and the imaging method is convenient to use in ultraviolet, visible, infrared and infrared refrigeration multi-system full-band imaging application.
3. The method of intensity-coded dual-channel compression imaging with a real exit pupil of claim 1, wherein: by adopting the intensity coding type dual-channel compression mode separation imaging with a real exit pupil, two separation images can be obtained, the two separation images are spliced according to the dual-channel visual field relation, and the visual effect of imaging is improved on the basis of expanding the visual field.
4. An intensity-coded dual-channel compression imaging system with a real exit pupil for implementing an intensity-coded dual-channel compression imaging method with a real exit pupil as claimed in claim 1 or 3, characterized in that: the system comprises a first diaphragm, a second diaphragm, a first main mirror, a second main mirror, a secondary mirror, a three-mirror, a coding plate, four mirrors, five mirrors, a real exit pupil, an area array CCD and an image restoration module; in the propagation direction of the light, the components are arranged in sequence;
the first diaphragm is positioned at the forefront end of the system in the light path and is an aperture diaphragm of a first channel, so that the aperture of an imaging beam is limited;
The second diaphragm is positioned at the forefront end of the system in the light path and is an aperture diaphragm of a second channel, so that the aperture of an imaging beam is limited;
the first primary mirror is positioned behind the first diaphragm in the light path, provides preset focal power, corrects aberration and reflects the imaging light beam passing through the first channel to the secondary mirror;
the second primary mirror is positioned behind the second diaphragm in the light path, provides preset focal power, corrects aberration and reflects the imaging light beam passing through the second channel to the secondary mirror;
the secondary mirror is positioned behind the primary mirror in the light path, provides preset focal power, corrects aberration and reflects imaging light beams passing through the first channel and the second channel to the three mirrors;
The three mirrors are positioned behind the secondary mirror in the light path, provide preset focal power, correct aberration and focus imaging light beams of the first channel and the second channel on an intermediate image plane;
the coding plate is positioned behind the three mirrors in the light path and is overlapped with the middle image surfaces of the three front mirrors, the middle image surfaces of the first channel and the second channel are coplanar but are not completely overlapped, certain position deviation exists, and the coding plate is overlapped with the middle image surfaces of the two channels;
The four mirrors are positioned behind the coding plate in the light path, provide certain optical power, correct aberration and form a reflective relay lens together with the five mirrors, and image the intermediate image surfaces of the first channel and the second channel on a final image surface;
The five mirrors are positioned behind the four mirrors in the light path, provide preset focal power, correct aberration and form a reflective relay lens together with the four mirrors, and image the intermediate image surfaces of the first channel and the second channel on a final image surface;
the real exit pupil is positioned behind the five mirrors in the light path and in front of the final image plane, and the real exit pupil can be obtained only by reasonable positions of the first diaphragm and the second diaphragm and good optical system design; the real exit pupil is matched with the cold stop of the rear infrared refrigeration detector;
The area array CCD is positioned behind the real exit pupil in the light path, and if the area array CCD is a refrigeration detector, the cold stop of the refrigeration CCD is matched with the real exit pupil; the optical image formed in the front is converted into electronic information and transmitted to the image restoration module at the rear;
The image restoration module restores the digital image transmitted by the CCD or CMOS photoelectric detector through a compressed sensing restoration algorithm, and restores the object side images of the two imaging channels from one image respectively.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210671525.2A CN115103198B (en) | 2022-06-14 | Intensity coding type dual-channel compression imaging method and system with real exit pupil |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210671525.2A CN115103198B (en) | 2022-06-14 | Intensity coding type dual-channel compression imaging method and system with real exit pupil |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN115103198A CN115103198A (en) | 2022-09-23 |
| CN115103198B true CN115103198B (en) | 2024-06-04 |
Family
ID=
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102891956A (en) * | 2012-09-25 | 2013-01-23 | 北京理工大学 | Method for designing compression imaging system based on coded aperture lens array |
| CN210774358U (en) * | 2019-09-06 | 2020-06-16 | 中国科学院西安光学精密机械研究所 | Dynamic double-arm multi-channel staring spectral imaging system based on compressed sensing |
| CN112665720A (en) * | 2020-12-29 | 2021-04-16 | 北京理工大学重庆创新中心 | Dual-channel tunable hyperspectral imager and method based on complementary compressed coding |
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102891956A (en) * | 2012-09-25 | 2013-01-23 | 北京理工大学 | Method for designing compression imaging system based on coded aperture lens array |
| CN210774358U (en) * | 2019-09-06 | 2020-06-16 | 中国科学院西安光学精密机械研究所 | Dynamic double-arm multi-channel staring spectral imaging system based on compressed sensing |
| CN112665720A (en) * | 2020-12-29 | 2021-04-16 | 北京理工大学重庆创新中心 | Dual-channel tunable hyperspectral imager and method based on complementary compressed coding |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| Gao et al. | Review on panoramic imaging and its applications in scene understanding | |
| CN104793343A (en) | Three-channel and single-Wollaston prism polarization imaging device and polarization information detecting method | |
| CN103278927A (en) | Two-waveband hole-diameter-shared light-path-shared zoom-shared imaging optical system | |
| Xia et al. | PANDA: Parallel asymmetric network with double attention for cloud and its shadow detection | |
| CN114387439A (en) | Semantic segmentation network based on fusion of optical and PolSAR (polar synthetic Aperture Radar) features | |
| CN115984349A (en) | Depth stereo matching algorithm based on central pixel gradient fusion and global cost aggregation | |
| Gao et al. | Compact and lightweight panoramic annular lens for computer vision tasks | |
| CN115103198B (en) | Intensity coding type dual-channel compression imaging method and system with real exit pupil | |
| CN117274047A (en) | Infrared image super-resolution reconstruction method combining double-path convolution and self-attention | |
| CN115223009A (en) | Small target detection method and device based on improved YOLOv5 | |
| Wei et al. | SARNet: Spatial Attention Residual Network for pedestrian and vehicle detection in large scenes | |
| Wang et al. | VIMI: Vehicle-infrastructure multi-view intermediate fusion for camera-based 3D object detection | |
| CN115103197B (en) | Intensity coding type wide-spectrum dual-channel compression imaging method and system | |
| CN102821236B (en) | Compression imaging system based on separated two-dimensional compression sensing principle | |
| CN112305739B (en) | Infrared dual-band imaging optical system combining common optical path wide and narrow fields of view | |
| Ding et al. | Long-distance vehicle dynamic detection and positioning based on gm-apd lidar and lidar-yolo | |
| CN113223065B (en) | Automatic matching method for SAR satellite image and optical image | |
| CN101581950B (en) | Coaxial joint transform optics correlator | |
| CN115065789B (en) | Wide-spectrum-band dual-channel compression imaging method and system with real exit pupil | |
| CN115100052B (en) | Wide-spectrum dual-channel compression imaging method and system | |
| CN210774358U (en) | Dynamic double-arm multi-channel staring spectral imaging system based on compressed sensing | |
| CN115103198A (en) | Intensity coding type dual-channel compression imaging method and system with real exit pupil | |
| CN115103197A (en) | Intensity-coding wide-spectrum-band two-channel compression imaging method and system | |
| CN115100052A (en) | Wide-spectrum dual-channel compression imaging method and system | |
| CN115065789A (en) | Wide-spectrum dual-channel compression imaging method and system with real exit pupil |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant |