CN116071230A - Super-resolution single-pixel associated imaging system and method based on Hadamard matrix transformation - Google Patents
Super-resolution single-pixel associated imaging system and method based on Hadamard matrix transformation Download PDFInfo
- Publication number
- CN116071230A CN116071230A CN202211370945.3A CN202211370945A CN116071230A CN 116071230 A CN116071230 A CN 116071230A CN 202211370945 A CN202211370945 A CN 202211370945A CN 116071230 A CN116071230 A CN 116071230A
- Authority
- CN
- China
- Prior art keywords
- super
- resolution
- imaging
- hadamard
- lens
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000003384 imaging method Methods 0.000 title claims abstract description 74
- 239000011159 matrix material Substances 0.000 title claims abstract description 44
- 230000009466 transformation Effects 0.000 title claims abstract description 32
- 238000000034 method Methods 0.000 title claims abstract description 17
- 230000002596 correlated effect Effects 0.000 claims abstract description 6
- 238000006243 chemical reaction Methods 0.000 claims abstract description 5
- 238000001914 filtration Methods 0.000 claims description 16
- 230000000875 corresponding effect Effects 0.000 claims description 6
- 230000000694 effects Effects 0.000 claims description 5
- 238000012545 processing Methods 0.000 claims description 4
- 238000004088 simulation Methods 0.000 claims description 4
- 229910052736 halogen Inorganic materials 0.000 claims description 3
- 150000002367 halogens Chemical class 0.000 claims description 3
- 239000004973 liquid crystal related substance Substances 0.000 claims description 3
- 230000008569 process Effects 0.000 claims description 2
- 230000003287 optical effect Effects 0.000 description 7
- 238000005516 engineering process Methods 0.000 description 6
- 238000001514 detection method Methods 0.000 description 4
- 238000004422 calculation algorithm Methods 0.000 description 3
- 238000011160 research Methods 0.000 description 3
- 230000007306 turnover Effects 0.000 description 3
- XUIMIQQOPSSXEZ-UHFFFAOYSA-N Silicon Chemical compound [Si] XUIMIQQOPSSXEZ-UHFFFAOYSA-N 0.000 description 2
- 238000005259 measurement Methods 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000012634 optical imaging Methods 0.000 description 2
- 229910052710 silicon Inorganic materials 0.000 description 2
- 239000010703 silicon Substances 0.000 description 2
- 239000000758 substrate Substances 0.000 description 2
- 241000282414 Homo sapiens Species 0.000 description 1
- 101000694017 Homo sapiens Sodium channel protein type 5 subunit alpha Proteins 0.000 description 1
- 230000003321 amplification Effects 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 238000010276 construction Methods 0.000 description 1
- 230000001276 controlling effect Effects 0.000 description 1
- 238000005314 correlation function Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 238000002059 diagnostic imaging Methods 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 238000004043 dyeing Methods 0.000 description 1
- 230000005284 excitation Effects 0.000 description 1
- 238000002474 experimental method Methods 0.000 description 1
- 238000005286 illumination Methods 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 238000003199 nucleic acid amplification method Methods 0.000 description 1
- 230000005855 radiation Effects 0.000 description 1
- 230000004043 responsiveness Effects 0.000 description 1
- 238000005070 sampling Methods 0.000 description 1
- 230000035945 sensitivity Effects 0.000 description 1
- 238000011426 transformation method Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T3/00—Geometric image transformations in the plane of the image
- G06T3/40—Scaling of whole images or parts thereof, e.g. expanding or contracting
- G06T3/4053—Scaling of whole images or parts thereof, e.g. expanding or contracting based on super-resolution, i.e. the output image resolution being higher than the sensor resolution
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F17/00—Digital computing or data processing equipment or methods, specially adapted for specific functions
- G06F17/10—Complex mathematical operations
- G06F17/16—Matrix or vector computation, e.g. matrix-matrix or matrix-vector multiplication, matrix factorization
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Mathematical Physics (AREA)
- Theoretical Computer Science (AREA)
- Computational Mathematics (AREA)
- Mathematical Analysis (AREA)
- Mathematical Optimization (AREA)
- Pure & Applied Mathematics (AREA)
- Data Mining & Analysis (AREA)
- Computing Systems (AREA)
- Algebra (AREA)
- Databases & Information Systems (AREA)
- Software Systems (AREA)
- General Engineering & Computer Science (AREA)
- Image Analysis (AREA)
Abstract
The super-resolution single-pixel associated imaging system and method based on Hadamard matrix transformation comprises a light source, wherein a target, an imaging lens, a spatial light modulation device, a converging lens and a single-pixel detector are sequentially arranged in the emitting direction of the light source; the signal processed in the single-pixel detector is denoised and amplified by a photodiode amplifier, analog-to-digital conversion and digital signal acquisition are completed by a data acquisition card, the digital signal is transmitted to a computer, and correlated imaging is carried out with a Hadamard transformation matrix generated in the computer. The invention is insensitive to the instability of light intensity, has the capability of resisting the influence of bad weather such as atmospheric disturbance, turbulence and the like, and can realize super-resolution imaging.
Description
Technical Field
The invention relates to the field of super-resolution associated imaging, in particular to a super-resolution single-pixel associated imaging system and method based on Hadamard matrix transformation.
Background
In the optical field, there is a problem that the diffraction of the current optical imaging system is limited due to the diffraction phenomenon of light, which makes the imaging resolution of the system extremely limited. With the remarkable development of the fields of nanotechnology, medical imaging technology, etc., the requirement for obtaining higher spatial resolution is also becoming more prominent. The diffraction limit is overcome, the resolution limit of the traditional optical system is exceeded, the performance bottlenecks of the fields of optical microscope, remote sensing imaging, astronomical detection and the like are broken through, sub-wavelength super-resolution imaging is realized, and the super-resolution technology for improving the resolution of an imaging system is currently becoming scientific research in all imaging science fields, is an important research direction in the imaging science fields and the modern optical high-tech fields, and is also a target pursued by the optical world for a long time.
At present, in order to break through the diffraction limit in the microscopic imaging field, scientific researchers invented a series of novel optical imaging technologies such as stimulated radiation loss microscope, light activated positioning microscope, structural light illumination fluorescence microscope and the like, and greatly expanded the capability of human beings for observing the tiny world. However, the imaging technologies mostly adopt a mode of time space change, and have the problems of low speed, fluorescent dyeing, external laser excitation, complex system, high manufacturing cost and the like, so that the super-resolution microscopes have certain limitations in practical application. And recently, the new single-pixel imaging technology has better detection characteristics, higher detection efficiency and sensitivity. Therefore, the single-pixel imaging has better imaging detection effect under the conditions of extremely weak light, atmospheric turbulence and scattering medium, and the single-pixel imaging based on the Walsh-Hadamard transformation method can perfectly recover the image when the measurement times are equal to the number of pixels of the measured image at present, but the imaging resolution is still limited by the pixel resolution of the spatial light modulator and the diffraction limit of the optical system. Therefore, how to achieve higher imaging resolution is a hot spot of research.
Disclosure of Invention
The invention aims to apply a Fourier filtering technology of a Hadamard base pattern and optical incoherent light field intensity second-order autocorrelation to the field of super-resolution imaging, so as to provide a super-resolution association imaging system and method based on a negative correlation between a Hadamard base matrix and a transformation matrix thereof.
The invention is realized by the following technical scheme: a super-resolution single-pixel associated imaging system based on Hadamard matrix transformation comprises a light source, wherein a target, an imaging lens, a spatial light modulation device, a converging lens and a single-pixel detector are sequentially arranged in the emitting direction of the light source; the signal processed in the single-pixel detector is denoised and amplified by a photodiode amplifier, analog-to-digital conversion and digital signal acquisition are completed by a data acquisition card, the digital signal is transmitted to a computer, and correlated imaging is carried out with a Hadamard transformation matrix generated in the computer. The light source is sunlight, laser, an incandescent light source, an LED light source, a halogen light source, an infrared light source, an ultraviolet light source or X-rays. The imaging lens is a convex lens, a concave lens, a telescope, a microscope or a camera lens. The spatial light modulator is a reflective digital micromirror array (DMD) or a liquid crystal Spatial Light Modulator (SLM) or a projector. The single-point detector is a high-sensitivity photoelectric bias detector or a barrel detector. The photodiode amplifier is an analog signal amplifier. The acquisition card is an analog-to-digital converter for converting analog signals into digital signals.
The method for performing super-resolution imaging by using the super-resolution single-pixel imaging system based on Hadamard matrix transformation comprises the following steps:
1) The light beam emitted by the light source irradiates on a target object, and the transmitted light or the reflected and scattered light passes through a lens with the focal length of F, is reflected by the spatial light modulator, and is collected by the single-pixel detector through the converging lens; the distance between the object and the lens with the focal length of F, the distance between the lens with the focal length of F and the reflecting surface of the spatial light modulator and the focal length of the lens with the focal length of F meet the imaging relation of Gao Sibao lenses;
2) And carrying out frequency domain Gaussian high-pass filtering according to a preset Hadamard modulation matrix in the spatial light modulator, so as to generate a corresponding Hadamard transformation matrix. Wherein the threshold is set according to the size of the modulation matrix. The threshold setting method comprises the following steps: fourier Gaussian filtering is carried out on the Hadamard base pattern with the size of 64 multiplied by 64 pixels, the filtering threshold is selected to be from 30 to 5, the step length is 2, simulation is respectively carried out according to the steps, super-resolution imaging effects are observed, and a group of threshold with the best super-resolution is selected as an experimental threshold.
3) The signals received by the single-pixel detector and the Hadamard transformation matrix are input into a traditional self-correlation imaging system, and the MATLAB operation program is utilized to process according to the light intensity second-order correlation imaging principle, so that super-resolution correlation imaging is realized on the object to be imaged. The transformation matrix is obtained by carrying out Fourier filtering processing on the Hadamard base pattern by software.
The beneficial effects of the invention are:
1. the invention has super-resolution imaging capability breaking diffraction limit, and can improve resolution by multiple times of the traditional imaging;
2. the invention has simple structure and easy operation, does not increase the complexity of a single-pixel imaging system and the complexity of data processing, and only uses computing software to generate a corresponding matrix of the Hadamard matrix for correlated imaging;
3. the invention is insensitive to the instability of light intensity and has the capability of resisting the influence of bad weather such as atmospheric disturbance, turbulence and the like.
Drawings
Fig. 1 is a schematic block diagram of an embodiment example.
Fig. 2 is a comparison graph of resolution results of a super-resolution single-pixel imaging system scheme based on Hadamard matrix transformation according to the present invention.
In the figure: 1. a light source; 2. the object is a double-slit object; 3. an imaging lens; 4. a spatial light modulation device; 5. a converging lens; 6. a single point detector; 7. a photodiode amplifier; 8. a collection card; 9. and a computer.
Detailed Description
The light source 1 is sunlight, laser, an incandescent light source, an LED light source, a halogen light source and an infrared or ultraviolet light source. The target object 2 is a double slit or other object. The imaging lens 3 is a convex lens, a concave mirror, a telescope, a microscope or a camera lens. The spatial light modulator 4 is a reflective high-resolution, high-contrast and high-responsiveness digital micromirror array DMD or a liquid crystal spatial light modulator SLM. The converging lens (5) is a convex lens, a concave lens, a telescope, a microscope or a camera lens. The single-point detector 6 is used for collecting the intensity information of the reflected object light, and can be a high-sensitivity photoelectric bias detector, such as a silicon photoelectric detector and a pin photoelectric detector; and may also be a barrel detector such as CCD, EMCCD, CMOS, ICCD, inGaAs. The photodiode amplifier 7 is a transimpedance amplifier which amplifies very small photodiode current with ultra-low noise, has an amplification factor as high as 108 and can realize offset compensation of photodiode dark current. The acquisition card 8 is a high-speed analog-digital conversion data acquisition card 8 and acquires light intensity information captured by the single-point detector 7. The computer 9 is respectively connected with the spatial light modulation device 4 and the data acquisition card 8, and is used for controlling the substrate pattern loaded by the spatial light modulation device 4, and processing, storing and displaying the measurement data acquired by the data acquisition card 8. The computer 9 applies a correlated imaging algorithm system, and uses MATLAB algorithm to normalize and correlate the transformation matrix with the bucket signal data received by the detector to reconstruct an image.
FIG. 1 is a schematic structural layout of a super-resolution single-pixel imaging system and method based on frequency domain filtering according to one embodiment of the invention. The single pixel imaging system of fig. 1 includes a light source: LED, target object: double slit imaging lens with focal length of 150mm, spatial light modulation device: digital micromirror array, focusing lens with focal length of 100mm, single point detector: silicon detector, photodiode amplifier, acquisition card.
The experimental steps are as follows:
1, a light beam emitted by a light source irradiates a target object through a light splitting device, and reflected and scattered light is imaged on a spatial light modulation device loaded with a substrate pattern after passing through an imaging lens;
2, after being reflected by the spatial light modulation device, the intensity collection is completed by a single-point detector, the intensity signal is amplified and denoised by a photodiode amplifier, and finally the amplified signal is subjected to analog-digital conversion and acquisition by an acquisition card;
3, performing frequency domain Gaussian filtering on the Hadamard matrix I (x) by utilizing MATLAB operation program at a computer end to generate a transformation matrix I F (x)。
And 4, respectively carrying out image reconstruction on the barrel detector signal and the Hadamard transformation matrix by utilizing a MATLAB operation program and applying a correlation imaging algorithm.
Wherein, according to the resolution of the actual spatial light modulation device size 1024×768, the Hadamard speckle is amplified in advance and loaded on the spatial light modulation device. The turnover speed of the spatial light modulation device is controlled by utilizing the turnover modulatability of the spatial light modulation device, so that each time of turnover is realized, a corresponding large amount of effective data can be acquired by the acquisition card, and the stability of the data is ensured by taking an average value. Then, the collected barrel signal data B is transmitted to the computer i One-to-one correspondence with the computer-generated Gaussian filter matrix according to the sampling order i, and then utilizing a normalized correlation function according to the principle and method of correlated imaging
An image of the target object may be reconstructed.
The foregoing is a basic construction and a main method of the system of the present invention, and the following further details the key points of the present invention.
The imaging system is the most different from the traditional association imaging system in that super-resolution imaging is carried out based on the negative correlation between the Hadamard matrix and the transformation matrix thereof in the association imaging stage, so that the Hadamard transformation matrix is generated by using Gaussian high-pass filtering operation which is the most critical in the invention. The method comprises the following steps of firstly converting a Hadamard base pattern into a two-dimensional airspace matrix through matlab software, and carrying out Fourier transformation to generate a corresponding frequency domain matrix. And then performing Gaussian high-pass filtering operation on the frequency domain matrix, and generating a corresponding Hadamard transformation matrix through Fourier inversion. During the experiment, the selection of the filtering threshold is closely related to the final associated imaging effect. In the simulation calculation, fourier Gaussian filtering is carried out on a Hadamard base pattern with the size of 64 multiplied by 64 pixels, filtering thresholds are selected to be from 30 to 5, the step length is 2, simulation is carried out according to the steps, super-resolution imaging effects are observed, and a group of thresholds with the best super-resolution are selected as experimental thresholds.
By now it should be appreciated by those skilled in the art that while one exemplary embodiment of the invention has been shown and described in detail herein, many other variations or modifications that are consistent with the principles of the invention may be directly ascertained or derived from the teachings of the present disclosure without departing from the spirit and scope of the invention. Accordingly, the scope of the present invention should be understood and deemed to cover all such other variations or modifications.
Claims (10)
1. A super-resolution single-pixel associated imaging system based on Hadamard matrix transformation is characterized in that: the device comprises a light source (1), wherein a target (2), an imaging lens (3), a spatial light modulation device (4), a converging lens (5) and a single-pixel detector (6) are sequentially arranged in the emitting direction of the light source (1); the signal processed in the single-pixel detector (6) is denoised and amplified by a photodiode amplifier (7), analog-to-digital conversion and digital signal acquisition are completed by a data acquisition card (8), the digital signal is transmitted to a computer (9), and correlated imaging is carried out with a Hadamard transformation matrix generated in the computer (9).
2. The super-resolution single-pixel associated imaging system based on Hadamard matrix transformation as claimed in claim 1, wherein: the light source (1) is sunlight, laser, an incandescent light source, an LED light source, a halogen light source, an infrared light source, an ultraviolet light source or X-rays.
3. The super-resolution single-pixel associated imaging system based on Hadamard matrix transformation as claimed in claim 1, wherein: the imaging lens (3) is a convex lens, a concave mirror, a telescope, a microscope or a camera lens.
4. The super-resolution single-pixel associated imaging system based on Hadamard matrix transformation as claimed in claim 1, wherein: the spatial light modulator (4) is a reflective digital micromirror array (DMD) or a liquid crystal Spatial Light Modulator (SLM) or a projector.
5. The super-resolution single-pixel associated imaging system based on Hadamard matrix transformation as claimed in claim 1, wherein: the single-point detector (6) is a high-sensitivity photoelectric bias detector or a barrel detector.
6. The super-resolution single-pixel associated imaging system based on Hadamard matrix transformation as claimed in claim 1, wherein: the photodiode amplifier (7) is an analog signal amplifier.
7. The super-resolution single-pixel associated imaging system based on Hadamard matrix transformation as claimed in claim 1, wherein: the acquisition card (8) is an analog-to-digital converter for converting analog signals into digital signals.
8. A method for performing super-resolution imaging by using the super-resolution single-pixel imaging system based on Hadamard matrix transformation as set forth in any one of claims 1 to 7, characterized by comprising the steps of:
1) the light beam emitted by the light source (1) irradiates on the target object (2), and the transmitted light or the reflected scattered light passes through the lens (3) with the focal length of F, is reflected by the spatial light modulator (4), and is collected by the single pixel detector (6) through the converging lens (5); the distance between the object and the lens (3) with the focal length of F, the distance between the lens (3) with the focal length of F and the reflecting surface of the spatial light modulator (4) and the focal length of the lens (3) with the focal length of F meet the imaging relation of Gao Sibao lenses;
2) And carrying out frequency domain Gaussian high-pass filtering according to a preset Hadamard modulation matrix in the spatial light modulator (4), so as to generate a corresponding Hadamard transformation matrix. Wherein the threshold is set according to the size of the modulation matrix.
3) The signals received by the single-pixel detector and the Hadamard transformation matrix are input into a traditional self-correlation imaging system, and the MATLAB operation program is utilized to process according to the light intensity second-order correlation imaging principle, so that super-resolution correlation imaging is realized on the object to be imaged.
9. The method of super-resolution imaging as claimed in claim 8, wherein: the transformation matrix is obtained by carrying out Fourier filtering processing on the Hadamard base pattern by software.
10. The method of super-resolution imaging as claimed in claim 8, wherein: the threshold setting method comprises the following steps: fourier Gaussian filtering is carried out on the Hadamard base pattern with the size of 64 multiplied by 64 pixels, the filtering threshold is selected to be from 30 to 5, the step length is 2, simulation is respectively carried out according to the steps, super-resolution imaging effects are observed, and a group of threshold with the best super-resolution is selected as an experimental threshold.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211370945.3A CN116071230A (en) | 2022-11-03 | 2022-11-03 | Super-resolution single-pixel associated imaging system and method based on Hadamard matrix transformation |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211370945.3A CN116071230A (en) | 2022-11-03 | 2022-11-03 | Super-resolution single-pixel associated imaging system and method based on Hadamard matrix transformation |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN116071230A true CN116071230A (en) | 2023-05-05 |
Family
ID=86182800
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202211370945.3A Pending CN116071230A (en) | 2022-11-03 | 2022-11-03 | Super-resolution single-pixel associated imaging system and method based on Hadamard matrix transformation |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN116071230A (en) |
-
2022
- 2022-11-03 CN CN202211370945.3A patent/CN116071230A/en active Pending
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| Sibarita | Deconvolution microscopy | |
| CN105589188B (en) | A kind of microscopical imaging method of Structured Illumination and device | |
| JP2019503036A (en) | Temporal compression sensing system | |
| AU2016233588A1 (en) | Correcting for aberrations in incoherent imaging system using fourier ptychographic techniques | |
| CN110793633B (en) | Single-pixel multispectral calculation imaging system and imaging method based on bundled optical fibers | |
| US11727294B2 (en) | Method and system for quantum information processing and computation | |
| Rodríguez et al. | Dual-mode optical microscope based on single-pixel imaging | |
| CN107942338B (en) | Multi-wavelength associated imaging system based on digital micromirror device | |
| CN109211790B (en) | Single-pixel phase imaging method based on Fourier power spectrum detection | |
| CN113251916B (en) | Femtosecond interference scattering microscopic imaging system and measuring method | |
| CN107667310B (en) | Fluorescence imaging system | |
| Kolobrodov et al. | Physical and mathematical model of the digital coherent optical spectrum analyser | |
| CN109884052B (en) | Subtraction type harmonic microscopic imaging method based on CCD detection | |
| CN110567959B (en) | Self-adaptive aberration correction image scanning microscopic imaging method | |
| CN112882246B (en) | Super-resolution imaging system and method based on filtering incoherent light field intensity high-order autocorrelation | |
| CN116071230A (en) | Super-resolution single-pixel associated imaging system and method based on Hadamard matrix transformation | |
| CN110873956B (en) | Ultrahigh-speed orthogonal polarization imaging device and method | |
| CN110672610A (en) | Micro-correlation imaging system and imaging method based on digital micromirror array | |
| CN114740008A (en) | Super-resolution wafer defect detection system | |
| CN115372991B (en) | Spectrum super-resolution single-pixel imaging method based on compressed sensing | |
| EP4332878A1 (en) | Optical image processing method, machine learning method, trained model, machine learning preprocessing method, optical image processing module, optical image processing program, and optical image processing system | |
| CN114966739A (en) | Target detection imaging system and method based on fiber laser phased array | |
| CN115372991A (en) | Spectrum super-resolution Shan Xiangsu imaging method based on compressed sensing | |
| CN111239081A (en) | Super-resolution total internal reflection microscopic imaging device and method based on illumination of annular array light source | |
| Cao et al. | Zero-photon imaging under extremely low-light illumination |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |