CN117950262B - Single-pixel imaging method and device based on single photon detector - Google Patents
Single-pixel imaging method and device based on single photon detector Download PDFInfo
- Publication number
- CN117950262B CN117950262B CN202410303178.7A CN202410303178A CN117950262B CN 117950262 B CN117950262 B CN 117950262B CN 202410303178 A CN202410303178 A CN 202410303178A CN 117950262 B CN117950262 B CN 117950262B
- Authority
- CN
- China
- Prior art keywords
- time
- coding pattern
- photon
- pixel
- scene
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000003384 imaging method Methods 0.000 title claims abstract description 98
- 239000011159 matrix material Substances 0.000 claims abstract description 44
- 238000009826 distribution Methods 0.000 claims abstract description 33
- 230000036962 time dependent Effects 0.000 claims abstract description 17
- 238000000034 method Methods 0.000 claims abstract description 16
- 230000000737 periodic effect Effects 0.000 claims abstract description 14
- 238000001514 detection method Methods 0.000 claims description 18
- 238000012545 processing Methods 0.000 claims description 8
- 239000013307 optical fiber Substances 0.000 claims description 6
- 238000004891 communication Methods 0.000 claims description 3
- 238000005070 sampling Methods 0.000 claims description 3
- 238000003860 storage Methods 0.000 claims description 3
- 238000012634 optical imaging Methods 0.000 abstract description 3
- 238000001161 time-correlated single photon counting Methods 0.000 description 13
- 238000005516 engineering process Methods 0.000 description 8
- 230000008901 benefit Effects 0.000 description 6
- 230000008569 process Effects 0.000 description 5
- 230000004044 response Effects 0.000 description 5
- 230000006835 compression Effects 0.000 description 3
- 238000007906 compression Methods 0.000 description 3
- 230000000694 effects Effects 0.000 description 3
- 230000004048 modification Effects 0.000 description 3
- 238000012986 modification Methods 0.000 description 3
- 230000001052 transient effect Effects 0.000 description 3
- 230000004075 alteration Effects 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 2
- 230000008859 change Effects 0.000 description 2
- 238000006243 chemical reaction Methods 0.000 description 2
- 238000009432 framing Methods 0.000 description 2
- 238000005286 illumination Methods 0.000 description 2
- 238000004519 manufacturing process Methods 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 230000010355 oscillation Effects 0.000 description 2
- 238000011160 research Methods 0.000 description 2
- 230000035945 sensitivity Effects 0.000 description 2
- 230000003068 static effect Effects 0.000 description 2
- 230000009466 transformation Effects 0.000 description 2
- 230000005540 biological transmission Effects 0.000 description 1
- 230000002860 competitive effect Effects 0.000 description 1
- 230000007123 defense Effects 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 238000009776 industrial production Methods 0.000 description 1
- 230000001737 promoting effect Effects 0.000 description 1
- 230000003595 spectral effect Effects 0.000 description 1
- 238000001228 spectrum Methods 0.000 description 1
- 239000000126 substance Substances 0.000 description 1
Landscapes
- Transforming Light Signals Into Electric Signals (AREA)
Abstract
The invention relates to the technical field of ultrafast optical imaging, and provides a single-pixel imaging method and device based on a single-photon detector, wherein the method comprises the following steps: generating a coding pattern for loading on the digital micromirror device, and performing spatial structured light coding by utilizing the relative motion existing between the periodic ultrafast dynamic scene and the coding pattern; based on the received trigger signal sent by the digital micromirror device, sequentially acquiring a time-dependent photon number distribution histogram corresponding to each coding pattern; deconvolution operation is carried out on the acquired time-dependent photon number distribution histogram, and then deconvoluted signals are grouped according to the relative time in the scene; and sequentially reconstructing instantaneous images of different moments of the scene by using the photon number signals subjected to time grouping and the known coding matrix. The invention solves the problem that the imaging speed of a single pixel is limited by the refreshing speed of the spatial light modulator, and improves the imaging speed.
Description
Technical Field
The invention relates to the technical field of ultrafast optical imaging, in particular to a single-pixel imaging method and device based on a single-photon detector.
Background
The statements in this section merely provide background information related to the present disclosure and may not necessarily constitute prior art.
The ultra-fast optical imaging helps people to observe transient scenes by means of fast shooting and slow releasing, is an important technical means for promoting scientific research and industrial production, and plays an irreplaceable role in the fields of national defense and military, aerospace, precision manufacturing, chemical industry, biomedical treatment and the like. Currently, the widely applied ultra-fast imaging technologies include compression ultra-fast imaging, framing camera, pumping-detection and the like. Although these ultrafast imaging techniques are long, there are also some unavoidable application scenario limitations and performance shortboards. For example: compression ultrafast imaging has the problems of complex equipment, high cost, complex reconstruction algorithm and the like; the accuracy requirement of a trigger control system of the framing camera is extremely high and the time resolution is relatively low; the pump-detection technology belongs to an active illumination ultrafast imaging technology, and can not image self-luminous or natural light illumination scenes. It can be seen that the existing ultrafast imaging technology is not perfect, and cannot meet the ever-increasing ultrafast imaging requirements in scientific research and industrial manufacturing.
Single-pixel imaging is a novel imaging technology which has been widely studied in recent years, and has great potential for compensating the shortages of the imaging technology of an area array sensor because the imaging technology can acquire target space information by combining structured light coding and using single-pixel detection without space resolution capability, and the pixel scale of an imaging detector is compressed to the limit. By virtue of the advantages of the single-pixel detector in the sensing spectral range and sensitivity, the imaging of the single-pixel detector in the terahertz, infrared, X-ray and other special wave bands, the imaging in the extremely weak light condition, the imaging of a scattering medium, the imaging in the high spatial dimension and other aspects have proved to have great advantages and excellent performances. However, the current single-pixel imaging still faces a problem that the imaging speed is always at a low level, and is not suitable for dynamic scene imaging. The single pixel imaging speed is primarily limited by the refresh rate of the spatial light modulator, which is most commonly used and more advanced is a digital micromirror device (which may be simply referred to as a DMD) with a refresh rate of 22 KHz. Even in the case of using a digital micromirror device DMD as a spatial light modulator, full sampling imaging is performed, with imaging speeds of not more than 10fps at ten thousand imaging resolutions. If undersampling encoding or compression reconstruction is performed, the imaging speed can be improved to a certain extent, but high-speed imaging level is still difficult to achieve.
In summary, the slower imaging speed of a single pixel is mainly limited by the speed of structured light encoding, but not the response speed of a single pixel detector; resulting in a single pixel detector that itself has a very high response bandwidth and has not been fully exploited.
Disclosure of Invention
In order to solve the problems, the invention provides a single-pixel imaging method and a single-pixel imaging device based on a single-photon detector, which can fully play the response speed advantage of the single-pixel detector and can realize the imaging of a single-pixel Cheng Xiangdui ultra-fast dynamic scene by utilizing the ultra-fast relative motion existing between the ultra-fast dynamic scene and each coding pattern when capturing the periodical ultra-fast dynamic scene.
In order to achieve the above purpose, the present invention adopts the following technical scheme:
One or more embodiments provide a single pixel imaging method based on a single photon detector, including the steps of:
generating a coding pattern for loading on the digital micromirror device, and performing spatial structured light coding by utilizing the relative motion existing between the periodic ultrafast dynamic scene and the coding pattern;
Based on the received trigger signal sent by the DMD, sequentially acquiring a time-dependent photon number distribution histogram corresponding to each coding pattern;
Deconvolution operation is carried out on the acquired time-dependent photon number distribution histogram, and then deconvoluted signals are grouped according to the relative time in the scene;
and sequentially reconstructing the instantaneous images of different moments of the scene by using the photon number signals subjected to time grouping and the coding pattern matrix corresponding to the coding pattern.
One or more embodiments provide a single-pixel imaging device based on a single-photon detector, which comprises an imaging lens, a TIR prism, a digital micro-mirror device, an optical fiber coupler, a single-photon detection system and a control terminal, wherein the imaging lens, the TIR prism, the digital micro-mirror device, the optical fiber coupler, the single-photon detection system and the control terminal are sequentially arranged, and the control terminal is respectively in communication connection with the digital micro-mirror device and the single-photon detection system; the control terminal is configured to perform the steps in the single-pixel imaging method based on a single photon detector described above.
One or more embodiments provide a single pixel imaging device based on a single photon detector, comprising:
And a space coding module: configured to generate a coding pattern for loading onto the digital micromirror device, spatially structured light encoding utilizing relative motion existing between the periodic ultrafast dynamic scene and the coding pattern;
The acquisition module is used for: the system is configured to sequentially acquire a time-dependent photon number distribution histogram corresponding to each coding pattern based on a trigger signal sent by the received digital micromirror device DMD;
And a signal processing and grouping module: the method comprises the steps of firstly deconvoluting an acquired time-dependent photon number distribution histogram, and then grouping deconvoluted signals according to relative time in a scene;
And (3) a reconstruction module: the method is configured to reconstruct instantaneous images of different moments of a scene in sequence by utilizing photon number signals after time grouping and a coding pattern matrix corresponding to the coding pattern.
An electronic device comprising a memory and a processor and computer instructions stored on the memory and running on the processor, which when executed by the processor, perform the steps in the single photon detector based single pixel imaging method described above.
A computer readable storage medium storing computer instructions which, when executed by a processor, perform the steps of the single-photon detector-based single-pixel imaging method described above.
Compared with the prior art, the invention has the beneficial effects that:
1) The imaging method of the invention skillfully utilizes the ultra-fast relative motion existing between the periodic ultra-fast dynamic scene and the coding pattern to realize the ultra-fast spatial structured light coding, solves the problem that the single-pixel imaging speed is always limited by the refresh speed of the spatial light modulator, ensures that the single-pixel imaging speed completely depends on the acquisition rate of a single-pixel detection system, and realizes the capture of the single-pixel Cheng Xiangdui ultra-fast dynamic scene;
2) In the imaging performance, the single photon detector and TCSPC are used as a single pixel detector system, so that the system has extremely high weak light detection capability, and the imaging speed can reach trillion frames per second, and exceeds the imaging speed of all known single pixel imaging related work at present; compared with other existing ultra-fast imaging technologies, the method has more competitive power in terms of hardware cost and system simplicity on the premise of excellent imaging speed, and is beneficial to accelerating and popularizing ultra-fast imaging to be applied to more fields;
the advantages of the present invention, as well as additional aspects of the invention, will be described in detail in the following detailed examples.
Drawings
The accompanying drawings, which are included to provide a further understanding of the invention and are incorporated in and constitute a part of this specification, illustrate embodiments of the invention and together with the description serve to explain the invention.
FIG. 1 is a flow chart of a rapid imaging method according to embodiment 1 of the present invention;
Fig. 2 is a schematic structural diagram of an ultrafast single-pixel imaging device based on a single-photon detector in embodiment 2 of the present invention.
Detailed Description
The invention will be further described with reference to the drawings and examples.
It should be noted that the following detailed description is exemplary and is intended to provide further explanation of the invention. Unless defined otherwise, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this invention belongs.
It is noted that the terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting of exemplary embodiments according to the present invention. As used herein, the singular is also intended to include the plural unless the context clearly indicates otherwise, and furthermore, it is to be understood that the terms "comprises" and/or "comprising" when used in this specification are taken to specify the presence of stated features, steps, operations, devices, components, and/or combinations thereof. It should be noted that, in the case of no conflict, the embodiments of the present invention and features of the embodiments may be combined with each other. The embodiments will be described in detail below with reference to the accompanying drawings.
Example 1
In one or more embodiments, as shown in fig. 1, a single-pixel imaging method based on a single photon detector includes the following steps:
S1, generating a coding pattern for loading on a digital micromirror device, and performing space structure light coding by utilizing relative motion existing between a periodic ultrafast dynamic scene and the coding pattern;
Specifically, the digital micromirror device sequentially refreshes a series of loaded coding patterns, and the exposure time of each coding pattern is set to be equal to the period of the ultra-fast dynamic scene or the integral multiple of the period in advance; in the exposure time of each coding pattern, the coding pattern is static, and the imaging scene changes at high speed, so that each coding pattern can realize continuous spatial coding of the light field at different moments of the ultrafast dynamic scene.
S2, based on a trigger signal sent by the received digital micromirror device DMD, sequentially acquiring a time-dependent photon number distribution histogram corresponding to each coding pattern;
Specifically, the photon number distribution histogram is recorded by a single photon detector and a time-related single photon counter TCSPC, and based on a trigger signal sent by a received digital micromirror device, signals recorded by the single photon detector and the time-related single photon counter TCSPC in the exposure time of each coding pattern are sequentially obtained, namely a photon number distribution histogram with the same period length as the ultra-fast dynamic scene;
In the embodiment, the ultrafast dynamic scene is a dynamic scene with high image frame conversion speed, and the conversion speed can reach trillion frames per second;
S3, deconvolution operation is carried out on the acquired time-dependent photon number distribution histogram, and then signals after deconvolution are grouped according to the relative time in the scene;
S4, sequentially reconstructing instantaneous images of the ultrafast dynamic scene at different moments according to the photon number signals subjected to time grouping and the coding pattern matrix corresponding to the coding pattern;
The coding pattern matrix A is the digital representation of all coding patterns;
The imaging of the embodiment skillfully utilizes the ultra-fast relative motion existing between the periodic ultra-fast dynamic scene and the coding pattern to realize ultra-fast spatial structured light coding, solves the problem that the single-pixel imaging speed is always limited by the refresh speed of the spatial light modulator, ensures that the single-pixel imaging speed completely depends on the acquisition rate of a single-pixel detection system, and realizes the capture of the single-pixel Cheng Xiangdui ultra-fast dynamic scene.
In the step S1, the coding pattern is a series of binary coding patterns, wherein the binary coding patterns are used for being loaded on a digital micromirror device, and the coding patterns are refreshed in sequence through a spatial light modulator to realize the spatial coding of an ultrafast dynamic scene;
Optionally, the generating process of the binary coding pattern matrix specifically includes the following steps:
S1-1, generating a Hadamard matrix with the same size order as the imaging pixel number according to the imaging pixel number;
Specifically, the Hadamard matrix is composed of an element 1 and an element-1;
s1-2, carrying out differential processing on the generated Hadamard matrix;
Since DMD cannot directly encode-1, differential processing is required for the generated Hadamard matrix, and the following steps are specific: differentiating each row of the Hadamard matrix into two rows, wherein the first row is formed by changing an element (1, -1) of a generating row into an element (1, 0), and the second row is formed by replacing the element (1, -1) of the generating row with the element (0, 1), so as to obtain a differential Hadamard matrix;
after the differential operation, each row of the obtained differential Hadamard matrix is composed of elements (0, 1), which can be represented by a spatial light modulator, and the matrix obtained after subtracting every two rows is completely equal to the normal Hadamard matrix.
S1-3, generating a random matrix consisting of 0 and 1, and performing exclusive OR operation with the differential Hadamard matrix; the length of each row of the random matrix is equal to that of each row of the differential Hadamard matrix, and 0 and 1 in the random matrix are randomly distributed;
The purpose of this step is to make the single pixel signal distribution uniform, which is helpful to improve the signal-to-noise ratio of imaging; before the exclusive-or operation, firstly generating a (0, 1) matrix which is equal to the length of each row of the differential Hadamard matrix and is randomly distributed, then sequentially carrying out the exclusive-or operation on each row of the differential Hadamard matrix and the random matrix, and finally obtaining the exclusive-or Hadamard matrix which still maintains the orthogonality of the normal Hadamard matrix;
S1-4, each row of the Hadamard matrix after the exclusive OR operation is transformed into a square matrix, up-sampling is carried out according to the pixel scale of the DMD and the imaging view field requirement, and the size of the coding pattern is adjusted by adding zero, so that the coding pattern consistent with the resolution of the DMD is obtained.
In the step 1, ultra-fast space structured light coding is carried out by utilizing the relative motion existing between a periodic ultra-fast dynamic scene and a coding pattern; in the embodiment, the spatial light modulator sequentially refreshes the coding patterns to realize the spatial coding of the scene to be imaged;
Specifically, the spatial encoding process is as follows:
Step S11, measuring a period T of an ultrafast dynamic scene to be imaged by a single photon detector system;
Step S12, setting the exposure time of each coding pattern to be a period T or an integral multiple of the period T;
S13, refreshing the loaded coding patterns sequentially through the digital micromirror device;
After each coding pattern is refreshed, the coding pattern is kept still, the imaging scene is changed at a high speed, and the continuous space coding of the light field at different moments of the ultra-fast dynamic scene can be realized by each coding pattern by setting the relation between the exposure time and the period T of the ultra-fast dynamic scene to be imaged.
In this embodiment, the spatial modulator realizes the ultrafast spatial encoding of the periodic ultrafast dynamic scene by refreshing the encoding patterns, and compared with the spatial encoding scheme in the prior art that the spatial modulator only completes one static scene by refreshing one encoding pattern, the encoding rate and efficiency can be greatly improved, each encoding pattern can spatially encode the light field of the ultrafast dynamic scene at any moment, and the encoding speed of the spatial modulator is greatly improved.
In step 2, a trigger signal is sent to a time-related single photon counter TCSPC every time the DMD refreshes a pattern, and the TCSPC starts to record a new photon number distribution histogram after receiving the trigger signal;
As an achievable solution, in step S2, the process of collecting the photon number distribution histogram may be expressed as:
Wherein, Is one/>Is a digital representation of all the coding patterns, specifically expressed as the total amount of coding patterns/>Each of the effective pixel numbers of each of the encoding patterns is/>And each. Since the Hadamard matrix is differentially operated, here/>。
Representing a periodic dynamic scene of imaging, discretized into/>Each moment, the scene at each moment is discretized into/>The number of spatial pixels corresponds to the number of effective pixels of the coding pattern.
The data collected by the single photon detection system is represented, each row represents a photon number distribution histogram, including/>At all times, co-acquire/>A strip.
In some embodiments, in step S3, signal processing and grouping are implemented, which specifically includes the following steps:
S3-1, deconvoluting the acquired photon number distribution histogram by adopting a Wiener deconvolution method; the convolution kernel is the time-bandwidth product of the imaging hardware system;
The time bandwidth product is the product of the pulse width and the spectrum width of the pulse, and the imaging hardware system is the single-pixel imaging device based on the single photon detector as shown in fig. 2.
Due to the time jitter of the single photon detector and TCSPC, optical element aberrations, and the presence of experimental noise, the acquired distribution histogram of the number of photons per sheet can be expressed as:
Wherein, Represents the/>Zhang Bianma pattern directly collected photon number distribution histogram; /(I)Represents the/>Zhang Bianma pattern-corresponding ideal photon number distribution histogram; /(I)Representing the time bandwidth effect of hardware, which is determined by the single photon detector and the time jitter of TCSPC and the aberration of the optical element; /(I)Representing a convolution operation; /(I)Representing experimental noise such as ambient light and dark counts of single photon detectors, etc.
In order to remove the influence of hardware time bandwidth as much as possible, the embodiment performs deconvolution operation on each collected photon number distribution histogram. However, a serious problem arises from the direct implementation of conventional deconvolution operations, namely that even if there are small random disturbances in the signal, relatively large oscillations occur in the result of conventional deconvolution operations. To avoid this problem as much as possible, the present embodiment can maximally suppress oscillation using a Wiener filter.
It should be noted that the noise-to-signal ratio (Noise to signal ratio, NSR) is a critical parameter when Wiener deconvolution is used, which directly affects the reconstruction. If NSR is too small, the denoising effect is not obvious; if NSR is too large, although the denoising effect is remarkable, image blurring is caused, which is equivalent to introducing another distortion.
The NSR parameter needs to be determined according to the actual noise level, and in this embodiment, the noise signal ratio NSR is preferably set to be about 0.1, and specifically may be set to be 0.08 to 0.12.
S3-2, signal grouping: after deconvolving all photon number distribution histograms, the photon numbers at the same time in each group of photon number distribution histograms are taken out as one group.
Specifically, the time interval of the signal packet is set according to the digital resolution of TCSPC, for example, the digital resolution of TCSPC is 1ps, and the minimum time interval between groups may be set to 1ps.
In step S4, a series of transient images are reconstructed; an inverse Hadamard transformation reconstruction algorithm is adopted, and instantaneous images representing different moments of a scene can be sequentially reconstructed by utilizing the photon number signals after grouping and a known coding pattern matrix A;
The adopted inverse Hadamard transformation reconstruction algorithm reconstructs instantaneous images representing different moments of the ultra-fast dynamic scene, and specifically comprises the following steps:
The inverse Hadamard transform operation is expressed as:
Wherein the matrix Is one-dimensional and represents the reconstructed representation/>Instant image data at moment is solved and then is deformed into a two-dimensional image; matrix/>Is two-dimensional and represents a Hadamard matrix after differential exclusive OR; matrix/>Is one-dimensional, representing wiener deconvolution and representation after grouping operations/>Photon count signal at time.
In this embodiment, the ultra-fast spatial encoding is performed by utilizing the relatively ultra-fast change between the periodic ultra-fast dynamic scene and each encoding pattern, and the photon number time distribution detection is performed by using the single photon detection device, so that the ultra-fast imaging speed of trillion frames per second can be realized by single-pixel imaging, the advantage of the high detection speed of the single-pixel detector is fully exerted, and the single-pixel imaging speed is improved.
Example 2
Based on embodiment 1, there is provided in this embodiment a single-pixel imaging device based on a single photon detector, including: the imaging lens, the TIR prism, the digital micromirror device DMD, the optical fiber coupler, the single photon detection system and the control terminal are sequentially arranged, and the control terminal is respectively in communication connection with the digital micromirror device DMD and the single photon detection system; the control terminal is configured to perform the steps in the single-pixel imaging method based on a single photon detector described in embodiment 1.
Wherein the single photon detection system comprises a single photon detector and TCSPC; TCSPC is a time-dependent single photon counting device; the control terminal may be a computer, a server, or the like.
When a scene to be imaged is acquired and imaged, firstly, an ultrafast changing scene is imaged to an effective coding area of the DMD by an imaging lens, and the middle part of the scene passes through a TIR prism which does not change the light propagation direction in the process of transmitting light from the lens to the DMD; the DMD then refreshes a series of pre-generated and stored encoding patterns, each of which has an exposure time equal to the period or integer multiple of the period of the periodic ultrafast dynamic scene.
Each time the DMD refreshes a pattern, it will send a trigger signal to the TCSPC, which will start recording a new photon number distribution histogram after receiving the trigger signal. Then, the light field coded by the DMD changes the transmission direction through the TIR prism, and is coupled into the optical fiber through the optical fiber coupler and transmitted to the single photon detector for detecting the target surface. The TCSPC is then coupled to a single photon detector that emits an electrical signal when it detects a photon, and is configured to receive the single photon detector signal and the precise time of arrival. Finally, forming a time-dependent photon number distribution histogram in a computer as a control terminal; and carrying out subsequent rapid imaging processing.
In this embodiment, the photon detector is used as a detector in a single-pixel imaging system, and can operate in geiger mode with higher sensitivity and response speed than a normal linear mode single-pixel detector. By adopting the imaging method of the embodiment 1, the advantage of the response speed of the single-pixel detector is fully exerted, so that the single-pixel imaging can capture a transient scene to realize ultra-fast imaging.
Example 3
Based on embodiment 1, the present embodiment provides a single-pixel imaging device based on a single photon detector, comprising:
And a space coding module: configured to generate a coding pattern for loading onto the digital micromirror device, spatially structured light encoding utilizing relative motion existing between the periodic ultrafast dynamic scene and the coding pattern;
The acquisition module is used for: the system is configured to sequentially acquire a time-dependent photon number distribution histogram corresponding to each coding pattern based on a trigger signal sent by the received digital micromirror device DMD;
And a signal processing and grouping module: the method comprises the steps of firstly deconvoluting an acquired time-dependent photon number distribution histogram, and then grouping deconvoluted signals according to relative time in a scene;
And (3) a reconstruction module: the method is configured to reconstruct instantaneous images of different moments of a scene in sequence by utilizing photon number signals after time grouping and a coding pattern matrix corresponding to the coding pattern.
Here, the modules in this embodiment are in one-to-one correspondence with the steps in embodiment 1, and the implementation process is the same, which is not described here.
Example 4
Based on embodiment 1, this embodiment provides an electronic device including a memory and a processor, and computer instructions stored on the memory and running on the processor, which when executed by the processor, perform the steps in the single-pixel imaging method based on a single photon detector described in embodiment 1.
Example 5
Based on embodiment 1, this embodiment provides a computer readable storage medium, configured to store computer instructions that, when executed by a processor, perform the steps in the single-pixel imaging method based on a single photon detector described in embodiment 1.
The above description is only of the preferred embodiments of the present invention and is not intended to limit the present invention, but various modifications and variations can be made to the present invention by those skilled in the art. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present invention should be included in the protection scope of the present invention.
While the foregoing description of the embodiments of the present invention has been presented in conjunction with the drawings, it should be understood that it is not intended to limit the scope of the invention, but rather, it is intended to cover all modifications or variations within the scope of the invention as defined by the claims of the present invention.
Claims (9)
1. The single-pixel imaging method based on the single-photon detector is characterized by comprising the following steps of:
Generating a coding pattern for loading onto a digital micromirror device, and performing spatial structured light coding by using the relative motion existing between a periodic ultrafast dynamic scene and the coding pattern, comprising the following steps:
Measuring a period T of an ultrafast dynamic scene to be imaged;
Setting the exposure time of each encoding pattern to be a period T or an integer multiple of the period T;
refreshing the loaded coding patterns in sequence through the digital micromirror device;
Based on the received trigger signal sent by the digital micromirror device, sequentially acquiring a time-dependent photon number distribution histogram corresponding to each coding pattern;
Deconvolution operation is carried out on the acquired time-dependent photon number distribution histogram, and then deconvoluted signals are grouped according to the relative time in the scene;
and sequentially reconstructing the instantaneous images of different moments of the scene by using the photon number signals subjected to time grouping and the coding pattern matrix corresponding to the coding pattern.
2. The single-pixel imaging method based on a single photon detector as claimed in claim 1 wherein the encoding pattern adopts a binary encoding pattern, and the generating method comprises the steps of:
Generating a Hadamard matrix with the same size order as the imaging pixel number according to the imaging pixel number;
performing differential processing on the generated Hadamard matrix to generate a differential Hadamard matrix;
generating a random matrix consisting of 0 and 1, and performing exclusive OR operation with the differential Hadamard matrix;
Each row of the Hadamard matrix after the exclusive OR operation is transformed into a square matrix, up-sampling is carried out according to the pixel scale of the digital micro-mirror device and the imaging view field requirement, and the size of the coding pattern is adjusted by adding zero, so that the coding pattern consistent with the resolution of the digital micro-mirror device is obtained.
3. The single-pixel imaging method based on a single photon detector as claimed in claim 1 wherein: deconvolution is carried out on the obtained photon number distribution histogram by adopting a Wiener deconvolution method; the noise signal ratio during deconvolution is set to 0.08 to 0.12.
4. The single-pixel imaging method based on a single photon detector as claimed in claim 1 wherein: and sequentially reconstructing the instantaneous images of different moments of the scene through an inverse Hadamard transform algorithm.
5. The single-pixel imaging method based on single photon detectors of claim 1, wherein deconvoluted signals are grouped by relative time in the scene, in particular:
Setting a time interval of the signal packet according to a digital resolution of the time-dependent single photon counting device;
after deconvolution of all photon number distribution histograms, the photon numbers at the same time in each photon number distribution histogram are divided into a group at set time intervals.
6. Single-pixel imaging device based on single photon detector, its characterized in that: the system comprises an imaging lens, a TIR prism, a digital micro-mirror device, an optical fiber coupler, a single photon detection system and a control terminal which are sequentially arranged, wherein the control terminal is respectively in communication connection with the digital micro-mirror device and the single photon detection system; the control terminal is configured to perform the steps in the single-pixel imaging method based on a single photon detector as claimed in any one of claims 1-5.
7. A single-pixel imaging device based on a single photon detector, comprising:
and a space coding module: configured to generate a coding pattern for loading onto a digital micromirror device, spatially structured light encoding using relative motion existing between a periodic ultrafast dynamic scene and the coding pattern, comprising the steps of:
Measuring a period T of an ultrafast dynamic scene to be imaged;
Setting the exposure time of each encoding pattern to be a period T or an integer multiple of the period T;
refreshing the loaded coding patterns in sequence through the digital micromirror device;
the acquisition module is used for: the system is configured to sequentially acquire a time-dependent photon number distribution histogram corresponding to each coding pattern based on a trigger signal sent by the received digital micromirror device;
And a signal processing and grouping module: the method comprises the steps of firstly deconvoluting an acquired time-dependent photon number distribution histogram, and then grouping deconvoluted signals according to relative time in a scene;
And (3) a reconstruction module: the method is configured to reconstruct instantaneous images of different moments of a scene in sequence by utilizing photon number signals after time grouping and a coding pattern matrix corresponding to the coding pattern.
8. An electronic device comprising a memory and a processor and computer instructions stored on the memory and running on the processor, which when executed by the processor, perform the steps in the single-photon detector-based single-pixel imaging method of any one of claims 1-5.
9. A computer readable storage medium storing computer instructions which, when executed by a processor, perform the steps in the single photon detector based single pixel imaging method of any one of claims 1-5.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202410303178.7A CN117950262B (en) | 2024-03-18 | 2024-03-18 | Single-pixel imaging method and device based on single photon detector |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202410303178.7A CN117950262B (en) | 2024-03-18 | 2024-03-18 | Single-pixel imaging method and device based on single photon detector |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN117950262A CN117950262A (en) | 2024-04-30 |
| CN117950262B true CN117950262B (en) | 2024-06-18 |
Family
ID=90798378
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202410303178.7A Active CN117950262B (en) | 2024-03-18 | 2024-03-18 | Single-pixel imaging method and device based on single photon detector |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN117950262B (en) |
Family Cites Families (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109343238B (en) * | 2018-09-20 | 2020-05-12 | 华东师范大学 | Compressed ultrahigh-speed photographic device based on electro-optic crystal deflection |
| KR102598511B1 (en) * | 2020-06-02 | 2023-11-06 | 한국과학기술원 | Ultrafast camera system and measurement method thereof |
| JPWO2022153969A1 (en) * | 2021-01-12 | 2022-07-21 | ||
| CN113709325B (en) * | 2021-07-20 | 2023-09-15 | 辽宁大学 | Single-pixel imaging method based on Hadamard frequency domain transformation matrix threshold filtering |
| CN114051106B (en) * | 2021-10-29 | 2022-08-02 | 中国科学院西安光学精密机械研究所 | Spatial spectrum filtering frequency domain reconstruction high-speed imaging system and method |
| CN114710615B (en) * | 2022-06-08 | 2022-08-12 | 中国人民解放军国防科技大学 | Efficient single-pixel imaging method and system |
| CN115567663A (en) * | 2022-08-22 | 2023-01-03 | 华东师范大学 | Ultra-sensitive mid-infrared single-pixel imaging method and device based on nonlinear spatial modulation |
| CN116560080B (en) * | 2023-07-10 | 2023-09-26 | 之江实验室 | Single photon single pixel imaging device and method through thick scattering medium |
-
2024
- 2024-03-18 CN CN202410303178.7A patent/CN117950262B/en active Active
Non-Patent Citations (2)
| Title |
|---|
| 单像素成像在特殊波段及三维成像的应用发展;孙宝清等;红外与激光工程;20200331;第49卷(第3期);全文 * |
| 基于锁相光子计数测量的单像素空间频率域成像系统;赵宽心;李同心;侯茜;但迈;高峰;;光学学报;20190410(第04期);全文 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN117950262A (en) | 2024-04-30 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10571675B2 (en) | Temporal compressive sensing systems | |
| CN101893552B (en) | Hyperspectral imager and imaging method based on compressive sensing | |
| US20120330162A1 (en) | Modulated aperture imaging for automatic moving target detection | |
| CN106772310A (en) | A kind of objective identification devices and methods therefor based on calculating ghost imaging | |
| CN109343238B (en) | Compressed ultrahigh-speed photographic device based on electro-optic crystal deflection | |
| CN116893429B (en) | Single-pixel imaging method and target identification method based on circular harmonic Fourier light field | |
| CN117950262B (en) | Single-pixel imaging method and device based on single photon detector | |
| CN114051106B (en) | Spatial spectrum filtering frequency domain reconstruction high-speed imaging system and method | |
| CN103986936B (en) | A kind of video compress acquisition system and its acquisition method | |
| CN107580164A (en) | The compressed sensing super-resolution imaging system and its imaging method of a kind of single measurement | |
| CN111164395B (en) | Spectral imaging apparatus and method | |
| CN111698435B (en) | Space-frequency spectrum multi-dimensional joint modulation imaging acceleration method and device | |
| CN212628122U (en) | Short wave infrared imaging system | |
| US20220272286A1 (en) | Image acquisition techniques with reduced noise using single photon avalanche diodes | |
| He et al. | Research on single-pixel imaging method in the complex environment | |
| CN109361833B (en) | Transmission method of single photon compression video transmission device | |
| CN111640063A (en) | Compression imaging system and method based on space frequency domain multi-scale modulation and reconstruction | |
| Li et al. | Compressive imaging beyond the sensor's physical resolution via coded exposure combined with time-delay integration | |
| Majumder et al. | Compressive Sensing Based Active Imaging System Using Programable Coded Mask and a Photodiode | |
| CN115580762B (en) | Multichannel coupling compression ultrafast imaging device | |
| Li et al. | TDI-based continuous window compressed spatio-temporal imaging capable of flexible voxels post-interpretation | |
| Chan et al. | SpinCam: High-Speed Imaging via a Rotating Point-Spread Function | |
| CN116033138B (en) | Single exposure compressed sensing passive three-dimensional imaging system and method | |
| Feng et al. | Real-time Ghost Imaging Algorithm on Multidimensional Vector Matrix Walsh Transformation with Free-Fps | |
| US20230401765A1 (en) | A method and a system for compressed ultrafast tomographic imaging |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant |