CN116228547B - Simulation method of synthetic aperture imaging process - Google Patents
Simulation method of synthetic aperture imaging process Download PDFInfo
- Publication number
- CN116228547B CN116228547B CN202310504700.3A CN202310504700A CN116228547B CN 116228547 B CN116228547 B CN 116228547B CN 202310504700 A CN202310504700 A CN 202310504700A CN 116228547 B CN116228547 B CN 116228547B
- Authority
- CN
- China
- Prior art keywords
- synthetic aperture
- spectrum
- aperture imaging
- resolution image
- pupil
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000003384 imaging method Methods 0.000 title claims abstract description 104
- 238000000034 method Methods 0.000 title claims abstract description 65
- 238000004088 simulation Methods 0.000 title claims abstract description 65
- 210000001747 pupil Anatomy 0.000 claims abstract description 36
- 238000001228 spectrum Methods 0.000 claims description 43
- 238000005070 sampling Methods 0.000 claims description 14
- 238000004364 calculation method Methods 0.000 claims description 11
- 238000012805 post-processing Methods 0.000 claims description 11
- 239000000654 additive Substances 0.000 claims description 5
- 230000000996 additive effect Effects 0.000 claims description 5
- 239000011159 matrix material Substances 0.000 claims description 4
- 230000002093 peripheral effect Effects 0.000 claims description 4
- 238000012545 processing Methods 0.000 claims description 3
- 230000009466 transformation Effects 0.000 claims description 3
- 238000003475 lamination Methods 0.000 abstract description 3
- 238000007781 pre-processing Methods 0.000 abstract description 2
- 238000002474 experimental method Methods 0.000 description 11
- 238000004422 calculation algorithm Methods 0.000 description 10
- 230000005540 biological transmission Effects 0.000 description 6
- 230000003287 optical effect Effects 0.000 description 6
- 230000003595 spectral effect Effects 0.000 description 4
- 238000006073 displacement reaction Methods 0.000 description 3
- 230000001427 coherent effect Effects 0.000 description 2
- 230000000694 effects Effects 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 238000012952 Resampling Methods 0.000 description 1
- 238000010276 construction Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T3/00—Geometric image transformation in the plane of the image
- G06T3/40—Scaling the whole image or part thereof
- G06T3/4007—Interpolation-based scaling, e.g. bilinear interpolation
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T5/00—Image enhancement or restoration
- G06T5/10—Image enhancement or restoration by non-spatial domain filtering
-
- G06T5/70—
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/20—Special algorithmic details
- G06T2207/20048—Transform domain processing
- G06T2207/20056—Discrete and fast Fourier transform, [DFT, FFT]
Landscapes
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Image Processing (AREA)
Abstract
The application provides a simulation method of a synthetic aperture imaging process, which comprises the following steps: the method comprises a preprocessing step, a supersampling step, a pupil dithering step, a low-resolution image generation step, an image dithering step and a downsampling step, wherein simulation for the pupil dithering and the image dithering is added under the condition that the simulation efficiency is not obviously reduced, so that the relative dithering of a lens and an imaging target in a real environment is simulated, and the influence of specific dithering on the imaging quality of a Fourier lamination can be more completely simulated.
Description
Technical Field
The invention relates to the technical field of image processing, in particular to a simulation method of a synthetic aperture imaging process.
Background
The complete simulation has guiding effect on experiments. When simulation of a high-power Fourier laminated imaging experiment is carried out, the simulation of the relative shake of a lens and a target surface is not carried out in the conventional algorithm scheme, so that the problems that a real experiment cannot be more closely simulated, the deviation of an experiment result is larger and the like are caused.
At present, in the simulation scheme of the disclosed Fourier laminated imaging shooting process, a simulation module for relatively shaking a lens and a target surface is not provided. In real experiments, especially ultra-long distance imaging experiments, the relative shake of the target and the lens is always present and unavoidable, and in order to explore the influence of the shake on the imaging quality of the fourier stack, a simulation module for the shake should be added in the algorithm.
Disclosure of Invention
In order to solve the problems in the prior art, the application provides a simulation method of a synthetic aperture imaging process, and pupil shake and image shake are added into an algorithm under the condition that simulation efficiency is not obviously reduced, so that the fitting degree of a simulation result and an experiment result is improved, and the guidance of simulation on the experiment is better realized.
In order to achieve the technical purpose, the invention adopts the following technical scheme:
a simulation method for synthetic aperture imaging comprises the following steps:
step S1: pretreatment: obtaining complex amplitude distribution of the target image;
step S2: supersampling: the complex amplitude distribution obtained in the step S1 is subjected to oversampling, wherein the oversampling is to increase the density of sampling points on the basis of the complex amplitude distribution, so as to obtain the complex amplitude distribution after the oversampling;
step S3: pupil dithering step: calculating a pupil sequence of the synthetic aperture, and generating a pupil sequence containing jitter by adding random translation to the pupil sequence;
step S4: low resolution image generation: calculating to obtain a low-resolution image sequence corresponding to the target image according to the supersampled complex amplitude distribution and the pupil sequence containing jitter;
step S5: image dithering step: adding random dithering to the low-resolution image sequence to generate a low-resolution image sequence containing dithering;
step S6: and (3) downsampling: and (3) downsampling the low-resolution image sequence containing the jitter, which is obtained in the step (S5), wherein the downsampling is to reduce the density of sampling points, and the downsampled low-resolution image sequence for Fourier stack reconstruction can be obtained.
As a preferred solution, the random translation in step S3 is a uniform random translation, and/or a random translation conforming to a two-dimensional gaussian distribution.
As a preferred solution, the random dithering in step S5 is a uniform random translation, and/or a random translation conforming to a two-dimensional gaussian distribution.
As a preferred solution, the step S5 further comprises adding noise to the low resolution image sequence.
As a preferred solution, the noise comprises multiplicative noise, and/or additive noise.
As a preferred embodiment, step S5 further comprises a step of scaling the low resolution image sequence, or the low resolution image sequence with jitter, said scaling being an equal-scale transformation of the size of the image sequence.
As a preferable scheme, the scaling factor is 0.9-1.1.
As a preferred solution, the scaling is a uniformly distributed random scaling or a random scaling conforming to a gaussian distribution.
As a preferred embodiment, the step S1 includes the steps of:
step S11: inputting an imaging target
；
Step S12: calculating imaging target amplitude
Said->
；
Step S13: adding phase distribution to imaging targets
Obtaining complex amplitude of imaging target
。
As a preferred embodiment, the step S2 includes the steps of:
step S21: the spectrum of the imaged object is calculated,
；
step S22: calculating the size of the imaging target spectrum
Said->
Matrix order for imaging target spectrum;
step S23: reconstructing and denoising an imaging target to generate a high-resolution image, obtaining a reconstructed image, and calculating the size of the reconstructed image
；
Step S24: comparison of
And->
The size of (1)>
≤ />
For->
Supersampling to obtain the complex amplitude distribution +.>
Returning to step S21 again, according to +.>
Recalculating the oversampled imaging target spectrum
And do->
Performing spectrum post-processing; if->
＞ />
Then the imaging target spectrum obtained in step S21
Directly performing spectrum post-processing, and marking the spectrum after spectrum post-processing as +.>
。
In a preferred embodiment, in step S22, the dimensions are as follows
Equal to the resolution of the imaged object.
In a preferred embodiment, in step S23, the dimensions are as follows
=0.9 to 1.1x, where x is the resolution of the reconstructed image.
As a preferred embodiment of the present invention,
=x。
in a preferred embodiment, in step S24, the spectrum post-processing is performed by performing peripheral zero padding on the high-frequency portion of the spectrum.
As a preferable mode, in the step S24, when
When the aperture imaging simulation method is stopped, a new imaging target with higher resolution than the original imaging target is selected, and simulation calculation is performed again from the step S1 until +.>
。
As a preferred embodiment, the step S3 includes the steps of:
step S31: pupil sequence for calculating synthetic aperture
；
Step S32: pupil alignment
Adding random translation to generate pupil sequence +.>
。
As a preferred embodiment, the step S4 includes the steps of:
step S41: calculating a low resolution image sequence spectrum
= />
The method comprises the steps of carrying out a first treatment on the surface of the Wherein the method comprises the steps of
For pupil sequences with jitter +.>
Spectrum of the imaging target calculated from the oversampled complex amplitude;
step S42: according to
Calculating to obtain a low resolution image sequence +.>
= />
Wherein
Inverse fourier transform symbols;
as a preferred solution, the simulation method further comprises a reconstruction step S7,
step S7: and (3) carrying out image registration, image denoising and stack restoration on the low-resolution image sequence which can be used for Fourier stack reconstruction and is obtained in the step (S6), and finally outputting a reconstruction target image.
The technical scheme has the advantages that: in the technical scheme, the simulation aiming at pupil shake and image shake is added to simulate the relative shake of the lens and the imaging target in the real environment, so that the simulation can be more complete to investigate the influence of specific shake on the imaging quality of the Fourier lamination.
Drawings
FIG. 1 is a simulation reconstruction result after adding a small amount of jitter in one embodiment provided in the present application;
FIG. 2 provides experimental reconstruction results in the presence of small amounts of jitter in one embodiment of the present application;
FIG. 3 is a simulation reconstruction result after adding a large amount of jitter in one embodiment provided herein;
FIG. 4 provides experimental reconstruction results in the presence of a large amount of jitter in one embodiment provided herein;
FIG. 5 is a simulated reconstruction result without added jitter in one embodiment provided herein;
fig. 6 is a flow chart of a simulation method of a synthetic aperture imaging process provided in one embodiment of the present application.
Detailed Description
Features and exemplary embodiments of various aspects of the present application are described in detail below to make the objects, technical solutions and advantages of the present application more apparent, and to further describe the present application in conjunction with the accompanying drawings and the detailed embodiments. It should be understood that the specific embodiments described herein are intended to be illustrative of the application and are not intended to be limiting. It will be apparent to one skilled in the art that the present application may be practiced without some of these specific details. The following description of the embodiments is merely intended to provide a better understanding of the present application by showing examples of the present application.
Fourier stack imaging, fourier Ptychography Imaging, FP for short, is a new image reconstruction technique, which uses fourier transforms to recover images and has better optical performance, and in general terms, FP is a technique that breaks up a real image into a series of fourier transformed samples, which are then used to reconstruct the original image.
The FP has the core principle that the image is subjected to multiple fourier transform, i.e., the image is first decomposed into different optical apertures, then the different optical apertures are used to detect spectral signals, the original image is combined by an analog simulation method, the FP can realize high-resolution image reconstruction, super-diffraction limit imaging is realized, and the FP has a better dynamic range and signal-to-noise ratio than the traditional imaging technology.
The key technology of FP is the construction of synthetic aperture imaging algorithms. In a real environment, relative jitter between a target surface and a lens is various, and there are up to 9 degrees of freedom of jitter, wherein the number of relative displacement degrees of freedom is 3, and the number of rotational degrees of freedom lenses, namely an imaging system and the target surface, is 6 respectively, but no simulation of the relative jitter between the lens and the target surface exists in the existing algorithm scheme at present, so that the simulated image and the actual image come in and go out. Therefore, the influence of jitter needs to be considered in the actual simulation, thereby ensuring the authenticity of the simulated image.
Based on the above, the application provides a simulation method of synthetic aperture imaging, which comprises the following steps:
step S1: pretreatment: obtaining complex amplitude distribution of the target image;
step S2: supersampling: the complex amplitude distribution obtained in the step S1 is subjected to oversampling, wherein the oversampling is to increase the density of sampling points on the basis of the complex amplitude distribution, so as to obtain the complex amplitude distribution after the oversampling;
step S3: pupil dithering step: calculating a pupil sequence of the synthetic aperture, and generating a pupil sequence containing jitter by adding random translation to the pupil sequence;
step S4: low resolution image generation: calculating to obtain a low-resolution image sequence corresponding to the target image according to the supersampled complex amplitude distribution and the pupil sequence containing jitter;
step S5: image dithering step: adding random dithering to the low-resolution image sequence to generate a low-resolution image sequence containing dithering;
step S6: and (3) downsampling: and (3) downsampling the low-resolution image sequence containing the jitter, which is obtained in the step (S5), wherein the downsampling is to reduce the density of sampling points, and the downsampled low-resolution image sequence for Fourier stack reconstruction can be obtained.
In the above technical solution, the target image is a concept of a spatial domain, and the synthetic aperture is a concept of a spectral domain.
According to the method, the dithering steps for the pupil and for the low-resolution image sequence are introduced in the algorithm process of the synthetic aperture imaging, so that the simulation accuracy of the optical transmission process is effectively improved under the condition that the simulation efficiency is not obviously reduced, and the influence of specific dithering on the imaging quality of the Fourier lamination can be more completely simulated.
In a real environment, the relative shake between the target surface and the lens is various, and there are shake of up to 9 degrees of freedom, wherein the relative displacement freedom is 3, and the rotational freedom lens comprises an imaging system and 6 target surfaces. But in far field imaging, rotational jitter under natural conditions has negligible effect on the imaging. Therefore, only the displacement shake between the target surface and the lens is needed to be simulated.
Under the above conditions, the influence of the shake between the target surface and the lens can be simplified to spectrum shake and image shake. Spectral dithering may be achieved in step S3 by translating each single aperture pupil in the synthetic aperture; image dithering can be realized by translating each low-resolution image sequence in the step S5, and the overall simulation scheme is closer to the actual working condition by adding dithering, so that the simulation accuracy is improved.
The preprocessing step of step S1 is to obtain the complex amplitude of the required target image by calculating simulation according to the target image, or obtain the intensity of the target image when the phase of the target image is 0, and provide a data base for the next supersampling step.
The step of supersampling in the step S2 is performed on the basis of the parameter data obtained in the step S1, and the density of sampling points is further improved for the data obtained in the step S1, so that a data basis is provided for constructing a low-resolution image sequence.
Step S3 is to simulate the actual working condition, and to increase one shake for the pupil to simulate the frequency spectrum shake.
Step S4 is performed by the simulation method, and the corresponding low-resolution image sequence can be obtained through calculation based on the super-sampled data in step S2 and the pupil subjected to jitter increasing in step S3, so that a low-resolution image can be further obtained.
Step S5 is to add jitter to the low resolution sequence to simulate the image jitter generated in the actual working condition.
Step S6 performs downsampling processing on the obtained low-resolution image sequence. Step S6 corresponds to the simulation of the receiving process of the detector, such as the CCD and the CMOS, and reduces the high sampling rate of the transmission process to the sampling rate or resolution of the image plane of the detector, so as to avoid the excessive data volume while attaching to the actual scene. The resampling step provided by the method effectively improves the simulation sampling rate in the optical transmission process, so that the constructed low-resolution image distortion rate is lower.
In the actual working condition, a large amount of jitter can be added, a small amount of jitter can also be added, and the specific added jitter amount is determined by the actual simulation requirement. Example 1 provides a simulation method result with a small amount of added jitter, and example 2 provides a simulation method result with a large amount of added jitter. The related experimental results are shown in fig. 1, 2, 3 and 4, and the technical scheme of the invention aims to make the simulation reconstruction result and the experimental reconstruction result fit as much as possible. As can be seen from the comparison results of fig. 1 and fig. 2 and the comparison results of fig. 3 and fig. 4, the reconstructed image obtained by the simulation after adding the jitter has higher fitting degree with the target surface image to be simulated due to certain distortion.
As a comparison example, the application also provides a simulation reconstruction result obtained by a simulation method without adding jitter, the simulation reconstruction result is shown in fig. 5, and the experimental reconstruction result corresponding to the simulation reconstruction result is shown in fig. 2. It can be seen that, compared with fig. 2, the simulation image of fig. 5 is too flat compared with the real target surface image, and there is an overfitting, and the difference from the actual experiment is too large, and the simulation result is inaccurate.
In one embodiment of the present application, the random translation in step S3 is a uniform random translation, and/or a random translation conforming to a two-dimensional gaussian distribution.
In one embodiment of the present application, the random dithering in step S5 is a uniform random translation, and/or a random translation conforming to a two-dimensional gaussian distribution.
In one embodiment of the present application, the step S5 further includes adding noise to the low-resolution image sequence, so as to better simulate the actual working condition.
Further, the noise includes multiplicative noise, and/or additive noise. The coherent noise is typically multiplicative noise and the incoherent noise is typically additive noise. Meanwhile, multiplicative noise and additive noise are added, so that the simulation is more close to an experimental result.
In one embodiment of the present application, step S5 further comprises a step of scaling the low resolution image sequence, or the low resolution image sequence with jitter, said scaling being an equal-scale transformation of the size of the image sequence. In this technical solution, when the simulated imaging process is near-field imaging, but not far-field imaging, that is, when the distance change caused by the relative shake between the target surface and the lens causes a non-negligible imaging change, the scaling of the low-resolution image may also be added in step S5, so as to increase the accuracy of the calculation.
Further, the scaling factor is 0.9-1.1.
Further, the scaling is uniformly distributed random scaling or random scaling conforming to a gaussian distribution.
In one embodiment of the present application, the step S1 includes the steps of:
step S11: inputting an imaging target
；
Step S12: calculating imaging target amplitude
Said->
；
Step S13: adding phase distribution to imaging targets
Obtaining complex amplitude of imaging target
。
The imaging target in step S11 corresponds to a target surface in an experiment, and is a picture with higher resolution in the simulation process, and the imaging target is the introduction of the picture.
Step S12 is a step of calculating the imaging target amplitude, because the phase of the coherent light can be superimposed on the amplitude only. Amplitude is the pair
The intensity parameters of (2) are obtained by root marking;
the phase distribution added in step S13 may be controlled to simulate transmission simulation or reflection simulation. Different simulations may be applied for different requirements. If reflection imaging is simulated, a large number of random phases are overlapped to simulate the modulation of the optical phase by the rough surface of the target; if transmission imaging is simulated, no phase distribution is added, or the transmission phase distribution of the required simulation target is added.
In one embodiment of the present application, the step S2 includes the steps of:
step S21: the spectrum of the imaged object is calculated,
；
step S22: calculating the size of the imaging target spectrum
Said->
Matrix order for imaging target spectrum;
step S23: reconstructing and denoising an imaging target to generate a high-resolution image, obtaining a reconstructed image, and calculating the size of the reconstructed image
；
Step S24: comparison of
And->
The size of (1)>
≤ />
For->
Supersampling to obtain the complex amplitude distribution +.>
Returning to step S21 again, according to +.>
Recalculating the oversampled imaging target spectrum
And do->
Performing spectrum post-processing; if->
＞ />
Then the imaging target spectrum obtained in step S21
Directly performing spectrum post-processing, and marking the spectrum after spectrum post-processing as +.>
。
When step S24 is performed, the theoretical maximum of the image obtained by aperture imaging is describedThe high frequency is already higher than the highest frequency of the imaging target. At this time, the complex amplitude of the imaging target can be calculated by a certain algorithm
The supersampling (upsampling) is equivalent to the supersampling of the target image, so that the upper limit of the effective frequency of the image can be effectively improved, and the definition of the image can be further improved. The supersampling algorithm can be realized by using a nearest and the like, the specific supersampling scheme is determined by the specific requirements of experiments, and the supersampling scheme is determined by the sampling rate or resolution of an input image, the synthetic aperture multiple, the lens focal length, the lens aperture and the like.
In this embodiment, on the basis of the original step S2, steps of image reconstruction and size judgment on the original image and the reconstructed image are added, the setting of the step can judge whether the input image is necessary to be subjected to oversampling, and when the sampling rate or resolution of the reconstructed image is lower than that of the input image, the step of oversampling can be skipped, and related data can be directly applied to the step S4, thereby effectively improving the calculation efficiency.
In one embodiment of the present application, in step S22, the dimensions
Equal to the resolution of the imaged object.
In one embodiment of the present application, in step S23, the dimensions
=0.9 to 1.1x, where x is the resolution of the reconstructed image. Size->
Can be calculated from the aperture imaging scheme, the detailed calculation scheme being related to the specific algorithm selection.
Preferably, the method comprises the steps of,
=x。
the step sequence of step S22 and step S23 may be exchanged,
and->
The calculation sequence of (3) does not affect the simulation result.
In one embodiment of the present application, in step S24, the spectral post-processing is peripheral zero padding of the high frequency portion of the spectrum. The purpose of performing the peripheral zero padding is based on the algorithm requirement, and in order to avoid the index exceeding the boundary, 0 needs to be padded on the periphery of the spectrum, specifically, the rows with 0 and the columns with 0 are padded on the edge of the spectrum matrix, and the number of specific rows and columns is calculated.
In one embodiment of the present application, in step S24, when
When the aperture imaging simulation method is stopped, a new imaging target with higher resolution than the original imaging target is selected, and simulation calculation is performed again from the step S1 until +.>
。
In one embodiment of the present application, the step S3 includes the steps of:
step S31: pupil sequence for calculating synthetic aperture
；
Step S32: pupil alignment
Adding random translation to generate pupil sequence +.>
。
In one embodiment of the present application, the step S4 includes the steps of:
step S41: calculating a low resolution image sequence spectrum
= />
The method comprises the steps of carrying out a first treatment on the surface of the Wherein->
For pupil sequences with jitter +.>
Spectrum of the imaging target calculated from the oversampled complex amplitude;
step S42: according to
Calculating to obtain a low resolution image sequence +.>
= />
Wherein->
Inverse fourier transform symbols;
as a preferred solution, the simulation method further comprises a reconstruction step S7,
step S7: and (3) carrying out image registration, image denoising and stack restoration on the low-resolution image sequence which can be used for Fourier stack reconstruction and is obtained in the step (S6), and finally outputting a reconstruction target image.
In general, the steps of the simulation of the imaging process and the reconstruction process may be performed separately, and step S7 provides a reconstruction step again, and the downsampled low-resolution image is reconstructed again, so as to obtain a resampled reconstruction target image. The physical process corresponding to step S6 is a sampling process of the CCD or CMOS, and the specific downsampling scheme is determined by the requirement, typically the sampling rate or resolution of the imaging CCD or CMOS that needs to be emulated. Through step S4, a low resolution image sequence can be obtained
Noise and jitter are increasedLater, +.>
After downsampling, a downsampled low-resolution image sequence +.>
。
In certain embodiments, the image reconstruction process as described in step S23 is the same as the reconstruction process in step S7 described above.
An exemplary flow provided by this embodiment is shown in fig. 6. In the actual working condition, the imaging target is input into a computer, after the target amplitude of the imaging target is read, phase distribution is added to the imaging target, the frequency spectrum of the imaging target is obtained through calculation, jitter is added to the pupil and the low-resolution image sequence, the actual working condition is simulated, and finally the imaging target is reconstructed to obtain a reconstructed image.
In all the technical schemes provided by the application, the formula only represents the calculation process, but not the scope limited by the formula, and all the simulation schemes or formula calculation schemes which can achieve the technical purpose of the application are considered as the technical scheme protection scope of the application.
Claims (18)
1. The simulation method for the synthetic aperture imaging is characterized by comprising the following steps of:
step S1: pretreatment: obtaining complex amplitude distribution of the target image;
step S2: supersampling: the complex amplitude distribution obtained in the step S1 is subjected to oversampling, wherein the oversampling is to increase the density of sampling points on the basis of the complex amplitude distribution, so as to obtain the complex amplitude distribution after the oversampling;
step S3: pupil dithering step: calculating a pupil sequence of the synthetic aperture, and generating a pupil sequence containing jitter by adding random translation to the pupil sequence;
step S4: low resolution image generation: calculating to obtain a low-resolution image sequence corresponding to the target image according to the supersampled complex amplitude distribution and the pupil sequence containing jitter;
step S5: image dithering step: adding random dithering to the low-resolution image sequence to generate a low-resolution image sequence containing dithering;
step S6: and (3) downsampling: and (3) downsampling the low-resolution image sequence containing the jitter, which is obtained in the step (S5), wherein the downsampling is to reduce the density of sampling points, and the downsampled low-resolution image sequence for Fourier stack reconstruction can be obtained.
2. A method of simulating synthetic aperture imaging according to claim 1, wherein: the random translation in the step S3 is a uniform random translation, and/or a random translation conforming to a two-dimensional gaussian distribution.
3. A method of simulating synthetic aperture imaging according to claim 1, wherein: the random jitter in step S5 is a uniform random translation, and/or a random translation conforming to a two-dimensional gaussian distribution.
4. A simulation method of synthetic aperture imaging according to claim 3, wherein: the step S5 further comprises adding noise to the low resolution image sequence.
5. A method of simulating synthetic aperture imaging according to claim 4, wherein: the noise includes multiplicative noise, and/or additive noise.
6. A method of simulating synthetic aperture imaging according to claim 1, wherein: step S5 further comprises the step of scaling the low resolution image sequence, or the low resolution image sequence with jitter, said scaling being an equal-scale transformation of the size of the image sequence.
7. A method of simulating synthetic aperture imaging according to claim 6, wherein: the scaling multiplying power is 0.9-1.1.
8. A method of simulating synthetic aperture imaging according to claim 7, wherein: the scaling is uniformly distributed random scaling or random scaling conforming to a gaussian distribution.
9. A method of simulating synthetic aperture imaging according to claim 1, wherein said step S1 comprises the steps of:
step S11: inputting an imaging target
；
Step S12: calculating imaging target amplitude
Said->
；
Step S13: adding phase distribution to imaging targets
Obtaining complex amplitude distribution of imaging target
。
10. A method of simulating synthetic aperture imaging according to claim 9, wherein said step S2 comprises the steps of:
step S21: the spectrum of the imaged object is calculated,
；
step S22: calculating the size of the imaging target spectrum
Said->
Matrix order for imaging target spectrum;
step S23: reconstructing and denoising an imaging target to generate a high-resolution image, obtaining a reconstructed image, and calculating the size of the reconstructed image
；
Step S24: comparison of
And->
The size of (1)>
≤/>
For->
Supersampling to obtain the complex amplitude distribution +.>
Returning to step S21 again, according to +.>
Recalculating the oversampled imaging target spectrum +.>
And is opposite to
Performing spectrum post-processing; if->
＞/>
Then the imaging target spectrum obtained in step S21 is +.>
Directly performing spectrum post-processing, and marking the spectrum after spectrum post-processing as +.>
。
11. A method of simulating synthetic aperture imaging according to claim 10, wherein: in step S22, the dimensions
Equal to the resolution of the imaged object.
12. A method of simulating synthetic aperture imaging according to claim 10, wherein: in step S23, the dimensions are as described
=0.9 to 1.1x, where x is the resolution of the reconstructed image.
13. A method of simulating synthetic aperture imaging according to claim 12, wherein:
=x。
14. a method of simulating synthetic aperture imaging according to claim 10, wherein: in step S24, the post-spectrum processing is to perform peripheral zero padding on the high-frequency part of the spectrum.
15. A method of simulating synthetic aperture imaging according to claim 10, wherein: in step S24, when
When the aperture imaging simulation method is stopped, a new imaging target with higher resolution than the original imaging target is selected, and simulation calculation is performed again from the step S1 until +.>
。
16. A method of simulating synthetic aperture imaging according to claim 1, wherein: the step S3 includes the steps of:
step S31: pupil sequence for calculating synthetic aperture
；
Step S32: pupil alignment
Adding random translation to generate pupil sequence +.>
。
17. A method of simulating synthetic aperture imaging according to claim 1, wherein: the step S4 includes the steps of:
step S41: calculating a low resolution image sequence spectrum
=/>
The method comprises the steps of carrying out a first treatment on the surface of the Wherein->
For pupil sequences with jitter +.>
Spectrum of the imaging target calculated from the oversampled complex amplitude;
step S42: according to
Calculating to obtain a low resolution image sequence +.>
=/>
Wherein->
Is an inverse fourier transform symbol.
18. A method of simulating synthetic aperture imaging according to claim 1, wherein:
the simulation method further comprises a reconstruction step S7,
step S7: and (3) carrying out image registration, image denoising and stack restoration on the low-resolution image sequence which can be used for Fourier stack reconstruction and is obtained in the step (S6), and finally outputting a reconstruction target image.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202310504700.3A CN116228547B (en) | 2023-05-08 | 2023-05-08 | Simulation method of synthetic aperture imaging process |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202310504700.3A CN116228547B (en) | 2023-05-08 | 2023-05-08 | Simulation method of synthetic aperture imaging process |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN116228547A CN116228547A (en) | 2023-06-06 |
| CN116228547B true CN116228547B (en) | 2023-07-07 |
Family
ID=86587622
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202310504700.3A Active CN116228547B (en) | 2023-05-08 | 2023-05-08 | Simulation method of synthetic aperture imaging process |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN116228547B (en) |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105258673A (en) * | 2015-11-02 | 2016-01-20 | 南京航空航天大学 | Target range finding method and apparatus based on binocular synthetic aperture focus image |
| JP2017034682A (en) * | 2016-09-08 | 2017-02-09 | 株式会社ニコン | Image generation apparatus, image processing apparatus, image generation method, and image processing program |
| CN114565515A (en) * | 2022-03-01 | 2022-05-31 | 佛山读图科技有限公司 | Construction method of system for realizing projection image data noise reduction and resolution recovery |
| CN115131201A (en) * | 2022-05-13 | 2022-09-30 | 南京理工大学 | Far-field diffuse reflection synthetic aperture super-resolution imaging method based on laminated reconstruction |
-
2023
- 2023-05-08 CN CN202310504700.3A patent/CN116228547B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105258673A (en) * | 2015-11-02 | 2016-01-20 | 南京航空航天大学 | Target range finding method and apparatus based on binocular synthetic aperture focus image |
| JP2017034682A (en) * | 2016-09-08 | 2017-02-09 | 株式会社ニコン | Image generation apparatus, image processing apparatus, image generation method, and image processing program |
| CN114565515A (en) * | 2022-03-01 | 2022-05-31 | 佛山读图科技有限公司 | Construction method of system for realizing projection image data noise reduction and resolution recovery |
| CN115131201A (en) * | 2022-05-13 | 2022-09-30 | 南京理工大学 | Far-field diffuse reflection synthetic aperture super-resolution imaging method based on laminated reconstruction |
Non-Patent Citations (3)
| Title |
|---|
| Extraordinary optical fields in nanostructures: from sub-diffraction-limited optics to sensing and energy conversion;Xiangang Luo 等;《Chemical Society Reviews》;第8卷;2458-2494 * |
| 单幅图像超分辨技术研究;刘春红;《中国优秀硕士学位论文全文数据库 (信息科技辑)》;I138-1752 * |
| 强度编码合成孔径激光雷达原理与实验;李飞 等;《红外与激光工程》;第44卷(第09期);2575-2582 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN116228547A (en) | 2023-06-06 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| Bertin | SkyMaker: astronomical image simulations made easy. | |
| Maravic et al. | Exact sampling results for some classes of parametric nonbandlimited 2-D signals | |
| Hardie | A fast image super-resolution algorithm using an adaptive Wiener filter | |
| CN110533607B (en) | Image processing method and device based on deep learning and electronic equipment | |
| Wang et al. | Single-intensity-recording optical encryption technique based on phase retrieval algorithm and QR code | |
| JP4499331B2 (en) | System and method for recovering wavefront phase information | |
| CN110675451B (en) | Digital self-adaptive correction method and system based on phase space optics | |
| Hung et al. | Real-time image super-resolution using recursive depthwise separable convolution network | |
| Jagatap et al. | Sample efficient fourier ptychography for structured data | |
| KR20140096532A (en) | Apparatus and method for generating digital hologram | |
| Qin et al. | Video superresolution reconstruction based on subpixel registration and iterative back projection | |
| Prasad et al. | High‐resolution imaging using integrated optical systems | |
| CN112506019B (en) | Off-axis digital holographic imaging reconstruction method based on kronecker product interpolation | |
| CN116228547B (en) | Simulation method of synthetic aperture imaging process | |
| KR102190773B1 (en) | Apparatus and method for speckle removal in hologram using light field conversion and deep learning | |
| Zhou et al. | Video super-resolution for wireless capsule endoscopy imaging sensor | |
| Ma et al. | Deep Gaussian denoiser epistemic uncertainty and decoupled dual-attention fusion | |
| Cui et al. | Multi-frame motion deblurring using coded exposure imaging with complementary fluttering sequences | |
| Lin et al. | Galaxy image translation with semi-supervised noise-reconstructed generative adversarial networks | |
| CN113658317B (en) | Method and device for processing continuous shooting image of electron microscope | |
| CN112381845B (en) | Rock core image generation method, model training method and device | |
| CN114384780B (en) | Method, apparatus, computer device and storage medium for imaging through scattering medium | |
| Zhang et al. | Computational Super-Resolution Imaging With a Sparse Rotational Camera Array | |
| EP4260026A1 (en) | Totagraphy: coherent diffractive/digital information reconstruction by iterative phase recovery using special masks | |
| CN117011140A (en) | Simulation method for synthetic aperture imaging |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |