CN117268288B - Optical diffraction tomography laser scanning method and device and electronic equipment - Google Patents

Optical diffraction tomography laser scanning method and device and electronic equipment Download PDF

Info

Publication number
CN117268288B
CN117268288B CN202310928441.7A CN202310928441A CN117268288B CN 117268288 B CN117268288 B CN 117268288B CN 202310928441 A CN202310928441 A CN 202310928441A CN 117268288 B CN117268288 B CN 117268288B
Authority
CN
China
Prior art keywords
scanning
laser scanning
laser
point set
filling rate
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202310928441.7A
Other languages
Chinese (zh)
Other versions
CN117268288A (en
Inventor
施可彬
马睿
耿乐
杨燕青
王艳丹
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Yangtze River Delta Institute Of Optoelectronics Peking University
Original Assignee
Yangtze River Delta Institute Of Optoelectronics Peking University
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Yangtze River Delta Institute Of Optoelectronics Peking University filed Critical Yangtze River Delta Institute Of Optoelectronics Peking University
Priority to CN202310928441.7A priority Critical patent/CN117268288B/en
Publication of CN117268288A publication Critical patent/CN117268288A/en
Application granted granted Critical
Publication of CN117268288B publication Critical patent/CN117268288B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B21/00Microscopes
    • G02B21/0004Microscopes specially adapted for specific applications
    • G02B21/002Scanning microscopes
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01BMEASURING LENGTH, THICKNESS OR SIMILAR LINEAR DIMENSIONS; MEASURING ANGLES; MEASURING AREAS; MEASURING IRREGULARITIES OF SURFACES OR CONTOURS
    • G01B11/00Measuring arrangements characterised by the use of optical techniques
    • G01B11/24Measuring arrangements characterised by the use of optical techniques for measuring contours or curvatures
    • G01B11/25Measuring arrangements characterised by the use of optical techniques for measuring contours or curvatures by projecting a pattern, e.g. one or more lines, moiré fringes on the object
    • G01B11/2518Projection by scanning of the object
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B21/00Microscopes
    • G02B21/0004Microscopes specially adapted for specific applications
    • G02B21/002Scanning microscopes
    • G02B21/0024Confocal scanning microscopes (CSOMs) or confocal "macroscopes"; Accessories which are not restricted to use with CSOMs, e.g. sample holders
    • G02B21/0036Scanning details, e.g. scanning stages
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B21/00Microscopes
    • G02B21/0004Microscopes specially adapted for specific applications
    • G02B21/002Scanning microscopes
    • G02B21/0024Confocal scanning microscopes (CSOMs) or confocal "macroscopes"; Accessories which are not restricted to use with CSOMs, e.g. sample holders
    • G02B21/008Details of detection or image processing, including general computer control

Landscapes

  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Chemical & Material Sciences (AREA)
  • Analytical Chemistry (AREA)
  • Optics & Photonics (AREA)
  • Engineering & Computer Science (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • General Engineering & Computer Science (AREA)
  • Microscoopes, Condenser (AREA)

Abstract

The invention provides an optical diffraction tomography laser scanning method, a device and electronic equipment, and relates to the technical field of optical diffraction tomography, wherein the method comprises the following steps: determining a spectrum filling rate based on the scanning parameters and an initial scanning point set, wherein the initial scanning point set comprises at least two scanning point groups; constructing a laser scanning objective function based on the frequency spectrum filling rate; based on a laser scanning objective function, taking the maximized spectrum filling rate as an optimization target, and performing iterative optimization on the initial scanning point set to obtain a laser scanning optimal solution; and determining a laser optimal scanning mode based on the target scanning point group and the scanning parameters corresponding to the laser scanning optimal solution so as to perform optical diffraction tomography laser scanning. The invention can ensure the maximum spectrum filling rate to fill the Fourier space to the greatest extent by automatically determining the optimal scanning mode, and improve the image quality and the image reconstruction efficiency.

Description

Optical diffraction tomography laser scanning method and device and electronic equipment
Technical Field
The invention relates to the technical field of three-dimensional microscopic imaging, in particular to an optical diffraction tomography laser scanning method, an optical diffraction tomography laser scanning device and electronic equipment.
Background
An optical diffraction tomography microscope (Optical Diffraction Tomography, ODT) is a technique for three-dimensional microscopic imaging that can nondestructively acquire refractive index profile information of a transparent sample. In ODT, laser scanning plays a key role. The laser scanning obtains projection data of the sample by changing the incident angle or the sample position, and reconstructs the three-dimensional refractive index distribution of the sample by the obtained projection data.
Since laser scanning at different angles is a sequential process, a limited number of scan angles are typically selected when imaging speed is considered. This will result in a loss of frequency content in the fourier space of the image, thereby degrading the image quality.
In the prior art, the scanning mode is generally selected according to manual experience, and as shown in fig. 1-4, common scanning modes include ring scanning, concentric circle scanning, grid scanning, fee Ma Saomiao and the like. The selection of the scanning mode is subjective, so that the spectrum filling rate is low, the quality of the finally reconstructed image is affected, and meanwhile, a great deal of time and cost are wasted in the selection of the scanning mode, and the three-dimensional reconstruction efficiency of the image is affected.
Disclosure of Invention
The invention provides an optical diffraction tomography laser scanning method, an optical diffraction tomography laser scanning device and electronic equipment, which are used for solving the defects that in the prior art, the selection of a scanning mode is subjective, the spectrum filling rate is low, and the quality of a finally reconstructed image is affected.
The invention provides an optical diffraction tomography laser scanning method, which comprises the following steps:
determining a spectrum filling rate based on the scanning parameters and an initial scanning point set, wherein the spectrum filling rate is a proportion of filling a spectrum of a Fourier space corresponding to a projection image during laser scanning, and the initial scanning point set comprises at least two scanning point groups;
constructing a laser scanning objective function based on the frequency spectrum filling rate;
based on the laser scanning objective function, iteratively optimizing the initial scanning point set by taking the maximized frequency spectrum filling rate as an optimization target to obtain a laser scanning optimal solution;
and determining a laser optimal scanning mode based on the target scanning point group corresponding to the laser scanning optimal solution and the scanning parameters so as to perform optical diffraction tomography laser scanning.
According to the optical diffraction tomography laser scanning method provided by the invention, the construction of the laser scanning objective function based on the spectrum filling rate comprises the following steps:
constructing a laser scanning objective function based only on the spectrum filling rate;
or alternatively, the first and second heat exchangers may be,
and constructing a laser scanning objective function based on constraint conditions, weights corresponding to the constraint conditions and the spectrum filling rate, wherein the constraint conditions are used for limiting distribution parameters or imaging parameters of scanning points in the target scanning point group.
According to the optical diffraction tomography laser scanning method provided by the invention, the iterative optimization is performed on the initial scanning point set based on the laser scanning objective function and with the maximized frequency spectrum filling rate as an optimization target, so as to obtain a laser scanning optimal solution, and the method comprises the following steps:
optimizing the laser scanning objective function by using an optimization algorithm based on the initial scanning point set to generate an iterative scanning point set, wherein the optimization algorithm is used for searching a laser scanning optimal solution in a scanning point set space, and a scanning point group in the iterative scanning point set is not identical to a scanning point group in the initial scanning point set;
judging whether preset conditions are met or not, wherein the preset conditions comprise: whether the iteration times are larger than a first preset threshold value or whether the laser scanning objective function difference value is smaller than a second preset threshold value or not, wherein the laser scanning objective function difference value is determined based on an iteration scanning function value corresponding to the iteration scanning point set of the current round and an iteration scanning function value corresponding to the iteration scanning point set of the previous round;
and under the condition that the preset condition is not met, taking the iterative scanning point set as an initial scanning point set of the next round of iterative optimization, stopping iteration until the preset condition is met, and determining the optimal solution of laser scanning based on the iterative scanning function value corresponding to the last iterative scanning point set.
According to the optical diffraction tomography laser scanning method provided by the invention, the determining the optimal solution of the laser scanning based on the iterative scanning function value corresponding to the last iterative scanning point set comprises the following steps:
determining the iterative scanning function value corresponding to each of all the scanning point groups in the last iterative scanning point set;
and determining the scanning point group corresponding to the optimal iterative scanning function value as the optimal laser scanning solution.
According to the optical diffraction tomography laser scanning method provided by the invention, the method further comprises the following steps:
and based on a target scanning point group corresponding to the laser scanning optimal solution, taking the maximized frequency spectrum filling rate as an optimization target, adjusting the scanning parameters, and determining a laser optimal scanning mode so as to perform optical diffraction tomography laser scanning.
According to the optical diffraction tomography laser scanning method provided by the invention, after the determination of the optimal scanning mode of the laser, the method further comprises the following steps:
and storing the target scanning point group so as to perform optical diffraction tomography laser scanning based on the target scanning point group.
According to the optical diffraction tomography laser scanning method provided by the invention, the scanning parameters comprise optical parameters and a scanning angle number, the optical parameters are determined based on the optical system, and the scanning angle number is determined based on the target shooting frame rate.
The invention also provides an optical diffraction tomography laser scanning device, which comprises:
the first determining module is used for determining a spectrum filling rate based on the scanning parameters and an initial scanning point set, wherein the spectrum filling rate is a proportion of filling a spectrum of a Fourier space corresponding to a projection image during laser scanning, and the initial scanning point set comprises at least two scanning point groups;
the construction module is used for constructing a laser scanning objective function based on the frequency spectrum filling rate;
the second determining module is used for carrying out iterative optimization on the initial scanning point set based on the laser scanning objective function and taking the maximized frequency spectrum filling rate as an optimization target to obtain a laser scanning optimal solution;
and the third determining module is used for determining a laser optimal scanning mode based on the target scanning point group corresponding to the laser scanning optimal solution and the scanning parameters so as to perform optical diffraction tomography laser scanning.
The invention also provides an electronic device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, the processor implementing the optical diffraction tomography laser scanning method as described above when executing the program.
The present invention also provides a non-transitory computer readable storage medium having stored thereon a computer program which, when executed by a processor, implements an optical diffraction tomography laser scanning method as described in any of the above.
According to the optical diffraction tomography laser scanning method, the optical diffraction tomography laser scanning device and the electronic equipment, the frequency spectrum filling rate is determined through the scanning parameters and the initial scanning point set, the laser scanning objective function is constructed based on the frequency spectrum filling rate, the maximized frequency spectrum filling rate is used as an optimization target, namely, the maximized laser scanning objective function is used as the optimization target, the initial scanning point set is subjected to iterative optimization to obtain a laser scanning optimal solution, the laser optimal scanning mode is determined according to the target scanning point set and the scanning parameters corresponding to the laser scanning optimal solution, the frequency spectrum filling rate is ensured to be maximized to fill the Fourier space to the greatest extent, the quality of the reconstructed image is improved, the objectivity and the degree of automation of determining the laser optimal scanning mode are improved, and the image reconstruction efficiency is improved.
Drawings
In order to more clearly illustrate the invention or the technical solutions of the prior art, the following description will briefly explain the drawings used in the embodiments or the description of the prior art, and it is obvious that the drawings in the following description are some embodiments of the invention, and other drawings can be obtained according to the drawings without inventive effort for a person skilled in the art.
FIG. 1 is a cut-away schematic view of spectrum filling for a circular scan pattern as provided by the prior art;
FIG. 2 is a schematic cut-away view of spectral filling of a concentric circle scan pattern as provided by the prior art;
FIG. 3 is a cut-away schematic view of spectrum filling of a grid scan pattern provided by the prior art;
FIG. 4 is a cut-away schematic view of spectral filling of a Fisher-Tropsch scan pattern as provided by the prior art;
FIG. 5 is a flow chart of a prior art optical diffraction tomography laser scanning method;
FIG. 6 is a schematic flow chart of an optical diffraction tomography laser scanning method according to an embodiment of the present invention;
FIG. 7 is a second flow chart of a method for scanning an optical diffraction tomography laser according to an embodiment of the present invention;
FIG. 8 is a schematic cut-away view of spectral filling provided by an embodiment of the present invention;
FIG. 9 is a schematic diagram of a structure of an optical diffraction tomography laser scanning device according to an embodiment of the present invention;
fig. 10 is a schematic structural diagram of an electronic device according to an embodiment of the present invention.
Detailed Description
For the purpose of making the objects, technical solutions and advantages of the present invention more apparent, the technical solutions of the present invention will be clearly and completely described below with reference to the accompanying drawings, and it is apparent that the described embodiments are some embodiments of the present invention, not all embodiments. All other embodiments, which can be made by those skilled in the art based on the embodiments of the invention without making any inventive effort, are intended to be within the scope of the invention.
An optical diffraction tomography microscope (Optical Diffraction Tomography, ODT) is a technique for three-dimensional microscopic imaging that can nondestructively acquire refractive index profile information of a transparent sample. The technical background of ODT can be traced back to the development of optical diffraction microscopy and computer tomography. The traditional optical microscope can only observe the surface morphology of the sample, and can not obtain the three-dimensional structure information inside the sample. The computer tomography technology is to collect projection images of a sample at different angles and use a mathematical algorithm to restore the three-dimensional structure of the sample.
In ODT, laser scanning plays a key role. The laser scanning is used for obtaining a projection image of a sample, and the principle is that a laser beam is focused on the sample, and after the laser interacts with the sample, the projection image of the sample is formed through diffraction phenomenon. By varying the angle of incidence of the laser beam or the relative position of the sample and the laser beam, different projection images can be obtained. These projection images can be used to reconstruct the three-dimensional refractive index profile of the sample. Specifically, the laser scanning technique plays several roles in ODT:
1) Projection image acquisition: laser scanning acquires a plurality of projection images of a sample by changing the angle of incidence or the sample position. These projection images are key data for reconstructing the sample.
2) Diffraction reconstruction: the projection image formed after the interaction of the laser and the sample is processed by a mathematical algorithm, so that diffraction information in the sample can be restored.
3) Refractive index reconstruction: by combining the diffraction information with other prior knowledge, such as the refractive index range of the sample, the refractive index profile of the sample can be reconstructed.
4) Three-dimensional imaging: finally, a three-dimensional refractive index distribution image of the sample can be obtained by processing and integrating the plurality of projection images.
Since laser scanning at different angles is a sequential process, a limited number of scan angles are typically selected when imaging speed is considered. This will result in a loss of frequency content in the fourier space of the projected image, thereby degrading image quality. Thus, by setting the scan pattern, the fourier space is effectively filled in a limited scan angle. The scan mode refers to illumination of the laser light sequentially from a specified scan angle. Therefore, setting an appropriate scanning mode is important for improving the quality of ODT microimaging.
To meet the symmetry of the resulting spectrum, the laser illumination points in the common scan pattern also meet the symmetry. As shown in fig. 1 to 4, common scanning modes include a ring scanning mode, a more complex scanning mode including a concentric circle scanning mode, a grid scanning mode, and a fee Ma Saomiao mode, and further include a line scanning mode, a spiral scanning mode, and the like. Wherein:
Circular scanning refers to the way CT (Computed Tomography ) images are made, in practice mainly with mechanically rotating mirrors. While the more complex scanning modes are usually achieved by different voltage driven galvanometers. The complex scanning mode can be flexibly realized by using the FPGA, the analog output of an embedded or data acquisition card and the like. As shown in fig. 5, in the more complex scanning manner shown in fig. 2-4, firstly, a scanning mode and the number of scanning angles are specified, secondly, optical parameters are set, and then, according to a formula of scanning points in the scanning mode, voltage values corresponding to the scanning angles are calculated, and the voltage values are stored for driving the galvanometer to realize laser scanning.
However, the setting of the above-mentioned scan pattern is severely dependent on manual experience, and it cannot be ensured that the set scan pattern can reach an optimal spectrum filling rate, thereby affecting the image quality of the final three-dimensional reconstruction. Meanwhile, the automation degree is low in the setting process of the scanning mode, a large amount of manpower resources and time cost are wasted, the efficiency of three-dimensional reconstruction is affected, and the applicability to different application scenes and signal characteristics is low.
In view of the foregoing problems in the prior art, an embodiment of the present invention provides an optical diffraction tomography laser scanning method, and fig. 6 is one of flow charts of the optical diffraction tomography laser scanning method provided in the embodiment of the present invention, as shown in fig. 6, where the method includes:
step 610, determining a spectrum filling rate based on the scanning parameters and an initial scanning point set, wherein the spectrum filling rate is a proportion of filling a spectrum of a fourier space corresponding to the projection image during laser scanning, and the initial scanning point set comprises at least two scanning point groups.
Step 620, constructing a laser scanning objective function based on the spectrum filling rate.
And 630, based on the laser scanning objective function, performing iterative optimization on the initial scanning point set by taking the maximized spectrum filling rate as an optimization target to obtain a laser scanning optimal solution.
And 640, determining a laser optimal scanning mode based on the target scanning point group corresponding to the laser scanning optimal solution and the scanning parameters so as to perform optical diffraction tomography laser scanning.
Specifically, the spectrum filling rate is a duty ratio of filling the spectrum of the fourier space and completely filling the spectrum of the fourier space in a set scan mode. The initial scanning point set may include at least two scanning point groups, each scanning point group includes a plurality of scanning points sequenced sequentially, each scanning point is a two-dimensional coordinate in the laser scanning process, and the sample can be scanned at different positions through different scanning points, so as to obtain projection images of corresponding positions. The distribution of the scanning points in each scanning point group is not identical, that is, the number of the scanning points in each scanning point group is not identical, the positions of the scanning points are not identical, and the like. After determining the scan parameters and the initial set of scan points, the spectral filling rate L may be determined spec (X|θ). The spectrum filling rate is actually the spectrum filling rate corresponding to each scanning point group in the initial scanning point set. According to the frequency spectrum filling rate, a laser scanning objective function can be constructed, the maximized frequency spectrum filling rate is used as an optimization target, iteration optimization is carried out on the initial scanning point set, in each iteration process, the maximum frequency spectrum filling rate in each scanning point set is determined as a laser scanning objective function value in the current iteration process, after iteration is stopped, a laser scanning optimal solution is obtained, a laser optimal scanning mode is determined according to the target scanning point set and scanning parameters corresponding to the laser scanning optimal solution, and then optical diffraction tomography laser scanning is carried out according to the laser optimal scanning mode.
It can be understood that the target scan point set corresponding to the optimal solution of laser scan may be one scan point set in the initial scan point set, or a new scan point set generated after optimizing the initial scan point set.
Optionally, the scanning parameters include an optical parameter and a number of scanning angles, the optical parameter is determined based on the optical system, and the number of scanning angles is determined based on the target photographing frame rate.
It will be appreciated that the optical parameters are used to calculate the spectral filling rate, and that the optical parameters may include: laser wavelength, cut-off refractive index, NA (avocadro's constant, avogalde Luo Changliang) value, and pixel size of the camera, etc. In addition, the larger the number of the scanning angles is, the higher the quality of the obtained projection image is, but the longer the shooting exposure time is.
Alternatively, the scan points in each scan point group in the initial scan point set may be randomly generated or determined according to a priori knowledge, which is not limited by the embodiment of the present invention.
Optionally, the constructing a laser scanning objective function based on the spectrum filling rate includes:
constructing a laser scanning objective function based only on the spectrum filling rate;
or alternatively, the first and second heat exchangers may be,
and constructing a laser scanning objective function based on constraint conditions, weights corresponding to the constraint conditions and the spectrum filling rate, wherein the constraint conditions are used for limiting distribution parameters or imaging parameters of scanning points in the target scanning point group.
Specifically, when constructing the laser scanning objective function, the laser scanning objective function X shown in the formula (1) may be constructed based on only the spectral filling rate opt The formula (1) is:
wherein θ represents a scan parameter, X represents any one of the scan point groups in the initial scan point set, or a new scan point group generated in the iterative optimization process, L spec (X|θ) represents the spectral filling ratio of the scan point group.
In addition, as shown in fig. 7, the laser scanning objective function X shown in formula (2) may be constructed together according to the spectral filling ratio and constraint conditions opt The constraint condition is used for limiting the distribution parameter or the imaging parameter of each scanning point in the target scanning point group. Wherein: the distribution parameters of each scanning point can comprise the density of the scanning points, the distribution range of the scanning points and the forbidden area on the scanning path, wherein the forbidden area on the scanning path is the forbidden distribution range of the scanning points, and the distribution range and the forbidden distribution range of the scanning points repel each other. Imaging parameters may include a range limit of scan angles, imaging speed requirements, etc., and embodiments of the present invention are not limited in this regard. The formula (2) is:
wherein: l (L) constrain (X|θ) represents a constraint condition, and λ represents a weight corresponding to the constraint condition.
Optionally, based on the laser scanning objective function, the performing iterative optimization on the initial scan point set with the maximized spectrum filling rate as an optimization target to obtain a laser scanning optimal solution includes:
Optimizing the laser scanning objective function by using an optimization algorithm based on the initial scanning point set to generate an iterative scanning point set, wherein the optimization algorithm is used for searching a laser scanning optimal solution in a scanning point set space, and a scanning point group in the iterative scanning point set is not identical to a scanning point group in the initial scanning point set;
judging whether preset conditions are met or not, wherein the preset conditions comprise: whether the iteration times are larger than a first preset threshold value or whether the laser scanning objective function difference value is smaller than a second preset threshold value or not, wherein the laser scanning objective function difference value is determined based on an iteration scanning function value corresponding to the iteration scanning point set of the current round and an iteration scanning function value corresponding to the iteration scanning point set of the previous round;
and under the condition that the preset condition is not met, taking the iterative scanning point set as an initial scanning point set of the next round of iterative optimization, stopping iteration until the preset condition is met, and determining the optimal solution of laser scanning based on the iterative scanning function value corresponding to the last iterative scanning point set.
Specifically, after the initial scan point set is determined, firstly determining the frequency spectrum filling rate corresponding to each scan point set, determining the maximum frequency filling rate as the iterative scan function value of the initial round from the frequency filling rates, then continuously updating the scan point set in the scan point set space by using an optimization algorithm to obtain a new iterative scan point set, continuously updating the frequency filling rate, further updating the iterative scan function value, and moving the iterative scan function value towards the direction of the optimal solution in the iterative process based on the change of the iterative scan function value, and stopping iteration when the iterative round reaches a first preset threshold value or the difference value between the iterative scan function value of the current round and the iterative scan function value of the previous round is smaller than a second preset threshold value, namely, the iterative scan function value tends to a stable state, and at this time, determining the optimal solution of laser scan according to the iterative scan function value corresponding to the last iterative scan point set after updating. The optimal scanning mode of the laser is determined by introducing proper objective functions, an optimization algorithm and other automatic optimization methods, and the optimal scanning mode can be automatically searched and determined so as to achieve the optimal spectrum filling rate and image reconstruction quality. The dependence on manual experience is reduced, and the image reconstruction efficiency and performance are improved. The scanning point set space comprises an initial scanning point set and an iterative scanning point set corresponding to each round.
Alternatively, the optimization algorithm may include a genetic algorithm, a particle swarm optimization algorithm, a simulated annealing algorithm, and the like, which is not limited in the embodiment of the present invention.
Taking an optimization algorithm as a genetic algorithm as an example, the optical diffraction tomography laser scanning method provided by the embodiment of the invention comprises the following steps:
1) An initialization population is created that contains a plurality of sets of scan points, i.e., an initial set of scan points. Each scanning point group comprises a plurality of scanning points, and each scanning point group corresponds to one scanning mode. The scan points in each set of scan points may be randomly generated or determined from a priori knowledge.
2) For each scanning point group, calculating the spectrum filling rate corresponding to each scanning point group, and determining the spectrum filling rate as the fitness value corresponding to each scanning point group, wherein the larger the fitness value is, the better the scanning point group is.
3) And selecting the fixed number or fixed proportion of scanning point groups as the parent scanning point groups of the next round by using a selection operator according to the fitness value of the scanning point groups. The selection operator can adopt methods such as roulette selection, tournament selection and the like, so that the scanning point group with higher fitness is more likely to be selected.
4) And carrying out genetic operation on the selected parent scanning point group to generate a new scanning point group in the next round. Genetic manipulation mainly includes crossover and mutation, wherein:
(1) Crossing: any two scan point groups are selected, and a new scan point group is generated by exchanging or combining scan points in the two parent scan point groups. The cross operation may be single-point cross, multi-point cross, uniform cross, etc., which is not limited by the embodiment of the present invention.
(2) Variation: a certain randomness may be introduced by changing one or more of the scan points in the set of scan points to increase the diversity of the set of scan points.
5) Adding the newly generated scanning point groups into an initial scanning point set, deleting some scanning point groups according to the frequency spectrum filling rate to obtain an iterative scanning point set, wherein the number of the iterative scanning point set is the same as that of the scanning point groups in the initial scanning point set so as to keep the scale of the population unchanged.
6) And (3) iteratively executing the steps 2) to 5), continuously updating the iterative scanning point set, and ensuring that the number of the iterative scanning point set of the current round is the same as the number of the scanning point groups of the iterative scanning point set of the previous round until a preset condition is met, and stopping iteration.
7) Outputting an optimal solution: and after the iteration is finished, selecting the maximum spectrum filling rate as the optimal solution of laser scanning, wherein the scanning point group corresponding to the maximum spectrum filling rate is the target scanning point group, namely the optimal laser scanning mode.
In the prior art, the scanning mode is limited by a plurality of inherent parameterized formulas when being set, and the flexibility and the innovation are lacked, so that the diversity of the scanning mode is insufficient, and the advantages of the scanning mode in different application scenes can not be fully exerted. In the embodiment of the application, more diversified scanning modes can be generated according to different optimization algorithms, so that the determined scanning modes are more suitable for specific application scenes while the maximum spectrum filling rate is ensured. Secondly, the flexibility of the scanning mode in the prior art is low, and the key scanning of a specific area cannot be realized. In the embodiment of the application, when the laser scanning objective function is constructed, the constraint condition is added, so that the method can better adapt to the communication environment and signal characteristics which change in real time, and better meet the actual application requirements. Meanwhile, the flexibility of the programmable embedding technology is fully developed, and the flexibility of determining the scanning mode is improved. And constructing a laser scanning objective function through the frequency spectrum filling rate and personalized constraint conditions, and improving the effect and performance of laser scanning.
Optionally, the determining the optimal solution for laser scanning based on the iterative scan function value corresponding to the last iterative scan point set includes:
Determining the iterative scanning function value corresponding to each of all the scanning point groups in the last iterative scanning point set;
and determining the scanning point group corresponding to the optimal iterative scanning function value as the optimal laser scanning solution.
Specifically, after iteration is stopped, a last iteration scanning point set can be obtained, the last iteration scanning point set comprises at least one scanning point group which is continuously optimized, and the scanning point group corresponding to the optimal iteration scanning function value is determined to be the optimal solution of laser scanning by determining the iteration scanning function value corresponding to each scanning point group, wherein the optimal iteration scanning function value is the maximum spectrum filling rate. The scanning point group in the last iteration scanning point set corresponding to the optimal solution of laser scanning is the target scanning point group, the laser scanning in the optical diffraction tomography can be performed according to the sequence of the scanning points in the target scanning point group and the specified scanning angle, projection images with different positions and different incidence angles are obtained, and the three-dimensional refractive index distribution image of the sample can be obtained after diffraction reconstruction, refractive index reconstruction and three-dimensional imaging. That is, after the target scan point group is obtained, the laser optimal scan pattern can be determined.
For example, in the embodiment of the present invention, the finally determined laser optimal scanning mode is shown in fig. 8, the scanning point set shown in fig. 8 is asymmetric, and compared with the spectrum X-Y tangential plane shown in fig. 8, the spectrum X-Y tangential plane shown in fig. 1-4 has a larger spectrum filling rate, that is, the quality of the finally reconstructed image is higher.
It should be noted that, the distribution of the scanning points in the target scanning point set may be symmetrical or asymmetrical. But can ensure that the spectrum filling rate corresponding to the target scanning point group is maximum and ensure that the quality of the obtained projection image is higher. If the distribution of each scanning point in the target scanning point group is asymmetric, only a plurality of scanning points on one side of the symmetry axis can be stored in the scanning point space, the scanning points are two-dimensional coordinates, and the scanning points on the other side of the symmetry axis can be obtained symmetrically, so that the requirement of symmetric arrangement of laser illumination points is met, and the requirement of final spectrum symmetry is further met. The method solves the problem that the prior art adopts symmetrical scanning modes and cannot meet the requirement of key scanning of an asymmetric target or a specific area.
Optionally, after the determining the optimal scanning mode of the laser, the method further includes:
And storing the target scanning point group so as to perform optical diffraction tomography laser scanning based on the target scanning point group.
Specifically, after the target scanning point group is determined, the target scanning point group can be stored, and the storage format can be a coordinate file or a data set format, so that optical diffraction tomography laser scanning is facilitated.
Optionally, the method further comprises:
and based on a target scanning point group corresponding to the laser scanning optimal solution, taking the maximized frequency spectrum filling rate as an optimization target, adjusting the scanning parameters, and determining a laser optimal scanning mode so as to perform optical diffraction tomography laser scanning.
Specifically, in practical application, adjustment and expansion are required according to specific situations. For example, after determining the optimal solution for laser scanning, a scanning parameter tuning step may be added to improve the performance of the scanning mode by automatically adjusting the scanning parameters, so as to obtain the optimal scanning mode for laser scanning. Furthermore, for large-scale and complex problems, distributed computing or parallel computing may be employed to accelerate the optimization process.
According to the optical diffraction tomography laser scanning method provided by the embodiment of the invention, the frequency spectrum filling rate is determined through the scanning parameters and the initial scanning point set, the laser scanning objective function is constructed based on the frequency spectrum filling rate, the maximized frequency spectrum filling rate is used as an optimization target, namely the maximized laser scanning objective function is used as the optimization target, the initial scanning point set is subjected to iterative optimization to obtain the laser scanning optimal solution, the laser optimal scanning mode is determined according to the target scanning point set and the scanning parameters corresponding to the laser scanning optimal solution, the frequency spectrum filling rate is ensured to be maximized to fill the Fourier space to the greatest extent, the quality of the reconstructed image is improved, the objectivity and the degree of automation of determining the laser optimal scanning mode are improved, and the image reconstruction efficiency is improved.
The optical diffraction tomography laser scanning device provided by the invention is described below, and the optical diffraction tomography laser scanning device described below and the optical diffraction tomography laser scanning method described above can be correspondingly referred to each other.
An embodiment of the present invention further provides an optical diffraction tomography laser scanning device, and fig. 9 is a schematic structural diagram of the optical diffraction tomography laser scanning device provided in the embodiment of the present invention, as shown in fig. 9, where the optical diffraction tomography laser scanning device 900 includes: a first determination module 910, a construction module 920, a second determination module 930, and a third determination module 940, wherein:
a first determining module 910, configured to determine a spectrum filling rate based on a scan parameter and an initial scan point set, where the spectrum filling rate is a proportion of filling a spectrum of a fourier space corresponding to a projection image during laser scanning, and the initial scan point set includes at least two scan point groups;
a construction module 920, configured to construct a laser scanning objective function based on the spectrum filling rate;
a second determining module 930, configured to iteratively optimize the initial scan point set based on the laser scanning objective function with the maximized spectrum filling rate as an optimization target, to obtain a laser scanning optimal solution;
And a third determining module 940, configured to determine a laser optimal scanning mode based on the target scan point set corresponding to the laser scanning optimal solution and the scan parameter, so as to perform optical diffraction tomography laser scanning.
According to the optical diffraction tomography laser scanning device provided by the embodiment of the invention, the frequency spectrum filling rate is determined through the scanning parameters and the initial scanning point set, the laser scanning objective function is constructed based on the frequency spectrum filling rate, the maximized frequency spectrum filling rate is used as an optimization target, namely, the maximized laser scanning objective function is used as the optimization target, the initial scanning point set is subjected to iterative optimization to obtain the laser scanning optimal solution, the laser optimal scanning mode is determined according to the target scanning point set and the scanning parameters corresponding to the laser scanning optimal solution, the frequency spectrum filling rate is ensured to be maximized to fill the Fourier space to the greatest extent, the quality of the reconstructed image is improved, the objectivity and the degree of automation of determining the laser optimal scanning mode are improved, and the image reconstruction efficiency is improved.
Optionally, the construction module 920 is specifically configured to:
constructing a laser scanning objective function based only on the spectrum filling rate;
or alternatively, the first and second heat exchangers may be,
and constructing a laser scanning objective function based on constraint conditions, weights corresponding to the constraint conditions and the spectrum filling rate, wherein the constraint conditions are used for limiting distribution parameters or imaging parameters of scanning points in the target scanning point group.
Optionally, the second determining module 930 is specifically configured to:
optimizing the laser scanning objective function by using an optimization algorithm based on the initial scanning point set to generate an iterative scanning point set, wherein the optimization algorithm is used for searching a laser scanning optimal solution in a scanning point set space, and a scanning point group in the iterative scanning point set is not identical to a scanning point group in the initial scanning point set;
judging whether preset conditions are met or not, wherein the preset conditions comprise: whether the iteration times are larger than a first preset threshold value or whether the laser scanning objective function difference value is smaller than a second preset threshold value or not, wherein the laser scanning objective function difference value is determined based on an iteration scanning function value corresponding to the iteration scanning point set of the current round and an iteration scanning function value corresponding to the iteration scanning point set of the previous round;
and under the condition that the preset condition is not met, taking the iterative scanning point set as an initial scanning point set of the next round of iterative optimization, stopping iteration until the preset condition is met, and determining the optimal solution of laser scanning based on the iterative scanning function value corresponding to the last iterative scanning point set.
Optionally, the second determining module 930 is specifically configured to:
Determining the iterative scanning function value corresponding to each of all the scanning point groups in the last iterative scanning point set;
and determining the scanning point group corresponding to the optimal iterative scanning function value as the optimal laser scanning solution.
Optionally, the optical diffraction tomography laser scanning apparatus 900 further includes an adjustment module, where the adjustment module is specifically configured to:
and based on a target scanning point group corresponding to the laser scanning optimal solution, taking the maximized frequency spectrum filling rate as an optimization target, adjusting the scanning parameters, and determining a laser optimal scanning mode so as to perform optical diffraction tomography laser scanning.
Optionally, the optical diffraction tomography laser scanning apparatus 900 further includes a storage module, where the storage module is specifically configured to:
and storing the target scanning point group so as to perform optical diffraction tomography laser scanning based on the target scanning point group.
Optionally, the scanning parameters include an optical parameter and a number of scanning angles, the optical parameter is determined based on the optical system, and the number of scanning angles is determined based on the target photographing frame rate.
Fig. 10 is a schematic structural diagram of an electronic device according to an embodiment of the present invention, as shown in fig. 10, the electronic device may include: a processor 1010, a communication interface (Communications Interface) 1020, a memory 1030, and a communication bus 1040, wherein the processor 1010, the communication interface 1020, and the memory 1030 communicate with each other via the communication bus 1040. Processor 1010 may invoke logic instructions in memory 1030 to perform an optical diffraction tomography laser scanning method comprising:
Determining a spectrum filling rate based on the scanning parameters and an initial scanning point set, wherein the spectrum filling rate is a proportion of filling a spectrum of a Fourier space corresponding to a projection image during laser scanning, and the initial scanning point set comprises at least two scanning point groups;
constructing a laser scanning objective function based on the frequency spectrum filling rate;
based on the laser scanning objective function, iteratively optimizing the initial scanning point set by taking the maximized frequency spectrum filling rate as an optimization target to obtain a laser scanning optimal solution;
and determining a laser optimal scanning mode based on the target scanning point group corresponding to the laser scanning optimal solution and the scanning parameters so as to perform optical diffraction tomography laser scanning.
Further, the logic instructions in the memory 1030 described above may be implemented in the form of software functional units and stored in a computer readable storage medium when sold or used as a stand alone product. Based on this understanding, the technical solution of the present invention may be embodied essentially or in a part contributing to the prior art or in a part of the technical solution, in the form of a software product stored in a storage medium, comprising several instructions for causing a computer device (which may be a personal computer, a server, a network device, etc.) to perform all or part of the steps of the method according to the embodiments of the present invention. And the aforementioned storage medium includes: a U-disk, a removable hard disk, a Read-Only Memory (ROM), a random access Memory (RAM, random Access Memory), a magnetic disk, or an optical disk, or other various media capable of storing program codes.
In another aspect, the present invention also provides a computer program product comprising a computer program, the computer program being storable on a non-transitory computer readable storage medium, the computer program, when executed by a processor, being capable of performing the optical diffraction tomography laser scanning method provided by the above methods, the method comprising:
determining a spectrum filling rate based on the scanning parameters and an initial scanning point set, wherein the spectrum filling rate is a proportion of filling a spectrum of a Fourier space corresponding to a projection image during laser scanning, and the initial scanning point set comprises at least two scanning point groups;
constructing a laser scanning objective function based on the frequency spectrum filling rate;
based on the laser scanning objective function, iteratively optimizing the initial scanning point set by taking the maximized frequency spectrum filling rate as an optimization target to obtain a laser scanning optimal solution;
and determining a laser optimal scanning mode based on the target scanning point group corresponding to the laser scanning optimal solution and the scanning parameters so as to perform optical diffraction tomography laser scanning.
In yet another aspect, the present invention also provides a non-transitory computer readable storage medium having stored thereon a computer program which, when executed by a processor, is implemented to perform the optical diffraction tomography laser scanning method provided by the above methods, the method comprising:
Determining a spectrum filling rate based on the scanning parameters and an initial scanning point set, wherein the spectrum filling rate is a proportion of filling a spectrum of a Fourier space corresponding to a projection image during laser scanning, and the initial scanning point set comprises at least two scanning point groups;
constructing a laser scanning objective function based on the frequency spectrum filling rate;
based on the laser scanning objective function, iteratively optimizing the initial scanning point set by taking the maximized frequency spectrum filling rate as an optimization target to obtain a laser scanning optimal solution;
and determining a laser optimal scanning mode based on the target scanning point group corresponding to the laser scanning optimal solution and the scanning parameters so as to perform optical diffraction tomography laser scanning.
The apparatus embodiments described above are merely illustrative, wherein the elements illustrated as separate elements may or may not be physically separate, and the elements shown as elements may or may not be physical elements, may be located in one place, or may be distributed over a plurality of network elements. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of this embodiment. Those of ordinary skill in the art will understand and implement the present invention without undue burden.
From the above description of the embodiments, it will be apparent to those skilled in the art that the embodiments may be implemented by means of software plus necessary general hardware platforms, or of course may be implemented by means of hardware. Based on this understanding, the foregoing technical solution may be embodied essentially or in a part contributing to the prior art in the form of a software product, which may be stored in a computer readable storage medium, such as ROM/RAM, a magnetic disk, an optical disk, etc., including several instructions for causing a computer device (which may be a personal computer, a server, or a network device, etc.) to execute the method described in the respective embodiments or some parts of the embodiments.
Finally, it should be noted that: the above embodiments are only for illustrating the technical solution of the present invention, and are not limiting; although the invention has been described in detail with reference to the foregoing embodiments, it will be understood by those of ordinary skill in the art that: the technical scheme described in the foregoing embodiments can be modified or some technical features thereof can be replaced by equivalents; such modifications and substitutions do not depart from the spirit and scope of the technical solutions of the embodiments of the present invention.

Claims (10)

1. An optical diffraction tomography laser scanning method, comprising:
determining a spectrum filling rate based on the scanning parameters and an initial scanning point set, wherein the spectrum filling rate is a proportion of filling a spectrum of a Fourier space corresponding to a projection image during laser scanning, and the initial scanning point set comprises at least two scanning point groups;
constructing a laser scanning objective function based on the frequency spectrum filling rate;
based on the laser scanning objective function, iteratively optimizing the initial scanning point set by taking the maximized frequency spectrum filling rate as an optimization target to obtain a laser scanning optimal solution;
and determining a laser optimal scanning mode based on the target scanning point group corresponding to the laser scanning optimal solution and the scanning parameters so as to perform optical diffraction tomography laser scanning.
2. The optical diffraction tomography laser scanning method as claimed in claim 1, wherein said constructing a laser scanning objective function based on the spectral filling rate comprises:
constructing a laser scanning objective function based only on the spectrum filling rate;
or alternatively, the first and second heat exchangers may be,
and constructing a laser scanning objective function based on constraint conditions, weights corresponding to the constraint conditions and the spectrum filling rate, wherein the constraint conditions are used for limiting distribution parameters or imaging parameters of scanning points in the target scanning point group.
3. The optical diffraction tomography laser scanning method as claimed in claim 1 or 2, wherein the iteratively optimizing the initial scan point set based on the laser scanning objective function with the maximized spectral filling rate as an optimization target to obtain a laser scanning optimal solution includes:
optimizing the laser scanning objective function by using an optimization algorithm based on the initial scanning point set to generate an iterative scanning point set, wherein the optimization algorithm is used for searching a laser scanning optimal solution in a scanning point set space, and a scanning point group in the iterative scanning point set is not identical to a scanning point group in the initial scanning point set;
judging whether preset conditions are met or not, wherein the preset conditions comprise: whether the iteration times are larger than a first preset threshold value or whether the laser scanning objective function difference value is smaller than a second preset threshold value, wherein the laser scanning objective function difference value is determined based on an iteration scanning function value corresponding to the iteration scanning point set of the current round and an iteration scanning function value corresponding to the iteration scanning point set of the previous round;
and under the condition that the preset condition is not met, taking the iterative scanning point set as an initial scanning point set of the next round of iterative optimization, stopping iteration until the preset condition is met, and determining the optimal solution of laser scanning based on the iterative scanning function value corresponding to the last iterative scanning point set.
4. The optical diffraction tomography laser scanning method as claimed in claim 3, wherein said determining the optimal solution for the laser scanning based on the iterative scan function values corresponding to the last set of iterative scan points comprises:
determining the iterative scanning function value corresponding to each of all the scanning point groups in the last iterative scanning point set;
and determining the scanning point group corresponding to the optimal iterative scanning function value as the optimal laser scanning solution.
5. The optical diffraction tomography laser scanning method as in claim 4, further comprising:
and based on a target scanning point group corresponding to the laser scanning optimal solution, taking the maximized frequency spectrum filling rate as an optimization target, adjusting the scanning parameters, and determining a laser optimal scanning mode so as to perform optical diffraction tomography laser scanning.
6. The optical diffraction tomography laser scanning method as claimed in claim 1 or 2, wherein after said determining the optimal scanning mode of the laser, the method further comprises:
and storing the target scanning point group so as to perform optical diffraction tomography laser scanning based on the target scanning point group.
7. The optical diffraction tomography laser scanning method as claimed in claim 1 or 2, wherein the scanning parameters include an optical parameter and a scanning angle number, the optical parameter being determined based on the optical system, the scanning angle number being determined based on the target photographing frame rate.
8. An optical diffraction tomography laser scanning device, comprising:
the first determining module is used for determining a spectrum filling rate based on the scanning parameters and an initial scanning point set, wherein the spectrum filling rate is a proportion of filling a spectrum of a Fourier space corresponding to a projection image during laser scanning, and the initial scanning point set comprises at least two scanning point groups;
the construction module is used for constructing a laser scanning objective function based on the frequency spectrum filling rate;
the second determining module is used for carrying out iterative optimization on the initial scanning point set based on the laser scanning objective function and taking the maximized frequency spectrum filling rate as an optimization target to obtain a laser scanning optimal solution;
and the third determining module is used for determining a laser optimal scanning mode based on the target scanning point group corresponding to the laser scanning optimal solution and the scanning parameters so as to perform optical diffraction tomography laser scanning.
9. An electronic device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, wherein the processor implements the optical diffraction tomography laser scanning method of any of claims 1-7 when the program is executed by the processor.
10. A non-transitory computer readable storage medium having stored thereon a computer program, wherein the computer program when executed by a processor implements the optical diffraction tomography laser scanning method of any of claims 1-7.
CN202310928441.7A 2023-07-26 2023-07-26 Optical diffraction tomography laser scanning method and device and electronic equipment Active CN117268288B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202310928441.7A CN117268288B (en) 2023-07-26 2023-07-26 Optical diffraction tomography laser scanning method and device and electronic equipment

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202310928441.7A CN117268288B (en) 2023-07-26 2023-07-26 Optical diffraction tomography laser scanning method and device and electronic equipment

Publications (2)

Publication Number Publication Date
CN117268288A CN117268288A (en) 2023-12-22
CN117268288B true CN117268288B (en) 2024-03-08

Family

ID=89207050

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202310928441.7A Active CN117268288B (en) 2023-07-26 2023-07-26 Optical diffraction tomography laser scanning method and device and electronic equipment

Country Status (1)

Country Link
CN (1) CN117268288B (en)

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101936717A (en) * 2010-07-29 2011-01-05 北京理工大学 Processing method of high-spatial resolution product of biaxial confocal optical path
KR20140045625A (en) * 2012-10-08 2014-04-17 한국표준과학연구원 Structured illumination imaging method using laser bean scanning
CN107064628A (en) * 2017-04-13 2017-08-18 中国电子科技集团公司第二十四研究所 High Precise Frequency Measurement System and method
CN111528799A (en) * 2020-04-28 2020-08-14 中山大学 Method for improving dynamic range of sweep frequency light source optical coherence tomography system
CN111610621A (en) * 2020-01-19 2020-09-01 北京大学 Bimodal microscopic imaging system and method
CN114965470A (en) * 2022-05-19 2022-08-30 南京理工大学 Light intensity transmission diffraction chromatography microimaging method based on non-interference synthetic aperture
CN115144371A (en) * 2022-07-19 2022-10-04 南京理工大学 Lensless Fourier laminated diffraction tomography microscopic imaging method based on wavelength scanning

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2013018024A1 (en) * 2011-07-29 2013-02-07 Ecole Polytechnique Federale De Lausanne (Epfl) Apparatus and method for quantitative phase tomography through linear scanning with coherent and non-coherent detection

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101936717A (en) * 2010-07-29 2011-01-05 北京理工大学 Processing method of high-spatial resolution product of biaxial confocal optical path
KR20140045625A (en) * 2012-10-08 2014-04-17 한국표준과학연구원 Structured illumination imaging method using laser bean scanning
CN107064628A (en) * 2017-04-13 2017-08-18 中国电子科技集团公司第二十四研究所 High Precise Frequency Measurement System and method
CN111610621A (en) * 2020-01-19 2020-09-01 北京大学 Bimodal microscopic imaging system and method
CN111528799A (en) * 2020-04-28 2020-08-14 中山大学 Method for improving dynamic range of sweep frequency light source optical coherence tomography system
CN114965470A (en) * 2022-05-19 2022-08-30 南京理工大学 Light intensity transmission diffraction chromatography microimaging method based on non-interference synthetic aperture
CN115144371A (en) * 2022-07-19 2022-10-04 南京理工大学 Lensless Fourier laminated diffraction tomography microscopic imaging method based on wavelength scanning

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
基于数字全息显微层析的癌细胞空泡化成像研究;刘雅坤 等;中国激光;20221031;第49卷(第20期);2007209-1至2007209-9 *

Also Published As

Publication number Publication date
CN117268288A (en) 2023-12-22

Similar Documents

Publication Publication Date Title
White et al. Recent developments in CrystFEL
CN108648264B (en) Underwater scene reconstruction method based on motion recovery and storage medium
RU2589386C2 (en) Device for direct projection
CN111738953A (en) Atmospheric turbulence degraded image restoration method based on boundary perception counterstudy
CN112927359B (en) Three-dimensional point cloud completion method based on deep learning and voxels
JP7346726B2 (en) Phase image reconstruction using deep learning
CN114078183B (en) Reconstruction method, device, equipment and medium of three-dimensional structure of porous medium
WO2020152885A1 (en) Optic and method of forming optic device
CN114493995A (en) Image rendering model training method, image rendering method and image rendering device
CN112200887B (en) Multi-focus image fusion method based on gradient sensing
EP4239583A1 (en) Three-dimensional reconstruction method, apparatus and system, and storage medium
CN112184547B (en) Super resolution method of infrared image and computer readable storage medium
JP2020166498A (en) Information processing apparatus, three-dimensional model generating method, and program
CN117268288B (en) Optical diffraction tomography laser scanning method and device and electronic equipment
CN111161384A (en) Path guiding method of participating media
Liu et al. Joint artifact correction and super-resolution of image slicing and mapping system via a convolutional neural network
CN107534729B (en) Image processing apparatus, image processing method, and program
Xing et al. Highly parallel algorithms for visual-perception-guided surface remeshing
CN114049939A (en) Pneumonia CT image generation method based on UNet-GAN network
KT et al. A flexible neural renderer for material visualization
CN113947547A (en) Monte Carlo rendering graph noise reduction method based on multi-scale kernel prediction convolutional neural network
Xie et al. Deep learning for estimation of Kirkpatrick–Baez mirror alignment errors
Hua et al. Spatial and axial resolution limits for mask-based lensless cameras
CN114967397B (en) Lens-free holographic three-dimensional imaging construction method and device
Jia et al. AdaptiveStereo: Depth estimation from adaptive structured light

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant