WO2020258434A1 - 一种基于tie的相位成像方法、装置及可读存储介质 - Google Patents
一种基于tie的相位成像方法、装置及可读存储介质 Download PDFInfo
- Publication number
- WO2020258434A1 WO2020258434A1 PCT/CN2019/097949 CN2019097949W WO2020258434A1 WO 2020258434 A1 WO2020258434 A1 WO 2020258434A1 CN 2019097949 W CN2019097949 W CN 2019097949W WO 2020258434 A1 WO2020258434 A1 WO 2020258434A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- defocus image
- image
- phase imaging
- tie
- corner
- Prior art date
Links
Images
Classifications
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N21/00—Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
- G01N21/17—Systems in which incident light is modified in accordance with the properties of the material investigated
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N21/00—Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
- G01N21/17—Systems in which incident light is modified in accordance with the properties of the material investigated
- G01N21/41—Refractivity; Phase-affecting properties, e.g. optical path length
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N21/00—Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
- G01N21/17—Systems in which incident light is modified in accordance with the properties of the material investigated
- G01N2021/1789—Time resolved
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N21/00—Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
- G01N21/17—Systems in which incident light is modified in accordance with the properties of the material investigated
- G01N21/41—Refractivity; Phase-affecting properties, e.g. optical path length
- G01N2021/4173—Phase distribution
- G01N2021/4186—Phase modulation imaging
Definitions
- the present invention relates to the field of optical imaging technology, in particular to a phase imaging method, device and readable storage medium based on TIE.
- the light intensity transmission equation (Transport of intensity equation, TIE) was first proposed in 1983. It is a non-interference phase imaging method that quantitatively restores the phase.
- the light intensity transmission equation is derived from the Helmholtz equation under paraxial approximation. It expresses the quantitative relationship between the light intensity variation in the direction of the optical axis and the phase of light waves on a plane perpendicular to the optical axis. This method does not require interference, is less affected by noise, and does not require complex optical path structure and phase unwrapping calculations.
- TIE moves the CCD camera to obtain the light intensity change on the plane perpendicular to the optical axis, but this movement operation will introduce additional errors and will reduce the acquisition speed.
- TIE The dynamic quantitative phase imaging method is proposed, one of which is to use dual cameras installed at the binocular tube of the microscope to achieve a single exposure to obtain the defocus image, although the method of configuring dual cameras on the binoculars is simple, compact and cost-effective Low, can obtain negative defocus image and positive defocus image at the same time without losing the spatial resolution, but due to the installation error of the two cameras and the processing error of the eyepiece, the field of view of the images collected by the two cameras cannot be completely matched, and the imaging effect Bad.
- the main purpose of the embodiments of the present invention is to provide a TIE-based phase imaging method, device, and readable storage medium, which can at least solve the problem of image viewing acquired by dual cameras when performing TIE-based dynamic quantitative phase imaging in related technologies.
- the field cannot be completely matched, the imaging system has low accuracy and poor imaging effect.
- the first aspect of the embodiments of the present invention provides a TIE-based phase imaging method, which is applied to a TIE-based dual-camera dynamic phase imaging system.
- the dual-camera dynamic phase imaging system is configured on the binocular tube There are dual cameras, and a copper ring is set between one of the eyepiece tube and the camera of the corresponding configuration.
- the method includes:
- corner points are the vertices of every two adjacent grids on the checkerboard;
- one of the out-of-focus images is corrected with respect to the other out-of-focus image
- phase imaging is performed on a preset experimental sample.
- the second aspect of the embodiments of the present invention provides a TIE-based phase imaging device, which is applied to a TIE-based dual-camera dynamic phase imaging system, and the dual-camera dynamic phase imaging system is configured on the binocular tube There are dual cameras, one of which is provided with a copper ring between the eyepiece tube and the corresponding camera.
- the device includes:
- the control module is used to control the dual cameras to perform synchronous single-frame imaging of a standard checkerboard to obtain a positive defocus image and a negative defocus image of the standard checkerboard;
- the extraction module is used to extract the corner points in the positive defocus image and the negative defocus image; the corner points are the vertices of every two adjacent grids on the checkerboard;
- the correction module is used to correct the field of view of one out-of-focus image relative to the other out-of-focus image according to the obtained homography matrix
- the imaging module is used to perform phase imaging on a preset experimental sample through the dual-camera dynamic phase imaging system after completing the field of view correction.
- a third aspect of the embodiments of the present invention provides an electronic device, which includes: a processor, a memory, and a communication bus;
- the communication bus is used to implement connection and communication between the processor and the memory
- the processor is configured to execute one or more programs stored in the memory to implement the steps of any of the above-mentioned TIE-based phase imaging methods.
- a fourth aspect of the embodiments of the present invention provides a computer-readable storage medium, the computer-readable storage medium stores one or more programs, and the one or more programs can be processed by one or more To implement the steps of any of the above-mentioned phase imaging methods based on TIE.
- two cameras are controlled to perform synchronous single-frame imaging on a standard checkerboard to obtain a positive defocused image and a negative defocused image of the standard checkerboard; respectively; Extract the corner points in the positive defocus image and the negative defocus image; solve the homography matrix based on the corner coordinates of the positive defocus image and the corner coordinates of the negative defocus image; calculate the homography matrix according to the obtained homography matrix
- One out-of-focus image is field-corrected relative to the other out-of-focus image; through the dual-camera dynamic phase imaging system after the field of view correction is completed, phase imaging is performed on the preset experimental sample.
- the homography matrix is calculated by using the image formed by the standard checkerboard, and the homography matrix is used to correct the field of view image of one of the cameras, which can achieve sub-pixel level matching accuracy and ensure the TIE phase imaging system. Accuracy improves the imaging effect.
- FIG. 1 is a schematic structural diagram of a phase imaging system based on TIE provided by the first embodiment of the present invention
- FIG. 2 is a schematic diagram of the basic flow of the TIE-based phase imaging method provided by the first embodiment of the present invention
- FIG. 3 is a schematic diagram of a field of view image provided by the first embodiment of the present invention.
- FIG. 4 is a schematic diagram of the basic flow of the corner extraction method provided by the first embodiment of the present invention.
- FIG. 5 is a schematic diagram of the consistency of corresponding corner points transformed to the same coordinate system provided by the first embodiment of the present invention.
- FIG. 6 is a schematic diagram of the basic flow of the method for field of view correction verification provided by the first embodiment of the present invention.
- FIG. 7 is a schematic diagram of a microlens array provided by the first embodiment of the present invention.
- FIG. 8 is a schematic diagram of height distribution comparison provided by the first embodiment of the present invention.
- FIG. 9 is a schematic diagram of morphological changes of algae cells at different times provided by the first embodiment of the present invention.
- FIG. 10 is a schematic structural diagram of a TIE-based phase imaging device according to a second embodiment of the present invention.
- FIG. 11 is a schematic structural diagram of an electronic device provided by a third embodiment of the present invention.
- this embodiment proposes a method based on The phase imaging method of TIE is applied to the dual-camera dynamic phase imaging system based on TIE.
- the dual-camera dynamic phase imaging system is equipped with dual cameras on the binocular tube, and a copper ring is set between the eyepiece tube and the corresponding camera. .
- Figure 1 shows the TIE-based dual-camera dynamic phase imaging system provided by this embodiment, in which collector lens represents condenser lens, condenser aperture represents condenser aperture, condenser represents condenser lens, sample represents sample stage, and objective represents objective lens , Tube lens means tube lens, beam splitter means beam splitter, mirror means mirror, eyepiece tube means eyepiece tube, c-mount brass spacer ring means C mount brass spacer, CCD means camera.
- Defocus is achieved by installing a fixed size C-mount brass spacer as a copper ring between the eyepiece tube and the camera.
- Fig. 2 is a schematic diagram of the basic flow of the TIE-based phase imaging method provided in this embodiment.
- the TIE-based phase imaging method proposed in this embodiment includes the following steps:
- Step 201 Control the dual cameras to perform synchronous single-frame imaging on a standard checkerboard to obtain a positive defocus image and a negative defocus image of the standard checkerboard.
- the standard checkerboard is used as the calibration sample, and the negative defocus image and the positive defocus image are acquired by the dual cameras on the imaging system synchronously with a single needle.
- the field of view collected in this embodiment is Images, where (a) is a negative defocus image, (b) is a positive defocus image. It can be seen from Figure 3 that the field of view of the images collected by the two cameras is not completely consistent. This inconsistency will significantly affect the accuracy of TIE phase recovery.
- Step 202 Extract the corner points in the positive defocus image and the negative defocus image respectively.
- corner points are the vertices of every two adjacent grids on the checkerboard.
- the corner points are very important features of the image and play an important role in the understanding and analysis of image graphics.
- FIG. 4 is a schematic flowchart of a corner extraction method provided by this embodiment.
- extracting corner points in a positive defocus image and a negative defocus image respectively includes the following steps:
- Step 401 Calculate gradients of pixels in the positive defocus image and the negative defocus image in the horizontal and vertical directions, and obtain an autocorrelation matrix based on the gradient;
- Step 402 Calculate the interest value of each pixel in the positive defocus image and the negative defocus image based on the corresponding autocorrelation matrix
- Step 403 In the positive defocus image and the negative defocus image, the pixel points corresponding to the maximum interest value in the local range are respectively determined as corner points.
- the Harris operator is used to extract the corner points in the two checkerboard images as corresponding feature points in different fields of view, and the accuracy of the position of the corner points extracted by the operator can reach the sub-pixel level.
- the gradients I x and I y of the image pixels in the horizontal and vertical directions and the product I x I y of the two are calculated to obtain the values of the four elements in the autocorrelation matrix.
- the autocorrelation matrix M is expressed as follows:
- the Harris corner response of each pixel is calculated based on the autocorrelation matrix, that is, the interest value, and then the maximum point is found in the local range. If the Harris corner response is greater than the preset threshold, the Is the corner point.
- Step 203 Based on the corner coordinate position of the positive defocus image and the corner coordinate position of the negative defocus image, the homography matrix is solved.
- the homography transformation of a plane is defined as a projection mapping from one plane to another plane. Based on this, this embodiment maps the corner points on one out-of-focus image plane to another out-of-focus image plane.
- the mapping relationship of the corner points on the image plane is represented by a homography matrix.
- the expression of the homography matrix is:
- the field of view image obtained by any one of the dual cameras can be rectified.
- the positive defocused image is calculated according to the obtained homography matrix.
- the corner coordinate position is transformed to the same coordinate system as the corner coordinate position of the negative defocus image to perform field of view correction.
- the homography matrix is the mapping relationship between the corner points on the positive defocus image plane and the corner points on the negative defocus image plane.
- solving the homography matrix includes: minimizing an error function; and calculating the corner coordinates of the positive defocus image and the negative distance The coordinates of the corner points of the focal image are substituted into the error function to solve the homography matrix.
- E is the error function
- H is the homography matrix
- a 33 is normalized to 1
- I is the coordinate position of the corner point in the negative defocus image
- N is the number of corner points taken
- this embodiment solves the homography matrix H by minimizing an error function E, and the optimization problem of the error function E can be solved by using singular value decomposition (SVD, Singular Value Decomposition).
- SVD singular value decomposition
- Step 204 Perform field-of-view correction on one of the out-of-focus images relative to the other out-of-focus image according to the obtained homography matrix.
- this embodiment uses the obtained homography matrix to transform one of the out-of-focus images, such as transforming a positive defocused image, that is, transforming the position of the corner points of the positively defocused image to be the same as the negatively defocused image Coordinate System.
- the gray scale of this point can be calculated by the bilinear interpolation method.
- the main idea is The gray value of the sub-pixel is calculated by the gray value corresponding to the 4 whole pixels around the sub-pixel.
- the surrounding four whole pixel positions are (x 1 ,y 1 ), (x 1 ,y 2 ), (x 2 ,y 1 ), (x 2 ,y 2 ), the corresponding gray values are f(x 1 ,y 1 ), f(x 1 ,y 2 ), f(x 2 ,y 1 ), f(x 2 ,y 2 ), at the sub-pixel point
- the gray value f(x,y) can be expressed as:
- the digital field of view correction of the dual-camera dynamic imaging system based on TIE is realized, and the matching accuracy of the corrected image can reach sub-level Pixel level.
- the microscope system is an Olympus IX73 inverted microscope system
- the objective lens is Olympus 10 ⁇ 0.3NA (NA is numerical aperture)
- the illumination source is a tungsten halogen lamp white light passing through a neutral filter (central wavelength 550nm, The quasi-monochromatic light generated after the bandwidth is 45nm)
- the size of a standard checkerboard single grid is 5 ⁇ m ⁇ 5 ⁇ m.
- Figure 5 is a schematic diagram of the consistency of the corresponding corner points transformed to the same coordinate system provided in this embodiment, showing that the two groups correspond The degree of agreement of the corner points in the same coordinate system, and the relative root mean square error of the two is calculated to be 0.8681 pixels.
- Step 205 Perform phase imaging on the preset experimental sample through the dual-camera dynamic phase imaging system after completing the field of view correction.
- the TIE phase imaging is performed through the system, which can ensure the imaging accuracy of the system and improve the imaging effect.
- the experimental samples in are the samples to be tested provided by the user during actual use.
- the light intensity transmission equation represents the relationship between the amount of light intensity change in the optical axis direction and the phase of the light wave on the plane perpendicular to the optical axis, and the specific form is expressed as follows:
- the light intensity transmission equation can be converted into a Poisson equation.
- the specific form is expressed as follows:
- the Fourier transform method is used to solve the Poisson equation to obtain the phase distribution
- two positive and negative defocused light intensity images are collected along the optical axis to approximate the numerical difference instead of the light intensity along the axis.
- this embodiment also verifies the field of view correction effect before performing phase imaging on the preset experimental sample through the dual-camera dynamic phase imaging system after completing the field of view correction, as shown in FIG. 6 for this implementation
- the example provides a schematic flow diagram of a field of view correction verification method, which specifically includes the following steps:
- Step 601 Obtain a positive defocus image and a negative defocus image after the field of view is corrected by a microlens array of a known size;
- Step 602 Solve the TIE based on the positive defocus image and the negative defocus image of the microlens array to obtain phase information of the microlens array;
- Step 603 Calculate the height distribution data of the micro lens array according to the phase information of the micro lens array
- Step 604 Calculate the radius of curvature of a single microlens based on the height distribution data
- Step 605 Compare the calculated radius of curvature with a preset reference value of the radius of curvature, and determine whether the field of view correction operation is ideal according to the comparison result.
- FIG. 7 is a schematic diagram of the microlens array provided by this embodiment, in which (a) is a negative defocus image, (b) is a positive defocus image, and (c) is the aforementioned image field correction using this embodiment Corrected positive defocus image after method.
- the corrected positive defocus image and the negative defocus image are solved by TIE to obtain the phase information of the microlens array
- this embodiment when calculating the height distribution data of the microlens array according to the phase information of the microlens array, this embodiment provides that the phase information of the microlens array is substituted into the preset height distribution calculation formula to calculate the height distribution of the microlens array.
- Height distribution data the height distribution calculation formula is as follows:
- h is the height distribution data
- Is the phase information of the microlens array
- ⁇ is the wavelength
- calculating the radius of curvature of a single microlens based on the height distribution data includes: determining the maximum height of the cross section of a single microlens based on the height distribution data; substituting the maximum height into a preset curvature radius calculation formula, and calculating The radius of curvature of a single microlens, and the formula for calculating the radius of curvature is as follows:
- Roc is the radius of curvature
- h is the maximum height
- D is the diameter of the microlens.
- the diameter of the microlens used in the experiment is 246 ⁇ m.
- the cross-sectional profile cut from the highest point of a single microlens is compared with the real cross-sectional profile in height distribution.
- the height distribution comparison schematic diagram provided by this embodiment is the highest point of the calculated cross-section.
- the manufacturer's reference value is (350 ⁇ 17.5) ⁇ m, so the experimentally calculated value is within the allowable error range. Make sure that the corrected image can correctly recover the phase information.
- this method is also used to realize dynamic imaging of the swimming phase of Haematococcus pluvialis cells, which verifies the effectiveness of dynamic biological phase imaging.
- Haematococcus pluvialis cells are one of the best organisms that produce natural antioxidant astaxanthin. How to use Haematococcus pluvialis cells to produce astaxanthin better and more is a research hotspot in related fields.
- the swimming state of algae cells in physiological saline was observed at a room temperature of 26°C.
- the experiment adopted an Olympus 20X 0.4NA objective lens, and a dual camera quickly collected an image sequence of a single algae cell moving within 200ms.
- Figure 9 shows the morphological changes of the algae cells at different times of extraction.
- the results show that the algae cells with flagella are constantly swimming, and the phase distribution of the algae cells is different at each time, so the method provided in this embodiment can be quantified
- the contour morphology changes of algae cells in the swimming stage were observed.
- the phase change is directly related to the volume change.
- the algae cells begin to accumulate astaxanthin, their volume will increase, and the growth environment of the algae cells (high salinity, high light intensity, nutrient depletion, etc.) will change It will affect the production of astaxanthin.
- the influence of changes in the external environment on the production of astaxanthin can be analyzed by quantitatively and dynamically detecting phase changes. Therefore, the use of a TIE-based dual-camera dynamic phase imaging system to explore the phase information of Haematococcus pluvialis cells has certain research significance and application prospects.
- the two cameras are controlled to perform synchronous single-frame imaging of the standard checkerboard to obtain the positive defocus image and the negative defocus image of the standard checkerboard; the positive defocus image and the negative defocus image are respectively extracted
- the corner points in the defocused image based on the corner coordinates of the positive defocus image and the corner coordinates of the negative defocus image, the homography matrix is solved; one of the defocused images is relative to the other according to the obtained homography matrix
- the field of view is corrected for the out-of-focus image; the phase imaging is performed on the preset experimental sample through the dual-camera dynamic phase imaging system after the field of view is corrected.
- the homography matrix is calculated by using the image formed by the standard checkerboard, and the homography matrix is used to correct the field of view image of one of the cameras, which can achieve sub-pixel level matching accuracy and ensure the TIE phase imaging system. Accuracy improves the imaging effect.
- this embodiment shows a method based on TIE's phase imaging device is applied to the dual-camera dynamic phase imaging system based on TIE.
- the dual-camera dynamic phase imaging system is equipped with dual cameras on the binocular tube, and a copper ring is set between one of the eyepiece tube and the corresponding camera.
- the phase imaging device of this embodiment includes:
- the control module 1001 is used to control the dual cameras to perform synchronous single-frame imaging of the standard checkerboard to obtain a positive defocus image and a negative defocus image of the standard checkerboard;
- the extraction module 1002 is used to extract the corner points in the positive defocus image and the negative defocus image respectively; the corner points are the vertices of every two adjacent grids on the checkerboard;
- the solving module 1003 is used to solve the homography matrix based on the corner coordinate position of the positive defocus image and the corner coordinate position of the negative defocus image;
- the correction module 1004 is used to correct the field of view of one out-of-focus image relative to the other out-of-focus image according to the obtained homography matrix;
- the imaging module 1005 is used to perform phase imaging on a preset experimental sample through the dual-camera dynamic phase imaging system after completing the field of view correction.
- the extraction module 1002 is specifically configured to calculate the horizontal and vertical gradients of pixels in the positive defocus image and the negative defocus image, respectively, and obtain the autocorrelation matrix based on the gradient;
- the corresponding autocorrelation matrix calculates the interest value of each pixel in the positive defocus image and the negative defocus image; respectively, the pixel points corresponding to the local maximum interest value in the positive defocus image and the negative defocus image Determine the corner point.
- the homography matrix is the mapping relationship between the corner points on the positive defocus image plane and the corner points on the negative defocus image plane; accordingly, the correction module 1004 is specifically used for According to the obtained homography matrix, the corner coordinate position of the positive defocus image is transformed to the same coordinate system as the corner coordinate position of the negative defocus image to perform field of view correction.
- the solving module 1003 is specifically configured to minimize an error function, and the error function is expressed as follows:
- E is the error function
- H is the homography matrix
- a 33 is normalized to 1
- I is the coordinate position of the corner point in the negative defocus image
- N is the number of corner points taken
- corner coordinate positions of the positive defocus image and the corner coordinate positions of the negative defocus image are substituted into the error function to solve the homography matrix.
- the phase imaging device of this embodiment further includes: a verification module, which is specifically used to perform a preset experiment on the dual-camera dynamic phase imaging system after completing the field of view correction.
- a verification module which is specifically used to perform a preset experiment on the dual-camera dynamic phase imaging system after completing the field of view correction.
- the imaging module 1005 is specifically used to perform phase imaging on the preset experimental sample through the dual-camera dynamic phase imaging system after the field of view correction is completed when the field of view correction
- the verification module calculates the height distribution data of the micro lens array according to the phase information of the micro lens array, it is specifically used to substitute the phase information of the micro lens array into a preset
- the height distribution calculation formula is to calculate the height distribution data of the micro lens array.
- the height distribution calculation formula is expressed as follows:
- h is the height distribution data
- Is the phase information of the micro lens array
- ⁇ is the wavelength
- n is the refractive index of the surrounding medium.
- the verification module when the verification module calculates the radius of curvature of a single microlens based on the height distribution data, it is specifically used to determine the maximum height of the cross section of a single microlens based on the height distribution data; The height is substituted into the preset curvature radius calculation formula to calculate the curvature radius of a single microlens.
- the curvature radius calculation formula is as follows:
- Roc is the radius of curvature
- h is the maximum height
- D is the diameter of the microlens.
- TIE-based phase imaging method in the foregoing embodiment can be implemented based on the TIE-based phase imaging device provided in this embodiment.
- Those of ordinary skill in the art can clearly understand that it is convenient and concise to describe.
- For the specific working process of the TIE-based phase imaging device described in this embodiment reference may be made to the corresponding process in the foregoing method embodiment, which will not be repeated here.
- the dual cameras are controlled to perform synchronous single-frame imaging on a standard checkerboard to obtain a positive defocus image and a negative defocus image of the standard checkerboard; the positive defocus image and the negative defocus image are extracted respectively The corner point in the focus image; based on the corner point coordinate position of the positive defocus image and the corner point coordinate position of the negative defocus image, the homography matrix is solved; according to the obtained homography matrix, one of the defocused images is separated from the other The focus image is corrected for the field of view; through the dual-camera dynamic phase imaging system after the field of view is corrected, the phase imaging of the preset experimental sample is performed.
- the homography matrix is calculated by using the image formed by the standard checkerboard, and the homography matrix is used to correct the field of view image of one of the cameras, which can achieve sub-pixel level matching accuracy and ensure the TIE phase imaging system. Accuracy improves the imaging effect.
- This embodiment provides an electronic device, as shown in FIG. 11, which includes a processor 1101, a memory 1102, and a communication bus 1103, where: the communication bus 1103 is used to implement connection and communication between the processor 1101 and the memory 1102; processing The device 1101 is configured to execute one or more computer programs stored in the memory 1102 to implement at least one step in the TIE-based phase imaging method in the first embodiment.
- This embodiment also provides a computer-readable storage medium, which is included in any method or technology for storing information (such as computer-readable instructions, data structures, computer program modules, or other data). Volatile or non-volatile, removable or non-removable media.
- Computer-readable storage media include but are not limited to RAM (Random Access Memory), ROM (Read-Only Memory, read-only memory), EEPROM (Electrically Erasable Programmable read only memory, charged Erasable Programmable Read-Only Memory) ), flash memory or other storage technology, CD-ROM (Compact Disc Read-Only Memory), digital versatile disk (DVD) or other optical disk storage, magnetic cassettes, magnetic tapes, magnetic disk storage or other magnetic storage devices, Or any other medium that can be used to store desired information and can be accessed by a computer.
- the computer-readable storage medium in this embodiment may be used to store one or more computer programs, and the stored one or more computer programs may be executed by a processor to implement at least one step of the method in the first embodiment.
- This embodiment also provides a computer program, which can be distributed on a computer-readable medium and executed by a computer-readable device to implement at least one step of the method in the first embodiment; and in some cases At least one of the steps shown or described can be performed in a different order from the order described in the foregoing embodiment.
- This embodiment also provides a computer program product, including a computer readable device, and the computer readable device stores the computer program as shown above.
- the computer-readable device in this embodiment may include the computer-readable storage medium as shown above.
- communication media usually contain computer-readable instructions, data structures, computer program modules, or other data in a modulated data signal such as a carrier wave or other transmission mechanism, and may include any information delivery medium. Therefore, the present invention is not limited to any specific combination of hardware and software.
Landscapes
- Physics & Mathematics (AREA)
- Health & Medical Sciences (AREA)
- Life Sciences & Earth Sciences (AREA)
- Chemical & Material Sciences (AREA)
- Analytical Chemistry (AREA)
- Biochemistry (AREA)
- General Health & Medical Sciences (AREA)
- General Physics & Mathematics (AREA)
- Immunology (AREA)
- Pathology (AREA)
- Studio Devices (AREA)
Abstract
Description
Claims (10)
- 一种基于光强传输方程TIE的相位成像方法,应用于基于TIE的双相机动态相位成像系统,所述双相机动态相位成像系统的双目镜筒上配置有双相机,其中一个目镜筒与对应配置的相机之间设置有铜环,其特征在于,包括:控制所述双相机对标准棋盘格进行同步单帧成像,得到所述标准棋盘格的正离焦图像和负离焦图像;分别提取所述正离焦图像和负离焦图像中的角点;所述角点为棋盘格上每相邻的两个格子所重合的顶点;基于所述正离焦图像的角点坐标位置以及所述负离焦图像的角点坐标位置,求解单应矩阵;根据求得的单应矩阵将其中一个离焦图像相对另一个离焦图像进行视场矫正;通过完成所述视场矫正后的所述双相机动态相位成像系统,对预设的实验样品进行相位成像。
- 如权利要求1所述的基于TIE的相位成像方法,其特征在于,所述分别提取所述正离焦图像和负离焦图像中的角点包括:分别计算所述正离焦图像和负离焦图像中像素点在水平和垂直方向上的梯度,基于所述梯度得到自相关矩阵;基于对应的所述自相关矩阵分别计算所述正离焦图像和负离焦图像中各像素点的兴趣值;分别将所述正离焦图像和负离焦图像中,局部范围内的极大兴趣值所对应的像素点确定为角点。
- 如权利要求1所述的基于TIE的相位成像方法,其特征在于,所述单应矩阵为所述正离焦图像平面上的角点对应到所述负离焦图像平面上的角点的映射关系;所述根据求得的单应矩阵将其中一个离焦图像相对另一个离焦图像进行视场矫正包括:根据求得的单应矩阵将所述正离焦图像的角点坐标位置变换至 与所述负离焦图像的角点坐标位置同一坐标系,以进行视场矫正。
- 如权利要求1所述的基于TIE的相位成像方法,其特征在于,在所述通过完成所述视场矫正后的所述双相机动态相位成像系统,对预设的实验样品进行相位成像之前,还包括:获取已知尺寸的微透镜阵列进行视场矫正后的正离焦图像和负离焦图像;基于所述微透镜阵列的正离焦图像和负离焦图像求解TIE,得到所述微透镜阵列的相位信息;根据所述微透镜阵列的相位信息计算所述微透镜阵列的高度分布数据;基于所述高度分布数据计算单个微透镜的曲率半径;将计算得到的所述曲率半径与预设的曲率半径参考值进行比较,并根据比较结果确定视场矫正操作是否理想;其中,在所述视场矫正操作理想时,执行所述通过完成所述视场矫正后的所述双相机动态相位成像系统,对预设的实验样品进行相位成像的步骤。
- 一种基于TIE的相位成像装置,应用于基于TIE的双相机动态相位成像系统,所述双相机动态相位成像系统的双目镜筒上配置有双相机,其中一个目镜筒与对应配置的相机之间设置有铜环,其特征在于,包括:控制模块,用于控制所述双相机对标准棋盘格进行同步单帧成像,得到所述标准棋盘格的正离焦图像和负离焦图像;提取模块,用于分别提取所述正离焦图像和负离焦图像中的角点;所述角点为棋盘格上每相邻的两个格子所重合的顶点;求解模块,用于基于所述正离焦图像的角点坐标位置以及所述负离焦图像的角点坐标位置,求解单应矩阵;矫正模块,用于根据求得的单应矩阵将其中一个离焦图像相对另一个离焦图像进行视场矫正;成像模块,用于通过完成所述视场矫正后的所述双相机动态相位成像系统,对预设的实验样品进行相位成像。
- 一种电子装置,其特征在于,包括:处理器、存储器和通信 总线;所述通信总线用于实现所述处理器和存储器之间的连接通信;所述处理器用于执行所述存储器中存储的一个或者多个程序,以实现如权利要求1至7中任意一项所述的基于TIE的相位成像方法的步骤。
- 一种计算机可读存储介质,其特征在于,所述计算机可读存储介质存储有一个或者多个程序,所述一个或者多个程序可被一个或者多个处理器执行,以实现如权利要求1至7中任意一项所述的基于TIE的相位成像方法的步骤。
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201910547569.2 | 2019-06-24 | ||
CN201910547569.2A CN110411981A (zh) | 2019-06-24 | 2019-06-24 | 一种基于tie的相位成像方法、装置及可读存储介质 |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2020258434A1 true WO2020258434A1 (zh) | 2020-12-30 |
Family
ID=68359604
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/CN2019/097949 WO2020258434A1 (zh) | 2019-06-24 | 2019-07-26 | 一种基于tie的相位成像方法、装置及可读存储介质 |
Country Status (2)
Country | Link |
---|---|
CN (1) | CN110411981A (zh) |
WO (1) | WO2020258434A1 (zh) |
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN113588034A (zh) * | 2021-07-29 | 2021-11-02 | 上海电力大学 | 一种变压器油中气体体积快速定量监测方法 |
CN114666480A (zh) * | 2022-03-28 | 2022-06-24 | 天津大学 | 基于相位信息的组合成像系统入射光线逐像素标定方法及装置 |
Families Citing this family (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN110930336B (zh) * | 2019-11-29 | 2023-11-28 | 深圳市商汤科技有限公司 | 图像处理方法及装置、电子设备和存储介质 |
CN112540527B (zh) * | 2020-12-07 | 2021-07-27 | 江苏科技大学 | 一种同步采集双离焦衍射图样的快速收敛叠层成像装置 |
CN115641368B (zh) * | 2022-10-31 | 2024-06-04 | 安徽农业大学 | 一种用于标定的离焦棋盘格图像特征提取方法 |
Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20080179521A1 (en) * | 2003-11-10 | 2008-07-31 | Technology Innovations, Llc | Digital imaging assembly & methods thereof |
CN105675151A (zh) * | 2016-01-06 | 2016-06-15 | 上海大学 | 一种基于光强传输方程相位恢复应用装置 |
CN106054570A (zh) * | 2016-04-26 | 2016-10-26 | 上海大学 | 采用强度传输方程实现单幅数字全息图较大相位重建方法 |
-
2019
- 2019-06-24 CN CN201910547569.2A patent/CN110411981A/zh active Pending
- 2019-07-26 WO PCT/CN2019/097949 patent/WO2020258434A1/zh active Application Filing
Patent Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20080179521A1 (en) * | 2003-11-10 | 2008-07-31 | Technology Innovations, Llc | Digital imaging assembly & methods thereof |
CN105675151A (zh) * | 2016-01-06 | 2016-06-15 | 上海大学 | 一种基于光强传输方程相位恢复应用装置 |
CN106054570A (zh) * | 2016-04-26 | 2016-10-26 | 上海大学 | 采用强度传输方程实现单幅数字全息图较大相位重建方法 |
Non-Patent Citations (1)
Title |
---|
XIAOLIN TIAN, YU WEI, MENG XIN, SUN AIHUI, XUE LIANG, LIU CHENG, WANG SHOUYU: "Real-time quantitative phase imaging based on transport of intensity equation with dual simultaneously recorded field of view", OPTICS LETTERS, vol. 41, no. 7, 1 April 2016 (2016-04-01), pages 1427 - 1430, XP055767932, ISSN: 0146-9592, DOI: 10.1364/OL.41.001427 * |
Cited By (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN113588034A (zh) * | 2021-07-29 | 2021-11-02 | 上海电力大学 | 一种变压器油中气体体积快速定量监测方法 |
CN113588034B (zh) * | 2021-07-29 | 2024-01-23 | 上海电力大学 | 一种变压器油中气体体积快速定量监测方法 |
CN114666480A (zh) * | 2022-03-28 | 2022-06-24 | 天津大学 | 基于相位信息的组合成像系统入射光线逐像素标定方法及装置 |
CN114666480B (zh) * | 2022-03-28 | 2023-12-22 | 天津大学 | 基于相位信息的组合成像系统入射光线逐像素标定方法及装置 |
Also Published As
Publication number | Publication date |
---|---|
CN110411981A (zh) | 2019-11-05 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
WO2020258434A1 (zh) | 一种基于tie的相位成像方法、装置及可读存储介质 | |
US10705326B2 (en) | Autofocus system for a computational microscope | |
JP6319329B2 (ja) | プレノプティック・カメラを使った表面属性の推定 | |
CN107255443B (zh) | 一种复杂环境下双目视觉传感器现场标定方法及装置 | |
US9679360B2 (en) | High-resolution light-field imaging | |
US8934721B2 (en) | Microscopic vision measurement method based on adaptive positioning of camera coordinate frame | |
CN107113370B (zh) | 图像记录设备及记录图像方法 | |
US20130293761A1 (en) | Image enhancement via calibrated lens simulation | |
JP2016024052A (ja) | 3次元計測システム、3次元計測方法及びプログラム | |
CN113568153B (zh) | 一种显微成像设备以及纳米尺度三维形貌测量系统 | |
JP2023134456A (ja) | マルチコアファイバイメージング | |
JP2022520258A (ja) | 波面の定量的測定のための顕微鏡、顕微鏡のためのモジュールおよびキット、波面の計算再構築のための方法およびコンピュータプログラム | |
Konda et al. | Parallelized aperture synthesis using multi-aperture Fourier ptychographic microscopy | |
Heydarian et al. | Three dimensional particle averaging for structural imaging of macromolecular complexes by localization microscopy | |
US20230073901A1 (en) | Systems and methods for performing multiple-wavelength quantitative phase imaging (qpi) | |
CN111063022B (zh) | 一种结合相位梯度与直接线性变换的相位体三维重建法 | |
JP4651550B2 (ja) | 三次元座標計測装置および方法 | |
US11385164B2 (en) | Method for calibrating an analysis device, and associated device | |
Li et al. | Rapid whole slide imaging via learning-based two-shot virtual autofocusing | |
Ishihara et al. | Depth estimation using spectrally varying defocus blur | |
JP2022044113A (ja) | 収差推定方法、収差推定装置、プログラム、及び記憶媒体 | |
CN111815544A (zh) | 一种数字全息频谱中心亚像素搜索方法 | |
Muhammad et al. | Calculating accurate window size for shape-from-focus | |
CN115060367B (zh) | 基于显微高光谱成像平台的全玻片数据立方体采集方法 | |
US20240137632A1 (en) | ENGINEERED POINT SPREAD FUNCTION (ePSF) OBJECTIVE LENSES |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 19935204 Country of ref document: EP Kind code of ref document: A1 |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 19935204 Country of ref document: EP Kind code of ref document: A1 |
|
32PN | Ep: public notification in the ep bulletin as address of the adressee cannot be established |
Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 12/04/2022) |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 19935204 Country of ref document: EP Kind code of ref document: A1 |