CN105389785A - Processing method of point spread function - Google Patents
Processing method of point spread function Download PDFInfo
- Publication number
- CN105389785A CN105389785A CN201510960385.0A CN201510960385A CN105389785A CN 105389785 A CN105389785 A CN 105389785A CN 201510960385 A CN201510960385 A CN 201510960385A CN 105389785 A CN105389785 A CN 105389785A
- Authority
- CN
- China
- Prior art keywords
- point spread
- spread function
- resolution
- low
- matrix
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000003672 processing method Methods 0.000 title abstract 3
- 239000011159 matrix material Substances 0.000 claims abstract description 25
- 238000000034 method Methods 0.000 claims abstract description 24
- 239000013598 vector Substances 0.000 claims abstract description 8
- 230000015572 biosynthetic process Effects 0.000 claims description 6
- 238000002474 experimental method Methods 0.000 claims description 4
- 238000003384 imaging method Methods 0.000 abstract description 7
- 230000003287 optical effect Effects 0.000 abstract description 6
- 238000005259 measurement Methods 0.000 abstract 3
- 230000006835 compression Effects 0.000 abstract 2
- 238000007906 compression Methods 0.000 abstract 2
- 238000004364 calculation method Methods 0.000 description 5
- 238000005516 engineering process Methods 0.000 description 3
- 239000000463 material Substances 0.000 description 2
- 230000003321 amplification Effects 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000004377 microelectronic Methods 0.000 description 1
- 238000000386 microscopy Methods 0.000 description 1
- 238000003199 nucleic acid amplification method Methods 0.000 description 1
- 210000000056 organ Anatomy 0.000 description 1
- 230000002123 temporal effect Effects 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T5/00—Image enhancement or restoration
- G06T5/73—Deblurring; Sharpening
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10056—Microscopic image
- G06T2207/10061—Microscopic image from scanning electron microscope
Landscapes
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Microscoopes, Condenser (AREA)
Abstract
The invention discloses a processing method of a point spread function in the technical field of microscopes. A method for processing a measurement matrix composed of point spread functions and low-resolution images acquired and obtained by a microscope to obtain a high-resolution reconstructed image is provided. The method comprises the steps of performing one-dimensional processing for point spread functions to form vectors; composing the measurement matrix by using the point spread function vector at each high-resolution grid center in order; then processing the measurement matrix and the low-resolution images recorded by a recording camera based on the microscope; and finally reconstructing through a compression sensing reconstructing algorithm to obtain high-resolution images. The processing method of the point spread function lays a foundation for compression sensing based optical super-resolution micro-imaging of super-diffraction limit to develop from theoretical research to functionization.
Description
Technical field
The invention belongs to microscopy field, specifically provide a kind of disposal route of point spread function.
Background technology
Super-resolution micro-imaging can make human eye directly observe microprocess and the structure of amplification.Super-resolution micro-imaging is widely used and demand in fields such as biology, medical science, material, precision optical machinery and microelectronics, and the solution for each subject engineering and key scientific issues is significant.The optical microscope of visible light wave range has the advantage of noncontact, not damaged, detectable sample interior, is the important tool of research organ, tissue and cell.Due to the existence of diffraction limit, horizontal and vertical resolution only has 200nm and 500nm respectively.The optical ultra-discrimination micro-imaging theory and technology of super diffraction limit is the focus of research always.
The optical ultra-discrimination micro-imaging realizing super diffraction limit that appears as of compressed sensing technology provides possibility.The optical ultra-discrimination micro-imaging of current super diffraction limit can be avoided one or minority fluorescence molecule once can only to make the repetition tedious work of image acquisition by compressed sensing binding site spread function, thus save huge human and material resources, shorten the collection reconstruct cycle of super-resolution imaging, greatly improve temporal resolution, simplify history image file administration, reduce data volume, for noise process and control also can more simplify.
Summary of the invention
The present invention is in order to the low problem of MIcrosope image resolution, and spy provides a kind of disposal route of point spread function.
The present invention is achieved by following proposal: a kind of disposal route of point spread function, and the process of described method is:
Step one: based on experiment by Gaussian function or the microscopical point spread function of Bessel function fitting, the fine-resolution meshes that the low-resolution image y of microscopical image record cameras record divides pixel less;
Step 2: the source point being point spread function with each grid element center, the numerical value of measuring point spread function in each pixel of low-resolution image, then by end to end for the numerical value row or column in each pixel, formation one is based on the column vector Φ of point spread function
j;
Step 3: based on the column vector Φ of the point spread function of all grid mid points of fine-resolution meshes
jaccording to the matrix Φ of the end to end formation of all grid mid point row or column based on point spread function, wherein Φ ∈ R
m × N, M < N, M and N are natural numbers, Φ
jthe jth row of Φ;
The each row orthogonalization of step 4: Φ, then each row is unitization, and last Φ respectively arranges unitization, obtains matrix Φ
p; Make Q=Φ
pΦ ' (Φ Φ ')
-1, matrix Φ
s=Q Φ;
Step 5: by microscopical image record collected by camera record low-resolution image y;
Step 6: the low-resolution image y that microscope collects is processed by matrix Q:
y
S=Qy;
Step 7: reconstruct real super-resolution image x by traditional signal reconstruction algorithm:
min||x||
0s.t.y
S=Φ
Sx。
The present invention, by point spread function of one-dimensional, forms calculation matrix.Then by calculation matrix and low resolution image process, high-resolution reconstructed image is finally obtained.The method is greatly high signal reconstruction ability and resolution.Method of the present invention not only simplifies microscopical hardware design and realization, and improves signal reconstruction effect, has a wide range of applications in fields such as microscopical image procossing.
Accompanying drawing explanation
Fig. 1 is the process flow diagram of the disposal route of a kind of point spread function described in embodiment one; Fig. 2 applies embodiment based on OMP restructing algorithm to matrix Φ
169 × 4096, matrix size 169 × 4096, the Accurate Reconstruction probability before and after the process that process obtains and the graph of a relation of degree of rarefication; Fig. 3 applies embodiment based on BP restructing algorithm to matrix Φ
169 × 4096, matrix size 169 × 4096, the Accurate Reconstruction probability before and after the process that process obtains and the graph of a relation of degree of rarefication; Fig. 4 applies embodiment based on CVX restructing algorithm to matrix Φ
169 × 4096, matrix size 169 × 4096, the Accurate Reconstruction probability before and after the process that process obtains and the graph of a relation of degree of rarefication.
Embodiment
Embodiment one: illustrate present embodiment according to Figure of description 1.A disposal route for point spread function, the process of described method is:
Step one: based on experiment by Gaussian function or the microscopical point spread function of Bessel function fitting, the fine-resolution meshes that the low-resolution image y of microscopical image record cameras record divides pixel less;
Step 2: the source point being point spread function with each grid element center, the numerical value of measuring point spread function in each pixel of low-resolution image, then by end to end for the numerical value row or column in each pixel, formation one is based on the column vector Φ of point spread function
j;
Step 3: based on the column vector Φ of the point spread function of all grid mid points of fine-resolution meshes
jaccording to the matrix Φ of the end to end formation of all grid mid point row or column based on point spread function, wherein Φ ∈ R
m × N, M < N, M and N are natural numbers, Φ
jthe jth row of Φ;
The each row orthogonalization of step 4: Φ, then each row is unitization, and last Φ respectively arranges unitization, obtains matrix Φ
p; Make Q=Φ
pΦ ' (Φ Φ ')
-1, matrix Φ
s=Q Φ;
Step 5: by microscopical image record collected by camera record low-resolution image y;
Step 6: the low-resolution image y that microscope collects is processed by matrix Q:
y
S=Qy;
Step 7: reconstruct real super-resolution image x by traditional signal reconstruction algorithm:
min||x||
0s.t.y
S=Φ
Sx。
Embodiment two: this embodiment is further illustrating the disposal route of a kind of point spread function described in embodiment one, low-resolution image y large in step one can be the image of the arbitrary resolution that existing microscope adopts arbitrary resolution record collected by camera to obtain, y ∈ R
m, x ∈ R
n.
Embodiment three: illustrate present embodiment below in conjunction with Fig. 2-Fig. 4.Present embodiment adopts the gaussian signal of the different degree of rarefication corresponding matrix Φ for the treatment of front and back respectively
169 × 4096, matrix size 169 × 4096, the reconstruct SBR compared after its each 500 experiments is greater than the reconstruct probability of 90dB.Be with in Fig. 2
what mark is curve before process; Band
what mark is curve after process.Fig. 2 represents the result of calculation of OMP restructing algorithm; The result of calculation of BP restructing algorithm is represented in Fig. 3; Fig. 4 represents the result of calculation of CVX restructing algorithm.
Experimental result as shown in figs 2-4.As seen from Figure 2, based on OMP restructing algorithm, the quality reconstruction curve after process is positioned at top before treatment, and quality reconstruction is better; Based on BP restructing algorithm, the quality reconstruction curve after process is positioned at top before treatment, and quality reconstruction is better; As seen from Figure 4, based on CVX restructing algorithm, the quality reconstruction curve after process is positioned at top before treatment, and quality reconstruction is better.
Claims (1)
1. a disposal route for point spread function, is characterized in that: the process of described method is:
Step one: based on experiment by Gaussian function or the microscopical point spread function of Bessel function fitting, the fine-resolution meshes that the low-resolution image y of microscopical image record cameras record divides pixel less;
Step 2: the source point being point spread function with each grid element center, the numerical value of measuring point spread function in each pixel of low-resolution image, then by end to end for the numerical value row or column in each pixel, formation one is based on the column vector Φ of point spread function
j;
Step 3: based on the column vector Φ of the point spread function of all grid mid points of fine-resolution meshes
jaccording to the matrix Φ of the end to end formation of all grid mid point row or column based on point spread function, wherein Φ ∈ R
m × N, M < N, M and N are natural numbers, Φ
jthe jth row of Φ;
The each row orthogonalization of step 4: Φ, then each row is unitization, and last Φ respectively arranges unitization, obtains matrix Φ
p; Make Q=Φ
pΦ ' (Φ Φ ')
-1, matrix Φ
s=Q Φ;
Step 5: by microscopical image record collected by camera record low-resolution image y;
Step 6: the low-resolution image y that microscope collects is processed by matrix Q:
y
S=Qy;
Step 7: reconstruct real super-resolution image x by traditional signal reconstruction algorithm:
min||x||
0s.t.y
S=Φ
Sx。
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201510960385.0A CN105389785A (en) | 2015-12-21 | 2015-12-21 | Processing method of point spread function |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201510960385.0A CN105389785A (en) | 2015-12-21 | 2015-12-21 | Processing method of point spread function |
Publications (1)
Publication Number | Publication Date |
---|---|
CN105389785A true CN105389785A (en) | 2016-03-09 |
Family
ID=55422038
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201510960385.0A Pending CN105389785A (en) | 2015-12-21 | 2015-12-21 | Processing method of point spread function |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN105389785A (en) |
Cited By (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN108088660A (en) * | 2017-12-15 | 2018-05-29 | 清华大学 | The point spread function measuring method and system of wide field fluorescence microscope |
CN109146790A (en) * | 2018-08-27 | 2019-01-04 | 深圳大学 | A kind of image reconstructing method, device, electronic equipment and storage medium |
CN110852945A (en) * | 2019-10-30 | 2020-02-28 | 华中科技大学 | High-resolution image acquisition method for biological sample |
CN111123538A (en) * | 2019-09-17 | 2020-05-08 | 印象认知(北京)科技有限公司 | Image processing method and method for adjusting diffraction screen structure based on point spread function |
CN113992840A (en) * | 2021-09-15 | 2022-01-28 | 中国航天科工集团第二研究院 | Large-view-field high-resolution imaging method and device based on compressed sensing |
CN115586638A (en) * | 2022-10-10 | 2023-01-10 | 长春理工大学 | Point spread function construction method of visible light broadband system containing single-layer diffraction element |
Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN101980289A (en) * | 2010-10-25 | 2011-02-23 | 上海大学 | Frequency domain registration and convex set projection-based multi-frame image super-resolution reconstruction method |
CN102622331A (en) * | 2012-02-10 | 2012-08-01 | 程涛 | Compressive sensing based Gaussian matrix optimizing method |
CN105049831A (en) * | 2014-03-18 | 2015-11-11 | 辉达公司 | Superresolution display using cascaded panels |
-
2015
- 2015-12-21 CN CN201510960385.0A patent/CN105389785A/en active Pending
Patent Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN101980289A (en) * | 2010-10-25 | 2011-02-23 | 上海大学 | Frequency domain registration and convex set projection-based multi-frame image super-resolution reconstruction method |
CN102622331A (en) * | 2012-02-10 | 2012-08-01 | 程涛 | Compressive sensing based Gaussian matrix optimizing method |
CN105049831A (en) * | 2014-03-18 | 2015-11-11 | 辉达公司 | Superresolution display using cascaded panels |
Non-Patent Citations (3)
Title |
---|
LEI ZHU 等: "Faster STORM Using Compressed Sensing", 《NAT METHODS》 * |
江月松 等: "点扩散函数的一维数值计算及其MATLAB实现", 《红外与激光工程》 * |
程涛 等: "压缩感知的等效二维稀疏变换", 《半导体光电》 * |
Cited By (11)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN108088660A (en) * | 2017-12-15 | 2018-05-29 | 清华大学 | The point spread function measuring method and system of wide field fluorescence microscope |
CN108088660B (en) * | 2017-12-15 | 2019-10-29 | 清华大学 | The point spread function measurement method and system of wide field fluorescence microscope |
CN109146790A (en) * | 2018-08-27 | 2019-01-04 | 深圳大学 | A kind of image reconstructing method, device, electronic equipment and storage medium |
CN109146790B (en) * | 2018-08-27 | 2022-10-11 | 深圳大学 | Image reconstruction method and device, electronic equipment and storage medium |
CN111123538A (en) * | 2019-09-17 | 2020-05-08 | 印象认知(北京)科技有限公司 | Image processing method and method for adjusting diffraction screen structure based on point spread function |
CN111123538B (en) * | 2019-09-17 | 2022-04-05 | 印象认知(北京)科技有限公司 | Image processing method and method for adjusting diffraction screen structure based on point spread function |
CN110852945A (en) * | 2019-10-30 | 2020-02-28 | 华中科技大学 | High-resolution image acquisition method for biological sample |
CN110852945B (en) * | 2019-10-30 | 2021-06-11 | 华中科技大学 | High-resolution image acquisition method for biological sample |
CN113992840A (en) * | 2021-09-15 | 2022-01-28 | 中国航天科工集团第二研究院 | Large-view-field high-resolution imaging method and device based on compressed sensing |
CN113992840B (en) * | 2021-09-15 | 2023-06-23 | 中国航天科工集团第二研究院 | Large-view-field high-resolution imaging method and device based on compressed sensing |
CN115586638A (en) * | 2022-10-10 | 2023-01-10 | 长春理工大学 | Point spread function construction method of visible light broadband system containing single-layer diffraction element |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN105389785A (en) | Processing method of point spread function | |
Ford et al. | Fast optically sectioned fluorescence HiLo endomicroscopy | |
Fang et al. | Minutes-timescale 3D isotropic imaging of entire organs at subcellular resolution by content-aware compressed-sensing light-sheet microscopy | |
DE60224392T2 (en) | THREE-DIMENSIONAL ILLUSTRATION OF INDIVIDUAL PARTICLES | |
US11815474B2 (en) | Method for accurately characterizing crystal three-dimensional orientation and crystallographic orientation | |
CN114331840B (en) | Method and device for reconstructing high-fidelity super-resolution microscopic image | |
Wan et al. | Progressive residual networks for image super-resolution | |
CN105528761B (en) | A kind of super-resolution reconstructing method of micro-image | |
Rasmi et al. | Limited-view light sheet fluorescence microscopy for three dimensional volume imaging | |
Duanmu et al. | The image super-resolution algorithm based on the dense space attention network | |
de Vieilleville et al. | Alternating direction method of multipliers applied to 3d light sheet fluorescence microscopy image deblurring using gpu hardware | |
Bhandary et al. | Double U-Net for Super-Resolution and Segmentation of Live Cell Images | |
Anandasabapathy et al. | An optical, endoscopic brush for high-yield diagnostics in esophageal cancer | |
Li et al. | Micro-CT imaging of super-resolution MBIR algorithm based on sub-pixel displacement | |
He et al. | High-speed optical diffraction tomography for high throughput cell imaging applications | |
Zhou et al. | Deep learning for super-resolution localization microscopy | |
Bouffard et al. | Multi-step reinforcement learning for medical image super-resolution | |
Purnapatra et al. | Generation of extended light-sheets for single and multi-photon fluorescence microscopy | |
Chao et al. | Remote focusing multifocal plane microscopy for the imaging of 3D single molecule dynamics with cellular context | |
CN105844699B (en) | Fluorescence microscope images three-dimensional rebuilding method and system based on compound Regularization Technique | |
Du et al. | Super-Resolution Fiber-Bundle Light Field Endoscopy | |
Li et al. | Spectrum learning for super-resolution tomographic reconstruction | |
Zhou et al. | Polarized hyperspectral microscopic imaging for collagen visualization on pathologic slides of head and neck squamous cell carcinoma | |
Jiang et al. | Multi-channel super-resolution with Fourier ptychographic microscopy | |
Cao et al. | Microscopic neural image registration based on the structure of mitochondria |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
C06 | Publication | ||
PB01 | Publication | ||
C10 | Entry into substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20160309 |
|
WD01 | Invention patent application deemed withdrawn after publication |