CN105389785A - Processing method of point spread function - Google Patents

Processing method of point spread function Download PDF

Info

Publication number
CN105389785A
CN105389785A CN201510960385.0A CN201510960385A CN105389785A CN 105389785 A CN105389785 A CN 105389785A CN 201510960385 A CN201510960385 A CN 201510960385A CN 105389785 A CN105389785 A CN 105389785A
Authority
CN
China
Prior art keywords
point spread
spread function
resolution
low
matrix
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201510960385.0A
Other languages
Chinese (zh)
Inventor
程涛
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Individual
Original Assignee
Individual
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Individual filed Critical Individual
Priority to CN201510960385.0A priority Critical patent/CN105389785A/en
Publication of CN105389785A publication Critical patent/CN105389785A/en
Pending legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00Image enhancement or restoration
    • G06T5/73Deblurring; Sharpening
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/10Image acquisition modality
    • G06T2207/10056Microscopic image
    • G06T2207/10061Microscopic image from scanning electron microscope

Landscapes

  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Microscoopes, Condenser (AREA)

Abstract

The invention discloses a processing method of a point spread function in the technical field of microscopes. A method for processing a measurement matrix composed of point spread functions and low-resolution images acquired and obtained by a microscope to obtain a high-resolution reconstructed image is provided. The method comprises the steps of performing one-dimensional processing for point spread functions to form vectors; composing the measurement matrix by using the point spread function vector at each high-resolution grid center in order; then processing the measurement matrix and the low-resolution images recorded by a recording camera based on the microscope; and finally reconstructing through a compression sensing reconstructing algorithm to obtain high-resolution images. The processing method of the point spread function lays a foundation for compression sensing based optical super-resolution micro-imaging of super-diffraction limit to develop from theoretical research to functionization.

Description

A kind of disposal route of point spread function
Technical field
The invention belongs to microscopy field, specifically provide a kind of disposal route of point spread function.
Background technology
Super-resolution micro-imaging can make human eye directly observe microprocess and the structure of amplification.Super-resolution micro-imaging is widely used and demand in fields such as biology, medical science, material, precision optical machinery and microelectronics, and the solution for each subject engineering and key scientific issues is significant.The optical microscope of visible light wave range has the advantage of noncontact, not damaged, detectable sample interior, is the important tool of research organ, tissue and cell.Due to the existence of diffraction limit, horizontal and vertical resolution only has 200nm and 500nm respectively.The optical ultra-discrimination micro-imaging theory and technology of super diffraction limit is the focus of research always.
The optical ultra-discrimination micro-imaging realizing super diffraction limit that appears as of compressed sensing technology provides possibility.The optical ultra-discrimination micro-imaging of current super diffraction limit can be avoided one or minority fluorescence molecule once can only to make the repetition tedious work of image acquisition by compressed sensing binding site spread function, thus save huge human and material resources, shorten the collection reconstruct cycle of super-resolution imaging, greatly improve temporal resolution, simplify history image file administration, reduce data volume, for noise process and control also can more simplify.
Summary of the invention
The present invention is in order to the low problem of MIcrosope image resolution, and spy provides a kind of disposal route of point spread function.
The present invention is achieved by following proposal: a kind of disposal route of point spread function, and the process of described method is:
Step one: based on experiment by Gaussian function or the microscopical point spread function of Bessel function fitting, the fine-resolution meshes that the low-resolution image y of microscopical image record cameras record divides pixel less;
Step 2: the source point being point spread function with each grid element center, the numerical value of measuring point spread function in each pixel of low-resolution image, then by end to end for the numerical value row or column in each pixel, formation one is based on the column vector Φ of point spread function j;
Step 3: based on the column vector Φ of the point spread function of all grid mid points of fine-resolution meshes jaccording to the matrix Φ of the end to end formation of all grid mid point row or column based on point spread function, wherein Φ ∈ R m × N, M < N, M and N are natural numbers, Φ jthe jth row of Φ;
The each row orthogonalization of step 4: Φ, then each row is unitization, and last Φ respectively arranges unitization, obtains matrix Φ p; Make Q=Φ pΦ ' (Φ Φ ') -1, matrix Φ s=Q Φ;
Step 5: by microscopical image record collected by camera record low-resolution image y;
Step 6: the low-resolution image y that microscope collects is processed by matrix Q:
y S=Qy;
Step 7: reconstruct real super-resolution image x by traditional signal reconstruction algorithm:
min||x|| 0s.t.y S=Φ Sx。
The present invention, by point spread function of one-dimensional, forms calculation matrix.Then by calculation matrix and low resolution image process, high-resolution reconstructed image is finally obtained.The method is greatly high signal reconstruction ability and resolution.Method of the present invention not only simplifies microscopical hardware design and realization, and improves signal reconstruction effect, has a wide range of applications in fields such as microscopical image procossing.
Accompanying drawing explanation
Fig. 1 is the process flow diagram of the disposal route of a kind of point spread function described in embodiment one; Fig. 2 applies embodiment based on OMP restructing algorithm to matrix Φ 169 × 4096, matrix size 169 × 4096, the Accurate Reconstruction probability before and after the process that process obtains and the graph of a relation of degree of rarefication; Fig. 3 applies embodiment based on BP restructing algorithm to matrix Φ 169 × 4096, matrix size 169 × 4096, the Accurate Reconstruction probability before and after the process that process obtains and the graph of a relation of degree of rarefication; Fig. 4 applies embodiment based on CVX restructing algorithm to matrix Φ 169 × 4096, matrix size 169 × 4096, the Accurate Reconstruction probability before and after the process that process obtains and the graph of a relation of degree of rarefication.
Embodiment
Embodiment one: illustrate present embodiment according to Figure of description 1.A disposal route for point spread function, the process of described method is:
Step one: based on experiment by Gaussian function or the microscopical point spread function of Bessel function fitting, the fine-resolution meshes that the low-resolution image y of microscopical image record cameras record divides pixel less;
Step 2: the source point being point spread function with each grid element center, the numerical value of measuring point spread function in each pixel of low-resolution image, then by end to end for the numerical value row or column in each pixel, formation one is based on the column vector Φ of point spread function j;
Step 3: based on the column vector Φ of the point spread function of all grid mid points of fine-resolution meshes jaccording to the matrix Φ of the end to end formation of all grid mid point row or column based on point spread function, wherein Φ ∈ R m × N, M < N, M and N are natural numbers, Φ jthe jth row of Φ;
The each row orthogonalization of step 4: Φ, then each row is unitization, and last Φ respectively arranges unitization, obtains matrix Φ p; Make Q=Φ pΦ ' (Φ Φ ') -1, matrix Φ s=Q Φ;
Step 5: by microscopical image record collected by camera record low-resolution image y;
Step 6: the low-resolution image y that microscope collects is processed by matrix Q:
y S=Qy;
Step 7: reconstruct real super-resolution image x by traditional signal reconstruction algorithm:
min||x|| 0s.t.y S=Φ Sx。
Embodiment two: this embodiment is further illustrating the disposal route of a kind of point spread function described in embodiment one, low-resolution image y large in step one can be the image of the arbitrary resolution that existing microscope adopts arbitrary resolution record collected by camera to obtain, y ∈ R m, x ∈ R n.
Embodiment three: illustrate present embodiment below in conjunction with Fig. 2-Fig. 4.Present embodiment adopts the gaussian signal of the different degree of rarefication corresponding matrix Φ for the treatment of front and back respectively 169 × 4096, matrix size 169 × 4096, the reconstruct SBR compared after its each 500 experiments is greater than the reconstruct probability of 90dB.Be with in Fig. 2 what mark is curve before process; Band what mark is curve after process.Fig. 2 represents the result of calculation of OMP restructing algorithm; The result of calculation of BP restructing algorithm is represented in Fig. 3; Fig. 4 represents the result of calculation of CVX restructing algorithm.
Experimental result as shown in figs 2-4.As seen from Figure 2, based on OMP restructing algorithm, the quality reconstruction curve after process is positioned at top before treatment, and quality reconstruction is better; Based on BP restructing algorithm, the quality reconstruction curve after process is positioned at top before treatment, and quality reconstruction is better; As seen from Figure 4, based on CVX restructing algorithm, the quality reconstruction curve after process is positioned at top before treatment, and quality reconstruction is better.

Claims (1)

1. a disposal route for point spread function, is characterized in that: the process of described method is:
Step one: based on experiment by Gaussian function or the microscopical point spread function of Bessel function fitting, the fine-resolution meshes that the low-resolution image y of microscopical image record cameras record divides pixel less;
Step 2: the source point being point spread function with each grid element center, the numerical value of measuring point spread function in each pixel of low-resolution image, then by end to end for the numerical value row or column in each pixel, formation one is based on the column vector Φ of point spread function j;
Step 3: based on the column vector Φ of the point spread function of all grid mid points of fine-resolution meshes jaccording to the matrix Φ of the end to end formation of all grid mid point row or column based on point spread function, wherein Φ ∈ R m × N, M < N, M and N are natural numbers, Φ jthe jth row of Φ;
The each row orthogonalization of step 4: Φ, then each row is unitization, and last Φ respectively arranges unitization, obtains matrix Φ p; Make Q=Φ pΦ ' (Φ Φ ') -1, matrix Φ s=Q Φ;
Step 5: by microscopical image record collected by camera record low-resolution image y;
Step 6: the low-resolution image y that microscope collects is processed by matrix Q:
y S=Qy;
Step 7: reconstruct real super-resolution image x by traditional signal reconstruction algorithm:
min||x|| 0s.t.y S=Φ Sx。
CN201510960385.0A 2015-12-21 2015-12-21 Processing method of point spread function Pending CN105389785A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201510960385.0A CN105389785A (en) 2015-12-21 2015-12-21 Processing method of point spread function

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201510960385.0A CN105389785A (en) 2015-12-21 2015-12-21 Processing method of point spread function

Publications (1)

Publication Number Publication Date
CN105389785A true CN105389785A (en) 2016-03-09

Family

ID=55422038

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201510960385.0A Pending CN105389785A (en) 2015-12-21 2015-12-21 Processing method of point spread function

Country Status (1)

Country Link
CN (1) CN105389785A (en)

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108088660A (en) * 2017-12-15 2018-05-29 清华大学 The point spread function measuring method and system of wide field fluorescence microscope
CN109146790A (en) * 2018-08-27 2019-01-04 深圳大学 A kind of image reconstructing method, device, electronic equipment and storage medium
CN110852945A (en) * 2019-10-30 2020-02-28 华中科技大学 High-resolution image acquisition method for biological sample
CN111123538A (en) * 2019-09-17 2020-05-08 印象认知(北京)科技有限公司 Image processing method and method for adjusting diffraction screen structure based on point spread function
CN113992840A (en) * 2021-09-15 2022-01-28 中国航天科工集团第二研究院 Large-view-field high-resolution imaging method and device based on compressed sensing
CN115586638A (en) * 2022-10-10 2023-01-10 长春理工大学 Point spread function construction method of visible light broadband system containing single-layer diffraction element

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101980289A (en) * 2010-10-25 2011-02-23 上海大学 Frequency domain registration and convex set projection-based multi-frame image super-resolution reconstruction method
CN102622331A (en) * 2012-02-10 2012-08-01 程涛 Compressive sensing based Gaussian matrix optimizing method
CN105049831A (en) * 2014-03-18 2015-11-11 辉达公司 Superresolution display using cascaded panels

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101980289A (en) * 2010-10-25 2011-02-23 上海大学 Frequency domain registration and convex set projection-based multi-frame image super-resolution reconstruction method
CN102622331A (en) * 2012-02-10 2012-08-01 程涛 Compressive sensing based Gaussian matrix optimizing method
CN105049831A (en) * 2014-03-18 2015-11-11 辉达公司 Superresolution display using cascaded panels

Non-Patent Citations (3)

* Cited by examiner, † Cited by third party
Title
LEI ZHU 等: "Faster STORM Using Compressed Sensing", 《NAT METHODS》 *
江月松 等: "点扩散函数的一维数值计算及其MATLAB实现", 《红外与激光工程》 *
程涛 等: "压缩感知的等效二维稀疏变换", 《半导体光电》 *

Cited By (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108088660A (en) * 2017-12-15 2018-05-29 清华大学 The point spread function measuring method and system of wide field fluorescence microscope
CN108088660B (en) * 2017-12-15 2019-10-29 清华大学 The point spread function measurement method and system of wide field fluorescence microscope
CN109146790A (en) * 2018-08-27 2019-01-04 深圳大学 A kind of image reconstructing method, device, electronic equipment and storage medium
CN109146790B (en) * 2018-08-27 2022-10-11 深圳大学 Image reconstruction method and device, electronic equipment and storage medium
CN111123538A (en) * 2019-09-17 2020-05-08 印象认知(北京)科技有限公司 Image processing method and method for adjusting diffraction screen structure based on point spread function
CN111123538B (en) * 2019-09-17 2022-04-05 印象认知(北京)科技有限公司 Image processing method and method for adjusting diffraction screen structure based on point spread function
CN110852945A (en) * 2019-10-30 2020-02-28 华中科技大学 High-resolution image acquisition method for biological sample
CN110852945B (en) * 2019-10-30 2021-06-11 华中科技大学 High-resolution image acquisition method for biological sample
CN113992840A (en) * 2021-09-15 2022-01-28 中国航天科工集团第二研究院 Large-view-field high-resolution imaging method and device based on compressed sensing
CN113992840B (en) * 2021-09-15 2023-06-23 中国航天科工集团第二研究院 Large-view-field high-resolution imaging method and device based on compressed sensing
CN115586638A (en) * 2022-10-10 2023-01-10 长春理工大学 Point spread function construction method of visible light broadband system containing single-layer diffraction element

Similar Documents

Publication Publication Date Title
CN105389785A (en) Processing method of point spread function
Ford et al. Fast optically sectioned fluorescence HiLo endomicroscopy
Fang et al. Minutes-timescale 3D isotropic imaging of entire organs at subcellular resolution by content-aware compressed-sensing light-sheet microscopy
DE60224392T2 (en) THREE-DIMENSIONAL ILLUSTRATION OF INDIVIDUAL PARTICLES
US11815474B2 (en) Method for accurately characterizing crystal three-dimensional orientation and crystallographic orientation
CN114331840B (en) Method and device for reconstructing high-fidelity super-resolution microscopic image
Wan et al. Progressive residual networks for image super-resolution
CN105528761B (en) A kind of super-resolution reconstructing method of micro-image
Rasmi et al. Limited-view light sheet fluorescence microscopy for three dimensional volume imaging
Duanmu et al. The image super-resolution algorithm based on the dense space attention network
de Vieilleville et al. Alternating direction method of multipliers applied to 3d light sheet fluorescence microscopy image deblurring using gpu hardware
Bhandary et al. Double U-Net for Super-Resolution and Segmentation of Live Cell Images
Anandasabapathy et al. An optical, endoscopic brush for high-yield diagnostics in esophageal cancer
Li et al. Micro-CT imaging of super-resolution MBIR algorithm based on sub-pixel displacement
He et al. High-speed optical diffraction tomography for high throughput cell imaging applications
Zhou et al. Deep learning for super-resolution localization microscopy
Bouffard et al. Multi-step reinforcement learning for medical image super-resolution
Purnapatra et al. Generation of extended light-sheets for single and multi-photon fluorescence microscopy
Chao et al. Remote focusing multifocal plane microscopy for the imaging of 3D single molecule dynamics with cellular context
CN105844699B (en) Fluorescence microscope images three-dimensional rebuilding method and system based on compound Regularization Technique
Du et al. Super-Resolution Fiber-Bundle Light Field Endoscopy
Li et al. Spectrum learning for super-resolution tomographic reconstruction
Zhou et al. Polarized hyperspectral microscopic imaging for collagen visualization on pathologic slides of head and neck squamous cell carcinoma
Jiang et al. Multi-channel super-resolution with Fourier ptychographic microscopy
Cao et al. Microscopic neural image registration based on the structure of mitochondria

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
WD01 Invention patent application deemed withdrawn after publication

Application publication date: 20160309

WD01 Invention patent application deemed withdrawn after publication