CN109146790A - A kind of image reconstructing method, device, electronic equipment and storage medium - Google Patents
A kind of image reconstructing method, device, electronic equipment and storage medium Download PDFInfo
- Publication number
- CN109146790A CN109146790A CN201810982770.9A CN201810982770A CN109146790A CN 109146790 A CN109146790 A CN 109146790A CN 201810982770 A CN201810982770 A CN 201810982770A CN 109146790 A CN109146790 A CN 109146790A
- Authority
- CN
- China
- Prior art keywords
- image
- digital template
- formula
- integral
- row
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 32
- 230000006870 function Effects 0.000 claims description 33
- 238000003384 imaging method Methods 0.000 claims description 17
- 239000011159 matrix material Substances 0.000 claims description 15
- 238000004891 communication Methods 0.000 claims description 11
- 238000012545 processing Methods 0.000 claims description 9
- 230000002123 temporal effect Effects 0.000 abstract description 8
- 238000004458 analytical method Methods 0.000 abstract description 3
- 230000007246 mechanism Effects 0.000 abstract description 3
- 230000008569 process Effects 0.000 abstract description 3
- 239000000523 sample Substances 0.000 description 18
- 238000000386 microscopy Methods 0.000 description 8
- 238000005516 engineering process Methods 0.000 description 5
- 238000010168 coupling process Methods 0.000 description 3
- 238000005859 coupling reaction Methods 0.000 description 3
- 230000001413 cellular effect Effects 0.000 description 2
- 230000008878 coupling Effects 0.000 description 2
- 238000010586 diagram Methods 0.000 description 2
- 238000005286 illumination Methods 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 230000002186 photoactivation Effects 0.000 description 2
- 239000000126 substance Substances 0.000 description 2
- 238000010870 STED microscopy Methods 0.000 description 1
- 230000004913 activation Effects 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 230000005779 cell damage Effects 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 230000005284 excitation Effects 0.000 description 1
- 230000004807 localization Effects 0.000 description 1
- 230000009022 nonlinear effect Effects 0.000 description 1
- 238000005192 partition Methods 0.000 description 1
- 230000000737 periodic effect Effects 0.000 description 1
- 230000005855 radiation Effects 0.000 description 1
- 238000000926 separation method Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T3/00—Geometric image transformations in the plane of the image
- G06T3/40—Scaling of whole images or parts thereof, e.g. expanding or contracting
- G06T3/4053—Scaling of whole images or parts thereof, e.g. expanding or contracting based on super-resolution, i.e. the output image resolution being higher than the sensor resolution
Landscapes
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Image Processing (AREA)
- Microscoopes, Condenser (AREA)
Abstract
The invention discloses a kind of image reconstructing method, device, electronic equipment and storage mediums, can obtain the wide-field image I of the single frames of the target sample of microscopic system acquisition0And it is arranged and wide-field image I0The identical digital template P of sizei, wherein i=1 ... N；According to formula Ii=I0*Pi, calculate digital template PiCorresponding light distribution Ii；According to formula Ti=∫ Ii, calculate light distribution IiIntegral Ti；Obtain the point spread function H of microscopic system；Based on formulaWith known integral Ti, point spread function H and digital template Pi, acquire unknown super resolution image S, according to the solutions of the embodiments of the present invention, the image that microscopic system only needs to acquire single frames can carry out image reconstruction and obtain super resolution image S, the temporal resolution for greatly improving image taking speed and algorithm facilitates look at the dynamic changing process of the cell interior component of target sample and carries out mechanism analysis.
Description
Technical field
The present invention relates to field of image processings more particularly to a kind of image reconstructing method, device, electronic equipment and storage to be situated between
Matter.
Background technique
In the past 20 years, with the breakthrough of diffraction limit, the development of technology and fluorescence probe, super-resolution microtechnic is
As the movable important method of observational study biological cell.It is broadly divided into three kinds from principle: the first is to utilize fluorescence
The unimolecule positioning and imaging method of substance switching effect, such as photoactivation position microscopy (Photoactivated
Localization Microscopy, PALM) and random optical reconstruct microscopy (Stochastic Optical
Reconstruction Microscopy, STORM).After sample is marked by fluorescence probe, with a branch of activation photoactivation fluorescence point
Son, another wavelength excitation fluorescent molecule are simultaneously imaged.But both technologies require to acquire many width original images, time
Resolution ratio is low；Second is the microscopy reduced to point spread function based on fluorescence nonlinear effect.Typical technology represents
For stimulated emission depletion microscopy (Stimulated Emission Depletion, STED).Beam of laser excites fluorescence point
Son, a branch of annular loss light will excite the fluorescence of light spot focus periphery to wipe, to limit the place that stimulated radiation occurs, subtract
Small point spread function improves resolution ratio.STED uses spot scan, is unfavorable for the imaging of large area, temporal resolution is low.And it needs
It is just able to achieve high spatial resolution with the higher loss light of power, but will cause photobleaching and cellular damage in this way；Third
Kind is Structured Illumination microscopy (Structured Illumination Microscopy, SIM).With periodic structure light
Irradiate the sample that is fluorescently labeled, the spatial frequency of sample and the different place of the spatial frequency of lighting pattern can generate not
That striped, the spatial frequency of sample can be solved according to the frequency of known lighting pattern.This microscopy belong to wide field at
Picture, it also requires acquisition multiple image, temporal resolution are low.Generally speaking, the typical super-resolution microtechnic of these types is all deposited
In a common disadvantage: image taking speed is slow, and temporal resolution is all relatively low, is unfavorable for realizing the dynamic sight to cellular informatics
It examines.
Summary of the invention
The main purpose of the embodiment of the present invention is to provide a kind of image reconstructing method, device, electronic equipment and storage and is situated between
Matter promotes the image taking speed and temporal resolution of super-resolution microtechnic.
To achieve the above object, first aspect of the embodiment of the present invention provides a kind of image reconstructing method, the image reconstruction side
Method includes:
Obtain the wide-field image I of the single frames of the target sample of microscopic system acquisition0；
Setting and the wide-field image I0The identical digital template P of sizei, wherein i=1 ... N；
According to formula Ii=I0*Pi, calculate the digital template PiCorresponding light distribution Ii, the * expression dot product；
According to formula Ti=∫ Ii, calculate the light distribution IiIntegral Ti；
Obtain the point spread function H of the microscopic system；
Based on the integral Ti, the point spread function H, the digital template PiAnd formula
Obtain super resolution image S, wherein describedIndicate convolution.
To achieve the above object, second aspect of the embodiment of the present invention provides a kind of image reconstruction device, which includes:
First obtains module, the wide-field image I of the single frames of the target sample for obtaining microscopic system acquisition0；
Setup module, for being arranged and the wide-field image I0The identical digital template P of sizei, wherein i=1 ... N；
First computing module, for according to formula Ii=I0*Pi, calculate the digital template PiCorresponding light distribution Ii,
The * indicates dot product；
Second computing module, for according to formula Ti=∫ Ii, calculate the light distribution IiIntegral Ti；
Second obtains module, for obtaining the point spread function H of the microscopic system；
Processing module, for being based on the integral Ti, the point spread function H, the digital template PiAnd formulaObtain super resolution image S, wherein describedIndicate convolution.
To achieve the above object, the third aspect of the embodiment of the present invention provides a kind of electronic equipment, which includes:
It includes: processor, memory and communication bus；
The communication bus is for realizing the connection communication between the processor and the memory；
For storing one or more programs, the processor is used to executing to be stored the memory in the memory
One or more program, to realize such as the step of above-mentioned image reconstructing method.
To achieve the above object, fourth aspect of the embodiment of the present invention provides a kind of storage medium, which is stored with
One or more program, one or more of programs can be executed by one or more processor, to realize as above-mentioned
Image reconstructing method the step of.
The embodiment of the invention provides a kind of image reconstructing method, device, electronic equipment and storage mediums, can obtain micro-
The wide-field image I of the single frames of the target sample of mirror system acquisition0, it is arranged and the wide-field image I0The identical digital mould of size
Plate Pi, wherein i=1 ... N；According to formula Ii=I0*Pi, calculate the digital template PiCorresponding light distribution Ii；According to formula
Ti=∫ Ii, calculate the light distribution IiIntegral Ti；Obtain the point spread function H of the microscopic system；Based on formulaWith known integral Ti, point spread function H and digital template Pi, acquire unknown super resolution image S,
According to the solutions of the embodiments of the present invention, it is only necessary to which the image of microscopic system acquisition single frames can carry out image reconstruction and obtain oversubscription
It distinguishes image S, greatly improves the temporal resolution of image taking speed and algorithm, facilitate look at the cell interior group of target sample
At the dynamic changing process and progress mechanism analysis of substance.
Detailed description of the invention
In order to more clearly explain the embodiment of the invention or the technical proposal in the existing technology, to embodiment or will show below
There is attached drawing needed in technical description to be briefly described, it should be apparent that, the accompanying drawings in the following description is only this
Some embodiments of invention for those skilled in the art without creative efforts, can also basis
These attached drawings obtain other attached drawings.
Fig. 1 is a kind of flow diagram of image reconstructing method in the embodiment of the present invention；
Fig. 2 is a kind of structural schematic diagram of image reconstruction device in the embodiment of the present invention.
Specific embodiment
In order to make the invention's purpose, features and advantages of the invention more obvious and easy to understand, below in conjunction with the present invention
Attached drawing in embodiment, technical scheme in the embodiment of the invention is clearly and completely described, it is clear that described reality
Applying example is only a part of the embodiment of the present invention, and not all embodiments.Based on the embodiments of the present invention, those skilled in the art
Member's every other embodiment obtained without making creative work, shall fall within the protection scope of the present invention.
That there are image taking speeds is slow for super-resolution microtechnic in the prior art, and the lower disadvantage of temporal resolution is unfavorable for
Realize that in order to solve the problems in the prior art, the embodiment of the present invention proposes a kind of image weight to the dynamic observation of cellular informatics
Structure method, referring to Fig. 1, which includes:
The wide-field image I of the single frames for the target sample that step 101, acquisition microscopic system acquire0；
In the present embodiment microscopic system include microscope and with the microscope in conjunction with obtaining microscope imaging image
Camera.In the present embodiment, camera can be CCD camera or CMOS camera, the present embodiment are not limited in this respect.
The image reconstructing method of the present embodiment can be to be realized by terminal, which includes but is not limited to that such as mobile phone is mobile
Terminal and such as computer fixed terminal.The wide field figure of the single frames of the target sample of microscopic system acquisition is obtained in step 101
As I0It include: the wide-field image I for receiving the single frames for the target sample that camera is sent in microscopic system0。
Wherein, the original wide-field image I of the present embodiment0The point for being considered as super resolution image S and microscopic system expands
Dissipate function H convolution after as a result, i.e.WhereinIndicate convolution algorithm.
Step 102, setting and wide-field image I0The identical digital template P of sizei, wherein i=1 ... N；
Step 103, according to formula Ii=I0*Pi, calculate digital template PiCorresponding light distribution Ii, wherein * indicates point
Multiply；
In the present embodiment, wide-field image I0Size and N number of digital template PiSize it is identical, i.e. wide-field image I0Square
Battle array and digital template PiMatrix line number having the same and columns.Digital template PiWith wide-field image I0Dot product, actually
PiMatrix and I0Matrix in same position element multiplication.
It willSubstitute into formula Ii=I0*Pi, and carry out that available I is unfoldedi(x, y)=[∫ ∫ S (u, v) H (x-u,
y-v)dudv]Pi(x, y), wherein (x, y) indicates to shoot wide-field image I in microscopic system0Camera imaging plane on
Coordinate (what is established on the imaging plane of camera is xy coordinate system)；(u, v) indicate target sample coordinate (target in the plane
What sample was established in the plane is uv coordinate system).
Step 104, according to formula Ti=∫ Ii, calculate light distribution IiIntegral Ti；
Specifically, according to known I0And Pi, calculate and digital template PiCorresponding light distribution IiIntegral Ti.Another party
Face, by Ii(x, y)=[∫ ∫ S (u, v) H (x-u, y-v) dudv] Pi(x, y) substitutes into Ti=∫ Ii, obtain integral TiExpression formula are as follows:
Ti=∫ Ii=∫ ∫ (∫ ∫ S (u, v) H (x-u, y-v) dudv) Pi(x,y)dxdy
To formula Ti=∫ Ii=∫ ∫ (∫ ∫ S (u, v) H (x-u, y-v) dudv) Pi(x, y) dxdy deform available:
Ti=∫ ∫ (∫ ∫ S (u, v) H (x-u, y-v) dudv) Pi(x,y)dxdy
=∫ ∫ S (u, v) dudv (∫ ∫ Pi(x,y)H(x-u,y-v)dxdy)
It is assumed that a new light distributionThat is light distribution I 'iIt is expressed as digital template PiWith
Result with super resolution image S dot product again after the point spread function H convolution of microscopic system.To I 'iI ' can be obtained by carrying out integrali
Integral are as follows:
∫∫S(u,v)dudv(∫∫Pi(x,y)H(x-u,y-v)dxdy)
So IiIntegral result and I 'iIntegral result it is equal.According to IiWith I 'iThe equal conclusion of integrated value, when me
Obtain original wide-field image I0With digital template PiWhen the integrated value of dot product result, equally it is considered that the integrated value is pair
Light distribution I 'iIntegral obtains.
SoIn this formula, T is integratediIt has been calculated at step 104, PiIn step
Obtained in 102, as long as so obtain point spread function H,In just only S be it is unknown, it is other to be
It is known that according to known integral Ti, digital template PiS is solved with point spread function H.Ti
Step 105, the point spread function H for obtaining microscopic system；
Step 106 is based on integral Ti, point spread function H, digital template PiAnd formulaIt obtains
Super resolution image S, whereinIndicate convolution.
Optionally, based on integral Ti, point spread function H, digital template PiAnd formulaIt obtains
Super resolution image S includes:
According to point spread function H, digital template PiAnd formulaObtain new digital template P 'i；
According to formulaIt obtains
Based on integral Ti、P′i、And single pixel camera imaging algorithm, obtain super-resolution
Image S.
Specifically, after the point spread function H of our measuring microscope systems, by point spread function H respectively with i=
N number of digital template P of 1 ... NiCarry out convolution, available fuzzy digit template P 'i, wherein
By fuzzy digit template P 'iWhen being considered as new digital template, new light distribution I 'iIt can regard as are as follows:
I′i=P 'i*S
Meanwhile
Ti=∫ I 'i=∫ P 'i*S
In formula Ti=∫ I 'i=∫ P 'i* in S, digital template P 'iWith light distribution I 'iIntegrated value TiBe it is known, this
Kind situation is identical as single pixel camera imaging principle.Based on integral Ti, digital template P 'i、With
And single pixel camera imaging algorithm, obtaining super resolution image S includes: based on formulaIt will be digital
Template P 'iRegard digital template used in single pixel camera imaging algorithm as, super resolution image S regards the calculation of single pixel camera imaging as
The image for needing to acquire in method, the integral T of light distributioniTo use digital template P 'iWhen the light intensity product that is acquired by single pixel camera
Score value acquires super resolution image S.It is understood that when using a large amount of digital template PiWhen, it can equally obtain a large amount of
Fuzzy digit template P 'iAnd corresponding light distribution integrated value Ti。
In the present embodiment, it is assumed that digital template P 'iFor the matrix of m row n column.Specifically, being based on formulaBy digital template P 'iRegard digital template used in single pixel camera imaging algorithm as, surpasses
Resolution image S regards the image for needing to acquire in single pixel camera imaging algorithm, the integral T of light distribution asiTo use digital mould
Plate P 'iWhen the light intensity integrated value that is acquired by single pixel camera, acquiring super resolution image S includes:
By digital template P 'iIt is launched into the row vector A that width is m × ni, by N number of row vector AiIt is combined into matrix A；
By N number of digital template PiCorresponding different integral TiIt is combined into column vector Τ；
To equation group AX=T, column vector X is calculated according to preset algorithm, wherein X is the column vector of m*n row, and X is oversubscription
Distinguish the expanded form of image S；
The column vector X of m*n row is combined into the matrix with m row n column, obtains super resolution image S.
Wherein it is possible to understand, matrix A shares N row, and m × n is arranged, specificallyI-th row of matrix A is equal to
Ai, AiWidth be m*n.Column vector Τ also has altogether N row, specificallyThe i-th row of vector Τ is equal to Τi, it is i-th
A digital template PiCorresponding light distribution IiIntegral.
Preset algorithm includes but is not limited in the present embodiment: least-squares algorithm, conjugate gradient algorithms and compressed sensing are calculated
At least one of method.
In order to solve the problems in the prior art, the present embodiment also provides a kind of image reconstruction device, referring to fig. 2, the figure
As reconstruct device includes:
First obtains mould 21, the wide-field image I of the single frames of the target sample for obtaining microscopic system acquisition0；
Setup module 22, for being arranged and wide-field image I0The identical digital template P of sizei, wherein i=1 ... N；
First computing module 23, for according to formula Ii=I0*Pi, calculate digital template PiCorresponding light distribution Ii, * table
Show dot product；
Second computing module 24, for according to formula Ti=∫ Ii, calculate light distribution IiIntegral Ti；
Second obtains module 25, for obtaining the point spread function H of microscopic system；
Processing module 26, for based on integral Ti, point spread function H, digital template PiAnd formulaObtain super resolution image S, whereinIndicate convolution, (x, y) indicates to shoot wide field in microscopic system
Image I0Camera imaging plane on coordinate；(u, v) indicate target sample coordinate in the plane.
Optionally, processing module 26, for according to point spread function H, digital template PiAnd formulaIt obtains
New digital template P 'i；
According to formulaIt obtains
Based on integral Ti、P′i、And single pixel camera imaging algorithm, obtain super-resolution
Image S.
Optionally, processing module 26 are used for digital template P 'iIt is launched into the row vector A that width is m × ni, by N number of row
Vector AiIt is combined into matrix A；
By N number of digital template PiCorresponding different integral TiIt is combined into column vector Τ；
To equation group AX=T, column vector X is calculated according to preset algorithm, wherein X is the column vector of m*n row, and X is oversubscription
Distinguish the expanded form of image S；
The column vector X of m*n row is combined into the matrix with m row n column, obtains super resolution image S.
In order to solve the problems in the prior art, the present embodiment also provides a kind of electronic equipment, which includes: place
Manage device, memory and communication bus；
Communication bus is for realizing the connection communication between processor and memory；
Memory is for storing one or more programs, and processor is for executing one or more stored in memory
Program, to realize such as the step of above-mentioned image reconstructing method.
In order to solve the problems in the prior art, the present embodiment also provides a kind of storage medium, which is stored with
One or more program, one or more program can be executed by one or more processor, to realize such as above-mentioned figure
As the step of reconstructing method.
Using the scheme of the present embodiment, the wide-field image I of the single frames of the target sample of microscopic system acquisition can be obtained0,
Setting and wide-field image I0The identical digital template P of sizei, wherein i=1 ... N；According to formula Ii=I0*Pi, calculate digital mould
Plate PiCorresponding light distribution Ii；According to formula Ti=∫ Ii, calculate light distribution IiIntegral Ti；Obtain the point of microscopic system
Spread function H；Based on formulaWith known integral Ti, point spread function H and digital template Pi, acquire
Unknown super resolution image S, according to the solutions of the embodiments of the present invention, the image that microscopic system only needs to acquire single frames can be into
Row image reconstruction obtains super resolution image S, greatly improves the temporal resolution of image taking speed and algorithm, facilitates look at mesh
The dynamic changing process and progress mechanism analysis of the cell interior component of standard specimen sheet.
In several embodiments provided herein, it should be understood that disclosed devices, systems, and methods, it can be with
It realizes by another way.For example, the apparatus embodiments described above are merely exemplary, for example, the division of module,
Only a kind of logical function partition, there may be another division manner in actual implementation, such as multiple module or components can be with
In conjunction with or be desirably integrated into another system, or some features can be ignored or not executed.Another point, it is shown or discussed
Mutual coupling, direct-coupling or communication connection can be through some interfaces, the INDIRECT COUPLING of device or module or
Communication connection can be electrical property, mechanical or other forms.
Module may or may not be physically separated as illustrated by the separation member, show as module
Component may or may not be physical module, it can and it is in one place, or may be distributed over multiple networks
In module.Some or all of the modules therein can be selected to achieve the purpose of the solution of this embodiment according to the actual needs.
It, can also be in addition, each functional module in each embodiment of the present invention can integrate in a processing module
It is that modules physically exist alone, can also be integrated in two or more modules in a module.Above-mentioned integrated mould
Block both can take the form of hardware realization, can also be realized in the form of software function module.
If integrated module is realized and when sold or used as an independent product in the form of software function module, can
To be stored in a computer readable storage medium.Based on this understanding, technical solution of the present invention substantially or
Say that all or part of the part that contributes to existing technology or the technical solution can embody in the form of software products
Out, which is stored in a storage medium, including some instructions are used so that a computer equipment
(can be personal computer, server or the network equipment etc.) executes all or part of each embodiment method of the present invention
Step.And storage medium above-mentioned include: USB flash disk, it is mobile hard disk, read-only memory (ROM, Read-Only Memory), random
Access various Jie that can store program code such as memory (RAM, Random Access Memory), magnetic or disk
Matter.
It should be noted that for the various method embodiments described above, describing for simplicity, therefore, it is stated as a series of
Combination of actions, but those skilled in the art should understand that, the present invention is not limited by the sequence of acts described because
According to the present invention, certain steps can use other sequences or carry out simultaneously.Secondly, those skilled in the art should also know
It knows, the embodiments described in the specification are all preferred embodiments, and related actions and modules might not all be this hair
Necessary to bright.
In the above-described embodiments, it all emphasizes particularly on different fields to the description of each embodiment, there is no the portion being described in detail in some embodiment
Point, it may refer to the associated description of other embodiments.
The above are to a kind of description of image reconstructing method, device, electronic equipment and storage medium provided by the present invention,
For those skilled in the art, thought according to an embodiment of the present invention, has in specific embodiments and applications
Change place, to sum up, the contents of this specification are not to be construed as limiting the invention.
Claims (9)
1. a kind of image reconstructing method characterized by comprising
Obtain the wide-field image I of the single frames of the target sample of microscopic system acquisition0；
Setting and the wide-field image I0The identical digital template P of sizei, wherein i=1 ... N；
According to formula Ii=I0*Pi, calculate the digital template PiCorresponding light distribution Ii, the * expression dot product；
According to formula Ti=∫ Ii, calculate the light distribution IiIntegral Ti；
Obtain the point spread function H of the microscopic system；
Based on the integral Ti, the point spread function H, the digital template PiAnd formulaIt obtains
Super resolution image S, wherein describedIndicate convolution.
2. image reconstructing method as described in claim 1, which is characterized in that described to be based on the integral Ti, the point spread function
Number H, the digital template PiAnd formulaObtaining super resolution image S includes:
According to the point spread function H, the digital template PiAnd formulaObtain new digital template P 'i；
According to formulaIt obtains
Based on the integral Ti, the P 'i, it is describedAnd single pixel camera imaging algorithm, it obtains
To super resolution image S.
3. image reconstructing method as claimed in claim 2, which is characterized in that the digital template P 'iFor m row n column matrix,
It is described to be based on the integral Ti, the P 'i, it is describedAnd single pixel camera imaging algorithm, it obtains
Include: to super resolution image S
By the digital template P 'iIt is launched into the row vector A that width is m × ni, by N number of row vector AiIt is combined into matrix A；
By N number of digital template PiCorresponding different integral TiIt is combined into column vector Τ；
To equation group AX=T, column vector X is calculated according to preset algorithm, wherein the X is the column vector of m*n row, and the X is
The expanded form of super resolution image S；
The column vector X of m*n row is combined into the matrix with m row n column, obtains super resolution image S.
4. image reconstructing method as claimed in claim 3, which is characterized in that the preset algorithm include: least-squares algorithm,
At least one of conjugate gradient algorithms and compressed sensing algorithm.
5. a kind of image reconstruction device characterized by comprising
First obtains module, the wide-field image I of the single frames of the target sample for obtaining microscopic system acquisition0；
Setup module, for being arranged and the wide-field image I0The identical digital template P of sizei, wherein i=1 ... N；
First computing module, for according to formula Ii=I0*Pi, calculate the digital template PiCorresponding light distribution Ii, the *
Indicate dot product；
Second computing module, for according to formula Ti=∫ Ii, calculate the light distribution IiIntegral Ti；
Second obtains module, for obtaining the point spread function H of the microscopic system；
Processing module, for being based on the integral Ti, the point spread function H, the digital template PiAnd formulaObtain super resolution image S, wherein describedIndicate convolution.
6. image reconstruction device as claimed in claim 5, which is characterized in that the processing module, for being expanded according to the point
Dissipate function H, the digital template PiAnd formulaObtain new digital template P 'i；According to formulaIt obtainsBased on the integral Ti, the P 'i, it is describedAnd single pixel camera imaging algorithm, obtain super resolution image S.
7. image reconstruction device as claimed in claim 6, which is characterized in that the processing module is used for the digital mould
Plate P 'iIt is launched into the row vector A that width is m × ni, by N number of row vector AiIt is combined into matrix A；By N number of digital template PiInstitute
Corresponding different integral TiIt is combined into column vector Τ；To equation group AX=T, column vector X is calculated according to preset algorithm, wherein
The X is the column vector of m*n row, and the X is the expanded form of super resolution image S；The column vector X of m*n row is combined into m
The matrix of row n column, obtains super resolution image S.
8. a kind of electronic equipment characterized by comprising include: processor, memory and communication bus；
The communication bus is for realizing the connection communication between the processor and the memory；
The memory is for storing one or more programs, and the processor is for executing one stored in the memory
Or multiple programs, to realize such as the step of image reconstructing method of any of claims 1-4.
9. a kind of storage medium, which is characterized in that the storage medium is stored with one or more program, it is one or
Multiple programs can be executed by one or more processor, to realize such as image reconstruction of any of claims 1-4
The step of method.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810982770.9A CN109146790B (en) | 2018-08-27 | 2018-08-27 | Image reconstruction method and device, electronic equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810982770.9A CN109146790B (en) | 2018-08-27 | 2018-08-27 | Image reconstruction method and device, electronic equipment and storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN109146790A true CN109146790A (en) | 2019-01-04 |
| CN109146790B CN109146790B (en) | 2022-10-11 |
Family
ID=64828400
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810982770.9A Active CN109146790B (en) | 2018-08-27 | 2018-08-27 | Image reconstruction method and device, electronic equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109146790B (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110007453A (en) * | 2019-05-13 | 2019-07-12 | 中国科学院生物物理研究所 | The fluorescence signal measuring device and its measurement method of a kind of more light illumination modes and application |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20120081535A1 (en) * | 2010-09-30 | 2012-04-05 | Olympus Corporation | Sample observation device for generating super resolution image |
| CN102800047A (en) * | 2012-06-20 | 2012-11-28 | 天津工业大学 | Method for reconstructing super resolution of single-frame image |
| CN103473751A (en) * | 2013-08-14 | 2013-12-25 | 西安理工大学 | CMOS sensor cell image super-resolution reconstruction method based on multiple objects |
| CN103903235A (en) * | 2014-01-27 | 2014-07-02 | 西安理工大学 | Cell image super-resolution reconstruction method |
| US20160054551A1 (en) * | 2014-08-21 | 2016-02-25 | Carl Zeiss Microscopy Gmbh | Method for imaging a sample by means of a microscope and microscope |
| CN105389785A (en) * | 2015-12-21 | 2016-03-09 | 程涛 | Processing method of point spread function |
| CN105589188A (en) * | 2016-03-10 | 2016-05-18 | 清华大学 | Imaging method and imaging device of structured illumination microscope |
-
2018
- 2018-08-27 CN CN201810982770.9A patent/CN109146790B/en active Active
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20120081535A1 (en) * | 2010-09-30 | 2012-04-05 | Olympus Corporation | Sample observation device for generating super resolution image |
| CN102800047A (en) * | 2012-06-20 | 2012-11-28 | 天津工业大学 | Method for reconstructing super resolution of single-frame image |
| CN103473751A (en) * | 2013-08-14 | 2013-12-25 | 西安理工大学 | CMOS sensor cell image super-resolution reconstruction method based on multiple objects |
| CN103903235A (en) * | 2014-01-27 | 2014-07-02 | 西安理工大学 | Cell image super-resolution reconstruction method |
| US20160054551A1 (en) * | 2014-08-21 | 2016-02-25 | Carl Zeiss Microscopy Gmbh | Method for imaging a sample by means of a microscope and microscope |
| CN105389785A (en) * | 2015-12-21 | 2016-03-09 | 程涛 | Processing method of point spread function |
| CN105589188A (en) * | 2016-03-10 | 2016-05-18 | 清华大学 | Imaging method and imaging device of structured illumination microscope |
Non-Patent Citations (1)
| Title |
|---|
| 朱琳 等: "多位相结构光照明显微重构技术仿真研究", 《光学与光电技术》 * |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110007453A (en) * | 2019-05-13 | 2019-07-12 | 中国科学院生物物理研究所 | The fluorescence signal measuring device and its measurement method of a kind of more light illumination modes and application |
| CN110007453B (en) * | 2019-05-13 | 2023-11-21 | 中国科学院生物物理研究所 | Multi-illumination-mode fluorescent signal measuring device and measuring method and application thereof |
Also Published As
| Publication number | Publication date |
|---|---|
| CN109146790B (en) | 2022-10-11 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| Luo et al. | Synthetic aperture-based on-chip microscopy | |
| Katz et al. | Non-invasive single-shot imaging through scattering layers and around corners via speckle correlations | |
| CN110441271B (en) | Light field high-resolution deconvolution method and system based on convolutional neural network | |
| US20180329225A1 (en) | Pattern Detection at Low Signal-To-Noise Ratio | |
| US20170003490A1 (en) | Image processing method and image processing apparatus | |
| Aspelmeier et al. | Modern statistical challenges in high-resolution fluorescence microscopy | |
| CN108550108B (en) | Fourier laminated imaging image reconstruction method based on phase iteration minimization | |
| Shaw | Deconvolution in 3-D optical microscopy | |
| CN106530381B (en) | A kind of deconvolution algorithm of the three-dimensional fluorescence micro-image accelerated based on GPU | |
| CN114331840B (en) | Method and device for reconstructing high-fidelity super-resolution microscopic image | |
| CN111123495A (en) | Three-dimensional total internal reflection microscopic imaging device and method based on annular array light source illumination | |
| WO2018227465A1 (en) | Sparse positive source separation model-based image deblurring algorithm | |
| Krishnan et al. | Optical aberration correction via phase diversity and deep learning | |
| CN114092325A (en) | Fluorescent image super-resolution reconstruction method and device, computer equipment and medium | |
| Cao et al. | Dynamic structured illumination microscopy with a neural space-time model | |
| CN109146790A (en) | A kind of image reconstructing method, device, electronic equipment and storage medium | |
| Bai et al. | Compressed blind deconvolution and denoising for complementary beam subtraction light-sheet fluorescence microscopy | |
| Zhao et al. | Faster super-resolution imaging with auto-correlation two-step deconvolution | |
| Rinsa et al. | Simultaneous multiple-level magnification selective plane illumination microscopy (sMx-SPIM) imaging system | |
| Toscani et al. | Single image deconvolution with super-resolution using the suppose algorithm | |
| EP3729161A1 (en) | Method and apparatus for optical confocal imaging, using a programmable array microscope | |
| CN108717685B (en) | Method and system for enhancing image resolution | |
| de Vieilleville et al. | Alternating direction method of multipliers applied to 3d light sheet fluorescence microscopy image deblurring using gpu hardware | |
| Gaire et al. | Accelerating 3D single-molecule localization microscopy using blind sparse inpainting | |
| Conchello et al. | Parametric blind deconvolution of fluorescence microscopy images: preliminary results |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |