CN105301794B - Super-resolution imaging device for fast moving objects - Google Patents
Super-resolution imaging device for fast moving objects Download PDFInfo
- Publication number
- CN105301794B CN105301794B CN201510727726.XA CN201510727726A CN105301794B CN 105301794 B CN105301794 B CN 105301794B CN 201510727726 A CN201510727726 A CN 201510727726A CN 105301794 B CN105301794 B CN 105301794B
- Authority
- CN
- China
- Prior art keywords
- resolution
- super
- imaging
- shooting area
- lens
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000003384 imaging method Methods 0.000 title claims abstract description 147
- 238000012545 processing Methods 0.000 claims abstract description 8
- 230000003287 optical effect Effects 0.000 claims description 40
- 238000001914 filtration Methods 0.000 claims description 7
- 230000015572 biosynthetic process Effects 0.000 claims description 3
- 210000001747 pupil Anatomy 0.000 claims description 3
- 230000021615 conjugation Effects 0.000 claims 1
- 238000000034 method Methods 0.000 description 12
- 230000008569 process Effects 0.000 description 6
- 238000006073 displacement reaction Methods 0.000 description 5
- 238000005516 engineering process Methods 0.000 description 4
- 238000005286 illumination Methods 0.000 description 4
- 230000008859 change Effects 0.000 description 3
- 239000005090 green fluorescent protein Substances 0.000 description 3
- 108010043121 Green Fluorescent Proteins Proteins 0.000 description 2
- 102000004144 Green Fluorescent Proteins Human genes 0.000 description 2
- 230000000295 complement effect Effects 0.000 description 2
- MURGITYSBWUQTI-UHFFFAOYSA-N fluorescin Chemical class OC(=O)C1=CC=CC=C1C1C2=CC=C(O)C=C2OC2=CC(O)=CC=C21 MURGITYSBWUQTI-UHFFFAOYSA-N 0.000 description 2
- 229910044991 metal oxide Inorganic materials 0.000 description 2
- 150000004706 metal oxides Chemical class 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 230000002186 photoactivation Effects 0.000 description 2
- 239000004065 semiconductor Substances 0.000 description 2
- 230000001413 cellular effect Effects 0.000 description 1
- 238000010835 comparative analysis Methods 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 230000005284 excitation Effects 0.000 description 1
- 238000002474 experimental method Methods 0.000 description 1
- 240000000971 garden vetch Species 0.000 description 1
- 238000004020 luminiscence type Methods 0.000 description 1
- 238000000386 microscopy Methods 0.000 description 1
- 230000035772 mutation Effects 0.000 description 1
- 230000008520 organization Effects 0.000 description 1
- 238000003672 processing method Methods 0.000 description 1
- 108090000623 proteins and genes Proteins 0.000 description 1
- 102000004169 proteins and genes Human genes 0.000 description 1
- 238000010791 quenching Methods 0.000 description 1
- 238000011160 research Methods 0.000 description 1
- 239000004576 sand Substances 0.000 description 1
- 229920006395 saturated elastomer Polymers 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Classifications
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/58—Optics for apodization or superresolution; Optical synthetic aperture systems
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/20—Image preprocessing
- G06V10/25—Determination of region of interest [ROI] or a volume of interest [VOI]
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10056—Microscopic image
Abstract
The present invention relates to a kind of super-resolution imaging device for fast moving objects.The device includes：Conventional resolution micro-imaging module, for showing moving object sample and super-resolution imageable target to provide both position and movable information；Rapid image is gathered and processing module, the movement velocity V for obtaining super-resolution imageable targeti, region of interest ROI movement velocity VrWith position and imaging shooting area Sp size, and position feedback control module and super-resolution image-forming module are supplied to；Position feedback control module, for adjusting the imaging shooting area Sp or intending imaging region Si position, keeps overlapping to intend shooting area Si with being imaged shooting area Sp；Super-resolution image-forming module, for being adjusted to, as shooting area Sp size, super-resolution imaging be carried out to super-resolution imageable target on moving object sample according to super-resolution imaging rate requirement.The present invention can eliminate the influence that object of which movement is imaged to super-resolution.
Description
Technical field
It is imaged the present invention relates to acquisition technology field, more particularly to a kind of super-resolution for fast moving objects
Device.
Background technology
Generally, the size of the discernmible smallest object of human eye is about 0.1mm.If wanting to see smaller thing
Body, then need by means of microtechnic.1873, German microtechnic expert Ernest ＆ Whitney Abbe disclose light microscope by
In the diffraction effect and finite aperture resolution ratio of light there is the principle of the limit, exactly the principle " constraint " conventional optical microscope
In the utilization of Nanometer World.
When only having single fluorescence molecule under the microscopical object lens visual field, it is fitted by specific algorithm, it is easy to more than light
Learn resolution limit.For explore microcosmos, break through light microscope optical limit super-resolution microtechnic meet the tendency of and
It is raw.Unimolecule tracking technique is incorporated into life science by Barak and Webb in 1981 first.Although monomolecular registration
Nanoscale can be reached, but it can not improve resolution ratio of the light microscope when differentiating two or more spot light.
Patterson and Lippincott-Schwartz in 2002 utilizes the mutation of green fluorescent protein (GFP) first
(PA-GFP) movement locus of observation specified protein in the cell.German Eric Bezig are observantly recognized：Using single point
Sub- Imaging-PAM, with reference to the characteristics of luminescence of this fluorescin, can break through the limit of optical resolution --- and photoactivation is fixed
Position microtechnic (PALM) is born.PALM imaging method can only be used for observing heterogenous expression albumen, to cellular endogenous albumen
It is helpless.2006, U.S. Howard-Hughes research institute scientist's Zhuan Xiao common vetch experimental group of Chinese origin was found：Different wavelength
Switchings of the chemiluminescence molecule Cy5 between fluorescence excitation state and dark-state can be controlled.Given this random optical reconstruct is developed
Microtechnic (STORM).Either PALM or STORM super-resolutions microscopy, the imaging of its point spread function still with
Traditional micro-imaging is consistent, it is necessary to activation-quenching fluorescence molecule repeatedly, so experiment is completed on fixed cells mostly.
2000, Germany scientist Stefan Hell proposed to reduce the spot size of exciting light by physical process, directly
Connect and reduce the halfwidth of point spread function to improve resolution ratio, successfully have developed stimulated emission depletion microtechnic (STED).Change
Become point spread function and realize that another method for breaking through optical diffraction limit is saturated structures illumination microtechnic (SSIM).2005
Year, nonlinear organization illumination optical part is incorporated on traditional microscope by Gustafsson first, has obtained resolution ratio
Reach 50nm image.But existing super-resolution techniques image taking speed is slow, and it is difficult to shoot motion (particularly quick fortune
It is dynamic) sample.
The content of the invention
One of purpose of the present invention is a kind of super-resolution imaging device for fast moving objects of offer, with
Solve the technical problem that image taking speed in the prior art is difficult to shoot moving object, particularly biological living slowly.
For achieving the above object, the embodiments of the invention provide a kind of super-resolution for fast moving objects into
As device, including：
Conventional resolution micro-imaging module, for showing moving object sample and super-resolution imageable target to provide this
The position and movable information of moving object sample and super-resolution imageable target；
Rapid image is gathered and processing module, the movement velocity V for obtaining super-resolution imageable targeti, region of interest
Domain ROI movement velocity VrWith position and imaging shooting area Sp size, and position feedback control module is supplied to and super
High-resolution imaging module；
Position feedback control module, for adjusting the imaging shooting area Sp or intending imaging region Si position, with
Keep overlapping with imaging shooting area Sp so that intending shooting area Si；
Super-resolution image-forming module, for being adjusted to according to super-resolution imaging rate requirement as shooting area Sp size,
Super-resolution imaging is carried out to super-resolution imageable target on moving object sample.
Alternatively, the position feedback control module includes Electrocontrolled sample platform and is successively set on the first imaging optical path
The first lens, the second lens and automatically controlled tilting mirror, wherein：
The side of first lens is provided with Electrocontrolled sample platform, and opposite side is provided with the second lens；
Side of second lens away from the Electrocontrolled sample platform sets the automatically controlled tilting mirror.
Alternatively, by setting the position of first lens and second lens so that automatically controlled tilting mirror is differentiated with conventional
Image-forming objective lens entrance pupil in rate micro-imaging module is into conjugate relation.
Alternatively, the rapid image collection includes rapid image collecting device and computing device with processing module, wherein：
The rapid image collecting device, for gathering moving object sample and super-resolution imageable target to provide the fortune
The position and movable information of animal body samples and super-resolution imageable target；
The computing device, for the position and movable information according to moving object sample and super-resolution imageable target with
Obtain the movement velocity V of super-resolution imageable targeti, region of interest ROI movement velocity VrArea is shot with position and imaging
Domain Sp size.
Alternatively, the rapid image collecting device uses imaging sensor or Position-Sensitive Detector.
Alternatively, the computing device obtains imaging frame frequency f according to below equations：
|Vr-Vi|/PPIs≤fs。
Alternatively, the conventional resolution micro-imaging module includes：Lighting unit and imaging unit：
The lighting unit includes lighting apparatus, the 3rd lens and the condenser being successively set on the second imaging optical path；
The side of 3rd lens is provided with the lighting apparatus, and opposite side is provided with the condenser；In the remote of the condenser
Side from lighting apparatus is provided with Electrocontrolled sample platform；
The imaging unit includes image-forming objective lens, optical splitter and the 3rd imaging being successively set on the second imaging optical path
Imaging len, optical filtering on road；The side of the image-forming objective lens is provided with Electrocontrolled sample platform, and opposite side is provided with the light splitting
Device；The optical splitter changes light the 3rd imaging optical path of formation on the second imaging optical path；The imaging len is arranged on described
The side of optical splitter, opposite side is provided with the optical filtering.
The embodiment of the present invention is by obtaining the position of moving object sample area-of-interest and super-resolution imageable target
Super-resolution imaging speed is determined with the resolution ratio of movement velocity, and combination super-resolution image-forming module, takes this as a foundation and is adjusted to
As the area of shooting area, it is ensured that super-resolution imaging rate；By being adjusted to as intending clapping on the position of shooting area or sample
The position in region is taken the photograph, so that imaging shooting area keeps overlapping with intending the position of shooting area on sample, so as to eliminate moving object
The influence that the motion of body sample is imaged to super-resolution.The present invention quickly and automatically can carry out superelevation to fast moving objects
Resolution imaging, can also automatically analyze the morphosis of moving object, the various fortune such as the spermatoblast that is particularly suitable for use in, biological tissue
The rapid ultra high resolution imaging of dynamic object.
Brief description of the drawings
The features and advantages of the present invention can be more clearly understood from by reference to accompanying drawing, accompanying drawing is schematical without that should manage
Solve to carry out any limitation to the present invention, in the accompanying drawings：
Fig. 1 is a kind of flow for super-resolution imaging method for fast moving objects that one embodiment of the invention is provided
Schematic diagram；
Fig. 2 is that a kind of super-resolution image device structure for fast moving objects that one embodiment of the invention is provided shows
It is intended to；
Fig. 3 is to be adjusted in one embodiment of the invention overlap process schematic as shooting area is adjusted with intending shooting area.
Embodiment
With reference to the accompanying drawings and examples, the embodiment to the present invention is described in further detail.Implement below
Example is used to illustrate the present invention, but is not limited to the scope of the present invention.
In a first aspect, the embodiments of the invention provide a kind of super-resolution imaging method for fast moving objects, such as
Shown in Fig. 1, including：
Set according to the position of super-resolution imageable target on moving object sample and include the super-resolution imageable target
Region of interest ROI；
Obtain the movement velocity V of the super-resolution imageable targetiWith the movement velocity V of the region of interest ROIrWith
Position；
According to the resolution ratio PPI of super-resolution image-forming modules, the region of interest ROI movement velocity VrAnd it is described
The movement velocity V of super-resolution imageable targetiObtain the imaging frame frequency f of the super-resolution image-forming modules；
According to the imaging frame frequency fsThe size of the imaging shooting area Sp is calculated with being imaged shooting area Sp relation；
A plan shooting area Si for including super-resolution imaging target is defined, the size of the plan shooting area Si shoots area with the imaging
Domain Sp size is identical, and with identical movement velocity Vr；
The adjustment plan shooting area Si or imaging shooting area Sp position, so that the plan shooting area Si
Keep overlapping with the imaging shooting area Sp；And according to the plan shooting area Si to super-resolution on moving object sample into
As target carries out super-resolution imaging.
The embodiment of the present invention by obtaining position and the movement velocity of moving object sample and super-resolution imageable target,
And combine the area that the resolution ratio of super-resolution image-forming module obtains imaging shooting area, it is ensured that super-resolution imaging rate；It is logical
The position being adjusted to as shooting area or sample is crossed so as to keep overlapping with the position that imaging shooting area intends shooting area, from
And the influence that the motion for eliminating moving object sample is imaged to super-resolution.The present invention can be quickly and automatically to moving object
Super-resolution imaging is carried out, the morphosis of moving object can also be automatically analyzed, the spermatoblast that is particularly suitable for use in, biological tissue
Etc. the rapid ultra high resolution imaging of various Moving Objects.
Alternatively, according to the resolution ratio PPI of super-resolution image-forming modules, the region of interest ROI movement velocity Vr
And the movement velocity V of the super-resolution imageable targetiObtain the imaging frame frequency f of the super-resolution image-forming modulesThe step of
Middle use below equation obtains imaging frame frequency fs：
|Vr-Vi|/PPIs≤fs。
Alternatively, the movement velocity V of the super-resolution imageable target is obtainediWith the movement velocity V of region of interest ROIr
Obtained in the following manner with position：
Obtain the moving object sample at least two images and the position of super-resolution imageable target；
Gather at least two images of region of interest ROI respectively in preset time；
The position of moving object sample and super-resolution imageable target at least two images is contrasted, to obtain moving object
The displacement of sample and super-resolution imageable target；
The region of interest is obtained according to the displacement of moving object sample and super-resolution imageable target and imaging frame frequency
Domain ROI movement velocity VrAnd the movement velocity V of the super-resolution imageable targeti。
Alternatively, the movement velocity V of region of interest ROI is obtainedrObtained in the following manner with position：
One is selected in region of interest ROI to represent a little with the first of its motion feature can be represented, in super-resolution
The second of its motion feature can be represented and represent a little by selecting one in imageable target；
The first representative point and second is gathered different at the time of respectively and represents the light intensity of point；
Relation that the representative of comparative analysis first is put and the described second light intensity for representing point changes with time, to obtain moving object
The displacement of body sample region of interest ROI and super-resolution imageable target and speed.
In practical application, the present invention can also obtain movement velocity and the position of the point by position sensor.
Alternatively, intend shooting area Si to keep overlapping using following methods realization with imaging shooting area Sp：
According to the movement velocity V of region of interest ROIrIt is adjusted to, as shooting area Sp position, make imaging shooting area
Sp motion is identical with the region of interest ROI direction of motion, velocity magnitude is equal.
Or,
It is imaged shooting area Sp and keeps constant, according to the movement velocity V of region of interest ROIrSample cell is adjusted, so that sample
Product produce the equal movement velocity-V of, velocity magnitude opposite with the region of interest ROI direction of motionr。
To embody a kind of the superior of super-resolution imaging method for fast moving objects provided in an embodiment of the present invention
Property, the embodiment of the present invention additionally provides a kind of super-resolution imaging side device for fast moving objects, as shown in Fig. 2 bag
Include：
Conventional resolution micro-imaging module 10, for showing moving object sample and super-resolution imageable target to provide
The position and movable information of the moving object sample and super-resolution imageable target；
Rapid image is gathered with processing module 20, movement velocity V, super-resolution imaging for obtaining moving object sample
The movement velocity V of targeti, intend shooting area Si movement velocity VrWith position and imaging shooting area Sp size, and provide
To position feedback control module 40 and super-resolution image-forming module 30；
Position feedback control module 40, for adjusting the imaging shooting area Sp or intending imaging region Si position,
Keep overlapping with being imaged shooting area Sp to intend shooting area Si；
Super-resolution image-forming module 30, for being adjusted to according to super-resolution imaging rate requirement as shooting area Sp chi
It is very little, super-resolution imaging is carried out to super-resolution imageable target on moving object sample.
As a kind of specific example of conventional resolution micro-imaging module 10, as shown in Fig. 2 the embodiment of the present invention is provided
Conventional resolution micro-imaging module 10 include lighting unit and imaging unit.Lighting unit includes being successively set on the second one-tenth
As lighting apparatus 101, the 3rd lens 102 and the condenser 103 in light path, wherein, the side of the 3rd lens 102 is provided with illumination
Equipment 101, opposite side is provided with condenser 103；It is provided with the side of the remote lighting apparatus 101 of the condenser 103 automatically controlled
Sample stage 104.Imaging unit includes the image-forming objective lens 105 being successively set on the second imaging optical path, optical splitter 106 and the three one-tenth
As the imaging len 107 in light path, optical filtering 108；The side of image-forming objective lens 105 is provided with Electrocontrolled sample platform 104, and opposite side is set
It is equipped with optical splitter 106；106 optical splitters change light the 3rd imaging optical path of formation on the second imaging optical path；Imaging len 107 is set
Put in the side of optical splitter 106, opposite side is provided with optical filtering 108.
In practical application, those skilled in the art according to specific usage scenario, can select the routine point of suitable parameters
Resolution micro-imaging module is to realize display fast moving objects sample and super-resolution imageable target, and the present invention is not construed as limiting.
The specific example with processing module 20 is gathered as a kind of rapid image, as shown in Fig. 2 the embodiment of the present invention is provided
Rapid image collection with processing module 20 include rapid image collecting device 201 and computing device 202, wherein：
Rapid image collecting device 201, for gathering moving object sample and super-resolution imageable target to provide the fortune
The position and movable information of animal body samples and super-resolution imageable target；
Computing device 202, for the position and movable information according to moving object sample and super-resolution imageable target with
Obtain movement velocity V, the movement velocity V of super-resolution imageable target of moving object samplei, intend shooting area Si motion speed
Spend VrWith position and imaging shooting area Sp size.
In practical application, rapid image collecting device 201 can use such as charge coupled cell (Charge-coupled
Device, CCD) or complementary metal oxide semiconductor (Complementary Metal Oxide Semiconductor,
The imaging sensor such as CMOS), also can be used Position-Sensitive Detector etc., and those skilled in the art can be according to specifically using field
Scape is selected, and the present invention is not construed as limiting.
In practical application, ambient noise of the computing device 202 at least two images, moving object sample A forms
Similitude of structure, moving object sample A and background etc., takes the technologies such as different background modelings, target identification, Track Pick-up
Movement velocity is calculated, those skilled in the art can select suitable processing method according to specific usage scenario.
As a kind of specific example of position feedback control module 40, as shown in Fig. 2 position provided in an embodiment of the present invention
Feedback control module 40 includes the first lens 403, the second lens 402 and the automatically controlled tilting mirror being successively set on the first imaging optical path
401, wherein：
The side of first lens 403 is provided with Electrocontrolled sample platform 104, and opposite side is provided with the second lens 402；
Side of second lens 402 away from the Electrocontrolled sample platform 104 sets automatically controlled tilting mirror 401.
In the embodiment of the present invention, by adjusting the position of the first lens 403 and the second lens 402, make automatically controlled tilting mirror 401 and
The entrance pupil of image-forming objective lens 105 is into conjugate relation.Adjusting automatically controlled tilting mirror 401 in time makes imaging shooting area Sp in moving object sample
It is upper quick mobile, overlapped so that imaging shooting area Sp is remained with plan shooting area Si, so as to eliminate moving object sample
The influence that is imaged to super-resolution of motion.It can also be clapped in the embodiment of the present invention by controlling Electrocontrolled sample platform quickly to change plan
Region Si position is taken the photograph, so as to reach imaging shooting area Sp with intending the purpose that shooting area Si positions are overlapped.Art technology
Personnel can be selected according to specific occasion, and the present invention is not construed as limiting.
As a kind of specific example of super-resolution image-forming module 30, as shown in Fig. 2 superelevation provided in an embodiment of the present invention
Resolution imaging module 30 is connected with position feedback control module 40, by adjusting the angle of automatically controlled tilting mirror 401 to adjust first
Imaging optical path changes the imaging shooting area Sp of super-resolution image-forming module 30；Meanwhile, also it is connected, receives with computing device 202
The imaging frame frequency f transmitted from computing device 202s, according to imaging frame frequency fsSuperelevation point is carried out to intending imaging shooting area Si
Imaging is distinguished, so as to shoot the picture rich in detail in moving object sample moving process.
In practical application, super-resolution image-forming module 30 can from for example with photoactivation position microtechnic (PALM),
The equipment of random optical reconstruct microtechnic (STORM) or Structured Illumination microtechnic (SIM), can also use laser scanning
The high-resolution imaging equipment such as light focusing, double (many) photon fluorescence micro-imagings, those skilled in the art can be according to specifically making
Selected with scene, the present invention is not construed as limiting.
A kind of work of super-resolution imaging device for fast moving objects provided in an embodiment of the present invention is described below
Make process.
As shown in figure 3, moving object sample A is placed in the sample cell in sample stage 104.
The light that lighting apparatus 101 is sent is incident upon sample cell bottom after the 3rd lens 102 and condenser 103.
The image that moving object sample A and super-resolution imageable target B1, B2 and B3 are formed passes through image-forming objective lens 105 and light splitting
After device 106, then after imaging len 107 and optical filtering 108 it is transferred to rapid image collecting device 201.
At least two images of the Quick Acquisition of rapid image collecting device 201 are simultaneously transferred to computing device 202, by the calculating
Equipment 202 is set comprising super-resolution imaging according to the position of super-resolution imageable target B1, B2 and B3 on moving object sample
Target B1, B2 and B3 region of interest ROI, rower of going forward side by side are determined.
The computing device 202 obtains the moving object sample at least two images and the position of super-resolution imageable target
Put；The moving object sample at least two images and the position of super-resolution imageable target are contrasted respectively, to obtain moving object
The displacement of body sample and super-resolution imageable target；According to the displacement of moving object sample and super-resolution imageable target and obtain
Take imaging frame frequency f during at least two imagessObtain moving object sample A movement velocity V, the motion of region of interest ROI
Speed VrAnd the movement velocity V of super-resolution imageable targeti.Wherein, imaging frame frequency fsMotion speed with moving object sample A
Spend V, intend shooting area Si movement velocity Vr, super-resolution imageable target movement velocity ViWith super-resolution image-forming module
Resolution ratio PPIsNeed to meet following condition：
|Vr-Vi|/fs≤PPIs
Computing device 202 obtains imaging rate according to above-mentioned formula and is transferred to super-resolution image-forming module 30, and according to
Obtain moving object sample A movement velocity V, intend shooting area Si movement velocity Vr, super-resolution imageable target motion
Speed ViThe angle for obtaining automatically controlled tilting mirror 401 is transferred to position feedback control module 40.
Position feedback control module 40 adjusts the angle of automatically controlled tilting mirror 401 according to received angle information, with timely
Adjusting automatically controlled tilting mirror 401 makes imaging shooting area Sp quickly be moved on moving object sample so that imaging shooting area Sp with
Intend shooting area Si and remain coincidence.
In the embodiment of the present invention can also by the way that positional information is transferred into the position that Electrocontrolled sample platform 104 adjusts sample,
Imaging shooting area Sp is set to keep overlapping with intending shooting area Si, so as to eliminate the movement velocity V for intending shooting area SirShadow
Ring.
The imaging rate of high-resolution imaging module 30 is generally related to the size that it is imaged shooting area Sp；Differentiating
When rate is constant, imaging shooting area Sp is bigger, imaging frame frequency fsIt is smaller.Super-resolution image-forming module 30 is imaged according to super-resolution
The resolution ratio PPI of modules, intend shooting area Si movement velocity VrAnd the movement velocity V of super-resolution imageable targetiObtain
The imaging frame frequency f of super-resolution image-forming modulesAnd imaging shooting area Sp, and then reduce or eliminate (Vi-Vr) influence.
Then high-resolution imaging module 30 according to imaging shooting area Sp size to super-resolution imageable target on moving object sample A
Carry out super-resolution imaging.
In summary, the super-resolution imaging device provided in an embodiment of the present invention for fast moving objects, by obtaining
Position and the movement velocity of moving object sample and super-resolution imageable target are taken, and combines point of super-resolution image-forming module
Resolution obtains the area of imaging shooting area, it is ensured that super-resolution imaging rate；By be adjusted to the position as shooting area with
The position with intending shooting area on sample is set to keep overlapping, so that what the motion for eliminating moving object sample was imaged to super-resolution
Influence.The present invention quickly and automatically can carry out super-resolution imaging to moving object, can also automatically analyze moving object
Morphosis, the rapid ultra high resolution imaging of the various Moving Objects such as the spermatoblast that is particularly suitable for use in, biological tissue.
It should also be noted that, herein, such as first and second or the like relational terms are used merely to one
Entity or operation make a distinction with another entity or operation, and not necessarily require or imply between these entities or operation
There is any this actual relation or order.Moreover, term " comprising ", "comprising" or its any other variant are intended to contain
Lid nonexcludability is included, so that process, method, article or equipment including a series of key elements not only will including those
Element, but also other key elements including being not expressly set out, or also include being this process, method, article or equipment
Intrinsic key element.
Although being described in conjunction with the accompanying embodiments of the present invention, those skilled in the art can not depart from this hair
Various modifications and variations are made in the case of bright spirit and scope, such modifications and variations are each fallen within by appended claims
Within limited range.
Claims (7)
1. a kind of super-resolution imaging device for fast moving objects, it is characterised in that including：
Conventional resolution micro-imaging module, for showing moving object sample and super-resolution imageable target to provide the motion
The position and movable information of object sample and super-resolution imageable target；
Rapid image is gathered and processing module, the movement velocity V for obtaining super-resolution imageable targeti, region of interest ROI
Movement velocity VrWith position and imaging shooting area Sp size, and position feedback control module and super-resolution are supplied to
Image-forming module；
Position feedback control module, for adjusting the imaging shooting area Sp or intending imaging region Si position, to cause
Intend shooting area Si to keep overlapping with imaging shooting area Sp；
Super-resolution image-forming module, for being adjusted to according to super-resolution imaging rate requirement as shooting area Sp size, to fortune
Super-resolution imageable target carries out super-resolution imaging on animal body samples.
2. super-resolution imaging device according to claim 1, it is characterised in that the position feedback control module includes
Electrocontrolled sample platform and the first lens being successively set on the first imaging optical path, the second lens and automatically controlled tilting mirror, wherein：
The side of first lens is provided with Electrocontrolled sample platform, and opposite side is provided with the second lens；
Side of second lens away from the Electrocontrolled sample platform sets the automatically controlled tilting mirror.
3. super-resolution imaging device according to claim 2, it is characterised in that by setting first lens and institute
The position of the second lens is stated so that automatically controlled tilting mirror is closed with the image-forming objective lens entrance pupil in conventional resolution micro-imaging module into conjugation
System.
4. super-resolution imaging device according to claim 1, it is characterised in that the rapid image collection and processing mould
Block includes rapid image collecting device and computing device, wherein：
The rapid image collecting device, for gathering moving object sample and super-resolution imageable target to provide the moving object
The position and movable information of body sample and super-resolution imageable target；
The computing device, for the position and movable information according to moving object sample and super-resolution imageable target to obtain
The movement velocity V of super-resolution imageable targeti, region of interest ROI movement velocity VrWith position and imaging shooting area Sp
Size.
5. super-resolution imaging device according to claim 4, it is characterised in that the rapid image collecting device is used
Imaging sensor or Position-Sensitive Detector.
6. super-resolution imaging device according to claim 4, it is characterised in that the computing device is according to below equation
Obtain imaging frame frequency fs：
|Vr-Vi|/PPIs≤fs；
Wherein, PPIsFor the resolution ratio of the super-resolution image-forming module.
7. super-resolution imaging device according to claim 1, it is characterised in that the conventional resolution micro-imaging mould
Block includes：Lighting unit and imaging unit：
The lighting unit includes lighting apparatus, the 3rd lens and the condenser being successively set on the second imaging optical path；It is described
The side of 3rd lens is provided with the lighting apparatus, and opposite side is provided with the condenser；In the remote photograph of the condenser
The side of bright equipment is provided with Electrocontrolled sample platform；
The imaging unit includes being successively set on the image-forming objective lens on the second imaging optical path, optical splitter and the 3rd imaging optical path
Imaging len, optical filtering；The side of the image-forming objective lens is provided with Electrocontrolled sample platform, and opposite side is provided with the optical splitter；
The optical splitter changes light the 3rd imaging optical path of formation on the second imaging optical path；The imaging len is arranged on the light splitting
The side of device, opposite side is provided with the optical filtering.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510727726.XA CN105301794B (en) | 2015-10-30 | 2015-10-30 | Super-resolution imaging device for fast moving objects |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510727726.XA CN105301794B (en) | 2015-10-30 | 2015-10-30 | Super-resolution imaging device for fast moving objects |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN105301794A CN105301794A (en) | 2016-02-03 |
| CN105301794B true CN105301794B (en) | 2017-08-25 |
Family
ID=55199243
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201510727726.XA Active CN105301794B (en) | 2015-10-30 | 2015-10-30 | Super-resolution imaging device for fast moving objects |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN105301794B (en) |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2003222801A (en) * | 2002-01-29 | 2003-08-08 | Olympus Optical Co Ltd | Microscopic image photographing device |
| CN1975782A (en) * | 2005-11-30 | 2007-06-06 | 汤姆逊许可公司 | Method of emendation for attention trajectory in video content analysis |
| EP1936422A1 (en) * | 2005-10-13 | 2008-06-25 | Nikon Corporation | Microscope |
| CN102216827A (en) * | 2008-09-13 | 2011-10-12 | 独立行政法人科学技术振兴机构 | Microscope device and fluorescent observing method using same |
| CN102687061A (en) * | 2009-10-19 | 2012-09-19 | 文塔纳医疗系统公司 | Imaging system and techniques |
| WO2014127372A2 (en) * | 2013-02-18 | 2014-08-21 | Theranos, Inc. | Image analysis and measurement of biological samples |
-
2015
- 2015-10-30 CN CN201510727726.XA patent/CN105301794B/en active Active
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2003222801A (en) * | 2002-01-29 | 2003-08-08 | Olympus Optical Co Ltd | Microscopic image photographing device |
| EP1936422A1 (en) * | 2005-10-13 | 2008-06-25 | Nikon Corporation | Microscope |
| CN1975782A (en) * | 2005-11-30 | 2007-06-06 | 汤姆逊许可公司 | Method of emendation for attention trajectory in video content analysis |
| CN102216827A (en) * | 2008-09-13 | 2011-10-12 | 独立行政法人科学技术振兴机构 | Microscope device and fluorescent observing method using same |
| CN102687061A (en) * | 2009-10-19 | 2012-09-19 | 文塔纳医疗系统公司 | Imaging system and techniques |
| WO2014127372A2 (en) * | 2013-02-18 | 2014-08-21 | Theranos, Inc. | Image analysis and measurement of biological samples |
Non-Patent Citations (1)
| Title |
|---|
| Recent Advances in Super-Resolution Fluorescence Imaging and Its Applications in Biology;Rongcheng Han,et al;《Journal of Genetics and Genomics》;20131123;第40卷(第12期);第583-595页 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN105301794A (en) | 2016-02-03 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| JP6288222B2 (en) | Observation apparatus and observation method | |
| CN104570315B (en) | A kind of color three dimension chromatography micro imaging system and method based on structured illumination | |
| US11530990B2 (en) | Light-sheet microscope with parallelized 3D image acquisition | |
| CN105319725B (en) | Super-resolution imaging method for fast moving objects | |
| US20150185456A1 (en) | Microscope system and control method therefor | |
| WO2010109811A1 (en) | Observation device | |
| US20140231638A1 (en) | Slide Scanner with a Tilted Image | |
| CN107238590A (en) | Based on the micro- microscopy tomography device being imaged with single pixel of mating plate | |
| CN112150446A (en) | Microscope examination and film reading scanning method, computer equipment and system | |
| CN111258045B (en) | High-resolution optical sheet microscopic imaging system for observing free-moving zebra fish | |
| JP2006293219A5 (en) | ||
| CN105301794B (en) | Super-resolution imaging device for fast moving objects | |
| JP4779149B2 (en) | Operating method of laser scanning microscope | |
| EP3223054A1 (en) | Microscope system and specimen observation method | |
| CN208255072U (en) | A kind of Enterozoa worm's ovum diagnostic imaging system of full-automation | |
| US11953670B2 (en) | System and method for rapid focusing and analysis using a micro-camera array microscope | |
| US11256078B2 (en) | Continuous scanning for localization microscopy | |
| CN205942080U (en) | Micro - imaging system of automatic focusing that planet surface material is taken one's place and is surveyed | |
| Park et al. | Advancements in fluorescence lifetime imaging microscopy Instrumentation: Towards high speed and 3D | |
| Vodyanoy | High resolution light microscopy of live cells | |
| CN212622268U (en) | High-speed large-field microscopic imaging device | |
| JP6655632B2 (en) | Method and system for analyzing weakly luminescent samples | |
| Mikami | High-speed fluorescence microscopy for next-generation life science | |
| JP2000180728A (en) | Double oriented fluorescent photometric multiple photon exciting laser microscope | |
| Yamato et al. | High-Speed and Low-Latency 3D Fluorescence Imaging for Robotic Microscope |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20240115 Address after: Room 5051 and 5053, No. 101 West Fourth Ring South Road, Fengtai District, Beijing, 100071 (Park) Patentee after: Beijing Dahua Sanxin Technology Development Co.,Ltd. Address before: No. 2, No. 1, Beichen West Road, Beichen, Beijing Patentee before: INSTITUTE OF GENETICS AND DEVELOPMENTAL BIOLOGY, CHINESE ACADEMY OF SCIENCES |
|
| TR01 | Transfer of patent right |