CN113358611A - Embedded three-dimensional photoelectric correlation imaging device and method - Google Patents

Embedded three-dimensional photoelectric correlation imaging device and method Download PDF

Info

Publication number
CN113358611A
CN113358611A CN202110469220.9A CN202110469220A CN113358611A CN 113358611 A CN113358611 A CN 113358611A CN 202110469220 A CN202110469220 A CN 202110469220A CN 113358611 A CN113358611 A CN 113358611A
Authority
CN
China
Prior art keywords
module
dimensional
scanning
electron microscope
vacuum
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN202110469220.9A
Other languages
Chinese (zh)
Other versions
CN113358611B (en
Inventor
徐涛
卢婧
纪伟
李尉兴
肖珂
张翔
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Institute of Biophysics of CAS
Original Assignee
Institute of Biophysics of CAS
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Institute of Biophysics of CAS filed Critical Institute of Biophysics of CAS
Priority to CN202110469220.9A priority Critical patent/CN113358611B/en
Publication of CN113358611A publication Critical patent/CN113358611A/en
Application granted granted Critical
Publication of CN113358611B publication Critical patent/CN113358611B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G01MEASURING; TESTING
    • G01NINVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N21/00Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
    • G01N21/62Systems in which the material investigated is excited whereby it emits light or causes a change in wavelength of the incident light
    • G01N21/63Systems in which the material investigated is excited whereby it emits light or causes a change in wavelength of the incident light optically excited
    • G01N21/64Fluorescence; Phosphorescence
    • G01N21/645Specially adapted constructive features of fluorimeters
    • G01N21/6456Spatial resolved fluorescence measurements; Imaging
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01NINVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N21/00Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
    • G01N21/01Arrangements or apparatus for facilitating the optical investigation
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01NINVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N21/00Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
    • G01N21/01Arrangements or apparatus for facilitating the optical investigation
    • G01N2021/0106General arrangement of respective parts
    • G01N2021/0112Apparatus in one mechanical, optical or electronic block

Landscapes

  • Health & Medical Sciences (AREA)
  • Physics & Mathematics (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Chemical & Material Sciences (AREA)
  • Analytical Chemistry (AREA)
  • Biochemistry (AREA)
  • General Health & Medical Sciences (AREA)
  • General Physics & Mathematics (AREA)
  • Immunology (AREA)
  • Pathology (AREA)
  • Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
  • Microscoopes, Condenser (AREA)

Abstract

一种嵌入式三维光电关联成像装置及方法,装置包括:电镜真空腔室、物镜模块、真空光学窗、扫描模块、光源模块、光电探测模块以及电镜成像模块;其中,物镜模块与电镜成像模块均设置在电镜真空腔室的内部,真空光学窗开设在电镜真空腔室的侧壁,并与物镜模块实现光路连通;扫描模块用于对光源模块发射的光束进行二维扫描,并将二维扫描光束通过真空光学窗传输至物镜模块,以使物镜模块对样品不同层面进行扫描;扫描模块还用于将物镜模块对样品不同层面扫描后得到的荧光和明场光线传输至光电探测模块进行光电探测;电镜成像模块用于对样品进行电镜成像。

Figure 202110469220

An embedded three-dimensional photoelectric correlation imaging device and method, the device comprises: an electron microscope vacuum chamber, an objective lens module, a vacuum optical window, a scanning module, a light source module, a photoelectric detection module and an electron microscope imaging module; wherein, the objective lens module and the electron microscope imaging module are both It is arranged inside the vacuum chamber of the electron microscope, and the vacuum optical window is opened on the side wall of the vacuum chamber of the electron microscope, and is connected with the objective lens module in the optical path; the scanning module is used for two-dimensional scanning of the light beam emitted by the light source module, and the two-dimensional scanning The light beam is transmitted to the objective lens module through the vacuum optical window, so that the objective lens module scans different layers of the sample; the scanning module is also used to transmit the fluorescence and brightfield light obtained after the objective lens module scans different layers of the sample to the photodetection module for photoelectric detection. ; The electron microscope imaging module is used for electron microscope imaging of the sample.

Figure 202110469220

Description

Embedded three-dimensional photoelectric correlation imaging device and method
Technical Field
The present disclosure relates to the field of photoelectric imaging, and in particular, to an embedded three-dimensional photoelectric correlation imaging apparatus and method.
Background
The fluorescent microscopic imaging realizes the positioning and observation of biological macromolecules and molecular compounds by marking specific protein or subcellular structures in cells through dyes or fluorescent molecules, and the resolution of most of fluorescent imaging is limited by the optical diffraction limit, so that the structural analysis of the biological macromolecules cannot be carried out. And cryo-electron tomography (cryo-ET) is a core technology for analyzing a biomacromolecule structure, and is used for reconstructing a three-dimensional image of a sample and analyzing the biomacromolecule structure by tilting the sample at different angles in a transmission electron microscope and acquiring a series of two-dimensional images. However, since the penetration depth of the electron beam is limited, the thickness of the sample cannot exceed 300nm, and most biological samples need to be thinned. At present, the thinning of a Focused Ion Beam (FIB) is the most promising thinning mode of a frozen sample, the FIB is generally integrated in a cavity of a Scanning Electron Microscope (SEM), a certain angle is formed between an ion emission gun and the sample, the upper surface and the lower surface of an interested area in the sample are cut and thinned, a flat sheet sample required by a transmission electron microscope can be obtained, and the prepared sheet sample is sent into the frozen transmission electron microscope through a freezing transmission system to be subjected to tomography imaging. In order to improve the efficiency and success rate of sample preparation, the fluorescence microscopy imaging and the electron microscopy imaging are correlated, and the navigation is provided for the accurate thinning of the FIB by combining the positioning advantage of the fluorescence microscope on target molecules and the resolution advantage of an electron microscope.
In carrying out the disclosed concept, applicants have discovered that the existing association of fluorescence microscopy and electron microscopy imaging has at least the following drawbacks: the axial resolution of the imaging by using the wide-field fluorescence microscope is very low, only two-dimensional information of a sample can be obtained, and the problem of three-dimensional information loss exists. In the imaging process, the sample is moved into the electron microscope from the light mirror, so that the risk of sample pollution is increased, and the requirement of immediately checking the fluorescence of the sample after thinning is difficult to realize.
BRIEF SUMMARY OF THE PRESENT DISCLOSURE
In view of the prior art, the present disclosure provides an embedded three-dimensional photoelectric correlation imaging apparatus and method, which are used to at least partially solve the above technical problems.
One aspect of the present disclosure provides an embedded three-dimensional photoelectric correlation imaging apparatus, including: the device comprises an electron microscope vacuum chamber 1, an objective lens module 2, a vacuum optical window 3, a scanning module 4, a light source module 5, a photoelectric detection module 6 and an electron microscope imaging module 7; the objective lens module 2 and the electron microscope imaging module 7 are both arranged inside the electron microscope vacuum chamber 1, and the vacuum optical window 3 is arranged on the side wall of the electron microscope vacuum chamber 1 and is communicated with the objective lens module 2 in a light path; the scanning module 4 is used for performing two-dimensional scanning on the light beam emitted by the light source module 5 and transmitting the two-dimensional scanning light beam to the objective lens module 2 through the vacuum optical window 3, so that the objective lens module 2 scans different layers of the sample; the scanning module 4 is also used for transmitting fluorescence and bright field light obtained after the objective lens module 2 scans different layers of the sample to the photoelectric detection module 6 for photoelectric detection; the electron microscope imaging module 7 is used for carrying out electron microscope imaging on the sample.
Optionally, the objective lens module 2 includes: 2-1 of a microscope objective, 2-2 of a vacuum piezoelectric displacement platform and 2-5 of a vacuum flange; wherein, the microscope objective 2-1 is arranged on the vacuum piezoelectric displacement platform 2-2, and the vacuum piezoelectric displacement platform 2-2 is arranged on the vacuum flange 2-5; the vacuum flange 2-5 is provided with a light path channel, the vacuum optical window 3 is connected with one end of the light path channel, and the vacuum piezoelectric displacement table 2-2 is used for driving the microscope objective 2-1 to axially scan different layers of the sample through two-dimensional scanning light beams.
Optionally, the objective lens module 2 further includes: a first mirror 2-3 and a second mirror 2-4 for deflecting the two-dimensional scanning beam passing through the optical path.
Optionally, the scanning module 4 comprises: the device comprises a light source interface 4-1, a dichroic mirror 4-2, an X-direction scanning galvanometer 4-3, a first relay mirror 4-4, a second relay mirror 4-5, a Y-direction scanning mirror 4-6, a scanning lens 4-7 and a microscope 4-8; the light source interface 4-1 is used for receiving the light beam emitted by the light source module 5; the dichroic mirror 4-2 is used for reflecting the light beam to the X-direction scanning galvanometer 4-3, the X-direction scanning galvanometer 4-3 is used for carrying out X-direction scanning on the light beam and reflecting the light beam to the second relay mirror 4-5 and the first relay mirror 4-4, the Y-direction scanning mirror 4-6 is used for carrying out Y-direction scanning on the light beam emitted by the first relay mirror 4-4 to obtain a two-dimensional scanning light beam, and the two-dimensional scanning light beam is reflected to the vacuum optical window 3 after passing through the scanning lens 4-7 and the microscope 4-8; the first relay mirror 4-4 and the second relay mirror 4-5 make the X-direction scanning galvanometer 4-3 conjugate with the Y-direction scanning galvanometer 4-6.
Optionally, the scanning module 4 further comprises: and the pinhole 4-9 is used for filtering the fluorescence and bright field light rays returned along the optical path of the scanning module 4 and transmitting the filtered fluorescence and bright field light rays to the photoelectric detection module 6 for photoelectric detection.
Alternatively, the pinholes 4-9 comprise fixed pinholes or variable pinholes.
Optionally, the light source module 5 is a multi-path coupled laser light source.
Optionally, the photo detection module 6 comprises at least one point detector, wherein when the photo detection module 6 comprises a plurality of point detectors, a dichroic mirror is arranged between different point detectors to distinguish different detection wavelengths.
Optionally, the point detector comprises a photomultiplier tube or an avalanche diode.
The present disclosure provides a photoelectric correlation imaging method based on the above embedded three-dimensional photoelectric correlation imaging apparatus, including: placing the sample in an electron microscope imaging position 8, and performing electron microscope imaging on the sample by using an electron microscope imaging module 7 to obtain an electron microscope image; moving the sample to an optical lens imaging position 9, and scanning different layers of the sample by using an objective lens module 2 based on a two-dimensional scanning light beam transmitted by a scanning module 4 to obtain a three-dimensional fluorescence image and a three-dimensional bright field image; and calculating coordinate transformation from the three-dimensional fluorescence image to the electron microscope image based on the three-dimensional bright field image, and associating the three-dimensional bright field image with the electron microscope image.
Drawings
Fig. 1 schematically shows a structure diagram of an embedded three-dimensional photoelectric correlation imaging device provided by an embodiment of the disclosure;
fig. 2 schematically illustrates a structural view of an objective lens module provided by an embodiment of the present disclosure;
FIG. 3 schematically illustrates a block diagram of a scanning module provided by an embodiment of the present disclosure;
FIG. 4 schematically illustrates a flow chart of an embedded three-dimensional photoelectric correlation imaging method of an embodiment of the present disclosure;
fig. 5 schematically shows a result graph of embedded three-dimensional photoelectric correlation imaging of an embodiment of the present disclosure.
[ description of reference ]
1-electron microscope vacuum chamber;
2-an objective lens module;
2-1-microobjective; 2-2-vacuum piezoelectric displacement table; 2-3-a first mirror; 2-4-second mirror; 2-5-vacuum flange;
3-a vacuum optical window;
4-a scanning module;
4-1-light source interface; a 4-2-dichroic mirror; 4-3-X direction scanning galvanometer; 4-4-a first relay mirror; 4-5-a second relay mirror; a 4-6-Y direction scanning mirror; 4-7-a scanning lens; 4-8-microscopic cylindrical lens; 4-9-pinhole;
5-a light source module;
6-a photoelectric detection module;
7-electron microscope imaging module
8-electron microscope imaging position;
9-optical imaging station.
Detailed Description
For the purpose of promoting a better understanding of the objects, aspects and advantages of the present disclosure, reference is made to the following detailed description taken in conjunction with the accompanying drawings.
Fig. 1 schematically shows a structure diagram of an embedded three-dimensional photoelectric correlation imaging device provided by an embodiment of the disclosure.
As shown in fig. 1, the embedded three-dimensional photoelectric correlation imaging apparatus may include:
the device comprises an electron microscope vacuum chamber 1, an objective lens module 2, a vacuum optical window 3, a scanning module 4, a light source module 5, a photoelectric detection module 6 and an electron microscope imaging module 7.
Objective module 2 and electronic speculum imaging module 7 all can set up in the inside of electronic speculum vacuum chamber 1, and vacuum optical window 3 is seted up at the lateral wall of electronic speculum vacuum chamber 1 to realize the light path intercommunication with objective module 2.
The vacuum optical window 3 is used for connecting light paths inside and outside the vacuum chamber 1 of the electron microscope without influencing the vacuum degree in the vacuum chamber 1 of the electron microscope, the light source module 5 is used for providing a light source required for exciting fluorescence and bright field illumination of a sample, the scanning module 4 is used for carrying out two-dimensional scanning on light beams emitted by the light source module 5, scanning points focused on the sample into a plane and transmitting the two-dimensional scanning light beams to the objective lens module 2 through the vacuum optical window 3, so that the objective lens module 2 scans different layers of the sample to realize three-dimensional imaging, the scanning module 4 is also used for collecting fluorescence and bright field light rays obtained after the objective lens module 2 scans different layers of the sample, and the fluorescence and bright field light are transmitted to the photoelectric detection module 6, and the photoelectric detection module 6 is used for performing photoelectric detection on the fluorescence and bright field light, converting the optical signal into an electric signal and acquiring and imaging. The electron microscope imaging module 7 is used for carrying out electron microscope imaging on the sample.
The embedded three-dimensional photoelectric correlation imaging device provided by the embodiment of the disclosure is further described with reference to the drawings.
Fig. 2 schematically illustrates a structural view of an objective lens module provided by an embodiment of the present disclosure.
As shown in fig. 2, the objective lens module 2 may include, for example:
2-1 of microscope objective, 2-2 of vacuum piezoelectric displacement platform and 2-5 of vacuum flange. The microscope objective 2-1 is arranged on the vacuum piezoelectric displacement platform 2-2, and the vacuum piezoelectric displacement platform 2-2 is arranged on the vacuum flange 2-5. The vacuum flange 2-5 is provided with a light path channel, the vacuum optical window 3 is connected with one end of the light path channel, and the vacuum piezoelectric displacement table 2-2 is used for driving the microscope objective 2-1 to axially scan different layers of a sample through a two-dimensional scanning light beam so as to ensure three-dimensional optical imaging. Wherein, the microscope objective 2-1 can be any commercial microscope objective
With reference to fig. 2, the objective lens module 2 may further include:
the first reflector 2-3 and the second reflector 2-4 are used for turning the two-dimensional scanning beam passing through the optical path channel to avoid collision.
According to the embodiment of the disclosure, the vacuum flange 2-5 can be further provided with a groove and threads for mounting the vacuum optical window 3 and a clamp, the vacuum piezoelectric displacement table 2-2, the reflectors 2-3 and 2-4 are mounted on the clamp, the clamp is mounted on the vacuum flange 2-5 through screws, the vacuum optical window 3 is fixed on the vacuum flange 2-5 in an adhesive manner, the vacuum flange 2-5 has the same shape and size as the original vacuum flange on the vacuum chamber 1 of the electron microscope, but a vacuum optical window mounting opening and an optical path channel are additionally processed, and a two-dimensional scanning beam can pass through the vacuum optical window without being shielded. Through the vacuum flange of this kind of structure, can guarantee better that vacuum optical window 3 connects the objective module in electron microscope vacuum chamber 1, do not influence the vacuum in electron microscope vacuum chamber 1 simultaneously.
Fig. 3 schematically shows a structural diagram of a scanning module provided in an embodiment of the present disclosure.
As shown in fig. 3, the scanning module 4 may include, for example:
the device comprises a light source interface 4-1, a dichroic mirror 4-2, an X-direction scanning galvanometer 4-3, a first relay mirror 4-4, a second relay 4-5, a Y-direction scanning mirror 4-6, a scanning lens 4-7 and a microscope 4-8.
Referring to fig. 1 to 3, the light source interface 4-1 is connected to the light source module 5 through an optical fiber, and is configured to receive the light beam emitted by the light source module 5. The dichroic mirror 4-2 is used for reflecting the collimated light beam to the X-direction scanning galvanometer 4-3. The X-direction scanning galvanometer 4-3 is used for scanning the light beam in the X direction and reflecting the light beam to the second relay mirror 4-5 and the first relay mirror 4-4. The Y-direction scanning mirror 4-6 is used for carrying out Y-direction scanning on the light beam emitted by the first relay mirror 4-4 to obtain a two-dimensional scanning light beam. The two-dimensional scanning light beam is reflected to the vacuum optical window 3 after passing through the scanning lens 4-7 and the microscope 4-8, enters the light path of the vacuum flange 2-3 through the vacuum optical window 3, is then reflected by the second reflecting mirror 2-4 and the first reflecting mirror 2-3, enters the microscope objective 2-1 and is focused on a sample, the microscope objective 2-1 is installed on the vacuum piezoelectric displacement table 2-2, and different layers of the sample are imaged through axial scanning of the vacuum piezoelectric displacement table 2-2, so that three-dimensional imaging is realized.
The first relay lens 4-4 and the second relay lens 4-5 ensure the conjugate relation between the X-direction scanning galvanometer 4-3 and the Y-direction scanning galvanometer 4-6, so that light spots are kept relatively static on the X-direction scanning galvanometer 4-3 and the Y-direction scanning galvanometer 4-6, and pupil drift is avoided. The relay mirror may be a lens, a spherical mirror, or an off-axis parabolic mirror, and in a specific example of the present disclosure, the relay mirror is selected to be an off-axis parabolic mirror.
According to the embodiment of the present disclosure, the scanning module 4 may further include a pinhole 4-9, for example, for filtering the fluorescence and bright field light returning along the optical path of the scanning module 4, and transmitting the filtered fluorescence and bright field light to the photodetection module 6 for photodetection. Specifically, with reference to fig. 1 to 3, the excited fluorescence and bright field light in the sample return to the dichroic mirror 4-2 along the original path, and reach the pinhole 4-9 through the dichroic mirror 4-2, and the pinhole 4-9 filters light from outside the focal plane of the sample, and enters the optical detection module 6 for photoelectric detection.
In the disclosed embodiment, the pinholes 4-9 may comprise fixed pinholes or variable pinholes, for example, an electrically variable pinhole is selected as the pinhole 4-9.
In the embodiment of the present disclosure, the light source module 5 may be a multi-path coupled laser light source. The photo detection module 6 comprises at least one point detector, wherein, when the photo detection module 6 comprises a plurality of point detectors, a dichroic mirror is arranged between the different point detectors to distinguish different detection wavelengths, and the point detectors may comprise photomultiplier tubes or avalanche diodes, for example two photomultiplier tubes are selected as the detectors.
In the embodiment of the present disclosure, the electron microscope imaging module 7 may include, for example, an electron emission gun and an ion emission gun. The ion emission gun and the sample are arranged at a certain angle, so that the upper surface and the lower surface of an interested area in the sample can be cut and thinned, and a flat sheet sample required by a transmission electron microscope can be obtained.
In the embodiment of the present disclosure, an electron microscope imaging position 8 and an optical lens imaging position 9 are further disposed in the electron microscope vacuum chamber 1, before three-dimensional photoelectric correlation imaging is performed, a three-dimensional space coordinate distance between the electron microscope imaging position 8 and the optical lens imaging position 9 needs to be manually calibrated, the distance is only related to imaging device hardware, is irrelevant to a sample, and is only used for rapidly positioning a target area, the precision requirement is low, the calibration is applicable for a long time after one time, and re-calibration is not needed until the imaging device hardware changes.
The embedded three-dimensional photoelectric correlation imaging device provided by the embodiment of the disclosure is provided with the objective lens module 2 and the scanning module 4 matched with the objective lens module, and can realize axial scanning on different layers of a sample by using a two-dimensional scanning light beam obtained by the scanning module 4 and combining the objective lens module 2 so as to obtain three-dimensional information of the sample, thereby solving the problem of three-dimensional information loss in the existing photoelectric correlation imaging. Simultaneously, objective module 2 and electron microscope imaging module 7 all set up in electron microscope vacuum chamber 1's inside for electron microscope imaging and optical imaging all can be accomplished at electron microscope vacuum chamber 1, have reduced the sample and have shifted the number of times, reduce the risk of sample pollution. In addition, due to the combination of the objective lens module and the scanning module, the imaging device can be applied to most commercial double-beam scanning electron microscopes on the market, and the cost is reduced.
Based on the same inventive concept, the embodiment of the disclosure also provides an embedded three-dimensional photoelectric correlation imaging method.
Fig. 4 schematically shows a flowchart of an embedded three-dimensional photoelectric correlation imaging method according to an embodiment of the present disclosure.
As shown in fig. 4, the method may include, for example, operations S401 to S403.
In operation S401, the sample is placed in the electron microscope imaging position 8, and the electron microscope imaging module 7 is used to perform electron microscope imaging on the sample, so as to obtain an electron microscope image.
In the embodiment of the disclosure, the sample loaded in the electron microscope chamber is moved to the electron microscope imaging position 8, the state of the sample is quickly browsed in a low power mode, the damage conditions of the sample such as the presence or absence of the film breakage of the carrier net and the like are observed, a region with a complete sample is found, the mode is switched to a medium power mode, the region is moved to the center of a field of view, and an electron microscope image excited by an ion beam and the current position coordinate are stored. The electron microscope image is shown in fig. 5 c.
In operation S402, the sample is moved to the optical lens imaging position 9, and different layers of the sample are scanned by using the objective module 2 based on the two-dimensional scanning beam transmitted by the scanning module 4, so as to obtain a three-dimensional fluorescence image and a three-dimensional bright field image.
In the embodiment of the present disclosure, the sample is moved to the imaging position 9 of the optical mirror according to the coordinate distance between the imaging position 9 of the optical mirror and the imaging position 8 of the electron microscope, and the three-dimensional bright field image and the three-dimensional fluorescence image of the sample are simultaneously acquired by using the embedded optical imaging device, where the maximum projections of the three-dimensional bright field image and the three-dimensional fluorescence image are shown as a and b in fig. 5. The bright field image contains coordinate grid information, and the selection of the target area can be quickly confirmed again.
In operation S403, a coordinate transformation from the three-dimensional fluorescence image to the electron microscope image is calculated based on the three-dimensional bright field image, and the three-dimensional bright field image is associated with the electron microscope image.
In the embodiment of the disclosure, first, in an electron microscope image excited by an ion beam and a fluorescence image generated by imaging with a light mirror, 3 to 8 corresponding locating points are found, the locating points are particles with a regular shape of hundreds of nanometers to several micrometers, and can emit fluorescence after being irradiated by laser, for example, b and c in fig. 5, 6 locating marks are selected for locating, coordinates of the locating points in the two images are recorded, and software can be used for recording. Then, based on the recorded coordinates, coordinate transformation from the three-dimensional fluorescence image to the electron microscope image excited by the ion beam is calculated through coordinate transformation parameter fitting, so that three-dimensional photoelectric correlation imaging is realized, and the image after the photoelectric correlation imaging is shown as d in fig. 5.
The photoelectric correlation imaging method provided by the embodiment of the disclosure can acquire three-dimensional information of a sample, reduces pollution of the sample in the imaging process, and has high image quality after photoelectric correlation imaging.
The above-mentioned embodiments are intended to illustrate the objects, aspects and advantages of the present disclosure in further detail, and it should be understood that the above-mentioned embodiments are only illustrative of the present disclosure and are not intended to limit the present disclosure, and any modifications, equivalents, improvements and the like made within the spirit and principle of the present disclosure should be included in the scope of the present disclosure.

Claims (10)

1.一种嵌入式三维光电关联成像装置,包括:1. An embedded three-dimensional photoelectric correlation imaging device, comprising: 电镜真空腔室(1)、物镜模块(2)、真空光学窗(3)、扫描模块(4)、光源模块(5)、光电探测模块(6)以及电镜成像模块(7);Electron microscope vacuum chamber (1), objective lens module (2), vacuum optical window (3), scanning module (4), light source module (5), photoelectric detection module (6) and electron microscope imaging module (7); 其中,所述物镜模块(2)与所述电镜成像模块(7)均设置在所述电镜真空腔室(1)的内部,所述真空光学窗(3)开设在所述电镜真空腔室(1)的侧壁,并与所述物镜模块(2)实现光路连通;Wherein, the objective lens module (2) and the electron microscope imaging module (7) are both arranged inside the electron microscope vacuum chamber (1), and the vacuum optical window (3) is opened in the electron microscope vacuum chamber ( 1) side wall, and realizes optical path communication with the objective lens module (2); 所述扫描模块(4)用于对所述光源模块(5)发射的光束进行二维扫描,并将二维扫描光束通过所述真空光学窗(3)传输至所述物镜模块(2),以使所述物镜模块(2)对样品不同层面进行扫描;The scanning module (4) is configured to perform two-dimensional scanning on the light beam emitted by the light source module (5), and transmit the two-dimensional scanning light beam to the objective lens module (2) through the vacuum optical window (3), so that the objective lens module (2) scans different layers of the sample; 所述扫描模块(4)还用于将物镜模块(2)对样品不同层面扫描后得到的荧光和明场光线传输至所述光电探测模块(6)进行光电探测;The scanning module (4) is further configured to transmit the fluorescence and bright field light obtained after the objective lens module (2) scans different layers of the sample to the photoelectric detection module (6) for photoelectric detection; 所述电镜成像模块(7)用于对所述样品进行电镜成像。The electron microscope imaging module (7) is used for performing electron microscope imaging on the sample. 2.根据权利要求1所述的嵌入式三维光电关联成像装置,其中,所述物镜模块(2)包括:2. The embedded three-dimensional photoelectric correlation imaging device according to claim 1, wherein the objective lens module (2) comprises: 显微物镜(2-1)、真空压电位移台(2-2)及真空法兰(2-5);Microscope objective lens (2-1), vacuum piezoelectric stage (2-2) and vacuum flange (2-5); 其中,所述显微物镜(2-1)安装在所述真空压电位移台(2-2)上,所述真空压电位移台(2-2)安装在所述真空法兰(2-5)上;Wherein, the microscope objective lens (2-1) is mounted on the vacuum piezoelectric displacement stage (2-2), and the vacuum piezoelectric displacement stage (2-2) is mounted on the vacuum flange (2-2). 5) on; 所述真空法兰(2-5)上设有光路通道,所述真空光学窗(3)连接所述光路通道的一端,所述真空压电位移台(2-2)用于带动所述显微物镜(2-1)通过所述二维扫描光束对所述样品不同层面进行轴向扫描。The vacuum flange (2-5) is provided with an optical path channel, the vacuum optical window (3) is connected to one end of the optical path channel, and the vacuum piezoelectric displacement stage (2-2) is used to drive the display device. The micro-objective lens (2-1) axially scans different layers of the sample through the two-dimensional scanning beam. 3.根据权利要求2所述的嵌入式三维光电关联成像装置,其中,所述物镜模块(2)还包括:3. The embedded three-dimensional photoelectric correlation imaging device according to claim 2, wherein the objective lens module (2) further comprises: 第一反射镜(2-3)和第二反射镜(2-4),用于对通过所述光路通道的二维扫描光束进行转折。The first reflecting mirror (2-3) and the second reflecting mirror (2-4) are used for turning the two-dimensional scanning light beam passing through the optical path channel. 4.根据权利要求1所述的嵌入式三维光电关联成像装置,其中,所述扫描模块(4)包括:4. The embedded three-dimensional photoelectric correlation imaging device according to claim 1, wherein the scanning module (4) comprises: 光源接口(4-1)、二向色镜(4-2)、X方向扫描振镜(4-3)、第一中继镜(4-4)、第二中继镜(4-5)、Y方向扫描镜(4-6)、扫描透镜(4-7)及显微筒镜(4-8);Light source interface (4-1), dichroic mirror (4-2), X-direction scanning galvanometer (4-3), first relay lens (4-4), second relay lens (4-5) , Y-direction scanning mirror (4-6), scanning lens (4-7) and microscope tube (4-8); 所述光源接口(4-1)用于接收所述光源模块(5)发射的光束;所述二向色镜(4-2)用于将所述光束反射至X方向扫描振镜(4-3),所述X方向扫描振镜(4-3)用于对所述光束进行X方向扫描并反射至第二中继镜(4-5)与第一中继镜(4-4),所述Y方向扫描镜(4-6)用于对所述第一中继镜(4-4)发射的光束进行Y方向扫描,得到所述二维扫描光束,所述二维扫描光束经所述扫描透镜(4-7)与显微筒镜(4-8)后被反射至所述真空光学窗(3);其中,所述第一中继镜(4-4)与第二中继镜(4-5)使得所述X方向扫描振镜(4-3)与所述Y方向扫描镜(4-6)共轭。The light source interface (4-1) is used to receive the light beam emitted by the light source module (5); the dichroic mirror (4-2) is used to reflect the light beam to the X-direction scanning galvanometer (4- 3), the X-direction scanning galvanometer (4-3) is used to scan the light beam in the X-direction and reflect it to the second relay mirror (4-5) and the first relay mirror (4-4), The Y-direction scanning mirror (4-6) is used to perform Y-direction scanning on the light beam emitted by the first relay mirror (4-4) to obtain the two-dimensional scanning light beam, and the two-dimensional scanning light beam is passed through the The scanning lens (4-7) and the microscope tube (4-8) are reflected to the vacuum optical window (3); wherein, the first relay lens (4-4) and the second relay are A mirror (4-5) makes the X-direction scanning mirror (4-3) conjugate with the Y-direction scanning mirror (4-6). 5.根据权利要求4所述的嵌入式三维光电关联成像装置,其中,所述扫描模块(4)还包括:5. The embedded three-dimensional photoelectric correlation imaging device according to claim 4, wherein the scanning module (4) further comprises: 针孔(4-9),用于对沿扫描模块(4)光路返回的所述荧光和明场光线进行过滤,并将过滤后的荧光和明场光线传输至所述光电探测模块(6)进行光电探测。Pinholes (4-9) for filtering the fluorescence and brightfield light returned along the optical path of the scanning module (4), and transmitting the filtered fluorescence and brightfield light to the photoelectric detection module (6) photoelectric detection. 6.根据权利要求5所述的嵌入式三维光电关联成像装置,其中,所述针孔(4-9)包括固定针孔或可变针孔。6. The embedded three-dimensional photoelectric correlation imaging device according to claim 5, wherein the pinholes (4-9) comprise fixed pinholes or variable pinholes. 7.根据权利要求1所述的嵌入式三维光电关联成像装置,其中,所述光源模块(5)为多路耦合激光光源。7. The embedded three-dimensional photoelectric correlation imaging device according to claim 1, wherein the light source module (5) is a multi-channel coupled laser light source. 8.根据权利要求1所述的嵌入式三维光电关联成像装置,其中,所述光电探测模块(6)包括至少一个点探测器,其中,当所述光电探测模块(6)包括多个点探测器时,不同点探测器之间设有二向色镜,以区分不同的探测波长。8. The embedded three-dimensional photoelectric correlation imaging device according to claim 1, wherein the photoelectric detection module (6) comprises at least one point detector, wherein when the photoelectric detection module (6) comprises a plurality of point detectors When the detector is used, a dichroic mirror is arranged between the detectors at different points to distinguish different detection wavelengths. 9.根据权利要求8所述的嵌入式三维光电关联成像装置,其中,所述点探测器包括光电倍增管或雪崩二极管。9. The embedded three-dimensional photo-correlation imaging device of claim 8, wherein the point detector comprises a photomultiplier tube or an avalanche diode. 10.一种基于权利要求1-9任一项所述嵌入式三维光电关联成像装置的光电关联成像方法,包括:10. A photoelectric correlation imaging method based on the embedded three-dimensional photoelectric correlation imaging device according to any one of claims 1-9, comprising: 将样品置于电镜成像位(8),使用电镜成像模块(7)对所述样品进行电镜成像,得到电镜图像;placing the sample in the electron microscope imaging position (8), and using the electron microscope imaging module (7) to perform electron microscope imaging on the sample to obtain an electron microscope image; 将所述样品移动至光镜成像位(9),基于扫描模块(4)传输的二维扫描光束,使用物镜模块(2)对所述样品进行不同层面进行扫描,得到三维荧光图像和三维明场图像;The sample is moved to the optical mirror imaging position (9), and based on the two-dimensional scanning beam transmitted by the scanning module (4), the sample is scanned at different levels using the objective lens module (2) to obtain a three-dimensional fluorescence image and a three-dimensional bright image. field image; 基于所述三维明场图像,计算所述三维荧光图像到所述电镜图像的坐标变换,将所述三维明场图像与所述电镜图像进行关联。Based on the three-dimensional bright field image, the coordinate transformation of the three-dimensional fluorescence image to the electron microscope image is calculated, and the three-dimensional bright field image is associated with the electron microscope image.
CN202110469220.9A 2021-04-28 2021-04-28 Embedded three-dimensional photoelectric correlation imaging device and method Active CN113358611B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202110469220.9A CN113358611B (en) 2021-04-28 2021-04-28 Embedded three-dimensional photoelectric correlation imaging device and method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202110469220.9A CN113358611B (en) 2021-04-28 2021-04-28 Embedded three-dimensional photoelectric correlation imaging device and method

Publications (2)

Publication Number Publication Date
CN113358611A true CN113358611A (en) 2021-09-07
CN113358611B CN113358611B (en) 2022-10-28

Family

ID=77525793

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202110469220.9A Active CN113358611B (en) 2021-04-28 2021-04-28 Embedded three-dimensional photoelectric correlation imaging device and method

Country Status (1)

Country Link
CN (1) CN113358611B (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115575364A (en) * 2022-09-30 2023-01-06 中国科学院生物物理研究所 Ion Beam Processing Method Based on Optical Microscopic Imaging

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103308496A (en) * 2012-03-16 2013-09-18 徐涛 Novel ultrahigh resolution photoelectric integration micro-imaging system
CN104142302A (en) * 2014-07-28 2014-11-12 中国科学院生物物理研究所 Optical vacuum cold station for light microscope and electron microscope correlated imaging
CN104215580A (en) * 2014-09-23 2014-12-17 中国科学技术大学 Method and device for correlated micro-imaging of frozen light microscope and frozen electron microscope
CN110864940A (en) * 2018-08-28 2020-03-06 国家纳米科学中心 A kind of sample pretreatment method and application of in-situ light-electron microscope correlation detection of transmission electron microscope
WO2020218667A1 (en) * 2019-04-23 2020-10-29 한국표준과학연구원 Optical objective lens alignment mount for sample chamber, light-reflecting mirror having electron through-hole and mounted on mount, and correlative light and electron microscope having spectrometer and comprising same

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103308496A (en) * 2012-03-16 2013-09-18 徐涛 Novel ultrahigh resolution photoelectric integration micro-imaging system
CN104142302A (en) * 2014-07-28 2014-11-12 中国科学院生物物理研究所 Optical vacuum cold station for light microscope and electron microscope correlated imaging
CN104215580A (en) * 2014-09-23 2014-12-17 中国科学技术大学 Method and device for correlated micro-imaging of frozen light microscope and frozen electron microscope
CN110864940A (en) * 2018-08-28 2020-03-06 国家纳米科学中心 A kind of sample pretreatment method and application of in-situ light-electron microscope correlation detection of transmission electron microscope
WO2020218667A1 (en) * 2019-04-23 2020-10-29 한국표준과학연구원 Optical objective lens alignment mount for sample chamber, light-reflecting mirror having electron through-hole and mounted on mount, and correlative light and electron microscope having spectrometer and comprising same

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
徐晓君: ""超稳冷冻超分辨荧光显微成像系统构建与冷冻光电融合成像支撑膜探索研究"", 《中国优秀博士学位论文全文数据库 基础科学辑》 *
李尉兴等: "冷冻超分辨光电融合成像技术――新挑战,新机遇", 《生物化学与生物物理进展》 *

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115575364A (en) * 2022-09-30 2023-01-06 中国科学院生物物理研究所 Ion Beam Processing Method Based on Optical Microscopic Imaging
EP4345440A1 (en) * 2022-09-30 2024-04-03 Institute of Biophysics Chinese Academy of Sciences Method of processing ion beam based on optical microscopy imaging

Also Published As

Publication number Publication date
CN113358611B (en) 2022-10-28

Similar Documents

Publication Publication Date Title
US6888148B2 (en) Arrangement for the optical capture of excited and /or back scattered light beam in a sample
US7113624B2 (en) Imaging apparatus and method employing a large linear aperture
US6947127B2 (en) Arrangement for the optical capture of excited and/or back scattered light beam in a sample
CN102841083B (en) Method and system of laser scanning phase-microscope imaging
CN103080807B (en) Be used for carrying out self-focusing method and apparatus to nutrient culture media in fluorescence microscopy
JP6596001B2 (en) Multifocal multiphoton imaging system and method
JP4945025B2 (en) Scanning microscope method with high axial resolution
CN108956561A (en) Copolymerization coke and annular total internal reflection double mode microscopic system based on scanning galvanometer
US7286224B2 (en) Time-multiplexed scanning light source for multi-probe, multi-laser fluorescence detection systems
ES2928577T3 (en) 2D and 3D Fixed Z-Scan
WO2012002886A1 (en) Confocal fluorescence lifetime imaging system
CN107003505A (en) Line scan, sample scan, multimode confocal microscope
US7280261B2 (en) Method of scanning and light collection for a rare cell detector
CN103954598A (en) Axial high-accuracy location method and device based on evanescent wave illumination
CN113358611A (en) Embedded three-dimensional photoelectric correlation imaging device and method
CN115656130A (en) A Fluorescence Emission Ratio Three-Dimensional Super-resolution Imaging Method
EP1806575B1 (en) Examination apparatus
JP4163301B2 (en) Scanning cytometer
US7545498B2 (en) System and method for removing auto-fluorescence through the use of multiple detection channels
JP2006275964A (en) Shading correction method for scanning fluorescence microscope
US20230221178A1 (en) Apparatus and a method for fluorescence imaging
US20220326502A1 (en) Apparatuses, systems and methods for solid immersion meniscus lenses
CN114910457A (en) Cathode fluorescence confocal micro-spectral imaging system and method
CN117434042B (en) Automated tomographic imaging system for fusing optical microscopic imaging and large sample tissue slice
US20230105897A1 (en) Methods and Systems for Blazed Mirror Oblique Plane Microscopy (OPM) Imaging of Oblique Planes

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant