WO2019096062A1 - Light-sheet illumination microsection imaging system and imaging result processing method - Google Patents

Light-sheet illumination microsection imaging system and imaging result processing method Download PDF

Info

Publication number
WO2019096062A1
WO2019096062A1 PCT/CN2018/114705 CN2018114705W WO2019096062A1 WO 2019096062 A1 WO2019096062 A1 WO 2019096062A1 CN 2018114705 W CN2018114705 W CN 2018114705W WO 2019096062 A1 WO2019096062 A1 WO 2019096062A1
Authority
WO
WIPO (PCT)
Prior art keywords
imaging
sample
illumination
light sheet
light
Prior art date
Application number
PCT/CN2018/114705
Other languages
French (fr)
Chinese (zh)
Inventor
曾绍群
骆清铭
张其
杨雄
白柯
李宁
Original Assignee
华中科技大学
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 华中科技大学 filed Critical 华中科技大学
Publication of WO2019096062A1 publication Critical patent/WO2019096062A1/en

Links

Images

Classifications

    • GPHYSICS
    • G01MEASURING; TESTING
    • G01NINVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N21/00Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
    • G01N21/01Arrangements or apparatus for facilitating the optical investigation
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01NINVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N21/00Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
    • G01N21/62Systems in which the material investigated is excited whereby it emits light or causes a change in wavelength of the incident light
    • G01N21/63Systems in which the material investigated is excited whereby it emits light or causes a change in wavelength of the incident light optically excited
    • G01N21/64Fluorescence; Phosphorescence
    • G01N21/6402Atomic fluorescence; Laser induced fluorescence
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01NINVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N21/00Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
    • G01N21/62Systems in which the material investigated is excited whereby it emits light or causes a change in wavelength of the incident light
    • G01N21/63Systems in which the material investigated is excited whereby it emits light or causes a change in wavelength of the incident light optically excited
    • G01N21/64Fluorescence; Phosphorescence
    • G01N21/645Specially adapted constructive features of fluorimeters
    • G01N21/6456Spatial resolved fluorescence measurements; Imaging
    • G01N21/6458Fluorescence microscopy
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01NINVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N21/00Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
    • G01N21/62Systems in which the material investigated is excited whereby it emits light or causes a change in wavelength of the incident light
    • G01N21/63Systems in which the material investigated is excited whereby it emits light or causes a change in wavelength of the incident light optically excited
    • G01N21/64Fluorescence; Phosphorescence
    • G01N21/6486Measuring fluorescence of biological material, e.g. DNA, RNA, cells
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01NINVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N21/00Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
    • G01N21/62Systems in which the material investigated is excited whereby it emits light or causes a change in wavelength of the incident light
    • G01N21/63Systems in which the material investigated is excited whereby it emits light or causes a change in wavelength of the incident light optically excited
    • G01N21/64Fluorescence; Phosphorescence
    • G01N21/645Specially adapted constructive features of fluorimeters
    • G01N2021/6463Optics

Definitions

  • the invention belongs to the field of biological imaging, and more particularly to a light sheet illumination microsection imaging system and an imaging result processing method.
  • FIG. 1 is a schematic illustration of a conventional light sheet illumination microscopy imaging system.
  • the light sheet illumination microscopic imaging system includes an illumination light path portion 101, a probe light path portion 103, and a sample moving portion 105.
  • the illumination light path portion 101 forms a light sheet illumination sample, and the excitation sample generates a fluorescence signal; the fluorescence signal passes through the detection light path.
  • the objective lens of the portion 103 and the focusing lens are collected and imaged onto the detector surface; the sample moving portion 105 carries the sample 107 for movement or rotation to image the entire sample.
  • FIG. 2 is a schematic illustration of a prior art micro-optical tomography system.
  • the micro-optical tomography system includes an imaging device 201, a sample plane cutting device 203, and a three-dimensional moving platform 205; the three-dimensional moving platform 205 carries the sample 207 in the cutting direction, and the sample plane cutting device 203 samples the sample 207.
  • the surface layer is cut one by one.
  • the image forming apparatus 201 performs line scan imaging on the cut portion leaving the sample, and the strip image is used to splicing the image of the entire section, and the three-dimensional structure of the sample is reconstructed from the sectional image.
  • the present invention provides a light sheet illumination microsection imaging system and an imaging result processing method, which are intended to solve the problem that the existing optical microscopic imaging system cannot acquire large volume biological samples.
  • High resolution especially high axial resolution.
  • a light sheet illumination microsection imaging system including a light sheet illumination imaging apparatus, a sample surface cutting apparatus, a sample moving apparatus, and an imaging result processing apparatus;
  • the device performs light sheet illumination imaging on the sample surface by oblique incident illumination and oblique detection;
  • the sample surface cutting device is used to cut the surface of the sample that has been imaged by the light sheet illumination imaging device to expose the unimaged portion;
  • the sample moving device is used for control The sample is moved such that different portions of the sample are cut by the sample cutting device and imaged by the light sheet illumination imaging device;
  • the imaging result processing device is used to control the coordination of other devices and to perform real-time processing of the raw imaging data acquired from the light illumination imaging device.
  • the light sheet illumination imaging device comprises an illumination module and a detection module; the illumination module is configured to form a light sheet illumination sample to excite the sample to generate fluorescence; and the detection module is configured to collect the fluorescence signal generated by the sample and image the same;
  • the illumination module comprises: a laser disposed in the direction of the optical path, a beam shaping unit and an illumination objective lens; the laser is used for emitting collimated light, and the beam shaping unit is configured to shape the collimated light emitted by the laser into a line spot, and the illumination objective lens A line spot for shaping the beam shaping unit is conjugated to the surface of the sample to form a light sheet, and the sample is illuminated;
  • the beam shaping unit comprises: a laser beam expanding unit and a beam compressing unit; the laser beam expanding unit is configured to expand the collimated light emitted by the laser in two dimensions, and the size of the beam expands by the illumination piece to be generated. The width is determined; the beam compression unit is configured to compress the collimated light into a line spot and form a light sheet to illuminate the sample;
  • the laser beam expanding unit includes: a first lens and a second lens disposed along the optical path direction confocal common optical axis, the first lens being a convex lens or a concave lens, and the second lens being a convex lens or a concave lens.
  • the beam compression unit comprises: a co-focusing cylindrical lens and an illumination barrel; the cylindrical lens is used to compress the collimated light into a line spot, and the illumination barrel is used to form a light sheet to illuminate the sample.
  • the detecting module comprises: an imaging objective lens, an imaging cylinder mirror and a detector; the imaging objective lens is used for imaging the fluorescence signal excited by the sample, and the imaging cylinder mirror is combined with the imaging objective lens to perfectly correct the aberration of the imaging objective lens, and the detector is used for the detector. Filming and recording the enlarged imaging results;
  • the laser When the sample is imaged, the laser emits collimated light; the collimated light passes through the beam shaping unit and the illumination objective lens to form a light sheet, and the sample is illuminated to excite the sample to generate a fluorescent signal; the fluorescent signal generated by the sample is captured and imaged by the detecting module.
  • the sample surface cutting device includes a tool, a blade holder and a tool holder, and the tool is fixed to the tool holder by a knife holder for cutting the surface of the imaged sample to expose the unimaged portion.
  • the sample moving device comprises: a precision three-dimensional moving platform for carrying the sample to move in the x, y, and z directions, so that different parts of the sample are cut by the sample cutting device and imaged by the light film illumination imaging device, wherein the x direction is scanning or cutting stepping Direction, y direction is the direction of sample movement after one cutting is completed, and z direction is sample axial direction; specifically, when cutting one column of sample section, the sample moves along x direction; after one row of cutting of sample section is completed, sample along y The direction moves, and the next column is cut; after the cutting of one sample section is completed, the sample moves in the z direction, and the next layer is cut.
  • the coordinate system of the illumination light path includes an x' direction, a y' direction, and a z' direction, wherein the x' direction is in the direction of the illumination objective lens, and the y' direction is in the same direction as the y direction;
  • the '-y'-z' coordinate system and the xyz coordinate system are standard Cartesian coordinate systems, and the x'-y'-z' coordinate system is rotated clockwise by the xyz coordinate system around the y direction.
  • the rotation angle is the illumination of the objective lens. The angle between the axis and the horizontal plane.
  • an imaging result processing method comprising intra-layer data reconstruction and inter-layer data registration for real-time processing of original imaging results to obtain an image according to a sample placement direction.
  • the intra-layer data reconstruction includes the following steps:
  • each frame is processed by translation;
  • each frame is processed by interpolation;
  • Inter-layer data registration the image detected during the two consecutive imaging processes, after the intra-layer data reconstruction, using the redundant part of the imaging process for algorithm registration.
  • the imaging result processing device is configured to control the coordinated operation of the other devices, while real-time processing of the raw imaging data acquired from the light-plate illumination imaging device by the imaging result processing method provided by the present invention.
  • the imaging result processing apparatus includes: an intra-layer data reconstruction module and an inter-layer data registration module;
  • the intra-layer data reconstruction module includes: an original stripe acquiring unit, a resampling unit, a translation interval calculating unit, and a frame processing unit; wherein:
  • the original strip acquisition unit acquires a series of original two-dimensional strip sequences oblique to the sample surface in each imaging process, each strip corresponding to a plurality of rows of pixels, each row of pixels being parallel to the xy plane;
  • the frame processing unit processes each frame by translation or interpolation according to the translation interval calculated by the translation interval calculation unit;
  • the inter-layer data registration module performs image registration using the redundant part of the data in the imaging process after the intra-layer data is reconstructed.
  • the angle between the illumination objective lens and the optical axis of the imaging objective lens is 90°, and both are inclined to the surface of the sample, and the working distance between the illumination objective lens and the imaging objective lens ensures that the objective lenses do not collide with each other when the focus of the two objective lenses coincides, so as to ensure each There is no mechanical interference between the components due to space constraints.
  • both the illumination objective and the detection objective are objective lenses having a larger numerical aperture, and more preferably, the numerical aperture of the illumination objective and the detection objective are greater than 0.5 to provide higher imaging resolution, especially axial resolution.
  • both the illumination objective and the detection objective are both submersible objectives with a magnification of 40 and a numerical aperture of 0.8.
  • the beam shaping unit further includes a plane mirror for changing the direction of the optical path and adjusting the collimation of the light beam.
  • the beam shaping unit further comprises two one-dimensional apertures for further limiting the beam to obtain different illumination patch widths and different illumination numerical apertures.
  • the first lens and the second lens perform the function of expanding the beam by being arranged in the form of a Kepler-type or Galilean-type variable magnification beam expander.
  • the detector is an area array detector or a line array detector; more preferably, an area array detector that adjusts the width of the detection surface; more preferably, a sub-array mode scientific level CMOS camera for real time Adjust the imaging range while improving image quality.
  • the direction of movement of the sample during imaging is parallel to the surface of the sample and perpendicular to the width of the light sheet such that the surface of the sample is uniformly illuminated by the light sheet.
  • the upper end of the imaging range at the time of imaging is located 1 to 20 microns below the surface of the sample; more preferably, it is 1-10 microns; more preferably, 3-5 microns, to avoid emission of light when the imaging range is too deep Or the image quality caused by unevenness of the sample surface when the imaging range is too shallow.
  • the illumination of the light sheet used in the imaging is in the range of 1 to 50 ⁇ m; more preferably, 1 to 10 ⁇ m; more preferably 2 to 5 ⁇ m, to avoid affecting the illumination effect due to the divergence of the light sheet.
  • the sample surface cutting device cuts the surface of the sample by diamond tool cutting, tungsten carbide tool cutting or vibration chip cutting; more preferably, for diamond tool cutting, the diamond tool has high cutting precision and the cut surface is relatively flat.
  • the light sheet illumination imaging device, the sample surface cutting device, and the sample moving device are mounted in the same rigid structure to maintain the accuracy of the working coordinates.
  • the above technical solution conceived by the present invention uses a high numerical aperture illumination objective lens and a detection objective lens for illumination and detection by using an optical film oblique incidence illumination combined with a mechanical cutting imaging method, and utilizes a subarray of a wide field detector.
  • the mode or line detector controls the imaging range and can achieve the following beneficial effects:
  • the imaged portion is removed layer by layer by the mechanical cutting device during the imaging process, and the unimaged portion is exposed, and the large-volume sample can be imaged, and the oblique observation of the illumination objective lens with high numerical aperture and the oblique observation of the objective lens with high numerical aperture are performed.
  • High-resolution, especially high-intensity, three-dimensional imaging is achieved, which achieves high resolution, especially high axial resolution imaging of large volume samples;
  • the detector photosensitive surface is tilted in the detection module, which can realize three-dimensional high sampling rate, thereby providing high image quality;
  • the sample is placed on a precise three-dimensional mobile platform, and the imaging result is acquired by a high-throughput area array detector, which can realize high-speed imaging.
  • FIG. 1 is a schematic view of a conventional light sheet illumination microscopic imaging system
  • FIG. 2 is a schematic view of a conventional micro optical tomography system
  • Figure 3 is a schematic view of a light sheet illumination microsection imaging system of the present invention.
  • FIG. 4 is a schematic view showing an optical path of a lighting module in the light sheet illumination imaging device of the present invention.
  • FIG. 5 is a schematic diagram of a process of detecting a signal of the present invention and a schematic diagram of processing the original data
  • Fig. 6 is a schematic view showing a method of processing an imaging result of the present invention.
  • 301 is a beam shaping unit
  • 302 is an illumination objective lens
  • 303 is a first lens
  • 304 is a second lens
  • 305 is a cylindrical lens
  • 306 is an illumination cylinder mirror
  • 307 is a reflection plane mirror
  • 401 is an imaging objective lens
  • 402 is an imaging cylinder mirror.
  • 403 is a detector
  • 501 is a cutter
  • 502 is a cutter holder
  • 503 is a cutter holder
  • 600 is a sample moving device
  • 700 is an imaging result processing device
  • 800 is a sample to be imaged.
  • the light sheet illumination microsection imaging system comprises a light sheet illumination imaging device, a sample surface cutting device, a sample moving device 600, and an imaging result processing device 700;
  • the light sheet illumination imaging device passes oblique incidence Illumination and oblique detection of the sample surface for light sheet illumination imaging;
  • sample surface cutting device for cutting the surface of the sample that has been imaged by the light sheet illumination imaging device to expose unimaged portions;
  • sample moving device 600 for controlling sample movement, The different portions of the sample are cut by the sample cutting device and imaged by the light sheet illumination imaging device;
  • the imaging result processing device 700 is used to control the coordination of other devices and to perform real-time processing of the raw imaging data acquired from the light illumination imaging device.
  • the light sheet illumination imaging device comprises an illumination module and a detection module; the illumination module is configured to form a light sheet illumination sample to excite the sample to generate fluorescence; and the detection module is configured to collect the fluorescence signal generated by the sample and image the same;
  • the illumination module includes: a laser disposed in the direction of the optical path, a beam shaping unit 301, and an illumination objective lens 302; the laser is used to emit collimated light, and the beam shaping unit 301 is configured to shape the collimated light emitted by the laser. a line spot, the illumination objective lens 302 is configured to conjugate the line spot obtained by shaping the beam shaping unit 301 to the surface of the sample to form a light sheet, and illuminate the sample;
  • the beam shaping unit 301 comprises: a laser beam expanding unit and a beam compressing unit; the laser beam expanding unit is configured to expand the collimated light emitted by the laser in two dimensions, and the size of the beam expanding is generated by the need The width of the illumination light sheet is determined; the beam compression unit is used to compress the collimated light into a line spot and form a light sheet to illuminate the sample;
  • the laser beam expanding unit includes: a first lens 303 and a second lens 304 disposed along the optical path direction confocal common optical axis;
  • the beam compression unit includes: a cylindrical lens 305 and a lighting barrel 306 disposed in a common focus Wherein the cylindrical lens 305 compresses the collimated light into a line spot, and the illumination barrel 306 is used to form a light sheet to illuminate the sample;
  • the detecting module as shown in FIG. 3, comprises: an imaging objective lens 401, an imaging cylinder mirror 402, and a detector 403; the imaging objective lens 401 is used for imaging a fluorescence signal excited by the sample, and the imaging cylinder mirror 402 is combined with the imaging objective lens 401 to perfectly The aberration of the imaging objective lens 401 is corrected, and the detector 403 is used to capture and record the enlarged imaging result.
  • the laser When imaging the sample, the laser emits collimated light; the collimated light passes through the beam shaping unit 301 and the illumination objective lens 302 to form a light sheet, and the sample is illuminated to excite the sample to generate a fluorescent signal; the fluorescent signal generated by the sample is captured and imaged by the detecting module.
  • the light sheet illumination imaging apparatus further includes a plane mirror 307 for changing the direction of the light path and adjusting the collimation of the light beam.
  • the sample surface cutting device comprises a cutter 501, a cutter holder 502 and a tool holder 503; the cutter 501 is fixed to the tool holder 503 by a cutter holder 502 for cutting the imaged sample surface to expose the unimaged portion;
  • the sample moving device 600 includes: a precision three-dimensional moving platform for carrying the sample 800 to move in the x, y, and z directions, so that different portions of the sample 800 are cut by the sample cutting device and imaged by the light sheet illumination imaging device.
  • the x direction is the scanning or cutting step direction
  • the y direction is the direction in which the sample moves after one cutting is completed
  • the z direction is the sample axial direction.
  • the cutting thickness is controlled in the z direction
  • the z direction is related to the imaging range.
  • the sample moves in the x direction; after one row of the sample section is cut, the sample moves in the y direction to cut the next column; after the cutting of one sample section is completed, the sample is along the z direction Move to cut the next slice.
  • the light sheet illumination imaging device, the sample surface cutting device, and the sample moving device 600 are fixed to the same marble holder.
  • the illumination module is fixed on the marble bracket by an optical plate
  • the detection modules are connected to each other and integrally mounted on the marble bracket by an aluminum alloy mechanical structure
  • the imaging cylinder mirror 402 and the detector 403 are fixed in position by a mechanical structure
  • the sample cutting device is fixed on the marble bracket by a steel mechanical structure to reduce the possibility of structural deformation, and is located on the side of the imaging module.
  • the height of the blade surface is the same as the position of the imaging focal plane so that the sample does not need to move excessively in the axial direction when the imaging and cutting processes are switched; the sample moving device 600 is fixed on the platform of the marble support; the sample 800 to be imaged is stably installed.
  • the imaging result processing device 700 is a workstation connected to the sample moving device 600 and the detector 403 for controlling the entire system and collecting data and processing the data.
  • the illumination objective lens 302 and the imaging objective lens 401 are two identical 40X, 0.8NA objective lenses, the optical axis of the illumination objective lens 302 is at an angle of 45° to the horizontal plane, and the optical axis of the imaging objective lens 401 is 45° from the horizontal plane.
  • the angle between the illumination objective lens 302 and the optical axis of the imaging objective lens 401 is 90°, and there is no collision between the objective lenses when the objective lenses are coincident.
  • the coordinate system of the illumination light path includes an x' direction, a y' direction, and a z' direction, wherein the x' direction is a direction along the illumination objective lens 302, y 'The direction is the same as the y direction; the x'-y'-z' coordinate system and the xyz coordinate system are standard Cartesian coordinate systems, and the x'-y'-z' coordinate system is rotated clockwise by the xyz coordinate system around the y direction.
  • the resulting angle of rotation is the angle between the optical axis of the illumination objective and the horizontal plane, ie 45°.
  • the illumination module of the light sheet illumination imaging device has a light path diagram as shown in FIG. 4, the first lens 303 and the second lens 304 are both convex lenses, and the cylindrical lens 305 compresses the light beam into a line spot in one dimension, and the illumination is performed.
  • the barrel mirror 306 and the illumination objective lens 302 conjugate the line spot to the sample surface, wherein the illumination barrel mirror 306 is in focus with the cylindrical lens 305.
  • the first lens 303 and the second lens 304 form a first Kepler beam expanding system, the beam expanding ratio is a first beam expanding ratio; the cylindrical lens 305 and the lighting barrel mirror 306 form a second Kepler expansion in the z' direction.
  • the beam system has a beam expansion ratio of a second beam expansion ratio.
  • the first lens 303 and the second lens 304 are selected according to the first beam expansion ratio, and the first beam expansion ratio calculation method is as shown in FIG. 4, specifically, the following steps are included:
  • the spot at the A position is a circular spot, so the spot diameter at the A position is the spot length in the y' direction, and the ratio of the spot diameter at the A position to the diameter of the original laser beam is the first Beam expansion ratio
  • the illumination barrel mirror 306 and the cylindrical lens 305 are selected according to the second beam expansion ratio.
  • the second beam expansion ratio calculation method is as shown in FIG. 4, specifically, the following steps are included:
  • the C position is the rear heel position of the illumination objective lens 302, and the length of the spot at the C position in the z' direction is calculated according to the posterior pupil diameter of the illumination rear illumination objective lens 302;
  • the illumination path is relatively long, there are multiple planar mirrors in the optical path for changing the direction of the optical path and adjusting the collimation of the beam.
  • the imaging process of the light sheet illumination imaging device, and the result data processing process of the imaging result processing device 700 are as shown in FIG.
  • the imaging range can be controlled by selecting the width of the active pixel of the detector 403.
  • the detector 403 is an area array detector sCMOS with a sub-array (ie, sub-array) detection mode, and the selected imaging range is in the object. 5.2 microns on the surface.
  • the sample moving device 600 carries the sample 800 in the process of moving the sample 800 to obtain a series of two-dimensional strip images 45° from the sample surface, according to the moving speed of the sample moving device 600, the exposure time of the detector 403, and the detector 403.
  • the pixel size and the magnification of the imaging objective 401 calculate the amount of translation required for each layer of image when the data is reconstructed.
  • the imaging result processing apparatus 700 processes the original imaging data acquired from the light sheet illumination imaging apparatus by the imaging result processing method provided by the present invention to obtain an image according to the sample placement direction, specifically, including intra-layer data reconstruction and inter-layer data matching. Quasi, as shown in Figure 6;
  • Intra-layer data reconstruction includes the following steps:
  • Inter-layer data registration is achieved by imaging redundancy and registration algorithm.
  • the interlayer deformation is small, and the layers are naturally registered.

Abstract

Provided are a light-sheet illumination microsection imaging system and an imaging result processing method. The light-sheet illumination microsection imaging system comprises a light-sheet illumination imaging device, a sample surface cutting device, a sample moving device (600), and an imaging result processing device (700). The light-sheet illumination imaging device performs light-sheet illumination imaging on the surface of a sample (800) by means of oblique incident illumination and oblique detection. The sample surface cutting device is used to cut a sample (800) that has already undergone imaging in order to expose a portion of the sample that has not undergone imaging. The sample moving device (600) is used to control movement of the sample (800), such that different portions of the sample (800) are cut and undergo imaging. The imaging result processing device (700) is used to control coordinated operation of the other devices, and performance of real-time processing on raw imaging data. The imaging result processing method comprises reconstructing intra-layer data and registering inter-layer data in order to obtain an image along a placement direction of the sample (800). The imaging system and imaging result processing method achieve high resolution imaging, especially high axial resolution imaging of large volume samples, while also providing high imaging quality and imaging speed.

Description

一种光片照明显微切片成像系统及成像结果处理方法Light slice illumination microsection imaging system and imaging result processing method [技术领域][Technical field]
本发明属于生物成像领域,更具体地,涉及一种光片照明显微切片成像系统及成像结果处理方法。The invention belongs to the field of biological imaging, and more particularly to a light sheet illumination microsection imaging system and an imaging result processing method.
[背景技术][Background technique]
生命科学研究中通常要在大体积范围内获取生物样本精细的三维结构信息,作为重要的工具,各类光学显微成像系统发展迅速,其中,光片照明显微成像系统和显微光学断层层析成像系统的应用较为广泛。In life science research, the fine three-dimensional structure information of biological samples is usually obtained in a large volume range. As an important tool, various optical microscopic imaging systems are developing rapidly, among which, the light film illumination microscopic imaging system and the microscopic optical tomographic layer The application of the imaging system is extensive.
图1所示为现有光片照明显微成像系统的示意图。如图1所示,光片照明显微成像系统包括照明光路部分101、探测光路部分103以及样本移动部分105;照明光路部分101形成光片照明样本,激发样本产生荧光信号;荧光信号通过探测光路部分103的物镜与聚焦透镜收集成像到探测器表面;样本移动部分105承载样本107进行移动或旋转以对整个样本进行成像。Figure 1 is a schematic illustration of a conventional light sheet illumination microscopy imaging system. As shown in FIG. 1, the light sheet illumination microscopic imaging system includes an illumination light path portion 101, a probe light path portion 103, and a sample moving portion 105. The illumination light path portion 101 forms a light sheet illumination sample, and the excitation sample generates a fluorescence signal; the fluorescence signal passes through the detection light path. The objective lens of the portion 103 and the focusing lens are collected and imaged onto the detector surface; the sample moving portion 105 carries the sample 107 for movement or rotation to image the entire sample.
图2所示为现有显微光学断层层析成像系统的示意图。如图2所示,显微光学断层层析成像系统包括成像装置201、样本平面切削装置203以及三维移动平台205;三维移动平台205携样本207沿切削方向运动,样本平面切削装置203将样本207的表层逐个条带地切削,切削过程中由成像装置201对离开样本的被切削部位进行线扫描成像,由条带图像拼接出整个断面的图像,由断面图像重建出样本的三维结构。Figure 2 is a schematic illustration of a prior art micro-optical tomography system. As shown in FIG. 2, the micro-optical tomography system includes an imaging device 201, a sample plane cutting device 203, and a three-dimensional moving platform 205; the three-dimensional moving platform 205 carries the sample 207 in the cutting direction, and the sample plane cutting device 203 samples the sample 207. The surface layer is cut one by one. During the cutting process, the image forming apparatus 201 performs line scan imaging on the cut portion leaving the sample, and the strip image is used to splicing the image of the entire section, and the three-dimensional structure of the sample is reconstructed from the sectional image.
现有光片照明显微成像系统,物镜之间存在相互干扰,且为实现对大体积样本成像所采用的低数值孔径的物镜会降低成像分辨率尤其是轴向分辨率,因此对样本进行成像时,无法同时获得大体积、高分辨率的成像结果;现有显微光学断层层析成像系统,其成像分辨率,特别是轴向的成像 分辨率受成像方式的限制,不能达到与横向分辨率相同的水平。总体而言,现有的光学显微成像技术对大体积生物样本成像时,无法获得较高的分辨率,尤其是轴向分辨率。Existing light sheet illumination microscopy imaging systems, where there is mutual interference between the objective lenses, and the low numerical aperture objective lens used to image large volume samples reduces imaging resolution, especially axial resolution, thus imaging the sample At the same time, large-volume, high-resolution imaging results cannot be obtained at the same time; in the existing micro-optical tomography system, the imaging resolution, especially the axial imaging resolution, is limited by the imaging mode, and cannot be achieved and laterally resolved. Rate the same level. In general, existing optical microscopy imaging techniques do not achieve high resolution, especially axial resolution, when imaging large volume biological samples.
[发明内容][Summary of the Invention]
针对现有技术的缺陷和改进需求,本发明提出了一种光片照明显微切片成像系统及成像结果处理方法,旨在解决现有的光学显微成像系统对大体积生物样本成像时无法获取高分辨率尤其是高轴向分辨率的问题。In view of the defects and improvement requirements of the prior art, the present invention provides a light sheet illumination microsection imaging system and an imaging result processing method, which are intended to solve the problem that the existing optical microscopic imaging system cannot acquire large volume biological samples. High resolution, especially high axial resolution.
为实现上述目的,按照本发明的一个方面,提供了一种光片照明显微切片成像系统,包括光片照明成像装置、样本表面切削装置、样本移动装置以及成像结果处理装置;光片照明成像装置通过斜入射照明及斜探测的方式对样本表面进行光片照明成像;样本表面切削装置用于切削已被光片照明成像装置成像的样本表面以暴露未成像的部分;样本移动装置用于控制样本移动,使得样本不同部分被样本切削装置切削并被光片照明成像装置成像;成像结果处理装置用于控制其他装置协调工作以及对获取自光片照明成像装置的原始成像数据进行实时处理。To achieve the above object, in accordance with one aspect of the present invention, a light sheet illumination microsection imaging system is provided, including a light sheet illumination imaging apparatus, a sample surface cutting apparatus, a sample moving apparatus, and an imaging result processing apparatus; The device performs light sheet illumination imaging on the sample surface by oblique incident illumination and oblique detection; the sample surface cutting device is used to cut the surface of the sample that has been imaged by the light sheet illumination imaging device to expose the unimaged portion; the sample moving device is used for control The sample is moved such that different portions of the sample are cut by the sample cutting device and imaged by the light sheet illumination imaging device; the imaging result processing device is used to control the coordination of other devices and to perform real-time processing of the raw imaging data acquired from the light illumination imaging device.
光片照明成像装置包括照明模块与探测模块;照明模块用于形成光片照明样本,激发样本产生荧光;探测模块用于采集样本产生的荧光信号并成像;The light sheet illumination imaging device comprises an illumination module and a detection module; the illumination module is configured to form a light sheet illumination sample to excite the sample to generate fluorescence; and the detection module is configured to collect the fluorescence signal generated by the sample and image the same;
更进一步地,照明模块包括:沿光路方向依次设置的激光器、光束整形单元和照明物镜;激光器用于发出准直光,光束整形单元用于将激光器发出的准直光整形成为线光斑,照明物镜用于将光束整形单元整形所得的线光斑共轭到样本表面形成光片,照明样本;Further, the illumination module comprises: a laser disposed in the direction of the optical path, a beam shaping unit and an illumination objective lens; the laser is used for emitting collimated light, and the beam shaping unit is configured to shape the collimated light emitted by the laser into a line spot, and the illumination objective lens A line spot for shaping the beam shaping unit is conjugated to the surface of the sample to form a light sheet, and the sample is illuminated;
更进一步地,光束整形单元包括:激光扩束单元和光束压缩单元;激光扩束单元用于使得激光器发出的准直光在二维上得到扩束,扩束的尺寸由需要产生的照明光片宽度决定;光束压缩单元用于将准直光压缩成为线 光斑并形成光片,照明样本;Further, the beam shaping unit comprises: a laser beam expanding unit and a beam compressing unit; the laser beam expanding unit is configured to expand the collimated light emitted by the laser in two dimensions, and the size of the beam expands by the illumination piece to be generated. The width is determined; the beam compression unit is configured to compress the collimated light into a line spot and form a light sheet to illuminate the sample;
更进一步地,激光扩束单元包括:沿光路方向共焦点共光轴设置的第一透镜和第二透镜,第一透镜为凸透镜或者凹透镜,第二透镜为凸透镜或者凹透镜。Further, the laser beam expanding unit includes: a first lens and a second lens disposed along the optical path direction confocal common optical axis, the first lens being a convex lens or a concave lens, and the second lens being a convex lens or a concave lens.
更进一步地,光束压缩单元包括:共焦点设置的柱透镜和照明筒镜;柱透镜用于将准直光压缩成为线光斑,照明筒镜用于形成光片,照明样本。Further, the beam compression unit comprises: a co-focusing cylindrical lens and an illumination barrel; the cylindrical lens is used to compress the collimated light into a line spot, and the illumination barrel is used to form a light sheet to illuminate the sample.
更进一步地,探测模块包括:成像物镜、成像筒镜以及探测器;成像物镜用于对样本激发的荧光信号成像,成像筒镜与成像物镜相结合以完善地校正成像物镜的像差,探测器用于拍摄并记录放大后的成像结果;Further, the detecting module comprises: an imaging objective lens, an imaging cylinder mirror and a detector; the imaging objective lens is used for imaging the fluorescence signal excited by the sample, and the imaging cylinder mirror is combined with the imaging objective lens to perfectly correct the aberration of the imaging objective lens, and the detector is used for the detector. Filming and recording the enlarged imaging results;
对样本成像时,激光器发出准直光;准直光经过光束整形单元及照明物镜后形成光片,照明样本,激发样本产生荧光信号;样本产生的荧光信号经过探测模块被采集成像。When the sample is imaged, the laser emits collimated light; the collimated light passes through the beam shaping unit and the illumination objective lens to form a light sheet, and the sample is illuminated to excite the sample to generate a fluorescent signal; the fluorescent signal generated by the sample is captured and imaged by the detecting module.
样本表面切削装置,包括刀具、刀托和刀架,刀具通过刀托固定于刀架上,用于切削已成像的样本表面以暴露未成像的部分。The sample surface cutting device includes a tool, a blade holder and a tool holder, and the tool is fixed to the tool holder by a knife holder for cutting the surface of the imaged sample to expose the unimaged portion.
样本移动装置包括:精密三维移动平台,用于携带样本沿x、y、z方向移动,使得样本不同部分被样本切削装置切削并被光片照明成像装置成像,其中x方向为扫描或切削步进方向,y方向为一次切削完成后样本移动的方向,z方向为样本轴向;具体地,对样本切面的一列进行切削时,样本沿x方向移动;样本切面的一列切削完成后,样本沿y方向移动,对下一列进行切削;一层样本切面切削完成后,样本沿z方向移动,对下一层切面进行切削。The sample moving device comprises: a precision three-dimensional moving platform for carrying the sample to move in the x, y, and z directions, so that different parts of the sample are cut by the sample cutting device and imaged by the light film illumination imaging device, wherein the x direction is scanning or cutting stepping Direction, y direction is the direction of sample movement after one cutting is completed, and z direction is sample axial direction; specifically, when cutting one column of sample section, the sample moves along x direction; after one row of cutting of sample section is completed, sample along y The direction moves, and the next column is cut; after the cutting of one sample section is completed, the sample moves in the z direction, and the next layer is cut.
更进一步地,光片照明成像装置,其照明光路的坐标系包括x’方向、y’方向和z’方向,其中x’方向为沿照明物镜的方向,y’方向与y方向同向;x’-y’-z’坐标系和x-y-z坐标系均为标准笛卡尔坐标系,x’-y’-z’坐标系由x-y-z坐标系绕y方向顺时针旋转所得,旋转角度为照明物镜的光轴与水平面的夹角。Further, in the light sheet illumination imaging apparatus, the coordinate system of the illumination light path includes an x' direction, a y' direction, and a z' direction, wherein the x' direction is in the direction of the illumination objective lens, and the y' direction is in the same direction as the y direction; The '-y'-z' coordinate system and the xyz coordinate system are standard Cartesian coordinate systems, and the x'-y'-z' coordinate system is rotated clockwise by the xyz coordinate system around the y direction. The rotation angle is the illumination of the objective lens. The angle between the axis and the horizontal plane.
按照本发明的另一个方面,提供了一种成像结果处理方法,包括层内数据重建和层间数据配准,用于对原始成像结果进行实时处理,以获得按照样本放置方向的图像。According to another aspect of the present invention, there is provided an imaging result processing method comprising intra-layer data reconstruction and inter-layer data registration for real-time processing of original imaging results to obtain an image according to a sample placement direction.
具体地,层内数据重建包括如下步骤:Specifically, the intra-layer data reconstruction includes the following steps:
(1)在每次成像过程中获取一系列原始的倾斜于样本表面的二维条带序列,每一个条带对应多行像素,每一行像素平行于xy平面;(1) obtaining a series of original two-dimensional strip sequences inclined to the surface of the sample in each imaging process, each strip corresponding to a plurality of rows of pixels, each row of pixels being parallel to the xy plane;
(2)对原始的二维条带序列进行重新采样,将每个条带中相同行的像素拼接得到一系列帧序列,每一帧图像垂直于样本轴向;重新采样的横向采样间隔为a=v△t,轴向采样间隔为c=S psinα/M,其中v为成像时平台运动的速度,△t为探测器曝光间隔,S p为探测器像素尺寸,α为探测光轴与垂直方向的夹角,M为探测放大率; (2) Resampling the original two-dimensional stripe sequence, splicing the pixels of the same row in each strip to obtain a series of frame sequences, each frame image is perpendicular to the sample axis; the resampled horizontal sampling interval is a = v △ t, the sampling interval is axially c = S p sinα / M, wherein when the velocity v is the movement of the imaging platform, △ t is the exposure interval detector, S p is the pixel size of the detector, α is the optical axis of the probe The angle in the vertical direction, M is the detection magnification;
(3)根据上下两帧的平移间隔计算每一帧的平移间隔,其中上下两帧的平移间隔为a'=S pcosα/M; (3) Calculate the translation interval of each frame according to the translation interval of the upper and lower frames, wherein the translation interval of the upper and lower frames is a'=S p cosα/M;
(4)根据步骤(3)的计算结果通过平移或插值对每一帧进行处理,具体地,计算所得每一帧的平移间隔为像素尺寸整数倍时,通过平移处理每一帧;计算所得每一帧的平移间隔为非像素尺寸的整数倍时,通过插值处理每一帧;(4) processing each frame by translation or interpolation according to the calculation result of the step (3). Specifically, when the translation interval of each frame is calculated as an integer multiple of the pixel size, each frame is processed by translation; When the translation interval of one frame is an integer multiple of the non-pixel size, each frame is processed by interpolation;
层间数据配准,将上下连续两次成像过程中所探测到的图像,在层内数据重建后使用成像过程中的冗余部分数据进行算法配准。Inter-layer data registration, the image detected during the two consecutive imaging processes, after the intra-layer data reconstruction, using the redundant part of the imaging process for algorithm registration.
更进一步地,成像结果处理装置用于控制其他装置协调工作,同时通过本发明提供的成像结果处理方法对获取自光片照明成像装置的原始成像数据进行实时处理。Further, the imaging result processing device is configured to control the coordinated operation of the other devices, while real-time processing of the raw imaging data acquired from the light-plate illumination imaging device by the imaging result processing method provided by the present invention.
更进一步地,成像结果处理装置包括:层内数据重建模块和层间数据配准模块;Further, the imaging result processing apparatus includes: an intra-layer data reconstruction module and an inter-layer data registration module;
更进一步地,层内数据重建模块包括:原始条带获取单元、重新采样 单元、平移间隔计算单元以及帧处理单元;其中:Further, the intra-layer data reconstruction module includes: an original stripe acquiring unit, a resampling unit, a translation interval calculating unit, and a frame processing unit; wherein:
原始条带获取单元在每次成像过程中获取一系列原始的倾斜于样本表面的二维条带序列,每一个条带对应多行像素,每一行像素平行于xy平面;The original strip acquisition unit acquires a series of original two-dimensional strip sequences oblique to the sample surface in each imaging process, each strip corresponding to a plurality of rows of pixels, each row of pixels being parallel to the xy plane;
重新采样单元对原始的二维条带序列进行重新采样,将每个条带中相同行的像素拼接得到一系列帧序列,每一帧图像垂直于样本轴向,重新采样的横向采样间隔为a=v△t,轴向采样间隔为c=S psinα/M,其中v为成像时平台运动的速度,△t为探测器曝光间隔,S p为探测器像素尺寸,α为探测光轴与垂直方向的夹角,M为探测放大率; The resampling unit resamples the original two-dimensional stripe sequence, and splices the pixels of the same row in each strip to obtain a series of frame sequences, each frame image is perpendicular to the sample axis, and the resampled horizontal sampling interval is a. = v △ t, the sampling interval is axially c = S p sinα / M, wherein when the velocity v is the movement of the imaging platform, △ t is the exposure interval detector, S p is the pixel size of the detector, α is the optical axis of the probe The angle in the vertical direction, M is the detection magnification;
平移间隔计算单元根据上下两帧的平移间隔计算每一帧的平移间隔,其中上下两帧的平移间隔为a'=S pcosα/M; The translation interval calculation unit calculates the translation interval of each frame according to the translation interval of the upper and lower frames, wherein the translation interval of the upper and lower frames is a'=S p cosα/M;
帧处理单元根据所述平移间隔计算单元计算所得的平移间隔通过平移或插值对每一帧进行处理;The frame processing unit processes each frame by translation or interpolation according to the translation interval calculated by the translation interval calculation unit;
层间数据配准模块,将上下连续两次成像过程中所探测到的图像,在层内数据重建后使用成像过程中的冗余部分数据进行算法配准。The inter-layer data registration module performs image registration using the redundant part of the data in the imaging process after the intra-layer data is reconstructed.
优选地,照明物镜与成像物镜的光轴夹角为90°,且均倾斜于样本表面,同时照明物镜与成像物镜的工作距离保证两物镜焦点重合时物镜之间不会相互碰撞,以保证各部件之间不会由于空间限制而发生机械干涉。Preferably, the angle between the illumination objective lens and the optical axis of the imaging objective lens is 90°, and both are inclined to the surface of the sample, and the working distance between the illumination objective lens and the imaging objective lens ensures that the objective lenses do not collide with each other when the focus of the two objective lenses coincides, so as to ensure each There is no mechanical interference between the components due to space constraints.
优选地,照明物镜与探测物镜均为数值孔径较大的物镜,更优选地,照明物镜与探测物镜的数值孔径大于0.5,以提供较高的成像分辨率尤其是轴向分辨率。Preferably, both the illumination objective and the detection objective are objective lenses having a larger numerical aperture, and more preferably, the numerical aperture of the illumination objective and the detection objective are greater than 0.5 to provide higher imaging resolution, especially axial resolution.
优选地,照明物镜与探测物镜均为放大率为40,数值孔径为0.8的浸水式物镜。Preferably, both the illumination objective and the detection objective are both submersible objectives with a magnification of 40 and a numerical aperture of 0.8.
优选地,按照光路方向,光束整形单元中还包括平面反射镜,用于改变光路方向以及调节光束的准直性。Preferably, in the direction of the optical path, the beam shaping unit further includes a plane mirror for changing the direction of the optical path and adjusting the collimation of the light beam.
优选地,光束整形单元还包括两个一维光阑,用于对光束进行进一步 的限制,以获取不同的照明光片宽度以及不同的照明数值孔径。Preferably, the beam shaping unit further comprises two one-dimensional apertures for further limiting the beam to obtain different illumination patch widths and different illumination numerical apertures.
优选地,第一透镜与第二透镜,通过按照开普勒式或伽利略式变倍扩束镜的形式排布实现扩束的功能。Preferably, the first lens and the second lens perform the function of expanding the beam by being arranged in the form of a Kepler-type or Galilean-type variable magnification beam expander.
优选地,探测器为面阵探测器或者线阵探测器;更优选地,为可调节探测面宽度的面阵探测器;更优选地,为sub-array模式的科研级CMOS相机,用于实时调整成像范围,同时提高成像质量。Preferably, the detector is an area array detector or a line array detector; more preferably, an area array detector that adjusts the width of the detection surface; more preferably, a sub-array mode scientific level CMOS camera for real time Adjust the imaging range while improving image quality.
优选地,成像时样本的移动方向平行于样本表面,且垂直于光片宽度,使得样本表面被光片均匀照亮。Preferably, the direction of movement of the sample during imaging is parallel to the surface of the sample and perpendicular to the width of the light sheet such that the surface of the sample is uniformly illuminated by the light sheet.
优选地,成像时成像范围的上端位于样本表面一下1-20微米的位置;更优选地,为1-10微米;更优选地,为3-5微米,避免因成像范围过深时光线发生发射或者成像范围过浅时样本表面不平整所导致的成像质量下降。Preferably, the upper end of the imaging range at the time of imaging is located 1 to 20 microns below the surface of the sample; more preferably, it is 1-10 microns; more preferably, 3-5 microns, to avoid emission of light when the imaging range is too deep Or the image quality caused by unevenness of the sample surface when the imaging range is too shallow.
优选地,成像时使用的光片照明范围为1-50微米;更优选地,为1-10微米;更优选地,为2-5微米,避免因光片发散而影响照明效果。Preferably, the illumination of the light sheet used in the imaging is in the range of 1 to 50 μm; more preferably, 1 to 10 μm; more preferably 2 to 5 μm, to avoid affecting the illumination effect due to the divergence of the light sheet.
优选地,样本表面切削装置切削样本表面的方式为金刚石刀具切削、碳化钨刀具切削或者振动切片切削;更优选地,为金刚石刀具切削,金刚石刀具切削精度高,并且切削出的切面较为平整。Preferably, the sample surface cutting device cuts the surface of the sample by diamond tool cutting, tungsten carbide tool cutting or vibration chip cutting; more preferably, for diamond tool cutting, the diamond tool has high cutting precision and the cut surface is relatively flat.
优选的,光片照明成像装置、样本表面切削装置以及样本移动装置安装于同一刚性结构中以保持工作坐标的精确度。Preferably, the light sheet illumination imaging device, the sample surface cutting device, and the sample moving device are mounted in the same rigid structure to maintain the accuracy of the working coordinates.
总体而言,通过本发明所构思的以上技术方案通过采用光片斜入射照明结合机械切削的成像方式,选用高数值孔径的照明物镜与探测物镜进行照明和探测,并且利用宽场探测器的subarray mode或线探测器控制成像范围,能够取得以下有益效果:In general, the above technical solution conceived by the present invention uses a high numerical aperture illumination objective lens and a detection objective lens for illumination and detection by using an optical film oblique incidence illumination combined with a mechanical cutting imaging method, and utilizes a subarray of a wide field detector. The mode or line detector controls the imaging range and can achieve the following beneficial effects:
(1)成像过程中通过机械切削装置逐层去除已成像部分并暴露未成像部分,可以对大体积样本成像,同时通过高数值孔径的照明物镜斜入射照明以及高数值孔径的探测物镜斜探测,实现了高分辨率尤其是高轴向分辨 率的三维成像,即实现了对大体积样本的高分辨率尤其是高轴向分辨率成像;(1) The imaged portion is removed layer by layer by the mechanical cutting device during the imaging process, and the unimaged portion is exposed, and the large-volume sample can be imaged, and the oblique observation of the illumination objective lens with high numerical aperture and the oblique observation of the objective lens with high numerical aperture are performed. High-resolution, especially high-intensity, three-dimensional imaging is achieved, which achieves high resolution, especially high axial resolution imaging of large volume samples;
(2)探测模块中探测器光敏面倾斜放置,可以实现三维高采样率,从而提供高成像质量;(2) The detector photosensitive surface is tilted in the detection module, which can realize three-dimensional high sampling rate, thereby providing high image quality;
(3)样本放置于精密的三维移动平台上,由高通量的面阵探测器采集成像结果,可以实现高速成像。(3) The sample is placed on a precise three-dimensional mobile platform, and the imaging result is acquired by a high-throughput area array detector, which can realize high-speed imaging.
[附图说明][Description of the Drawings]
图1是现有的光片照明显微成像系统示意图;1 is a schematic view of a conventional light sheet illumination microscopic imaging system;
图2是现有的显微光学断层层析成像系统示意图;2 is a schematic view of a conventional micro optical tomography system;
图3是本发明的光片照明显微切片成像系统示意图;Figure 3 is a schematic view of a light sheet illumination microsection imaging system of the present invention;
图4是本发明的光片照明成像装置中照明模块的光路示意图;4 is a schematic view showing an optical path of a lighting module in the light sheet illumination imaging device of the present invention;
图5是本发明探测信号的过程示意图以及对原始数据的处理示意图;5 is a schematic diagram of a process of detecting a signal of the present invention and a schematic diagram of processing the original data;
图6是本发明的成像结果处理方法的示意图。Fig. 6 is a schematic view showing a method of processing an imaging result of the present invention.
在所有附图中,相同的附图标记用来表示相同的元件或者结构,其中:Throughout the drawings, the same reference numerals are used to refer to the
301为光束整形单元,302为照明物镜,303为第一透镜,304为第二透镜,305为柱透镜,306为照明筒镜,307为反射平面镜,401为成像物镜,402为成像筒镜,403为探测器,501为刀具,502为刀托,503为刀架,600为样本移动装置,700为成像结果处理装置,800为待成像样本。301 is a beam shaping unit, 302 is an illumination objective lens, 303 is a first lens, 304 is a second lens, 305 is a cylindrical lens, 306 is an illumination cylinder mirror, 307 is a reflection plane mirror, 401 is an imaging objective lens, and 402 is an imaging cylinder mirror. 403 is a detector, 501 is a cutter, 502 is a cutter holder, 503 is a cutter holder, 600 is a sample moving device, 700 is an imaging result processing device, and 800 is a sample to be imaged.
[具体实施方式][Detailed ways]
为了使本发明的目的、技术方案及优点更加清楚明白,以下结合附图及实施例,对本发明进行进一步详细说明。应当理解,此处所描述的具体实施例仅仅用以解释本发明,并不用于限定本发明。此外,下面所描述的本发明各个实施方式中所涉及到的技术特征只要彼此之间未构成冲突就可以相互组合。The present invention will be further described in detail below with reference to the accompanying drawings and embodiments. It is understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention. Further, the technical features involved in the various embodiments of the present invention described below may be combined with each other as long as they do not constitute a conflict with each other.
本发明提供的光片照明显微切片成像系统,如图3所示,包括光片照明成像装置、样本表面切削装置、样本移动装置600以及成像结果处理装置700;光片照明成像装置通过斜入射照明及斜探测的方式对样本表面进行光片照明成像;样本表面切削装置用于切削已被光片照明成像装置成像的样本表面以暴露未成像的部分;样本移动装置600用于控制样本移动,使得样本不同部分被样本切削装置切削并被光片照明成像装置成像;成像结果处理装置700用于控制其他装置协调工作以及对获取自光片照明成像装置的原始成像数据进行实时处理。The light sheet illumination microsection imaging system provided by the present invention, as shown in FIG. 3, comprises a light sheet illumination imaging device, a sample surface cutting device, a sample moving device 600, and an imaging result processing device 700; the light sheet illumination imaging device passes oblique incidence Illumination and oblique detection of the sample surface for light sheet illumination imaging; sample surface cutting device for cutting the surface of the sample that has been imaged by the light sheet illumination imaging device to expose unimaged portions; sample moving device 600 for controlling sample movement, The different portions of the sample are cut by the sample cutting device and imaged by the light sheet illumination imaging device; the imaging result processing device 700 is used to control the coordination of other devices and to perform real-time processing of the raw imaging data acquired from the light illumination imaging device.
光片照明成像装置包括照明模块与探测模块;照明模块用于形成光片照明样本,激发样本产生荧光;探测模块用于采集样本产生的荧光信号并成像;The light sheet illumination imaging device comprises an illumination module and a detection module; the illumination module is configured to form a light sheet illumination sample to excite the sample to generate fluorescence; and the detection module is configured to collect the fluorescence signal generated by the sample and image the same;
照明模块,如图3所示,包括:沿光路方向依次设置的激光器、光束整形单元301和照明物镜302;激光器用于发出准直光,光束整形单元301用于将激光器发出的准直光整形成为线光斑,照明物镜302用于将光束整形单元301整形所得的线光斑共轭到样本表面形成光片,照明样本;The illumination module, as shown in FIG. 3, includes: a laser disposed in the direction of the optical path, a beam shaping unit 301, and an illumination objective lens 302; the laser is used to emit collimated light, and the beam shaping unit 301 is configured to shape the collimated light emitted by the laser. a line spot, the illumination objective lens 302 is configured to conjugate the line spot obtained by shaping the beam shaping unit 301 to the surface of the sample to form a light sheet, and illuminate the sample;
光束整形单元301,如图4所示,包括:激光扩束单元和光束压缩单元;激光扩束单元用于使得激光器发出的准直光在二维上得到扩束,扩束的尺寸由需要产生的照明光片宽度决定;光束压缩单元用于将准直光压缩成为线光斑并形成光片,照明样本;The beam shaping unit 301, as shown in FIG. 4, comprises: a laser beam expanding unit and a beam compressing unit; the laser beam expanding unit is configured to expand the collimated light emitted by the laser in two dimensions, and the size of the beam expanding is generated by the need The width of the illumination light sheet is determined; the beam compression unit is used to compress the collimated light into a line spot and form a light sheet to illuminate the sample;
激光扩束单元,如图4所示,包括:沿光路方向共焦点共光轴设置的第一透镜303和第二透镜304;光束压缩单元包括:共焦点设置的柱透镜305和照明筒镜306,其中柱透镜305将准直光压缩成为线光斑,照明筒镜306用于形成光片,照明样本;The laser beam expanding unit, as shown in FIG. 4, includes: a first lens 303 and a second lens 304 disposed along the optical path direction confocal common optical axis; the beam compression unit includes: a cylindrical lens 305 and a lighting barrel 306 disposed in a common focus Wherein the cylindrical lens 305 compresses the collimated light into a line spot, and the illumination barrel 306 is used to form a light sheet to illuminate the sample;
探测模块,如图3所示,包括:成像物镜401、成像筒镜402以及探测器403;成像物镜401用于对样本激发的荧光信号成像,成像筒镜402与成像物镜401相结合以完善地校正成像物镜401的像差,探测器403用于拍 摄并记录放大后的成像结果。The detecting module, as shown in FIG. 3, comprises: an imaging objective lens 401, an imaging cylinder mirror 402, and a detector 403; the imaging objective lens 401 is used for imaging a fluorescence signal excited by the sample, and the imaging cylinder mirror 402 is combined with the imaging objective lens 401 to perfectly The aberration of the imaging objective lens 401 is corrected, and the detector 403 is used to capture and record the enlarged imaging result.
对样本成像时,激光器发出准直光;准直光经过光束整形单元301及照明物镜302后形成光片,照明样本,激发样本产生荧光信号;样本产生的荧光信号经过探测模块被采集成像。When imaging the sample, the laser emits collimated light; the collimated light passes through the beam shaping unit 301 and the illumination objective lens 302 to form a light sheet, and the sample is illuminated to excite the sample to generate a fluorescent signal; the fluorescent signal generated by the sample is captured and imaged by the detecting module.
优选地,光片照明成像装置,还包括平面反射镜307,用于改变光路方向以及调节光束的准直性。Preferably, the light sheet illumination imaging apparatus further includes a plane mirror 307 for changing the direction of the light path and adjusting the collimation of the light beam.
样本表面切削装置,包括刀具501、刀托502和刀架503;刀具501通过刀托502固定于刀架503上,用于切削已成像的样本表面以暴露未成像的部分;The sample surface cutting device comprises a cutter 501, a cutter holder 502 and a tool holder 503; the cutter 501 is fixed to the tool holder 503 by a cutter holder 502 for cutting the imaged sample surface to expose the unimaged portion;
样本移动装置600,如图3所示,包括:精密三维移动平台,用于携带样本800沿x、y、z方向移动,使得样本800不同部分被样本切削装置切削并被光片照明成像装置成像,其中x方向为扫描或切削步进方向,y方向为一次切削完成后样本移动的方向,z方向为样本轴向。其中,在z方向上控制切削厚度,并且z方向与成像范围相关。具体地,对样本切面的一列进行切削时,样本沿x方向移动;样本切面的一列切削完成后,样本沿y方向移动,对下一列进行切削;一层样本切面切削完成后,样本沿z方向移动,对下一层切面进行切削。The sample moving device 600, as shown in FIG. 3, includes: a precision three-dimensional moving platform for carrying the sample 800 to move in the x, y, and z directions, so that different portions of the sample 800 are cut by the sample cutting device and imaged by the light sheet illumination imaging device. , wherein the x direction is the scanning or cutting step direction, the y direction is the direction in which the sample moves after one cutting is completed, and the z direction is the sample axial direction. Among them, the cutting thickness is controlled in the z direction, and the z direction is related to the imaging range. Specifically, when cutting a column of the sample section, the sample moves in the x direction; after one row of the sample section is cut, the sample moves in the y direction to cut the next column; after the cutting of one sample section is completed, the sample is along the z direction Move to cut the next slice.
如图3所示,光片照明成像装置、样本表面切削装置以及样本移动装置600固定于同一个大理石支架座上。具体地,照明模块通过一块光学平板固定在大理石支架上,探测模块通过一铝合金机械结构相互连接并整体安装于大理石支架上;成像物镜401与成像筒镜402之间有两个平面反射镜307,用于调节探测光轴,成像筒镜402与探测器403通过机械结构固定其位置关系;样本切削装置通过钢机械结构固定于大理石支架上以减小其结构上形变的可能,位于成像模块侧面,其刀面高度与成像焦面位置相同以使得成像与切削过程切换时样本不需要在轴向移动过大的距离;样本移动装置600固定于大理石支架的平台上;待成像样本800稳固的安装在样 本移动装置600上;成像结果处理装置700是一台工作站,与样本移动装置600和探测器403连接,用于控制整个系统以及采集数据并对数据进行处理。As shown in FIG. 3, the light sheet illumination imaging device, the sample surface cutting device, and the sample moving device 600 are fixed to the same marble holder. Specifically, the illumination module is fixed on the marble bracket by an optical plate, and the detection modules are connected to each other and integrally mounted on the marble bracket by an aluminum alloy mechanical structure; there are two plane mirrors 307 between the imaging objective lens 401 and the imaging cylinder mirror 402. For adjusting the optical axis of the probe, the imaging cylinder mirror 402 and the detector 403 are fixed in position by a mechanical structure; the sample cutting device is fixed on the marble bracket by a steel mechanical structure to reduce the possibility of structural deformation, and is located on the side of the imaging module. The height of the blade surface is the same as the position of the imaging focal plane so that the sample does not need to move excessively in the axial direction when the imaging and cutting processes are switched; the sample moving device 600 is fixed on the platform of the marble support; the sample 800 to be imaged is stably installed. On the sample moving device 600; the imaging result processing device 700 is a workstation connected to the sample moving device 600 and the detector 403 for controlling the entire system and collecting data and processing the data.
在本实施例中,照明物镜302与成像物镜401为两个相同的40X,0.8NA的物镜,照明物镜302的光轴与水平面呈45°夹角,成像物镜401的光轴与水平面呈45°夹角,照明物镜302与成像物镜401的光轴夹角为90°,且两物镜焦点重合时物镜之间不出现相互碰撞。In the present embodiment, the illumination objective lens 302 and the imaging objective lens 401 are two identical 40X, 0.8NA objective lenses, the optical axis of the illumination objective lens 302 is at an angle of 45° to the horizontal plane, and the optical axis of the imaging objective lens 401 is 45° from the horizontal plane. The angle between the illumination objective lens 302 and the optical axis of the imaging objective lens 401 is 90°, and there is no collision between the objective lenses when the objective lenses are coincident.
在本实施例中,光片照明成像装置,如图4所示,其照明光路的坐标系包括x’方向、y’方向和z’方向,其中x’方向为沿照明物镜302的方向,y’方向与y方向同向;x’-y’-z’坐标系和x-y-z坐标系均为标准笛卡尔坐标系,x’-y’-z’坐标系由x-y-z坐标系绕y方向顺时针旋转所得,旋转角度为照明物镜的光轴与水平面的夹角,即45°。In the present embodiment, the light sheet illumination imaging apparatus, as shown in FIG. 4, the coordinate system of the illumination light path includes an x' direction, a y' direction, and a z' direction, wherein the x' direction is a direction along the illumination objective lens 302, y 'The direction is the same as the y direction; the x'-y'-z' coordinate system and the xyz coordinate system are standard Cartesian coordinate systems, and the x'-y'-z' coordinate system is rotated clockwise by the xyz coordinate system around the y direction. The resulting angle of rotation is the angle between the optical axis of the illumination objective and the horizontal plane, ie 45°.
在本实施例中,光片照明成像装置的照明模块,其光路示意图如图4所示,第一透镜303与第二透镜304均为凸透镜,柱透镜305将光束一维压缩为线光斑,照明筒镜306与照明物镜302将此线光斑共轭照明到样本表面,其中照明筒镜306与柱透镜305共焦点。第一透镜303与第二透镜304形成第一开普勒扩束系统,其扩束比为第一扩束比;柱透镜305和照明筒镜306在z’方向上形成第二开普勒扩束系统,其扩束比为第二扩束比。In the embodiment, the illumination module of the light sheet illumination imaging device has a light path diagram as shown in FIG. 4, the first lens 303 and the second lens 304 are both convex lenses, and the cylindrical lens 305 compresses the light beam into a line spot in one dimension, and the illumination is performed. The barrel mirror 306 and the illumination objective lens 302 conjugate the line spot to the sample surface, wherein the illumination barrel mirror 306 is in focus with the cylindrical lens 305. The first lens 303 and the second lens 304 form a first Kepler beam expanding system, the beam expanding ratio is a first beam expanding ratio; the cylindrical lens 305 and the lighting barrel mirror 306 form a second Kepler expansion in the z' direction. The beam system has a beam expansion ratio of a second beam expansion ratio.
使用时,根据照明要求选取各个部件。具体地,一方面,根据第一扩束比选取第一透镜303和第二透镜304,第一扩束比计算方法如图4所示,具体地,包括如下步骤:When in use, select each component according to lighting requirements. Specifically, in one aspect, the first lens 303 and the second lens 304 are selected according to the first beam expansion ratio, and the first beam expansion ratio calculation method is as shown in FIG. 4, specifically, the following steps are included:
(1)确定光片照明的宽度,即图4中D位置处(成像位置处)的光斑在y’方向上的长度;(1) determining the width of the light sheet illumination, that is, the length of the spot in the y' direction at the position D (at the imaging position) in FIG. 4;
(2)根据照明物镜302的放大倍数计算B位置处光斑与D位置处光斑的关系,并由此计算出B位置处在光斑在y’方向上的长度,此长度即A位置处光斑在y’方向上的长度;(2) Calculate the relationship between the spot at the B position and the spot at the D position according to the magnification of the illumination objective lens 302, and thereby calculate the length of the B spot in the y' direction, which is the spot at the A position. 'the length in the direction;
(3)在本实施例中,A位置处光斑为圆形光斑,因此A位置处光斑直径即y’方向上的光斑长度,A位置处光斑直径与原始激光束的直径之比即为第一扩束比;(3) In the present embodiment, the spot at the A position is a circular spot, so the spot diameter at the A position is the spot length in the y' direction, and the ratio of the spot diameter at the A position to the diameter of the original laser beam is the first Beam expansion ratio
另一方面,根据第二扩束比选取照明筒镜306和柱透镜305,第二扩束比计算方法如图4所示,具体地,包括如下步骤:On the other hand, the illumination barrel mirror 306 and the cylindrical lens 305 are selected according to the second beam expansion ratio. The second beam expansion ratio calculation method is as shown in FIG. 4, specifically, the following steps are included:
(1)C位置为照明物镜302的后瞳位置,根据照明后照明物镜302的后瞳孔径计算C位置处光斑在z’方向上的长度;(1) The C position is the rear heel position of the illumination objective lens 302, and the length of the spot at the C position in the z' direction is calculated according to the posterior pupil diameter of the illumination rear illumination objective lens 302;
(2)A位置处光斑在z’方向上的长度即A位置处光斑的直径;(2) the length of the spot at the A position in the z' direction, that is, the diameter of the spot at the A position;
(3)C位置处光斑在z’方向上的长度与A位置处光斑在z’方向上的长度之比即为第二扩束比;(3) the ratio of the length of the spot in the z' direction at the C position to the length of the spot in the z' direction at the A position is the second expansion ratio;
因为照明光路比较长,在光路中有多块平面反射镜用于改变光路方向以及调节光束的准直性。Because the illumination path is relatively long, there are multiple planar mirrors in the optical path for changing the direction of the optical path and adjusting the collimation of the beam.
光片照明成像装置的成像过程,以及成像结果处理装置700的结果数据处理过程,如图5所示。通过选取探测器403的激活像素的宽度可控制成像范围,本实施例中,探测器403为带有sub-array(即亚阵列)探测模式的面阵探测器sCMOS,且选取的成像范围在物面上5.2微米。样本移动装置600携带样本800移动的过程中探测器403曝光获得一系列与样本表面呈45°的二维条带图像,根据样本移动装置600的运动速度、探测器403的曝光时间、探测器403的像素尺寸以及成像物镜401的放大倍数计算数据重建时每一层图像所需的平移量。The imaging process of the light sheet illumination imaging device, and the result data processing process of the imaging result processing device 700 are as shown in FIG. The imaging range can be controlled by selecting the width of the active pixel of the detector 403. In this embodiment, the detector 403 is an area array detector sCMOS with a sub-array (ie, sub-array) detection mode, and the selected imaging range is in the object. 5.2 microns on the surface. The sample moving device 600 carries the sample 800 in the process of moving the sample 800 to obtain a series of two-dimensional strip images 45° from the sample surface, according to the moving speed of the sample moving device 600, the exposure time of the detector 403, and the detector 403. The pixel size and the magnification of the imaging objective 401 calculate the amount of translation required for each layer of image when the data is reconstructed.
成像结果处理装置700通过本发明提供的成像结果处理方法对获取自光片照明成像装置的原始成像数据进行处理以获得按照样本放置方向的图像,具体地,包括层内数据重建和层间数据配准,如图6所示;The imaging result processing apparatus 700 processes the original imaging data acquired from the light sheet illumination imaging apparatus by the imaging result processing method provided by the present invention to obtain an image according to the sample placement direction, specifically, including intra-layer data reconstruction and inter-layer data matching. Quasi, as shown in Figure 6;
层内数据重建包括如下步骤:Intra-layer data reconstruction includes the following steps:
(1)在每次成像过程中获取一系列原始的倾斜于样本表面的二维条带序列,每一个条带对应多行像素,每一行像素平行于xy平面;(1) obtaining a series of original two-dimensional strip sequences inclined to the surface of the sample in each imaging process, each strip corresponding to a plurality of rows of pixels, each row of pixels being parallel to the xy plane;
(2)对原始的二维条带序列进行重新采样,将每个条带中相同行的像素拼接得到一系列帧序列,每一帧图像垂直于样本轴向;重新采样的横向采样间隔为a=v△t,轴向采样间隔为c=S psinα/M,其中v为成像时平台运动的速度,△t为探测器曝光间隔,S p为探测器像素尺寸,α为探测光轴与垂直方向的夹角,M为探测放大率; (2) Resampling the original two-dimensional stripe sequence, splicing the pixels of the same row in each strip to obtain a series of frame sequences, each frame image is perpendicular to the sample axis; the resampled horizontal sampling interval is a = v △ t, the sampling interval is axially c = S p sinα / M, wherein when the velocity v is the movement of the imaging platform, △ t is the exposure interval detector, S p is the pixel size of the detector, α is the optical axis of the probe The angle in the vertical direction, M is the detection magnification;
(3)根据上下两帧的平移间隔计算每一帧的平移间隔,其中上下两帧的平移间隔为a'=S pcosα/M;在本实施例中,通过调节平台移动速度或探测曝光间隔时间,使得a'=0.5a以方便重建后数据对齐; (3) Calculate the translation interval of each frame according to the translation interval of the upper and lower frames, wherein the translation interval of the upper and lower frames is a'=S p cosα/M; in this embodiment, by adjusting the platform movement speed or detecting the exposure interval Time, such that a' = 0.5a to facilitate data alignment after reconstruction;
(4)根据步骤(3)的计算结果通过平移或插值对每一帧进行处理;(4) processing each frame by translation or interpolation according to the calculation result of step (3);
层间数据配准通过成像冗余以及配准算法实现,针对本实施例中的样本,因其采用树脂包埋,层间形变很小,层间天然配准。Inter-layer data registration is achieved by imaging redundancy and registration algorithm. For the samples in this embodiment, because of resin embedding, the interlayer deformation is small, and the layers are naturally registered.
本领域的技术人员容易理解,以上所述仅为本发明的较佳实施例而已,并不用以限制本发明,凡在本发明的精神和原则之内所作的任何修改、等同替换和改进等,均应包含在本发明的保护范围之内。Those skilled in the art will appreciate that the above description is only a preferred embodiment of the present invention, and is not intended to limit the present invention. Any modifications, equivalent substitutions and improvements made within the spirit and scope of the present invention, All should be included in the scope of protection of the present invention.

Claims (10)

  1. 一种光片照明显微切片成像系统,其特征在于,包括光片照明成像装置、样本表面切削装置、样本移动装置以及成像结果处理装置;所述光片照明成像装置通过斜入射照明及斜探测的方式对样本表面进行光片照明成像;所述样本表面切削装置用于切削已被所述光片照明成像装置成像的样本表面以暴露未成像的部分;所述样本移动装置用于控制样本移动,使得样本不同部分被所述样本切削装置切削并被所述光片照明成像装置照明成像;所述成像结果处理装置用于控制其他装置协调工作以及对获取自所述光片照明成像装置的原始成像数据进行实时处理。A light sheet illumination microsection imaging system, comprising: a light sheet illumination imaging device, a sample surface cutting device, a sample moving device, and an imaging result processing device; the light sheet illumination imaging device passes oblique incident illumination and oblique detection Membrane illumination imaging of the sample surface; the sample surface cutting device is for cutting a sample surface that has been imaged by the light sheet illumination imaging device to expose an unimaged portion; the sample moving device is for controlling sample movement Having different portions of the sample cut by the sample cutting device and illuminated by the light sheet illumination imaging device; the imaging result processing device for controlling the coordination of other devices and for procuring the original from the light sheet illumination imaging device The imaging data is processed in real time.
  2. 如权利要求1所述的光片照明显微切片成像系统,其特征在于,所述光片照明成像装置包括照明模块与探测模块;照明模块用于形成光片照明样本,激发样本产生荧光;探测模块用于采集样本产生的荧光信号并成像;The light sheet illumination microsection imaging system according to claim 1, wherein the light sheet illumination imaging apparatus comprises a illumination module and a detection module; the illumination module is configured to form a light sheet illumination sample, and the excitation sample generates fluorescence; The module is used to collect and image the fluorescent signal generated by the sample;
    所述照明模块包括:沿光路方向依次设置的激光器、光束整形单元和照明物镜;所述激光器用于发出准直光,所述光束整形单元用于将所述激光器发出的准直光整形成为线光斑,所述照明物镜用于将所述光束整形单元整形所得的线光斑共轭到样本表面形成光片,照明样本;所述光束整形单元包括:激光扩束单元和光束压缩单元;所述激光扩束单元用于使得激光器发出的准直光在二维上得到扩束,扩束的尺寸由需要产生的照明光片宽度决定;所述光束压缩单元用于将准直光压缩成为线光斑;The illumination module includes: a laser disposed in the direction of the optical path, a beam shaping unit, and an illumination objective lens; the laser is configured to emit collimated light, and the beam shaping unit is configured to shape the collimated light emitted by the laser into a line a light spot, the illumination objective lens is configured to conjugate the line spot obtained by shaping the beam shaping unit to a sample surface to form a light sheet, and illuminate the sample; the beam shaping unit comprises: a laser beam expanding unit and a beam compressing unit; The beam expanding unit is configured to expand the collimated light emitted by the laser in two dimensions, the size of the beam expanding being determined by the width of the illumination light sheet to be generated; the beam compressing unit is configured to compress the collimated light into a line spot;
    所述探测模块包括成像物镜、成像筒镜以及探测器;所述成像物镜用于对样本激发的荧光信号成像,所述成像筒镜与所述成像物镜相结合以校正所述成像物镜的像差,所述探测器用于拍摄并记录放大后的成像结果。The detection module includes an imaging objective lens, an imaging cylindrical lens, and a detector; the imaging objective lens is used for imaging a fluorescent signal excited by a sample, and the imaging cylindrical lens is combined with the imaging objective lens to correct aberration of the imaging objective lens The detector is used to capture and record the enlarged imaging result.
  3. 如权利要求1所述的光片照明显微切片成像系统,其特征在于,所述样本表面切削装置包括刀具、刀托和刀架;所述刀具通过所述刀托固定 于所述刀架上,用于在成像时切削样本表面。A light sheet illumination microsection imaging system according to claim 1, wherein said sample surface cutting means comprises a cutter, a holder and a holder; said cutter being fixed to said holder by said holder Used to cut the surface of the sample during imaging.
  4. 如权利要求1所述的光片照明显微切片成像系统,其特征在于,所述样本移动装置包括:精密三维移动平台,用于携带样本沿x、y、z方向移动,使得样本不同部分被所述样本切削装置切削并被所述光片照明成像装置照明成像,其中x方向为扫描或切削步进方向,y方向为一次切削完成后样本移动的方向,z方向为样本轴向。The light sheet illumination microsection imaging system according to claim 1, wherein the sample moving device comprises: a precision three-dimensional moving platform for carrying the sample to move in the x, y, and z directions, so that different parts of the sample are The sample cutting device is cut and illuminated by the light sheet illumination imaging device, wherein the x direction is a scanning or cutting step direction, the y direction is a direction in which the sample moves after one cutting is completed, and the z direction is a sample axial direction.
  5. 如权利要求2所述的光片照明显微切片成像系统,其特征在于,所述照明物镜与所述成像物镜均为数值孔径较大的物镜,两物镜的光轴夹角为90°,且均倾斜于样本表面;同时照明物镜与成像物镜的工作距离保证两物镜焦点重合时物镜之间不会相互碰撞。The optical sheet illumination microsection imaging system according to claim 2, wherein the illumination objective lens and the imaging objective lens are both objective lenses having a large numerical aperture, and the optical axes of the two objective lenses are at an angle of 90°, and Both are inclined to the surface of the sample; at the same time, the working distance between the illumination objective and the imaging objective ensures that the objective lenses do not collide with each other when the two objective lenses coincide.
  6. 如权利要求2所述的光片照明显微切片成像系统,其特征在于,所述激光扩束单元包括:沿光路方向共焦点共光轴设置的第一透镜和第二透镜;所述第一透镜为凸透镜或者凹透镜,所述第二透镜为凸透镜或者凹透镜;所述第一透镜和所述第二透镜按照开普勒式或伽利略式变倍扩束镜的形式排布;The light sheet illumination microsection imaging system according to claim 2, wherein the laser beam expanding unit comprises: a first lens and a second lens disposed along a light path direction confocal common optical axis; The lens is a convex lens or a concave lens, and the second lens is a convex lens or a concave lens; the first lens and the second lens are arranged in the form of a Kepler or Galilean variable magnification beam expander;
    所述光束压缩单元包括:共焦点设置的柱透镜和照明筒镜;柱透镜用于将准直光压缩成为线光斑,照明筒镜用于形成光片,照明样本。The beam compression unit comprises: a cylindrical lens and an illumination barrel mirror arranged in a confocal manner; the cylindrical lens is used to compress the collimated light into a line spot, and the illumination barrel mirror is used to form a light sheet to illuminate the sample.
  7. 如权利要求2所述的光片照明显微切片成像系统,其特征在于,所述探测器为可调节像素激活范围的面阵探测器或者线阵探测器。The light sheet illumination microsection imaging system of claim 2 wherein said detector is an area array detector or a line array detector that adjusts a range of pixel activation.
  8. 如权利要求3所述的光片照明显微切片成像系统,其特征在于,所述样本表面切削装置切削样本表面的方式为金刚石刀具切削、碳化钨刀具切削或者振动切片切削。The light sheet illumination microsection imaging system according to claim 3, wherein the sample surface cutting means cuts the surface of the sample by diamond cutter cutting, tungsten carbide cutter cutting or vibration section cutting.
  9. 如权利要求1至4任一项所述的光片照明显微切片成像系统,其特征在于,所述光片照明成像装置、所述样本表面切削装置以及所述样本移动装置安装于同一刚性结构中以保持工作坐标的精确度。The light sheet illumination microsection imaging system according to any one of claims 1 to 4, wherein the light sheet illumination imaging device, the sample surface cutting device, and the sample moving device are mounted on the same rigid structure. In order to maintain the accuracy of the working coordinates.
  10. 一种基于权利要求1所述的光片照明显微切片成像系统的成像结 果处理方法,其特征在于,包括层内数据重建和层间数据配准;A method for processing an imaging result according to the light sheet illumination microsection imaging system of claim 1, comprising: intra-layer data reconstruction and inter-layer data registration;
    所述层内数据重建具体包括如下步骤:The intra-layer data reconstruction specifically includes the following steps:
    (1)在每次成像过程中获取一系列原始的倾斜于样本表面的二维条带序列,每一个条带对应多行像素,每一行像素平行于xy平面;(1) obtaining a series of original two-dimensional strip sequences inclined to the surface of the sample in each imaging process, each strip corresponding to a plurality of rows of pixels, each row of pixels being parallel to the xy plane;
    (2)对原始的二维条带序列进行重新采样,将每个条带中相同行的像素拼接得到一系列帧序列,每一帧图像垂直于样本轴向;重新采样的横向采样间隔为a=v△t,轴向采样间隔为c=S psinα/M,其中v为成像时平台运动的速度,△t为探测器曝光间隔,S p为探测器像素尺寸,α为探测光轴与垂直方向的夹角,M为探测放大率; (2) Resampling the original two-dimensional stripe sequence, splicing the pixels of the same row in each strip to obtain a series of frame sequences, each frame image is perpendicular to the sample axis; the resampled horizontal sampling interval is a = v △ t, the sampling interval is axially c = S p sinα / M, wherein when the velocity v is the movement of the imaging platform, △ t is the exposure interval detector, S p is the pixel size of the detector, α is the optical axis of the probe The angle in the vertical direction, M is the detection magnification;
    (3)根据上下两帧的平移间隔计算每一帧的平移间隔,其中上下两帧的平移间隔为a'=S pcosα/M; (3) Calculate the translation interval of each frame according to the translation interval of the upper and lower frames, wherein the translation interval of the upper and lower frames is a'=S p cosα/M;
    (4)根据步骤(3)的计算结果通过平移或插值对每一帧进行处理;(4) processing each frame by translation or interpolation according to the calculation result of step (3);
    所述层间数据配准,将上下连续两次成像过程中所探测到的图像,在层内数据重建后使用成像过程中的冗余部分数据进行算法配准。The inter-layer data registration performs image registration using the redundant partial data in the imaging process after the intra-layer data is reconstructed.
PCT/CN2018/114705 2017-11-20 2018-11-09 Light-sheet illumination microsection imaging system and imaging result processing method WO2019096062A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201711160085.X 2017-11-20
CN201711160085.XA CN108020503B (en) 2017-11-20 2017-11-20 Light sheet illumination microscopic section imaging system and imaging result processing method

Publications (1)

Publication Number Publication Date
WO2019096062A1 true WO2019096062A1 (en) 2019-05-23

Family

ID=62080726

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2018/114705 WO2019096062A1 (en) 2017-11-20 2018-11-09 Light-sheet illumination microsection imaging system and imaging result processing method

Country Status (2)

Country Link
CN (1) CN108020503B (en)
WO (1) WO2019096062A1 (en)

Families Citing this family (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108020503B (en) * 2017-11-20 2020-09-08 苏州博芮恩光电科技有限公司 Light sheet illumination microscopic section imaging system and imaging result processing method
WO2020019409A1 (en) * 2018-07-26 2020-01-30 Focus-Ebeam Technology (Beijing) Co., Ltd. Imaging system and method for specimen detection
CN108982454B (en) * 2018-07-30 2021-03-02 华中科技大学苏州脑空间信息研究院 Axial multilayer parallel scanning microscopic imaging method and system
CN108982503B (en) * 2018-07-30 2021-03-02 华中科技大学苏州脑空间信息研究院 Multilayer signal coplanar parallel detection method based on gradient reflection
CN111122567B (en) * 2018-11-01 2022-09-16 华中科技大学苏州脑空间信息研究院 High-flux optical tomography three-dimensional imaging system
CN111122568B (en) * 2018-11-01 2022-04-22 华中科技大学苏州脑空间信息研究院 High-flux optical tomography method and imaging system
CN109596588B (en) * 2018-12-16 2021-10-08 华中科技大学 High-resolution four-dimensional light field microscopic imaging system based on light sheet illumination
CN111012325B (en) * 2019-12-05 2022-07-29 华中科技大学苏州脑空间信息研究院 Precise light control system and light control method
CN111413342B (en) * 2020-04-20 2021-03-26 华中科技大学 Microscopic imaging system for frozen section
CN113741020A (en) * 2021-08-25 2021-12-03 华中科技大学苏州脑空间信息研究院 Natural modulation optical sheet illumination imaging method and system

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20120002043A1 (en) * 2009-03-27 2012-01-05 Sony Corporation Observation apparatus
CN102928970A (en) * 2012-10-19 2013-02-13 华中科技大学 Method and system for rapidly three-dimensionally microimaging large sample
CN103207150A (en) * 2013-03-21 2013-07-17 华中科技大学 High-resolution tomography optical microscopic imaging device for tissue samples
CN104677871A (en) * 2015-02-27 2015-06-03 中国科学院自动化研究所 Multi-photon exciting, illuminating and micro-imaging system of X-ray plate
CN105190399A (en) * 2013-05-10 2015-12-23 欧洲分子生物学实验室 A microscope module for imaging a sample
CN105359025A (en) * 2013-07-10 2016-02-24 卡尔蔡司显微镜有限责任公司 Assembly for light sheet microscopy
CN108020503A (en) * 2017-11-20 2018-05-11 华中科技大学 A kind of mating plate illumination microsection imaging system and method for processing imaging results

Family Cites Families (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8575570B2 (en) * 2010-08-25 2013-11-05 California Institute Of Technology Simultaneous orthogonal light sheet microscopy and computed optical tomography
CN103886568B (en) * 2014-03-18 2017-06-06 南方医科大学 Lung 4D CT image super-resolution rebuilding methods based on registration
CN104111242B (en) * 2014-06-17 2017-08-18 华中科技大学 A kind of voxel super-resolution micro imaging method
CN104967759B (en) * 2015-02-13 2016-05-04 华中科技大学 A kind of scanning imaging system for low light level signal
DE102015209756A1 (en) * 2015-05-28 2016-12-01 Carl Zeiss Microscopy Gmbh Arrangement and method for light-sheet microscopy
CN105548927B (en) * 2015-08-06 2018-11-09 清华大学 The magnetic resonance diffusion imaging method repeatedly excited excited simultaneously based on multilayer

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20120002043A1 (en) * 2009-03-27 2012-01-05 Sony Corporation Observation apparatus
CN102928970A (en) * 2012-10-19 2013-02-13 华中科技大学 Method and system for rapidly three-dimensionally microimaging large sample
CN103207150A (en) * 2013-03-21 2013-07-17 华中科技大学 High-resolution tomography optical microscopic imaging device for tissue samples
CN105190399A (en) * 2013-05-10 2015-12-23 欧洲分子生物学实验室 A microscope module for imaging a sample
CN105359025A (en) * 2013-07-10 2016-02-24 卡尔蔡司显微镜有限责任公司 Assembly for light sheet microscopy
CN104677871A (en) * 2015-02-27 2015-06-03 中国科学院自动化研究所 Multi-photon exciting, illuminating and micro-imaging system of X-ray plate
CN108020503A (en) * 2017-11-20 2018-05-11 华中科技大学 A kind of mating plate illumination microsection imaging system and method for processing imaging results

Also Published As

Publication number Publication date
CN108020503B (en) 2020-09-08
CN108020503A (en) 2018-05-11

Similar Documents

Publication Publication Date Title
WO2019096062A1 (en) Light-sheet illumination microsection imaging system and imaging result processing method
JP6553631B2 (en) Method and apparatus for light sheet microscopy
JP6934856B2 (en) Optical sheet microscope that simultaneously images multiple target surfaces
US9857577B2 (en) Microscope with a viewing direction perpendicular to the illumination direction
JP6996048B2 (en) Wide field high resolution microscope
CN108982452B (en) Multi-focus scanning three-dimensional imaging method and system based on double-spiral point spread function
WO2012035903A1 (en) Device for observing three-dimensional confocal point, and observation focal plane displacement/correction unit
EP3032312B1 (en) Confocal scanner and confocal microscope
TW200907318A (en) Eccentricity amount measuring device
JP7109130B2 (en) microscope
JP6798990B2 (en) Line scan, specimen scan, multimode confocal microscope
CN109477954A (en) SCAPE microscopy and image reconstruction with phase modulation component
US20220043246A1 (en) Microscope and method for microscopic image recording with variable illumination
US9134523B2 (en) Predictive focusing for image scanning systems
JP2009152120A (en) Electron beam tomography method, and electron beam tomography device
US20200379232A1 (en) Optical scanning arrangement and method
KR101393514B1 (en) High-sensitivity and video-rate confocal fluorescence microscope
WO2023103960A1 (en) Three-dimensional imaging apparatus and imaging method
CN113075174B (en) Oblique top-mounted static Bessel optical sheet imaging system
JP2001059712A (en) Method and apparatus for detecting stereoscopic shape as well as confocal detector
JP2005070225A (en) Surface image projector and the surface image projection method
CN116360087A (en) Multichannel light sheet illumination microscopic imaging device and operation method thereof
JP2020101743A (en) Confocal microscope and its imaging method
CN212410449U (en) Image scanning microscopic imaging system
US6744572B1 (en) System and method for imaging an object

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 18878980

Country of ref document: EP

Kind code of ref document: A1

122 Ep: pct application non-entry in european phase

Ref document number: 18878980

Country of ref document: EP

Kind code of ref document: A1