WO2020088014A1 - 一种高通量光学层析三维成像系统 - Google Patents
一种高通量光学层析三维成像系统 Download PDFInfo
- Publication number
- WO2020088014A1 WO2020088014A1 PCT/CN2019/098367 CN2019098367W WO2020088014A1 WO 2020088014 A1 WO2020088014 A1 WO 2020088014A1 CN 2019098367 W CN2019098367 W CN 2019098367W WO 2020088014 A1 WO2020088014 A1 WO 2020088014A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- image
- sample
- strip
- pixels
- imaging
- Prior art date
Links
Images
Classifications
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N21/00—Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
- G01N21/62—Systems in which the material investigated is excited whereby it emits light or causes a change in wavelength of the incident light
- G01N21/63—Systems in which the material investigated is excited whereby it emits light or causes a change in wavelength of the incident light optically excited
- G01N21/64—Fluorescence; Phosphorescence
- G01N21/645—Specially adapted constructive features of fluorimeters
- G01N21/6456—Spatial resolved fluorescence measurements; Imaging
- G01N21/6458—Fluorescence microscopy
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N21/00—Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
- G01N21/84—Systems specially adapted for particular applications
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N1/00—Sampling; Preparing specimens for investigation
- G01N1/28—Preparing specimens for investigation including physical details of (bio-)chemical methods covered elsewhere, e.g. G01N33/50, C12Q
- G01N1/286—Preparing specimens for investigation including physical details of (bio-)chemical methods covered elsewhere, e.g. G01N33/50, C12Q involving mechanical work, e.g. chopping, disintegrating, compacting, homogenising
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N21/00—Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
- G01N21/01—Arrangements or apparatus for facilitating the optical investigation
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N21/00—Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
- G01N21/62—Systems in which the material investigated is excited whereby it emits light or causes a change in wavelength of the incident light
- G01N21/63—Systems in which the material investigated is excited whereby it emits light or causes a change in wavelength of the incident light optically excited
- G01N21/64—Fluorescence; Phosphorescence
- G01N21/6428—Measuring fluorescence of fluorescent products of reactions or of fluorochrome labelled reactive substances, e.g. measuring quenching effects, using measuring "optrodes"
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B21/00—Microscopes
- G02B21/0004—Microscopes specially adapted for specific applications
- G02B21/002—Scanning microscopes
- G02B21/0024—Confocal scanning microscopes (CSOMs) or confocal "macroscopes"; Accessories which are not restricted to use with CSOMs, e.g. sample holders
- G02B21/0032—Optical details of illumination, e.g. light-sources, pinholes, beam splitters, slits, fibers
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B21/00—Microscopes
- G02B21/0004—Microscopes specially adapted for specific applications
- G02B21/002—Scanning microscopes
- G02B21/0024—Confocal scanning microscopes (CSOMs) or confocal "macroscopes"; Accessories which are not restricted to use with CSOMs, e.g. sample holders
- G02B21/0036—Scanning details, e.g. scanning stages
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B21/00—Microscopes
- G02B21/0004—Microscopes specially adapted for specific applications
- G02B21/002—Scanning microscopes
- G02B21/0024—Confocal scanning microscopes (CSOMs) or confocal "macroscopes"; Accessories which are not restricted to use with CSOMs, e.g. sample holders
- G02B21/0052—Optical details of the image generation
- G02B21/0076—Optical details of the image generation arrangements using fluorescence or luminescence
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B21/00—Microscopes
- G02B21/0004—Microscopes specially adapted for specific applications
- G02B21/002—Scanning microscopes
- G02B21/0024—Confocal scanning microscopes (CSOMs) or confocal "macroscopes"; Accessories which are not restricted to use with CSOMs, e.g. sample holders
- G02B21/008—Details of detection or image processing, including general computer control
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B21/00—Microscopes
- G02B21/06—Means for illuminating specimens
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B21/00—Microscopes
- G02B21/24—Base structure
- G02B21/26—Stages; Adjusting means therefor
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B21/00—Microscopes
- G02B21/36—Microscopes arranged for photographic purposes or projection purposes or digital imaging or video purposes including associated control and data processing arrangements
- G02B21/361—Optical details, e.g. image relay to the camera or image sensor
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B21/00—Microscopes
- G02B21/36—Microscopes arranged for photographic purposes or projection purposes or digital imaging or video purposes including associated control and data processing arrangements
- G02B21/365—Control or image processing arrangements for digital or video microscopes
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B21/00—Microscopes
- G02B21/36—Microscopes arranged for photographic purposes or projection purposes or digital imaging or video purposes including associated control and data processing arrangements
- G02B21/365—Control or image processing arrangements for digital or video microscopes
- G02B21/367—Control or image processing arrangements for digital or video microscopes providing an output produced by processing a plurality of individual source images, e.g. image tiling, montage, composite images, depth sectioning, image comparison
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T11/00—2D [Two Dimensional] image generation
- G06T11/003—Reconstruction from projections, e.g. tomography
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T11/00—2D [Two Dimensional] image generation
- G06T11/003—Reconstruction from projections, e.g. tomography
- G06T11/006—Inverse problem, transformation from projection-space into object-space, e.g. transform methods, back-projection, algebraic methods
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T17/00—Three dimensional [3D] modelling, e.g. data description of 3D objects
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/0002—Inspection of images, e.g. flaw detection
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
- H04N13/106—Processing image signals
- H04N13/156—Mixing image signals
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/20—Image signal generators
- H04N13/204—Image signal generators using stereoscopic image cameras
- H04N13/207—Image signal generators using stereoscopic image cameras using a single 2D image sensor
- H04N13/221—Image signal generators using stereoscopic image cameras using a single 2D image sensor using the relative movement between cameras and objects
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N1/00—Sampling; Preparing specimens for investigation
- G01N1/28—Preparing specimens for investigation including physical details of (bio-)chemical methods covered elsewhere, e.g. G01N33/50, C12Q
- G01N1/286—Preparing specimens for investigation including physical details of (bio-)chemical methods covered elsewhere, e.g. G01N33/50, C12Q involving mechanical work, e.g. chopping, disintegrating, compacting, homogenising
- G01N2001/2873—Cutting or cleaving
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N21/00—Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
- G01N21/01—Arrangements or apparatus for facilitating the optical investigation
- G01N2021/0106—General arrangement of respective parts
- G01N2021/0112—Apparatus in one mechanical, optical or electronic block
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N21/00—Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
- G01N21/17—Systems in which incident light is modified in accordance with the properties of the material investigated
- G01N2021/1765—Method using an image detector and processing of image signal
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N21/00—Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
- G01N21/17—Systems in which incident light is modified in accordance with the properties of the material investigated
- G01N2021/178—Methods for obtaining spatial resolution of the property being measured
- G01N2021/1785—Three dimensional
- G01N2021/1787—Tomographic, i.e. computerised reconstruction from projective measurements
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B21/00—Microscopes
- G02B21/06—Means for illuminating specimens
- G02B21/08—Condensers
- G02B21/082—Condensers for incident illumination only
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/09—Beam shaping, e.g. changing the cross-sectional area, not otherwise provided for
- G02B27/0938—Using specific optical elements
- G02B27/095—Refractive optical elements
- G02B27/0955—Lenses
- G02B27/0966—Cylindrical lenses
Definitions
- the present disclosure relates to imaging technology, and in particular to a high-throughput optical tomography three-dimensional imaging system.
- the out-of-focus background interference of the traditional wide-field microscope makes it impossible to obtain a clear image of the focal plane.
- the tissue is cut into thin slices to avoid background interference, and optical tomography uses optical imaging methods to achieve similar tissue slices.
- the imaging effect is also called optical sectioning.
- Confocal microscopic imaging technology blocks the defocused background interference by placing a pinhole in front of the camera, and only passes the effective signal of the focal plane to achieve the optical tomography effect.
- Multi-photon excitation microscopic imaging technology utilizes nonlinear effects and only has sufficient energy at the focal point to excite the fluorescence signal of the sample to achieve the ideal optical tomography effect.
- these two optical tomography techniques use point-by-point scanning imaging, which is obviously insufficient in imaging flux compared with wide-field imaging.
- Structured light illumination microimaging technology uses a high-frequency periodic pattern modulation to superimpose wide-field illumination to realize the modulation of the focal plane signal, while the defocus signal is suppressed due to the rapid attenuation of this high-frequency modulation, thereby achieving optical Chromatography.
- a structured light illumination microscopic imaging reconstruction algorithm to obtain an optical tomographic image.
- this method also needs to scan the sample imaging area back and forth three times to obtain the original data required for the reconstruction of the structured light illumination microscopic imaging algorithm, which sacrifices the imaging speed, and this imaging method needs to be used in the strip imaging system
- the beam modulation device realizes the modulation of the illumination light field, which increases the complexity of the system.
- the imaging quality depends greatly on the contrast of the modulation pattern.
- the existing imaging methods cannot perform three-dimensional imaging, so it is necessary to develop a simple and efficient high-throughput optical tomography three-dimensional imaging system.
- the purpose of the present disclosure is to overcome the above technical deficiencies, and propose a high-throughput optical tomography three-dimensional imaging system to solve the technical problem of slow three-dimensional imaging speed in the prior art.
- the technical solution of the present disclosure provides a high-throughput optical tomography three-dimensional imaging system, which is characterized by including:
- a light beam modulation module which is used to modulate the light beam into a modulated light beam that can be focused on the focal plane of the objective lens and can diverge on the defocused surface of the objective lens, and the modulated light beam has not exactly the same modulation intensity on the focal plane of the objective lens;
- An imaging module which is used to image at least one sample strip of at least one surface layer of a sample illuminated by a modulated beam under different pixels;
- Resection module which is used to remove the imaged surface layer of the sample
- the demodulation module is used to demodulate the sample image of a sample strip in a surface layer to form an optical tomographic image, and reconstruct the optical tomographic image of each sample strip of each surface layer to form a three-dimensional image.
- the present disclosure forms at least one surface layer by separating samples and at least one surface layer to form at least one sample strip, which can achieve imaging of the entire sample by imaging each sample strip when When performing multi-level imaging, the imaged part can be cut by the excision module to realize the imaging of any layer of the sample, and the imaging speed is fast and the efficiency is high.
- FIG. 1 is a schematic diagram of the optical structure of the high-throughput optical tomography three-dimensional imaging system of the present disclosure
- FIG. 2 is a connection block diagram of the high-throughput optical tomography three-dimensional imaging system of the present disclosure
- FIG. 3 is a schematic diagram of sample imaging of the present disclosure
- FIG. 4 is a schematic diagram of reconstruction of an optical tomographic image according to Embodiment 1 of the present disclosure
- Example 5 is a schematic diagram of reconstruction of an optical tomographic image of Example 2 of the present disclosure.
- the present disclosure provides a high-throughput optical tomography three-dimensional imaging system 10, which includes a beam modulation module 11, an imaging module 12, an ablation module 13, and a demodulation module 14.
- the beam modulation module 11 is used to modulate the beam into a modulated beam 11b that can be focused on the focal plane of the objective lens 117 and can diverge on the defocused surface of the objective lens 117, and the modulated beam 11b has not exactly the same modulation on the focal plane of the objective lens 117 Intensity; the beam modulation module 11 includes a shaping optical path for shaping the illumination light into a linear beam 11a and a modulation optical path for modulating the linear beam 11a into a linear illumination modulation beam 11b.
- the beam modulation module 11 may be composed of a laser light source 111, a first lens 112, a second lens 113, a cylindrical lens 114, a third lens 115, a dichroic mirror 116, and an objective lens 117 arranged in sequence along the light direction.
- the laser light source 111, the first The lens 112, the second lens 113, and the cylindrical lens 114 form a shaping optical path
- the third lens 115, the dichroic mirror 116, and the objective lens 117 form a modulation optical path.
- the laser light source 111 emits illumination light, which is processed by the first lens 112 and the second lens 113 in order to expand the beam.
- the expanded beam is modulated by the cylindrical lens 114 to form a linear beam 11a.
- the linear beam 11a is divergent light, so it is modulated by the third lens 115 to form a parallel beam of linear beam 11a, and after the dichroic mirror 116 modulates its incident direction, it enters the objective lens 117 to form the focal plane of the objective lens 117 and focus
- the line illuminating the modulated light beam 11b can diverge on the defocused surface of the objective lens 117.
- the optical axis of the modulated beam 11b is perpendicular to the optical axis of the illumination light and the non-reflected linear beam 11a, that is, the first lens 112, the second lens 113, the cylindrical lens 114, and the third lens 115 are coaxial
- the central axes of the first lens 112, the second lens 113, the cylindrical lens 114, and the third lens 115 are perpendicular to the central axis of the objective lens 117.
- the angle between the dichroic mirror 116 and the optical axis of the modulated beam 11b is 45 °, which can ensure that the width of the linear beam 11a reflected by the dichroic mirror 116 does not change.
- the illumination light is first formed into a linear beam 11a, and then the linear beam 11a is modulated into a modulated beam 11b that can be illuminated linearly.
- the focal plane of the objective lens 117 can be focused and the objective lens 117 can be focused on The modulated beam 11b diverging from the out-of-focus plane illuminates the sample 30 linearly, which can facilitate the sample 30 to excite fluorescence, thereby facilitating subsequent imaging.
- the above-mentioned modulated light beam 11b is specifically modulated by waveforms with not exactly the same modulation intensity at the focal plane of the objective lens, such as Gaussian modulation, sinusoidal modulation, and triangular modulation. Since the illumination beam of this embodiment uses a Gaussian beam, the modulated beam 11b formed in this embodiment is Gaussian modulated. In this embodiment, other waveform modulations with different modulation strengths may also be used as needed.
- the imaging module 12 is used to image at least one sample strip of at least one surface layer of the sample 20 illuminated by the modulated beam 11b under different pixels; it includes a driving unit 121, an imaging unit 122, an image block acquisition unit 123, and a stitching unit 124,
- the driving unit 121 is used to drive the beam modulation module 11 and the sample 20 to perform relative motion in three directions perpendicular to each other, and the imaging unit 122 is used to continuously image along the length direction of the sample strip.
- the relative movement direction of one of the module 11 and the sample 20 is the same.
- the driving unit 121 of this embodiment may adopt a three-dimensional electric translation stage, and the sample 20 may be placed on the three-dimensional electric translation stage, and the three-dimensional electric translation stage may drive the sample 20 in the horizontal direction, Longitudinal movement, and can drive the sample 20 to move up and down in the vertical plane, so as to achieve relative movement of the driving beam modulation module 11 and the sample 20 in three directions perpendicular to each other; it can be understood that the driving unit 121 of this embodiment It is not limited to driving the sample 20 to move in three vertical directions, it may also drive the beam modulation module 11 to move in three vertical directions.
- the three-dimensional motorized translation stage is located directly under the objective lens 117, and the upper surface of the three-dimensional motorized translation stage is in a horizontal state, and the central axis of the objective lens 117 is perpendicular to the upper surface of the three-dimensional motorized translation stage.
- the imaging unit 122 is composed of an imaging optical path, which is composed of an emission filter 122a, a barrel lens 122b, and an imaging camera 122c located directly above the objective lens 117.
- the sample 20 is excited by the modulated light beam 11b and emits fluorescence through the objective lens in turn. 117.
- the dichroic mirror 116, the emission filter 122a and the barrel lens 122b, and the imaging camera 122c detects and forms an image.
- the imaging camera 122c of this embodiment is an area array CCD (Charge-coupled device, charge coupled element) or area array CMOS (Complementary) with Sub-array (Sub-array) or ROI (Region of Interest).
- the imaging area of the imaging camera 122c in this embodiment is N rows of pixels, N ⁇ 2, and the imaging direction and the width of the imaging area of the imaging camera 122c are respectively equal to the line illumination modulation beam 11b The direction and width are the same.
- the sample 20 in this embodiment may be in the shape of a rectangular block. Therefore, when performing three-dimensional imaging, the sample 20 may be composed of a sample body and a solid medium wrapped around the sample body.
- the solid medium is generally agar, paraffin or Resin.
- the sample 20 can be divided to form a plurality of surface layers that are evenly arranged from top to bottom, respectively: first surface layer, second surface layer, third surface layer, etc., and each surface layer is evenly divided in the longitudinal direction to form a plurality of sample strips, These are: first sample strip, second sample strip, third sample strip, etc.
- the width of the sample strip may be set to be the same as the width of the N rows of pixels of the imaging camera 122c.
- the sample when imaging, the sample is set to eight surface layers, and each surface layer is divided to form four sample strips.
- the driving unit 121 drives the sample 20 to move continuously and at a constant speed in the lateral direction, then the imaging camera 122c The first sample strip 211 of 21 is imaged.
- the sample 20 returns in the lateral direction, which can image the first sample strip 221 of the second surface layer 22, and then the third surface layer 23 in turn The first sample strip 231 and the first sample strip 241 of the fourth surface layer 24 are imaged.
- the imaging camera 122c has a limited number of imaging layers in the vertical direction, when the set imaging layer number is reached, for example, the fourth surface layer 24
- the sample 20 can be driven to move longitudinally by the width of one sample strip, and the second sample strip 212 of the first surface layer 21, the second sample strip 222 of the second surface layer 22, and the third surface layer 23
- the second sample strip 232 of the second surface strip and the second sample strip 242 of the fourth surface layer 24 are imaged, and then the other sample strips of the first surface layer 21 to the fourth surface layer 24 are imaged as described above.
- Module 13 will be completed A first skin layer 21 to the fourth surface 24 removed; resection, drive the sample 20 is moved upward from four skin thickness, and then continue the imaging surface of the fifth to eighth surface.
- I (i) is the sample image formed under i pixels
- f (i) is the modulation intensity corresponding to the sample image I (i)
- I in is the focal plane image of the sample image
- I out is the defocus of the sample image Face image
- the N rows of pixels of the imaging camera 122c are arranged in the lateral direction, which is the same as the movement direction of the sample strip, so that the sample strips of the sample 20 can be imaged separately under different pixels.
- the modulated beam 11b has the following characteristics in the X and Y directions, respectively:
- the modulated light beam 11b has not exactly the same modulation intensity in the X direction on the N rows of pixels, and the modulated light beam 11b has the same modulation intensity in the Y direction on each row of pixels in the N rows of pixels, specifically
- the X direction is horizontal and the Y direction is vertical.
- the distribution direction and width of the pixels in the N rows are the same as the distribution direction and width of the line illumination modulated light beam 11b, respectively, and are in a conjugate relationship with each other, thereby facilitating the imaging area corresponding to the line illumination modulated beam 11b.
- the pixels in this embodiment are line pixels, and the sample image is a stripe image.
- the sample 20 moves along the imaging pixel arrangement direction. Since the exposure time of a single frame of imaging is the same as the time for the sample 20 to move one row of pixels, each row of pixels is sequentially along the length direction of the sample 20 A plurality of strip image blocks are formed, and the plurality of strip image blocks are continuous imaging of the sample 20.
- the image block obtaining unit 123 in this embodiment is used to obtain a stripe image block of the i-th row of pixels in each frame image of a sample strip obtained in chronological order.
- the calculation formula of the stripe image block is
- I t (i) is the strip image block corresponding to the pixel of the i-th row in the t-th image
- ie Is the focal plane image of the m-th strip image block in the complete strip image
- f (i) is the modulation intensity corresponding to the pixel in the i-th row
- the stitching unit 124 is used to stitch the stripe image blocks of the i-th row of pixels in each frame image of a sample strip in sequence to obtain the stripe image of the i-th row of pixels.
- the calculation formula is:
- the stripe image is formed by stitching M stripe image blocks, where, Is the focal plane image corresponding to the m-th strip image block in the strip image, m ⁇ M.
- the above-mentioned stripe image is formed by shifting and stitching a plurality of stripe images corresponding to a row of pixels, and it is the stripe image described above, that is, N rows of pixels can be spliced to form N stripe images, respectively.
- the demodulation module 14 is used to demodulate the strip image of a sample strip in a surface layer to form an optical tomographic image, and reconstruct the optical tomographic image of each sample strip of each surface layer to form a three-dimensional image.
- the demodulation module 14 includes an image accumulation unit 141, a demodulation unit 142, and a tomography unit 143.
- the image accumulation unit 141 is used to accumulate the strip images of at least one row of pixels of a sample strip to form a first strip image, And accumulate the strip images of at least one row of pixels of the sample strip to form a second strip image.
- the demodulation unit 142 is used to demodulate the first strip image and the second strip image into an optical tomographic image.
- the tomography unit 143 is used to reconstruct optical tomographic images of multiple sample strips to form a three-dimensional image.
- the optical tomographic image obtained by the above demodulation algorithm is zero, so in this embodiment, the cumulative value of the modulation intensity corresponding to the stripe image under ⁇ pixels and the modulation intensity corresponding to the stripe image under ⁇ pixels can be set The accumulated value of is different.
- the demodulation unit 142 can obtain the focal plane image of the corresponding sample strip, that is, the optical tomographic image, according to the following demodulation algorithm.
- the demodulation formula of the demodulation algorithm adopted by the demodulation unit 142 is:
- ⁇ and ⁇ are positive integers, c is a constant greater than 0, I 1 is the cumulative sum of the stripe images acquired under ⁇ pixels, and I 2 is the cumulative sum of the sample images acquired under ⁇ pixels; ⁇ pixels The accumulated value of the modulation intensity corresponding to the sample image below is not the same as the accumulated value of the modulation intensity corresponding to the sample image under ⁇ pixels.
- each stripe is composed of multiple stripe image blocks, so
- Embodiment 1 As shown in (a) of FIG. 4, when the sample moves along the pixel arrangement direction of N rows, it can obtain an N + M-1 frame image (M in the time t 1 to t N + M-1 Is the number of stripe image blocks corresponding to the complete stripe image.
- N is 8 and M is 9
- each row of pixels in the N + M-1 frame image corresponds to a stripe image block
- a first frame bar may acquire a first row of pixels of the image with the image block I 1 (1), the pixels of row 1 of the second frame image block with the image I 2 (1), the first and the frame image N
- Strip image block I 2 (1) to strip image block I N + M-1 (1) can be spliced in sequence to form a strip image, and the corresponding pixels from the second row to the Nth row can be spliced to form the corresponding Stripe image.
- Embodiment 2 As shown in FIG. 5, a stripe image formed by stitching under the pixels in the fourth row among them Strip image formed by stitching under the first row of pixels among them Strip image formed by stitching under the second row of pixels among them Stripe image formed by stitching under the third row of pixels among them
- I 1 is the cumulative sum of the sample images acquired under the pixels in rows 1, 2, and 3, that is I 2 is the cumulative sum of the sample images obtained under the pixels in the fourth row, ie Then it is equivalent to selecting the value of ⁇ to be 3 and the value of ⁇ to be 1, so it can be known from the demodulation formula: therefore,
- the optical tomographic images of each sample strip can be obtained in turn, and the tomography unit 143 can stitch all the optical tomographic images to form a three-dimensional three-dimensional image.
- the sample 20 when the longitudinal width of the sample 20 is smaller than the width of the imaging area of the N-line pixels of the imaging camera 122c, there is only one sample strip per surface layer, and the sample 20 does not require longitudinal movement during the imaging process;
- the longitudinal width of 20 is smaller than the width of the imaging area of the N-line pixels of the imaging camera 122c, and the thickness is smaller than the imaging depth of the imaging camera 122c, for example, there are only two surface layers, then the sample 20 only needs to make a round-trip motion in the lateral direction , It also does not require the excision module 13 to perform surface excision; where, when the width of the sample 20 is less than the width of the N-line pixel imaging area of the imaging camera 122c and its thickness is less than the set thickness of one surface, then the sample 20 It only needs one scan for imaging, which can be regarded as two-dimensional imaging. As can be seen from the above, this embodiment forms a three-dimensional image by superimposing multiple two-dimensional images.
Landscapes
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Chemical & Material Sciences (AREA)
- Analytical Chemistry (AREA)
- Engineering & Computer Science (AREA)
- Optics & Photonics (AREA)
- Health & Medical Sciences (AREA)
- Immunology (AREA)
- Multimedia (AREA)
- Pathology (AREA)
- General Health & Medical Sciences (AREA)
- Life Sciences & Earth Sciences (AREA)
- Biochemistry (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Theoretical Computer Science (AREA)
- Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
- Signal Processing (AREA)
- Chemical Kinetics & Catalysis (AREA)
- General Engineering & Computer Science (AREA)
- Computer Graphics (AREA)
- Software Systems (AREA)
- Geometry (AREA)
- Quality & Reliability (AREA)
- Mathematical Analysis (AREA)
- Pure & Applied Mathematics (AREA)
- Algebra (AREA)
- Mathematical Optimization (AREA)
- Mathematical Physics (AREA)
- Microscoopes, Condenser (AREA)
- Investigating Or Analysing Materials By Optical Means (AREA)
- Studio Devices (AREA)
- Investigating, Analyzing Materials By Fluorescence Or Luminescence (AREA)
Abstract
Description
Claims (10)
- 一种高通量光学层析三维成像系统,其特征在于,包括:光束调制模块,其用于将光束调制成能够在物镜的焦平面聚焦并能够在物镜的离焦面发散的调制光束,且该调制光束在物镜的焦平面具有不完全相同的调制强度;成像模块,其用于采用相机对调制光束照明下的同一样本的至少一个表层的至少一个样本条在不同像素下进行成像;切除模块,其用于将样本的已成像的表层切除;解调模块,其用于将一个表层中的一个样本条的样本图像解调形成光学层析图像,并将每个表层的每个样本条的光学层析图像重建形成三维图像。
- 根据权利要求1所述的高通量光学层析三维成像系统,其特征在于,所述成像模块中,形成的样本条的样本图像的计算公式为:I(i)=I inf(i)+I out其中,I(i)为i像素下形成的样本图像,f(i)为样本图像I(i)所对应的调制强度,I in为样本图像的焦平面图像,I out为样本图像的离焦面图像;所述解调模块中,解调公式为:I in=c×|βI 1–αI 2|其中,α、β为正整数,c为大于0的常数,I 1为α个像素下获取的样本图像的累加和,I 2为β个像素下获取的样本图像的累加和;α个像素下的样本图像相对应的调制强度的累加值和β个像素下的样本图像相对应的调制强度的累加值不相同。
- 根据权利要求2所述的高通量光学层析三维成像系统,其特征在于,所述成像模块包括一用于驱动光束调制模块和样本在相互垂直的三个方向上作相对运动的驱动单元及一用于沿样本条长度方向作连续成像的成像单元,所述样本条的长度方向与光束调制模块和样本的其中一个相对运动方向相同。
- 根据权利要求3所述的高通量光学层析三维成像系统,其特征在于,所述成像模块中的相机的成像区域为N行像素,N≥2;在与样本成像平面相平行的平面上形成相垂直X与Y两个方向,所述调制光束在X与Y方向分别具有如下特性:所述调制光束在所述N行像素上沿X方向上具有不完全相同的调制强度,所述调制光束在所述N行像素的每一行像素上沿Y方向上具有相同的调制强度;所述像素为行像素,所述样本图像为条带图像。
- 根据权利要求4所述的高通量光学层析三维成像系统,其特征在于,所述成像 模块还包括一图像块获取单元及一拼接单元,所述图像块获取单元用于获取按时间顺序所得的一个样本条的每帧图像中的第i行像素的条带图像块,条带图像块的计算公式为 I t(i)为第t帧图像中第i行像素对应的条带图像块, 为I t(i)相对的条带图像块的焦平面图像,即 为完整的条带图像中的第m个条带图像块的焦平面图像, 为I t(i)相对的条带图像块的离焦面图像,f(i)为第i行像素对应的调制强度;所述拼接单元用于将一个样本条的每帧图像中的第i行像素的条带图像块依次拼接获得第i行像素的条带图像,其计算公式为 其中,M为完整的条带图像所对应的条带图像块数量,m≤M。
- 根据权利要求6所述的高通量光学层析三维成像系统,其特征在于,所述成像单元成像的单帧曝光时间与光束调制模块和样本沿样本条长度方向相对移动一行像素的时间相同;所述N行像素的分布方向和宽度分别与调制光束的分布方向和宽度相同,并互为物像共轭关系。
- 根据权利要求7所述的高通量光学层析三维成像系统,其特征在于,所述光束调制模块包括一用于将照明光线整形成呈线状的线光束的整形光路及一用于将线光束调制成线照明调制光束的调制光路。
- 根据权利要求8所述的高通量光学层析三维成像系统,其特征在于,所述整形光路包括沿照明光线的传递方向依次设置的激光光源、第一透镜、第二透镜、柱透镜;所述调制光路包括用于将线光束的发散光线调制成平行光线的第三透镜、用于调制线光束的入射方向的二向色镜及一与调制入射方向后的线光束同轴设置的物镜。
- 根据权利要求9所述的高通量光学层析三维成像系统,其特征在于,所述驱动单元为一用于驱动样本在相互垂直的三个方向上运动的平移台,所述平移台位于所述物镜远离二向色镜一侧,且其垂直于所述调制光束的光轴;所述切除模块中包括振动切片刀具、金刚石刀具、硬质合金刀具中的一种或多种。
Priority Applications (6)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
AU2019372392A AU2019372392B2 (en) | 2018-11-01 | 2019-07-30 | High-throughput optical sectioning three-dimensional imaging system |
EP19878242.7A EP3876022A4 (en) | 2018-11-01 | 2019-07-30 | High-throughput optical tomography three-dimensional imaging system |
KR1020217016637A KR102593253B1 (ko) | 2018-11-01 | 2019-07-30 | 고플럭스 광학 단층촬영 3차원 이미징 시스템 |
JP2021523973A JP7190034B2 (ja) | 2018-11-01 | 2019-07-30 | 高スループット光トモグラフィ三次元イメージングシステム |
CA3118393A CA3118393C (en) | 2018-11-01 | 2019-07-30 | High-throughput optical sectioning three-dimensional imaging system |
US17/302,330 US11906723B2 (en) | 2018-11-01 | 2021-04-30 | High-throughput optical sectioning three-dimensional imaging system |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201811296073.4 | 2018-11-01 | ||
CN201811296073.4A CN111122567B (zh) | 2018-11-01 | 2018-11-01 | 一种高通量光学层析三维成像系统 |
Related Child Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US17/302,330 Continuation US11906723B2 (en) | 2018-11-01 | 2021-04-30 | High-throughput optical sectioning three-dimensional imaging system |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2020088014A1 true WO2020088014A1 (zh) | 2020-05-07 |
Family
ID=70464702
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/CN2019/098367 WO2020088014A1 (zh) | 2018-11-01 | 2019-07-30 | 一种高通量光学层析三维成像系统 |
Country Status (8)
Country | Link |
---|---|
US (1) | US11906723B2 (zh) |
EP (1) | EP3876022A4 (zh) |
JP (1) | JP7190034B2 (zh) |
KR (1) | KR102593253B1 (zh) |
CN (1) | CN111122567B (zh) |
AU (1) | AU2019372392B2 (zh) |
CA (1) | CA3118393C (zh) |
WO (1) | WO2020088014A1 (zh) |
Families Citing this family (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US11521401B2 (en) * | 2020-07-31 | 2022-12-06 | Bridging Biosciences, LLC | Fertility window prediction using a convolutional neural network (CNN) and other learning methods |
CN117705775B (zh) * | 2024-02-05 | 2024-04-26 | 中国科学院长春光学精密机械与物理研究所 | 多色荧光显微成像系统、成像方法、自动聚焦方法 |
Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN102928970A (zh) * | 2012-10-19 | 2013-02-13 | 华中科技大学 | 一种大样本快速三维显微成像的方法和系统 |
CN103207449A (zh) * | 2013-04-17 | 2013-07-17 | 华中科技大学 | 一种结构光快速扫描显微成像方法 |
CN104061879A (zh) * | 2014-06-19 | 2014-09-24 | 四川大学 | 一种连续扫描的结构光三维面形垂直测量方法 |
Family Cites Families (20)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2773607B2 (ja) * | 1993-10-28 | 1998-07-09 | 日本電気株式会社 | 顕微鏡照明装置 |
WO1998045745A1 (en) | 1997-04-04 | 1998-10-15 | Isis Innovation Limited | Microscopy imaging apparatus and method |
GB0030310D0 (en) | 2000-12-13 | 2001-01-24 | Medical Res Council | Apparatus and method for imaging a histological sample |
GB0211068D0 (en) | 2002-05-14 | 2002-06-26 | Amersham Biosciences Uk Ltd | Method for assessing biofilms |
JP3731073B2 (ja) | 2002-09-17 | 2006-01-05 | 独立行政法人理化学研究所 | 顕微鏡装置 |
JP5307439B2 (ja) * | 2007-04-23 | 2013-10-02 | オリンパス株式会社 | レーザ顕微鏡 |
CN101661159B (zh) | 2008-08-25 | 2011-09-21 | 麦克奥迪实业集团有限公司 | 一种基于二维调制技术的切层图像获取方法 |
US9285575B2 (en) * | 2009-01-26 | 2016-03-15 | President And Fellows Of Harvard College | Systems and methods for selective detection and imaging in coherent Raman microscopy by spectral excitation shaping |
DE102010013830A1 (de) * | 2010-03-26 | 2011-09-29 | Carl Zeiss Microlmaging Gmbh | Mikroskop und Verfahren zur mikroskopischen Erfassung von Licht einer Probe |
JP5454424B2 (ja) * | 2010-09-03 | 2014-03-26 | ソニー株式会社 | 撮像方法 |
US20120127464A1 (en) * | 2010-11-22 | 2012-05-24 | Canon Kabushiki Kaisha | Light source apparatus |
US8649024B2 (en) * | 2010-12-03 | 2014-02-11 | Zygo Corporation | Non-contact surface characterization using modulated illumination |
TWI486625B (zh) * | 2013-05-16 | 2015-06-01 | Univ Nat Central | 數位全像顯微鏡 |
JP2015215509A (ja) * | 2014-05-12 | 2015-12-03 | パナソニックIpマネジメント株式会社 | 表示装置、表示方法およびプログラム |
EP3542142A1 (en) | 2016-11-18 | 2019-09-25 | Tissuevision, Inc. | Automated tissue section capture, indexing and storage system and methods |
CN108020503B (zh) * | 2017-11-20 | 2020-09-08 | 苏州博芮恩光电科技有限公司 | 一种光片照明显微切片成像系统及成像结果处理方法 |
CN108593605B (zh) * | 2018-04-23 | 2020-02-28 | 清华大学 | 三维高速宽视场层析成像方法及装置 |
KR20200071563A (ko) * | 2018-12-11 | 2020-06-19 | 삼성전자주식회사 | Hsi 기반 검사 장치 |
US10839542B2 (en) * | 2019-01-29 | 2020-11-17 | The Chinese University Of Hong Kong | Systems and methods for 3D laparoscopic surface reconstruction |
US20230045982A1 (en) * | 2021-08-11 | 2023-02-16 | Vergent Research Pty Ltd | Shuttered Light Field Display |
-
2018
- 2018-11-01 CN CN201811296073.4A patent/CN111122567B/zh active Active
-
2019
- 2019-07-30 EP EP19878242.7A patent/EP3876022A4/en active Pending
- 2019-07-30 JP JP2021523973A patent/JP7190034B2/ja active Active
- 2019-07-30 KR KR1020217016637A patent/KR102593253B1/ko active IP Right Grant
- 2019-07-30 WO PCT/CN2019/098367 patent/WO2020088014A1/zh unknown
- 2019-07-30 CA CA3118393A patent/CA3118393C/en active Active
- 2019-07-30 AU AU2019372392A patent/AU2019372392B2/en active Active
-
2021
- 2021-04-30 US US17/302,330 patent/US11906723B2/en active Active
Patent Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN102928970A (zh) * | 2012-10-19 | 2013-02-13 | 华中科技大学 | 一种大样本快速三维显微成像的方法和系统 |
CN103207449A (zh) * | 2013-04-17 | 2013-07-17 | 华中科技大学 | 一种结构光快速扫描显微成像方法 |
CN104061879A (zh) * | 2014-06-19 | 2014-09-24 | 四川大学 | 一种连续扫描的结构光三维面形垂直测量方法 |
Also Published As
Publication number | Publication date |
---|---|
CA3118393C (en) | 2023-06-27 |
CN111122567B (zh) | 2022-09-16 |
JP7190034B2 (ja) | 2022-12-14 |
JP2022511676A (ja) | 2022-02-01 |
CA3118393A1 (en) | 2020-05-07 |
US20210333536A1 (en) | 2021-10-28 |
CN111122567A (zh) | 2020-05-08 |
KR102593253B1 (ko) | 2023-10-24 |
AU2019372392A1 (en) | 2021-06-03 |
AU2019372392B2 (en) | 2023-01-19 |
US11906723B2 (en) | 2024-02-20 |
KR20210086694A (ko) | 2021-07-08 |
EP3876022A4 (en) | 2021-12-29 |
EP3876022A1 (en) | 2021-09-08 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN109187459B (zh) | 一种自适应扫描宽视场高通量层析显微成像方法及装置 | |
US11530990B2 (en) | Light-sheet microscope with parallelized 3D image acquisition | |
US11906723B2 (en) | High-throughput optical sectioning three-dimensional imaging system | |
JP2021165851A (ja) | ライトシート顕微鏡法のための構成及び方法 | |
CN108061964B (zh) | 一种可用于大样品的高速三维显微成像装置和方法 | |
CN105683805A (zh) | 图像取得装置以及图像取得装置的图像取得方法 | |
CN108765285A (zh) | 一种基于视频清晰度融合的大尺寸显微图像生成方法 | |
BR112020007609A2 (pt) | método de reconstrução de imagem, dispositivo e dispositivo de imagiologia microscópica | |
CN107478628A (zh) | 一种基于光子重组的双光子荧光显微方法及装置 | |
US11356593B2 (en) | Methods and systems for single frame autofocusing based on color- multiplexed illumination | |
WO2020088013A1 (zh) | 一种高通量光学层析成像方法及成像系统 | |
CN107850766A (zh) | 用于光学显微镜中的图像处理的系统和方法 | |
US20230221541A1 (en) | Systems and methods for multiview super-resolution microscopy | |
CN111650739B (zh) | 基于dmd的单帧曝光快速三维荧光成像系统及方法 | |
CN111260747B (zh) | 基于虚拟数字调制的高通量光学层析成像方法及系统 | |
CN117631249B (zh) | 线扫共聚焦扫描光场显微成像装置及方法 |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 19878242 Country of ref document: EP Kind code of ref document: A1 |
|
ENP | Entry into the national phase |
Ref document number: 2021523973 Country of ref document: JP Kind code of ref document: A |
|
ENP | Entry into the national phase |
Ref document number: 3118393 Country of ref document: CA |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
ENP | Entry into the national phase |
Ref document number: 20217016637 Country of ref document: KR Kind code of ref document: A |
|
ENP | Entry into the national phase |
Ref document number: 2019372392 Country of ref document: AU Date of ref document: 20190730 Kind code of ref document: A |
|
ENP | Entry into the national phase |
Ref document number: 2019878242 Country of ref document: EP Effective date: 20210601 |