CN113433108B - Stomach peeping biopsy histopathology imaging method based on stimulated Raman scattering - Google Patents

Stomach peeping biopsy histopathology imaging method based on stimulated Raman scattering Download PDF

Info

Publication number
CN113433108B
CN113433108B CN202110612877.6A CN202110612877A CN113433108B CN 113433108 B CN113433108 B CN 113433108B CN 202110612877 A CN202110612877 A CN 202110612877A CN 113433108 B CN113433108 B CN 113433108B
Authority
CN
China
Prior art keywords
image
imaging
stimulated raman
images
raman scattering
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202110612877.6A
Other languages
Chinese (zh)
Other versions
CN113433108A (en
Inventor
季敏标
刘至杰
胡皓
敖建鹏
周平红
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Fudan University
Original Assignee
Fudan University
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Fudan University filed Critical Fudan University
Priority to CN202110612877.6A priority Critical patent/CN113433108B/en
Publication of CN113433108A publication Critical patent/CN113433108A/en
Application granted granted Critical
Publication of CN113433108B publication Critical patent/CN113433108B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G01MEASURING; TESTING
    • G01NINVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N21/00Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
    • G01N21/62Systems in which the material investigated is excited whereby it emits light or causes a change in wavelength of the incident light
    • G01N21/63Systems in which the material investigated is excited whereby it emits light or causes a change in wavelength of the incident light optically excited
    • G01N21/65Raman scattering
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T3/00Geometric image transformations in the plane of the image
    • G06T3/40Scaling of whole images or parts thereof, e.g. expanding or contracting
    • G06T3/4038Image mosaicing, e.g. composing plane images from plane sub-images
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T3/00Geometric image transformations in the plane of the image
    • G06T3/40Scaling of whole images or parts thereof, e.g. expanding or contracting
    • G06T3/4053Scaling of whole images or parts thereof, e.g. expanding or contracting based on super-resolution, i.e. the output image resolution being higher than the sensor resolution
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/0002Inspection of images, e.g. flaw detection
    • G06T7/0012Biomedical image inspection
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01NINVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N21/00Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
    • G01N21/62Systems in which the material investigated is excited whereby it emits light or causes a change in wavelength of the incident light
    • G01N21/63Systems in which the material investigated is excited whereby it emits light or causes a change in wavelength of the incident light optically excited
    • G01N21/65Raman scattering
    • G01N2021/653Coherent methods [CARS]
    • G01N2021/655Stimulated Raman
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/10Image acquisition modality
    • G06T2207/10024Color image
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/30Subject of image; Context of image processing
    • G06T2207/30004Biomedical image processing

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Health & Medical Sciences (AREA)
  • Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
  • General Health & Medical Sciences (AREA)
  • Quality & Reliability (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Radiology & Medical Imaging (AREA)
  • Medical Informatics (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Chemical & Material Sciences (AREA)
  • Analytical Chemistry (AREA)
  • Biochemistry (AREA)
  • Immunology (AREA)
  • Pathology (AREA)
  • Investigating, Analyzing Materials By Fluorescence Or Luminescence (AREA)

Abstract

本发明属于非线性光学成像技术领域,具体为一种基于受激拉曼散射的胃内窥活检组织病理学成像方法。本发明方法利用受激拉曼散射显微成像的快速和免处理、免标记性质,可以在短时间内获取胃活检的组织病理学图像信息。本发明是首次将受激拉曼散射显微技术临床用于胃镜内窥活检中,相比于现有传统组织病理学技术,其优点体现在:成像速度快,成像质量高,无需进行预处理,无创保留原有组织,并且可以在一定深度内对各平面进行成像。

Figure 202110612877

The invention belongs to the technical field of nonlinear optical imaging, in particular to a gastric endoscopic biopsy histopathological imaging method based on stimulated Raman scattering. The method of the invention utilizes the fast, processing-free and label-free properties of stimulated Raman scattering microscopic imaging, and can acquire the histopathological image information of gastric biopsy in a short time. The present invention is the first clinical application of stimulated Raman scattering microscopy in gastroscopic endoscopic biopsy. Compared with existing traditional histopathological techniques, its advantages are reflected in: fast imaging speed, high imaging quality, and no need for pretreatment , non-invasively retain the original tissue, and can image each plane within a certain depth.

Figure 202110612877

Description

基于受激拉曼散射的胃内窥活检组织病理学成像方法Histopathological Imaging Method of Gastric Endoscopic Biopsy Based on Stimulated Raman Scattering

技术领域technical field

本发明属于非线性光学成像技术领域,具体涉及一种基于受激拉曼散射的胃内窥活检组织病理学成像方法。The invention belongs to the technical field of nonlinear optical imaging, in particular to a gastric endoscopic biopsy histopathological imaging method based on stimulated Raman scattering.

背景技术Background technique

胃癌是影响人类健康的重大疾病。据全国肿瘤登记中心最新年报显示,胃癌每年新发病人数超 68万人,死亡约50万人,现已成为我国第二大致死性肿瘤。胃癌防控的关键在于早诊早治。及时发现早癌,延缓和逆转癌前病变可有效降低胃癌的发生率和病死率。胃癌的发生经历慢性炎症-癌前病变-早癌-浸润癌等多个步骤。胃癌的发生通常整个过程需要数十年的发展和事件累积。即使已经发生早癌,通常仍需约44个月的时间才可进展为晚期。因此,将胃癌前病变和早癌作为胃癌防控的关键节点,及时给予必要的干预和治疗,将有效降低胃癌的发病率和病死率,减轻胃癌的危害。但是由于胃早癌及癌前病变缺乏明显的形态特征,单靠内镜下表现无法明确,必须依靠组织病理诊断。而后者需要经历脱水、包埋、切片、染色、阅片等多个步骤,具有明显的时间滞后性。因此,非时间劳动密集型,术中快速得到组织病理学图像就显得十分重要。Gastric cancer is a major disease affecting human health. According to the latest annual report of the National Cancer Registry Center, the number of new cases of gastric cancer exceeds 680,000 each year, and about 500,000 people die, making it the second deadliest tumor in my country. The key to the prevention and control of gastric cancer is early diagnosis and early treatment. Timely detection of early cancer, delay and reversal of precancerous lesions can effectively reduce the incidence and mortality of gastric cancer. The occurrence of gastric cancer goes through multiple steps such as chronic inflammation-precancerous lesions-early cancer-invasive cancer. The development of gastric cancer usually requires decades of development and accumulation of events. Even if an early cancer develops, it usually takes about 44 months to progress to an advanced stage. Therefore, taking gastric precancerous lesions and early cancers as the key nodes in the prevention and control of gastric cancer, and giving necessary intervention and treatment in time will effectively reduce the incidence and mortality of gastric cancer and reduce the harm of gastric cancer. However, due to the lack of obvious morphological characteristics of early gastric cancer and precancerous lesions, endoscopic findings alone cannot be clearly defined, and histopathological diagnosis must be relied on. The latter needs to go through multiple steps such as dehydration, embedding, slicing, staining, and film reading, which has an obvious time lag. Therefore, it is very important to quickly obtain histopathological images during the operation without time and labor intensive.

拉曼光谱技术可快速、准确、无创检测病变分子信息。具有在效果上比拟病理结果,在检测时间上超越传统病理的优势,拉曼光谱是一种无损的分析技术,它是基于入射光和物质的非弹性散射效应的原理,可以描述待检样本分子中化学键/基团的在入射光下的特征振动。因此,拉曼光谱包含了分子的指纹信息。其重要优势在于,可依据样本分子的拉曼指纹特征直接的辨别物质的种类,尤其是对于医学疾病领域疾病分子的指纹识别优势明显。相比较其他的检测方法,如荧光检测,拉曼检测不但具有分子指纹识别的优势明显。相比较其他的检测方法,如荧光检测,拉曼检测不但具有分子指纹识别的特性,且具有无需样品处理、水不敏感(含水的医学生物检测尤其有用,红外光谱法就无法实现)及微区微量检测等优点,这是目前其他检测技术所无法比拟的。拉曼光谱技术的第二个优势就是“快”。拉曼光谱采集可以在几秒种内完成,检测的成本也比较低廉,实际检测时只需要将样本置于拉曼检查点,检测结束就可快速的判断。Raman spectroscopy technology can quickly, accurately and non-invasively detect molecular information of lesions. It has the advantages of comparing pathological results in effect and surpassing traditional pathology in detection time. Raman spectroscopy is a non-destructive analysis technique based on the principle of inelastic scattering effect of incident light and substances, which can describe the molecules of samples to be tested. Characteristic vibrations of chemical bonds/groups under incident light. Therefore, the Raman spectrum contains the fingerprint information of the molecule. Its important advantage is that it can directly identify the type of substance based on the Raman fingerprint characteristics of sample molecules, especially for fingerprint identification of disease molecules in the field of medical diseases. Compared with other detection methods, such as fluorescence detection, Raman detection not only has the obvious advantages of molecular fingerprint identification. Compared with other detection methods, such as fluorescence detection, Raman detection not only has the characteristics of molecular fingerprint recognition, but also has the characteristics of no need for sample treatment, water insensitivity (especially useful for medical biological detection containing water, which cannot be achieved by infrared spectroscopy) and micro-area detection. It has advantages such as trace detection, which is unmatched by other detection technologies at present. The second advantage of Raman spectroscopy is "fast". Raman spectrum collection can be completed within a few seconds, and the cost of detection is relatively low. In actual detection, only the sample needs to be placed at the Raman checkpoint, and a quick judgment can be made after the detection is completed.

然而传统自发拉曼光谱不能实现对样品进行空间成像,而生物样品往往具有很强的空间异质性,例如,病变范围分布不均一,轻重不同等情况。受激拉曼散射结合了拉曼散射和爱因斯坦的受激辐射原理,可实现拉曼效应103~105的增益,达到视频速度的高速成像。受激拉曼光谱继承了自发拉曼光谱的分子指纹特征,具有很好的分子特异性,能根据不同分子的特征振动光谱,以类似病理图像的形式来表现它们。因此,主要优势在于可实现样品空间成像,能够,若能定位、筛选待检临床的可疑区域,结合快速成像技术精准地得到样品不同位点的拉曼光谱,更有利于提高诊断的准确性和靶向性。However, traditional spontaneous Raman spectroscopy cannot achieve spatial imaging of samples, and biological samples often have strong spatial heterogeneity, for example, the distribution of lesions is not uniform, and the severity is different. Stimulated Raman scattering combines Raman scattering and Einstein's stimulated radiation principle, which can achieve a gain of 103~105 of the Raman effect and achieve high-speed imaging at video speed. Stimulated Raman spectroscopy inherits the molecular fingerprint characteristics of spontaneous Raman spectroscopy, has good molecular specificity, and can represent different molecules in a form similar to pathological images according to their characteristic vibration spectra. Therefore, the main advantage is that it can realize spatial imaging of the sample, and if it can locate and screen suspicious clinical areas to be tested, combined with rapid imaging technology to accurately obtain Raman spectra at different positions of the sample, it will be more conducive to improving the accuracy of diagnosis and targeting.

发明内容Contents of the invention

本发明的目的在于提供一种成像速度快、成像质量高的胃内窥活检组织病理学成像方法,以解决现有技术中存在的样品预处理复杂、处理过程劳动密集、以及时间滞后明显等问题。The purpose of the present invention is to provide a gastric endoscopic biopsy histopathological imaging method with fast imaging speed and high imaging quality, so as to solve the problems in the prior art such as complicated sample pretreatment, labor-intensive processing, and obvious time lag. .

本发明提供的胃内窥活检组织病理学成像方法,是基于受激拉曼散射技术,具体步骤为:The histopathological imaging method of gastric endoscopic biopsy provided by the present invention is based on stimulated Raman scattering technology, and the specific steps are:

S1、针对胃组织中存在的生物化学组分,根据组织病理学中所关心的特征,选择合适的生物分子作为待检测物质,利用受激拉曼散射显微成像系统检测待测物质对应的标准样品,以获得在受激拉曼成像系统中的具体参数的最优状态;所述参数包括:泵浦光波长和斯托克斯光波长、泵浦光与斯托克斯光之间的相对时延;S1. For the biochemical components existing in gastric tissue, according to the characteristics of concern in histopathology, select appropriate biomolecules as the substance to be detected, and use the stimulated Raman scattering microscopic imaging system to detect the corresponding standard of the substance to be tested sample to obtain the optimal state of specific parameters in the stimulated Raman imaging system; the parameters include: pump light wavelength and Stokes light wavelength, the relative ratio between pump light and Stokes light delay;

S2、根据S1的结果设置实验参数,对胃活检组织中的待检测物质进行区域选定,然后对于每一个区域进行快速的显微成像:具体是在每一帧图像扫描结束之后,按照原本区域设计好的位置将样品台进行移动,之后再进行下一帧图像扫描,如此往复,直到整个选定区域被扫描完全,得到整个区域视野的分块图像,最后通过拼接算法将其拼接为一张大尺寸图像;S2. Set the experimental parameters according to the results of S1, select the area of the substance to be detected in the gastric biopsy tissue, and then perform rapid microscopic imaging for each area: specifically, after the scanning of each frame of image, according to the original area The designed position moves the sample stage, and then scans the next frame of image, and so on, until the entire selected area is scanned completely, and the block image of the entire field of view is obtained, and finally it is stitched into a large one by stitching algorithm size image;

当需要对脂质、蛋白质以及胶原等多种待检测物质进行成像时,则在扫描每一帧图像后,将实验参数进行自动切换,以调整为扫描另一种待检测物质通道,而后再进行样品台平移;同时,运用多模态方式同时对其他物质进行成像;When it is necessary to image multiple substances to be detected such as lipids, proteins, and collagen, after scanning each frame of image, the experimental parameters are automatically switched to adjust to scan another channel of the substance to be detected, and then proceed The sample stage is translated; at the same time, the multi-modal method is used to image other substances at the same time;

S3、将多个区域扫描的小图编写拼接算法,将其拼接为一张具有完整视野的大图;具体是将图片序列读取到算法程序中,首先将小图按照序列号排列到完整大图的预计位置,然后对相邻图片进行拼接,对于相邻图片的边缘部分进行裁剪或平均处理,以去除重复部分,再使用平均算法,计算相邻图片边缘的某几行或几列像素点数值之差,再生成补偿矩阵对每个小图由于光斑不均导致的图像数值不均进行补偿,最后得到完整视野的数张不同通道的组织样本图;S3. Write a stitching algorithm for the small images scanned in multiple areas, and stitch them into a large image with a complete field of view; specifically, read the sequence of images into the algorithm program, and first arrange the small images into a complete large image according to the serial number The estimated position of the picture, and then splicing adjacent pictures, cropping or averaging the edge part of the adjacent picture to remove the repeated part, and then using the averaging algorithm to calculate the number of rows or columns of pixels on the edge of the adjacent picture value difference, regenerate the compensation matrix to compensate for the unevenness of the image value caused by the unevenness of the light spot in each small image, and finally obtain several tissue sample images of different channels in the complete field of view;

S4、将S3中获取的不同通道物质合成伪彩图;具体是将不同通道的图像在经过线性组合,并分别使用不同颜色的查找表将其映射为不同颜色的图像,然后使用叠加方法将其合成为一张带有各种化学组分的类组织病理学图像,以提供给后续病理诊断使用。S4. Synthesize the pseudo-color images of different channel substances obtained in S3; specifically, the images of different channels are linearly combined, and they are mapped to images of different colors using look-up tables of different colors, and then superimposed using the superposition method. Synthesize a histopathological-like image with various chemical components to provide for subsequent pathological diagnosis.

在步骤S1中,若待检测的物质不止一种,且不同物质的拉曼峰位波数距离涵盖在所用脉冲激光器的光谱范围内,则将折中选择拉曼峰波数的中间值来定为所需的拉曼波数,并以此来选择泵浦光波长,使得所有待测物质能够在不改变泵浦光波长的条件下测得拉曼峰。脉冲激光器涵盖的光谱范围是根据傅里叶变换结合激光器极限脉冲的持续时间计算得到。In step S1, if there are more than one substance to be detected, and the Raman peak wavenumber distance of different substances covers the spectral range of the pulsed laser used, then the middle value of the Raman peak wavenumber is selected as the compromise. The required Raman wavenumber is used to select the wavelength of the pump light, so that all substances to be tested can measure the Raman peak without changing the wavelength of the pump light. The spectral range covered by a pulsed laser is calculated from the Fourier transform combined with the duration of the laser's limit pulse.

本发明通过对脂质、蛋白质以及胶原三种物质的示例分析,验证了受激拉曼对胃组织中的生物大分子成分的无损快速成像能力,并对整个新鲜组织进行了x-y面全视野的完整扫描,结合多模态完成了三种组分的二维扫描,得到了新鲜组织中的脂质、蛋白质、胶原的相对分布状态,并与传统组织病理学图像进行对比,验证其一致性,为本发明的实用性提供了验证。The present invention verifies the ability of stimulated Raman to rapidly and non-destructively image biomacromolecular components in gastric tissue through the example analysis of lipid, protein and collagen, and conducts x-y full field of view imaging of the whole fresh tissue Complete scanning, combined with multi-modality to complete the two-dimensional scanning of the three components, obtained the relative distribution of lipids, proteins, and collagen in fresh tissues, and compared them with traditional histopathological images to verify their consistency. Verification is provided for the practicability of the present invention.

本发明基于的受激拉曼散射显微成像技术是一种新型的、免标记的无损成像手段,是一种非线性相干拉曼散射过程,不仅拥有自发拉曼光谱对分子化学键的特异性分辨的优点,而且在斯托克斯光的受激辐射作用下,将微弱的拉曼信号提高了4-8个数量级,使其具有高信噪比实时成像能力。同时,受激拉曼散射属于非线性光学过程,只有在光焦点处光强密度足够大才会产生,具多维空间的超分辨能力。The stimulated Raman scattering microscopic imaging technology based on the present invention is a new type of label-free nondestructive imaging means, and a nonlinear coherent Raman scattering process, which not only has the specific resolution of molecular chemical bonds by spontaneous Raman spectroscopy Moreover, under the stimulated radiation of Stokes light, the weak Raman signal is increased by 4-8 orders of magnitude, making it capable of real-time imaging with high signal-to-noise ratio. At the same time, stimulated Raman scattering is a nonlinear optical process, which can only be produced when the light intensity density at the light focus is sufficiently high, and has super-resolution capabilities in multi-dimensional space.

本发明提出的内镜中的胃活检组织快速组织病理学成像方法,是受激拉曼散射显微技术在胃镜内窥活检中的首次应用。本发明针对的胃镜活检组织尺寸在毫米量级,在充分利用了组织中生物大分子分布特征,形成基本组织结构的基础上,借助受激拉曼散射显微成像计数的快速成像以及x-y面平移台扫描等优势,并结合图像拼接算法,最终给出类似于传统组织病理学特征的图像。The rapid histopathological imaging method of gastric biopsy tissue in endoscope proposed by the present invention is the first application of stimulated Raman scattering microscopic technique in gastroscopic endoscopic biopsy. The size of gastroscopic biopsy tissue targeted by the present invention is on the order of millimeters. On the basis of making full use of the distribution characteristics of biological macromolecules in the tissue and forming the basic tissue structure, the rapid imaging and x-y plane translation by means of stimulated Raman scattering microscopic imaging counting Advantages such as table scanning, combined with image stitching algorithms, finally give images similar to traditional histopathological features.

本发明与传统方法相比,具有重大突破,具体体现在:胃组织从胃镜活检或切缘手术采集并浸泡在福尔马林中后,无需再进行任何预处理工作(包括进行石蜡包埋或是冰冻处理后切片染色),即可放置于玻片上,在保证组织无创的情况下给出其特定组织成分的组织病理学图像。Compared with the traditional method, the present invention has a major breakthrough, which is embodied in that after the gastric tissue is collected from gastroscopic biopsy or surgical margin surgery and soaked in formalin, no pretreatment (including paraffin embedding or freezing) is required. Section staining after processing), it can be placed on a glass slide, and the histopathological image of its specific tissue components can be given under the condition of ensuring non-invasive tissue.

本发明成像速度快,无需进行预处理,无创保留原有组织,并且可以在一定深度内对各平面进行成像,操作过程简便,单帧图像的扫描时间为1.1s左右,成像质量高。The invention has fast imaging speed, no need for pretreatment, non-invasively retains the original tissue, and can image each plane within a certain depth, the operation process is simple, the scanning time of a single frame image is about 1.1s, and the imaging quality is high.

本发明对于受激拉曼散射显微成像技术在应用领域的拓展提供了范例。The invention provides an example for expanding the application field of the stimulated Raman scattering microscopic imaging technology.

附图说明Description of drawings

图1为本发明实施例中采用的受激拉曼散射显微系统。Fig. 1 is a stimulated Raman scattering microscope system used in the embodiment of the present invention.

图2为图1中实现样品x-y轴扫描区域选定及划分图。Fig. 2 is a diagram showing the selection and division of the x-y axis scanning area of the sample in Fig. 1 .

图3为本发明实施例中图片拼接及伪彩映射软件的使用流程图。Fig. 3 is a flow chart of using picture stitching and pseudo-color mapping software in an embodiment of the present invention.

图4为三种待测物质对应的受激拉曼散射成像系统所成单帧图像。Fig. 4 is a single-frame image formed by the stimulated Raman scattering imaging system corresponding to the three substances to be tested.

图5为三种待测物质对应的完整区域受激拉曼单通道图像/多通道拼接图像,以及传统组织病理学HE染色对应图像。Figure 5 is the complete area stimulated Raman single-channel image/multi-channel mosaic image corresponding to the three substances to be tested, and the corresponding image of traditional histopathological HE staining.

图5为为三种待测物质对应的完整区域受激拉曼单通道图像/多通道拼接图像,以及传统组织病理学HE染色对应图像。Figure 5 is the complete area stimulated Raman single-channel image/multi-channel mosaic image corresponding to the three substances to be tested, and the corresponding image of traditional histopathological HE staining.

图中标号:1为飞秒激光器,1-1为泵浦光输出端口,1-2为斯托克斯光输出端口,2-1为第一个调节光功率元器件组合,2-2为第二个调节光功率元器件组合,3-1为SF57色散玻璃,3-2为第二个SF57色散玻璃,4为电光调制器,5为精密位移台,6为二向色镜,7为二维扫描振镜,8为二相色镜,9为物镜,10为样本平移台,11为聚光镜,12为短通滤光片,13为光电探测器,14为锁相放大器,15为光电倍增固安,16为电脑。Numbers in the figure: 1 is the femtosecond laser, 1-1 is the pump light output port, 1-2 is the Stokes light output port, 2-1 is the first combination of components for adjusting optical power, 2-2 is the The second component combination for adjusting optical power, 3-1 is SF57 dispersion glass, 3-2 is the second SF57 dispersion glass, 4 is electro-optic modulator, 5 is precision translation stage, 6 is dichroic mirror, 7 is Two-dimensional scanning galvanometer, 8 is a dichroic mirror, 9 is an objective lens, 10 is a sample translation stage, 11 is a condenser, 12 is a short-pass filter, 13 is a photodetector, 14 is a lock-in amplifier, and 15 is a photoelectric Doubling the security, 16 is the computer.

具体实施方式Detailed ways

下面结合具体实施例和附图对本发明做进一步说明。The present invention will be further described below in conjunction with specific embodiments and accompanying drawings.

实施例1Example 1

搭建受激拉曼散射显微成像系统,如图1所示。在系统中,激光器1产生飞秒脉冲激光,泵浦光输出端口1-1能680nm-1300nm可调谐波长的飞秒激光,作为泵浦光,另一端斯托克斯光输出端口1-2输出固定波长1040nm的飞秒激光,作为斯托克斯光。泵浦光与斯托克斯光分别经过半波片与偏振分光棱镜的组合2-1和2-2调整功率后,通过SF57色散玻璃3-1和3-2完成线性啁啾过程,使得飞秒光拉伸为皮秒光,并且在啁啾过程中光谱按照时间和空间排列,为受激拉曼散射系统提供半高全宽为15cm-1的光谱分辨率。而后,斯托克斯光被电光调制器4按照一定的频率实现光脉冲的0、1数字调制,并通过精密位移台5改变斯托克斯光的光程,以调节斯托克斯光与泵浦光之间的相对时间延迟,而后,斯托克斯光与泵浦光与二相色镜6处合束后,在二维扫描振镜7的作用下,经由二相色镜8反射到物镜9后,振镜振动的过程会改变物镜9聚焦于平移台10上组织样本的焦点,随着振镜的振动会重复扫描某一个焦面,光透射过样品后,经过聚焦透镜11将透射光聚焦,经由滤光片12滤除斯托克斯光后,经过受激拉曼散射作用后的泵浦光被光电探测器13探测到,而后通过锁相放大器14进行解调得到受激拉曼损失信号。而在平移台10处沿着原路返回的反射光中,波长较短的二次谐波会经由二相色镜8透射后被光电倍增管15收集并转化为电信号,结合被锁相放大器14解调的拉曼信号传输到电脑16中显示,在扫描完一个通道的一帧图像后,会改变精密位移台5的位置,重复上述过程扫描另一个通道的图像。A stimulated Raman scattering microscopy imaging system was built, as shown in Figure 1. In the system, the laser 1 generates femtosecond pulsed laser, and the pump light output port 1-1 can be femtosecond laser with a tunable wavelength of 680nm-1300nm as the pump light, and the Stokes light output port 1-2 at the other end outputs Femtosecond laser with a fixed wavelength of 1040nm, as Stokes light. After the pump light and Stokes light are adjusted through the combination 2-1 and 2-2 of the half-wave plate and the polarization beam splitter prism, the linear chirp process is completed through the SF57 dispersion glass 3-1 and 3-2, so that the flying The second light is stretched to picosecond light, and the spectrum is arranged in time and space during the chirping process, providing the stimulated Raman scattering system with a spectral resolution of 15cm -1 full width at half maximum. Then, the Stokes light is digitally modulated by the electro-optic modulator 4 according to a certain frequency to achieve 0, 1 digital modulation of the light pulse, and the optical path of the Stokes light is changed by the precision displacement stage 5 to adjust the Stokes light and The relative time delay between the pump light, and then, after the Stokes light and the pump light combine with the dichroic mirror 6, they are reflected by the dichroic mirror 8 under the action of the two-dimensional scanning galvanometer 7 After reaching the objective lens 9, the vibrating process of the vibrating mirror will change the focus of the objective lens 9 on the tissue sample on the translation stage 10. With the vibration of the vibrating mirror, a certain focal plane will be scanned repeatedly. After the light is transmitted through the sample, it will pass through the focusing lens 11 The transmitted light is focused, and after the Stokes light is filtered out by the filter 12, the pump light after stimulated Raman scattering is detected by the photodetector 13, and then demodulated by the lock-in amplifier 14 to obtain the stimulated Raman loss signal. In the reflected light returning along the original path at the translation stage 10, the second harmonic wave with a shorter wavelength will be collected by the photomultiplier tube 15 after being transmitted through the dichroic mirror 8 and converted into an electrical signal, combined with a lock-in amplifier 14. The demodulated Raman signal is transmitted to the computer 16 for display. After one frame of image of one channel is scanned, the position of precision translation stage 5 is changed, and the above process is repeated to scan the image of another channel.

胃组织中一般主要包含脂质、蛋白质、胶原等成分,在本实施例中,将脂质、蛋白质、胶原作为待检测物质,脂质的拉曼峰位于拉曼位移2845cm-1处,蛋白质的拉曼峰位于拉曼位移2930cm-1处,胶原通过二次谐波产生的方式收集,因此取波数中间值2887cm-1为中心拉曼位移,当斯托克斯光的波长固定为1040nm时,计算得到泵浦光的波长为801nm,因而二次谐波产生的胶原信号波长为520nm和400.5nm。经过扫描后,得到三种待测物质的每帧图像(如图4所示)。Stomach tissue generally mainly contains components such as lipid, protein, and collagen. In this embodiment, lipid, protein, and collagen are used as substances to be detected. The Raman peak of lipid is located at a Raman shift of 2845 cm The Raman peak is located at the Raman shift of 2930cm -1 , and the collagen is collected by the second harmonic generation, so the central Raman shift is taken as the median wave number of 2887cm -1 . When the wavelength of the Stokes light is fixed at 1040nm, The calculated wavelength of the pump light is 801nm, so the collagen signal wavelengths generated by the second harmonic are 520nm and 400.5nm. After scanning, images of each frame of the three substances to be tested are obtained (as shown in Figure 4).

本实施例利用胃活检组织中的成分构成标定了受激拉曼散射显微成像系统的实验参数,验证了受激拉曼散射显微技术对胃活检的成像可行性,为实施例2中的扫描完整病理图像奠定基础。In this example, the experimental parameters of the stimulated Raman scattering microscopy imaging system were calibrated using the components in the gastric biopsy tissue, and the feasibility of the imaging of gastric biopsy by stimulated Raman scattering microscopy was verified, which is the example in Example 2. Scan the complete pathology image to lay the foundation.

实施例2Example 2

在本实施例中,选取脂质、蛋白质和胶原作为待检测物。结合实施例1,胃活检组织快速组织病理学成像方法共包括以下步骤:In this embodiment, lipid, protein and collagen are selected as the substances to be detected. With reference to Example 1, the rapid histopathological imaging method of gastric biopsy tissue includes the following steps:

S1、由脂质和蛋白质的成像实际情况得到各自拉曼峰在受激拉曼散射显微系统中的实验参数,所述参数包括:固定的斯托克斯波长为1040nm,、泵浦波长为选择801nm,以及相应的时延对应的波数选择为2845cm-1和2930cm-1处,具体时延位置依照实际实验条件得到;S1. Obtain the experimental parameters of the respective Raman peaks in the stimulated Raman scattering microscope system from the actual situation of imaging of lipids and proteins. The parameters include: the fixed Stokes wavelength is 1040nm, and the pump wavelength is Choose 801nm, and the wavenumber corresponding to the corresponding time delay is selected as 2845cm -1 and 2930cm -1 , and the specific time delay position is obtained according to the actual experimental conditions;

S2、首先设置好激光器的两路输出,再将斯托克斯光和泵浦光的相对时间延迟对应波数设为2845cm-1,选择好焦平面后,移动样品平移台10寻找所需成像的区域,并记录下各边界的位置;S2. First set up the two outputs of the laser, and then set the corresponding wavenumber of the relative time delay between the Stokes light and the pump light to 2845cm -1 , after selecting the focal plane, move the sample translation stage 10 to find the desired imaging point area, and record the location of each boundary;

S3、打开二次谐波通道,并设置好触发信号进行脂质、蛋白质通道自动切换;运行样本平移台自动移动程序,如图2所示,在每个区域视野中将脂质、蛋白质通道以及多模态同时成像的胶原扫描完成后,平移台自动移动到下一个区域进行扫描成像,重复此过程,直至预先设定的扫描区域全部扫描完成。S3, open the second harmonic channel, and set the trigger signal to automatically switch the lipid and protein channels; run the automatic movement program of the sample translation stage, as shown in Figure 2, in each area of view, the lipid, protein channels and After the collagen scanning of multimodal simultaneous imaging is completed, the translation stage automatically moves to the next area for scanning and imaging, and this process is repeated until all the pre-set scanning areas are scanned.

S4、将S3中获取的图片序列导入图片拼接软件,以如图3所示的软件使用流程完成受激拉曼图像生成,从而生成近似传统组织病理学图像的受激拉曼组织病理学图像。S4. Import the image sequence obtained in S3 into the image stitching software, and complete the generation of stimulated Raman images by using the software as shown in FIG. 3 , thereby generating stimulated Raman histopathological images similar to traditional histopathological images.

本实施例依据CH2,CH3化学键所对应的脂质,蛋白质以及具有产生二次谐波性质的胶原在胃组织中的分布状态,以及传统组织病理学HE染色所呈现的组织结构,获得了以受激拉曼散射图像为主的组织病理学图像,并验证了其与传统组织病理学图像的一致性。In this example, based on the distribution state of lipids, proteins and collagen with the property of generating second harmonics in gastric tissue corresponding to CH 2 and CH 3 chemical bonds, as well as the tissue structure presented by traditional histopathological HE staining, obtained Stimulated Raman scattering images are the main histopathological images, and their consistency with traditional histopathological images has been verified.

根据上述实施例,基于受激拉曼散射的胃内窥活检组织病理学成像方法可以概述为两个过程步骤:1.沿x-y轴扫描该焦平面的胃组织,获取具有一系列选定区域中的二维图像;2.将图片序列依次导入图片拼接,伪彩映射软件中,得到受激拉曼组织病理学图像。According to the above-mentioned embodiments, the gastric endoscopic biopsy histopathological imaging method based on stimulated Raman scattering can be summarized as two process steps: 1. Scanning the gastric tissue in the focal plane along the x-y axis, acquiring 2. Import the image sequence into the image stitching and pseudo-color mapping software in sequence to obtain stimulated Raman histopathological images.

图5给出了三种待测物质对应的完整区域受激拉曼单通道图像/多通道拼接图像,以及传统组织病理学HE染色对应图像。其中:Figure 5 shows the complete area stimulated Raman single-channel image/multi-channel mosaic image corresponding to the three substances to be tested, and the corresponding image of traditional histopathological HE staining. in:

Lipid:以2845cm-1拉曼位移处对胃组织获取的受激拉曼图像。Lipid: Stimulated Raman images of gastric tissue acquired at a Raman shift of 2845 cm -1 .

Protein:以2930cm-1拉曼位移处对胃组织获取的受激拉曼图像。Protein: Stimulated Raman images of gastric tissue acquired at a Raman shift of 2930cm -1 .

Collagen:使用光电倍增管采集到的胃组织二次谐波生成的胶原纤维图像。Collagen: Collagen fiber image generated by the second harmonic wave of gastric tissue collected by photomultiplier tube.

SRS:使用RGB三个通道分别对上述三个图像进行伪彩映射合成的图像。SRS: An image synthesized by performing pseudo-color mapping on the above three images using the three channels of RGB.

SRH:使用类似病理学伪彩分别对上述三个图像进行映射合成的图像。SRH: An image synthesized by mapping the above three images separately using pathologically similar pseudo-colors.

HE:使用H&E染色的标准组织病理学图像。HE: Standard histopathological images stained using H&E.

实施例选取了某一胃镜活检组织作为样本,具体说明本发明的实验思想和特点。本发明的保护范围不限于上述实施例。所以,凡依据本发明所应用于受激拉曼散射内窥活检技术时,均在本发明的保护范围之内。The embodiment selects a gastroscopic biopsy tissue as a sample, and specifically illustrates the experimental idea and characteristics of the present invention. The protection scope of the present invention is not limited to the above-mentioned embodiments. Therefore, any application of the stimulated Raman scattering endoscopic biopsy technique according to the present invention falls within the scope of protection of the present invention.

Claims (2)

1. A histopathology imaging method of an intragastric endoscopic biopsy based on stimulated Raman scattering is characterized by comprising the following specific steps:
s1, selecting proper biomolecules as a substance to be detected according to characteristics concerned in histopathology aiming at biochemical components in stomach tissues, and detecting a standard sample corresponding to the substance to be detected by using a stimulated Raman scattering microscopic imaging system to obtain the optimal state of specific parameters in the stimulated Raman imaging system; the parameters include: pump and stokes wavelengths, relative time delays between pump and stokes;
s2, setting experiment parameters according to the result of the S1, carrying out region selection on a substance to be detected in the stomach biopsy tissue, and then carrying out rapid microscopic imaging on each region: after scanning of each frame of image is finished, moving the sample stage according to the designed position of the original region, then scanning the next frame of image, repeating the steps until the whole selected region is completely scanned to obtain a blocked image of the field of view of the whole region, and finally splicing the blocked image into a large-size image through a splicing algorithm;
when multiple substances to be detected such as lipid, protein and collagen need to be imaged, after each frame of image is scanned, the experimental parameters are automatically switched to be adjusted to scan another substance channel to be detected, and then the sample platform is translated; meanwhile, a multi-modal mode is used for imaging the substance;
s3, compiling a splicing algorithm for the small images scanned in the plurality of areas, and splicing the small images into a large image with a complete view field; reading a picture sequence into an algorithm program, firstly arranging small pictures to the expected position of a complete large picture according to the sequence number, splicing adjacent pictures, cutting or averagely processing the edge part of the adjacent pictures to remove repeated parts, then using an averaging algorithm to calculate the difference of pixel point values of certain rows or columns of the edge of the adjacent pictures, generating a compensation matrix to compensate the image value unevenness of each small picture caused by the uneven light spots, and finally obtaining a plurality of tissue sample pictures of different channels of a complete view field;
s4, synthesizing different channel substances obtained in the S3 into a pseudo-color image; the method specifically comprises the steps of linearly combining images of different channels, respectively mapping the images into images of different colors by using lookup tables of different colors, and then synthesizing the images into a tissue-like pathological image with various chemical components by using an overlapping method so as to provide the tissue-like pathological image for subsequent pathological diagnosis.
2. The method for histopathological imaging of endoscopic biopsy according to claim 1, wherein in step S1, when there is more than one substance to be detected and the raman peak wave number distance of different substances is within the spectrum range of the used pulse laser, the middle value of the raman peak wave number is selected as the required raman wave number in the compromise, and the wavelength of the pump light is selected accordingly, so that all substances to be detected can measure the raman peak without changing the wavelength of the pump light; the spectral range covered by a pulsed laser is calculated from the fourier transform in combination with the duration of the laser limit pulses.
CN202110612877.6A 2021-06-02 2021-06-02 Stomach peeping biopsy histopathology imaging method based on stimulated Raman scattering Active CN113433108B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202110612877.6A CN113433108B (en) 2021-06-02 2021-06-02 Stomach peeping biopsy histopathology imaging method based on stimulated Raman scattering

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202110612877.6A CN113433108B (en) 2021-06-02 2021-06-02 Stomach peeping biopsy histopathology imaging method based on stimulated Raman scattering

Publications (2)

Publication Number Publication Date
CN113433108A CN113433108A (en) 2021-09-24
CN113433108B true CN113433108B (en) 2022-11-18

Family

ID=77804154

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202110612877.6A Active CN113433108B (en) 2021-06-02 2021-06-02 Stomach peeping biopsy histopathology imaging method based on stimulated Raman scattering

Country Status (1)

Country Link
CN (1) CN113433108B (en)

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113933285A (en) * 2021-10-18 2022-01-14 安徽理工大学 Establishment of a Label-Free Quantitative Method for Detecting Collagen in Lung Tissue
CN114359799B (en) * 2021-12-29 2024-05-24 深圳乐易通医疗设备研发有限公司 Real-time monitoring system for pathological samples
CN114460060B (en) * 2022-02-28 2023-10-03 复旦大学 Raman spectrum imaging system and method for rapid detection of nano/micro plastic

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107748158B (en) * 2017-11-03 2020-11-06 中国科学院重庆绿色智能技术研究院 Device and method for rapid detection of micro-Raman imaging spectroscopy
US11756675B2 (en) * 2018-02-06 2023-09-12 The Regents Of The University Of Michigan Systems and methods for analysis and remote interpretation of optical histologic images
CN110208241B (en) * 2019-05-11 2021-10-26 复旦大学 Rapid three-dimensional chemical imaging method for atmospheric single particle based on stimulated Raman scattering

Also Published As

Publication number Publication date
CN113433108A (en) 2021-09-24

Similar Documents

Publication Publication Date Title
CN113433108B (en) Stomach peeping biopsy histopathology imaging method based on stimulated Raman scattering
US11662316B2 (en) Fluorescence observation apparatus and fluorescence observation method
US8078268B2 (en) System and method of chemical imaging using pulsed laser excitation and time-gated detection to determine tissue margins during surgery
JP6416887B2 (en) Microscopic observation of tissue samples using structured illumination
JP5687201B2 (en) Combined microscopy
US7945077B2 (en) Hyperspectral microscope for in vivo imaging of microstructures and cells in tissues
JP6046325B2 (en) Method and apparatus for the observation and analysis of one or more biological samples with progressively increased resolution
JP5316161B2 (en) Observation device
US10337995B2 (en) Systems and methods for oblique laser scanning
JP2006023387A (en) Microscope
Vanna et al. Vibrational imaging for label-free cancer diagnosis and classification
CN104880445A (en) Early cancer diagnosis device based on combination of auto-fluorescence lifetime imaging and fluorescence spectroscopy
CN103323410A (en) A device and a method based on a liquid-crystal filtering device for microscopic spectral imaging
CN111122535B (en) A Hyperspectral Rapid Imaging Measurement System for Molecular Vibrational Modes
CN113624731B (en) Super-resolution fluorescence hyperspectral microscopic imaging system
CN108507985B (en) Four-dimensional fluorescence resonance energy transfer efficiency visual microscope analysis system and method
Tweel et al. Automated whole slide imaging for label-free histology using photon absorption remote sensing microscopy
EP3824799A1 (en) Device, apparatus and method for imaging an object
CN212159566U (en) Hyperspectral living body fluorescence molecule imaging system
WO2009050437A1 (en) A system and method for infrared imaging
Song et al. Multiplexing ultraviolet-excited ultrasound and autofluorescence enables slide-free and label-free intraoperative histopathology imaging
Zhang et al. Speckle illumination microscopy enables slide-free and non-destructive pathology of human lung adenocarcinoma
Pozhar et al. Application of Acousto-Optical Hyperspectral Imaging for Skin Cancer Diagnostics
US12100153B2 (en) Photon absorption remote sensing system for histological assessment of tissues
Lin Volumetric stimulated Raman scattering microscopy

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant