CN103903231A - Method for removing auto-fluorescence interference in multi-spectra excitation fluorescence imaging - Google Patents
Method for removing auto-fluorescence interference in multi-spectra excitation fluorescence imaging Download PDFInfo
- Publication number
- CN103903231A CN103903231A CN201410139271.5A CN201410139271A CN103903231A CN 103903231 A CN103903231 A CN 103903231A CN 201410139271 A CN201410139271 A CN 201410139271A CN 103903231 A CN103903231 A CN 103903231A
- Authority
- CN
- China
- Prior art keywords
- image
- autofluorescence
- multispectral
- imaging
- fluorescence
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 37
- 230000005284 excitation Effects 0.000 title claims abstract description 32
- 238000000799 fluorescence microscopy Methods 0.000 title abstract description 18
- 238000001228 spectrum Methods 0.000 title description 2
- 239000011159 matrix material Substances 0.000 claims abstract description 16
- 238000000354 decomposition reaction Methods 0.000 claims abstract description 13
- 238000004364 calculation method Methods 0.000 claims abstract description 6
- 239000013598 vector Substances 0.000 claims description 26
- 238000003384 imaging method Methods 0.000 claims description 17
- 230000017105 transposition Effects 0.000 claims description 3
- 230000003287 optical effect Effects 0.000 claims 4
- 238000002073 fluorescence micrograph Methods 0.000 abstract description 42
- 239000007850 fluorescent dye Substances 0.000 abstract description 15
- 230000003595 spectral effect Effects 0.000 abstract description 7
- 238000012404 In vitro experiment Methods 0.000 abstract description 5
- 230000008901 benefit Effects 0.000 abstract description 3
- 238000012545 processing Methods 0.000 abstract description 3
- 241000699660 Mus musculus Species 0.000 description 4
- 238000011580 nude mouse model Methods 0.000 description 4
- 238000004088 simulation Methods 0.000 description 4
- 238000010521 absorption reaction Methods 0.000 description 2
- 238000010276 construction Methods 0.000 description 2
- 238000010586 diagram Methods 0.000 description 2
- 238000000338 in vitro Methods 0.000 description 2
- 238000001727 in vivo Methods 0.000 description 2
- 230000010354 integration Effects 0.000 description 2
- 238000005259 measurement Methods 0.000 description 2
- 238000007781 pre-processing Methods 0.000 description 2
- 238000011160 research Methods 0.000 description 2
- 230000031018 biological processes and functions Effects 0.000 description 1
- 230000001413 cellular effect Effects 0.000 description 1
- 238000007621 cluster analysis Methods 0.000 description 1
- 239000002131 composite material Substances 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 230000007812 deficiency Effects 0.000 description 1
- 238000003745 diagnosis Methods 0.000 description 1
- 239000003814 drug Substances 0.000 description 1
- 229940079593 drug Drugs 0.000 description 1
- 239000000975 dye Substances 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000002474 experimental method Methods 0.000 description 1
- 210000000936 intestine Anatomy 0.000 description 1
- 230000004060 metabolic process Effects 0.000 description 1
- 239000013307 optical fiber Substances 0.000 description 1
- 238000012634 optical imaging Methods 0.000 description 1
- 238000003672 processing method Methods 0.000 description 1
- 239000000523 sample Substances 0.000 description 1
- 238000000926 separation method Methods 0.000 description 1
- 230000009466 transformation Effects 0.000 description 1
Images
Landscapes
- Investigating, Analyzing Materials By Fluorescence Or Luminescence (AREA)
Abstract
本发明公开了一种多光谱激发荧光成像中去除自体荧光干扰的方法,其特征在于,包括以下步骤:采集多幅生物体表的多光谱原始荧光图像;根据生物体的尺寸,从图像中选取矩形感兴趣区域;构建组合图像并计算其相关矩阵,对相关矩阵进行特征值分解;计算迭代初值;迭代求解自体荧光图像;去除自体荧光图像。本发明的有益之处在于:仅需一个波长的激发光源,并且对荧光探针在不同波长下的激发效率无要求;对采集到的多光谱原始荧光图像进行裁剪,在不损失荧光图像信息的同时减少了参与处理的像素个数,减少了运算量;通过特征值分解获取迭代初值,无需预先进行体外实验来测定荧光信号的光谱曲线,在保证计算精度的同时降低了实现复杂度。
The invention discloses a method for removing autofluorescence interference in multi-spectral excited fluorescence imaging, which is characterized in that it comprises the following steps: collecting multiple multi-spectral original fluorescence images on the surface of a living body; selecting from the images according to the size of the living body Rectangular region of interest; construct the combined image and calculate its correlation matrix, and perform eigenvalue decomposition on the correlation matrix; calculate the initial value of iteration; iteratively solve the autofluorescence image; remove the autofluorescence image. The advantages of the present invention are: only one wavelength of excitation light source is required, and there is no requirement for the excitation efficiency of fluorescent probes at different wavelengths; the collected multi-spectral original fluorescence images are cut without loss of fluorescence image information At the same time, the number of pixels participating in the processing is reduced, and the amount of calculation is reduced; the initial value of the iteration is obtained through eigenvalue decomposition, and no in vitro experiments are required to measure the spectral curve of the fluorescence signal, which reduces the complexity of implementation while ensuring the calculation accuracy.
Description
技术领域technical field
本发明涉及一种激发荧光成像图像预处理方法,具体涉及一种多光谱激发荧光成像中去除自体荧光干扰的方法,属于图像预处理技术领域。The invention relates to an image preprocessing method for excited fluorescence imaging, in particular to a method for removing autofluorescence interference in multispectral excited fluorescence imaging, and belongs to the technical field of image preprocessing.
背景技术Background technique
多光谱激发荧光成像中,通过外部光源激发生物体内的荧光探针,荧光探针的发射荧光信号经过生物体内的散射与吸收,到达生物体表。多光谱激发荧光成像利用光纤或相机等装置采集经过带通滤光片组滤波的生物体表的荧光信号,能够对活体状态下的生物过程进行细胞和分子水平的定性和定量研究,在肿瘤早期诊断、探针的生物分布研究、靶向药物的体内代谢跟踪等领域被广泛应用。In multi-spectral excited fluorescence imaging, the fluorescent probe in the organism is excited by an external light source, and the emitted fluorescence signal of the fluorescent probe reaches the surface of the organism through scattering and absorption in the organism. Multi-spectral excited fluorescence imaging uses devices such as optical fibers or cameras to collect fluorescent signals on the surface of organisms filtered by band-pass filter groups, which can conduct qualitative and quantitative research on biological processes in vivo at the cellular and molecular levels. It is widely used in fields such as diagnosis, biodistribution research of probes, and in vivo metabolism tracking of targeted drugs.
自体荧光主要来自生物活体自身肠、脂肪、皮肤等组织受外部光源激发后产生的荧光,在可见光波段(400nm-700nm)比较强,严重时淹没有用的目标荧光信号,对目标荧光信号的检测产生干扰。Autofluorescence mainly comes from the fluorescence produced by living organisms' own intestines, fat, skin and other tissues excited by external light sources. It is relatively strong in the visible light band (400nm-700nm), and when it is serious, it will drown the useless target fluorescence signal. interference.
现有技术中,通过采集两个不同激发波长或者多个不同发射波长的荧光图像,采用图像处理方法,对自体荧光干扰进行去除。In the prior art, the autofluorescence interference is removed by collecting two fluorescence images with different excitation wavelengths or a plurality of different emission wavelengths, and adopting an image processing method.
中国发明专利申请,公开号:CN102096914A,公开了一种生物荧光图像中自体荧光干扰的去除方法。该方法采集两幅不同波段的激发荧光图像,利用聚类分析和种子漫水等方法去除自体荧光干扰。该方法要求激发荧光图像1中染料的激发效率高于激发荧光图像2中荧光染料的激发效率,且激发荧光图像1的激发光波长大于激发荧光图像2的激发波长。Chinese invention patent application, publication number: CN102096914A, discloses a method for removing autofluorescence interference in bioluminescent images. In this method, two excited fluorescence images of different wavelength bands were collected, and the interference of autofluorescence was removed by methods such as cluster analysis and seed flooding. This method requires that the excitation efficiency of the dye in the excited fluorescence image 1 is higher than that of the fluorescent dye in the excited fluorescence image 2, and the excitation wavelength of the excitation light in the excited fluorescence image 1 is greater than that in the excited fluorescence image 2.
文献Anne-sophie Montcuquet,Lionel Hervé,Fabrice Navarro,Jean-Marc Dinten,I.Mars“Nonnegative matrixfactorization:a blind spectra separation method for in vivofluorescent optical imaging”,Journal of BiomedicalOptics,15(5),056009,2010公开了一种多光谱激发荧光成像中的自体荧光去除方法。该方法通过采集多幅不同发射波长的荧光图像,以体外实验得到的荧光探针的光谱曲线作为迭代初值,采用加入正则化约束项的非负矩阵分解方法,去除自体荧光。Literature Anne-sophie Montcuquet, Lionel Hervé, Fabrice Navarro, Jean-Marc Dinten, I.Mars "Nonnegative matrixfactorization: a blind spectrum separation method for in vivofluorescent optical imaging", Journal of Biomedical Optics, 15(5), 056009, 2010 discloses a method for removing autofluorescence in multispectral excited fluorescence imaging. In this method, multiple fluorescent images with different emission wavelengths are collected, and the spectral curve of the fluorescent probe obtained from in vitro experiments is used as an initial iteration value, and a non-negative matrix decomposition method with regularization constraints is used to remove autofluorescence.
上述两类方法在实施过程中存在的缺陷为:第一类方法需要两个不同波长的激发光源,且要求使用的荧光探针在长波长下的激发效率高于短波长下的激发效率;第二类方法采用体外实验得到的荧光探针的光谱曲线作为迭代初值,用户需要进行体外测量实验,操作不方便;同时,由于感兴趣区域通常只占图像中的部分像素,而该类方法直接对采集到的多光谱图像进行处理,没有选取感兴趣区域并进行裁剪,运算量大。The defects in the implementation of the above two types of methods are as follows: the first type of method requires two excitation light sources with different wavelengths, and the excitation efficiency of the fluorescent probe required to be used is higher than that of the short wavelength at the long wavelength; The second type of method uses the spectral curve of the fluorescent probe obtained from the in vitro experiment as the iterative initial value, and the user needs to perform an in vitro measurement experiment, which is inconvenient to operate; at the same time, since the region of interest usually only occupies part of the pixels in the image, this type of method directly To process the collected multispectral images, the region of interest is not selected and cropped, which requires a large amount of computation.
发明内容Contents of the invention
为解决现有技术的不足,本发明的目的在于提供一种对激发光源和荧光探针无特殊要求、无需体外测量荧光信号光谱曲线的去除自体荧光干扰的方法。In order to solve the deficiencies of the prior art, the purpose of the present invention is to provide a method for removing autofluorescence interference that has no special requirements on excitation light sources and fluorescent probes, and does not require in vitro measurement of fluorescence signal spectral curves.
为了实现上述目标,本发明采用如下的技术方案:In order to achieve the above object, the present invention adopts the following technical solutions:
一种多光谱激发荧光成像中去除自体荧光干扰的方法,其特征在于,包括以下步骤:A method for removing autofluorescence interference in multispectral excited fluorescence imaging, comprising the following steps:
(1)、采集多光谱原始荧光图像:利用多光谱激发荧光成像设备采集同一激发波长下的J幅生物体表的多光谱原始荧光图像,记为Aj,j=1,2,...,J;(1) Acquisition of multi-spectral raw fluorescence images: use multi-spectral excitation fluorescence imaging equipment to collect J multi-spectral raw fluorescence images of biological body surfaces under the same excitation wavelength, denoted as A j , j=1,2,... ,J;
(2)、图像裁剪:根据生物体的尺寸,从步骤(1)采集的J幅多光谱原始荧光图像中选取矩形感兴趣区域,对多光谱原始荧光图像进行裁剪,裁剪后的荧光图像长和宽与图像中生物体的长和宽相同,记为Bj,Bj包括P行Q列像素,j=1,2,...,J;(2) Image cropping: According to the size of the organism, select a rectangular region of interest from the J multispectral raw fluorescence images collected in step (1), and crop the multispectral raw fluorescence images. The length and length of the cropped fluorescence images are The width is the same as the length and width of the organism in the image, denoted as B j , B j includes P rows and Q columns of pixels, j=1,2,...,J;
(3)、特征值分解:构建组合图像C,组合图像C的第j行由图像Bj排列成的行向量构成,组合图像C包括J行L列像素,L=P×Q,计算组合图像C的相关矩阵D,对相关矩阵D进行特征值分解,取最大特征值对应的特征列向量u,并将u中小于0的元素设置为0,其余元素不变,得到v;(3) Eigenvalue decomposition: construct a combined image C, the jth row of the combined image C is composed of row vectors arranged by the image Bj, the combined image C includes J rows and L columns of pixels, L=P×Q, and the combined image C is calculated Correlation matrix D of the correlation matrix D, perform eigenvalue decomposition on the correlation matrix D, take the eigencolumn vector u corresponding to the largest eigenvalue, and set the elements less than 0 in u to 0, and keep the rest of the elements unchanged to obtain v;
(4)、计算迭代初值:根据步骤(3)得到的向量v,由下式计算迭代初值a0和s0:(4) Calculate the initial value of iteration: According to the vector v obtained in step (3), calculate the initial value of iteration a 0 and s 0 by the following formula:
a0=1 (1)a 0 =1 (1)
s0=vT (2)s 0 =v T (2)
式(1)中,1表示包含L个元素的全1列向量;In formula (1), 1 means a full 1-column vector containing L elements;
式(2)中,T表示转置运算;In formula (2), T represents the transpose operation;
(5)、迭代求解自体荧光图像:以步骤(4)中的a0和s0作为初值,利用下式进行K次迭代:(5) Iteratively solve the autofluorescence image: take a 0 and s 0 in step (4) as initial values, and use the following formula to perform K iterations:
式(3)和式(4)中,k=1,2,...,K;ak,i表示第k次迭代得到的列向量ak的第i个元素;表示列向量的第i个元素;表示行向量的第i个元素;In formula (3) and formula (4), k=1,2,...,K; a k,i represents the i-th element of the column vector a k obtained in the k-th iteration; Represents a column vector The i-th element of ; represents a row vector The i-th element of ;
根据第K次迭代得到的结果计算E=aKsK,并将前述E的每一行重构成一幅包括P行Q列像素的图像,得到J幅自体荧光图像,记为Fj,j=1,2,...,J;Calculate E=a K s K according to the results obtained in the K-th iteration, and reconstruct each row of the aforementioned E into an image including P rows and Q columns of pixels to obtain J autofluorescence images, denoted as F j , j= 1,2,...,J;
(6)、去除自体荧光图像:从裁剪得到的J幅荧光图像Bj中减去由步骤(5)得到的自体荧光图像Fj,得到J幅仅包括目标信息的荧光图像Gj:(6) Remove the autofluorescence image: Subtract the autofluorescence image F j obtained in step (5) from the cropped J fluorescence images B j to obtain J fluorescence images G j including only target information:
Gj=Bj-Fj (5)G j =B j -F j (5)
式中,j=1,2,...,J。In the formula, j=1,2,...,J.
前述的多光谱激发荧光成像中去除自体荧光干扰的方法,其特征在于,在步骤(1)中,采用J个发射滤光片采集前述多光谱原始荧光图像。The aforementioned method for removing autofluorescence interference in multispectral excited fluorescence imaging is characterized in that, in step (1), J emission filters are used to collect the aforementioned multispectral raw fluorescence images.
前述的多光谱激发荧光成像中去除自体荧光干扰的方法,其特征在于,前述J个发射滤光片带宽相同、相邻滤光片的中心波长间隔与滤光片带宽相等。The aforementioned method for removing autofluorescence interference in multi-spectral excited fluorescence imaging is characterized in that the aforementioned J emission filters have the same bandwidth, and the center wavelength intervals of adjacent filters are equal to the filter bandwidth.
前述的多光谱激发荧光成像中去除自体荧光干扰的方法,其特征在于,在步骤(1)中,采集前述J幅多光谱原始荧光图像时,采集设备积分时间与成像生物体姿态均保持不变。The aforementioned method for removing autofluorescence interference in multispectral excited fluorescence imaging is characterized in that, in step (1), when collecting the aforementioned J multispectral raw fluorescence images, the integration time of the acquisition device and the posture of the imaging organism remain unchanged .
前述的多光谱激发荧光成像中去除自体荧光干扰的方法,其特征在于,在步骤(3)中,前述相关矩阵D根据下式计算得到:The aforementioned method for removing autofluorescence interference in multispectral excited fluorescence imaging is characterized in that, in step (3), the aforementioned correlation matrix D is calculated according to the following formula:
本发明的有益之处在于:The benefits of the present invention are:
1、仅需一个波长的激发光源,并且对荧光探针在不同波长下的激发效率无要求;1. Only one wavelength of excitation light source is required, and there is no requirement for the excitation efficiency of fluorescent probes at different wavelengths;
2、本发明对采集到的多光谱原始荧光图像进行裁剪,在不损失荧光图像信息的同时减少了参与处理的像素个数,减少了运算量;2. The present invention cuts the collected multi-spectral original fluorescence image, reduces the number of pixels involved in the processing without losing the information of the fluorescence image, and reduces the amount of computation;
3、本发明通过特征值分解获取迭代初值,无需预先进行体外实验来测定荧光信号的光谱曲线,在保证计算精度的同时降低了实现复杂度。3. The present invention obtains the iterative initial value through eigenvalue decomposition, and does not need to conduct in vitro experiments in advance to measure the spectral curve of the fluorescence signal, which reduces the implementation complexity while ensuring the calculation accuracy.
附图说明Description of drawings
图1是本发明的方法的主要流程示意图;Fig. 1 is the main flow diagram of the method of the present invention;
图2是利用本发明的方法获得的仿真实验结果图。Fig. 2 is a diagram of simulation experiment results obtained by using the method of the present invention.
具体实施方式Detailed ways
本发明提供的方法采集同一激发波长下的多幅发射荧光图像并对图像进行裁剪,利用多光谱激发荧光成像过程中有用荧光信号与自体荧光信号光谱曲线不同的特点,通过特征值分解提供迭代初值,采用非负矩阵分解方法去除自体荧光。The method provided by the present invention collects multiple emission fluorescence images under the same excitation wavelength and cuts the images, utilizes the characteristics of different spectral curves of useful fluorescence signals and autofluorescence signals in the process of multi-spectral excitation fluorescence imaging, and provides an iterative initial method through eigenvalue decomposition. Values, autofluorescence was removed using the non-negative matrix factorization method.
以下结合附图和具体实施例对本发明作具体的介绍。The present invention will be specifically introduced below in conjunction with the accompanying drawings and specific embodiments.
参照图1,本发明的多光谱激发荧光成像中去除自体荧光的方法,包括以下步骤:Referring to Fig. 1, the method for removing autofluorescence in the multispectral excited fluorescence imaging of the present invention comprises the following steps:
1、采集多光谱原始荧光图像1. Acquisition of multispectral raw fluorescence images
以体内有荧光探针的生物体为成像对象,利用多光谱激发荧光成像设备采集图像,具体的,通过切换多光谱激发荧光成像设备的发射滤光片,采集同一激发波长、不同发射波长下的J幅生物体表的多光谱原始荧光图像,记为Aj,j=1,2,...,J。Taking organisms with fluorescent probes in the body as imaging objects, using multi-spectral excitation fluorescence imaging equipment to collect images, specifically, by switching the emission filters of the multi-spectral excitation fluorescence imaging equipment, collecting images under the same excitation wavelength and different emission wavelengths The raw multispectral fluorescence images of J biological surface, denoted as A j , j=1,2,...,J.
发射滤光片数量为J个,并且J个发射滤光片带宽相同、相邻滤光片的中心波长间隔与滤光片带宽相等。The number of emission filters is J, and the bandwidths of the J emission filters are the same, and the center wavelength interval of adjacent filters is equal to the bandwidth of the filters.
在采集J幅多光谱原始荧光图像时,采集设备积分时间与成像生物体姿态均保持不变。When acquiring J multispectral raw fluorescence images, the integration time of the acquisition equipment and the pose of the imaging organism remain unchanged.
2、图像裁剪2. Image cropping
通常情况下,多光谱激发荧光成像设备的成像视野大于成像对象,采集到的多光谱原始荧光图像只有部分像素包含有效信息,为了在保留有效信息的同时减少像素个数从而减少后续运算量,根据生物体的尺寸,从步骤1采集的J幅多光谱原始荧光图像中选取矩形感兴趣区域,对多光谱原始荧光图像进行裁剪,裁剪后的荧光图像长和宽与图像中生物体的长和宽相同,记为Bj,Bj包括P行Q列像素,j=1,2,...,J。Usually, the imaging field of view of multi-spectral excited fluorescence imaging equipment is larger than the imaging object, and only some pixels of the collected multi-spectral raw fluorescence image contain valid information. The size of the organism, select a rectangular region of interest from the J multispectral raw fluorescence images collected in step 1, and crop the multispectral raw fluorescence image. The length and width of the cropped fluorescence image are the same as the length and width of the organism in the image Same, denoted as B j , B j includes pixels in rows P and columns Q, j=1,2,...,J.
3、特征值分解3. Eigenvalue decomposition
(1)构建组合图像C,组合图像C的第j行由图像Bj排列成的行向量构成,组合图像C包括J行L列像素,L=P×Q。(1) Construct the combined image C. The jth row of the combined image C is composed of row vectors arranged by the image B j . The combined image C includes J rows and L columns of pixels, L=P×Q.
组合图像C的具体构造步骤如下:The specific construction steps of the combined image C are as follows:
将裁剪后的荧光图像Bj的第1行像素到第J行像素拼成一行像素,像素个数L为:L=P×Q,由J幅图像得到J行像素,该J行像素自上而下排列,构成一幅包含J行L列像素的组合图像。The cropped fluorescent image B j is composed of pixels from the first row to the Jth row of pixels into a row of pixels, the number of pixels L is: L=P×Q, J rows of pixels are obtained from J images, and the J row of pixels starts from the top Arranged downwards to form a composite image including J rows and L columns of pixels.
(2)计算组合图像C的相关矩阵D,相关矩阵D根据下式计算得到:(2) Calculate the correlation matrix D of the combined image C, and the correlation matrix D is calculated according to the following formula:
(3)对相关矩阵D进行特征值分解,取最大特征值对应的特征列向量u,并将u,并将u中小于0的元素设置为0,其余元素不变,得到v。(3) Decompose the eigenvalue of the correlation matrix D, take the eigencolumn vector u corresponding to the largest eigenvalue, set u and the elements less than 0 in u to 0, and keep the rest of the elements unchanged to obtain v.
4、计算迭代初值4. Calculate the initial value of iteration
根据步骤3得到的向量v,由下式计算迭代初值a0和s0:According to the vector v obtained in step 3, the iteration initial values a 0 and s 0 are calculated by the following formula:
a0=1 (1)a 0 =1 (1)
s0=vT (2)s 0 =v T (2)
式(1)中,1表示包含L个元素的全1列向量;In formula (1), 1 represents a full 1-column vector containing L elements;
式(2)中,T表示转置运算。In formula (2), T represents the transposition operation.
5、迭代求解自体荧光图像5. Iteratively solve the autofluorescence image
以步骤4中的a0和s0作为初值,利用下式进行K次迭代:Taking a 0 and s 0 in step 4 as initial values, use the following formula to perform K iterations:
式(3)和式(4)中,k=1,2,...,K;ak,i表示第k次迭代得到的列向量ak的第i个元素;表示列向量的第i个元素;表示行向量的第i个元素。In formula (3) and formula (4), k=1,2,...,K; a k,i represents the i-th element of the column vector a k obtained in the k-th iteration; Represents a column vector The i-th element of ; represents a row vector The i-th element of .
根据第K次迭代得到的结果计算E=aKsK,并将E的每一行重构成一幅包括P行Q列像素的图像,得到J幅自体荧光图像,记为Fj,j=1,2,...,J。Calculate E=a K s K based on the results obtained in the Kth iteration, and reconstruct each row of E into an image including P rows and Q columns of pixels to obtain J autofluorescence images, denoted as F j , j=1 ,2,...,J.
具体的,J幅自体荧光图像Fj的构造步骤如下:Specifically, the construction steps of J autofluorescence images Fj are as follows:
将所述E的每一行像素等分成P份Q个像素,并将此P份Q个像素自上而下排列,得到一幅P×Q的二维图像,E包括J行,共得到J幅自体荧光图像。Divide each row of pixels of E into P parts of Q pixels, and arrange the P parts of Q pixels from top to bottom to obtain a P×Q two-dimensional image. E includes J lines, and a total of J pictures are obtained Autofluorescence image.
6、去除自体荧光图像6. Remove autofluorescence images
从裁剪得到的J幅荧光图像Bj中减去由步骤5得到的自体荧光图像Fj,得到J幅仅包括目标信息的荧光图像Gj:Subtract the autofluorescence image F j obtained in step 5 from the cropped J fluorescence images B j to obtain J fluorescence images G j that only include target information:
Gj=Bj-Fj (5)G j =B j -F j (5)
式中,j=1,2,...,J。In the formula, j=1,2,...,J.
为了更好的理解本发明,下面结合仿真实验对本发明的效果进一步的描述,仿真实验以体内有荧光探针的裸鼠作为成像对象。In order to better understand the present invention, the effects of the present invention will be further described below in combination with simulation experiments. The simulation experiments use nude mice with fluorescent probes in their bodies as imaging objects.
1、采集多光谱原始荧光图像。1. Collect multispectral raw fluorescence images.
采用与荧光探针吸收峰波长匹配的激发光源照射体内有该荧光探针标记的裸鼠,利用多光谱激发荧光设备采集裸鼠体表的荧光探针发射峰附近6个中心波长的原始荧光图像,记为Aj,j=1,2,…,6。The nude mice labeled with the fluorescent probe were irradiated with an excitation light source matching the absorption peak wavelength of the fluorescent probe, and the original fluorescence images of the six central wavelengths near the emission peak of the fluorescent probe on the surface of the nude mice were collected using a multi-spectral excitation fluorescence device. , denoted as A j , j=1,2,…,6.
需要说明的是,多光谱激发荧光设备利用高灵敏度CCD相机进行图像采集,其像素个数为1024×1024,因此,采集到的每幅原始荧光图像均由1024×1024个像素构成。It should be noted that the multi-spectral excitation fluorescence equipment uses a high-sensitivity CCD camera for image acquisition, and the number of pixels is 1024×1024. Therefore, each original fluorescence image collected consists of 1024×1024 pixels.
2、图像裁剪。2. Image cropping.
根据裸鼠的尺寸,从步骤1采集的6幅原始荧光图像中选取725×270的矩形感兴趣区域,对原始荧光图像进行裁剪,裁剪后的荧光图像记为Bj,Bj包括725行270列像素,j=1,2,…,6。According to the size of the nude mice, a rectangular region of interest of 725×270 was selected from the six original fluorescence images collected in step 1, and the original fluorescence images were cropped. Column of pixels, j=1,2,…,6.
3、特征值分解。3. Eigenvalue decomposition.
将裁减后的荧光图像Bj的第1行像素到第725行像素拼成一行像素,像素个数为725×270=195750,由6幅图像得到6行像素,该6行像素自上而下排列,构成一幅包含6行195750列像素的组合图像,记为C,根据下式计算组合图像C的相关矩阵D:Combine the pixels from the 1st row to the 725th row of the cropped fluorescent image B j into a row of pixels, the number of pixels is 725×270=195750, and 6 rows of pixels are obtained from 6 images, and the 6 rows of pixels are from top to bottom Arranged to form a combined image containing 6 rows and 195,750 columns of pixels, denoted as C, and the correlation matrix D of the combined image C is calculated according to the following formula:
其中,T表示转置运算,对相关矩阵D进行特征值分解,取最大特征值对应的特征列向量u,并将u中小于0的元素设置为0,其余元素不变,得到v。Among them, T represents the transposition operation, and the eigenvalue decomposition is performed on the correlation matrix D, and the characteristic column vector u corresponding to the largest eigenvalue is taken, and the elements less than 0 in u are set to 0, and the remaining elements remain unchanged to obtain v.
4、计算迭代初值。4. Calculate the initial value of iteration.
由下式计算迭代初值a0和s0:The iteration initial values a 0 and s 0 are calculated by the following formula:
a0=1,s0=vT a 0 =1, s 0 =v T
其中,1表示包含195750个元素的全1列向量,T表示转置运算。Among them, 1 means a full 1-column vector containing 195750 elements, and T means a transpose operation.
5、迭代求解自体荧光图像。5. Iteratively solve the autofluorescence image.
以步骤4中的a0和s0作为初值,利用下式进行20次迭代:Taking a 0 and s 0 in step 4 as initial values, use the following formula to perform 20 iterations:
式中,k=1,2,...,20;ak,i表示第k次迭代得到的列向量ak的第i个元素;表示列向量的第i个元素;表示行向量的第i个元素。In the formula, k=1,2,...,20; a k,i represents the ith element of the column vector a k obtained in the kth iteration; Represents a column vector The i-th element of ; represents a row vector The i-th element of .
根据第K次迭代得到的结果计算E=aKsK,并将所述E的每一行重构成一幅包括725行270列像素的图像,得到6幅自体荧光图像,记为F1,F2,......,F6。Calculate E=a K s K according to the results obtained in the Kth iteration, and reconstruct each row of E into an image including 725 rows and 270 columns of pixels to obtain 6 autofluorescence images, which are denoted as F 1 , F 2 ,..., F6 .
6、去除自体荧光图像,根据下式从6幅裁剪后的荧光图像中减去由步骤5得到的自体荧光图像,得到6幅仅包括目标信息的荧光图像:6. Remove the autofluorescence image, subtract the autofluorescence image obtained in step 5 from the 6 cropped fluorescence images according to the following formula, and obtain 6 fluorescence images including only target information:
Gj=Bj-Fj,j=1,2,...,6。G j =B j -F j , j=1,2,...,6.
图2所示为2组仿真实验结果。图中,a1,a2,......,a6所示为裁剪后的6幅多光谱激发荧光图像,每幅荧光图像包括725×270个像素,图中包括目标荧光信号和自体荧光信号,可以看到,自体荧光信号对目标荧光信号形成一定干扰。图b1,b2,......,b6所示为采用本发明方法去除自体荧光后的荧光图像,可以看到,自体荧光被有效去除。Figure 2 shows the results of two sets of simulation experiments. In the figure, a1, a2,...,a6 show six cropped multi-spectral excitation fluorescence images, each fluorescence image includes 725×270 pixels, including target fluorescence signals and autofluorescence signals , it can be seen that the autofluorescence signal interferes with the target fluorescence signal to some extent. Figures b1, b2, ..., b6 show the fluorescence images after the autofluorescence is removed by the method of the present invention, and it can be seen that the autofluorescence is effectively removed.
由此可见,本发明的方法具有如下优势:This shows that method of the present invention has following advantage:
1、仅需一个波长的激发光源,并且对荧光探针在不同波长下的激发效率无要求;1. Only one wavelength of excitation light source is required, and there is no requirement for the excitation efficiency of fluorescent probes at different wavelengths;
2、对采集到的多光谱原始荧光图像进行裁剪,在不损失荧光图像信息的同时减少了参与处理的像素个数,减少了运算量;2. Crop the collected multi-spectral original fluorescence image, reduce the number of pixels involved in the processing without losing the information of the fluorescence image, and reduce the amount of calculation;
3、通过特征值分解获取迭代初值,无需预先进行体外实验来测定荧光信号的光谱曲线,在保证计算精度的同时降低了实现复杂度。3. The iterative initial value is obtained through eigenvalue decomposition, and no in vitro experiments are required to measure the spectral curve of the fluorescent signal, which reduces the complexity of implementation while ensuring calculation accuracy.
需要说明的是,上述实施例不以任何形式限制本发明,凡采用等同替换或等效变换的方式所获得的技术方案,均落在本发明的保护范围内。It should be noted that the above embodiments do not limit the present invention in any form, and all technical solutions obtained by means of equivalent replacement or equivalent transformation fall within the protection scope of the present invention.
Claims (5)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201410139271.5A CN103903231B (en) | 2014-04-08 | 2014-04-08 | A kind of multispectral excite in fluorescence imaging remove autofluorescence interference method |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201410139271.5A CN103903231B (en) | 2014-04-08 | 2014-04-08 | A kind of multispectral excite in fluorescence imaging remove autofluorescence interference method |
Publications (2)
Publication Number | Publication Date |
---|---|
CN103903231A true CN103903231A (en) | 2014-07-02 |
CN103903231B CN103903231B (en) | 2016-09-07 |
Family
ID=50994538
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201410139271.5A Active CN103903231B (en) | 2014-04-08 | 2014-04-08 | A kind of multispectral excite in fluorescence imaging remove autofluorescence interference method |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN103903231B (en) |
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN105078415A (en) * | 2015-08-27 | 2015-11-25 | 西安电子科技大学 | Method for separating Cerenkov fluorescence from secondary excitation fluorescence based on double-spectrum information |
CN112424588A (en) * | 2018-07-24 | 2021-02-26 | 索尼公司 | Information processing device and microscope for separating fluorescence of fluorescent reagent from autofluorescence of sample |
Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20090245611A1 (en) * | 2008-03-26 | 2009-10-01 | General Electric Company | Method and Apparatus for Removing Tissue Autofluorescence |
EP2213222A1 (en) * | 2009-01-30 | 2010-08-04 | FUJIFILM Corporation | Fluorescence endoscope system and fluorescence imaging method |
CN102096914A (en) * | 2011-01-26 | 2011-06-15 | 中国科学院自动化研究所 | Method for eliminating interference of autologous florescence from biological fluorescence image |
-
2014
- 2014-04-08 CN CN201410139271.5A patent/CN103903231B/en active Active
Patent Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20090245611A1 (en) * | 2008-03-26 | 2009-10-01 | General Electric Company | Method and Apparatus for Removing Tissue Autofluorescence |
EP2213222A1 (en) * | 2009-01-30 | 2010-08-04 | FUJIFILM Corporation | Fluorescence endoscope system and fluorescence imaging method |
CN102096914A (en) * | 2011-01-26 | 2011-06-15 | 中国科学院自动化研究所 | Method for eliminating interference of autologous florescence from biological fluorescence image |
Non-Patent Citations (4)
Title |
---|
ANNE-SOPHIE MONTCUQUET等: "Nonnegative matrix factorization:a blind spectra separation method for in vivo fluorescent optical imaging", 《JOURNAL OF BIOMEDICAL OPTICS》, vol. 15, no. 5, 31 October 2010 (2010-10-31), XP055013153, DOI: doi:10.1117/1.3491796 * |
CYRIL GOBINET等: "About Importance of Positivity Constraint for Source Separation in Fluorescence Spectroscopy", 《SIGNAL PROCESSING CONFERENCE,2005 13TH EUROPEAN》, 8 September 2005 (2005-09-08) * |
殷海青: "图像分析中的非负矩阵分解理论及其最优化和正则化方法研究", 《中国博士学位论文全文数据库 信息科技辑》, vol. 2011, no. 12, 15 December 2011 (2011-12-15) * |
黄远程: "高光谱影像混合像元分解的若干关键技术研究", 《中国博士学位论文全文数据库 信息科技辑》, vol. 2012, no. 1, 15 January 2012 (2012-01-15), pages 44 * |
Cited By (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN105078415A (en) * | 2015-08-27 | 2015-11-25 | 西安电子科技大学 | Method for separating Cerenkov fluorescence from secondary excitation fluorescence based on double-spectrum information |
CN105078415B (en) * | 2015-08-27 | 2017-06-30 | 西安电子科技大学 | Cerenkov fluorescence and secondary excitation fluorescence separation method based on double spectral informations |
CN112424588A (en) * | 2018-07-24 | 2021-02-26 | 索尼公司 | Information processing device and microscope for separating fluorescence of fluorescent reagent from autofluorescence of sample |
Also Published As
Publication number | Publication date |
---|---|
CN103903231B (en) | 2016-09-07 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
Lee et al. | Motion artifact reduction in wearable photoplethysmography based on multi-channel sensors with multiple wavelengths | |
Rey-Barroso et al. | Visible and extended near-infrared multispectral imaging for skin cancer diagnosis | |
CN102893137B (en) | Rapid multispectral imaging method and apparatus for cancer detection and localization and applications | |
CA2685000C (en) | Method for real time tumour visualisation and demarcation by means of photodynamic diagnosis | |
CN102488493B (en) | Small animal living body multi-mode molecule imaging system and imaging method | |
JP2013090922A5 (en) | ||
Medvedev et al. | Event-related fast optical signal in a rapid object recognition task: improving detection by the independent component analysis | |
DE102012216013A1 (en) | Minimally invasive image-based determination of the concentration of carbon dioxide (CO2) in exhaled breath | |
CN102495066B (en) | Non-destructive testing method for pods based on hyperspectral transmission image acquisition system | |
EP3472803A1 (en) | Method and apparatus for estimating the value of a physical parameter in a biological tissue | |
Chiarelli et al. | Fiberless, multi-channel fNIRS-EEG system based on silicon photomultipliers: towards sensitive and ecological mapping of brain activity and neurovascular coupling | |
DE102011017064A1 (en) | Diagnostic measuring device with integrated spectrometer | |
US20220094861A1 (en) | Multispectral imaging sensors and systems | |
CN109752377B (en) | Spectroscopic bimodal projection tomography tissue blood vessel imaging device and method | |
CN104305957A (en) | Head-wearing molecule image navigation system | |
Ron et al. | Self-gated respiratory motion rejection for optoacoustic tomography | |
CN103903231B (en) | A kind of multispectral excite in fluorescence imaging remove autofluorescence interference method | |
Wang et al. | Deep learning in ex-vivo lung cancer discrimination using fluorescence lifetime endomicroscopic images | |
CN111489316B (en) | Mammary gland diffusion optical tomography system based on genetic algorithm | |
JP2023520007A (en) | Systems, methods, and apparatus for multispectral photoacoustic imaging | |
Deng et al. | Non-invasive methods for heart rate measurement in fish based on photoplethysmography | |
CN204072055U (en) | Wear-type molecular image navigation system | |
Estevez et al. | Mónica Canabal-Carbia | |
CN103413281B (en) | The method of the removal background fluorescence interference in the imaging of a kind of biological living fluorescence excitation | |
Kedir et al. | Spectranet: A deep model for skin oxygenation measurement from multi-spectral data |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
C06 | Publication | ||
PB01 | Publication | ||
C10 | Entry into substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
C14 | Grant of patent or utility model | ||
GR01 | Patent grant | ||
TR01 | Transfer of patent right |
Effective date of registration: 20220419 Address after: 510700 Room 601, building C, No. 288, Shenzhou Road, Huangpu District, Guangzhou, Guangdong Patentee after: Guangzhou bolutang Biotechnology Co.,Ltd. Address before: 712026 Hanzhong, No. 266, Xinglong section, Xifeng Road, Xi'an, Shaanxi Patentee before: XIDIAN University |
|
TR01 | Transfer of patent right |