WO2023222119A1 - 多通道荧光成像系统、内窥镜成像系统和内窥镜成像方法 - Google Patents

多通道荧光成像系统、内窥镜成像系统和内窥镜成像方法 Download PDF

Info

Publication number
WO2023222119A1
WO2023222119A1 PCT/CN2023/095327 CN2023095327W WO2023222119A1 WO 2023222119 A1 WO2023222119 A1 WO 2023222119A1 CN 2023095327 W CN2023095327 W CN 2023095327W WO 2023222119 A1 WO2023222119 A1 WO 2023222119A1
Authority
WO
WIPO (PCT)
Prior art keywords
light
fluorescence
image
light source
band
Prior art date
Application number
PCT/CN2023/095327
Other languages
English (en)
French (fr)
Inventor
陈聪平
林路易
吴晓华
Original Assignee
深圳迈瑞生物医疗电子股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 深圳迈瑞生物医疗电子股份有限公司 filed Critical 深圳迈瑞生物医疗电子股份有限公司
Publication of WO2023222119A1 publication Critical patent/WO2023222119A1/zh

Links

Classifications

    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor

Definitions

  • the present application relates to the technical field of endoscopic imaging, and more specifically to a multi-channel fluorescence imaging system, an endoscopic imaging system and an endoscopic imaging method.
  • the present application provides a multi-channel fluorescence imaging system, which includes a light source component, a light transmission component, an imaging component, an image processor and a display, wherein: the light source component is used to simultaneously output at least two fluorescent dyes Respectively corresponding excitation light; the light transmission component is used to transmit the light emitted by the light source component to a target object using the fluorescent dye, and receive fluorescence from the target object; the imaging component is used from The optical transmission component receives the The fluorescence and generate an electrical signal; the image processor is used to separate at least two fluorescent signals from the electrical signal, and generate one channel of image data based on each fluorescent signal, wherein the at least two fluorescent signals respectively correspond to based on the at least two fluorescent dyes; the display is configured to display at least one of a plurality of channel images based on the image data.
  • the light source component is used to simultaneously output at least two fluorescent dyes Respectively corresponding excitation light
  • the light transmission component is used to transmit the light emitted by the light source component to a target object
  • an endoscopic imaging system in another aspect of the present application, includes the above-mentioned multi-channel fluorescence imaging system, wherein the light transmission component in the multi-channel fluorescence imaging system is an endoscopic component.
  • the endoscope assembly transmits the light emitted by the light source assembly in the multi-channel fluorescence imaging system to the tissue to be observed of the target object using fluorescent dye, and receives the fluorescence from the tissue to be observed.
  • an endoscopic imaging method which method includes: obtaining the reflected light of visible light by the tissue to be observed, and the fluorescence excited by at least two fluorescent dyes by the tissue to be observed; based on the The reflected light generates a visible light image signal, and generates a fluorescence image signal based on the fluorescence.
  • first image data is generated based on the visible light image signal.
  • the first image data includes image data of one channel, and is based on the fluorescence image.
  • the signal generates second image data, the second image data includes at least two channels of image data, and the image data of different channels in the second image data correspond to fluorescence excited by different fluorescent dyes; based on the first image data Generate a first image, and generate a second image based on the second image data; images of at least two channels in the second image are superposed and displayed with the first image, or images of different channels in the second image are displayed The images are displayed superimposed on each other; wherein the images of different channels in the second image correspond to different fluorescent markers, and different fluorescent markers are displayed in different colors.
  • the light source component of the multi-channel fluorescence imaging system can simultaneously output the corresponding excitation light of at least two fluorescent dyes.
  • the imaging component can simultaneously receive fluorescence in different bands and convert it into electrical signals.
  • the different fluorescence signals can be processed by the image processor.
  • the fluorescent signals corresponding to the dyes are separated from each other from the electrical signals, and one channel of image data is generated based on each fluorescent signal, enabling a single image processor to achieve multi-channel fluorescence imaging without time sharing.
  • Figure 1 shows a schematic structural block diagram of a multi-channel fluorescence imaging system according to an embodiment of the present application.
  • FIG. 2 shows a schematic structural block diagram of a more specific example system of a multi-channel fluorescence imaging system according to an embodiment of the present application.
  • Figure 3 shows a schematic diagram of spectral transmission characteristics of a multi-channel fluorescence imaging system according to an embodiment of the present application.
  • Figure 4 shows a schematic flow chart of real-time intraoperative video navigation of a multi-channel fluorescence imaging system according to an embodiment of the present application.
  • FIG. 5 shows a schematic diagram of an exemplary manner in which a multi-channel fluorescence imaging system presents a multi-channel fluorescence image according to an embodiment of the present application.
  • FIG. 6 shows a schematic diagram of another exemplary manner in which a multi-channel fluorescence imaging system presents a multi-channel fluorescence image according to an embodiment of the present application.
  • Figure 7 shows a schematic flow chart of the endoscopic imaging method according to the embodiment of the present application.
  • FIG. 1 shows a schematic structural block diagram of a multi-channel fluorescence imaging system 100 according to an embodiment of the present application.
  • the multi-channel fluorescence imaging system 100 includes a light source component 110, a light transmission component 120, an imaging component 130, an image processor 140 and a display 150, wherein: the light source component 110 is used to simultaneously output at least two fluorescent dyes corresponding to each other.
  • the light transmission component 120 is used to transmit the light emitted by the light source component 110 to a target object using a fluorescent dye, and receive fluorescence from the target object;
  • the imaging component 130 is used to receive fluorescence from the light transmission component 120 and generate electricity. signal;
  • the image processor 140 is configured to separate at least two fluorescent signals from the electrical signal and generate one channel of image data based on each fluorescent signal, wherein the at least two fluorescent signals respectively correspond to at least two fluorescent dyes;
  • the display 150 For displaying at least one of the plurality of channel images based on the image data.
  • the light source component 110 of the multi-channel fluorescence imaging system 100 can simultaneously output the corresponding excitation light of at least two fluorescent dyes, and the imaging component 130 can simultaneously receive fluorescence in different wavelength bands and convert it into electrical signals, and through the image
  • the processor 140 separates the fluorescent signals corresponding to different fluorescent dyes from the electrical signals, and generates one channel of image data based on each fluorescent signal, enabling a single image processor 140 to realize multi-channel fluorescence imaging without time sharing, that is, It can achieve simultaneous imaging of fluorescence in two or more different wavelength bands using a small number of excitation light sources, without the need to switch excitation light sources and emission bands.
  • the light output by the light source component 110 includes light in the visible light band, and the corresponding excitation lights of at least two fluorescent dyes are in the visible light band.
  • the light source component 110 is also used to filter out light in emission bands corresponding to at least two fluorescent dyes from the visible light band;
  • the light transmission component 120 is also used to receive reflected light from the target object;
  • the imaging component 130 The image processor 140 is also used to separate the visible light reflection signal from the electrical signal and generate the visible light reflection signal based on the visible light reflection signal.
  • One channel of image data This embodiment can be applied to fields where the corresponding excitation light of the fluorescent dyes used is in the visible light band. scene.
  • the light output by the light source assembly 110 includes light in the near-infrared band, and the corresponding excitation lights of at least two fluorescent dyes are in the near-infrared band.
  • the light source assembly 110 is also used to filter out light in the emission wavelength bands corresponding to the at least two fluorescent dyes from the near-infrared band. This embodiment can be applied to scenarios where the corresponding excitation light of the fluorescent dyes used is in the near-infrared band.
  • the light output by the light source assembly 110 includes light in the visible light band and light in the near-infrared band, and the corresponding excitation lights of at least two fluorescent dyes are both in the visible light band, or both are in the near-infrared band, Or part of it is in the visible light band and the rest is in the near-infrared band.
  • the light source component 110 is also used to filter out light in emission bands corresponding to at least two fluorescent dyes from the visible light band and/or the near-infrared band; the light transmission component 120 is also used to receive light from the target object.
  • the imaging component 130 is also used to receive reflected light from the light transmission component 120, and the electrical signal generated by the imaging component 130 is also generated based on the reflected light; the image processor 140 is also used to separate the visible light reflection signal from the electrical signal, And generate one channel of image data based on the visible light reflection signal.
  • This embodiment can be applied to scenarios where the corresponding excitation light portions of the fluorescent dyes used are all in the visible light band, or both are in the near-infrared band, or part of the excitation light is in the visible light band and the rest is in the near-infrared band.
  • the multi-channel fluorescence imaging system 100 is used to obtain a user's selective instruction to determine a current output mode from a plurality of output modes of the light source assembly 110 .
  • the multiple output modes include: the corresponding excitation lights of at least two fluorescent dyes are both in the visible light band, both are in the near-infrared band, part of them is in the visible light band and the remaining part is in the near-infrared band.
  • the light source assembly 110 includes a light source host, and the user selects the required output mode through the user operation interface (touch screen, physical buttons, etc.) of the light source host.
  • the multi-channel fluorescence imaging system 100 provides users with selectable light source output modes. This method allows users to freely choose the type of fluorescent dye used without changing the product (light source), increasing flexibility. At the same time, the same set of products can also be applied to more fluorescent dye types. It is no longer necessary to design different models of products for different fluorescent dye types, which also reduces product R&D and production costs.
  • the light source assembly 110 may include a first light source, a second light source, a first filter Optical device, second optical filter and optical combiner, wherein: the first light source is used to output light in the visible light band; the second light source is used to output light in the near-infrared band; the first optical filter is used to neutralize the first light source with at least The light in the emission band corresponding to part of the two fluorescent dyes is filtered out to obtain visible light to be output; the second optical filter is used to filter out the emission band corresponding to the remaining part of the at least two fluorescent dyes in the second light source.
  • the light is filtered to obtain the near-infrared light to be output; the light combiner is used to combine the visible light to be output and the near-infrared light to be output into a beam of light to transmit to the target object through the light transmission component 120 .
  • the imaging component 130 may include a beam splitter, a third filter, a fourth filter, a first image sensor and a second image sensor, wherein the beam splitter is used to separate the reflected light and fluorescence from the light transmission component 120. It is the first light and the second light.
  • the first light includes the reflected light and the visible light component in the fluorescence.
  • the second light includes the near-infrared component in the fluorescence.
  • the third filter is used to neutralize the first light.
  • the light in the excitation band corresponding to part of the fluorescent dye is filtered to obtain the visible light to be processed; the fourth optical filter is used to filter the light in the excitation band corresponding to the remaining fluorescent dyes in the second light to obtain the near-infrared light to be processed;
  • the first image sensor is used to output a visible light signal based on the visible light to be processed;
  • the second image sensor is used to output a near-infrared light signal based on the near-infrared light to be processed;
  • the image processor 140 is used to separate the visible light reflection signal and at least one visible light signal from the visible light signal.
  • a visible light fluorescence signal is also used to obtain at least one near-infrared fluorescence signal based on the near-infrared light signal.
  • the corresponding excitation light of at least two fluorescent dyes is in the near-infrared band
  • the light source assembly 110 includes a first light source, a second light source, a first filter and a light combiner, wherein: the first light source is used to output light in the visible light band; the second light source is used to output light in the near-infrared band; the first optical filter is used to filter the light in the emission bands corresponding to the at least two fluorescent dyes in the second light source.
  • the near-infrared light to be output is obtained; the light combiner is used to combine the light output by the first light source and the near-infrared light to be output into a beam of light, so as to transmit it to the light source via the light transmission component 120 target.
  • the imaging component 130 includes a beam splitter, a second filter, a first image sensor and a second image sensor, wherein the beam splitter is used to divide the reflected light and fluorescence from the light transmission component 120 into a first path of light and a third path of light.
  • the first path of light includes reflected light
  • the second path of light includes near-infrared fluorescence
  • the second optical filter is used to filter out the light in the excitation wavelength bands corresponding to at least two fluorescent dyes in the second path of light, to obtain The near-infrared light to be processed
  • the first image sensor is used to output a visible light signal based on the reflected light
  • the second image sensor is used to output a near-infrared light signal based on the near-infrared light to be processed
  • the image processor 140 is used to obtain and Near-infrared fluorescence signals corresponding to at least two fluorescent dyes.
  • the corresponding excitation lights of at least two fluorescent dyes are in the visible light band
  • the light source assembly 110 includes a first light source, a second light source and a first filter, wherein: the first The light source is used to output light in the visible light band; the second light source is used to output light in the near-infrared band, and when the first light source is turned on, the second light source is turned off; the first filter is used to separate the first light source from at least two fluorescent dyes. The light in the corresponding emission band is filtered out to obtain visible light to be output.
  • the imaging component 130 includes a second optical filter and an image sensor, wherein: the second optical filter is used to filter the reflected light and fluorescence from the light transmission component 120 in the excitation wavelength bands corresponding to the at least two fluorescent dyes. to obtain visible light to be processed; the image sensor is configured to output a visible light signal based on the visible light to be processed; the image processor 140 is configured to separate the visible light reflection signal and the near-infrared fluorescence signal corresponding to at least two fluorescent dyes from the visible light signal.
  • the second optical filter is used to filter the reflected light and fluorescence from the light transmission component 120 in the excitation wavelength bands corresponding to the at least two fluorescent dyes. to obtain visible light to be processed
  • the image sensor is configured to output a visible light signal based on the visible light to be processed
  • the image processor 140 is configured to separate the visible light reflection signal and the near-infrared fluorescence signal corresponding to at least two fluorescent dyes from the visible light signal.
  • the multiple channel images displayed by the display 150 include visible light reflection images and fluorescent images, where the visible light reflection images and fluorescent images are displayed in a superimposed manner, and different fluorescent images correspond to fluorescent markers of different colors. , different fluorescent markers are superimposed on the visible light reflection image for display at the same time, or part of the different fluorescent markers are superimposed on the visible light reflection image for display.
  • the multiple channel images displayed by the display 150 include multiple fluorescent images, different fluorescent images correspond to fluorescent markers of different colors, and different fluorescent markers are displayed simultaneously or partially.
  • all or part of the plurality of fluorescence images can also be displayed in an overlay with at least one of the following: a laser speckle image, a narrow-band light reflection image, and an optical correlation tomography image.
  • the system 100 may further include a light source regulator assembly, which is used to control the switch of the light source assembly 110 and adjust and control the intensity of the light output by the light source assembly 110 .
  • the light source component 110 of the multi-channel fluorescence imaging system 100 can simultaneously output the corresponding excitation light of at least two fluorescent dyes, and the imaging component 130 can simultaneously receive fluorescence in different wavelength bands and convert it into electrical signals.
  • the image processor 140 separates the fluorescence signals corresponding to different fluorescent dyes from the electrical signals, and generates one channel of image data based on each fluorescence signal, so that a single image processor 140 can realize multi-channel fluorescence imaging without time sharing. .
  • the light transmission component 120 is an endoscope component.
  • the endoscope component transmits the light emitted by the light source component 110 to the tissue to be observed of the target object using fluorescent dye, and receives light from the tissue to be observed. Fluorescence.
  • the multi-channel fluorescence imaging system 100 may be called an endoscopic imaging system. The structure, operation and image presentation of the endoscopic imaging system 200 will be described below with reference to FIGS. 2 to 6 , which is referred to as a multi-channel fluorescence imaging system. A more specific example of system 100 is shown.
  • the system 200 includes: a light source module (corresponding to the light source assembly 110 described above), used to provide a white light illumination light source and a fluorescence excitation light source; an endoscopic lens (corresponding to the light transmission component 120 described above) , used to transmit illumination and excitation light; the imaging module (corresponding to the imaging component 130 mentioned above), used to collect white light reflection signals and different fluorescence video signals; the light source regulator module, adjust the intensity of white light and excitation light Control; the image processor (corresponding to the image processor 140 mentioned above), performs real-time processing of the collected video signals; the main controller, used to control the light source regulator and the image processor, and collect and process the video The signal is presented to a display device (corresponding to the display 150 described above).
  • a light source module corresponding to the light source assembly 110 described above
  • an endoscopic lens corresponding to the light transmission component 120 described above
  • the imaging module corresponding to the imaging component 130 mentioned above
  • the light source regulator module adjust the intensity of white light and excitation light Control
  • the image processor corresponding to the image
  • the light source module consists of two light sources and a filter that combines light through a light combiner.
  • the first light source and the second light source have different wavelength ranges, covering visible light wide band (400-720nm) and near-infrared narrow band (760-790nm). ), used to realize white light reflection imaging and fluorescence imaging at the same time.
  • the excitation light of the fluorescence can be part of the visible light of the first light source or the near-infrared light of the second light source.
  • the emission band of fluorescence can be the visible light band or the near-infrared band.
  • the first filter filters out the fluorescence band components in the first light source. removed, while retaining other visible light components.
  • the second filter filters out the fluorescence band components in the second light source, while retaining other near-infrared light components.
  • the light combiner combines the first and second light sources of different wavelength ranges into a beam of light, which is finally transmitted through the endoscopic lens to the tissue surface.
  • the imaging module consists of two image sensors and corresponding filters and a beam splitter.
  • the beam splitter separates the white light reflection signal and fluorescence signal collected by the endoscopic lens into two channels according to the wavelength range, namely the visible light band and the near-infrared band.
  • the specific wavelength bands are then filtered out through the third and fourth optical filters, and then transmitted to the first sensor and the second sensor respectively.
  • the first sensor collects both the reflection image of white light and the fluorescence image of the visible light band, while the second sensor only collects the fluorescence image of the near-infrared band.
  • the spectral transmission characteristics of the light source and imaging path filters, beam splitters and combiners can be seen in Figure 3.
  • multi-channel multi-fluorescence real-time intraoperative video navigation is shown in Figure 4.
  • multi-channel fluorescence imaging can be divided into the following scenarios:
  • a variety of fluorescent dyes are in the visible light band ( ⁇ 730nm), such as Fluorescein, PPIX, LUM015, MB, SGM-101, etc.; at this time, the excitation light is a visible light broad spectrum (400 ⁇ 720nm), and the corresponding fluorescence band has been Filtering, imaging is achieved through a white light sensor, and the fluorescence signal is extracted based on specific colors in the white light image.
  • a variety of fluorescent dyes are in the near-infrared band (>730nm), such as OTL-38, IRDye800, ICG, etc.; at this time, the excitation light is a near-infrared narrow spectrum (760 ⁇ 790nm), and the corresponding fluorescence band has been filtered out , imaging is achieved through a near-infrared sensor, and the fluorescence signal is extracted based on specific colors in the near-infrared image.
  • Some fluorescent dyes are in the visible light band, and some dyes are in the near-infrared band; at this time, the excitation light is visible light and near-infrared dual spectrum, the white light and near-infrared sensors image at the same time, and the fluorescence signal of each band is extracted according to the specific color of the image obtained.
  • the image presentation method of multi-channel fluorescence endoscopic imaging can be to superimpose/fuse two or more fluorescent displays on a white light image, and different fluorescent markers are distinguished by different colors (as shown in Figure 5 ), the fluorescent color can be natural visible light color or pseudo color.
  • the fluorescence of several bands can also be displayed in independent image channels, each channel corresponding to a fluorescent marker; the fluorescence of several bands can also be displayed in one image at the same time, and different fluorescent markers are distinguished by different colors (as shown in Figure 6 Show).
  • the system 200 described above is capable of imaging multiple channels of fluorescence simultaneously and can present multi-channel images.
  • multi-channel fluorescence simultaneous imaging is achieved by using excitation light of different bands and image sensors of different bands to work simultaneously, while multi-channel images are presented by superimposing/fusion of different fluorescence signals in different colors.
  • Possible design changes or deformation directions of the system 200 include:
  • This multi-channel simultaneous imaging solution is combined with a time-sharing imaging solution.
  • multiple fluorescent targets are imaged by alternately switching the excitation light source or image sensor.
  • the multi-channel simultaneous imaging method of the system 200 is utilized to achieve imaging of multiple fluorescent targets.
  • the first light source and the second light source are turned on in a time-sharing manner, and the visible light band in the first light source includes multiple excitation light bands, so multi-fluorescence imaging can also be performed.
  • This multi-target fluorescence channel image presentation method is combined with signals other than white light images, including but not limited to laser speckle imaging, narrow-band light reflection imaging, optical correlation tomography, etc.
  • the light source component of the endoscopic imaging system can simultaneously output the corresponding excitation light of at least two fluorescent dyes, and the imaging component can simultaneously receive fluorescence in different bands and convert it into electrical signals, and through the image
  • the processor separates the fluorescent signals corresponding to different fluorescent dyes from the electrical signals and generates one channel of image data based on each fluorescent signal, enabling a single image processor to achieve multi-channel fluorescence endoscopic imaging without time sharing.
  • FIG. 7 shows a schematic flow chart of the endoscopic imaging method 700 according to an embodiment of the present application. As shown in Figure 7, the endoscopic imaging method 700 may include the following steps:
  • step S710 the visible light reflected light of the tissue to be observed and the fluorescence excited by at least two fluorescent dyes by the tissue to be observed are obtained.
  • a visible light image signal is generated based on reflected light
  • a fluorescence image signal is generated based on fluorescence.
  • first image data is generated based on the visible light image signal.
  • the first image data includes image data of one channel
  • a third image signal is generated based on the fluorescence image signal.
  • Two image data, the second image data includes image data of at least two channels, and the image data of different channels in the second image data correspond to fluorescence excited by different fluorescent dyes.
  • step S730 a first image is generated based on the first image data, and a second image is generated based on the second image data; images of at least two channels in the second image are superimposed and displayed on the first image, or different channels in the second image are displayed The images are displayed superimposed on each other; wherein, images of different channels in the second image correspond to different fluorescent markers, and different fluorescent markers are displayed in different colors.
  • the endoscopic imaging method 700 realizes multi-channel fluorescence endoscopic imaging and image presentation, which superimposes/fuses two or more fluorescent displays on a white light image, and different fluorescent markers are distinguished by different colors.
  • the fluorescence color can be natural visible light color or pseudo color; it can also display several bands of fluorescence in independent image channels, each channel corresponding to a fluorescent marker; several bands of fluorescence can also be displayed in one image at the same time, Different fluorescent markers are distinguished by different colors.
  • Such an image presentation method allows users to observe different fluorescent markers and their positioning very intuitively, thereby conveniently observing multi-foci development and/or multi-tumor markers.
  • method 700 may further include (not shown): acquiring third image data, where the third image data includes at least one of the following: image data for laser speckle imaging, Image data for light reflection imaging and image data for optical correlation tomography; generating a third image based on the third image data; superimposing and displaying the image of at least one channel in the second image and the third image.
  • the overlay presentation of multi-channel fluorescence images, laser speckle images, narrow-band light reflection images, and optical correlation tomography images can also be realized, which facilitates users to conduct diagnostic evaluation by combining different images of the tissue to be tested.
  • the disclosed devices and methods can be implemented in other ways.
  • the device embodiments described above are only illustrative.
  • the division of units is only a logical function division. In actual implementation, there may be other division methods.
  • multiple units or components may be combined or integrated. to another device, or some features can be ignored, or not implemented.
  • Various component embodiments of the present application may be implemented in hardware, or in software modules running on one or more processors, or in a combination thereof.
  • a microprocessor or a digital signal processor (DSP) may be used in practice to implement some or all functions of some modules according to embodiments of the present application.
  • DSP digital signal processor
  • the present application may also be implemented as a device program (eg, computer program and computer program product) for performing part or all of the methods described herein.
  • Such a program implementing the present application may be stored on a computer-readable medium, or may be in the form of one or more signals. Such signals may be downloaded from an Internet website, or provided on a carrier signal, or in any other form.

Abstract

一种多通道荧光成像系统、内窥镜成像系统和内窥镜成像方法。多通道荧光成像系统(100)包括光源组件(110)、光传输组件(120)、成像组件(130)、图像处理器(140)和显示器(150)。光源组件(110)用于同时输出至少两种荧光染料各自对应的激发光。光传输组件(120)用于将光源组件(110)发出的光传输至使用了荧光染料的目标对象，并接收来自目标对象的荧光。成像组件(130)用于从光传输组件(120)接收荧光并生成电信号。图像处理器(140)用于从电信号中分离出至少两种荧光信号，并基于每种荧光信号生成一个通道的图像数据，其中至少两种荧光信号分别对应于至少两种荧光染料。显示器(150)用于基于图像数据显示多个通道图像中的至少一个。

Description

多通道荧光成像系统、内窥镜成像系统和内窥镜成像方法
说明书
技术领域
本申请涉及内窥成像技术领域，更具体地涉及一种多通道荧光成像系统、内窥镜成像系统和内窥镜成像方法。
背景技术
近年来，内窥镜技术的发展给外科手术微创化带来了极大便利，也加快了微创外科的普及。传统的白光反射式内窥镜可以进入不同的人体组织，以较小的手术创伤代价为医生提供可视化观察，但由于其图像分辨率及对比度等技术指标的限制，传统的内窥镜还不能对肉眼无法判别的细微病灶做甄别。荧光内窥镜技术的出现使得病灶显影和肿瘤标记成为了可能，同时还能实现淋巴定位和血管示踪。
然而，目前荧光内窥镜大多只能对单一的近红外荧光染料吲哚菁绿(ICG)进行成像，其特异性较差的特点限制了其在不同临床手术方面的应用。由于不同的荧光染料的激发和发射波段可能存在较大差别，目前现有的荧光内窥成像设备基本不能兼容多个不同波段的荧光成像。此外，目前虽有少量方案涉及多光谱荧光内窥成像，但其一般是通过调节光源激发波段或者选择滤过单一的发射波段来分别对不同的荧光染料做成像，不能做到对两种及以上不同波段荧光的同时成像，或者需要结合多种不同波长的激发光源以及成像单元才能实现多光谱成像。
发明内容
本申请一方面，提供了一种多通道荧光成像系统，所述系统包括光源组件、光传输组件、成像组件、图像处理器和显示器，其中：所述光源组件用于同时输出至少两种荧光染料各自对应的激发光；所述光传输组件用于将所述光源组件发出的光传输至使用了所述荧光染料的目标对象，并接收来自所述目标对象的荧光；所述成像组件用于从所述光传输组件接收所 述荧光并生成电信号；所述图像处理器用于从所述电信号中分离出至少两种荧光信号，并基于每种荧光信号生成一个通道的图像数据，其中所述至少两种荧光信号分别对应于所述至少两种荧光染料；所述显示器用于基于所述图像数据显示多个通道图像中的至少一个。
本申请另一方面，提供了一种内窥镜成像系统，所述内窥镜成像系统包括上述的多通道荧光成像系统，其中所述多通道荧光成像系统中的光传输组件为内窥镜组件，所述内窥镜组件将所述多通道荧光成像系统中的光源组件发出的光传输至使用了荧光染料的目标对象的待观测组织，并接收来自所述待观测组织的荧光。
本申请再一方面，提供了一种内窥镜成像方法，所述方法包括：获取待观测组织对可见光的反射光，以及所述待观测组织对至少两种荧光染料激发的荧光；基于所述反射光生成可见光图像信号，并基于所述荧光生成荧光图像信号，同时，基于所述可见光图像信号生成第一图像数据，所述第一图像数据包括一个通道的图像数据，并基于所述荧光图像信号生成第二图像数据，所述第二图像数据包括至少两个通道的图像数据，所述第二图像数据中不同通道的图像数据对应于不同荧光染料激发的荧光；基于所述第一图像数据生成第一图像，基于所述第二图像数据生成第二图像；所述第二图像中的至少两个通道的图像与所述第一图像叠加显示，或者，所述第二图像中不同通道的图像彼此叠加显示；其中，所述第二图像中不同通道的图像对应于不同的荧光标记，不同的荧光标记以不同的颜色来显示。
根据本申请实施例的多通道荧光成像系统的光源组件能够同时输出至少两种荧光染料各自对应的激发光，成像组件能够同时接收不同波段的荧光并转换为电信号，通过图像处理器将不同荧光染料对应的荧光信号从电信号中彼此分离出来，并基于每种荧光信号生成一个通道的图像数据，能够实现单个图像处理器不分时实现多通道荧光成像。
附图说明
图1示出根据本申请实施例的多通道荧光成像系统的示意性结构框图。
图2示出根据本申请实施例的多通道荧光成像系统的一个更具体示例系统的示意性结构框图。
图3示出根据本申请实施例的多通道荧光成像系统的光谱传输特性示意图。
图4示出根据本申请实施例的多通道荧光成像系统在实时术中视频导航的示意性流程图。
图5示出根据本申请实施例的多通道荧光成像系统呈现多通道荧光图像的一个示例性方式的示意图。
图6示出根据本申请实施例的多通道荧光成像系统呈现多通道荧光图像的另一个示例性方式的示意图。
图7示出本申请实施例的内窥镜成像方法的示意性流程图。
具体实施方式
为了使得本申请的目的、技术方案和优点更为明显，下面将参照附图详细描述根据本申请的示例实施例。显然，所描述的实施例仅仅是本申请的一部分实施例，而不是本申请的全部实施例，应理解，本申请不受这里描述的示例实施例的限制。基于本申请中描述的本申请实施例，本领域技术人员在没有付出创造性劳动的情况下所得到的所有其他实施例都应落入本申请的保护范围之内。
在下文的描述中，给出了大量具体的细节以便提供对本申请更为彻底的理解。然而，对于本领域技术人员而言显而易见的是，本申请可以无需一个或多个这些细节而得以实施。在其他的例子中，为了避免与本申请发生混淆，对于本领域公知的一些技术特征未进行描述。
应当理解的是，本申请能够以不同形式实施，而不应当解释为局限于这里提出的实施例。相反地，提供这些实施例将使公开彻底和完全，并且将本申请的范围完全地传递给本领域技术人员。
在此使用的术语的目的仅在于描述具体实施例并且不作为本申请的限制。在此使用时，单数形式的“一”、“一个”和“所述/该”也意图包括复数形式，除非上下文清楚指出另外的方式。还应明白术语“组成”和/或“包括”，当在该说明书中使用时，确定所述特征、整数、步骤、操作、元件和/或部件的存在，但不排除一个或更多其他的特征、整数、步骤、操作、元件、部件和/或组的存在或添加。在此使用时，术语“和/或”包括相 关所列项目的任何及所有组合。
为了彻底理解本申请，将在下列的描述中提出详细的步骤以及详细的结构，以便阐释本申请提出的技术方案。本申请的较佳实施例详细描述如下，然而除了这些详细描述外，本申请还可以具有其他实施方式。
首先，参考图1描述根据本申请实施例的多通道荧光成像系统。图1示出了根据本申请实施例的多通道荧光成像系统100的示意性结构框图。如图1所示，多通道荧光成像系统100包括光源组件110、光传输组件120、成像组件130、图像处理器140和显示器150，其中：光源组件110用于同时输出至少两种荧光染料各自对应的激发光；光传输组件120用于将光源组件110发出的光传输至使用了荧光染料的目标对象，并接收来自目标对象的荧光；成像组件130用于从光传输组件120接收荧光并生成电信号；图像处理器140用于从电信号中分离出至少两种荧光信号，并基于每种荧光信号生成一个通道的图像数据，其中至少两种荧光信号分别对应于至少两种荧光染料；显示器150用于基于图像数据显示多个通道图像中的至少一个。
在本申请的实施例中，多通道荧光成像系统100的光源组件110能够同时输出至少两种荧光染料各自对应的激发光，成像组件130能够同时接收不同波段的荧光并转换为电信号，通过图像处理器140将不同荧光染料对应的荧光信号从电信号中彼此分离出来，并基于每种荧光信号生成一个通道的图像数据，能够实现单个图像处理器140不分时实现多通道荧光成像，也即能够实现利用少数激发光源对两种及以上不同波段荧光的同时成像，不需要切换激发光源和发射波段。
在本申请的一个实施例中，光源组件110输出的光包括可见光波段的光，至少两种荧光染料各自对应的激发光均处于可见光波段。在该实施例中，光源组件110还用于从可见光波段中滤除与至少两种荧光染料各自对应的发射波段的光；光传输组件120还用于接收来自目标对象的反射光；成像组件130还用于从光传输组件120接收反射光，成像组件130所生成的电信号还基于反射光而生成；图像处理器140还用于从电信号中分离出可见光反射信号，并基于可见光反射信号生成一个通道的图像数据。该实施例可应用于所使用的荧光染料各自对应的激发光均处于可见光波段的场 景。
在本申请的另一个实施例中，光源组件110输出的光包括近红外波段的光，至少两种荧光染料各自对应的激发光均处于近红外波段。在该实施例中，光源组件110还用于从近红外波段中滤除与至少两种荧光染料各自对应的发射波段的光。该实施例可应用于所使用的荧光染料各自对应的激发光均处于近红外波段的场景。
在本申请的再一个实施例中，光源组件110输出的光包括可见光波段的光和近红外波段的光，至少两种荧光染料各自对应的激发光均处于可见光波段，或者均处于近红外波段，或者部分处于可见光波段而其余部分处于近红外波段。在该实施例中，光源组件110还用于从可见光波段和/或近红外波段中滤除与至少两种荧光染料各自对应的发射波段的光；光传输组件120还用于接收来自目标对象的反射光；成像组件130还用于从光传输组件120接收反射光，成像组件130所生成的电信号还基于反射光而生成；图像处理器140还用于从电信号中分离出可见光反射信号，并基于可见光反射信号生成一个通道的图像数据。该实施例可应用于所使用的荧光染料各自对应的激发光部分均处于可见光波段，或者均处于近红外波段，或者部分处于可见光波段而其余部分处于近红外波段的场景。
在一实施例中，多通道荧光成像系统100用于获取用户的选择性指令，以从光源组件110的多种输出模式中确定当前输出模式。该多种输出模式包括：至少两种荧光染料各自对应的激发光均处于可见光波段，均处于近红外波段，部分处于可见光波段而其余部分处于近红外波段。例如，光源组件110包括一光源主机，用户通过光源主机的用户操作界面(触摸屏、物理按键等)选择所需要的输出模式。
对于不同的荧光染料，其所需要的激发光的频段是不同的。目前，尤其是内窥镜手术，临床所采用的荧光染料的种类为限，例如ICG、MB美蓝、荧光素钠、PPIX(PDD\5-ALA)等，不同内窥镜厂家所出厂的产品都是仅适用于某几种特定的荧光染料，用户只能使用该产品所支持的荧光染料进行手术。行业中也在不断的探索新的荧光染料，未来随着荧光染料的增加，用户的选择性也会更多，以灵活的支持不同情况的手术。因此，本实施例提供的多通道荧光成像系统100，给用户提供了可选择的光源输出模 式，使得用户可以在不更换产品(光源)的情况下，随意选择所使用的荧光染料类型，增加灵活性。同时，同一套产品也可适用更多的荧光染料类型，不再需要针对不同荧光染料类型设计不同型号的产品，亦减少了产品的研发和生产成本。
在该实施例中，在一种情况下，至少两种荧光染料各自对应的激发光部分处于可见光波段而其余部分处于近红外波段，光源组件110可以包括第一光源、第二光源、第一滤光器、第二滤光器和合光器，其中：第一光源用于输出可见光波段的光；第二光源用于输出近红外波段的光；第一滤光器用于将第一光源中与至少两种荧光染料中的部分荧光染料对应的发射波段的光滤除，得到待输出可见光；第二滤光器用于将第二光源中与至少两种荧光染料中的其余部分荧光染料对应的发射波段的光滤除，得到待输出近红外光；合光器用于将待输出可见光和待输出近红外光合成一束光，以经由光传输组件120传送至目标对象。
相应地，成像组件130可以包括分光器、第三滤光器、第四滤光器、第一图像传感器和第二图像传感器，其中：分光器用于将来自光传输组件120的反射光和荧光分为第一路光和第二路光，第一路光包括反射光和荧光中的可见光成分，第二路光包括荧光中的近红外成分；第三滤光器用于将第一路光中与部分荧光染料对应的激发波段的光滤除，得到待处理可见光；第四滤光器用于将第二路光中与其余部分荧光染料对应的激发波段的光滤除，得到待处理近红外光；第一图像传感器用于基于待处理可见光输出可见光信号；第二图像传感器用于基于待处理近红外光输出近红外光信号；图像处理器140用于从可见光信号中分离出可见光反射信号和至少一种可见光荧光信号，还用于基于近红外光信号获取至少一种近红外荧光信号。
在该实施例中，在另一种情况下，至少两种荧光染料各自对应的激发光均处于近红外波段，光源组件110包括第一光源、第二光源、第一滤光器和合光器，其中：第一光源用于输出可见光波段的光；第二光源用于输出近红外波段的光；第一滤光器用于将第二光源中与至少两种荧光染料各自对应的发射波段的光滤除，得到待输出近红外光；合光器用于将第一光源输出的光和待输出近红外光合成一束光，以经由光传输组件120传送至 目标对象。
相应地，成像组件130包括分光器、第二滤光器、第一图像传感器和第二图像传感器，其中：分光器用于将来自光传输组件120的反射光和荧光分为第一路光和第二路光，第一路光包括反射光，第二路光包括近红外荧光；第二滤光器用于将第二路光中与至少两种荧光染料各自对应的激发波段的光滤除，得到待处理近红外光；第一图像传感器用于基于反射光输出可见光信号；第二图像传感器用于基于待处理近红外光输出近红外光信号；图像处理器140用于基于近红外光信号获取与至少两种荧光染料各自对应的近红外荧光信号。
在该实施例中，在再一种情况下，至少两种荧光染料各自对应的激发光均处于可见光波段，光源组件110包括第一光源、第二光源和第一滤光器，其中：第一光源用于输出可见光波段的光；第二光源用于输出近红外波段的光，且第一光源开启时第二光源关闭；第一滤光器用于将第一光源中与至少两种荧光染料各自对应的发射波段的光滤除，得到待输出可见光。
相应地，成像组件130包括第二滤光器和图像传感器，其中：第二滤光器用于将来自光传输组件120的反射光和荧光中与至少两种荧光染料各自对应的激发波段的光滤除，得到待处理可见光；图像传感器用于基于待处理可见光输出可见光信号；图像处理器140用于从可见光信号中分离出可见光反射信号和与至少两种荧光染料各自对应的近红外荧光信号。
在本申请的一个实施例中，显示器150显示的多个通道图像包括可见光反射图像和荧光图像，其中可见光反射图像和荧光图像通过叠加的方式进行显示，不同的荧光图像对应于不同颜色的荧光标记，不同的荧光标记同时叠加在可见光反射图像上进行显示，或者不同的荧光标记中部分荧光标记叠加在可见光反射图像上进行显示。
在本申请的另一个实施例中，显示器150显示的多个通道图像包括多个荧光图像，不同的荧光图像对应于不同颜色的荧光标记，不同的荧光标记同时显示或者部分显示。
在本申请的进一步的实施例中，多个荧光图像的全部或部分还能够与以下中的至少一项叠加显示：激光散斑图像、窄带光反射图像、光学相关层析图像。
在本申请的实施例中，系统100还可以包括光源调节器组件，光源调节器组件用于控制光源组件110的开关，并对光源组件110输出的光的强度进行调节控制。
基于上面的描述，根据本申请实施例的多通道荧光成像系统100的光源组件110能够同时输出至少两种荧光染料各自对应的激发光，成像组件130能够同时接收不同波段的荧光并转换为电信号，通过图像处理器140将不同荧光染料对应的荧光信号从电信号中彼此分离出来，并基于每种荧光信号生成一个通道的图像数据，能够实现单个图像处理器140不分时实现多通道荧光成像。
在本申请的实施例中，光传输组件120为内窥镜组件，内窥镜组件将光源组件110发出的光传输至使用了荧光染料的目标对象的待观测组织，并接收来自待观测组织的荧光。在该实施例中，多通道荧光成像系统100可以称为内窥镜成像系统，下面结合图2到图6描述该内窥镜成像系统200的结构、操作以及图像呈现，其作为多通道荧光成像系统100的一个更具体示例示出。
如图2所示，系统200包括：光源模块(对应于前文所述的光源组件110)，用于提供白光照明光源以及荧光激发光源；内窥镜头(对应于前文所述的光传输组件120)，用于传输照明和激发光；成像模块(对应于前文所述的成像组件130)，用于采集白光反射信号和不同的荧光视频信号；光源调节器模块，对白光与激发光的强度进行调节控制；图像处理器(对应于前文所述的图像处理器140)，对采集到视频信号进行实时处理；主控制器，用于对光源调节器及图像处理器进行控制，将采集处理后的视频信号呈现至显示设备(对应于前文所述的显示器150)。
其中，光源模块由两路光源以及滤光片通过合光器合光组成，第一光源与第二光源波长范围不同，分别覆盖可见光宽波段(400～720nm)以及近红外窄波段(760～790nm)，用于同时实现白光反射成像以及荧光成像，荧光的激发光可以是第一光源的部分可见光，也可以是第二光源的近红外光。在多光谱荧光成像时，荧光的发射波段可以是可见光波段，也可以是近红外波段。
对于可见光波段荧光，第一滤光器将第一光源中的荧光波段成分滤除 掉，而保留其他的可见光成分。而对于近红外波段荧光，第二滤光器将第二光源中的荧光波段成分滤除掉，而保留其他的近红外光成分。合光器将不同波长范围的第一和第二光源结合成一束光，最终通过内窥镜头传输照射至组织表面。
成像模块由两个图像传感器及相应的滤光器以及分光器组成，其中分光器将内窥镜头收集到的白光反射信号以及荧光信号根据波长范围分开为两路，即可见光波段以及近红外波段，随后经过第三和第四滤光器将其中的特定波段滤除，再分别传输至第一传感器与第二传感器。第一传感器既采集白光的反射图像，也采集可见光波段的荧光图像，而第二传感器只采集近红外波段的荧光图像。光源及成像路滤光器、分光器以及合光器的光谱传输特性可见图3。
多通道多荧光实时术中视频导航的具体流程如图4所示，针对荧光靶标的不同，多通道荧光成像可分为以下几种场景：
1.多种荧光染料均在可见光波段(＜730nm)，比如Fluorescein,PPIX,LUM015,MB,SGM-101等；此时，激发光为可见光宽光谱(400～720nm)，其中对应的荧光波段已经滤除，成像通过白光传感器实现，荧光信号根据白光图像中特定的颜色提取。
2.多种荧光染料均在近红外波段(＞730nm),比如OTL-38，IRDye800,ICG等；此时，激发光为近红外窄光谱(760～790nm)，其中对应的荧光波段已经滤除，成像通过近红外传感器实现，荧光信号根据近红外图像中特定的颜色提取。
3.部分荧光染料在可见光波段，部分染料在近红外波段；此时，激发光为可见光以及近红外双光谱，白光和近红外传感器同时成像，各波段荧光信号根据获得图像的特定颜色提取得到。
在本申请的实施例中，对于多通道荧光内窥成像的图像呈现方式，可以是白光图像上叠加/融合两种或以上荧光显示，不同的荧光标记以不同的颜色区分(如图5所示)，荧光颜色可以是自然可见光颜色也可以是伪彩色。另外，若干波段荧光也可以按独立的图像通道显示，每个通道对应一种荧光标记；若干波段的荧光还可以同时在一个图像中显示，不同的荧光标记以不同的颜色区分(如图6所示)。
总体地，上述系统200能够对多通道荧光同时成像且能够呈现多通道图像。其中，多通道荧光同时成像通过利用不同波段的激发光以及不同波段的图像传感器同时工作来实现，而多通道图像则是通过不同颜色来叠加/融合不同的荧光信号来呈现。该系统200可能的变更设计方向或变形方向包括：
(1)这种多通道同时成像的方案与分时成像的方案相结合，例如，通过交替切换激发光源或图像传感器来对多种荧光靶标成像，其中当切换至某一光源或图像传感器时，利用了系统200的多通道同时成像方法，来实现对多个荧光靶标成像。例如，第一光源和第二光源分时打开，第一光源中可见光波段包括多个激发光波段，因此也可以进行多荧光成像。
(2)这种多靶标荧光通道的图像呈现方式与除白光图像以外的信号相结合，包括但不限于激光散斑成像，窄带光反射成像，光学相关层析成像等。
基于上面的描述，根据本申请实施例的内窥镜成像系统的光源组件能够同时输出至少两种荧光染料各自对应的激发光，成像组件能够同时接收不同波段的荧光并转换为电信号，通过图像处理器将不同荧光染料对应的荧光信号从电信号中彼此分离出来，并基于每种荧光信号生成一个通道的图像数据，能够实现单个图像处理器不分时实现多通道荧光内窥成像。
下面结合图7描述根据本申请另一方面提供的内窥镜成像方法。图7示出了本申请实施例的内窥镜成像方法700的示意性流程图。如图7所示，内窥镜成像方法700可以包括如下步骤：
在步骤S710，获取待观测组织对可见光的反射光，以及待观测组织对至少两种荧光染料激发的荧光。
在步骤S720，基于反射光生成可见光图像信号，并基于荧光生成荧光图像信号，同时，基于可见光图像信号生成第一图像数据，第一图像数据包括一个通道的图像数据，并基于荧光图像信号生成第二图像数据，第二图像数据包括至少两个通道的图像数据，第二图像数据中不同通道的图像数据对应于不同荧光染料激发的荧光。
在步骤S730，基于第一图像数据生成第一图像，基于第二图像数据生成第二图像；第二图像中的至少两个通道的图像与第一图像叠加显示，或者，第二图像中不同通道的图像彼此叠加显示；其中，第二图像中不同通道的图像对应于不同的荧光标记，不同的荧光标记以不同的颜色来显示。
在本申请的实施例中，内窥镜成像方法700实现了多通道荧光内窥成像以及图像呈现，其在白光图像上叠加/融合两种或以上荧光显示，不同的荧光标记以不同的颜色区分，荧光颜色可以是自然可见光颜色也可以是伪彩色；其也可以将若干波段荧光按独立的图像通道显示，每个通道对应一种荧光标记；若干波段的荧光还可以同时在一个图像中显示，不同的荧光标记以不同的颜色区分。这样的图像呈现方式使得用户能够非常直观地观察到不同的荧光标记及其定位，从而便利地观测到多病灶显影和/或多肿瘤标记。
在本申请的实施例中，方法700还可以包括(未示出)：获取第三图像数据，第三图像数据包括以下中的至少一项：用于激光散斑成像的图像数据、用于窄带光反射成像的图像数据、用于光学相关层析成像的图像数据；基于第三图像数据生成第三图像；将第二图像中的至少一个通道的图像与第三图像叠加显示。在该实施例中，还可以实现多通道荧光图像与激光散斑图像、窄带光反射图像以及光学相关层析图像的叠加呈现，便于用户结合待测组织的不同图像进行诊断评估。
尽管这里已经参考附图描述了示例实施例，应理解上述示例实施例仅仅是示例性的，并且不意图将本申请的范围限制于此。本领域普通技术人员可以在其中进行各种改变和修改，而不偏离本申请的范围和精神。所有这些改变和修改意在被包括在所附权利要求所要求的本申请的范围之内。
本领域普通技术人员可以意识到，结合本文中所公开的实施例描述的各示例的单元及算法步骤，能够以电子硬件、或者计算机软件和电子硬件的结合来实现。这些功能究竟以硬件还是软件方式来执行，取决于技术方案的特定应用和设计约束条件。专业技术人员可以对每个特定的应用来使用不同方法来实现所描述的功能，但是这种实现不应认为超出本申请的范围。
在本申请所提供的几个实施例中，应该理解到，所揭露的装置和方法，可以通过其他的方式实现。例如，以上所描述的装置实施例仅仅是示意性的，例如，单元的划分，仅仅为一种逻辑功能划分，实际实现时可以有另外的划分方式，例如多个单元或组件可以结合或者可以集成到另一个装置，或一些特征可以忽略，或不执行。
在此处所提供的说明书中，说明了大量具体细节。然而，能够理解，本申请的实施例可以在没有这些具体细节的情况下实践。在一些实例中，并未详细示出公知的方法、结构和技术，以便不模糊对本说明书的理解。
类似地，应当理解，为了精简本申请并帮助理解各个发明方面中的一个或多个，在对本申请的示例性实施例的描述中，本申请的各个特征有时被一起分组到单个实施例、图、或者对其的描述中。然而，并不应将该本申请的方法解释成反映如下意图：即所要求保护的本申请要求比在每个权利要求中所明确记载的特征更多的特征。更确切地说，如相应的权利要求书所反映的那样，其发明点在于可以用少于某个公开的单个实施例的所有特征的特征来解决相应的技术问题。因此，遵循具体实施方式的权利要求书由此明确地并入该具体实施方式，其中每个权利要求本身都作为本申请的单独实施例。
本领域的技术人员可以理解，除了特征之间相互排斥之外，可以采用任何组合对本说明书(包括伴随的权利要求、摘要和附图)中公开的所有特征以及如此公开的任何方法或者装置的所有过程或单元进行组合。除非另外明确陈述，本说明书(包括伴随的权利要求、摘要和附图)中公开的每个特征可以由提供相同、等同或相似目的的替代特征来代替。
此外，本领域的技术人员能够理解，尽管在此的一些实施例包括其他实施例中所包括的某些特征而不是其他特征，但是不同实施例的特征的组合意味着处于本申请的范围之内并且形成不同的实施例。例如，在权利要求书中，所要求保护的实施例的任意之一都可以以任意的组合方式来使用。
本申请的各个部件实施例可以以硬件实现，或者以在一个或者多个处理器上运行的软件模块实现，或者以它们的组合实现。本领域的技术人员应当理解，可以在实践中使用微处理器或者数字信号处理器(DSP)来实现根据本申请实施例的一些模块的一些或者全部功能。本申请还可以实现为用于执行这里所描述的方法的一部分或者全部的装置程序(例如，计算机程序和计算机程序产品)。这样的实现本申请的程序可以存储在计算机可读介质上，或者可以具有一个或者多个信号的形式。这样的信号可以从因特网网站上下载得到，或者在载体信号上提供，或者以任何其他形式提供。
应该注意的是上述实施例对本申请进行说明而不是对本申请进行限 制，并且本领域技术人员在不脱离所附权利要求的范围的情况下可设计出替换实施例。在权利要求中，不应将位于括号之间的任何参考符号构造成对权利要求的限制。本申请可以借助于包括有若干不同元件的硬件以及借助于适当编程的计算机来实现。在列举了若干装置的单元权利要求中，这些装置中的若干个可以是通过同一个硬件项来具体体现。单词第一、第二、以及第三等的使用不表示任何顺序。可将这些单词解释为名称。
以上，仅为本申请的具体实施方式或对具体实施方式的说明，本申请的保护范围并不局限于此，任何熟悉本技术领域的技术人员在本申请揭露的技术范围内，可轻易想到变化或替换，都应涵盖在本申请的保护范围之内。本申请的保护范围应以权利要求的保护范围为准。

Claims (19)

  1. 一种多通道荧光成像系统，其特征在于，所述系统包括光源组件、光传输组件、成像组件、图像处理器和显示器，其中：
    所述光源组件用于同时输出至少两种荧光染料各自对应的激发光；
    所述光传输组件用于将所述光源组件发出的光传输至使用了所述荧光染料的目标对象，并接收来自所述目标对象的荧光；
    所述成像组件用于从所述光传输组件接收所述荧光并生成电信号；
    所述图像处理器用于从所述电信号中分离出至少两种荧光信号，并基于每种荧光信号生成一个通道的图像数据，其中所述至少两种荧光信号分别对应于所述至少两种荧光染料；
    所述显示器用于基于所述图像数据显示多个通道图像中的至少一个。
  2. 根据权利要求1所述的系统，其特征在于，所述光源组件输出的光包括可见光波段的光，所述至少两种荧光染料各自对应的激发光均处于所述可见光波段；
    所述光源组件还用于从所述可见光波段中滤除与所述至少两种荧光染料各自对应的发射波段的光；
    所述光传输组件还用于接收来自所述目标对象的反射光；
    所述成像组件还用于从所述光传输组件接收所述反射光，所述成像组件所生成的电信号还基于所述反射光而生成；
    所述图像处理器还用于从所述电信号中分离出可见光反射信号，并基于所述可见光反射信号生成一个通道的图像数据。
  3. 根据权利要求1所述的系统，其特征在于，所述光源组件输出的光包括近红外波段的光，所述至少两种荧光染料各自对应的激发光均处于所述近红外波段；
    所述光源组件还用于从所述近红外波段中滤除与所述至少两种荧光染料各自对应的发射波段的光。
  4. 根据权利要求1所述的系统，其特征在于，所述光源组件输出的光包括可见光波段的光和近红外波段的光，所述至少两种荧光染料各自对应的激发光均处于所述可见光波段，或者均处于所述近红外波段，或者部 分处于所述可见光波段而其余部分处于所述近红外波段；
    所述光源组件还用于从所述可见光波段和/或所述近红外波段中滤除与所述至少两种荧光染料各自对应的发射波段的光；
    所述光传输组件还用于接收来自所述目标对象的反射光；
    所述成像组件还用于从所述光传输组件接收所述反射光，所述成像组件所生成的电信号还基于所述反射光而生成；
    所述图像处理器还用于从所述电信号中分离出可见光反射信号，并基于所述可见光反射信号生成一个通道的图像数据。
  5. 根据权利要求4所述的系统，其特征在于，所述系统用于获取用户的选择性指令，以从所述光源组件的多种输出模式中确定当前输出模式；
    所述多种输出模式包括：所述至少两种荧光染料各自对应的激发光均处于所述可见光波段，均处于所述近红外波段，部分处于所述可见光波段而其余部分处于所述近红外波段。
  6. 根据权利要求5所述的系统，其特征在于，所述至少两种荧光染料各自对应的激发光部分处于所述可见光波段而其余部分处于所述近红外波段，所述光源组件包括第一光源、第二光源、第一滤光器、第二滤光器和合光器，其中：
    所述第一光源用于输出所述可见光波段的光；
    所述第二光源用于输出所述近红外波段的光；
    所述第一滤光器用于将所述第一光源中与所述至少两种荧光染料中的部分荧光染料对应的发射波段的光滤除，得到待输出可见光；
    所述第二滤光器用于将所述第二光源中与所述至少两种荧光染料中的其余部分荧光染料对应的发射波段的光滤除，得到待输出近红外光；
    所述合光器用于将所述待输出可见光和所述待输出近红外光合成一束光，以经由所述光传输组件传送至所述目标对象。
  7. 根据权利要求6所述的系统，其特征在于，所述成像组件包括分光器、第三滤光器、第四滤光器、第一图像传感器和第二图像传感器，其中：
    所述分光器用于将来自所述光传输组件的反射光和荧光分为第一路光和第二路光，所述第一路光包括所述反射光和所述荧光中的可见光成分， 所述第二路光包括所述荧光中的近红外成分；
    所述第三滤光器用于将所述第一路光中与所述部分荧光染料对应的激发波段的光滤除，得到待处理可见光；
    所述第四滤光器用于将所述第二路光中与所述其余部分荧光染料对应的激发波段的光滤除，得到待处理近红外光；
    所述第一图像传感器用于基于所述待处理可见光输出可见光信号；
    所述第二图像传感器用于基于所述待处理近红外光输出近红外光信号；
    所述图像处理器用于从所述可见光信号中分离出可见光反射信号和至少一种可见光荧光信号，还用于基于所述近红外光信号获取至少一种近红外荧光信号。
  8. 根据权利要求4所述的系统，其特征在于，所述至少两种荧光染料各自对应的激发光均处于所述近红外波段，所述光源组件包括第一光源、第二光源、第一滤光器和合光器，其中：
    所述第一光源用于输出所述可见光波段的光；
    所述第二光源用于输出所述近红外波段的光；
    所述第一滤光器用于将所述第二光源中与所述至少两种荧光染料各自对应的发射波段的光滤除，得到待输出近红外光；
    所述合光器用于将所述第一光源输出的光和所述待输出近红外光合成一束光，以经由所述光传输组件传送至所述目标对象。
  9. 根据权利要求8所述的系统，其特征在于，所述成像组件包括分光器、第二滤光器、第一图像传感器和第二图像传感器，其中：
    所述分光器用于将来自所述光传输组件的反射光和荧光分为第一路光和第二路光，所述第一路光包括所述反射光，所述第二路光包括近红外荧光；
    所述第二滤光器用于将所述第二路光中与所述至少两种荧光染料各自对应的激发波段的光滤除，得到待处理近红外光；
    所述第一图像传感器用于基于所述反射光输出可见光信号；
    所述第二图像传感器用于基于所述待处理近红外光输出近红外光信号；
    所述图像处理器用于基于所述近红外光信号获取与所述至少两种荧光染料各自对应的近红外荧光信号。
  10. 根据权利要求4所述的系统，其特征在于，所述至少两种荧光染料各自对应的激发光均处于所述可见光波段，所述光源组件包括第一光源、第二光源和第一滤光器，其中：
    所述第一光源用于输出所述可见光波段的光；
    所述第二光源用于输出所述近红外波段的光，且所述第一光源开启时所述第二光源关闭；
    所述第一滤光器用于将所述第一光源中与所述至少两种荧光染料各自对应的发射波段的光滤除，得到待输出可见光。
  11. 根据权利要求10所述的系统，其特征在于，所述成像组件包括第二滤光器和图像传感器，其中：
    所述第二滤光器用于将所述来自所述光传输组件的反射光和荧光中与所述至少两种荧光染料各自对应的激发波段的光滤除，得到待处理可见光；
    所述图像传感器用于基于所述待处理可见光输出可见光信号；
    所述图像处理器用于从所述可见光信号中分离出可见光反射信号和与所述至少两种荧光染料各自对应的近红外荧光信号。
  12. 根据权利要求2、4-11中的任一项所述的系统，其特征在于，所述显示器显示的多个通道图像包括可见光反射图像和荧光图像，其中所述可见光反射图像和所述荧光图像通过叠加的方式进行显示，不同的荧光图像对应于不同颜色的荧光标记，不同的荧光标记同时叠加在所述可见光反射图像上进行显示，或者不同的荧光标记中部分荧光标记叠加在所述可见光反射图像上进行显示。
  13. 根据权利要求1-11中的任一项所述的系统，其特征在于，所述显示器显示的多个通道图像包括多个荧光图像，不同的荧光图像对应于不同颜色的荧光标记，不同的荧光标记同时显示或者部分显示。
  14. 根据权利要求13所述的系统，其特征在于，所述多个荧光图像的全部或部分还能够与以下中的至少一项叠加显示：激光散斑图像、窄带光反射图像、光学相关层析图像。
  15. 根据权利要求1-11中的任一项所述的系统，其特征在于，所述光传输组件为内窥镜组件，所述内窥镜组件将所述光源组件发出的光传输至使用了所述荧光染料的目标对象的待观测组织，并接收来自所述待观测组织的荧光。
  16. 根据权利要求1-11中的任一项所述的系统，其特征在于，所述系统还包括光源调节器组件，所述光源调节器组件用于控制所述光源组件的开关，并对所述光源组件输出的光的强度进行调节控制。
  17. 一种内窥镜成像系统，其特征在于，所述内窥镜成像系统包括权利要求1-14、16中的任一项所述的多通道荧光成像系统，其中所述多通道荧光成像系统中的光传输组件为内窥镜组件，所述内窥镜组件将所述多通道荧光成像系统中的光源组件发出的光传输至使用了荧光染料的目标对象的待观测组织，并接收来自所述待观测组织的荧光。
  18. 一种内窥镜成像方法，其特征在于，所述方法包括：
    获取待观测组织对可见光的反射光，以及所述待观测组织对至少两种荧光染料激发的荧光；
    基于所述反射光生成可见光图像信号，并基于所述荧光生成荧光图像信号，同时，基于所述可见光图像信号生成第一图像数据，所述第一图像数据包括一个通道的图像数据，并基于所述荧光图像信号生成第二图像数据，所述第二图像数据包括至少两个通道的图像数据，所述第二图像数据中不同通道的图像数据对应于不同荧光染料激发的荧光；
    基于所述第一图像数据生成第一图像，基于所述第二图像数据生成第二图像；
    所述第二图像中的至少两个通道的图像与所述第一图像叠加显示，或者，所述第二图像中不同通道的图像彼此叠加显示；
    其中，所述第二图像中不同通道的图像对应于不同的荧光标记，不同的荧光标记以不同的颜色来显示。
  19. 根据权利要求18所述的方法，其特征在于，所述方法还包括：
    获取第三图像数据，所述第三图像数据包括以下中的至少一项：用于激光散斑成像的图像数据、用于窄带光反射成像的图像数据、用于光学相关层析成像的图像数据；
    基于所述第三图像数据生成第三图像；
    将所述第二图像中的至少一个通道的图像与所述第三图像叠加显示。
PCT/CN2023/095327 2022-05-20 2023-05-19 多通道荧光成像系统、内窥镜成像系统和内窥镜成像方法 WO2023222119A1 (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN2022094199 2022-05-20
CNPCT/CN2022/094199 2022-05-20

Publications (1)

Publication Number Publication Date
WO2023222119A1 true WO2023222119A1 (zh) 2023-11-23

Family

ID=88834700

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2023/095327 WO2023222119A1 (zh) 2022-05-20 2023-05-19 多通道荧光成像系统、内窥镜成像系统和内窥镜成像方法

Country Status (1)

Country Link
WO (1) WO2023222119A1 (zh)

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20090236541A1 (en) * 2008-03-24 2009-09-24 General Electric Company System and Methods for Optical Imaging
US20100036203A1 (en) * 2006-12-14 2010-02-11 Olympus Corporation Endoscope system
CN104614353A (zh) * 2015-01-28 2015-05-13 中国科学院半导体研究所 基于双通道的多光谱荧光成像显微系统和方法
CN109480776A (zh) * 2018-10-30 2019-03-19 中国科学院自动化研究所 近红外荧光手术成像系统及其使用方法
CN109864691A (zh) * 2019-04-04 2019-06-11 济南显微智能科技有限公司 一种双示踪荧光内窥镜
CN110236694A (zh) * 2019-06-04 2019-09-17 广东欧谱曼迪科技有限公司 基于光谱响应特性的同屏近红外双谱荧光成像方法及系统
CN110811498A (zh) * 2019-12-19 2020-02-21 中国科学院长春光学精密机械与物理研究所 可见光和近红外荧光3d融合图像内窥镜系统
CN212364081U (zh) * 2020-05-27 2021-01-15 苏州影睿光学科技有限公司 宽光谱荧光多通道实时显微成像系统

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20100036203A1 (en) * 2006-12-14 2010-02-11 Olympus Corporation Endoscope system
US20090236541A1 (en) * 2008-03-24 2009-09-24 General Electric Company System and Methods for Optical Imaging
CN104614353A (zh) * 2015-01-28 2015-05-13 中国科学院半导体研究所 基于双通道的多光谱荧光成像显微系统和方法
CN109480776A (zh) * 2018-10-30 2019-03-19 中国科学院自动化研究所 近红外荧光手术成像系统及其使用方法
CN109864691A (zh) * 2019-04-04 2019-06-11 济南显微智能科技有限公司 一种双示踪荧光内窥镜
CN110236694A (zh) * 2019-06-04 2019-09-17 广东欧谱曼迪科技有限公司 基于光谱响应特性的同屏近红外双谱荧光成像方法及系统
CN110811498A (zh) * 2019-12-19 2020-02-21 中国科学院长春光学精密机械与物理研究所 可见光和近红外荧光3d融合图像内窥镜系统
CN212364081U (zh) * 2020-05-27 2021-01-15 苏州影睿光学科技有限公司 宽光谱荧光多通道实时显微成像系统

Similar Documents

Publication Publication Date Title
JP6785941B2 (ja) 内視鏡システム及びその作動方法
US9992428B2 (en) Single-chip sensor multi-function imaging
US10231658B2 (en) Endoscope system, processor device for endoscope system, operation method for endoscope system, and operation method for processor device
KR101671195B1 (ko) 수술 로봇용 확대 입체 가시영상
JP6785948B2 (ja) 医療用画像処理装置及び内視鏡システム並びに医療用画像処理装置の作動方法
JP3862582B2 (ja) 蛍光画像取得方法および装置並びにプログラム
JP5496075B2 (ja) 内視鏡診断装置
JP4689767B2 (ja) 蛍光画像装置および蛍光画像装置の作動方法
JP5654167B1 (ja) 内視鏡システム及びその作動方法
JPH09327433A (ja) 胃腸および呼吸器官における特有蛍光を使用した罹病組織を検出する映像システム
US10602918B2 (en) Switching between white light imaging and excitation light imaging leaving last video frame displayed
WO2011092951A1 (ja) 画像取得装置、観察装置、および観察システム
WO2018105020A1 (ja) 内視鏡装置
JP2001137174A (ja) 蛍光画像表示方法および装置
JP2004024656A (ja) 蛍光内視鏡装置
WO2020095671A1 (ja) 画像取得システム及び画像取得方法
JPWO2014132741A1 (ja) 画像処理装置及び内視鏡システムの作動方法
WO2023222119A1 (zh) 多通道荧光成像系统、内窥镜成像系统和内窥镜成像方法
JP2007125403A (ja) 蛍光画像装置
CN111568549A (zh) 一种具有实时成像功能的可视化系统
KR102372603B1 (ko) 기능영상 제공 의료 시스템
WO2022059233A1 (ja) 画像処理装置、内視鏡システム、画像処理装置の作動方法、及び画像処理装置用プログラム

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 23807068

Country of ref document: EP

Kind code of ref document: A1