CN117084627A

CN117084627A - Multi-mode imaging system

Info

Publication number: CN117084627A
Application number: CN202210510628.0A
Authority: CN
Inventors: 朱锐
Original assignee: SHENZHEN VIVOLIGHT MEDICAL DEVICE & TECHNOLOGY CO LTD
Current assignee: SHENZHEN VIVOLIGHT MEDICAL DEVICE & TECHNOLOGY CO LTD
Priority date: 2022-05-11
Filing date: 2022-05-11
Publication date: 2023-11-21

Abstract

The application provides a multi-mode imaging system, which comprises an OCT imaging system and a fluorescence imaging system, wherein an OCT image can be acquired through the OCT imaging system, and a fluorescence image can be acquired through the fluorescence imaging system, so that the device can be switched between an OCT working mode and a fluorescence imaging mode. Meanwhile, in the fluorescence imaging process, the spectrum detection module for detecting fluorescence comprises a plurality of detection channels for filtering fluorescence with different wavelengths, and fluorescence with different wavelength ranges is detected through the detection channels, so that fluorescence images corresponding to the fluorescence with different wavelength ranges can be obtained, and the identification effect of the fluorescence with different wavelengths is improved. The multi-mode imaging system provided by the application can realize identification and recognition of biological tissues according to OCT images and fluorescent images, can improve the image detection effect of fluorescence with different wavelengths, and can improve the identification and recognition effect of different biological tissues.

Description

Multi-mode imaging system

Technical Field

The application belongs to the technical field of medical imaging equipment, and particularly relates to a multi-mode imaging system.

Background

Optical coherence tomography (optical coherence tomography, OCT) is a technique for acquiring high resolution cross-sectional images of biological tissue and can enable real-time visualization of the images. The principle of the OCT technique is to measure an image of a living tissue by using an interference optical system. At present, the identification of biological tissues by an OCT system is carried out by manually identifying and recognizing mostly by depending on the experience of medical staff, and the accuracy of the identification is greatly fluctuated by different experiences of the medical staff.

Thus, a multimode system combining OCT imaging with fluorescence imaging has a greater advantage over a single OCT imaging system. Fluorescence imaging is a technique in which a living tissue is excited by laser light to emit fluorescence, and the fluorescence is detected to obtain a fluorescence image of the living tissue, so that a medical staff can recognize the living tissue by the fluorescence image. However, the existing multimode system combining OCT imaging and fluorescence imaging still has to improve the recognition effect on the biological tissue.

Disclosure of Invention

The embodiment of the application aims to provide a multi-mode imaging system so as to solve the technical problem that a multi-mode system combining OCT imaging and fluorescence imaging in the prior art has poor identification effect on biological tissues. The accuracy of identification and recognition of biological tissues can be improved.

In a first aspect, an embodiment of the present application provides a multi-modality imaging system, including: the system comprises an OCT imaging system, a fluorescence imaging system, a control device and a display device, wherein the fluorescence imaging system comprises a spectrum detection module and a continuous spectrum light source, the continuous spectrum light source is used for providing continuous spectrum excitation light, and the continuous spectrum excitation light excites biological tissues to emit fluorescence; the spectrum detection module is provided with a plurality of detection channels, fluorescence is respectively incident to the detection channels, the detection channels respectively detect the fluorescence to obtain fluorescence in different wavelength ranges, and the fluorescence in different wavelength ranges is respectively converted to obtain a plurality of electric signals, and the different electric signals correspond to the fluorescence in different wavelength ranges; the plurality of detection channels transmit the plurality of electrical signals to a control device, the control device converts the plurality of electrical signals into a plurality of fluoroscopic images, and the display device is used for displaying the plurality of fluoroscopic images.

According to the embodiment of the application, the continuous spectrum light source is used for emitting continuous spectrum excitation light, the continuous spectrum excitation light is used for exciting the biological tissue to emit fluorescence with a wider wavelength range, then the fluorescence with the wider wavelength range emitted by the biological tissue is detected through the plurality of detection channels to respectively obtain fluorescence with different wavelength ranges, and then the fluorescence with the different wavelength ranges is converted and displayed to form a plurality of fluorescence images corresponding to the fluorescence with different wavelength ranges, so that medical staff can obtain the fluorescence images of the fluorescence with different wavelength ranges corresponding to the biological tissue, and the accuracy of identifying and identifying the biological tissue according to the fluorescence images is improved.

In a possible implementation manner of the first aspect, the plurality of detection paths includes a first detection path and a second detection path; the first detection path comprises a first filter, a first grating and a first photoelectric sensor, wherein the first filter is used for filtering fluorescence to obtain fluorescence in a first wavelength range, the fluorescence in the first wavelength range is incident to the first grating, the fluorescence in the first wavelength range is processed by the first grating and then is incident to the first photoelectric sensor, and the fluorescence in the first wavelength range processed by the first grating is converted into a first electric signal by the first photoelectric sensor; the second detection path comprises a second filter, a second grating and a second photoelectric sensor, wherein the second filter is used for filtering fluorescence to obtain fluorescence in a second wavelength range, the fluorescence in the second wavelength range is incident to the second grating, the fluorescence in the second wavelength range is processed by the second grating and then is incident to the second photoelectric sensor, and the fluorescence in the second wavelength range processed by the second grating is converted into a second electric signal by the second photoelectric sensor. In the possible implementation manner, the fluorescence in the first wavelength range is obtained through the first filter of the first detection channel, the fluorescence in the second wavelength range is obtained through the second filter, then the fluorescence in the first wavelength range and the fluorescence in the second wavelength range are processed and detected, the electric signals corresponding to the fluorescence in the first wavelength range and the fluorescence in the second wavelength range are obtained, and detection imaging of the fluorescence in the first wavelength range and the fluorescence in the second wavelength range is realized.

In a second aspect, embodiments of the present application provide a multi-modality imaging system, comprising: the system comprises an OCT imaging system, a fluorescence imaging system, a control device and a display device, wherein the fluorescence imaging system comprises a spectrum detection module, an optical switch and a discrete spectrum light source, the discrete spectrum light source is used for providing excitation light in different wavelength ranges in different time periods, the excitation light in the different wavelength ranges excites biological tissues to emit different fluorescence, the different fluorescence corresponds to the different wavelength ranges, and the different fluorescence is incident to the optical switch in the different time periods; the spectrum detection module is provided with a plurality of detection channels, the detection channels are used for detecting fluorescence in different wavelength ranges, the optical switch enables first fluorescence in the different fluorescence to be incident into a first detection channel in the detection channels in a first time period, the first fluorescence corresponds to the first wavelength range, the first detection channel filters the first fluorescence to obtain fluorescence in the first wavelength range, and the fluorescence in the first wavelength range is converted into a first electric signal; the first detection path transmits the first electric signal to the control device, the control device converts the first electric signal into a first fluorescent image, and the display device is used for displaying the first fluorescent image.

According to the embodiment of the application, the discrete spectrum light source is utilized to emit the excitation light in different wavelength ranges in different time periods, the excitation light in different wavelength ranges is utilized to excite the biological tissue to emit different fluorescence, the different fluorescence is approximately in a certain wavelength range, then the different fluorescence is detected through the spectrum detection module to obtain the fluorescence in different wavelength ranges, and the fluorescence in different wavelength ranges is detected and imaged, so that medical staff can obtain fluorescence images of the fluorescence in different wavelength ranges corresponding to the biological tissue, and the identification and recognition accuracy of the biological tissue according to the fluorescence images is improved. Meanwhile, compared with a continuous spectrum light source, the device can reduce the production cost by adopting a discrete spectrum light source, improve the utilization rate of excitation light and save electric energy.

In a third aspect, embodiments of the present application further provide a multi-modality imaging system, including: the OCT imaging system comprises a spectrum detection module, a time division multiplexer, an optical switch and a plurality of single-band light sources, wherein different single-band light sources are used for providing excitation lights in different wavelength ranges, the excitation lights in different wavelength ranges are incident to the time division multiplexer, the time division multiplexer is used for enabling the excitation lights in different wavelength ranges to be incident to biological tissues in different time periods, the excitation lights in different wavelength ranges excite the biological tissues to emit different fluorescence, the different fluorescence corresponds to different wavelength ranges, and the different fluorescence is incident to the optical switch in different time periods; the spectrum detection module is provided with a plurality of detection channels, the detection channels are used for detecting fluorescence in different wavelength ranges, the optical switch enables first fluorescence in the different fluorescence to be incident into a first detection channel in the detection channels in a first time period, the first fluorescence corresponds to the first wavelength range, the first detection channel filters the first fluorescence to obtain fluorescence in the first wavelength range, and the fluorescence in the first wavelength range is converted into a first electric signal; the first detection path transmits the first electrical signal to the control device, the control device converts the first electrical signal into a first fluorescent image, and the display device is used for displaying the first fluorescent image.

According to the embodiment of the application, the excitation light with different wavelength ranges is provided by different single-band light sources, the time division multiplexing processing is carried out on the excitation light with different wavelength ranges by the time division multiplexer, the excitation light with different wavelength ranges is utilized to excite the biological tissue to emit different fluorescence, the different fluorescence is approximately within a certain wavelength range, then the different fluorescence is detected by the spectrum detection module, the fluorescence with different wavelength ranges is obtained, and the detection imaging of the fluorescence with different wavelength ranges is carried out, so that medical staff can obtain fluorescence images of the fluorescence with different wavelength ranges corresponding to the biological tissue, and the identification and recognition accuracy of the biological tissue is improved. Meanwhile, compared with a continuous spectrum light source, the device has the advantages that the production cost of the device can be reduced by adopting a plurality of different single-band light sources, the utilization rate of excitation light can be improved, and electric energy is saved.

In a possible implementation manner of the second or third aspect, the excitation light of different wavelength ranges includes excitation light of a wavelength range of 450nm to 530nm and excitation light of a wavelength range of 650nm to 800 nm. In the possible implementation manner, the blue-green fluorescence image and the near-infrared fluorescence image of the biological tissue can be obtained by performing fluorescence imaging on the biological tissue through blue-green fluorescence excitation light with the wavelength range of 450nm to 530nm and near-infrared fluorescence excitation light with the wavelength range of 650nm to 800nm, and the recognition effect of the biological tissue according to the fluorescence image can be improved.

In another possible implementation manner of the third aspect, the control device is further configured to centrally control the optical switch and the time division multiplexer. In the possible implementation manner, the optical switch and the time division multiplexer of the device are controlled in a centralized manner through the control equipment, synchronous control of the optical switch and the time division multiplexer is convenient to realize, and the automation control degree of the device can be improved.

In one possible implementation manner of the first aspect to the third aspect, the first detection path includes a first filter, a first grating and a first photoelectric sensor, the first filter is used for filtering the first fluorescence to obtain fluorescence in a first wavelength range, the fluorescence in the first wavelength range is incident to the first grating, the fluorescence in the first wavelength range is processed by the first grating and then is incident to the first photoelectric sensor, and the fluorescence in the first wavelength range processed by the first grating is converted into the first electrical signal by the first photoelectric sensor; the plurality of detection paths further comprise a second detection path, the second detection path comprises a second filter, a second grating and a second photoelectric sensor, the second filter is used for filtering second fluorescence in different fluorescence to obtain fluorescence in a second wavelength range, the second fluorescence corresponds to the second wavelength range, the fluorescence in the second wavelength range is incident to the second grating, the second grating is used for processing the fluorescence in the second wavelength range and then is incident to the second photoelectric sensor, and the second photoelectric sensor is used for converting the fluorescence in the second wavelength range processed by the second grating into a second electric signal. In the possible implementation manner, the first fluorescence is detected through the first filter of the first detection channel to obtain fluorescence in a first wavelength range, the second fluorescence is detected through the second filter to obtain fluorescence in a second wavelength range, and then the fluorescence in the first wavelength range and the fluorescence in the second wavelength range are processed and detected to obtain electric signals corresponding to the fluorescence in the first wavelength range and the fluorescence in the second wavelength range, so that detection imaging of the fluorescence in the first wavelength range and the fluorescence in the second wavelength range is realized.

In another possible implementation manner of the first aspect to the third aspect, the first detection path further includes a first focusing lens and a second focusing lens, the fluorescent light in the first wavelength range emitted by the first filter is incident on the first focusing lens, the fluorescent light in the first wavelength range is focused by the first focusing lens and then is incident on the first grating, the fluorescent light in the first wavelength range is processed by the first grating and then is incident on the second focusing lens, and the fluorescent light in the first wavelength range processed by the first grating is focused by the second focusing lens and then is incident on the first photoelectric sensor; the second detection path further comprises a third focusing lens and a fourth focusing lens, the fluorescence in the second wavelength range emitted by the second filter sheet is incident to the third focusing lens, the fluorescence in the second wavelength range is focused by the third focusing lens and then is incident to the second grating, the fluorescence in the second wavelength range is processed by the second grating and then is incident to the fourth focusing lens, and the fluorescence in the second wavelength range processed by the second grating is focused by the fourth focusing lens and then is incident to the second photoelectric sensor. In this implementation manner, the fluorescent imaging effect of the device can be improved by focusing the first detection path through the first focusing lens and the second focusing lens and focusing the second detection path through the third focusing lens and the fourth focusing lens.

In another possible implementation manner of the first aspect to the third aspect, the first wavelength range is 530nm to 650nm, and the second wavelength range is 800nm to 900nm. In this embodiment, the detection and imaging of blue-green fluorescence having a wavelength range of 530nm to 650nm and near-infrared fluorescence having a wavelength range of 800nm to 900nm can improve the recognition effect of medical staff on biological tissues.

In one possible implementation, the device further comprises an imaging catheter, wherein the imaging catheter is used for injecting the continuous spectrum excitation light into the biological tissue, receiving fluorescence excited by the continuous spectrum excitation light from the biological tissue and injecting the fluorescence into the plurality of detection channels; alternatively, the excitation light of different wavelength ranges is incident to the imaging catheter, the imaging catheter irradiates the excitation light of different wavelength ranges to the biological tissue, receives different fluorescence emitted by the biological tissue excited by the excitation light of different wavelength ranges, and irradiates the different fluorescence to the optical switch. In the implementation mode, the imaging catheter stretches into the blood vessel to carry out fluorescence imaging on the blood vessel wall and the plaque, and images of fluorescence in different wavelength ranges are obtained, so that the recognition effect on the blood vessel wall and the plaque can be improved by applying the device.

In another possible implementation of the first to third aspects, the fluorescence emitted by the biological tissue includes NIRAF fluorescence and NIRF fluorescence. In the possible implementation manner, by detecting the NIRAF fluorescence and the NIRF fluorescence, fluorescence images of different wavelength ranges of fluorescence from different sources can be obtained, and the application range of the fluorescence images to biological tissues is improved.

The multi-mode imaging system provided by the application has the beneficial effects that: compared with the prior art, fluorescence in different wavelength ranges is detected through a plurality of detection channels, and fluorescence images corresponding to the fluorescence in different wavelength ranges are obtained, so that medical staff can recognize biological tissues according to the fluorescence images corresponding to the fluorescence in different wavelengths, and the recognition effect on the biological tissues is improved. Particularly, when the blood vessel wall and plaque on the blood vessel wall are subjected to fluorescence imaging, the plaque is identified according to fluorescence images corresponding to fluorescence in different wavelength ranges, so that the effects of fluorescence imaging and diagnosis on the blood vessel can be improved, and the medical level can be improved.

Drawings

In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings that are needed in the embodiments or the description of the prior art will be briefly described below, it being obvious that the drawings in the following description are only some embodiments of the present application, and that other drawings may be obtained according to these drawings without inventive effort for a person skilled in the art.

FIG. 1 is a schematic diagram of a system architecture of a multi-modality imaging system with a continuous spectrum light source according to an embodiment of the present application;

FIG. 2 is a schematic diagram of a spectrum detection module with a beam splitter according to an embodiment of the present application;

FIG. 3 is a schematic diagram of a control architecture of a multi-modality imaging system with discrete spectrum light sources according to another embodiment of the present application;

FIG. 4 is a schematic diagram of a spectrum sensing module with an optical switch according to another embodiment of the present application;

FIG. 5 is a schematic diagram showing the control states of a discrete spectrum light source and an optical switch according to another embodiment of the present application;

FIG. 6 is a schematic diagram of a multi-mode imaging system with multiple single-band light sources according to another embodiment of the present application;

fig. 7 is a schematic diagram of a control state of synchronous control of a multiband light source, a time division multiplexer and an optical switch according to another embodiment of the present application;

FIG. 8 is a schematic diagram illustrating a control structure of a multi-modality imaging system according to another embodiment of the present application;

wherein, each reference sign in the figure:

110-OCT light source; 121-a first light coupler; 122-a second light coupler; 131-a first circulator; 132-a second circulator; 140-imaging catheter; 141-a catheter body; 142-an imaging probe; 143-conduit coupling; 140-a collimator; 150-a mirror; 160-balanced photodetectors; 210-a fluorescent imaging light source; 211-a continuous spectrum light source; 212-discrete spectrum light source; 213-a first single band light source; 214-a second single band light source; 220-a spectrum detection module; 221-a first detection path; 221 a-first filter, 221 b-first focusing lens, 221 c-first grating, 221 d-second focusing lens; 221 e-a first linear CCD camera; 222-a second detection path; 222 a-a second filter; 222 b-a third focusing lens; 222 c-a second grating, 222 d-a fourth focusing lens; 222 e-a second linear array CCD camera; 223-beam splitter; 224-optical switch; 230-time division multiplexer; 300-a control device; 310-a display device; 400. a vessel wall; 410. plaque.

Detailed Description

In order to make the technical problems, technical schemes and beneficial effects to be solved more clear, the application is further described in detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are for purposes of illustration only and are not intended to limit the scope of the application.

It will be understood that when an element is referred to as being "mounted" or "disposed" on another element, it can be directly on the other element or be indirectly on the other element. When an element is referred to as being "connected to" another element, it can be directly connected to the other element or be indirectly connected to the other element.

It is to be understood that the terms "length," "width," "upper," "lower," "front," "rear," "left," "right," "vertical," "horizontal," "top," "bottom," "inner," "outer," and the like are merely for convenience in describing and simplifying the description based on the orientation or positional relationship shown in the drawings, and do not indicate or imply that the devices or elements referred to must have a particular orientation, be constructed and operated in a particular orientation, and thus are not to be construed as limiting the application.

Furthermore, the terms "first," "second," and the like, are used for descriptive purposes only and are not to be construed as indicating or implying a relative importance or implicitly indicating the number of technical features indicated. Thus, a feature defining "a first" or "a second" may explicitly or implicitly include one or more such feature. In the description of the present application, the meaning of "a plurality" is two or more, unless explicitly defined otherwise.

Optical coherence tomography (optical coherence tomography, OCT) imaging techniques are used to acquire high resolution cross-sectional images of biological tissue. When the imaging device based on the OCT imaging technology is used, light from an OCT imaging light source is divided into a sample light beam (also known as a measuring arm and a sample arm) and a reference light beam (also known as a reference arm) at a separator (also known as a beam splitter and a light coupler), the sample arm is reflected or scattered at a biological tissue, the reference arm is reflected at a reflecting mirror, then a light interference pattern is generated by controlling the interference between the reference arm and the sample arm, and a cross-section image of the biological tissue can be acquired by detecting the generated light interference pattern.

The infrared light with the wavelength of 700-1600 nm has less scattering and absorption phenomena when penetrating biological tissues such as skin, fat, bones and the like, so that the infrared light with the wavelength range has lower 'breakage rate' compared with visible light, and the infrared light with the wavelength of 700-1600 nm is regarded as an optical 'transparent' window of the biological tissues. Among them, OCT imaging generally uses infrared light having a wavelength of 1310nm as a light source.

Meanwhile, in the region with the wavelength of 700-1600 nm, the autofluorescence from various pigments in organisms is also greatly reduced. Thus, imaging biological tissue using fluorescence in the region of wavelengths from 700 to 1600nm is also of great advantage. Among them, near-infrared auto-fluorescence (NIRAF) imaging and near-infrared fluorescence (NIRF) imaging are two techniques for performing fluorescence imaging by using infrared light in a wavelength range of 700 to 1600 nm. NIRAF imaging and NIRF imaging irradiate biological tissue with near infrared laser light to obtain fluorescence emitted from the biological tissue, and then obtain fluorescence images of the biological tissue from the fluorescence. Here, the NIRAF imaging process and the NIRF imaging process are collectively referred to as fluoroscopic imaging, and images obtained by the NIRAF imaging and the NIRF imaging are collectively referred to as fluoroscopic images.

Currently, there are multi-modality imaging systems that combine OCT imaging with fluorescence imaging, which are devices capable of acquiring both cross-sectional images of biological tissue by OCT imaging techniques and images of biological tissue by fluorescence imaging. Although such a multi-modality imaging system can obtain images obtained by OCT imaging and fluorescence imaging, recognition of different biological tissues by the obtained OCT images and fluorescence images is still poor.

In view of the above, embodiments of the present application provide a multi-mode imaging system, which can simultaneously acquire a biological tissue image by using OCT imaging and fluorescence imaging, and acquire fluorescence in different wavelength ranges from the biological tissue during fluorescence imaging, and perform spectral detection on the fluorescence in different wavelength ranges to obtain fluorescence images corresponding to the fluorescence in different wavelength ranges of different biological tissues, and acquire OCT images of the biological tissue in combination with OCT imaging to identify the biological tissue, so as to improve accuracy of identifying the biological tissue according to the images.

In some scenes, the multi-mode imaging system of the embodiment of the application can be used for imaging the inner wall of a blood vessel to identify plaques on the wall of the blood vessel, near infrared light is used for irradiating the plaques on the inner wall of the blood vessel to excite fluorescence during fluorescence imaging, so that fluorescence emitted by different types of plaques on the inner wall of the blood vessel is detected, and fluorescence emitted by different plaques with different wavelengths is filtered through the multi-mode imaging system to obtain fluorescent images of different types of plaques on the wall of the blood vessel, so that medical staff can conveniently identify and identify the different types of plaques on the inner wall of the blood vessel, and OCT images of the side wall of the blood vessel are obtained by combining OCT imaging, so that accuracy of identifying and identifying the plaques on the inner wall of the blood vessel can be improved.

In other scenes, the multi-mode imaging system provided by the embodiment of the application can be used for acquiring fluorescent images of gland tissues in a human body, near infrared light is used for irradiating the gland tissues to excite fluorescence during fluorescent imaging, normal tissues and lesion tissues on the gland tissues emit fluorescence with different wavelengths, the fluorescence with different wavelengths can be filtered through the multi-mode imaging system, further fluorescent images respectively corresponding to the normal tissues and the lesion tissues of the gland are acquired, and simultaneously OCT images of the gland tissues are acquired by combining an OCT technology, so that the identification and recognition effects of medical staff on different tissues in the gland are facilitated.

In other scenes, the multi-mode imaging system of the embodiment of the application can be used for acquiring fluorescent images of fundus radiography, injecting contrast agent (such as sodium fluorescein) near eyes of a patient, irradiating the fundus retina with near infrared light, enabling new blood vessels of the fundus retina and leaked blood vessels to emit fluorescent light with different wavelengths, filtering and detecting the fluorescent light with different wavelength ranges through the multi-mode imaging system, acquiring fluorescent images corresponding to the new blood vessels in the fundus retina and the fluorescent light with different wavelengths of the leaked blood vessels, and simultaneously acquiring OCT images of the fundus retina by combining OCT technology, so that the accuracy of identifying and identifying the fundus retinopathy of a medical worker can be improved.

Specific details of a multi-modality imaging system of embodiments of the present application that OCT images and fluoroscopic images of plaque inside a vessel's sidewall through an imaging catheter are described below in connection with specific examples.

In use, referring to the use state of the imaging catheter 140 in fig. 1, when imaging plaque 410 in a blood vessel, the imaging catheter 140 is inserted into the blood vessel through the blood vessel wall 400, then an image of the plaque 410 on the blood vessel wall 400 is acquired through the imaging catheter 140, and then the plaque 410 is identified according to the image of the plaque 410.

As shown in the schematic structural diagram 1 of the embodiment of the present application, fig. 1 includes an OCT imaging system composed of an OCT light source 110, a first light coupler 121, a second light coupler 122, a first circulator 131, a second circulator 132, an imaging catheter 140, a collimator 140, a mirror 150, a balanced photodetector 160, a control device 300, and a display device 310, and fig. 1 also includes a fluorescence imaging system composed of a fluorescence imaging light source 210, an imaging catheter 140, a spectrum detection module 220, a control device 300, and a display device 310. Wherein the OCT imaging system and the fluoroscopic imaging system share the imaging catheter 140, the control device 300, and the display device 310 to acquire OCT images and fluoroscopic images of the biological tissue.

Specific details of OCT imaging performed by the multi-modality imaging system of embodiments of the present application are described in detail below.

As shown in the multi-modality imaging system of fig. 1, in performing OCT imaging, the OCT light source 110 is configured to output light required for OCT imaging, and the light emitted from the OCT light source 110 is incident on the first light coupler 121. Wherein OCT light source 110 may be a swept light source. The multi-mode imaging system is an OCT imaging working mode when OCT imaging is carried out.

The first light coupler 121 is configured to split light, for example, as shown in the multi-mode imaging system of fig. 1, where the first light coupler 121 may split the received light emitted from the OCT light source 110 into two light beams, i.e., a sample beam and a reference beam, the sample beam is incident into the first circulator 131, and the reference beam is incident into the collimator 150.

Wherein, as shown in the multi-modality imaging system of fig. 1, the first circulator 131 is used for branching transmission of light, and the first circulator 131 has a property of unidirectional transmission of light. As shown in the optical path of the first circulator 131 in fig. 1, the first circulator 131 has a port through which light is transmitted to the imaging conduit 140, and the sample light incident to the first circulator 131 from the first light coupler is incident into the imaging conduit 140 and irradiates the light onto the vessel wall 400 through the imaging conduit 140.

Specifically, as shown in the structure of the imaging catheter 140 in fig. 1, the imaging catheter 140 may include a catheter body 141 and an imaging probe 142, the imaging probe 142 is disposed in the catheter body 141, the catheter body 141 has a certain pushing capability and over-bending capability, and a main function of the catheter body 141 is to limit a radial movement range of the imaging probe 142 to protect a blood vessel wall. The imaging probe 142 plays a role in transmitting light beams and collecting light beams, the imaging probe 142 can be used for making light incident on biological tissues, and the imaging probe 142 can also be used for receiving light reflected by the biological tissues or emitted fluorescence. During imaging, the imaging probe 142 moves along the length of the imaging catheter 140 and rotates 360 ° along the blood vessel within the imaging catheter 140, scanning and imaging of the blood vessel can be accomplished by the imaging probe 142.

In the imaging catheter structure of some embodiments, as shown in the imaging catheter 140 structure of fig. 1, a catheter connector 143 is disposed on the imaging catheter 140, and the catheter connector 143 is used to connect the imaging probe 142 in the imaging catheter 140 with an external optical fiber to transmit light, so as to form a path for conducting light.

Meanwhile, as shown in the optical path of the first circulator 131 in fig. 1, the first circulator 131 also has a port for transmitting light to the second light coupler 122, and in OCT imaging, light irradiated to the blood vessel wall 400 or plaque 410 through the imaging catheter 140 is reflected by the blood vessel wall 400 or plaque 410 to form sample beam reflection light, the sample beam reflection light is incident into the imaging catheter 140, the sample beam reflection light is incident into the first circulator 131, and the sample beam reflection light is incident into the second light coupler 122 through the first circulator 131.

Meanwhile, as shown in the optical path in fig. 1, the reference beam emitted from the first light coupler 121 is incident into the collimator 150, the collimator 150 is used for improving the collimation degree of the light, the reference beam after the collimator 150 improves the collimation degree is incident onto the reflecting mirror 160, the reflecting mirror 160 reflects the reference beam to form the reference beam reflected light, the reference beam reflected light reflected from the reflecting mirror 160 is incident into the collimator 150 again, and the collimator 150 can improve the collimation degree of the reference beam reflected light and is emitted from the second circulator 132.

As shown in the optical path of the second circulator 132 in fig. 1, the second circulator 132 has a port through which light is incident to the second light coupler 170, so that reference beam reflected light incident to the second circulator 132 is incident into the second light coupler 122.

As shown in the optical path of the second light coupler 122 in fig. 1, the second light coupler 122 is used for combining light beams, and the reflected light of the sample beam and the reflected light of the reference beam can be combined together to form a beam of light through the second light coupler 122, so that the reflected light of the sample beam and the reflected light of the reference beam interfere to form interference light required by OCT imaging, and the interference light exits from the second light coupler 122 and then enters the balance photodetector 170.

As shown in the optical path of the balance photodetector 170 in fig. 1, in OCT imaging, the balance photodetector 170 is configured to detect an optical signal and convert the optical signal into an electrical signal, interference light of reflected light of a sample beam and reflected light of a reference beam is incident into the balance photodetector 170, the balance photodetector 170 is configured to detect the light, an electrical signal corresponding to the interference light of reflected light of the sample beam and reflected light of the reference beam is formed, and then the balance photodetector 170 outputs the electrical signal to the control device 300, and the control device 300 implements conversion of the electrical signal into an OCT image signal.

Specifically, referring to the control device 300 in fig. 1, the control device 300 may be configured with a display device 310 for displaying an image, the display device 310 having a display screen, the control device 300 outputting an OCT image signal, the display device 310 being capable of displaying the OCT image signal, so that the display device 310 is capable of displaying an OCT image of the present multi-modality imaging system in an OCT imaging operation mode in real time, so that a medical staff can view the OCT image in real time.

The OCT image obtained by the OCT working mode is a cross-sectional image of the blood vessel sidewall, so that the cross-sectional situation of the blood vessel wall 400 can be obtained, and further, a medical staff can recognize and identify the cross-sectional situation of the blood vessel wall 400, so as to obtain pathological information of the blood vessel wall 400 and the plaque 410.

Specific details of fluorescence imaging performed by the multi-modality imaging system of embodiments of the present application are described below.

As shown in the multi-modality imaging system of fig. 1, the present multi-modality imaging system is a fluorescence imaging mode of operation at the time of fluorescence imaging. In fluorescence imaging, the display device 310 is capable of displaying in real time the fluorescence image obtained by the present multi-modality imaging system in the fluorescence imaging mode of operation, such that a medical staff is capable of viewing the fluorescence image of the vessel wall 400 in real time.

In the present apparatus, when performing fluorescence imaging, the fluorescence imaging light source 210 is configured to output excitation light required for fluorescence imaging, where the excitation light is configured to excite biological tissue to emit fluorescence. For example, the fluorescence imaging light source 210 may be a near infrared light source, and the wavelength of the output near infrared light is between 700 and 1600nm, and the near infrared light can excite the vascular wall 400 and the plaque 410 to emit fluorescence. As shown in the light path diagram of fig. 1, the excitation light emitted by the fluorescent imaging light source 210 is incident into the imaging catheter 140.

When the device performs fluorescence imaging, as shown in the optical path of the multi-mode imaging system in fig. 1, excitation light is conducted through the imaging catheter 140, the excitation light is incident on the blood vessel wall 400 and the plaque 410, the blood vessel wall 400 and the plaque 410 are excited by the excitation light to emit fluorescence, the imaging catheter 140 is used for receiving and transmitting the fluorescence, the fluorescence is incident into the spectrum detection module 220 from the imaging catheter 140, and the spectrum detection module 220 is used for detecting the fluorescence.

Specifically, referring to fig. 1, in fluorescence imaging, the spectrum detection module 220 is configured to detect fluorescence and convert the fluorescence into an electrical signal corresponding to the fluorescence, the spectrum detection module 220 outputs the electrical signal to the control device 300, the control device 300 can convert the electrical signal corresponding to the fluorescence into a fluorescence image signal corresponding to the fluorescence, the fluorescence image signal is transmitted to the display device 310 through the control device, and the display device 310 can display the fluorescence image after receiving the fluorescence image signal, so as to realize real-time display of the fluorescence image, so that a medical staff can directly observe the fluorescence image of the blood vessel wall 400 and the plaque 410 in real time from the display device 310.

It should be understood that the embodiment of the present application does not limit the type of fluorescence and the manner of obtaining the fluorescence in fluorescence imaging. For example, the present apparatus may perform fluorescence imaging using fluorescence obtained by near infrared auto fluorescence (NIRAF) technique, or may perform fluorescence imaging using fluorescence obtained by near infrared fluorescence (NIRF) technique.

Since different plaques 410 on the blood vessel wall 400 react differently to excitation light of different wavelengths, i.e. different plaques 410 can be excited with fluorescence of different wavelengths. Therefore, in order to more accurately identify the plaque 410 on the blood vessel wall 400, the spectrum detection module 220 is provided with an optical device for obtaining different wavelength ranges, and the spectrum detection module 220 is used for detecting fluorescence in different wavelength ranges to obtain electric signals corresponding to the fluorescence in different wavelength ranges, the control device 300 is used for detecting the electric signals corresponding to the fluorescence to obtain fluorescent image signals in different wavelength ranges, and the display device 310 is used for displaying the fluorescent image signals in different wavelength ranges, so that a medical staff can directly observe fluorescent images corresponding to different plaques 410 on the blood vessel wall 400 from the display device 310, thereby being beneficial to identifying the plaque 410 by the medical staff.

For example, by detecting the atherosclerosis plaque on the blood vessel wall by using fluorescence with different wavelengths, different fluorescence images generated by the atherosclerosis plaque under the excitation of the excitation light with different wavelengths can be observed, and more accurate pathological information of the atherosclerosis plaque on the blood vessel wall can be obtained. The pathological information comprises the information of the development stage, the type and the like of the atherosclerosis plaque.

Specifically, as shown in fig. 2, with the structure of the spectrum detection module 220, the fluorescence emitted from the imaging catheter 140 reaches the spectrum imaging module 220, and the spectrum detection module 220 includes a first detection path 221 and a second detection path 222, that is, the fluorescence emitted from the imaging catheter 140 can enter the first detection path 221 and the second detection path 222. The first detection path 221 is configured to detect fluorescence in a first wavelength range to obtain an electrical signal corresponding to fluorescence in the first wavelength range, and the second detection path 222 is configured to detect fluorescence in a second wavelength range to obtain an electrical signal corresponding to fluorescence in the second wavelength range.

It should be understood that, the spectrum detection module 220 may further be provided with three, four or more detection paths for detecting fluorescence in different wavelength ranges, so as to obtain electrical signals corresponding to fluorescence in different wavelength ranges.

It should be noted that, the fluorescence inputted into the first detection path 221 and the second detection path 222 may be fluorescence with the same spectrum, and the fluorescence is filtered through the first detection path 221 and the second detection path 222 to obtain fluorescence with different wavelength ranges, and then the fluorescence with different wavelength ranges is detected through the first detection path 221 and the second detection path 222 to obtain a telecommunication card corresponding to the fluorescence with different wavelength ranges.

It should be noted that, the fluorescence inputted into the first detection path 221 and the second detection path 222 may be fluorescence in a wavelength range, the first detection path 221 and the second detection path 222 are used for detecting fluorescence in different wavelength ranges in decibels, and the spectrum detection module 220 may be switched between the first detection path 221 and the second detection path 222 to detect fluorescence in different wavelength ranges, so that the spectrum detection module 220 can obtain electrical signals corresponding to the fluorescence in different wavelength ranges respectively.

In the spectrum detection module of some embodiments, as illustrated by the spectrum detection module 220 illustrated in fig. 2, the first detection path 221 includes a first filter 221a, a first focusing lens 221b, a first grating 221c, a first focusing lens 221d, and a first line CCD camera 221e. When the fluorescent light from the imaging catheter 140 passes through the first detection channel 221, the fluorescent light is incident on the first filter 221a, the first filter 221a filters fluorescent light with different wavelengths, the first filter 221a can only pass fluorescent light with a first wavelength range, the fluorescent light within the first wavelength range is emitted from the first filter 221a and is incident on the first focusing lens 221b, the first focusing lens 221b is used for focusing the fluorescent light, the focused fluorescent light is emitted from the first focusing lens 221b and is incident on the first grating 221c, the first grating 221c is used for modulating the fluorescent light, the fluorescent light modulated by the first grating 221c is emitted from the first grating 221c and is incident on the second focusing lens 221d, the second focusing lens 221d is used for focusing the fluorescent light, and the light focused by the second focusing lens 221d is emitted from the second focusing lens 221d and is incident on the first linear CCD camera 221e for detection, so as to obtain an electric signal corresponding to the fluorescent light with the first wavelength range.

Subsequently, the electrical signal corresponding to the fluorescence in the first wavelength range is transmitted to the control device 300 for processing, so as to obtain a fluorescence image corresponding to the fluorescence in the first wavelength range, and the electrical signal corresponding to the fluorescence in the first wavelength range is processed in the control device 300 and displayed in the display device 310, so as to obtain a fluorescence image corresponding to the fluorescence in the first wavelength range.

Likewise, in the spectrum detection module of some embodiments, as illustrated by the spectrum detection module 220 illustrated in fig. 2, the second detection path 222 includes a second filter 222a, a third focusing lens 222b, a second grating 222c, a fourth focusing lens 222d, and a second line CCD camera 222e. When the fluorescence light from the imaging catheter 140 enters the second detection channel 222 for detection, the fluorescence light is filtered by the second filter 222a to obtain fluorescence light in a second wavelength range, the fluorescence light in the second wavelength range is firstly incident to the second filter 222a for filtering, the second filter 222a can only pass through fluorescence in the second wavelength range, fluorescence in other wavelength ranges is blocked by the second filter 222a, fluorescence in the second wavelength range obtained by filtering by the second filter 222a is emitted from the second filter 222a and is incident to the third focusing lens 222b, the third focusing lens 222b is used for focusing the fluorescence, the focused fluorescence is emitted from the third focusing lens 222b and is incident on the second grating 222c, the fluorescence modulated by the second grating 222c is emitted from the second grating 222c and is incident on the fourth focusing lens 222d, the fluorescence in the other wavelength ranges is focused by the fourth focusing lens 222d, the fluorescence is emitted from the fourth focusing lens 222d and is incident to the second linear array CCD 222e, and the fluorescence light in the second linear array CCD is detected, and the fluorescence light in the linear array can be detected by the second linear CCD array 222e.

Subsequently, the corresponding electrical signal of the fluorescence in the second wavelength range is transmitted to the control device 300 for processing, so as to obtain a fluorescence image signal corresponding to the fluorescence in the second wavelength range, the control device 300 transmits the fluorescence image signal of the fluorescence in the second wavelength range to the display device 310, and the display device 310 displays the fluorescence image signal of the fluorescence in the second wavelength range, so as to obtain a fluorescence image corresponding to the fluorescence in the second wavelength range.

The first linear array CCD camera 221e and the second linear array CCD camera 222e are photoelectric sensors, and the first linear array CCD camera 221e and the second linear array CCD camera 222e convert fluorescent light into an electric signal by detecting a spectrum of fluorescent light. Alternatively, the first and second linear CCD cameras 221e and 222e may be replaced by other types of photosensors, such as CMOS cameras, and the type of photosensors for detecting fluorescence is not limited in the embodiment of the present application.

In the spectrum detection module of some embodiments, the first wavelength range suitable for fluorescence detection may be 530nm to 650nm, and the fluorescence in 530nm to 650nm is blue-green fluorescence, so as to obtain a fluorescence image corresponding to the blue-green fluorescence.

In other embodiments of the spectral detection module, the second wavelength range suitable for fluorescence detection may be 800nm to 900nm, and the fluorescence in 800nm to 900nm may be near infrared fluorescence.

In the spectrum detection module of some embodiments, the blue-green fluorescence with the first wavelength range of 530nm to 650nm and the near-infrared fluorescence with the second wavelength range of 800nm to 900nm may be used to perform fluorescence imaging on the blood vessel wall 400 and the plaque 410, so as to obtain a blue-green fluorescence image and a near-infrared fluorescence image of the blood vessel wall 400 respectively, and clinical practice shows that when different plaques 410 on the blood vessel wall 400 are identified by combining the blue-green fluorescence image and the near-infrared fluorescence image, a more accurate identification result may be obtained, and the type of the plaque 410 may be identified more accurately.

When the spectrum detection module 220 is used to detect fluorescence of different wavelengths to obtain images of fluorescence of different wavelength ranges, the fluorescence imaging light source 210 capable of emitting fluorescence of different wavelengths is selected according to the required fluorescence of different wavelength ranges based on the principle that the fluorescence of different wavelengths can be excited by the excitation light of different wavelengths, and then the fluorescence imaging light source 210 capable of emitting fluorescence of different wavelengths is excited by the excitation light of different wavelengths to excite biological tissue to emit fluorescence of different wavelengths, so that fluorescence images corresponding to the fluorescence of different wavelengths can be obtained by detecting the fluorescence of different wavelengths.

Thus, in the fluorescence imaging system of some embodiments, when the fluorescence inputted into the first detection path 221 and the second detection path 222 is fluorescence with the same spectrum, the fluorescence imaging light source 210 may be a continuous spectrum light source, and the continuous spectrum light source may emit excitation light with a continuous spectrum, for example, the fluorescence imaging light source 210 may be a supercontinuum light source with an excitation light wavelength range of 400nm to 2400 nm.

As shown in the fluorescence imaging system in fig. 1, when the continuous spectrum light source is the fluorescence imaging light source 210, the continuous spectrum excitation light emitted from the fluorescence imaging light source 210 is incident into the imaging catheter 140, the continuous spectrum excitation light excites the blood vessel wall 400 and the plaque 410 to emit fluorescence, the imaging catheter 140 receives the fluorescence emitted from the blood vessel wall 400 and the plaque 410, and the imaging catheter 140 emits the fluorescence into the spectrum detection module 220.

As shown by the spectral detection module 220 in fig. 2, the spectral detection module 220 in fig. 2 is used to perform fluorescence imaging in conjunction with a fluorescence imaging system as in fig. 1. In order to make the fluorescence emitted from the imaging catheter 140 respectively enter the first detection channel 221 and the second detection channel 222 of the spectrum detection module 220, the fluorescence can be split by the optical beam splitter 223, the imaging catheter 140 makes the fluorescence enter the optical beam splitter 223, and the optical beam splitter 223 splits the light so that the fluorescence enters the first filter 221a of the first detection channel 221 and the second filter 222a of the second detection channel 222 after splitting, so as to realize the detection of the fluorescence in different wavelength ranges through the first detection channel 221 and the second detection channel 222.

Here, the beam splitter 223 may be replaced with other optical devices capable of splitting light such as a light coupler, and specific optical devices for splitting light are not limited herein.

Meanwhile, the imaging catheter 140 can be directly communicated with the first detection channel 221 and the second detection channel 222 through a plurality of optical fibers, namely, the fact that multiple fluorescence beams are directly incident into the first detection channel 221 and the second detection channel 222 from the imaging catheter 140 is realized.

It should be noted that, when the fluorescence imaging light source 210 uses the continuous spectrum light source 211 to perform fluorescence imaging, the cost of the multi-mode imaging system using the continuous spectrum light source is high due to the high price of the continuous spectrum light source, which affects the use cost of the multi-mode imaging system. Meanwhile, when the continuous spectrum light source is used by the fluorescence imaging light source 210, the spectrum detection module 220 directly filters the fluorescence outside the first wavelength range and the second wavelength range, so that the fluorescence outside the first wavelength range and the second wavelength range is directly wasted, and the electric energy is wasted. Accordingly, based on the above considerations of production costs and power waste, other types of fluorescent imaging light sources 210 may be considered for use to improve the economics and energy conservation effects of the present multi-modality imaging system.

For the above reasons, for the fluorescence imaging light source 210 in other embodiments, the fluorescence imaging light source 210 may be a discrete spectrum light source 212 capable of emitting excitation light of multiple wavelength ranges that are emitted from the discrete spectrum light source over different time periods. The cost of the multi-mode imaging system applying the discrete spectrum light source is lower because the price of the discrete spectrum light source is lower; and the excitation light in a specific wavelength range can be sent out more specifically, so that the utilization rate of fluorescence by the multi-mode imaging system is higher, and the energy-saving effect of the multi-mode imaging system is improved.

For example, the inside of the discrete spectrum light source 212 may specifically be two semiconductor lasers emitting in a single wavelength range, and the discrete spectrum light source 212 controls the working states of the two semiconductor lasers inside the discrete spectrum light source 212, that is, the two semiconductor lasers emitting in a single wavelength range are alternately turned on and off, that is, an effect that the discrete spectrum light source 212 can emit excitation light in multiple wavelength ranges is achieved, and the wavelength ranges of the different excitation lights are discrete, so that the discrete spectrum light source 212 can emit excitation light in different wavelength ranges in different time periods.

Specifically, as shown in the fluorescence detection system in fig. 3, when the fluorescence imaging light source 210 is the discrete spectrum light source 212, the multi-mode imaging system uses the first detection path 221 of the spectrum detection module 220 to detect and image fluorescence with a wavelength range of 530nm to 650nm, and can emit excitation light with a wavelength range of 450nm to 530nm through the fluorescence imaging light source 210, so as to obtain fluorescence with a wavelength range of 530nm to 650nm, and further obtain a blue-green fluorescence image with better effect.

Specifically, as shown in the fluorescence detection system in fig. 3, when the fluorescence imaging light source 210 is the discrete spectrum light source 212, the fluorescence imaging light source 210 can emit excitation light with a wavelength range of 650nm to 800nm to excite biological tissue to obtain fluorescence with a wavelength range of 800nm to 900nm, and further obtain a fluorescence image corresponding to the fluorescence with a wavelength range of 800nm to 900nm when the fluorescence with a wavelength range of 800nm to 900nm is detected and imaged by the second detection path 222 of the spectrum detection module 220.

For use with the above-described fluorescence imaging system in which the fluorescence imaging light source 210 is a discrete spectrum light source 212, as shown in the spectrum detection module structure of fig. 4, the spectrum detection module 220 is provided with an optical switch 224 for controlling the light path switching on the front side of the first filter 221a and the second filter 222 a. The optical switch 224 is an optical path switching device, and the optical switch 224 has ports that communicate with the first detection path 221 and the second detection path 222, respectively, and can control the fluorescent light emitted from the optical switch 224 to enter the first detection path 221 or the second detection path 222, respectively, by the optical switch 224, and further, the fluorescent light passing through the imaging catheter 140 can enter the first detection path 221 or the second detection path 222, respectively, to be detected, so that the degree of automation control of the multi-mode imaging system can be improved.

It should be appreciated that the optical switch 224 may be a mechanical optical switch, a microelectromechanical optical switch, or other forms of optical switches, and embodiments of the present application are not limited to the form of the optical switch 224.

It should be appreciated that the optical switch 224 may be configured to set different operating states according to time, for example, as shown in the operating state diagram of fig. 5, the optical switch 224 may be configured to switch to the first detection path 221 during the A1 period when fluorescence of the first wavelength range is incident from the imaging catheter 140 into the first detection path 221; and then switches to the second detection path 222 during the A2 period, at which time fluorescence of the second wavelength range is incident from the imaging catheter 140 into the second detection path 222 for detection.

Accordingly, when the fluorescence imaging light source 210 is the discrete spectrum light source 212, in order to match with the working state of the optical switch 224, the discrete spectrum light source 212 emits the excitation light with the wavelength range of 450nm to 530nm in the A1 time period, and the discrete spectrum light source 212 emits the excitation light with the wavelength range of 650nm to 800nm in the A2 time period, so as to obtain fluorescence images corresponding to fluorescence in different wavelength ranges smoothly.

It should be further noted that, to achieve the effects of controlling the production cost and saving energy, the fluorescence imaging light source 210 is not limited to the use of the discrete spectrum light source 212 described above, and a multi-mode imaging system using other types of fluorescence imaging light sources 210 will be specifically described below.

As shown in the optical path structure of fig. 6, for the purpose that the present multi-mode imaging system can detect fluorescence in different wavelength ranges by using the first detection path 221 and the second detection path 222, the fluorescence imaging light source 210 may employ a plurality of single-band light sources 213 that continuously emit excitation light in different wavelength ranges, for example, the fluorescence imaging light source 210 may include the first single-band light source 213 and the second single-band light source 214. The first single-band light source 213 and the second single-band light source 214 can respectively emit excitation light within a specific wavelength range, and the excitation light within a plurality of wavelength ranges can excite the biological tissue to emit fluorescence within different wavelength ranges.

In order to cooperate with the fluorescence imaging light source 210 including the first single-band light source 213 and the second single-band light source 214, by disposing the time division multiplexer 230 between the fluorescence imaging light source 210 and the imaging catheter 140, the excitation light emitted from the first single-band light source 213 and the second single-band light source 214 is incident into the time division multiplexer 230, and the time division multiplexer 230 can control the excitation light in different wavelength ranges emitted by the first single-band light source 213 and the second single-band light source 214 to pass through the time division multiplexer 230 in different time periods, that is, can control the passing state of the excitation light emitted by the fluorescence imaging light source 210 by controlling the working state of the time division multiplexer 230, and then, the excitation light in different wavelength ranges is incident into the imaging catheter 140 by the time division multiplexer 230 for fluorescence imaging.

Here, the time division multiplexer 230 is a time-division multiplexing (TDM) device, which can transmit different signals at different time periods of the same physical connection, so as to achieve multiplexing. Here, the time division multiplexer 230 uses time as a parameter for dividing the optical signals, and processes each optical signal into optical signals that do not overlap each other on a time axis, that is, an optical signal path from the first single-band light source 213 and the second single-band light source 214 to the imaging catheter 140 through the time division multiplexer 230 is divided into a plurality of time periods with a sequence on the time axis in time sequence, and then excitation light in different wavelength ranges is incident to the imaging catheter 140 in the time periods, so as to achieve the purpose of not interfering each other when fluorescence imaging is performed by the excitation light in different wavelength ranges.

Meanwhile, in order to detect fluorescence of different wavelength ranges excited by excitation light of different wavelength ranges in different time periods from the time division multiplexer 230, switching of the first detection path 221 and the second detection path 222 is also controlled by the optical switch 224. As shown in the optical path structure of the spectrum detection module 220 in fig. 4, the optical switch 224 has ports respectively communicating with the first detection path 221 and the second detection path 222, and the optical switch 224 can control the fluorescent light emitted from the optical switch 224 to be respectively incident on the first detection path 221 or the second detection path 222, so that the fluorescent light passing through the imaging catheter 140 can be respectively introduced into the first detection path 221 or the second detection path 222 for detection.

A specific procedure for fluorescence imaging by controlling excitation light of different wavelength ranges by the time division multiplexer 230 will be described below.

When the time division multiplexer 230 controls fluorescence imaging by using excitation light of 450 nm-530 nm, the specific control process is as follows: the first single-band light source 213 continuously emits excitation light with a wavelength of 450nm to 530nm, the second single-band light source 214 continuously emits excitation light with a wavelength of 650nm to 800nm, the excitation light with a wavelength of 450nm to 530nm and the excitation light with a wavelength of 650nm to 800nm are all incident to the time division multiplexer 230, the time division multiplexer 230 controls the excitation light with a wavelength of 450nm to 530nm to pass through the time division multiplexer 230 in a first period, and makes the excitation light with a wavelength of 650nm to 800nm unable to pass through the time division multiplexer 230 in the first period, the time division multiplexer 230 is in a first state, the optical switch 224 switches the spectrum detection module 220 to the first detection path 221, excitation light with the wavelength of 450-530 nm is emitted from the time division multiplexer 230 and is incident into the imaging catheter 140, the excitation light with the wavelength of 450-530 nm emitted from the imaging catheter 140 is incident on the blood vessel wall 400 and the plaque 410, the blood vessel wall 400 and the plaque 410 are excited to emit fluorescence with the wavelength range of about 530-650 nm, the imaging catheter 140 receives the fluorescence with the wavelength range of about 530-650 nm, the fluorescence is incident into the first detection channel 221 of the spectrum detection module 220 through the imaging catheter 140, the stray light is filtered and removed through the first detection channel 221, the detection is performed through the first detection channel 221, and then fluorescence imaging is performed on the fluorescence with the wavelength range of 530-650 nm, namely the purpose of fluorescence imaging through the first detection channel 221 is achieved.

Similarly, when the time division multiplexer 230 controls fluorescence imaging using 650nm to 800nm excitation light, the specific control process is: the first single-band light source 213 continuously emits excitation light with a wavelength of 450nm to 530nm, the second single-band light source 214 continuously emits excitation light with a wavelength of 650nm to 800nm, both the excitation light with a wavelength of 450nm to 530nm and the excitation light with a wavelength of 650nm to 800nm are incident to the time division multiplexer 230, the time division multiplexer 230 controls the excitation light with a wavelength of 650nm to 800nm to pass through the time division multiplexer 230 in a second period of time, and makes the excitation light with a wavelength of 450nm to 530nm unable to pass through the time division multiplexer 230 in a second period of time, at this time, the time division multiplexer 230 is in a second state, at this time, the optical switch 224 switches the spectrum detection module 220 to the second detection path 222, excitation light with the wavelength of 650-800 nm is emitted from the time division multiplexer 230 and is incident into the imaging catheter 140, the excitation light with the wavelength of 650-800 nm emitted from the imaging catheter 140 is incident on the blood vessel wall 400 and the plaque 410, the blood vessel wall 400 and the plaque 410 are excited to emit fluorescence with the wavelength range of about 800-900 nm, the imaging catheter 140 receives the fluorescence with the wavelength range of about 800-900 nm, and the fluorescence is incident into the second detection passage 222 of the spectrum detection module 220 through the imaging catheter 140, the first detection passage 221 is used for filtering and removing stray light, the first detection passage 221 is used for detecting, and then fluorescence imaging is carried out on the fluorescence with the wavelength range of 800-900 nm, namely the purpose of fluorescence imaging through the first detection passage 221 is achieved.

As shown in the working state schematic diagram of fig. 7, when performing fluorescence imaging, the first single-band light source 213 continuously emits excitation light of 450nm to 530nm, the second single-band light source 214 continuously emits excitation light of 650nm to 800nm, the time division multiplexer 230 switches to the first state in the A1 time period, at this time, the excitation light with the wavelength of 450nm to 530nm enters the imaging catheter 140, and the optical switch 224 also switches to the first detection path 221 in the A1 time period, so as to realize detection of fluorescence excited by the excitation light with the wavelength of 650nm to 800 nm; subsequently, the time division multiplexer 230 is switched to the second state in the A2 period, and at this time, the excitation light with the wavelength of 650nm to 800nm enters the imaging catheter 140, and the optical switch 224 is also switched to the second detection path 222 in the A2 period, so as to realize detection of fluorescence excited by the excitation light with the wavelength of 650nm to 800 nm.

Specifically, the time division multiplexer 230 may divide the optical signal path from the time division multiplexer 230 to the imaging catheter 140 into time periods of millisecond (for example, 5 milliseconds), and provide the time periods to the first detection path 221 and the second detection path 222 of the fluorescence imaging system, respectively, so that the fluorescence imaging system of the multi-modality imaging system can obtain fluorescence images corresponding to fluorescence in the wavelength ranges corresponding to the first detection path 221 and the second detection path 222, respectively.

In the control manner of some embodiments, in order to better directly control the optical switch 223 and control the optical switch 223 to perform synchronous control with the time division multiplexer 230, as shown in the control structure of fig. 7, the control device 300 is respectively in control connection with the optical switch 224 and the time division multiplexer 230, and then the control device 300 controls the time division multiplexer 230 and the optical switch 224 to perform synchronous operation. The control process is specifically as follows: when the control device 300 controls the time division multiplexer 230 to switch to the first state in the first period, the control device 300 controls the optical switch 224 to switch to the first detection path 221 for fluorescence detection of the first wavelength range; when the control device 300 controls the time division multiplexer 230 to be in the second state for the second period, the control device 300 controls the optical switch 223 to switch to the second detection path 222 for fluorescence detection of the second wavelength range.

In some embodiments, in order to improve the automation control degree of the device, the control device 300 may be further connected to the OCT light source 110, the fluorescent imaging light source 210, the first linear array CCD camera 221e, the second linear array CCD camera 222e, and the balanced photodetector 170 in a control manner, so that the control device 300 directly controls the working states of the OCT light source 110, the fluorescent imaging light source 210, the first linear array CCD camera 221e, the second linear array CCD camera 222e, and the balanced photodetector 170, to implement centralized automatic control on the multi-mode imaging system.

For example, when the control device 300 controls the present apparatus to operate in the OCT operation mode, the control device 300 controls the fluorescent imaging light source 210, the first linear array CCD camera 221e, and the second linear array CCD camera 222e to be turned off, controls the OCT light source 110 and the balance photodetector 170 to be turned on, and OCT imaging is performed by the present multi-mode imaging system.

For another example, when the control device 300 controls the apparatus to operate in the fluorescence imaging working mode, the control device 300 controls the fluorescence imaging light source 210, the first linear array CCD camera 221e and the second linear array CCD camera 222e to be turned on, and controls the OCT light source 110 and the balance photodetector 170 to be turned off through the control device 300, and the control device 300 controls the time division multiplexer 230 to switch the apparatus into an optical path formed by the fluorescence imaging light source 210, the time division multiplexer 230, the imaging catheter 140 and the spectrum detection module 220, so as to perform fluorescence imaging. The fluorescence detection process of different wavelength ranges by the spectrum detection module 220 has been described in detail in the foregoing process of synchronous control of the optical switch 224 and the time division multiplexer 230, and will not be described herein.

For another example, when the control device 300 controls the device to perform OCT imaging and fluorescence imaging simultaneously, the control device 300 can control the device to switch between the fluorescence imaging working state and the OCT imaging working state, so that the device can obtain the OCT image of the biological tissue and the fluorescence image corresponding to fluorescence in different wavelength ranges simultaneously, and the recognition effect on the biological tissue can be improved.

The foregoing description of the preferred embodiments of the application is not intended to be limiting, but rather is intended to cover all modifications, equivalents, and alternatives falling within the spirit and principles of the application.

Claims

1. A multi-modality imaging system comprising: OCT imaging system, fluorescence imaging system, control device and display device, its characterized in that: the fluorescence imaging system comprises a spectrum detection module and a continuous spectrum light source, wherein the continuous spectrum light source is used for providing continuous spectrum excitation light, and the continuous spectrum excitation light excites biological tissues to emit fluorescence;

the spectrum detection module is provided with a plurality of detection channels, the fluorescence is respectively incident to the detection channels, the detection channels respectively detect the fluorescence to obtain fluorescence in different wavelength ranges, the fluorescence in the different wavelength ranges is respectively converted to obtain a plurality of electric signals, and the different electric signals correspond to the fluorescence in the different wavelength ranges;

the plurality of detection channels transmit the plurality of electrical signals to the control device, the control device converts the plurality of electrical signals into a plurality of fluorescence images, and the display device is used for displaying the plurality of fluorescence images.

2. The multi-modality imaging system of claim 1, wherein: the plurality of detection paths includes a first detection path and a second detection path;

the first detection path comprises a first filter, a first grating and a first photoelectric sensor, wherein the first filter is used for filtering the fluorescence to obtain fluorescence in a first wavelength range, the fluorescence in the first wavelength range is incident to the first grating, the fluorescence in the first wavelength range is processed by the first grating and then is incident to the first photoelectric sensor, and the fluorescence in the first wavelength range after being processed by the first grating is converted into a first electric signal by the first photoelectric sensor;

the second detection path comprises a second filter, a second grating and a second photoelectric sensor, wherein the second filter is used for filtering the fluorescence to obtain fluorescence in a second wavelength range, the fluorescence in the second wavelength range is incident to the second grating, the fluorescence in the second wavelength range is processed by the second grating and then is incident to the second photoelectric sensor, and the fluorescence in the second wavelength range processed by the second photoelectric sensor is converted into a second electric signal.

3. A multi-modality imaging system comprising: OCT imaging system, fluorescence imaging system, control device and display device, its characterized in that: the fluorescence imaging system comprises a spectrum detection module, an optical switch and a discrete spectrum light source, wherein the discrete spectrum light source is used for providing excitation light in different wavelength ranges in different time periods, the excitation light in the different wavelength ranges excites biological tissues to emit different fluorescence, the different fluorescence corresponds to the different wavelength ranges, and the different fluorescence is incident to the optical switch in the different time periods;

the spectrum detection module is provided with a plurality of detection channels, the detection channels are used for detecting fluorescence in different wavelength ranges, the optical switch enables first fluorescence in the different fluorescence to be incident into a first detection channel in the detection channels in a first time period, the first fluorescence corresponds to a first wavelength range, the first detection channel filters the first fluorescence to obtain fluorescence in the first wavelength range, and the fluorescence in the first wavelength range is converted into a first electric signal;

the first detection path transmits the first electric signal to the control device, the control device converts the first electric signal into a first fluorescent image, and the display device is used for displaying the first fluorescent image.

4. A multi-modality imaging system comprising: OCT imaging system, fluorescence imaging system, control device and display device, its characterized in that: the fluorescence imaging system comprises a spectrum detection module, a time division multiplexer, an optical switch and a plurality of single-band light sources, wherein different single-band light sources are used for providing excitation light in different wavelength ranges, the excitation light in different wavelength ranges is incident to the time division multiplexer, the time division multiplexer is used for enabling the excitation light in different wavelength ranges to be incident to biological tissues in different time periods, the excitation light in different wavelength ranges excites the biological tissues to emit different fluorescence, the different fluorescence corresponds to the different wavelength ranges, and the different fluorescence is incident to the optical switch in different time periods;

The first detection path transmits the first electric signal to the control device, the control device converts the first electric signal into a first fluorescence image, and the display device is used for displaying the first fluorescence image.

5. The multi-modality imaging system of claim 3 or 4, wherein: the excitation light of different wavelength ranges comprises the excitation light of which the wavelength range is 450-530 nm and the excitation light of which the wavelength range is 650-800 nm.

6. The multi-modality imaging system of claim 3 or 4, wherein: the first detection path comprises a first filter, a first grating and a first photoelectric sensor, wherein the first filter is used for filtering the first fluorescence to obtain fluorescence in a first wavelength range, the fluorescence in the first wavelength range is incident to the first grating, the fluorescence in the first wavelength range is processed by the first grating and then is incident to the first photoelectric sensor, and the fluorescence in the first wavelength range after being processed by the first grating is converted into a first electric signal by the first photoelectric sensor;

the plurality of detection channels further comprise a second detection channel, the second detection channel comprises a second filter, a second grating and a second photoelectric sensor, the second filter is used for filtering second fluorescence in different fluorescence to obtain fluorescence in a second wavelength range, the second fluorescence corresponds to the second wavelength range, the fluorescence in the second wavelength range is incident to the second grating, the second grating is used for processing the fluorescence in the second wavelength range and then is incident to the second photoelectric sensor, and the second photoelectric sensor is used for converting the fluorescence in the second wavelength range processed by the second grating into a second electric signal.

7. The multi-modality imaging system of claim 2 or 6, wherein: the first detection path further comprises a first focusing lens and a second focusing lens, the fluorescent light in the first wavelength range emitted by the first filter sheet is incident to the first focusing lens, the fluorescent light in the first wavelength range is focused by the first focusing lens and then is incident to the first grating, the fluorescent light in the first wavelength range is processed by the first grating and then is incident to the second focusing lens, and the fluorescent light in the first wavelength range processed by the first grating is focused by the second focusing lens and then is incident to the first photoelectric sensor;

the second detection path further comprises a third focusing lens and a fourth focusing lens, the fluorescence in the second wavelength range emitted by the second filter sheet is incident to the third focusing lens, the fluorescence in the second wavelength range is focused by the third focusing lens and then is incident to the second grating, the fluorescence in the second wavelength range is processed by the second grating and then is incident to the fourth focusing lens, and the fluorescence in the second wavelength range processed by the second grating is focused by the fourth focusing lens and then is incident to the second photoelectric sensor.

8. The multi-modality imaging system of claim 2 or 6, wherein: the first wavelength range is 530 nm-650 nm, and the second wavelength range is 800 nm-900 nm.

9. The multi-modality imaging system of any of claims 1 to 7, wherein: the imaging catheter is used for making the continuous spectrum excitation light incident on the biological tissue, receiving the fluorescence emitted by the biological tissue excited by the continuous spectrum excitation light and making the fluorescence incident on the detection channels;

or,

the imaging catheter is used for making the excitation light in different wavelength ranges incident to the biological tissue, receiving different fluorescence emitted by the biological tissue and excited by the excitation light in different wavelength ranges, and making the different fluorescence incident to the optical switch.

10. The multi-modality imaging system of any of claims 1 to 7, wherein: the fluorescence emitted by the biological tissue comprises: NIRAF fluorescence and NIRF fluorescence.