CN111419149A - Multi-mode endoscope and endoscopic imaging system - Google Patents

Multi-mode endoscope and endoscopic imaging system Download PDF

Info

Publication number
CN111419149A
CN111419149A CN202010175481.5A CN202010175481A CN111419149A CN 111419149 A CN111419149 A CN 111419149A CN 202010175481 A CN202010175481 A CN 202010175481A CN 111419149 A CN111419149 A CN 111419149A
Authority
CN
China
Prior art keywords
imaging
endoscope
ultrasonic
signal
optical
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202010175481.5A
Other languages
Chinese (zh)
Inventor
戴翠霞
杜奉献
孔瑞明
邱锐
高磊
葛坚坚
董柏文
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shanghai Institute of Technology
Original Assignee
Shanghai Institute of Technology
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shanghai Institute of Technology filed Critical Shanghai Institute of Technology
Priority to CN202010175481.5A priority Critical patent/CN111419149A/en
Publication of CN111419149A publication Critical patent/CN111419149A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B1/00Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
    • A61B1/005Flexible endoscopes
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B1/00Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
    • A61B1/00131Accessories for endoscopes
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B1/00Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
    • A61B1/012Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor characterised by internal passages or accessories therefor
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B1/00Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
    • A61B1/04Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor combined with photographic or television appliances
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/0059Measuring for diagnostic purposes; Identification of persons using light, e.g. diagnosis by transillumination, diascopy, fluorescence
    • A61B5/0062Arrangements for scanning
    • A61B5/0066Optical coherence imaging
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/0059Measuring for diagnostic purposes; Identification of persons using light, e.g. diagnosis by transillumination, diascopy, fluorescence
    • A61B5/0071Measuring for diagnostic purposes; Identification of persons using light, e.g. diagnosis by transillumination, diascopy, fluorescence by measuring fluorescence emission
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B8/00Diagnosis using ultrasonic, sonic or infrasonic waves
    • A61B8/08Detecting organic movements or changes, e.g. tumours, cysts, swellings
    • A61B8/0833Detecting organic movements or changes, e.g. tumours, cysts, swellings involving detecting or locating foreign bodies or organic structures

Abstract

The present invention relates to a multi-modal endoscope and endoscopic imaging system, which combines ultrasonic imaging, optical coherence tomography, fluorescence imaging and electronic endoscopic imaging, and has an imaging optical system and an imaging element, which is inserted into the alimentary tract (esophagus, stomach, duodenum, large intestine) or respiratory tract (trachea, bronchus) of a subject to be examined, and can image the alimentary tract and the respiratory tract; the device is provided with an optical coherent imaging device and a fluorescence imaging device which have different imaging principles, are respectively in signal connection with an image processing device, and are combined by a wavelength division multiplexer to be used as a fluorescence imaging system, so that medical images of tissues and organs can be acquired by combining the advantages of various imaging devices, and more accurate tomograms of the tissues and organs are captured. Compared with the prior art, the invention can provide a multi-mode imaging endoscope and an endoscopic system with excellent performance.

Description

Multi-mode endoscope and endoscopic imaging system
Technical Field
The invention relates to the technical field of medical instruments, in particular to a multi-mode endoscope and an endoscopic imaging system.
Background
In recent years, the continuous development of new imaging techniques has provided new tools for early diagnosis of diseases, including endoscopic ultrasound imaging, optical coherence tomography, fluorescence imaging, confocal imaging, and the like.
An ultrasonic Endoscope (EUS) is a medical device that integrates ultrasonic waves and an endoscope. After the bending portion of the ultrasonic endoscope is inserted into the human body, the internal organs are tomographic-scanned by the endoscope probe at the distal end portion, and an ultrasonic image of the internal organs is obtained. Because the detection depth of ultrasonic imaging is very deep, the ultrasonic endoscope plays an important role in diagnosis and treatment of endoscope rooms in domestic large hospitals.
Optical Coherence Tomography (OCT) has several features including high resolution, no contact, and no damage. Endoscopic OCT (Endoscopic OCT, E-OCT) is used as an important branch of OCT technology, light is guided to an organ tissue to be measured through a probe, the defect of limited light penetration depth can be overcome, a high-resolution tomographic image of organ depth in a human body is obtained, and early treatment of diseases is realized through research of tissue morphology.
Fluorescence Imaging (Fluorescence Imaging) is a linear relationship between the intensity of a Fluorescence signal emitted from a fluorescent substance after excitation and the amount of fluorescein in a certain range. Fluorescence is a molecule with high specificity, and the structure and the components of tissues can be simultaneously analyzed by combining fluorescence imaging and OCT, so that an accurate imaging means can be provided for early pancreaticobiliary tract lesions. However, there is currently no development of OCT/fluorescence endoscopic imaging for early lesions of organs.
In conclusion, for the diagnosis of early diseases in vivo, the clinical requirements in the aspects of body, tomography, high resolution and imaging depth are combined. By combining the characteristics of each imaging technology, it is important to provide a multi-modal endoscope and imaging system.
Chinese patent CN201910378525.1 provides an endoscope that can suppress breakage of optical fibers and is excellent in mountability and operability. The endoscope includes a light guide that guides illumination light generated by the light source device from the light source device to a distal end portion of an insertion portion of the endoscope through an operation portion of the endoscope through an inside of the endoscope. This design allows real-time imaging, but fails to provide multi-modality imaging and thus provides more accurate tomographic imaging of the tissue organ.
Disclosure of Invention
The present invention is directed to overcoming the above-mentioned drawbacks of the prior art and providing a multi-modal endoscope and an endoscopic imaging system.
The purpose of the invention can be realized by the following technical scheme:
a multi-modality endoscope, comprising:
the inserting part is used for converting the optical signal into an electric signal, transmitting the signal to the connecting part through a signal wire after receiving the electric signal, and displaying the transmitted electric signal after image processing in the electronic endoscope system device;
the insertion part comprises a front end part, a bending part and a flexible tube part which are sequentially arranged, wherein the front end part comprises ultrasonic transducers which are arranged in a side row and are used for being connected with an ultrasonic endoscopic imaging device through a signal line, a probe, an optical focusing module which is used for being connected with an OCT imaging observation device through an optical fiber, an image pickup element used for receiving optical signals and a treatment instrument channel used for placing a biopsy forceps and other therapeutic instruments;
an operation section for performing air supply, water supply, and negative pressure suction operations to the distal end portion of the insertion section, performing a bending operation to the bending portion of the insertion section, and controlling the treatment instrument to be conveyed to the body cavity through the treatment instrument channel;
a connecting portion for connecting the insertion portion with the electronic endoscope system device.
Furthermore, the front end part is a top end hard structure, and the plurality of ultrasonic transducers are arranged on the outer surface of the front end part of the hard structure in a side-to-side array mode.
Further, the insertion portion further includes an illumination window and a single mode optical fiber for transmitting light to the illumination window for illumination.
Further, the operation portion is provided on the proximal end side of the insertion portion, and the operation portion includes a bending knob for bending the bending portion, an air supply/water supply tube for supplying air and water to the distal end portion of the insertion portion, a negative pressure suction tube for sucking excess liquid at the distal end portion of the insertion portion through the inside of the endoscope, and a treatment instrument insertion port for connecting to a treatment instrument channel of the operation portion.
The probe includes the illumination window for holding illumination in a forward view, an end portion negative pressure suction device window for sucking out an unnecessary liquid tube, a water supply/air supply window for holding an end portion of a water supply tube and for holding an end portion of an air supply tube, a treatment instrument channel window for holding an end portion of a treatment instrument channel and communicating with a treatment instrument insertion port, and an imaging device observation window for data transmission of an electronic endoscope device.
The optical focusing module is a hemispherical focusing ball lens, a gold-plated reflecting film is arranged on the horizontal bottom surface of the hemispherical focusing ball lens, the horizontal bottom surface and the axial direction of the optical fiber form an angle of 45 degrees, and other parts of the hemispherical focusing ball lens except the horizontal bottom surface are fused with the multimode optical fiber.
The image pickup element converts the received optical signal into an electric signal, transmits the electric signal to the electronic endoscope imaging device through a signal line, and then displays the electric signal through the image processing device.
A multi-modality endoscopic imaging system, the system comprising:
the multi-modal endoscope;
the image processing device is respectively in signal connection with the OCT imaging observation device, the fluorescence imaging device and the ultrasonic imaging device, and is used for outputting a control signal according to the operation of a user and generating a multi-mode image of the tissue organ according to the received feedback signal;
the ultrasonic imaging device is connected with an ultrasonic transducer of the multi-mode endoscope through a signal line and used for outputting an ultrasonic control signal according to the control signal, so that the ultrasonic transducer emits ultrasonic waves to a sample tissue to be detected and converts the returned feedback ultrasonic waves into ultrasonic feedback signals;
the OCT imaging observation device is connected with the hemispherical focusing ball lens through an optical fiber and used for outputting an optical signal according to a control signal, and the optical signal reaches the tissue of the sample to be detected through the hemispherical focusing ball lens and receives an optical signal fed back by the collected tissue of the sample to be detected;
the fluorescence imaging observation device forms a fluorescence imaging system by utilizing the wavelength division multiplexer and the OCT imaging observation device and is used for integrating an optical coherent imaging sample arm light source and a fluorescence excitation light source into the same single-mode broadband optical fiber light path;
and the electronic endoscope system device is connected with the insertion part of the multi-mode endoscope and is used for carrying out image processing and displaying on the electric signal transmitted back by the insertion part.
Furthermore, the multi-mode endoscopic imaging system adopts the double-clad fiber coupler to collect the emitted light, and adopts semiconductor laser as an excitation light source for fluorescence imaging.
Furthermore, the OCT imaging observation device adopts a high-speed VECSE L light source, and the fluorescence imaging system adopts a 680-750nm waveband of semiconductor adjustable laser as an excitation light source.
Compared with the prior art, the invention has the following advantages:
1) the multimode endoscopic imaging system is provided with a first optical imaging device, namely an optical coherent imaging device and a second optical imaging device, namely a fluorescence imaging device, which have different imaging principles, wherein compared with other technologies, the optical coherent imaging technology has non-invasion and high resolution and can detect the internal microstructure of the biological tissue in vivo, and the OCT endoscopic imaging technology after being combined with the endoscopic technology can directly image the biological tissue, can finish high-precision scanning of the tissue, and further can carry out early diagnosis on early canceration and atherosclerosis; fluorescence imaging is that the intensity of a fluorescence signal emitted after a fluorescent substance is excited is in a linear relation with the amount of fluorescein within a certain range; the multi-mode system can fully utilize the deep tissue imaging capability of the ultrasound, the high-resolution tissue imaging capability of the OCT and the high sensitivity and specificity of the fluorescent molecule targeted imaging to realize real-time visualized multi-mode imaging.
2) Compared with the single-mode endoscope, the multi-mode endoscope has the characteristics of singleness, instability and poor imaging resolution, the lens of the multi-mode endoscope can convert an acoustic signal-electric signal and an optical signal-electric signal into each other through a signal line and an optical fiber, has the clinical characteristics of integrating the aspects of body, tomography, high resolution and imaging depth, comprehensively balances the series of problems, is suitable for diagnosing early diseases in the body, and provides an accurate image means for early canceration and the like; in addition, compared with the traditional single-mode endoscope, the multi-mode endoscope can realize tomography of the gastrointestinal tract, can detect micro pathological changes of various gastrointestinal diseases, is beneficial to patients to treat in advance and improves the cure rate.
3) The special hemispherical focusing ball lens and the ultrasonic transducer in the lens of the multi-mode endoscope can ensure that multiple functions are realized by one-time endoscope descending, the hemispherical focusing ball lens is used for being connected with an OCT imaging observation device through an optical fiber, the ultrasonic transducer is used for being connected with an ultrasonic endoscopic imaging device through a signal line, different devices use respective independent channels, and the normal and stable work of the devices can be ensured without mutual interference.
4) The optical coherent imaging device and the fluorescence imaging device are respectively in signal connection with the image processing device, and the wavelength division multiplexer is combined to be used as a fluorescence imaging system, so that medical images of tissues and organs can be acquired by combining the advantages of various imaging devices, and more accurate tomograms of the tissues and organs are captured.
Drawings
FIG. 1 is a side sectional view schematically showing the insertion section and the operation section of a multi-modal endoscope in accordance with an embodiment of the present invention;
FIG. 2 is a schematic structural view of a probe at the distal end of an insertion section of a multi-modal endoscope in accordance with an embodiment of the present invention;
FIG. 3 is a schematic structural diagram of a multi-modality endoscopic imaging system according to an embodiment of the present invention;
the reference numbers in the figures indicate:
101. a multi-modal endoscopic imaging system 102, a multi-modal endoscope 103, an ultrasonic observation device 104, an electronic endoscopic observation device 105, an OCT imaging observation device 106, a fluorescence imaging observation device 107, a computer 108, a wavelength division multiplexer 109, a water supply tank 110, an insertion portion 111, an operation portion 112, a treatment instrument insertion port 113, a universal cable 114, and a connector; 203. sample tissues to be detected, 204, an ultrasonic transducer, 205, a hemispherical focusing ball lens, 206, a first signal line, 207, a multimode optical fiber, 208, a single-mode optical fiber, 209, a second signal line, 210, a negative pressure suction tube, 211, an air and water supply tube, 212 and a treatment instrument channel; 301. a probe 302, an illumination window 303, a negative pressure suction device window 304, a water supply/air supply window 305, a treatment instrument channel window 306, and an imaging device observation window.
Detailed Description
The invention is described in detail below with reference to the figures and specific embodiments. It is to be understood that the embodiments described are only a few embodiments of the present invention, and not all embodiments. All other embodiments, which can be obtained by a person skilled in the art without any inventive step based on the embodiments of the present invention, shall fall within the scope of protection of the present invention.
Examples
The invention relates to a multimode endoscope, the lens of the multimode endoscope can carry on the interconversion of acoustic signal-electrical signal, mere signal-electrical signal through the signal line, optic fibre, it has clinical characteristics in several aspects of integrating in the body, fault imaging, high resolution and imaging depth, the endoscope includes:
the insertion part is provided with a front end part, the front end part is of a top end hard structure, and the front end part comprises a plurality of ultrasonic transducers, probes and image pickup elements such as CCD/CMOS for receiving optical signals, wherein the ultrasonic transducers, the probes and the image pickup elements are arranged in a side row. The imaging device is inserted into the digestive tract (esophagus, stomach, duodenum, and large intestine) or the respiratory tract (trachea and bronchus) of a subject, and can image the digestive tract and the respiratory tract. The insertion portion also has a bending portion and a flexible tube portion, the bending portion is located at the rear side of the front end portion, and the insertion portion is structurally composed of: the outermost layer is rubber, the middle layer is metal net, and the innermost layer is bent snake bone. The snake bone is made of a plurality of annular metals and can bend and move in four directions, namely up, down, left and right. The bending part is used for adjusting the observation field direction; the flexible pipe part is arranged at the rear side of the bending part and structurally comprises the following components: the flexible tube portion is a three-layer structure based on a helical tube, a mesh tube, and an outer skin. The flexible tube portion has flexibility, so that the insertion property of the flexible tube portion into the body is improved, and the lower the flexibility value is, the more flexible the flexible tube portion is, the more difficult it is to be inserted into the body.
An operation part capable of controlling the insertion part front end: water is delivered for flushing the lens surface of the objective lens and keeping the visual field clear; delivering gas, whereby the gas enters the body cavity to cause dilation; negative pressure suction, when too much liquid in the cavity obstructs observation, the suction button can be controlled to suck the liquid into the suction bottle; the treatment instrument channel, the biopsy forceps and other therapeutic instruments can also be controlled to enter the body cavity by the operation part.
A connecting portion for connecting the insertion portion with the electronic endoscope system device. The insertion portion has a CCD or CMOS at its distal end for receiving an optical signal, and converts the optical signal into an electrical signal, and transmits the electrical signal to the connection portion via a signal line after receiving the electrical signal. Meanwhile, the transmitted electric signal enters an electronic endoscope system device and is displayed after image processing; the ultrasonic transducer of the insertion part is connected with the connecting part through a signal wire, and the signal wire can drive the ultrasonic transducer to emit high-frequency ultrasonic waves and emit the ultrasonic waves to the tissue of a sample to be measured. Meanwhile, ultrasonic signals reflected from the tissue of the sample to be detected can be received by the ultrasonic transducer and converted into electric signals, the electric signals are transmitted into the ultrasonic imaging system through the signal line and the connecting part, and the ultrasonic signals are displayed after being processed by the image system. The light reflected by the sample returns to the multimode optical fiber in the original path, is transmitted to the optical module through the connecting part, and is displayed after being processed by the image system.
Fig. 1 is a side sectional view of an insertion section and an operation section of a multi-modal endoscope, and a sample tissue 203 to be measured is provided corresponding to a distal end portion of the insertion section at the time of detection.
1) The insertion portion of the endoscope includes an ultrasonic transducer 204, a hemispherical focusing ball lens 205, a first signal line 206, a multimode optical fiber 207, a single-mode optical fiber 208, a second signal line 209, a negative pressure suction tube 210, an air/water feeding tube 211, and a treatment instrument channel 212. The ultrasonic transducers 204 are located on the outer surface of the hard part, and a plurality of ultrasonic transducers 204 are arranged in a row at the side of the front end. Each ultrasonic transducer 204 is connected to a first signal line 206. The ultrasonic transducer 204 is connected to an ultrasonic endoscopic imaging apparatus via a signal line, and can image surrounding organs (such as a pancreas, a bladder, a bile duct, a pancreatic duct, a lymph node, an organ in a mediastinum, and a blood vessel) using ultrasonic waves. The ultrasonic transducer is used to convert an electric pulse signal transmitted from the ultrasonic observation device into an ultrasonic pulse (acoustic pulse) and irradiate the ultrasonic pulse to a subject, and to convert an ultrasonic echo reflected by the subject into an electric echo signal represented by a voltage change and output the electric echo signal. Ultrasound imaging generates and detects ultrasound signals through an acoustic generator and receiver.
The insert is provided with a light outlet, which is located at the side of the front end of the insert, and the spherical surface of the hemispherical focusing ball lens 205 is arranged corresponding to the light outlet. The hemispherical focusing ball lens 205 can be connected with the OCT imaging observation device through an optical fiber, the hemispherical focusing ball lens 205 is used for optical focusing, a gold-plated reflecting film is arranged on the horizontal bottom surface of the hemispherical focusing ball lens, an angle of 45 degrees is formed between the horizontal bottom surface and the axial direction of the optical fiber, so that the plated reflecting film irradiates a signal transmitted by the optical fiber on the sample tissue 203 to be measured in the direction of 90 degrees, and the other part of the hemispherical focusing ball lens 205 is directly fused with the multimode optical fiber 207, so that the obtained optical signal is transmitted. Preferably, the light outlet hole adopts a light lens.
The single mode optical fiber 208 in the insertion portion transmits light directly to the illumination window 302 at the front end of the insertion portion of the endoscope for illumination; an image pickup device such as a CCD/cmos receives an optical signal through the image pickup window 306, converts the optical signal into an electrical signal, transmits the electrical signal to the electronic endoscope imaging apparatus through the second signal line 209, and displays the electrical signal through the image processing apparatus.
The negative pressure suction tube 210 in the insertion part is connected to a negative pressure suction device window 303 in the endoscope at the front end of the insertion part for sucking excess mucus, digestive products and tissue fluid in the intestines and stomach.
The air supply and water supply pipe 211 in the insertion part is connected with the water supply and air supply window 304 at the front end of the insertion part in the endoscope, and when the condition of blurred vision is clinically met, the water supply is used for flushing the mirror surface of the objective lens and the operation field so as to keep the vision clear; air supply is used for expanding the body cavity of the human body; both are used to clean the entire endoscope field of view of foreign matter.
The insertion portion treatment instrument channel 212 is used for placement of biopsy forceps and other therapeutic instruments.
2) The operation unit 111 is a portion connected to the proximal end side of the insertion unit 110 and configured to receive various operations from a doctor or the like. The operation portion 111 includes a bending knob for performing a bending operation of the bending portion and a plurality of operation members for performing various operations. Such as water supply, air supply, lighting, and negative pressure suction, among others. The operation unit 111 is provided with a treatment instrument insertion port 112, and the treatment instrument insertion port 112 communicates with the treatment instrument channel 212, so that the treatment instrument insertion path is connected to the treatment instrument window 305, thereby helping the doctor to judge the condition of a disease more accurately.
FIG. 2 shows a front view of a probe 301 at a front end portion of an insertion section of a multi-modal endoscope, the probe 301 including an illumination window 302 for maintaining illumination in a forward field of view; a negative pressure suction device window 303 for sucking out an end of the excess liquid tube; a water supply/air supply window 304 for holding an end portion of the water supply pipe and for holding an end portion of the air supply pipe; a treatment instrument channel window 305 for holding an end portion of the treatment instrument channel 212, the window communicating with the treatment instrument insertion port 112; and an imaging device observation window 306 for data transmission of the electronic endoscope device.
The present invention also relates to a multi-modality endoscopic imaging system which combines ultrasonic imaging, optical coherence tomography, fluorescence imaging, and electronic endoscopic imaging, has an imaging optical system and an imaging element, is inserted into the digestive tract (esophagus, stomach, duodenum, large intestine) or respiratory tract (trachea, bronchus) of a subject, and can image the digestive tract or respiratory tract.
Specifically, the system includes the multi-modality endoscope 102 in the above, and further includes an image processing device (not shown in the drawings), an ultrasonic imaging device (not shown in the drawings), an ultrasonic observation device 103, an electronic endoscope device 104, an OCT imaging observation device 105 (first optical imaging device), a fluorescence imaging device 106 (second optical imaging device), a computer 107, a wavelength division multiplexer 108, a water supply tank 109, and a universal cable 113. The OCT imaging observation device 105, the ultrasonic imaging device 103, the fluorescence imaging observation device 106 and the electronic endoscope system device 104 use independent channels respectively, so that the normal and stable work of the OCT imaging observation device, the ultrasonic imaging device 103, the fluorescence imaging observation device 106 and the electronic endoscope system device 104 can be guaranteed without mutual interference.
The ultrasonic observation device 103, the electronic endoscope device 104, the OCT imaging observation device 105, and the fluorescence imaging observation device 106 are connected to a computer 107, respectively. The operation section 111 of the multi-modal endoscope 102 is connected to the proximal end side of the insertion section 110 and is used for receiving various operations from a doctor or the like. The universal cable 113 is a cable that extends from the operation portion 112 of the multi-mode endoscope 102 and includes a plurality of signal cables for transmitting various signals, optical fibers for transmitting illumination light supplied from the light source device, and the like. One end of the universal cable 113 is connected to the operation unit 112, and the other end is connected to the connector 114. The connector 114 is used to connect the universal cable 113 to the ultrasonic observation device 103, the electronic endoscope device 104, the wavelength division multiplexer 108, and the water supply tank 109, respectively. The multi-modal endoscope 102 is provided with an ultrasonic transducer 204, and the ultrasonic transducer 204 converts an electric pulse signal transmitted from the ultrasonic observation device 103 into an ultrasonic pulse (acoustic pulse) and irradiates the ultrasonic pulse to a subject, and converts an ultrasonic echo reflected by the subject into an electric echo signal represented by a voltage change and outputs the electric echo signal. Ultrasound imaging generates and detects ultrasound signals through an acoustic generator and receiver.
The image processing device is used for outputting a control signal according to the operation of a user and generating a multi-modal image of the tissue organ according to the received feedback signal. The image processing device is respectively connected with the OCT imaging observation device 105, the fluorescence imaging device 106 and the ultrasonic imaging device through signals.
The multi-modal endoscope 102 is also in signal connection with the two optical imaging devices and the ultrasonic imaging device respectively, the multi-modal endoscope 102 feeds back an optical feedback signal according to optical signals of the two optical imaging devices and feeds back an ultrasonic feedback signal according to an ultrasonic control signal of the ultrasonic imaging device, and finally the image processing device obtains a medical image of a sample tissue on the pancreaticobiliary duct according to the optical feedback signal and the ultrasonic feedback signal, so that a user can judge the state of the tissue organ according to the image and corresponding medical knowledge.
The ultrasonic imaging device is connected with an ultrasonic transducer in the multi-mode endoscope 102 by a signal line, and is used for outputting an ultrasonic control signal according to the control signal, so that the ultrasonic transducer emits ultrasonic waves to a sample tissue to be measured and converts the returned feedback ultrasonic waves into ultrasonic feedback signals.
The OCT imaging observation device 105 is connected to the hemispherical focusing ball lens 205 by an optical fiber, and is configured to output an optical signal according to the control signal, where the optical signal reaches the sample tissue to be measured through the hemispherical focusing ball lens 205, and receives an optical signal fed back from the collected sample tissue to be measured.
The wavelength division multiplexer 108 is connected with the OCT imaging observation device 105 and the fluorescence imaging observation device 106, and the two observation devices are respectively connected with the image processing device through signals. One end of the wavelength division multiplexer 108 is in signal connection with the OCT imaging observation device 105 through an optical fiber, and is in signal connection with the fluorescence imaging observation device 106 through another optical fiber, and the other end of the wavelength division multiplexer 108 is connected with the hemispherical focusing ball lens 205 through an optical fiber. The OCT imaging scope 105 and the fluorescence imaging scope 106 can be combined by a wavelength division multiplexer 108 to serve as a fluorescence imaging system. The emitted light is collected using a double-clad Fiber (DCF) coupler to ensure compactness and stability of the system. A semiconductor laser is used as an excitation light source for fluorescence imaging, and a DCF coupler is incorporated into the excitation light and emission light transmission collection. In the transmission process, the composite light beam passes through the single-point mode core from the input port to the output port, and the small diameter of the single-point mode core ensures that high optical energy density is generated on surface tissues, so that high-efficiency excitation is realized. The output of the back-emitted fluorescence via the DCF to a large diameter multimode fiber improves the ability to collect the emitted light and obtain fluorescence information in the PMT via corresponding filtering.
Preferably, in the multi-mode endoscopic imaging system, the OCT imaging observation device 105 adopts a high-speed VECSE L light source to realize long-distance imaging, light emitted by the light source is transmitted to a hemispherical ball lens through a multi-mode optical fiber and refracted onto a sample at 90 degrees, a 680-plus 750nm waveband of semiconductor tunable laser is adopted as an excitation light source to realize fluorescent molecule imaging, and the wavelength division multiplexer 108 is selected to integrate an optical coherent imaging sample arm light source and a fluorescent excitation light source into the same single-mode broadband optical fiber light path according to the conditions of different wavelengths of the OCT imaging observation device 105 and the fluorescent imaging observation device 106, so that the dual-mode optical fiber light path design ensures the compactness and stability of a dual-mode optical path system.
The multimode endoscopic imaging system is provided with an optical coherent imaging device and a fluorescence imaging device which have different imaging principles, wherein the optical coherent imaging technology has non-invasion and high resolution compared with other technologies, and can detect the internal microstructure of the biological tissue in vivo, and the OCT endoscopic imaging technology combined with the endoscopic technology can directly image the biological tissue, can complete high-precision scanning of the tissue, and further can carry out early diagnosis on early canceration and atherosclerosis.
The invention can realize the analysis of the structure and the components of the tissue by combining the fluorescence imaging technology and the OCT imaging technology, can provide an accurate imaging means for early pancreaticobiliary tract lesions and the like, and compared with the characteristics of single modality imaging technology, such as single property, instability and poor imaging resolution ratio, the multi-modality imaging technology is more suitable for the diagnosis of in vivo early diseases, and integrates the clinical characteristics of the aspects of body, tomography, high resolution ratio and imaging depth.
While the invention has been described with reference to specific embodiments, the invention is not limited thereto, and those skilled in the art can easily conceive of various equivalent modifications or substitutions within the technical scope of the invention. Therefore, the protection scope of the present invention shall be subject to the protection scope of the claims.

Claims (10)

1. A multi-modality endoscope, comprising:
the inserting part is used for converting the optical signal into an electric signal, transmitting the signal to the connecting part through a signal wire after receiving the electric signal, and displaying the transmitted electric signal after image processing in the electronic endoscope system device; the insertion part comprises a front end part, a bending part and a flexible tube part which are sequentially arranged, wherein the front end part comprises ultrasonic transducers which are arranged in a side row and are used for being connected with an ultrasonic endoscopic imaging device through a signal line, a probe, an optical focusing module which is used for being connected with an OCT imaging observation device through an optical fiber, an image pickup element used for receiving optical signals and a treatment instrument channel used for placing a biopsy forceps and other therapeutic instruments;
an operation section for performing air supply, water supply, and negative pressure suction operations to the distal end portion of the insertion section, performing a bending operation to the bending portion of the insertion section, and controlling the treatment instrument to be conveyed to the body cavity through the treatment instrument channel;
a connecting portion for connecting the insertion portion with the electronic endoscope system device.
2. The multi-modality endoscope according to claim 1, wherein the distal end portion is a rigid distal end structure, and the plurality of ultrasonic transducers are laterally arranged in a row on an outer surface of the distal end portion of the rigid distal end structure.
3. The multi-modality endoscope of claim 1, wherein the optical focusing module is a hemispherical focusing ball lens, a gold-plated reflective film is disposed on a horizontal bottom surface of the hemispherical focusing ball lens, the horizontal bottom surface forms an angle of 45 ° with an axial direction of the optical fiber, and the hemispherical focusing ball lens is fused with the multi-mode optical fiber except for the horizontal bottom surface.
4. The multi-modality endoscope of claim 1, wherein the insertion portion further comprises an illumination window and a single mode optical fiber for transmitting light to the illumination window for illumination.
5. The multi-modality endoscope according to claim 1, wherein the image capture component converts the received optical signals into electrical signals, transmits the electrical signals to the electronic endoscope imaging device via a signal line, and then displays the electrical signals through the image processing device.
6. The multi-modal endoscope according to claim 1, wherein the operation section is provided on a proximal end side of the insertion section, and the operation section includes a bending knob for bending the bending section, an air supply/water supply tube for supplying air and water to a distal end portion of the insertion section, a negative pressure suction tube for sucking excess liquid at the distal end portion of the insertion section through the inside of the endoscope, and a treatment instrument insertion port for connecting to a treatment instrument channel of the operation section.
7. The multi-modality endoscope according to claim 4, wherein the probe includes the illumination window for holding illumination of the forward field of view, an end portion negative pressure suction device window for sucking out an unnecessary liquid tube, an end portion water supply/air supply window for holding an end portion of a water supply tube and for holding an end portion of an air supply tube, a treatment instrument channel window for holding an end portion of a treatment instrument channel in communication with a treatment instrument insertion port, and an imaging device observation window for data transmission of an electronic endoscope device.
8. A multi-modal endoscopic imaging system comprising the multi-modal endoscope of any of claims 1 to 7, the system further comprising:
the image processing device is respectively in signal connection with the OCT imaging observation device, the fluorescence imaging device and the ultrasonic imaging device, and is used for outputting a control signal according to the operation of a user and generating a multi-mode image of the tissue organ according to the received feedback signal;
the ultrasonic imaging device is connected with an ultrasonic transducer of the multi-mode endoscope through a signal line and used for outputting an ultrasonic control signal according to the control signal, so that the ultrasonic transducer emits ultrasonic waves to a sample tissue to be detected and converts the returned feedback ultrasonic waves into ultrasonic feedback signals;
the OCT imaging observation device is connected with the hemispherical focusing ball lens through an optical fiber and used for outputting an optical signal according to a control signal, and the optical signal reaches the tissue of the sample to be detected through the hemispherical focusing ball lens and receives an optical signal fed back by the collected tissue of the sample to be detected;
the fluorescence imaging observation device forms a fluorescence imaging system by utilizing the wavelength division multiplexer and the OCT imaging observation device and is used for integrating an optical coherent imaging sample arm light source and a fluorescence excitation light source into the same single-mode broadband optical fiber light path;
and the electronic endoscope system device is connected with the insertion part of the multi-mode endoscope and is used for carrying out image processing and displaying on the electric signal transmitted back by the insertion part.
9. The system of claim 8, wherein the system employs a double-clad fiber coupler to collect the emitted light and semiconductor laser as an excitation light source for fluorescence imaging.
10. The system of claim 8, wherein the OCT imaging and visualization device employs a high-speed VECSE L light source, and the fluorescence imaging system employs 680-750nm band of semiconductor tunable laser as an excitation light source.
CN202010175481.5A 2020-03-13 2020-03-13 Multi-mode endoscope and endoscopic imaging system Pending CN111419149A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202010175481.5A CN111419149A (en) 2020-03-13 2020-03-13 Multi-mode endoscope and endoscopic imaging system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202010175481.5A CN111419149A (en) 2020-03-13 2020-03-13 Multi-mode endoscope and endoscopic imaging system

Publications (1)

Publication Number Publication Date
CN111419149A true CN111419149A (en) 2020-07-17

Family

ID=71553941

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202010175481.5A Pending CN111419149A (en) 2020-03-13 2020-03-13 Multi-mode endoscope and endoscopic imaging system

Country Status (1)

Country Link
CN (1) CN111419149A (en)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113520294A (en) * 2021-07-27 2021-10-22 郑州光超医疗科技有限公司 Bimodal optical coherence tomography endoscopic probe
CN113520272A (en) * 2021-06-29 2021-10-22 上海应用技术大学 Endoscopic catheter-multi-mode optical imaging coupling detection system
CN115645013A (en) * 2022-12-29 2023-01-31 山东百多安医疗器械股份有限公司 Multi-mode tracheostomy device combined with electrocardio ultrasonic endoscope
CN115919372A (en) * 2023-01-28 2023-04-07 深圳先进技术研究院 Multimode endoscopic imaging system based on short wave near-infrared fluorescence

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20090326322A1 (en) * 2008-06-27 2009-12-31 Intuitive Surgical, Inc. Medical robotic system with image referenced camera control using partitionable orientational and translational modes
US20160357007A1 (en) * 2015-05-05 2016-12-08 Eric Swanson Fixed distal optics endoscope employing multicore fiber
CN106361294A (en) * 2016-11-15 2017-02-01 华南师范大学 Device and method for endovascular optical coherence tomography - opto-acoustic - ultrasonic multimode imaging
CN106714696A (en) * 2015-02-25 2017-05-24 奥林巴斯株式会社 Ultrasonic probe
CN108498120A (en) * 2017-02-23 2018-09-07 富士胶片株式会社 Endoscope
CN109349982A (en) * 2018-12-07 2019-02-19 深圳先进技术研究院 Multi-modal Cholangiopancreatogrinhy system

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20090326322A1 (en) * 2008-06-27 2009-12-31 Intuitive Surgical, Inc. Medical robotic system with image referenced camera control using partitionable orientational and translational modes
CN106714696A (en) * 2015-02-25 2017-05-24 奥林巴斯株式会社 Ultrasonic probe
US20160357007A1 (en) * 2015-05-05 2016-12-08 Eric Swanson Fixed distal optics endoscope employing multicore fiber
CN106361294A (en) * 2016-11-15 2017-02-01 华南师范大学 Device and method for endovascular optical coherence tomography - opto-acoustic - ultrasonic multimode imaging
CN108498120A (en) * 2017-02-23 2018-09-07 富士胶片株式会社 Endoscope
CN109349982A (en) * 2018-12-07 2019-02-19 深圳先进技术研究院 Multi-modal Cholangiopancreatogrinhy system

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113520272A (en) * 2021-06-29 2021-10-22 上海应用技术大学 Endoscopic catheter-multi-mode optical imaging coupling detection system
CN113520294A (en) * 2021-07-27 2021-10-22 郑州光超医疗科技有限公司 Bimodal optical coherence tomography endoscopic probe
CN115645013A (en) * 2022-12-29 2023-01-31 山东百多安医疗器械股份有限公司 Multi-mode tracheostomy device combined with electrocardio ultrasonic endoscope
CN115919372A (en) * 2023-01-28 2023-04-07 深圳先进技术研究院 Multimode endoscopic imaging system based on short wave near-infrared fluorescence

Similar Documents

Publication Publication Date Title
JP6673985B2 (en) Method of controlling operation of an imaging system
CN111419149A (en) Multi-mode endoscope and endoscopic imaging system
Zhou et al. Photoacoustic imaging with fiber optic technology: A review
CN101518455B (en) Hard ultrasonic hysteroscope system
JP4919786B2 (en) Fluorescence endoscope
CA2472197A1 (en) Apparatus and method for spectroscopic examination of the colon
US8911357B2 (en) Optical structure observation apparatus and structure information processing method of the same
US20110077463A1 (en) Optical probe and endoscope apparatus
JP5097715B2 (en) Fluorescence endoscope
JPS58218952A (en) Ultrasonic endoscope flexibly attached with elongated array
CN102824154A (en) Combined endoscope imaging system based on OCT (Optical Coherence Tomography) and imaging method
CN111225600A (en) Device for endoscopic photoacoustic imaging, in particular of hollow and hollow objects
CN101703415B (en) Hard ultrasonic gallbladder endoscope system
WO2021090056A1 (en) Combined ultrasound and endoscopy
CN112842523B (en) Eccentric endoscope laser catheter
CN102100533A (en) Integrated thermal-infrared scanning cystoscope system
US11849917B2 (en) Disposable miniature endoscopy system
JP5318762B2 (en) Endoscopic procedure fiberscope coupling device
CN102100530A (en) Integrated infrared thermally scanning duodenoscope system
US20220378400A1 (en) Combined ultrasound and endoscopy
CN116763239A (en) Broad spectrum fluorescent endoscope device
JP2010502311A6 (en) Endoscopic procedure fiberscope coupling device
JP2010502311A5 (en)
JPH0352286B2 (en)
JP2007075402A (en) Oct (optical coherence tomography) observation implement and oct system

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication

Application publication date: 20200717

RJ01 Rejection of invention patent application after publication