CN212307814U - Multi-mode microscopic endoscopic imaging device - Google Patents

Multi-mode microscopic endoscopic imaging device Download PDF

Info

Publication number
CN212307814U
CN212307814U CN202020488222.3U CN202020488222U CN212307814U CN 212307814 U CN212307814 U CN 212307814U CN 202020488222 U CN202020488222 U CN 202020488222U CN 212307814 U CN212307814 U CN 212307814U
Authority
CN
China
Prior art keywords
module
endoscopic
laser
probe
multimode
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202020488222.3U
Other languages
Chinese (zh)
Inventor
杨西斌
熊大曦
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Suzhou Institute of Biomedical Engineering and Technology of CAS
Original Assignee
Suzhou Institute of Biomedical Engineering and Technology of CAS
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Suzhou Institute of Biomedical Engineering and Technology of CAS filed Critical Suzhou Institute of Biomedical Engineering and Technology of CAS
Priority to CN202020488222.3U priority Critical patent/CN212307814U/en
Application granted granted Critical
Publication of CN212307814U publication Critical patent/CN212307814U/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Abstract

The utility model discloses a multi-mode microscopic endoscopic imaging device. The device comprises a confocal endoscopic imaging system, a photoacoustic endoscopic imaging system, an ultrasonic endoscopic imaging system, a multimode endoscopic probe and a computer. Wherein, confocal endoscopic imaging system includes: the device comprises a laser module, a first light guide module, a photoelectric conversion module and a first signal acquisition module; the photoacoustic endoscopic imaging system includes: the device comprises a pulse laser module, a second light guide module and a second signal acquisition module; the ultrasonic endoscopic imaging system comprises: an ultrasonic module and a third signal acquisition module which are integrated in the multimode endoscopic probe. The utility model discloses combined three kinds of imaging methods of confocal, optoacoustic and supersound, and possessed preceding scanning and two kinds of modes of side direction scanning, can conveniently realize the in vivo detection of different yardstick, different resolution ratios to various lumen tissues, obtained a plurality of dimension information of lumen tissue, realized the accurate diagnosis of disease.

Description

Multi-mode microscopic endoscopic imaging device
Technical Field
The utility model belongs to the endoscope imaging field, in particular to endoscopic imaging device is in a plurality of modes in a microscope.
Background
At present, the incidence rate and the death rate of malignant tumors in China are high, early discovery and early treatment are the core requirements of prevention and treatment of the malignant tumors, and endoscopy and biopsy cases are the main means for diagnosing early cancers of digestive tracts at present. The current endoscope optical new technology clinically applied to the diagnosis of precancerous lesions comprises the following steps: amplifying electronic endoscopes, electronic dye endoscopes (narrowband imaging (NBI), intelligent spectral colorimetric (FICE), high definition intelligent electronic dye endoscopes (i-Scan), Blue Laser Imaging (BLI)), ultrasonic endoscopes, confocal laser microscopy (CLE), photoacoustic endoscopes, and the like.
The ultrasonic endoscopic imaging can realize real-time imaging of deep tumors, trans-visceral tumor and small-focus tumors, but is limited by resolution, so that in-vivo pathological diagnosis cannot be realized; laser confocal endoscopic imaging is used as a non-invasive 'optical biopsy' tool, an important technical means (a Cellvizio product of Mauna Kea Tectogies company in France) is provided for early diagnosis of internal organ tumors which are mostly originated from superficial epithelial tissues in a human body, the resolution is very high, in-vivo pathological imaging can be realized, the diagnosis targeting and specificity are strong, deep tissue examination cannot be realized, in-vivo fluorescence imaging of a fluorescein sodium dye with an excitation wavelength of 480nm can only be realized by the existing technology, and multi-band imaging cannot be realized for more different tumor types; the photoacoustic endoscopic imaging has the advantages that the depth imaging of ultrasound and the high optical resolution capability are achieved, functional information such as tumor neovascular structure and blood oxygen saturation can be acquired, but in the aspect of a single index, the depth is not as good as that of the ultrasonic endoscopic imaging, and the resolution is not as good as that of the laser confocal endoscopic imaging.
Chinese patent 201210363551.5 discloses a MEMS optical probe, using this optical probe through the angle of design MEMS galvanometer 9, can realize to scan forward and scan forward to the side, when the cooperation endoscope is used, can realize the scanning to human internal organs and more hidden tissue, adopt the lateral scanning probe difficult to carry out the problem of scanning to human internal organs and more hidden tissue region, but this is a single mode imaging method, can only realize optical imaging, can't realize ultrasonic imaging and optoacoustic imaging, can't solve the tissue deep imaging problem promptly.
Chinese patent 201610190321.1 discloses an optical probe for endoscopic imaging, which is intended to solve the problems of small radial scanning area of an optical probe using an MEMS micro-mirror and imaging shadow caused by a wire in an optical probe using a micro-motor, but the probe contains the micro-motor 3 inside, which cannot realize a miniaturized design, and vibrations caused by the operation of the motor can form large noise, which is not beneficial to imaging, and in addition, does not contain ultrasound and photoacoustic imaging functions.
Chinese patent 201811496856.7 discloses a multimode imaging system of pancreas bile duct and peep pipe device in it, has proposed a multimode imaging's system, this patent peep the optics focus module of probe in, do not include in above-mentioned two patents the scanning device of similar MEMS galvanometer, can only focus on a bit when the probe is fixed, can't form images, only the probe rotates, carries out the scanning concatenation of pointwise through the mode of rotatory back withdrawing and just can form images, this utility model optics focus module's transmitting direction with ultrasonic transducer's transmitting direction deviates from each other, can only realize looking sideways at the formation of image, can't form images to the forward target of peeping the pipe.
SUMMERY OF THE UTILITY MODEL
An object of the utility model is to provide a can obtain a plurality of dimension information of different yards of lumen tissue, different resolution ratios, improve scope imaging accuracy, specificity and targeted multimode microscopic endoscopic imaging device.
Realize the utility model discloses the technical solution of purpose does: a multi-modal microscopic endoscopic imaging device comprises a confocal endoscopic imaging system, a photoacoustic endoscopic imaging system, an ultrasonic endoscopic imaging system, a multi-modal endoscopic probe and a computer;
the confocal endoscopic imaging system includes: the device comprises a laser module, a first light guide module, a photoelectric conversion module and a first signal acquisition module; the computer generates a trigger signal to excite the laser module to generate laser, the laser is transmitted to the multimode endoscopic probe through the first light guide module, the multimode endoscopic probe focuses the laser on the lumen tissue to be detected to excite fluorescence and collect fluorescence signals, the fluorescence signals are transmitted to the computer after sequentially passing through the photoelectric conversion module and the first signal collection module, and a confocal endoscopic image is constructed through the computer processing;
the photoacoustic endoscopic imaging system comprises: the device comprises a pulse laser module, a second light guide module and a second signal acquisition module; the computer generates a trigger signal to excite the pulse laser module to generate pulse laser, the pulse laser is transmitted to the multimode endoscopic probe through the second light guide module, the multimode endoscopic probe focuses the pulse laser on the lumen tissue to be detected to form a light spot and excites the light spot to generate an acoustic signal, the ultrasonic module integrated in the multimode endoscopic probe collects the acoustic signal and converts the acoustic signal into an electric signal, and then the electric signal is transmitted to the computer through the second signal collection module and processed by the computer to construct a photoacoustic endoscopic image;
the ultrasonic endoscopic imaging system comprises: the ultrasonic module and the third signal acquisition module are integrated in the multimode endoscopic probe; the computer generates a trigger signal to excite the ultrasonic module to emit ultrasonic waves, the ultrasonic module receives the ultrasonic waves reflected by the lumen tissue to be detected and transmits the ultrasonic waves to the computer through the third signal acquisition module, and the ultrasonic endoscopic images are constructed through the processing of the computer.
Further, the laser/pulse laser module comprises N lasers/pulse lasers arranged in parallel, and the lasers/pulse lasers at one end are sequentially and respectively recorded as a first laser/pulse laser to an nth laser/pulse laser, the laser/pulse laser module further comprises a reflecting mirror and second to nth dichroic mirrors which are respectively arranged on output light paths of the first laser/pulse laser to the nth laser/pulse laser, the reflecting mirror and the second to nth dichroic mirrors are coaxially arranged, and reflected light of the reflecting mirror is coupled with light beams incident to the second to nth-1 dichroic mirrors and then enters the light guide module.
Further, the ultrasound module includes an ultrasound transducer and a signal line transmitting an ultrasound signal.
Further, the second light guide module includes: the device comprises a beam expanding collimation system, a first dichroic mirror, a first focusing system and a first optical fiber; pulse laser generated by the pulse laser module is converted into parallel light through the beam expanding and collimating system and enters the first dichroic mirror, and transmitted light of the first dichroic mirror is coupled to the first optical fiber through the first focusing system and then transmitted to the multimode endoscopic probe along the first optical fiber.
Further, the first light guide module includes a second light guide module, and further includes: a filter focusing system; laser generated by the laser module is changed into parallel light after passing through the beam expanding and collimating system and enters the first dichroic mirror, transmitted light of the first dichroic mirror is coupled to the first optical fiber through the first focusing system and then is transmitted to the multimode endoscopic probe along the first optical fiber, the multimode endoscopic probe focuses the laser on lumen tissues to be measured to excite fluorescence and collect fluorescence signals, and the fluorescence signals return along the first optical fiber and are transmitted to the photoelectric conversion module after being reflected by the first dichroic mirror, entering the light filtering and focusing system.
Further, the second light guide module further comprises a second focusing system; the laser/pulse laser is coupled to the second optical fiber through the second focusing system and transmitted to the beam expanding collimation system through the second optical fiber before being changed into parallel light through the beam expanding collimation system and entering the first dichroic mirror.
Furthermore, the multimode endoscopic probe comprises a tubular hollow probe protective shell, and an expanded beam focusing system and an MEMS galvanometer which are arranged in the hollow probe protective shell;
the multimode endoscopic probe adopts a lateral scanning structure, light beams transmitted by the light guide module enter the MEMS galvanometer after passing through the beam expanding and focusing system, and the light beams are deflected by the MEMS galvanometer and then are emitted from an opening arranged on the side wall of the hollow probe protective shell to realize lateral focusing;
or the multimode endoscopic probe adopts a forward scanning structure, the multimode endoscopic probe further comprises a reflecting assembly, light beams transmitted by the light guide module are reflected to the MEMS vibrating mirror by the reflecting assembly after passing through the beam expanding focusing system, and the light beams are emitted from the radial surface of the hollow probe protective shell after being deflected by the MEMS vibrating mirror, so that forward focusing is realized.
Furthermore, the imaging device also comprises a three-dimensional scanning system for realizing three-dimensional imaging of the lumen tissue to be measured, the system is controlled by a computer, and comprises a rotating device for driving the multimode endoscopic probe to rotate for 360 degrees to realize 360-degree scanning imaging and a translation device for driving the multimode endoscopic probe to move along the length direction of the lumen to realize imaging in the length direction of the lumen.
Further, the timing control of the imaging apparatus is: the computer generates a trigger signal, and the three paths of delay circuits respectively and sequentially excite the laser module to generate laser, excite the ultrasonic module to emit ultrasonic waves and excite the pulse laser module to generate pulse laser; the time sequence of the three paths of delay circuits is generated by the FPGA controlled by the computer.
Compared with the prior art, the utility model, it is showing the advantage and is: 1) three imaging modes of laser confocal endoscopy, photoacoustic endoscopy and ultrasonic endoscopy are realized through the same probe, imaging can be performed on the same site in the same visual field, and various dimensional information with different depths and different resolutions can be obtained for accurate diagnosis of diseases, for example, the confocal endoscopy resolution is 1-3 microns, the imaging depth is 50-100 microns, and the cell structure morphology can be observed; the photoacoustic endoscopic resolution is 50-100 microns, the imaging depth is 1-2mm, and the microvascular distribution condition, namely the functional information of the aerobic metabolism strength of the organ can be obtained without fluorescent agent dyeing; the ultrasonic endoscopic imaging resolution is 100-200 microns, the imaging depth is 2-5mm, the tissue deep disease form is obtained, and the tumor infiltration depth information is obtained; 2) the probe has two imaging modes, a side-view imaging mode, and compared with the Cellvizo product of Mauna Kea Tecnologies company in France, the probe can perform imaging on the side wall of the micro-cavity, because the front-view imaging probe cannot rotate 90 degrees in the micro-cavity, an imaging surface is aligned to a surface to be imaged, imaging can only be performed in a larger cavity, an MEMS galvanometer is adopted, and a complete image can be obtained by scanning the galvanometer when the probe is fixed, while the contrast 3 cannot perform imaging when the probe is fixed; 3) the utility model discloses compact structure, stability are strong, can satisfy the clinical demand to multimode information acquisition.
The present invention will be described in further detail with reference to the accompanying drawings.
Drawings
Fig. 1 is a schematic diagram of a multi-modal microscopic endoscopic imaging apparatus according to an embodiment.
Fig. 2 is a schematic diagram of a multi-modal microscopic endoscopic imaging apparatus according to an embodiment.
Fig. 3 is a schematic structural view of a side-viewing imaging endoscopic probe of the multimode endoscopic probe according to an embodiment.
Fig. 4 is a structural diagram of a forward-looking imaging endoscopic probe of the multimode endoscopic probe according to an embodiment.
Fig. 5 is a timing diagram of the multi-modal microscopic endoscopic imaging apparatus according to an embodiment.
Detailed Description
In order to make the objects, technical solutions and advantages of the present application more apparent, the present application is described in further detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative of the present application and are not intended to limit the present application.
In one embodiment, in conjunction with fig. 1, there is provided a multi-modal microscopic endoscopic imaging apparatus, the apparatus comprising a confocal endoscopic imaging system, a photoacoustic endoscopic imaging system, an ultrasonic endoscopic imaging system, a multi-modal endoscopic probe, and a computer;
the confocal endoscopic imaging system comprises: the device comprises a laser module, a first light guide module, a photoelectric conversion module and a first signal acquisition module; the computer generates a trigger signal to excite the laser module to generate laser, the laser is transmitted to the multimode endoscopic probe through the first light guide module, the multimode endoscopic probe focuses the laser on the lumen tissue to be detected to excite fluorescence and collect fluorescence signals, the fluorescence signals are transmitted to the computer after sequentially passing through the photoelectric conversion module and the first signal collection module, and a confocal endoscopic image is constructed through the computer processing;
the photoacoustic endoscopic imaging system includes: the device comprises a pulse laser module, a second light guide module and a second signal acquisition module; the computer generates a trigger signal to excite the pulse laser module to generate pulse laser, the pulse laser is transmitted to the multimode endoscopic probe through the second light guide module, the multimode endoscopic probe focuses the pulse laser on the lumen tissue to be detected to form light spots and excites the pulse laser to generate acoustic signals (the acoustic signals are generated by thermal expansion and cold contraction caused by photo-thermal), the ultrasonic module integrated in the multimode endoscopic probe collects the acoustic signals and converts the acoustic signals into electric signals, then the electric signals are transmitted to the computer through the second signal collection module, and the photoacoustic endoscopic images are constructed through the processing of the computer (signal demodulation and ultrasonic imaging algorithm);
the ultrasonic endoscopic imaging system comprises: the ultrasonic module and the third signal acquisition module are integrated in the multimode endoscopic probe; the computer generates a trigger signal to excite the ultrasonic module to emit ultrasonic waves, the ultrasonic module receives the ultrasonic waves reflected by the lumen tissue to be detected and transmits the ultrasonic waves to the computer through the third signal acquisition module, and the ultrasonic endoscopic images are constructed through computer processing (signal demodulation and ultrasonic imaging algorithm).
Here, the first signal acquisition module to the third signal acquisition module may be three independent signal acquisition modules, or may be the same signal acquisition module.
Here, the signal acquisition module may adopt a signal acquisition card, for example.
Here, the photoelectric conversion module may employ a photomultiplier tube PMT, which is exemplary preferred.
The multi-mode microscopic endoscopic imaging device can simultaneously realize three kinds of imaging of confocal endoscopic imaging, photoacoustic endoscopic imaging and ultrasonic endoscopic imaging, wherein the confocal endoscopic imaging realizes tissue superficial high-resolution in-vivo pathological imaging, the photoacoustic endoscopic imaging realizes unmarked tissue newborn nourishing blood vessel high-resolution imaging, and the ultrasonic endoscopic imaging realizes deep tissue high-resolution imaging. Therefore, the specificity and the targeting of endoscopic imaging can be improved, and the direct relation between the endoscopic diagnosis and the pathological diagnosis is established.
Further, in an embodiment, with reference to fig. 2, the laser/pulse laser module includes N lasers/pulse lasers arranged in parallel, and the lasers/pulse lasers at one end are sequentially and respectively denoted as a first laser/pulse laser to an nth laser/pulse laser, and the laser/pulse laser module further includes a reflecting mirror and second to nth dichroic mirrors respectively arranged on output optical paths of the first laser/pulse laser to the nth laser/pulse laser, the reflecting mirror and the second to nth dichroic mirrors are coaxially arranged, and reflected light of the reflecting mirror is coupled with light beams incident on the second to nth-1 dichroic mirrors and then enters the light guide module.
By adopting the scheme of the embodiment, the imaging of different excitation wavelengths can be realized, and the adaptability is wide.
Further, in one embodiment, the ultrasound module includes an ultrasound transducer and a signal line for transmitting an ultrasound signal.
Here, the ultrasonic transducer is an ultrasonic transmitting element and an ultrasonic receiving element, and ultrasonic waves emitted by the ultrasonic transducer are absorbed and reflected by the tissue of the cavity to be measured, and echoes are received by the same ultrasonic transducer.
Here, the signal line may be a cable, for example.
By adopting the scheme of the embodiment, an independent ultrasonic transmitting element and an independent ultrasonic receiving element are not needed, and the ultrasonic transmitting and receiving processes can be completed by one element, so that the structure of the whole device is simplified.
Further, in one embodiment, with reference to fig. 2, the second light guide module includes: the device comprises a beam expanding collimation system, a first dichroic mirror, a first focusing system and a first optical fiber; pulse laser generated by the pulse laser module is converted into parallel light through the beam expanding and collimating system and enters the first dichroic mirror, and transmitted light of the first dichroic mirror is coupled to the first optical fiber through the first focusing system and then transmitted to the multimode endoscopic probe along the first optical fiber.
Here, it is exemplary preferable that the first optical fiber is a single mode fiber or a multimode fiber or a double clad fiber.
Further, in one embodiment, with reference to fig. 2, the first light guide module includes a second light guide module, and further includes: a filter focusing system; laser generated by the laser module is changed into parallel light after passing through the beam expanding and collimating system and enters the first dichroic mirror, transmitted light of the first dichroic mirror is coupled to the first optical fiber through the first focusing system and then is transmitted to the multimode endoscopic probe along the first optical fiber, the multimode endoscopic probe focuses the laser on lumen tissues to be measured to excite fluorescence and collect fluorescence signals, and the fluorescence signals return along the first optical fiber and are transmitted to the photoelectric conversion module after being reflected by the first dichroic mirror, entering the light filtering and focusing system.
Here, the filter focusing system may include a color filter assembly and a focusing lens, which are sequentially disposed. The filter can eliminate the influence of excitation light and other stray light reflected by tissues in the light path.
Here, preferably, the first optical fiber is located on the back focal plane of the first focusing system, and can eliminate the influence of stray signal light returned by the non-focal plane layer on the surface of the lumen tissue to be measured.
Further, in one embodiment, with reference to fig. 2, the second light guide module further includes a second focusing system; the laser/pulse laser is coupled to the second optical fiber through the second focusing system and transmitted to the beam expanding collimation system through the second optical fiber before being changed into parallel light through the beam expanding collimation system and entering the first dichroic mirror.
Here, it is exemplary and preferable that the second optical fiber is a single mode fiber or a multimode fiber or a double clad fiber or a fiber bundle.
By adopting the scheme of the embodiment, the light guide module is simple and compact in structure, easy to realize, low in light loss ratio and high in detection precision.
Further, in one embodiment, the multimode endoscopic probe comprises a tubular hollow probe protective shell, and an expanded beam focusing system and a MEMS galvanometer which are arranged inside the hollow probe protective shell;
with reference to fig. 3, the multimode endoscopic probe adopts a lateral scanning structure, light beams transmitted by the light guide module enter the MEMS galvanometer after passing through the beam expanding and focusing system, and the light beams are deflected by the MEMS galvanometer and then emitted from an opening formed in the side wall of the hollow probe protective shell, thereby achieving lateral focusing;
or, with reference to fig. 4, the multimode endoscopic probe adopts a forward scanning structure, and further includes a reflection assembly, wherein the light beam transmitted by the light guide module is reflected by the reflection assembly to the MEMS galvanometer after passing through the beam expanding and focusing system, and the light beam is deflected by the MEMS galvanometer and then emitted from the radial surface of the hollow probe protective shell, thereby realizing forward focusing.
Here, the MEMS galvanometer is a two-dimensional scanning galvanometer, one scanning direction is a fast scanning direction with a fast vibration speed, the resonance type galvanometer with the fast vibration speed is used for completing laser scanning in the X direction, the other scanning direction is a slow scanning direction with a slow vibration speed, the galvanometer scanning at a corresponding speed, and the two scanning directions are synchronized by a signal, so that focused laser is scanned into a plane by a point, and two-dimensional plane imaging is realized.
Here, the expanded beam focusing system may employ a gradient index lens or a lens group, collect light emitted from the first optical fiber, and perform expanded beam and focusing.
Here, the reflection assembly may employ one or more reflection prisms, which are exemplary preferred.
Here, the beam expanding and focusing system, the MEMS galvanometer and the reflection assembly are fixed on the inner wall of the tubular hollow probe protective shell through the base respectively. The stability of the element is good, and the stability of the detection result is further improved.
By adopting the scheme of the embodiment, the shape of the hollow probe protective shell is similar to that of the pipe cavity to be detected, when the multi-mode endoscopic probe is placed into the pipe cavity to be detected, the axial direction of the tubular hollow probe protective shell basically follows the axis of the pipe cavity to be detected, so that the tubular hollow probe protective shell can conveniently move in the pipe cavity, and the pipe cavity can be comprehensively detected.
By adopting the scheme of the embodiment, the multimode endoscopic probe is small in size and can be well suitable for detecting the lumen with small diameter.
By adopting the scheme of the embodiment, the three imaging modes have two modes of forward scanning and lateral scanning, so that in-vivo diagnosis of lumens and tube wall tissues of a respiratory system, a digestive system, a urinary system and the like with different scales and different resolutions can be conveniently realized, multiple dimensional information of diseases is obtained, and accurate diagnosis of the diseases is realized.
Further, in one embodiment, in combination with fig. 2, the imaging device further includes a three-dimensional scanning system for three-dimensional imaging of the lumen tissue to be measured, the system is controlled by a computer, and includes a rotating device for driving the multimode endoscopic probe to rotate 360 ° to realize 360 ° scanning imaging, and a translating device for driving the multimode endoscopic probe to move along the length direction of the lumen to realize the imaging in the length direction of the lumen.
Here, the rotating device may exemplarily include a rotating platform and a first motion controller driving the rotating platform to rotate, and the translating device may include a translating platform and a second motion controller driving the translating platform to move. The rotary platform is arranged on the translation platform, and a catheter connected with the multimode endoscopic probe is arranged on the rotary platform. The computer generates a trigger signal to control the motion controller to work after passing through the delay circuit, and the motion controller drives the rotating platform or the moving platform to move so as to drive the catheter to rotate or translate, and further drive the multimode endoscopic probe to rotate or translate. Wherein, the time delay circuit can make the probe rotate or translate after scanning a position.
Here, the motion controller may be a stepping motor.
By adopting the scheme of the embodiment, the information of any position in the to-be-measured tube cavity can be obtained.
Further, in one embodiment, the timing control of the imaging device of the present invention is: the computer generates a trigger signal, and the three paths of delay circuits respectively and sequentially excite the laser module to generate laser, excite the ultrasonic module to emit ultrasonic waves and excite the pulse laser module to generate pulse laser; the timing sequence of the three-way delay circuit is generated by a computer-controlled FPGA, and an example of a time sequence is shown in fig. 5.
Here, the three-way delay circuit can be replaced by a one-way delay circuit with three-way output.
By adopting the scheme of the embodiment, synchronous triggering imaging among three imaging modes can be realized, and subsequent analysis is utilized and the analysis precision is improved by comparing the three imaging results.
The technical features of the above embodiments can be arbitrarily combined, and for the sake of brevity, all possible combinations of the technical features in the above embodiments are not described, but should be considered as the scope of the present specification as long as there is no contradiction between the combinations of the technical features.
The above-mentioned embodiments only express several embodiments of the present application, and the description thereof is more specific and detailed, but not construed as limiting the scope of the utility model. It should be noted that, for a person skilled in the art, several variations and modifications can be made without departing from the concept of the present application, which falls within the scope of protection of the present application. Therefore, the protection scope of the present patent shall be subject to the appended claims.

Claims (8)

1. A multi-mode microscopic endoscopic imaging device is characterized by comprising a confocal endoscopic imaging system, a photoacoustic endoscopic imaging system, an ultrasonic endoscopic imaging system, a multi-mode endoscopic probe and a computer;
the confocal endoscopic imaging system includes: the device comprises a laser module, a first light guide module, a photoelectric conversion module and a first signal acquisition module; the computer generates a trigger signal to excite the laser module to generate laser, the laser is transmitted to the multimode endoscopic probe through the first light guide module, the multimode endoscopic probe focuses the laser on the lumen tissue to be detected to excite fluorescence and collect fluorescence signals, the fluorescence signals are transmitted to the computer after sequentially passing through the photoelectric conversion module and the first signal collection module, and a confocal endoscopic image is constructed through the computer processing;
the photoacoustic endoscopic imaging system comprises: the device comprises a pulse laser module, a second light guide module and a second signal acquisition module; the computer generates a trigger signal to excite the pulse laser module to generate pulse laser, the pulse laser is transmitted to the multimode endoscopic probe through the second light guide module, the multimode endoscopic probe focuses the pulse laser on the lumen tissue to be detected to form a light spot and excites the light spot to generate an acoustic signal, the ultrasonic module integrated in the multimode endoscopic probe collects the acoustic signal and converts the acoustic signal into an electric signal, and then the electric signal is transmitted to the computer through the second signal collection module and processed by the computer to construct a photoacoustic endoscopic image;
the ultrasonic endoscopic imaging system comprises: the ultrasonic module and the third signal acquisition module are integrated in the multimode endoscopic probe; the computer generates a trigger signal to excite the ultrasonic module to emit ultrasonic waves, the ultrasonic module receives the ultrasonic waves reflected by the lumen tissue to be detected and transmits the ultrasonic waves to the computer through the third signal acquisition module, and the ultrasonic endoscopic images are constructed through the processing of the computer.
2. The apparatus according to claim 1, wherein the laser/pulse laser module comprises N lasers/pulse lasers arranged in parallel, and the lasers/pulse lasers at one end are sequentially denoted as a first laser/pulse laser to an nth laser/pulse laser, respectively, and further comprises a reflecting mirror and second to nth dichroic mirrors respectively arranged on output optical paths of the first laser/pulse laser to the nth laser/pulse laser, the reflecting mirror and the second to nth dichroic mirrors are coaxially arranged, and reflected light from the reflecting mirror is coupled with light beams incident on the second to nth-1 dichroic mirrors and then enters the light guide module.
3. The multi-modal microscopic endoscopic imaging apparatus according to claim 1, wherein said ultrasound module comprises an ultrasound transducer and a signal line transmitting an ultrasound signal.
4. The multi-modal microscopic endoscopic imaging apparatus according to claim 1, wherein said second light guide module comprises: the device comprises a beam expanding collimation system, a first dichroic mirror, a first focusing system and a first optical fiber; pulse laser generated by the pulse laser module is converted into parallel light through the beam expanding and collimating system and enters the first dichroic mirror, and transmitted light of the first dichroic mirror is coupled to the first optical fiber through the first focusing system and then transmitted to the multimode endoscopic probe along the first optical fiber;
the first light guide module comprises a second light guide module and further comprises: a filter focusing system; laser generated by the laser module is changed into parallel light after passing through the beam expanding and collimating system and enters the first dichroic mirror, transmitted light of the first dichroic mirror is coupled to the first optical fiber through the first focusing system and then is transmitted to the multimode endoscopic probe along the first optical fiber, the multimode endoscopic probe focuses the laser on lumen tissues to be measured to excite fluorescence and collect fluorescence signals, and the fluorescence signals return along the first optical fiber and are transmitted to the photoelectric conversion module after being reflected by the first dichroic mirror, entering the light filtering and focusing system.
5. The multi-modal microscopy endoscopic imaging apparatus according to claim 4, wherein the second light guide module further comprises a second focusing system; the laser/pulse laser is coupled to the second optical fiber through the second focusing system and transmitted to the beam expanding collimation system through the second optical fiber before being changed into parallel light through the beam expanding collimation system and entering the first dichroic mirror.
6. The apparatus according to claim 1, wherein the multi-modal endoscopic microscopy probe comprises a tubular hollow probe shell, and an expanded beam focusing system and a MEMS galvanometer disposed inside the hollow probe shell;
the multimode endoscopic probe adopts a lateral scanning structure, light beams transmitted by the light guide module enter the MEMS galvanometer after passing through the beam expanding and focusing system, and the light beams are deflected by the MEMS galvanometer and then are emitted from an opening arranged on the side wall of the hollow probe protective shell to realize lateral focusing;
or the multimode endoscopic probe adopts a forward scanning structure, the multimode endoscopic probe further comprises a reflecting assembly, light beams transmitted by the light guide module are reflected to the MEMS vibrating mirror by the reflecting assembly after passing through the beam expanding focusing system, and the light beams are emitted from the radial surface of the hollow probe protective shell after being deflected by the MEMS vibrating mirror, so that forward focusing is realized.
7. The apparatus according to claim 1 or 6, wherein the imaging apparatus further comprises a three-dimensional scanning system for three-dimensional imaging of the lumen tissue to be measured, the system is controlled by a computer, and comprises a rotating device for driving the multi-mode endoscopic probe to rotate 360 ° for 360 ° scanning imaging, and a translating device for driving the multi-mode endoscopic probe to move along the length direction of the lumen for imaging in the length direction of the lumen.
8. The multi-modality microscopic endoscopic imaging apparatus according to claim 1, wherein the timing control of the imaging apparatus is: the computer generates a trigger signal, and the three paths of delay circuits respectively and sequentially excite the laser module to generate laser, excite the ultrasonic module to emit ultrasonic waves and excite the pulse laser module to generate pulse laser; the time sequence of the three paths of delay circuits is generated by the FPGA controlled by the computer.
CN202020488222.3U 2020-04-07 2020-04-07 Multi-mode microscopic endoscopic imaging device Active CN212307814U (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202020488222.3U CN212307814U (en) 2020-04-07 2020-04-07 Multi-mode microscopic endoscopic imaging device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202020488222.3U CN212307814U (en) 2020-04-07 2020-04-07 Multi-mode microscopic endoscopic imaging device

Publications (1)

Publication Number Publication Date
CN212307814U true CN212307814U (en) 2021-01-08

Family

ID=74019681

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202020488222.3U Active CN212307814U (en) 2020-04-07 2020-04-07 Multi-mode microscopic endoscopic imaging device

Country Status (1)

Country Link
CN (1) CN212307814U (en)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111387947A (en) * 2020-04-07 2020-07-10 中国科学院苏州生物医学工程技术研究所 Multi-mode microscopic endoscopic imaging device and method
CN112664180A (en) * 2021-03-18 2021-04-16 武汉中岩科技股份有限公司 Detection probe, detector and control method for detecting hole forming and groove forming by scanning method
CN113349708A (en) * 2021-06-08 2021-09-07 之江实验室 Dual-mode high-resolution large-depth microscopic endoscopic imaging system based on large dispersion lens
CN116299837A (en) * 2023-01-04 2023-06-23 华中科技大学 Preparation method of full-light type lateral photoinduced ultrasonic self-collecting optical fiber endoscope

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111387947A (en) * 2020-04-07 2020-07-10 中国科学院苏州生物医学工程技术研究所 Multi-mode microscopic endoscopic imaging device and method
CN112664180A (en) * 2021-03-18 2021-04-16 武汉中岩科技股份有限公司 Detection probe, detector and control method for detecting hole forming and groove forming by scanning method
CN113349708A (en) * 2021-06-08 2021-09-07 之江实验室 Dual-mode high-resolution large-depth microscopic endoscopic imaging system based on large dispersion lens
CN113349708B (en) * 2021-06-08 2023-05-26 之江实验室 Bimodal high-resolution large-depth microscopic endoscopic imaging system based on large-dispersion lens
CN116299837A (en) * 2023-01-04 2023-06-23 华中科技大学 Preparation method of full-light type lateral photoinduced ultrasonic self-collecting optical fiber endoscope
CN116299837B (en) * 2023-01-04 2024-03-15 华中科技大学 Preparation method of full-light type lateral photoinduced ultrasonic self-collecting optical fiber endoscope

Similar Documents

Publication Publication Date Title
CN212307814U (en) Multi-mode microscopic endoscopic imaging device
Zhou et al. Photoacoustic imaging with fiber optic technology: A review
US9513276B2 (en) Method and apparatus for optical imaging via spectral encoding
EP2209412B1 (en) Multi-path, multi-magnification, non-confocal fluorescence emission endoscopy apparatus and methods
CN102824154B (en) Combined endoscope imaging system based on OCT (Optical Coherence Tomography) and imaging method
WO2015003449A1 (en) Optoacoustic-fluorescence dual-mode endoscope
CN103462645B (en) Forward sight Photoacoustic endoscope
CN108670177B (en) Imaging probe of breast duct endoscope
CN113397481B (en) photoacoustic-OCT bimodal endoscopic imaging system and method based on optical fiber scanning
JP2006204430A (en) Tomographic image acquisition device
CN113812929B (en) Multi-modal imaging device
CN111387947A (en) Multi-mode microscopic endoscopic imaging device and method
Li et al. Miniature probe for forward-view wide-field optical-resolution photoacoustic endoscopy
KR101356708B1 (en) Multi-modal Confocal Endo-microscope for Natural Orifice Transluminal Endoscopic Surgery
CN115568820A (en) All-fiber photoacoustic endoscopic imaging device and system based on far-end scanning
CN209899367U (en) Bimodal endoscope device based on liquid lens self-focusing
WO2020113570A1 (en) Multi-mode cholangiopancreatography system
CN218899431U (en) Imaging probe
CN213216842U (en) Confocal laser oral cavity micro-endoscope system
CN116262027A (en) Multi-point focusing photoacoustic endoscopic imaging catheter
Huang et al. Multimodal Optical Imaging by Microendoscope
CN115251811A (en) Large-depth photoacoustic multi-mode flexible endoscopic imaging probe based on micro stepping motor
CN115281620A (en) Imaging probe
CN117752289A (en) Multi-mode broad spectrum endoscopic imaging device and imaging method

Legal Events

Date Code Title Description
GR01 Patent grant
GR01 Patent grant