WO2024075895A1

WO2024075895A1 - Image processing system using confocal fluorescence microscope

Info

Publication number: WO2024075895A1
Application number: PCT/KR2022/019587
Authority: WO
Inventors: 김규영; 김영렬; 황경민
Original assignee: 주식회사 브이픽스메디칼
Priority date: 2022-10-05
Filing date: 2022-12-05
Publication date: 2024-04-11

Abstract

An optical system according to an embodiment of the present disclosure comprises: a first laser coupled to a first optical fiber and a second laser coupled to a second optical fiber; an optical fiber coupler comprising the first optical fiber, the second optical fiber, and a third optical fiber coupled to each other so that a first beam propagating through the first optical fiber and a second beam propagating through the second optical fiber are simultaneously propagated through the third optical fiber; and a light propagation module through which the first beam and the second beam output from the optical fiber coupler are propagated.

Description

Image processing system using confocal fluorescence microscopy

The present disclosure relates to an image processing system using a confocal fluorescence microscope, and more specifically, the structure of an optical system mounted on a confocal fluorescence microscope equipped with a multi-wavelength or short-wavelength laser beam, and the structure of the confocal fluorescence microscope. It relates to the structure of the probe cover provided on the probe and image stitching using a confocal fluorescence microscope.

Confocal fluorescence microscopy is used to observe organs inside the human body, such as the stomach, bronchi, esophagus, duodenum, and rectum, where lesions cannot be directly seen by medical experts, and to use them for cancer diagnosis or treatment such as surgery.

To observe organs inside the human body using a confocal fluorescence microscope, a fluorescent contrast agent that is harmless to the human body is first injected through the capillaries. Then, when the injected fluorescent agent spreads to the cell tissue through the capillaries, a laser beam is irradiated to the cell tissue while a confocal fluorescence microscope is in contact with the cell tissue (or lesion tissue), and is emitted from the cell tissue. Receives emission light. By performing imaging processing using the received and emitted light, cellular tissue can be observed at a magnified level at the microscopic level.

In the process of irradiating a laser beam to a cell tissue to observe the cell tissue using a confocal fluorescence microscope, a laser beam of short wavelength or multiple wavelengths (e.g., two or more wavelengths) may be used.

In addition, when the probe of a confocal fluorescence microscope is entered into the body, the probe may be covered with a sterilized probe cover to ensure the hygiene of the subject.

In addition, the field of view (fov) of a confocal fluorescence microscope is hundreds of um, and large-area images of several millimeters may be required for medical experts to observe and diagnose tissue images of lesions. Therefore, it is necessary to secure large-area images in the order of several millimeters by stitching tissue images of hundreds of micrometers.

In order to observe cell tissue using a confocal fluorescence microscope equipped with a multi-wavelength laser beam, a plurality of laser beams irradiated or radiated from a plurality of lasers must be focused on the optical fiber core. do.

At this time, in order to adjust the optical system (or optical members of the optical system) so that all of the plurality of laser beams have high light-gathering efficiency, optical members corresponding to each of the plurality of laser beams must be adjusted. In other words, adjusting the optical system of a confocal fluorescence microscope equipped with a multi-wavelength laser beam is very difficult and may take a long time. Therefore, productivity in manufacturing optical module products equipped with the optical system may be low and tolerances between products may be large. Additionally, light efficiency may be reduced due to the number of optical members corresponding to each of the plurality of laser beams.

Therefore, structural features of optical module products may be required to efficiently adjust the optical system of a confocal fluorescence microscope equipped with a multi-wavelength laser beam.

In addition, during the process of attaching (inserting) the probe of a confocal fluorescence microscope (or confocal endoscopic microscope) to the probe cover, the distal end of the probe is changed due to the user's manipulation of the cover tip located at the distal end of the probe cover. Impact may be applied to the optical window, and such impact may cause the optical window to be damaged or detached from the probe cover.

Therefore, in the process of attaching (inserting) the probe of a confocal fluorescence microscope (or confocal endoscopic microscope) to the probe cover, even if the probe impacts the optical window of the cover tip located at the distal end of the probe cover, the optical window is not damaged. Structural features of the probe cover that prevent it from being damaged or detached may be required.

Additionally, in order for a medical professional to make a diagnosis through multiple images of tissue acquired through a confocal fluorescence microscope (or confocal endoscopic microscope), the multiple images must be stitched. However, an image processing device that is connected to a confocal fluorescence microscope and processes a plurality of images may need location information for each of the plurality of images in order to stitch the plurality of images.

A sensor module located on the probe body of a confocal fluorescence microscope (or confocal endoscopic microscope) may acquire location information of the probe body and/or sensor module when an image processing device acquires a plurality of images. Meanwhile, while the image processing device acquires a plurality of images, the probe tip of the confocal fluorescence microscope moves in a state of substantially contacting the tissue, and the position information of the plurality of images is the position information of the probe tip. may be substantially the same as Additionally, since the location of the probe body and the location of the probe tip (or distal end) are separated by a predetermined distance, the location information of the sensor module located in the probe body and the location information of the probe tip may be different. Therefore, in order to stitch a plurality of images, it is necessary to use the position information of each of the plurality of images, but by stitching the plurality of images using the position information of the sensor module located at a predetermined distance from the position of the plurality of images. Errors may occur.

Therefore, the image processing device calibrates (or corrects) the positional information of the sensor module located in the probe body with the positional information of the probe tip and provides the corrected positional information of the probe tip (or distal end of the probe) adjacent to the tissue. A method may be needed to obtain and stitch a plurality of images by projecting them onto a virtual plane based on the position information of the probe tip.

The object ( An optical system for irradiating an object, acquiring emission light emitted from the object, and processing the obtained emission light includes the first laser and the second optical fiber coupled to the first optical fiber. The second laser coupled to the first optical fiber, the first optical fiber, and the third optical fiber such that the first beam propagating through the first optical fiber and the second beam propagating through the second optical fiber are simultaneously propagated through the third optical fiber. It may include an optical fiber coupler coupled with two optical fibers and a third optical fiber, and an optical propagation module through which the first beam and the second beam output from the optical fiber coupler propagate. The light propagation module includes an optical path along which the first beam, the second beam, and the emitted light propagate, a plurality of optical members, a first collimator coupled to the third optical fiber, and the It may include a second collimator coupled to a fourth optical fiber and coupled to a probe for irradiating the first beam and the second beam to the object.

It is mounted on a confocal fluorescence microscope according to an embodiment of the present disclosure to irradiate a first beam of a first wavelength to an object, acquire emission light emitted from the object, and obtain the obtained An optical system that processes emitted light may include a first laser coupled to a first optical fiber, and a light propagation module through which the first beam output from the first laser propagates. The light propagation module includes an optical path along which the first beam and the emitted light propagate, a plurality of optical members, a first collimator coupled to the first optical fiber, and the light propagation module. It may include a second collimator coupled to a second optical fiber and coupled to a probe for irradiating the first beam to the object.

A probe cover surrounding a probe of a confocal fluorescence microscope (or confocal endomicroscope) according to an embodiment of the present disclosure may include a cover tube. The cover tube may include a first part accommodating the probe tube of the probe and a second part accommodating a probe nut located at a proximal end of the probe tube. The first portion may include a first region having an outer diameter of a first length and a second region having an outer diameter of a second length longer than the first length. A first protruding part may be formed on the outer surface of the second part, and a plurality of second protruding parts may be formed on the inner surface of the second part. The probe cover is coupled to the distal end of the cover tube and may include a cover tip including an optical window and an elastic member. The elastic member may surround the entire outer surface of the first region, a first side of the elastic member may be adhered to a portion of the second region, and a second side of the elastic member may be bonded to a portion of the optical window. The probe cover may include a cover nut, and a receiving groove may be formed on an inner surface of the cover nut, and the receiving groove may be coupled to the first protrusion of the second portion. The probe cover may include a cover drape that is fused and bonded over the entire outer surface of the cover nut.

Stitching a plurality of images acquired through a probe of a confocal fluorescence microscope (or confocal endomicroscope) in an in-vivo environment according to an embodiment of the present disclosure. The image processing device may include at least one processor included in the probe and electrically connected to a sensor that acquires location information. The at least one processor may acquire a first image of a first region of the tissue at a first viewpoint using the probe, and obtain first location information of the sensor corresponding to the first viewpoint. there is. The at least one processor acquires first calibrated location information as location information of the first image based on the first location information and a predetermined parameter, and uses the probe to obtain a second viewpoint. A second image of the second region of the tissue may be obtained. The at least one processor acquires second location information of the sensor corresponding to the second viewpoint, and based on the second location information and the predetermined parameter, generates a second corrected image as location information of the second image. Location information may be acquired, and the first image and the second image may be stitched based on the first corrected location information and the second corrected location information.

An image processing device that acquires a plurality of images through a probe of a confocal fluorescence microscope (or confocal endomicroscope) in an in-vivo environment according to an embodiment of the present disclosure It may include at least one processor electrically connected to a sensor that acquires location information included in the probe. At least one processor may acquire a first image of a first area of the tissue at a first viewpoint using the probe, and obtain first location information of the sensor corresponding to the first viewpoint. At least one processor may acquire first calibrated location information based on the first location information and a predetermined parameter, and may convert the first calibrated location information and the obtained first image into an image. It can be transmitted to an external device that performs stitching. At least one processor may acquire a second image of a second region of the tissue at a second viewpoint using the probe, and obtain second location information of the sensor corresponding to the second viewpoint. . At least one processor may acquire second corrected location information based on the second location information and the predetermined parameter, and transmit the second corrected location information and the obtained second image to the external device. there is.

According to an embodiment of the present disclosure, the optical system of a confocal fluorescence microscope equipped with a multi-wavelength laser beam can efficiently focus the multi-wavelength laser beam on the optical fiber core to have high concentrating efficiency by providing a collimator.

According to an embodiment of the present disclosure, productivity of optical module products equipped with an optical system of a confocal fluorescence microscope can be increased, and tolerances between products can be reduced.

According to an embodiment of the present disclosure, the optical system of a confocal fluorescence microscope equipped with a multi-wavelength laser beam can reduce the number of optical members by providing a collimator, thereby increasing light efficiency.

According to an embodiment of the present disclosure, the optical system of the confocal fluorescence microscope is provided with a rail on which optical members can move, so that the user can selectively use a confocal fluorescence microscope equipped with a short-wavelength or multi-wavelength laser beam, User convenience can be increased.

According to an embodiment of the present disclosure, in the process of attaching (inserting) the probe to the probe cover, even if the distal end of the probe impacts the optical window of the cover tip located at the distal end of the probe cover, the Impact can be alleviated by the elastic force of the elastic member, thereby preventing the optical window from being damaged or detached from the probe cover.

According to one embodiment of the present disclosure, the elastic member of the cover tip prevents the optical window from being broken or detached from the probe cover, so that while observing the inside of the body through a probe covered with a probe cover, a part of the probe cover (e.g., It can prevent problems (broken optical windows) remaining in the body.

According to an embodiment of the present disclosure, errors that may occur when stitching images due to differences in positional information between the sensor module and the probe tip can be reduced or prevented.

According to an embodiment of the present disclosure, the location information of the image acquired through the confocal endoscopy microscope is obtained more precisely and the stitching of the images is performed precisely, thereby providing high-resolution stitched images to the user of the confocal endoscopy microscope. can do.

In addition, various effects that can be directly or indirectly realized through the present disclosure may be provided.

FIG. 1 is a diagram illustrating a multi-wavelength optical system using a plurality of lasers as a light source according to an embodiment.

FIG. 2 is a diagram for explaining an optical path included in a light propagation module according to an embodiment.

FIG. 3 explains a light propagation module including an optical path according to an embodiment.

FIG. 4 is a diagram for explaining a first beam splitter, a second beam splitter, a first filter, and a second filter according to an embodiment.

FIG. 5 is a diagram for explaining a light propagation module including a third filter according to an embodiment.

FIG. 6 is a diagram illustrating an arrangement structure of a plurality of optical members of FIG. 5 in an optical path according to an embodiment.

FIG. 7 is a diagram for explaining an arrangement structure of a plurality of optical members in an optical path according to an embodiment.

FIG. 8 is a diagram illustrating a short-wavelength optical system using a first laser as a light source according to an embodiment.

FIG. 9 is a diagram illustrating a short-wavelength optical system using a first laser as a light source according to an embodiment.

FIG. 10 is a diagram illustrating a short-wavelength optical system using a second laser as a light source according to an embodiment.

FIG. 11 is a diagram illustrating a short-wavelength optical system using a second laser as a light source according to an embodiment.

FIG. 12 is a diagram illustrating a multi-wavelength optical system using a plurality of lasers as a light source according to an embodiment.

FIG. 13 is a diagram for explaining a first beam splitter, a second beam splitter, a first filter, and a second filter according to an embodiment.

FIG. 14 is a diagram for explaining a first beam splitter, a second beam splitter, a first filter, and a second filter according to an embodiment.

FIG. 15 is a diagram for explaining the positions of a plurality of optical members in an optical system according to an embodiment.

FIG. 16 is a diagram for explaining specifications of a first beam splitter, a second beam splitter, a first filter, and a second filter according to an embodiment.

FIG. 17 is a diagram for explaining an optical system including one laser according to an embodiment.

FIG. 18 is a diagram for explaining an optical system including one laser according to an embodiment.

FIG. 19 is a diagram for explaining movement of a second beam splitter within an optical path according to an embodiment.

Figure 20 is a diagram for explaining a probe cover accommodating a probe according to one embodiment.

FIG. 21 is an enlarged view of portion A of FIG. 1 according to an embodiment.

FIG. 22 is an enlarged view of portion B of FIG. 1 according to an embodiment.

Figure 23 is a diagram for explaining a process in which an elastic member is stretched according to an embodiment.

Figure 24 is a diagram for explaining an elastic member according to one embodiment.

Figure 25 is a diagram for explaining an elastic member according to one embodiment.

Figure 26 is a diagram for explaining elastic members according to various embodiments.

Figure 27 is a diagram for explaining an elastic member including a guide portion according to various embodiments.

Figure 28 is a diagram for explaining an elastic member including an elastic member and a guide portion according to an embodiment.

FIG. 29 is a diagram for explaining an optical window formed of an elastic member according to an embodiment.

FIG. 30 is a diagram for explaining an optical window formed of an elastic member according to an embodiment.

FIG. 31 is a diagram for explaining an optical window formed of an elastic member according to an embodiment.

Figure 32 is a diagram showing an actual photo of a probe cover according to one embodiment.

Figure 33 is a diagram showing an actual photograph of a probe cover and a probe according to an embodiment.

FIG. 34 is a diagram illustrating a probe that does not include a bending portion and a probe cover for a probe that does not include a bending portion, according to an embodiment.

Figure 35 is a diagram for explaining a probe according to one embodiment.

Figure 36 is a diagram for explaining the difference between the position of the sensor module and the position of the probe tip according to one embodiment.

Figure 37 is a diagram for explaining stitching of images acquired through a probe according to an embodiment.

Figure 38 is a diagram for explaining a method of obtaining corrected location information according to an embodiment.

Figure 39 is a diagram for explaining a method of stitching a first image and a second image according to an embodiment.

Figure 40 is a diagram for explaining a method of stitching 3D images according to an embodiment.

FIG. 41 is a diagram illustrating a method of stitching multiple images using corrected location information according to an embodiment.

Figure 42 is a diagram for explaining programs mounted on an image processing device according to an embodiment.

Figure 43 is a diagram for explaining a first program and a second program mounted on different devices according to an embodiment.

FIG. 44 is a diagram for explaining an organization displayed in a panoramic display in the example of FIG. 8 according to an embodiment.

In relation to the description of the drawings, identical or similar reference numerals may be used for identical or similar components.

Hereinafter, various embodiments of the present invention are described with reference to the accompanying drawings. However, this is not intended to limit the present invention to specific embodiments, and should be understood to include various modifications, equivalents, and/or alternatives to the embodiments of the present invention.

The present disclosure relates to an image processing system using a confocal fluorescence microscope, wherein the image processing system includes an optical system (e.g., light propagation module) of the confocal fluorescence microscope, and a plurality of lasers (or light sources). Laser beams radiating from the optical system propagate to the probe of the confocal fluorescence microscope, the laser beams are irradiated from the probe to an object (e.g., body tissue), and the image processing system emits light from the object. An image of the object can be obtained by processing the emitted light. The image processing device may obtain a large-area image by stitching the acquired image. A medical expert can diagnose a lesion on the object by observing a large-area image acquired through the image processing device.

Referring to FIG. 1, a multi-wavelength optical system 101 (or multi-wavelength confocal fluorescence microscope) according to an embodiment includes a plurality of lasers 110, a light propagation module 120, and a plurality of optical fibers 130. ), optical fiber coupler 140, a plurality of collimators 150, first pinhole 161, second pinhole 162, first photodetector 171, second photodetector 172 ), and/or a probe 180. The photodetector (eg, the first photodetector 171 and the second photodetector 172) may include a photo multiplier tube (PMT).

According to one embodiment, the plurality of optical fibers 130 may include a first optical fiber 131, a second optical fiber 132, a third optical fiber 133, and/or a fourth optical fiber 134. The term optical fiber in the present disclosure may refer to a member through which beams output from the plurality of lasers 110 pass, transmit, or propagate, and may be replaced by the term connection member.

According to one embodiment, the plurality of lasers 110 may include a first laser 111 and a second laser 112. The plurality of lasers 110 may correspond to a light source in the optical system 101. For example, each of the plurality of lasers 110 may be a pigtail laser diode (LD).

According to one embodiment, the first laser 111 may emit a first beam (or light ray) of a first wavelength (eg, a wavelength corresponding to 450 nm to 500 nm). For example, the first laser 111 may emit a first beam having a wavelength of the first value. This is not limited to the meaning that the first beam only has a wavelength value of the first value. For example, the first beam may correspond to light having a wavelength range of a specified range (eg, 450 nm to 500 nm), and the wavelength value of the highest peak among the wavelength values in the wavelength range may be the first value. The second laser 112 may emit a second beam (or light ray) of a second wavelength (eg, a wavelength corresponding to 750 nm to 800 nm). The second laser 112 may emit a second beam having a wavelength of a second value. This is not limited to the meaning that the second beam only has a wavelength value of the second value. For example, the second beam may correspond to light having a wavelength range of a specified range (eg, 750 nm to 800 nm), and the wavelength value of the highest peak among the wavelength values in the wavelength range may be the second value. According to one embodiment, the first beam of the first laser 111 may be blue light (eg, cyan). The second beam of the second laser 112 may be red light.

According to one embodiment, the plurality of lasers 110 may be connected to the optical fiber coupler 140. For example, the first laser 111 may be connected to the optical fiber coupler 140 through the first optical fiber 131, and the second laser 112 may be connected to the optical fiber coupler 140 through the second optical fiber 132. can be connected

According to one embodiment, the optical fiber coupler 140 may be connected to the light propagation module 120. For example, the first collimator 151 may be connected to the light propagation module 120, and the optical fiber coupler 140 may be connected to the first collimator 151 of the light propagation module 120 through the third optical fiber 133. can be connected As a result, the optical fiber coupler 140 may be connected to the light propagation module 120 through the third optical fiber 133 and the first collimator 151. In one embodiment, the first collimator 151 may correspond to a fiber port. The first collimator 151 may include a collimating lens. The collimating lens may refer to a lens that adjusts the optical path of incident light to be parallel. The collimating lens included in the first collimator 151 may be an achromatic coating lens to prevent chromatic aberration of two wavelengths.

According to one embodiment, the optical fiber coupler 140 is mentioned as a separate component from the first optical fiber 131, the second optical fiber 132, and the third optical fiber 133, but is not limited thereto. For example, the optical fiber coupler 140 may be understood as an element connected to the first optical fiber 131, the second optical fiber 132, and the third optical fiber 133.

According to one embodiment, the first beam and the second beam output from the optical fiber coupler 140 may be propagated to the light propagation module 120. For example, the first beam output from the first laser 111 is transmitted through the first optical fiber 131, the optical fiber coupler 140, the third optical fiber 133, and the first collimator 151 to the light propagation module 120. ) can be spread. For example, the second beam output from the second laser 112 is transmitted through the second optical fiber 132, the optical fiber coupler 140, the third optical fiber 133, and the first collimator 151 to the light propagation module 120. ) can be spread.

According to one embodiment, the light propagation module 120 may include a plurality of optical members. For example, the light propagation module 120 includes a first beam splitter 121, a second beam splitter 122, a first filter 123, a second filter 124, and a first lens 125. ), and/or a second lens 126.

According to one embodiment, the first filter 123 may be disposed between the first beam splitter 121 and the first photodetector 171. A first lens 125 may be disposed between the first filter 123 and the first photodetector 171. In one embodiment, a first lens 125 is disposed between the first lens 125 and the first photodetector 171. A pinhole 161 may be disposed.

According to one embodiment, the second filter 124 may be disposed between the second beam splitter 122 and the second photodetector 172. A second lens 126 may be disposed between the second filter 124 and the second photodetector 172. In one embodiment, a second pinhole 162 may be disposed between the second lens 126 and the second photodetector 172.

According to one embodiment, the light propagation module 120 may be connected to the probe 180. For example, the light propagation module 120 may include a second collimator 152, and the second collimator 152 may be connected to the probe 180 through the fourth optical fiber 134. In one embodiment, the second collimator 152 may correspond to a fiber port. The second collimator 152 may include a collimating lens. The collimating lens may refer to a lens that adjusts the optical path of incident light to be parallel. The collimating lens included in the second collimator 151 may be an achromatic coating lens to prevent chromatic aberration of two wavelengths.

According to one embodiment, the first beam emitted from the first laser 111 may be incident on the object 190 (eg, a cell). The first emission light formed as the first beam is irradiated to the object 190 may propagate to the first photodetector 171. For example, the first beam emitted from the first laser 111 may be reflected by the second beam splitter 122. The first beam reflected by the second beam splitter 122 may pass through the first beam splitter 121 and propagate to the probe 180 through the fourth optical fiber 134. The first beam propagated by the probe 180 may be incident on the object 190.

In one example, the first emission light formed as the first beam is irradiated to the object 190 may propagate to the light propagation module 120 through the fourth optical fiber 134. The first emission light propagated through the light propagation module 120 may be reflected by the first beam splitter 121. The first emission light reflected by the first beam splitter 121 may pass through the first filter 123, the first lens 125, and the first pinhole 161 and propagate to the first photodetector 171. . The first photodetector 171 may amplify the propagated first emission light.

According to one embodiment, the first emission light amplified by the first photodetector 171 may be used to observe the object 190 (eg, a cell) or a lesion associated with the object 190.

According to one embodiment, the first emission light may be formed by exciting the first beam. For example, the first emission light formed as the first beam of the first wavelength is incident on the object 190 may have a wavelength higher than the first wavelength.

According to one embodiment, the first filter 123 may correspond to a band pass filter. The first lens 125 can adjust the focusing of the beam incident on the first lens 125.

According to one embodiment, the second beam emitted from the second laser 112 may be incident on the object 190 (eg, a cell). The second emission light formed as the second beam is irradiated to the object 190 may propagate to the second photodetector 172. For example, the second beam emitted from the second laser 112 may be reflected by the second beam splitter 122. The second beam reflected by the second beam splitter 122 may pass through the first beam splitter 121 and propagate to the probe 180 through the fourth optical fiber 143. The second beam propagated through the probe 180 may be incident on the object 190.

In one example, the second emission light formed as the second beam is irradiated to the object 190 may propagate to the light propagation module 120 through the fourth optical fiber 134. The second emission light propagated through the light propagation module 120 may pass through the first beam splitter 121. The second emission light that has passed through the first beam splitter 121 may pass through the second filter 124, the second lens 126, and the second pinhole 162 and propagate to the second photodetector 172. . The second photodetector 172 may amplify the propagated second emission light.

According to one embodiment, the second emission light may be formed by exciting the second beam. For example, the second emission light formed as the second beam of the second wavelength is incident on the object 190 may have a wavelength higher than the second wavelength.

According to one embodiment, the second emission light amplified by the second photodetector 172 may be used to observe the object 190 (eg, a cell) or a lesion associated with the object 190.

According to one embodiment, the second filter 124 may correspond to a long pass filter. The second lens 126 can adjust the focusing of the beam incident on the second lens 126.

According to one embodiment, since the optical system 101 includes the optical fiber coupler 140, beams emitted from the plurality of lasers 110 can be easily gathered on the optical fiber. For example, when the optical fiber coupler 140 is not included in the optical system 101, the beams emitted from the plurality of lasers 110 are radiated in free space, so they are connected to one optical fiber (e.g., the third optical fiber 133). ) may be difficult to gather in. On the other hand, when the optical system 101 according to an embodiment includes an optical fiber coupler 140, the beams emitted from the plurality of lasers 110 are transmitted through one optical fiber (e.g., a third optical fiber) through the optical fiber coupler 140. It can be gathered relatively easily into the optical fiber 133). As a result, as the optical system 101 is included in the optical fiber coupler 140, the efficiency (or light collection efficiency) of gathering a plurality of beams into one optical fiber can be increased.

The term light propagation module of the present disclosure may be changed to a light propagation circuit, an optical circuit, a confocal fluorescence microscope, or an optical endoscope circuit.

The term propagate in the present disclosure may be replaced with the terms transfer, delivery, or transmit.

The plurality of lasers 110 of the present disclosure have been described as including two lasers (eg, the first laser 111 and the second laser 112), but this is only an example. For example, the plurality of lasers 110 may further include additional lasers that are distinct from the first laser 111 and the second laser 112. As an example, the plurality of lasers 110 may further include a third laser, and the third laser may radiate or irradiate a beam of a different wavelength from the first laser 111 and the second laser 112. there is.

Referring to FIG. 2, the light propagation module 120 according to one embodiment may include an optical path 210. The optical path 210 may correspond to a propagation path of beams emitted from the first laser 111 and/or the second laser 112.

According to one embodiment, the optical path 210 may include a first part 211, a second part 212, and/or a third part 213.

According to one embodiment, the first part 211 may connect the first collimator 151 and the second collimator 152. For example, the first part 211 may include a first connection part 231 and a second connection part 232. The first connection part 231 may be connected to the first collimator 151, and the second connection part 232 may be connected to the second collimator 152. In one example, the first connection part 231 may be referred to as a coupled part or joint where the first collimator 151 and the first part 211 are connected in FIG. 6, which will be described later. . In one example, the second connection part 231 may be referred to as a coupling part or joining part where the second collimator 152 and the first part 211 are connected in FIG. 6, which will be described later.

According to one embodiment, the second part 212 may extend from the first part 211 and be connected to the first photodetector 171. For example, the second part 212 may include a third connection part 233. The third connection part 233 may be connected to the first photodetector 171.

According to one embodiment, the third part 213 may extend from the first part 211 and be connected to the second photodetector 172. For example, the third portion 213 may include a fourth connection portion 234. The fourth connection portion 234 may be connected to the second photodetector 172.

According to one embodiment, grooves may be formed in the optical path 210 to accommodate a plurality of optical members. For example, the first portion 211 includes a first groove 221 for accommodating the beam splitter, a second groove 222 for accommodating the first beam splitter 121, and a second beam splitter 122. A third groove 223 may be formed to accommodate. For example, a fourth groove 224 may be formed in the second portion 212 to accommodate the first filter 123. For example, a fifth groove 225 may be formed in the third portion 213 to accommodate the second filter 124, and a sixth groove 226 may be formed to accommodate the second filter 124. can be formed.

According to one embodiment, the optical path 210 may further include a fourth portion 214. In one embodiment, the fourth portion 214 may extend from the first portion 211 . The fourth part 214 may be connected to the fifth connection part 235 to which the third collimator can be coupled. As a result, the fourth part 214 can connect the first part 211 and the fifth connection part 235.

According to one embodiment, since the light propagation module 120 includes a plurality of grooves, the light propagation module 120 can be selectively used as a short-wavelength or multi-wavelength module. For example, when the light propagation module 120 is used as a short-wavelength module, the beam splitter may be disposed in only one of the first groove 221, the second groove 222, and the third groove 223. For another example, when the light propagation module 120 is used as a multi-wavelength module, the beam splitter may be placed in only two of the first groove 221, the second groove 222, and the third groove 223. there is. As a result, the light propagation module 120 can be selectively used as a short-wavelength module or a multi-wavelength module.

Meanwhile, even when beam splitters are disposed in all of the first groove 221, the second groove 222, and the third groove 223, in the embodiment disclosed in FIG. 19, the beam splitter can be selectively used as a short-wavelength module or a multi-wavelength module. You can. Details about this are described later in FIG. 19.

According to one embodiment, the optical path 210 may have various shapes. For example, the optical path 210 may have a cylindrical shape. However, this is just an example. For example, the optical path 210 may have a rectangular parallelepiped shape. For example, the first part 211 of the optical path 210 may have a cylindrical shape, and the second part 212 of the optical path 210 may have a rectangular parallelepiped shape.

According to one embodiment, a fixing member may be disposed in each of the plurality of grooves, and the fixing member may fix the optical member to the groove. For example, a fixing member may be disposed in the third groove 223, and the fixing member may fix the second beam splitter 122 disposed in the third groove 223 to the third groove 223. .

In the present disclosure, the optical path 210 is described as including a first part 211, a second part 212, a third part 213, and a fourth part 214, but this is only an example. For example, the optical path 210 may include only the first part 211, the second part 212, and the third part 213, and may not include the fourth part 214. Hereinafter, in FIG. 3, an optical path not including the fourth portion 214 will be described.

In the present disclosure, the optical path 210 is described as including a first part 211, a second part 212, a third part 213, and a fourth part 214, but this is only an example. For example, the first part can be replaced by the first light path, the second part can be replaced by the second light path, the third part can be replaced by the third light path, and the fourth part can be replaced by the fourth light path. can be replaced with

The term optical path in the present disclosure may be replaced with the term track, path, or duct.

FIG. 3 explains an optical propagation module including an optical path according to an embodiment.

Referring to FIG. 3 , the optical path 310 according to one embodiment may include a first part 311, a second part 312, and a third part 313.

According to one embodiment, grooves may be formed in the optical path 310 to accommodate a plurality of optical members. For example, a first groove 321 for accommodating the first beam splitter 121 and a second groove 322 for accommodating the second beam splitter 122 may be formed in the first portion 311. You can. For example, a third groove 323 may be formed in the second portion 312 to accommodate the first filter 123. For example, a fourth groove 324 may be formed in the third portion 313 to accommodate the second filter 124, and a fifth groove 325 may be formed to accommodate the second filter 124. can be formed.

Referring to FIG. 4, the first beam splitter 121 according to an embodiment has a first wavelength (e.g., a wavelength corresponding to about 450 nm to 550 nm) and a second wavelength larger than the first wavelength (e.g., a wavelength corresponding to about 550 nm to 550 nm). A beam having a wavelength corresponding to the first wavelength range (wavelength corresponding to 650 nm) may not be transmitted. That is, the first beam splitter 121 may reflect a beam having a wavelength between the first wavelength and the second wavelength.

According to one embodiment, the second beam splitter 122 may transmit a beam corresponding to a second wavelength band of a third wavelength (eg, a wavelength corresponding to about 750 nm to 850 nm) or more. The third wavelength (eg, a wavelength corresponding to approximately 750 nm to 850 nm) may be a larger wavelength than the second wavelength (eg, a wavelength corresponding to approximately 550 nm to 650 nm). The second beam splitter 122 may not transmit a beam having a wavelength less than the third wavelength. That is, the second beam splitter 122 may reflect a beam having a wavelength less than the third wavelength.

According to one embodiment, the first filter 123 includes a fourth wavelength (e.g., a wavelength corresponding to about 450 nm to 530 nm) and a fifth wavelength that is larger than the fourth wavelength (e.g., a wavelength corresponding to about 530 nm to 600 nm). ) can transmit a beam having a wavelength corresponding to the third wavelength band. The first filter 123 may block a beam having a wavelength lower than the fourth wavelength or higher than the fifth wavelength. Accordingly, the first filter may correspond to a band pass filter.

According to one embodiment, the second filter 124 may transmit a beam having a wavelength corresponding to a fourth wavelength band that is larger than the sixth wavelength (e.g., a wavelength corresponding to about 750 nm to 850 nm). The sixth wavelength may be a larger wavelength than the fifth wavelength. The second filter 124 may block a beam having a wavelength lower than the sixth wavelength. Accordingly, the second filter 124 may correspond to a long pass filter.

According to one embodiment, the first wavelength band of the first beam splitter 121 may at least partially overlap with the third wavelength band of the first filter 123. For example, the first emission light may be reflected from the first beam splitter 121, pass through the first filter 123, and propagate to the first photodetector 171. Accordingly, the first and third wavelength bands may overlap at least partially.

According to one embodiment, the second wavelength band of the second beam splitter 122 may at least partially overlap with the fourth wavelength band of the second filter 124. For example, the second emission light may need to pass through the second beam splitter 122 and the second filter 124 and propagate to the second photodetector 172. Accordingly, the second and fourth wavelength bands may overlap at least partially.

Referring to FIG. 5 , the light propagation module 120 according to an embodiment may include a third filter 524 and/or a fourth filter 525.

The third filter 524 of FIG. 5 of the present disclosure may substantially correspond to the second filter 124 of FIG. 1 . That is, the third filter 524, like the second filter 124, may also correspond to a long pass filter (LPF). The embodiment of FIG. 5 of the present disclosure may be understood as an embodiment in which a fourth filter 525 is added to the embodiment of FIG. 1 .

According to one embodiment, the third filter 524 and the fourth filter 525 are disposed between the second beam splitter 122 and the second lens 126, resulting in higher filtering compared to the case where one filter is disposed. Efficiency can be secured.

According to one embodiment, the first beam splitter 121 may be placed in the first groove 221 of FIG. 2, and the second beam splitter 122 may be placed in the third groove 223 of FIG. 2. there is.

FIG. 6 is a diagram for explaining an arrangement structure of a plurality of optical members of FIG. 5 in an optical path according to an embodiment.

Referring to FIG. 6 , the light propagation module 120 according to an embodiment may include a plurality of optical members, and the plurality of optical members may each be disposed in the optical path 210. In one embodiment, the first beam splitter 121 may be disposed in the first portion 211. The first beam splitter 121 disposed in the first part 211 may transmit beams passing through the first part 211. For example, the first beam splitter 121 may transmit the first beam of the first laser 111 and the second beam of the second laser 112. The first beam splitter 121 disposed in the first part 211 may reflect or transmit emitted light passing through the first part 211. For example, the first beam splitter 121 may reflect the first emission light passing through the first part 211 and transmit the second emission light passing through the first part 211.

According to one embodiment, the second beam splitter 122 may be disposed in the first portion 211. The second beam splitter 122 disposed in the first part 211 may reflect beams passing through the first part 211. For example, the second beam splitter 122 may reflect the first beam of the first laser 111 and the second beam of the second laser. The second beam splitter 122 disposed in the first part 211 may transmit the emitted light passing through the first part 211. For example, the second beam splitter 122 may transmit the second emission light passing through the first portion 211.

According to one embodiment, the first filter 123 may be disposed in the second portion 212. The first filter 123 disposed in the second portion 212 may be a band pass filter that passes a designated wavelength band (eg, a wavelength band between the third and fourth wavelengths in FIG. 4). In one embodiment, the first lens 125 may be disposed in the second portion 212, and the first lens 125 may adjust the focusing of the incident first emitted light.

According to one embodiment, the third filter 524 may be disposed in the third portion 213. The third filter 524 disposed in the third portion 213 may be a band-pass filter that passes a designated wavelength (e.g., a wavelength band greater than or equal to the sixth wavelength in FIG. 4). In one embodiment, the second lens 126 may be disposed in the third portion 213, and the second lens 126 may adjust the focusing of the incident second emitted light.

According to one embodiment, the fourth filter 525 may be disposed in the third portion 213. The fourth filter 525 disposed in the third portion 213 may be a long pass filter (LPF) that passes a designated wavelength (e.g., a wavelength band greater than or equal to the sixth wavelength in FIG. 4).

In FIG. 6 of the present disclosure, the light propagation module 120 is described as including both a third filter 524 and a fourth filter 525 in the third portion 213, but this is only an example. The light propagation module 120 may include only the third filter 524 and the fourth filter 525. That is, at least one of the third filter 524 and the fourth filter 525 may be omitted.

According to one embodiment, the first portion 211 of the optical path 210 may connect the first collimator 151 and the second collimator 152. The second part 212 of the optical path 210 may extend from the first part 211 and be connected to the first connection port 653, and the second part 212 may be connected to the first connection port 653. 1 can be connected to the photodetector 171. The third part 213 of the optical path 210 may extend from the first part 211 and be connected to the second connection port 654, and the third part 213 may be connected to the second connection port 654. 2 can be connected to the photodetector 172.

FIG. 7 is a diagram illustrating an arrangement structure of a plurality of optical members in an optical path according to an embodiment of the present invention.

Referring to FIG. 7 , the light propagation module 120 of FIG. 7 according to an embodiment may not include the fourth filter 525 compared to the light propagation module of FIG. 6 .

The embodiment of FIG. 7 of the present disclosure may correspond to an embodiment in which the fourth filter 525 is removed from the embodiment of FIG. 6 .

Referring to FIG. 8, a short-wavelength optical system 801 (or short-wavelength confocal fluorescence microscope) according to an embodiment includes a first laser 811, a light propagation module 820, a first beam splitter 821, and a first laser 811. 2 beam splitter 822, first optical fiber 831, second optical fiber 832, plurality of collimators 850, first filter 823, first lens 825, first pinhole 861, and /Or may include a first photo detector (photo multiplier tube) 871.

8 of the present disclosure, the first laser 811, the light propagation module 820, a plurality of collimators 850, the first filter 823, the first lens 825, the first pinhole 861, and the first The photodetector 871 sequentially includes the first laser 111 of FIG. 1, the light propagation module 120, a plurality of collimators 150, the first filter 123, the first lens 125, and the first pinhole ( 161) and the first photodetector 171. Therefore, the first laser 111, the light propagation module 120, the plurality of collimators 150, the first filter 123, the first lens 125, the first pinhole 161, and The description of the first photodetector 171 includes the first laser 811 of FIG. 8, the light propagation module 820, a plurality of collimators 850, the first filter 823, the first lens 825, and the first lens 825. 1 It can be applied to the pinhole 861 and the first photodetector 871.

The first beam splitter 821 and the second beam splitter 822 of FIG. 8 of the present disclosure may correspond to the first beam splitter 121 and the second beam splitter 122 of FIG. 1, respectively.

According to one embodiment, the first laser 811 may be connected to the first collimator 851 through the first optical fiber 831. In one embodiment, the light propagation module 820 may be connected to the probe through the second optical fiber 832. The first collimator 851 and the second collimator 852 may each include a collimating lens. The collimating lens may refer to a lens that adjusts the optical path of incident light to be parallel. The collimating lenses included in each of the first collimator 851 and the second collimator 852 shown in FIG. 8 are collimators included in each of the first collimator 151 and the second collimator 152 shown in FIG. 1. Some of the features may be different from those of the camera lens. For example, the collimating lens in Figure 1 includes a function to adjust the optical path of the incident light to be parallel as well as a function to prevent chromatic aberration of the two wavelengths, but the collimating lens in Figure 8 has a function to adjust the optical path of the incident light to be parallel. It only has the function of adjusting the furnace to be parallel.

According to one embodiment, the first beam emitted from the first laser 811 may be reflected by the second beam splitter 822, and the first beam reflected by the second beam splitter 822 may be reflected by the first beam splitter 822. It can pass through the beam splitter 821. The transmitted first beam splitter 821 may propagate to the probe through the second collimator 852 and the second optical fiber 832.

According to one embodiment, the first emission light may be formed as the first beam is incident from the probe to the object (eg, the object 190 in FIG. 1). The first emission light may propagate to the light propagation module 820 through the second optical fiber 832. The first emission light may be reflected by the first beam splitter 821. The reflected first emission light may pass through the first filter 823, the first lens 825, and the first pinhole 861 and propagate to the first photodetector 871.

According to one embodiment, the first emission light has a relatively high wavelength compared to the first beam, so the first beam may pass through the first beam splitter 821, and the first emission light may pass through the first beam splitter (821). 821) and may be reflected.

According to one embodiment, the first beam splitter 821 may be placed in the second groove 222 of FIG. 2, and the second beam splitter 822 may be placed in the third groove 223 of FIG. 2. there is.

Referring to FIG. 9, a short-wavelength optical system 901 (or short-wavelength confocal fluorescence microscope) according to an embodiment includes a first laser 911, a light propagation module 920, a first optical fiber 931, and a second Optical fiber 932, second beam splitter 922, second filter 924, second lens 926, plurality of collimators 950, second pinhole 962, and/or first photodetector 971 ) may include.

9 of the present disclosure, the first laser 911, the light propagation module 920, a plurality of collimators 950, the second beam splitter 922, the second lens 926, the second pinhole 962, and the 1 The photodetector 971 sequentially includes the first laser 111 of FIG. 1, the light propagation module 120, a plurality of collimators 150, the second beam splitter 122, the second lens 126, and the second It may correspond to the pinhole 162 and the first photodetector 171. Therefore, the first laser 111, the light propagation module 120, the plurality of collimators 150, the second beam splitter 122, the second lens 126, and the second pinhole 162 of FIG. 1 of the present disclosure And the description of the first photodetector 171 includes the first laser 911, light propagation module 920, plurality of collimators 950, second beam splitter 922, and It can be applied to the second lens 926, the second pinhole 962, and the first photodetector 971.

According to one embodiment, the second filter 924 may be a band pass filter.

According to one embodiment, the first laser 911 may be connected to the first collimator 951 through the first optical fiber 931. In one embodiment, the light propagation module 920 may be connected to the probe through the second optical fiber 932.

According to one embodiment, the first beam emitted from the first laser 911 may be reflected by the second beam splitter 922, and the first beam reflected by the second beam splitter 922 may be reflected by the second beam splitter 922. It may propagate to the probe through the collimator 952 and the second optical fiber 932.

According to one embodiment, the first emission light may be formed as the first beam is incident from the probe to the object (eg, the object 190 in FIG. 1). The first emission light may propagate to the light propagation module 920 through the second optical fiber 932. The first emission light may pass through the second filter 924, the second lens 926, and the second pinhole 962 and propagate to the first photodetector 971.

According to one embodiment, the second beam splitter 922 may be placed in the third groove 223.

Referring to FIG. 10, a short-wavelength optical system 1001 (or short-wavelength confocal fluorescence microscope) according to an embodiment includes a second laser 1012, a light propagation module 1020, a first optical fiber 1031, and a second Optical fiber 1032, second beam splitter 1022, second filter 1024, second lens 1026, plurality of collimators 1050, second pinhole 1062, and/or second photodetector 1072 ) may include.

10 of the present disclosure includes a second laser 1012, a light propagation module 1020, a plurality of collimators 1050, a second beam splitter 1022, a second filter 1024, a

second lens

1026, 2 The pinhole 1062 and the second photodetector 1072 are sequentially connected to the second laser 112 of FIG. 1, the light propagation module 120, a plurality of collimators 150, the second beam splitter 122, and the second It may correspond to the filter 124, the second lens 126, the second pinhole 162, and the second photodetector 172. Accordingly, the second laser 112, the light propagation module 120, the plurality of collimators 150, the second beam splitter 122, the second filter 124, and the second lens 126 of FIG. 1 of the present disclosure. , the description of the second pinhole 162 and the second photodetector 172 includes the second laser 1012, the light propagation module 1020, the plurality of collimators 1050, and the second laser 1012, the light propagation module 1020, the plurality of

collimators

1050, and 2 It can be applied to the beam splitter 1022, the second filter 1024, the second lens 1026, the second pinhole 1062, and the second photodetector 1072.

According to one embodiment, the second laser 1012 may be connected to the first collimator 1051 through the first optical fiber 1031. In one embodiment, the light propagation module 1020 may be connected to the probe through the second optical fiber 1032.

According to one embodiment, the second beam emitted from the second laser 1011 may be reflected by the second beam splitter 1022, and the second beam reflected by the second beam splitter 1022 may be reflected by the second beam splitter 1022. It may propagate to the probe through the collimator 1052 and the second optical fiber 1032.

According to one embodiment, second emission light may be formed as the second beam is incident from the probe to the object (eg, object 190 in FIG. 1). The second emission light may propagate to the light propagation module 1020 through the second optical fiber 1032. The second emission light may pass through the second filter 1024, the second lens 1026, and the second pinhole 1062 and propagate to the second photodetector 1072.

According to one embodiment, the second beam splitter 1022 may be placed in the third groove 223.

Referring to FIG. 11, a short-wavelength optical system 1101 (or short-wavelength confocal fluorescence microscope) according to an embodiment includes a second laser 1112, a light propagation module 1120, a first optical fiber 1131, and a second Optical fiber 1132, second beam splitter 1122, second filter 1124, second lens 1126, plurality of collimators 1150, second pinhole 1162, and/or second photodetector 1172 ) may include.

11 of the present disclosure, the second laser 1112, the light propagation module 1120, a plurality of collimators 1150, the second beam splitter 1122, the second lens 1126, the second pinhole 1162, and the first 2 The photodetector 1172 sequentially includes the second laser 112 of FIG. 1, the light propagation module 120, a plurality of collimators 150, the second beam splitter 122, the second lens 126, and the second It may correspond to the pinhole 162 and the second photodetector 172. Therefore, the first laser 111, the light propagation module 120, the plurality of collimators 150, the second beam splitter 122, the second lens 126, and the second pinhole 162 of FIG. 1 of the present disclosure And the description of the second photodetector 172 includes the second laser 1112, light propagation module 1120, plurality of collimators 1150, second beam splitter 1122, and It can be applied to the second lens 1126, the second pinhole 1162, and the second photodetector 1172.

According to one embodiment, the second filter 1124 may be a band pass filter. Therefore, the second filter 1124 of FIG. 11 of the present disclosure may correspond to the second filter 924 of FIG. 9, and the description of the second filter 924 of FIG. 9 includes the second filter 1124 of FIG. 11. ) can be applied.

According to one embodiment, the second laser 1112 may be connected to the first collimator 1151 through the first optical fiber 1131. In one embodiment, the light propagation module 1120 may be connected to the probe through the second optical fiber 1132.

According to one embodiment, the second beam emitted from the second laser 1112 may be reflected by the second beam splitter 1122, and the second beam reflected by the second beam splitter 1122 may be reflected by the second beam splitter 1122. It may propagate to the probe through the collimator 1152 and the second optical fiber 1132.

According to one embodiment, second emission light may be formed as the second beam is incident from the probe to the object (eg, object 190 in FIG. 1). The second emission light may propagate to the light propagation module 1120 through the second optical fiber 1132. The second emission light may pass through the second filter 1124, the second lens 1126, and the second pinhole 1162 and propagate to the second photodetector 1172.

Referring to FIG. 12, a multi-wavelength optical system 1201 (or multi-wavelength confocal fluorescence microscope) according to an embodiment includes a plurality of lasers 1210, a light propagation module 1220, and a plurality of optical fibers 1230. ), an optical fiber coupler 140, a plurality of collimators 1250, a first pinhole 1261, a second pinhole 1262, a first photodetector 1271, a second photodetector 1272, and/or a probe ( 1280).

The plurality of lasers 1210 in FIG. 12 may include a different laser from the plurality of lasers 110 in FIG. 1 . For example, the plurality of lasers 1210 in FIG. 12 may include a first laser 1211 and a second laser 1212. The first laser 1211 may emit a beam of a first wavelength (eg, a wavelength corresponding to 450 nm to 500 nm). The second laser 1212 may emit a beam of a third wavelength (eg, a wavelength corresponding to between 350 nm and 450 nm). On the other hand, the plurality of lasers 110 in FIG. 1 include a first laser 111 that emits a beam of a first wavelength (e.g., a wavelength corresponding to 450 nm to 500 nm) and a second wavelength (e.g., 750 nm to 800 nm). It may include a second laser 112 that radiates a beam of a wavelength corresponding to the wavelength.

As a result, in the embodiment of FIG. 12, the second laser 112, which emits a beam of the second wavelength (e.g., a wavelength corresponding to 750 nm to 800 nm) of FIG. 1, emits a beam of a third wavelength (e.g., a wavelength corresponding to between 350 nm and 450 nm). It may correspond to an embodiment in which the second laser 1212 emits a beam of a corresponding wavelength).

Unlike the second filter 1224 of FIG. 1, the second filter 1224 of FIG. 12 may be a band pass filter. For example, the second filter 1224 in FIG. 1 may be a long pass filter, while the second filter 1224 in FIG. 12 may be a band pass filter. Additionally, in FIG. 12, the second filter 1224 is described as one, but this is only an example. For example, the light propagation module 1220 may further include a second filter 1224 and a third filter disposed in parallel with the second filter 1224.

According to one embodiment, the plurality of lasers 1210 may include a first laser 1211 and a second laser 1212. A plurality of lasers 1210 may correspond to light sources in the optical system 1201. For example, each of the plurality of lasers 1210 may be a pigtail laser diode (LD).

According to one embodiment, the plurality of lasers 1210 may be connected to the optical fiber coupler 1240. For example, the first laser 1211 may be connected to the optical fiber coupler 1240 through the first optical fiber 1231, and the second laser 1212 may be connected to the optical fiber coupler 1240 through the second optical fiber 1232. can be connected

According to one embodiment, the optical fiber coupler 1240 may be connected to the light propagation module 1220. For example, the light propagation module 1220 may include a first collimator 1251, and the optical fiber coupler 1240 may connect the first collimator 1251 of the light propagation module 1220 through the third optical fiber 1233. can be connected to As a result, the optical fiber coupler 1240 may be connected to the light propagation module 1220 through the third optical fiber 1233 and the first collimator 1251. In one embodiment, the first collimator 1251 may correspond to a fiber port.

According to one embodiment, the first beam and the second beam output from the optical fiber coupler 1240 may be propagated to the light propagation module 1220. For example, the first beam output from the first laser 1211 is transmitted through the first optical fiber 1231, the optical fiber coupler 1240, the third optical fiber 1233, and the first collimator 1251 to the light propagation module 1220. ) can be spread. For example, the second beam output from the second laser 1212 is transmitted through the second optical fiber 1232, the optical fiber coupler 1240, the third optical fiber 1233, and the first collimator 1251 to the light propagation module 1220. ) can be spread.

According to one embodiment, the light propagation module 1220 may include a plurality of optical members. For example, the light propagation module 1220 includes a first beam splitter 1221, a second beam splitter 1222, a first filter 1223, a second filter 1224, a first lens 1225, and/ Alternatively, it may include a second lens 1226.

According to one embodiment, a first filter 1223 may be disposed between the first beam splitter 1221 and the first photodetector 1271. A first lens 1225 may be disposed between the first filter 1223 and the first photodetector 1271. In one embodiment, a first lens 1225 is disposed between the first lens 1225 and the first photodetector 1271. A pinhole 1261 may be disposed.

According to one embodiment, a second filter 1224 may be disposed between the second beam splitter 1222 and the second photodetector 1272. A second lens 1226 may be disposed between the second filter 1224 and the second photodetector 1272. In one embodiment, a second pinhole 1262 may be disposed between the second lens 1226 and the second photodetector 1272.

According to one embodiment, the light propagation module 1220 may be connected to the probe 1280. For example, the light propagation module 1220 may include a second collimator 1252, and the second collimator 1252 may be connected to the probe 1280 through the fourth optical fiber 1234. In one embodiment, the second collimator 1252 may correspond to a fiber port.

According to one embodiment, the first beam emitted from the first laser 1211 may be incident on the object 1290. The first emission light formed as the first beam is irradiated to the object 1290 may propagate to the first photodetector 1271. For example, the first beam emitted from the first laser 1211 may be reflected by the second beam splitter 1222. The first beam reflected by the second beam splitter 1222 may pass through the first beam splitter 1221 and propagate to the probe 1280 through the fourth optical fiber 1234. The first beam propagated by the probe 1280 may be incident on the object 1290.

In one example, the first emission light formed as the first beam is irradiated to the object 1290 may propagate to the light propagation module 1220 through the fourth optical fiber 1234. The first emission light propagated through the light propagation module 1220 may be reflected by the first beam splitter 1221. The first emission light reflected by the first beam splitter 1221 may pass through the first filter 1223, the first lens 1225, and the first pinhole 1261 and propagate to the first photodetector 1271. . The first photodetector 1271 may amplify the propagated first emission light.

According to one embodiment, the first emission light may be formed by exciting the first beam. For example, the first emission light formed as the first beam of the first wavelength is incident on the object 1290 may have a wavelength higher than the first wavelength (eg, a wavelength corresponding to between 350 nm and 450 nm).

According to one embodiment, the first filter 1223 may correspond to a band pass filter. The first lens 1225 can adjust the focusing of the beam incident on the first lens 1225.

According to one embodiment, the second beam emitted from the second laser 1212 may be incident on an object. The second emission light formed as the second beam is irradiated to the object 1290 may propagate to the second photodetector 1272. For example, the second beam emitted from the second laser 1212 may be reflected by the second beam splitter 1222. The second beam reflected by the second beam splitter 1222 may pass through the first beam splitter 1221 and propagate to the probe 1280 through the fourth optical fiber 1243. The second beam propagated by the probe 1280 may be incident on the object.

In one example, the second emission light formed as the second beam is irradiated to the object may propagate to the light propagation module 1220 through the fourth optical fiber 1234. The second emission light propagated through the light propagation module 1220 may pass through the first beam splitter 1221. The second emission light that has passed through the first beam splitter 1221 may pass through the second filter 1224, the second lens 1226, and the second pinhole 1262 and propagate to the second photodetector 1272. . The second photodetector 1272 may amplify the propagated second emission light.

According to one embodiment, the second emission light may be formed by exciting the second beam. For example, the second emission light formed as the second beam of the second wavelength is incident on the object 1290 may have a wavelength higher than the second wavelength.

According to one embodiment, the second filter 1224 may correspond to a long pass filter. The second lens 1226 may adjust the focusing of the beam incident on the second lens 1226.

According to one embodiment, the first photodetector 1271 may be a photodetector for a first beam of a first wavelength (eg, a wavelength corresponding to 350 nm to 450 nm). For example, the first photodetector 1271 may detect first emission emitted from the object 1290 in response to a first beam of a first wavelength (e.g., a wavelength corresponding to between 350 nm and 450 nm) being incident on the object 1290. Light can be received, and the first emitted light can be amplified.

According to one embodiment, the second photodetector 1272 may be a photodetector for a second beam of a third wavelength (eg, a wavelength corresponding to between 450 nm and 500 nm). For example, the second photodetector 1272 may detect a second beam of a second wavelength (e.g., a wavelength corresponding to between 450 nm and 500 nm) incident on the object 1290 to detect a second emission emitted from the object 1290. Light can be received, and the second emitted light can be amplified.

Referring to FIG. 13, the first beam splitter 1221 according to one embodiment has a seventh wavelength (e.g., a wavelength corresponding to about 450 nm to 500 nm) and an eighth wavelength larger than the seventh wavelength (e.g., a wavelength corresponding to about 500 nm to 500 nm). The beam corresponding to the fifth wavelength band (wavelength corresponding to 550 nm) may not be transmitted. That is, the first beam splitter 1221 may reflect the beam corresponding to the fifth wavelength band between the seventh and eighth wavelengths.

According to one embodiment, the second beam splitter 1222 may transmit a beam corresponding to a sixth wavelength band greater than the eighth wavelength (e.g., a wavelength corresponding to about 450 nm to 500 nm). The second beam splitter 1222 may not transmit a beam having a wavelength less than the ninth wavelength. That is, the second beam splitter 1222 can reflect a beam having a wavelength less than the ninth wavelength.

According to one embodiment, the first filter 1223 has a 10th wavelength (e.g., a wavelength corresponding to about 400 nm to 450 nm) and an 11th wavelength larger than the 10th wavelength (e.g., a wavelength corresponding to about 450 nm to 500 nm). ) can transmit the beam corresponding to the 7th wavelength band. The first filter 1223 may block a beam having a wavelength lower than the tenth wavelength or greater than the eleventh wavelength. Accordingly, the first filter 1223 may correspond to a band pass filter.

According to one embodiment, the second filter 1224 includes a 12th wavelength (e.g., a wavelength corresponding to about 450 nm to 530 nm) and a 13th wavelength larger than the 12th wavelength (e.g., a wavelength corresponding to about 530 nm to 600 nm). ) can transmit the beam corresponding to the 8th wavelength band. The second filter 1224 may block beams having a wavelength lower than the 12th wavelength or greater than the 13th wavelength. Accordingly, the second filter 1224 may correspond to a band pass filter.

Referring to FIG. 14, a multi-wavelength optical system 1401 (or multi-wavelength confocal fluorescence microscope) according to an embodiment includes a plurality of lasers 1410, a light propagation module 1420, and a plurality of optical fibers 1430. ), an optical fiber coupler 1440, a plurality of collimators 1450, a first pinhole 1461, a second pinhole 1462, a first photodetector 1471, and/or a second photodetector 1472. You can.

According to one embodiment, a plurality of lasers 1410, a plurality of optical fibers 1430, an optical fiber coupler 1440, a plurality of collimators 1450, a first pinhole 1461, and a second pinhole 1462 of FIG. 14 ), the first photodetector 1471 and the second photodetector 1472 respectively sequentially include a plurality of lasers 1210, a plurality of optical fibers 1230, an optical fiber coupler 1240, and a plurality of collimators ( 1250), the first pinhole 1261, the second pinhole 1262, the first photodetector 1271, and the second photodetector 1272.

According to one embodiment, the light propagation module 1420 may include a plurality of optical members. A plurality of optical members include a first beam splitter 1421, a second beam splitter 1422, a first filter 1423, a first lens 1424, a second filter 1425, and a second lens 1426. It can be included.

According to one embodiment, the plurality of optical members of the light propagation module 1420 of FIG. 14 may be arranged differently from the optical members of the light propagation module 1220 of FIG. 12.

For example, the first beam splitter 1421 of FIG. 14 may be placed in the first groove 221 of FIG. 2. On the other hand, the first beam splitter 1221 of FIG. 12 may be placed in the second groove 222 of FIG. 2. Additionally, the second beam splitter 1422 of FIG. 14 may be disposed in the second groove 222 of FIG. 2. On the other hand, the second beam splitter 1222 of FIG. 12 may be placed in the third groove 223.

According to one embodiment, the first beam output from the optical fiber coupler 1440 may be reflected by the first beam splitter 1421. The reflected first beam may propagate to the probe through the fourth optical fiber 1434, and the first beam may be output from the probe and reflected on an object (eg, the object 170 in FIG. 1). The first emission light formed as the first beam is reflected by the object may propagate to the light propagation module 1420 through the probe and the fourth optical fiber 1434. The first emission light may pass through the first beam splitter 1421, the second beam splitter 1422, the second filter 1425, the second lens 1426, and the second pinhole 1462. The transmitted first emission light may propagate to the second photodetector 1472.

According to one embodiment, the second beam output from the optical fiber coupler 1440 may be reflected by the first beam splitter 1421. The reflected second beam may propagate to the probe through the fourth optical fiber 1434, and the second beam may be output from the probe and reflected on an object (eg, the object 170 in FIG. 1). The second emission light formed as the second beam reflects off the object may propagate to the light propagation module 1420 through the probe and the fourth optical fiber 1434. The second emission light may pass through the first beam splitter 1421 and be reflected by the second beam splitter 1422. The reflected second emission light may pass through the first filter 1423, the first lens 1424, and the first pinhole 1461, and may propagate to the first photodetector 1471.

Referring to FIG. 15 , the first collimator 1451 according to one embodiment may be connected to the fourth portion 214 of the optical path 210. The second collimator 1452 may be connected to the first portion 211 of the optical path 210. In one embodiment, the first connection port 1553 for connection to the first photodetector 1471 may be connected to the second portion 212. The second connection port 1554 for connection to the second photodetector 1472 may be connected to the third portion 213.

According to one embodiment, the first beam splitter 1421 may be placed in the first groove 221, and the second beam splitter 1422 may be placed in the second groove 222. The first filter 1423 may be placed in the fourth groove 224, and the second filter 1425 may be placed in the fifth groove 225.

According to one embodiment, the light propagation module 1420 may include a third filter 1525 in addition to the second filter 1425. The third filter 1525 may be a band pass filter substantially the same as the second filter 1425. The third filter 1525 may be disposed in the sixth groove 226.

In FIG. 15 of the present disclosure, the light propagation module 1420 is described as including a second filter 1425 and a third filter 1525, but this is only an example. For example, the light propagation module 1420 may include only one of the second filter 1425 and the third filter 1525.

Referring to FIG. 16, the first beam splitter 1421 according to one embodiment has a 14th wavelength (e.g., a wavelength corresponding to about 400 nm to 450 nm) and a 15th wavelength (e.g., a wavelength corresponding to about 450 nm to 500 nm). It can transmit the 9th wavelength band between wavelengths). The first beam splitter 1421 can transmit a 10th wavelength band between the 16th wavelength (e.g., a wavelength corresponding to about 500 nm to 550 nm) and the 17th wavelength (e.g., a wavelength corresponding to about 550 nm to 600 nm). there is. The first beam splitter 1421 may transmit an 11th wavelength band that is greater than or equal to the 18th wavelength (e.g., a wavelength corresponding to about 600 nm to 650 nm). As a result, the first beam splitter 1421 may have band pass characteristics that transmit a plurality of wavelength bands.

According to one embodiment, the second beam splitter 1422 may transmit a 12th wavelength band that is greater than or equal to the 19th wavelength (e.g., a wavelength corresponding to about 450 nm to 500 nm). As a result, the second beam splitter 1422 may have long pass characteristics.

According to one embodiment, the first filter 1423 is a 13th wavelength between the 20th wavelength (e.g., a wavelength corresponding to about 400 nm to 450 nm) and the 21st wavelength (e.g., a wavelength corresponding to about 450 nm to 500 nm) or less. Wavelengths can be transmitted. As a result, the first filter 1423 may be a band pass filter.

According to one embodiment, the second filter 1425 is a 14th filter that is between the 22nd wavelength (e.g., a wavelength corresponding to about 450 nm to 530 nm) and the 23rd wavelength (e.g., a wavelength corresponding to about 530 nm to 600 nm) or less. Wavelengths can be transmitted. As a result, the second filter 1425 may be a band pass filter.

Referring to FIG. 17, an optical system (or confocal fluorescence microscope) 1701 according to an embodiment includes a second laser 1412, a light propagation module 1720, a first collimator 1451, and/or a second May include a collimator 1452.

According to one embodiment, the second laser 1412 may emit or irradiate a beam of a third wavelength (eg, 405 nm).

According to one embodiment, the second laser 1412 may be connected to the first collimator 1451 through the first optical fiber 1431. In one embodiment, the first collimator 1451 is connected to the light propagation module 1720, and as a result, the second laser 1412 is connected to the light propagation module 17200 through the first optical fiber 14310 and the first collimator 1451. can be connected to

According to one embodiment, the light propagation module 1720 may be connected to the second optical fiber 1432 through the second collimator 1452, and as a result, the light propagation module 1720 connects the second optical fiber 1432 with the probe. can be connected

According to one embodiment, the light propagation module 1720 may include a first beam splitter 1421, a second beam splitter 1422, a first filter 1423, and a first lens 1424.

According to one embodiment, the beam of the third wavelength (e.g., a wavelength corresponding to 350 nm to 450 nm) emitted from the second laser 1412 is reflected by the first beam splitter 1421 and is sent to the second collimator 1452 and It may propagate to the second optical fiber 1432. The propagated beam may be irradiated to an object (eg, the object 190 in FIG. 1), and emission light may be formed. The formed emitted light may propagate to the second optical fiber 1432 through the probe. The emitted light may pass through the first beam splitter 1421 and be reflected by the second beam splitter 1422. The reflected emitted light may pass through the first filter 1423 and the first pinhole 1461 and propagate to the first photodetector 1471.

According to one embodiment, the beam of the third wavelength (e.g., a wavelength corresponding to 350 nm to 450 nm) emitted from the second laser 141 is reflected by the first beam splitter 1421, but the emitted light is emitted from the first beam. The reason why the emitted light passes through the splitter 1421 is because it has a relatively higher wavelength than the third wavelength beam. That is, as the beam of the third wavelength is reflected by the object, the emitted light may be excited and may have a relatively higher wavelength than the beam of the third wavelength.

According to one embodiment, the first beam splitter 1421 may be placed in the first groove 221 of FIG. 2, and the second beam splitter 1422 may be placed in the second groove 222 of FIG. 2. there is.

Referring to FIG. 18, an optical system (or confocal fluorescence microscope) 1801 according to an embodiment includes a second laser 1412, a light propagation module 1820, a first collimator 1451, and/or a second May include a collimator 1452.

According to one embodiment, the second laser 1412 may emit or irradiate a beam of a third wavelength (e.g., a wavelength corresponding to 350 nm to 450 nm).

According to one embodiment, the light propagation module 1820 may include a first beam splitter 1421, a second filter 1425, and a first lens 1426.

According to one embodiment, the beam of the third wavelength (e.g., a wavelength corresponding to 350 nm to 450 nm) emitted from the second laser 1412 is reflected by the first beam splitter 1421 and is sent to the second collimator 1452 and It may propagate to the second optical fiber 1432. The propagated beam may be irradiated to an object (eg, the object 190 in FIG. 1), and emission light may be formed. The formed emitted light may propagate to the second optical fiber 1432 through the probe. Emitted light may pass through the first beam splitter 1421. The reflected emitted light may pass through the second filter 1425 and the second pinhole 1462 and propagate to the first photodetector 1471.

According to one embodiment, the beam of the third wavelength (e.g., a wavelength corresponding to 350 nm to 450 nm) emitted from the second laser 141 is reflected by the first beam splitter 1421, but the emitted light is emitted from the first beam. The reason why the emitted light passes through the splitter 1421 is because it has a relatively higher wavelength than the third wavelength beam. That is, as the third wavelength beam is irradiated to the object, the third wavelength beam may be excited, and the emitted light may have a relatively higher wavelength than the third wavelength beam.

Referring to FIG. 19, a second beam splitter 1422 may be disposed in the first portion 211 of the optical path 210 according to one embodiment. FIG. 19 is a cross-section of the first part 211 viewed from the third part 213 toward the first part 211, based on the drawing of FIG. 15. A first rail 1921 may be formed on the upper edge of the first part 211 of the optical path 210, and a second rail 1922 may be formed on the lower edge of the first part 211. For example, the first rail 1921 and the second rail 1922 are aligned in a direction perpendicular to the longitudinal direction of the optical path 210 at both ends of the slot into which the second beam splitter 1422 can be inserted. It can be formed according to Both ends of the slot may be second grooves 222.

According to one embodiment, at least one processor of the optical system 101 positions the second beam splitter in the first portion 211 within the optical path 210 or moves the second beam splitter so that the second beam splitter is It can be controlled to move to a space 1910 other than the optical path 210. For example, at least one processor controls the first rail 1921 and the second rail 1922 when the second beam splitter 1422 is to be utilized as in the embodiment of FIG. 17 to create a second beam splitter ( 1422) can be controlled to be located in the first part 211. For another example, when the second beam splitter 1422 is not utilized as in the embodiment of FIG. 18, at least one processor controls the first rail 1921 and the second rail 1922 to split the second beam. Splitter 1422 can be moved to space 1910.

As a result, the at least one processor redirects the second beam splitter 1422 located at the first location (e.g., within the first portion 211 of the optical path 210) to a second location (e.g., in space) according to specified conditions. 1910), or the second beam splitter 1422 located in the second position can be moved to the first position.

According to one embodiment, when the second beam splitter 1422 moves out of the first part 211 of the optical path 210 and is located in the space 1910, the light propagation module (e.g., the light propagation module 1820) Beams or emitted light passing through the optical path 210 may not pass through the second beam splitter 1422.

According to one embodiment, the optical system 101 may increase compatibility of the light propagation module (eg, the light propagation module 1420) by controlling the position of the second beam splitter 1422. For example, beam splitters may be disposed in the first groove 221, the second groove 222, and the third groove 223 in the light propagation module 1420 shown in FIG. 15, respectively. In one example, at least one processor may move some of the beam splitters into the optical path 210 and some of the beam splitters out of the optical path 210 when a predetermined condition is satisfied.

As a result, the light propagation module 1420 can perform both the functions of a light propagation module using multiple wavelengths and a light propagation module using a short wavelength.

According to one embodiment, the optical system 101 may further include a display, and at least one processor may display the status of beam splitters disposed in the grooves of the light propagation module 1420 on the display. For example, at least one processor may display that the first beam splitter 121 of the first groove 221 is not disposed in the first portion 221 (eg, is in an out state). At least one processor may display that the second beam splitter 122 of the second groove 222 is disposed in the first portion 221 (eg, in state). As a result, at least one processor notifies the user whether the light propagation module 1420 is currently being used as a multi-wavelength module or a short-wavelength module by displaying the status of the beam splitters disposed in the light propagation module 1420. ) can. It is obvious to those skilled in the art that the explanation that the state of an optical member (eg, beam splitter) can be displayed on the display can equally be applied to filters (eg, first filter, second filter).

According to one embodiment, at least one processor may transmit the status of optical members displayed on the display to an external device (eg, a user's terminal). For example, at least one processor may transmit the status of the optical members to an external device so that a user located at a distance from the optical system 101 can identify the status of the optical members.

In FIG. 19 of the present disclosure, it is explained that the beam splitters are fixed to the rail of the optical path 210, but this is only an example. For example, in the embodiments of FIGS. 1 to 18 of the present application, the beam splitters may be fixed to the groove (eg, the first groove 221) and not move.

In FIG. 19 of the present disclosure, the description is based on the second beam splitter 1422, but this is only an example, and the content described in FIG. 19 may be substantially applied to other beam splitters. For example, the content described in FIG. 19 may be equally applied to the first beam splitter 1421.

In FIG. 19 of the present disclosure, the description is based on the second beam splitter 1422, but this is only an example, and the content described in FIG. 19 may also be substantially applied to filters. For example, the content described in FIG. 19 may be equally applied to the first filter 1423, the second filter 1425, and the third filter 1525.

In the present disclosure, it has been described that the movement of the second beam splitter 1422 is performed for the light propagation module 120 or at least one processor in the optical system 101, but this is only an example. The second beam splitter 1422 may be moved according to user input to the light propagation module 120 or the optical system 101.

The object ( An optical system for irradiating an object, acquiring emission light emitted from the object, and processing the obtained emission light includes the first laser coupled to a first optical fiber and the laser coupled to a second optical fiber. 2 May include lasers. The optical system connects the first optical fiber and the second optical fiber to a third optical fiber such that the first beam propagating through the first optical fiber and the second beam propagating through the second optical fiber simultaneously propagate through the third optical fiber. It may include an optical fiber coupler coupled to an optical fiber, and an optical propagation module through which the first beam and the second beam output from the optical fiber coupler propagate. The light propagation module includes an optical path through which the first beam, the second beam, and the emitted light propagate, a plurality of optical members, a first collimator and a first beam coupled to the third optical fiber. And it may include a second collimator coupled to the fourth optical fiber and coupled to a probe for irradiating the second beam to the object.

According to one embodiment, the plurality of optical members of the light propagation module are a first beam splitter that does not transmit a beam having a wavelength corresponding to a wavelength band between the first wavelength and a second wavelength greater than the first wavelength, And it may include a second beam splitter that does not transmit a beam having a wavelength corresponding to a wavelength band below a third wavelength that is greater than the second wavelength.

According to one embodiment, a beam that is not transmitted through the first beam splitter may be reflected by the first beam splitter. A beam that is not transmitted through the second beam splitter may be reflected by the second beam splitter.

According to one embodiment, the plurality of optical members of the light propagation module include a first filter that transmits only a beam having a wavelength corresponding to a wavelength band between a fourth wavelength and a fifth wavelength that is greater than the fourth wavelength, and the fifth wavelength. It may include a second filter that transmits a beam having a wavelength corresponding to a wavelength band greater than or equal to the sixth wavelength.

According to one embodiment, the first emission light emitted from the object in response to the first beam being irradiated to the object may have a wavelength corresponding to the wavelength range between the fourth wavelength and the fifth wavelength. . The second emission light emitted from the object in response to the second beam being irradiated to the object may have a wavelength corresponding to a wavelength range of the sixth wavelength or higher.

According to one embodiment, the light propagation module may further include a first photo detector (photo multiplier tube) and a second photo detector. The optical path of the light propagation module includes a first part connecting the first collimator and the second collimator, a second part extending from the first part and connected to the first photodetector, and extending from the first part. It may include a third part connected to the second photodetector.

According to one embodiment, the first emission light emitted from the object in response to the first beam being incident on the object may propagate to the first photodetector. Second emission light emitted from the object in response to the second beam being incident on the object may propagate to the second photodetector.

According to one embodiment, the light propagation module may include a first connection portion capable of being coupled to the first collimator and a fifth connection portion capable of being coupled to the third collimator. The optical path of the light propagation module includes a fourth part connecting the first part and the fifth connection part, and the first connection part is determined based on optical characteristics of the first laser and the second laser, or A collimator corresponding to the one connection part may be coupled to one of the fifth connection parts.

According to one embodiment, the plurality of optical members may include a first beam splitter and a second beam splitter. A first groove may be formed in the first portion of the optical path to accommodate the first beam splitter, and a second groove may be formed to accommodate the second beam splitter.

According to one embodiment, a first rail may be disposed in the second groove, and the second beam splitter may be fixed on the first rail. When the second beam splitter is in the first position on the first rail, the first beam and the second beam may be incident on the second beam splitter, and the second beam splitter may be incident on the first beam splitter. When moving a specified distance from the first position along the rail, the first beam and the second beam may not be incident on the second beam splitter.

According to one embodiment, the position of the second beam splitter on the first rail may be controlled by at least one processor included in the light propagation module or may be controlled according to user input.

According to one embodiment, the light propagation module includes a first beam splitter, a first filter, a first lens for controlling the focusing of the incident beam, a first pin hole, and a first photo detector (photo multiplier tube). It can be included. The first filter may be disposed between the first beam splitter and the first photodetector. The first lens may be disposed between the first filter and the first photodetector. The first pinhole may be disposed between the first lens and the first photodetector through which the beam output from the first lens passes.

According to one embodiment, the central wavelength of the first emission light emitted from the object in response to the first beam being incident on the object may have a higher wavelength than the first wavelength of the first beam. A central wavelength of second emission light emitted from the object in response to the second beam being incident on the object may have a higher wavelength than the second wavelength of the second beam.

According to one embodiment, the first wavelength of the first beam may be a wavelength corresponding to between 450 nm and 500 nm, and the second wavelength of the second beam may be a wavelength corresponding to between 750 nm and 800 nm.

It is mounted on a confocal fluorescence microscope according to an embodiment of the present disclosure to irradiate a first beam of a first wavelength to an object, acquire emission light emitted from the object, and obtain the obtained An optical system that processes emitted light may include a first laser coupled to a first optical fiber and a light propagation module through which the first beam output from the first laser propagates. The light propagation module includes an optical path through which the first beam and the emitted light propagate to the object, a plurality of optical members, a first collimator coupled to the first optical fiber, and the light propagation module. It may include a second collimator coupled to a second optical fiber and coupled to a probe for irradiating the first beam propagating through the object to the object.

Referring to FIG. 20, according to one embodiment, the optical system (or confocal endoscopic microscope) 2000 may include a probe cover 2001 and a probe 2002. The probe cover 2001 may accommodate, cover, or surround the probe 2002.

According to one embodiment, the probe 2002 includes a probe body 2011, an optical fiber 2012, a bending portion 2013, a probe nut 2014, and/or a probe tube 2015. can do. In one embodiment, the optical fiber 2012 may be connected to one end of the probe body 2011. The probe body 2011 may be referred to as a part of the optical system (or confocal endoscopic microscope) 2000 that the user grips. The probe nut 2014 may be referred to as a component connecting the bending portion 2013 and the probe tube 2015. At least a portion of the probe tube 2015 may be introduced into the body.

According to one embodiment, the probe cover 2001 may include a cover tube 2020, a cover tip 2023, a cover nut 2030, and/or a drape 2040. The drape 2040 may be referred to as vinyl that covers the probe body 2011 and the optical fiber 2012 and protects them from external substances. Drape 2040 may be formed of polyethylene (PE). In one embodiment, the cover tube 2020 may include a first part 2021 and/or a second part 2022. For example, the cover tube 2020 includes a first part 2021 that receives the probe tube 2015, and a second part 2022 that receives the probe nut 2014 located at the proximal end of the probe tube 2015. ) may include.

In one example, the proximal end may be referred to as an end that is relatively adjacent to the user of the optical system 2000. Accordingly, the proximal end of the probe tube 2015 may be referred to as an end relatively adjacent to the probe body 2011 among the ends of the probe tube 2015. Therefore, it is obvious that in the present disclosure, the term proximal end can be replaced with the term proximal end adjacent to the user or the probe body 2011 held by the user.

According to one embodiment, the cover tip 2023 may include an optical window and/or an elastic member. The configuration of the cover tip 2023 is described in detail in FIG. 22 below.

According to one embodiment, the cover nut 2030 may be coupled or engaged with the second portion 2022 of the cover tube 2020. For example, a protrusion may be formed on the second part 2022 of the cover tube 2020, and the cover nut 2030 may be coupled or fastened to the second part 2022. The coupling structure of the cover tube 2020 and the cover nut 2030 is described in detail in FIG. 2 below.

According to one embodiment, the drape 2040 (or cover drape) may be fused and joined to the entire outer surface of the cover nut 2030. The fusion may include at least one of heat, ultrasound, or adhesive. For example, the cover nut 2030 may be coupled or fastened to the second portion 2022 of the cover tube 2020. The fastened cover nut 2030 may be combined with the drape 2040 through a heat fusion process. The coupling structure of the cover nut 2030 and the drape is described in detail in FIG. 9 below.

According to one embodiment, the probe cover 2001 may include a marker attached to at least one of a cover tube 2020, a cover nut 2030, and a drape 2040. In one embodiment, the mark may correspond to an identification mark for authenticating or identifying the probe cover 2001. For example, the label may include at least one of a near-field communication (NFC) tag or a barcode.

According to one embodiment, the probe 2002 accommodated in the probe cover 2001 may be set to operate only when the probe cover 2001 is authenticated through an identification mark. For example, the probe 2002 may be set to operate only when the probe cover 2001 is certified as genuine through an identification mark. For example, a user can recognize an identification mark attached to the drape 2040 using an external device (eg, user equipment) and transmit information about the recognized identification mark to the probe 2002. The probe 2002 may identify, determine, or check whether the probe cover 2001 to which the identification mark is attached is genuine based on information about the recognized identification mark.

According to one embodiment, the operation of identifying whether the probe cover 2001 to which the identification mark is attached is genuine based on information about the recognized identification mark may be performed by at least a processor of the probe 2002, but may be performed by an external device (e.g., It can also be performed by user equipment.

According to one embodiment, if the attached identification mark is not genuine or the attached identification mark does not match the identification mark stored in the memory of the probe 2002 or an external server, at least one processor of the probe 2002 or An external device (e.g., user equipment) may notify the user that an object (e.g., drape 2040) to which an identification mark is attached is not genuine. The means of notifying the user may vary. For example, a message can be transmitted to an external device (eg, user equipment) or a message can be displayed on the display of the probe 2002.

According to one embodiment, the cover tube 2020 may have a first length L1. The first part 2021 of the cover tube 2020 may have a second length L2, and the second part 2022 may have a third length L3. In one embodiment, the second length L2 may be relatively longer than the third length L3. For example, the first length (L1) may be 127.2 mm, the second length (L2) may be 114.4 mm, and the third length (L3) may be 12.8 mm. As another example, the first length L1 may have a value between about 126 and 128 mm. However, the numerical example of the cover tube 2020 is only an example, and the cover tube 2020 may have various lengths.

According to one embodiment, the outer diameter of the cover tube 2020 may be constant. In one embodiment, the outer diameter of the cover tube 2020 may vary. For example, the outer diameter of the cover tube 2020 may gradually increase from the distal end of the cover tube 2020 to the proximal end of the cover tube 2020. The distal end of the present disclosure may be referred to as an end or end portion relatively distant from the probe body 2011, and the proximal end may be referred to as an end or end portion relatively close to the probe body 2011. there is.

According to one embodiment, the probe cover 2001 may accommodate or surround at least a portion of the probe 2002 to block direct contact between the probe 2002 and the body. For example, the cover tube 2020 of the probe cover 2001 may surround the probe nut 2014 and the probe tube 2015, and may block contact between the probe nut 2014 and the probe tube 2015 and the outside. You can. The drape 2040 of the probe cover 2001 may cover the probe body 2011 and the bending portion 2013 and block contact between the probe body 2011 and the bending portion 2013 and the outside.

Accordingly, the probe cover 2001 can prevent the probe 2002 from directly contacting the body or external space even if at least a portion of the probe 2002 is inserted into a part of the body, and hygiene can be ensured.

In the present disclosure, the term surround may be replaced with the term cover or encapsulate.

FIG. 21 is an enlarged view of portion A of FIG. 1 according to an embodiment.

Referring to FIG. 21, the probe nut 2014 of the probe 2002 according to one embodiment may connect the bending portion 2013 and the probe tube 2015. The probe nut 2014 may correspond to a connection member that connects or couples the bending portion 2013 and the probe tube 2015.

According to one embodiment, the first part 2021 of the probe cover 2001 may cover at least a portion of the probe tube 2015. The first part 2021 of the probe cover 2001 may correspond to the probe tube 2015.

According to one embodiment, the second part 2022 of the probe cover 2001 may surround at least a portion of the probe nut 2014. The second part 2022 of the probe cover 2001 may correspond to the probe nut 2014.

According to one embodiment, the second portion 2022 of the probe cover 2001 may include a first protruding portion 2110 and a plurality of second protruding portions 2120. For example, a first protrusion 2110 may be formed on the outer surface of the second part 2022, and a plurality of second protrusions 2120 may be formed on the inner surface of the second part 2022.

According to one embodiment, a cover nut 2030 may be coupled to the first protrusion 2110 of the second portion 2022. For example, the cover nut 2030 may include a groove corresponding to the first protrusion 2110. As the first protrusion 2110 is inserted into the groove of the cover nut 2030, the cover nut 2030 and the first protrusion 2110 may be coupled. As a result, the cover nut 2030 may be coupled to the second portion 2022 of the cover tube 2020 through the first protrusion 2110.

In the present disclosure, it has been described that the first protrusion 2110 is formed in the second portion 2022 and the groove is formed in the cover nut 2030, but this is only an example. For example, a groove may be formed in the second part 2022 and a protrusion may be formed in the cover nut 2030, and as the protrusion of the cover nut 2030 enters the groove of the second part 2022, the second Portion 2022 and cover nut 2030 may be coupled.

According to one embodiment, the first protrusion 2110 may have a locking structure shape so as to be attached to the groove. The shape of the locking structure may include a thread or luer-lock. For example, the first protrusion 2110 may have a screw thread shape or a luer lock shape. In FIG. 2 of the present disclosure, it is explained that the first protrusion 2110 as a single screw thread is formed on the outer surface of the second part 2112, but this is only an example. A plurality of distinct screw threads (or a plurality of protrusions) may be formed on the outer surface of the second portion 2112.

According to one embodiment, the second protrusions 2120 may include first protrusions 2121 and/or second protrusions 2122. For example, the second protrusions 2120 may include a first protrusion 2121 formed at a first point on the inner surface of the second portion 2022 (2121). The second protrusions 2120 may include a second protrusion 2122 formed at a second point on the inner surface of the second portion 2022. The second point may be a point that is symmetrical to the first point.

According to one embodiment, the second protrusions 2120 are formed at equal intervals along the circumferential line of the inner surface of the second part 2022, and the circumferential line may be located at the center of the second part 2022. there is.

According to one embodiment, the second protrusions 2120 may be substantially perpendicular to the longitudinal direction of the second portion 2022.

In the present disclosure, the second protrusions 2120 are described as including first protrusions 2121 (2121) and/or second protrusions 2122, but this is only an example and the second protrusions 2120 may vary in number. It may include protrusions. For example, the second protrusions 2120 may include third and fourth protrusions in addition to the

first protrusions

2121 and 2122 . The third and fourth protrusions are each formed on the inner surface of the second portion 2022 and may be symmetrical.

According to one embodiment, the probe nut 2014 may include grooves corresponding to the second protrusions 2120. For example, the probe nut 2014 may include a first groove 2014a corresponding to the first protrusion 2121 (2121) and/or a second groove 2014b corresponding to the second protrusion 2122. there is.

According to one embodiment, as the second protrusions 2120 enter the grooves of the probe nut 2014, the cover tube 2020 may be fixed to the probe nut 2014. In FIG. 2 of the present disclosure, it is explained that the second protrusions 2120 are simply inserted into the grooves of the probe nut 2014 and fastened to fix the cover tube 2020 and the probe nut 2014, but this is only an example. . For example, fixing members or adhesive members that increase friction may be disposed in the grooves of the probe nut 2014. As the second protrusions 2120 enter the grooves of the probe nut 2014, the second protrusions 2120 may be coupled to fixing members or adhesive members. As a result, the probe nut 2014 and the cover tube 2020 can be more strongly coupled.

According to one embodiment, the outer diameter of the probe tube 2015 may have a first width W1 (eg, about 5.3 mm). An inside diameter of the probe tube 2015 adjacent to the probe nut 2014 may have a second width W2 (eg, about 4 mm). That is, the inner diameter of the proximal end of the probe tube 2015 may have a second width W2 (eg, about 4 mm). However, the numerical example of the outer diameter and inner diameter of the probe tube 2015 is only an example and does not limit the present disclosure.

FIG. 22 is an enlarged view of portion B of FIG. 1 according to an embodiment.

Referring to FIG. 22, the cover tip 2023 according to one embodiment may include an elastic member 2211 and/or an optical window 2212.

According to one embodiment, the elastic member 2211 may be a material having an elastic modulus of a specified size or more. For example, the elastic member may include an elastic polymer (eg, polypropylene (PP)), silicon, and/or rubber. For example, the elastic member 2211 may be elastically stretched in a specified direction when a tensile force is applied in the specified direction. The term elastic member in the present disclosure may be replaced with the term elastic material.

According to one embodiment, the optical window 2212 may be a window through which a beam (eg, a laser beam) or reflected light reflected from an object transmits. For example, the optical window 2212 may include a transparent material (eg, glass, silicon, silicon dioxide).

According to one embodiment, the optical window 2212 may have a second width W3. For example, the second width W3 may be about 7.0 mm. The outer diameter of the optical window 2212 may also be substantially understood as the outer diameter of the cover tip 2023.

According to one embodiment, the elastic member 2211 may be adhered to the first portion 2021 of the cover tube 2020. Referring to the enlarged view of part C of the present disclosure, for example, the first part 2021 includes a first area 2221 and a second radius having an outer diameter of a first radius (or length) D1. It may include a second area 2222 having an outer diameter of (or length) D2. In one example, the elastic member 2211 may surround the entire outer surface of the first area 2221, and the elastic member 2211 may be attached to a portion of the second area 2222. In one example, the second radius D2 may be longer than the first radius D1.

According to one embodiment, the first side of the elastic member 2231 may be adhered to the second area 2222, and the second side of the elastic member 2231 may be adhered to the optical window 2212. In one embodiment, the second surface of the elastic member 2231 may be opposite to the first surface. In the present disclosure, the elastic member 2231 is described as being adhered to the optical window 2212, but this is only an example. For example, the elastic member 2231 may be disposed below the optical window 2212 to support the optical window 2212. Accordingly, the elastic member 2231 can be replaced with a supporting member having elastic force.

According to one embodiment, the optical window 2212 can be prevented from being damaged by the probe tube 2015 by being coupled or adhered to the optical window 2212 by the elastic member 2231. For example, in the process of putting the cover tube 2020 on the probe tube 2015, the probe tube 2015 may apply pressure to the optical window 2212 due to a user's error or mechanical limitations. If the elastic member 2231 is not coupled to the optical window 2212, the optical window 2212 may be damaged by applied pressure. On the other hand, as the elastic member 2231 according to one embodiment is coupled to the optical window 2212, even if pressure is applied to the optical window 2212, the elastic member 2231 moves in a specified direction (e.g., in the cover tube 2020). It can be stretched in the longitudinal direction. As the elastic member 2231 elastically extends in a specified direction, the optical window 2212 may not be damaged or broken.

As a result, as the elastic member 2231 is coupled to the optical window 2212, safety problems (e.g., damage to the optical window 2212) that may occur during observation of lesions using a confocal endoscopic microscope can be eliminated. , stability can be secured.

According to one embodiment, the cover tube 2020 may be integrally formed with the elastic member 2211, and the optical window 2212 may be adhered to the distal end of the cover tube 2020. For example, optical window 2212 can be glued or bonded to the distal end of first portion 2021 of cover tube 2020.

According to one embodiment, the inside diameter of the other end of the probe tube 2015 that is relatively far from the probe nut 2014 may have a fourth width W4 (eg, about 4.1 mm). That is, the inner diameter of the distal end of the probe tube 2015 may have a fourth width W4 (eg, about 4.1 mm). However, the numerical example of the inner diameter of the probe tube 2015 is only an example and does not limit the present disclosure.

The cover tube 2020, the elastic member 2211, and the optical window 2212 of the present disclosure have been described as separate configurations, but this is only an example. In one embodiment, the cover tube 2020, the elastic member 2211, and the optical window 2212 may be formed integrally.

In the present disclosure, the first part 2021 is described as including regions such as the first region 2221 and the second region 2222, but this is only an example. The first area 2221 and the second area 2222 may also be referred to as a portion or part in a three-dimensional concept. For example, the first part 2021 may be described as including the first part 2221 and the second part 2222. For example, the first part 2021 may be described as including a first sub-part 2221 and a second sub-part 2222.

According to one embodiment, the first area 2221 and the second area 2222 may form an offset. For example, the first area 2221 may form a first staircase, and the second area 2222 may form a second staircase.

According to one embodiment, the elastic member 2211 may be attached to the second step formed by the second region 2222. In one embodiment, the elastic member 2211 may have a height longer than the height from the second step to the first step.

According to one embodiment, the elastic member 2211 may include a third area 2211a forming a third step and a fourth area 2211b forming a fourth step. The third area 2211a and the fourth area 2211b may form a step. The optical window 2212 may be adhered or coupled to the third step formed by the third region 2211a. In one embodiment, the step between the third and fourth steps may substantially correspond to the thickness of the optical window 2212.

Referring to FIG. 23 , before pressure is applied to the optical window 2212 according to one embodiment, the elastic member 2211 may have a height equal to the first height h1 from the reference height. In one embodiment, the optical window 2212 may have a height equal to the second height h2 from the reference height.

According to one embodiment, as pressure is applied to the optical window 2212, the elastic member 2211 may be elastically stretched in a designated direction. In one embodiment, the designated direction may refer to a height direction or a direction perpendicular to the optical window 2212.

According to one embodiment, as the elastic member 2211 is extended, the optical window 2212 may have a height equal to the third height h3 from the reference height. Therefore, when comparing before and after pressure is applied to the optical window 2212, the elastic member 2211 can be stretched by the third height (h3) - the second height (h2), and the optical window 2212 can be stretched by the third height (h3) - the second height (h2). Height (h3) - You can move up by the second height (h2). For example, assuming that the height of the elastic member 2211 is the fourth height (h4), the height of the elastic member 2211 after pressure is applied to the optical window 2212 is the fourth height (h4) + the third height ( h3) - may correspond to the second height (h2).

According to one embodiment, damage to the optical window 2212 may be reduced or prevented as the elastic member 2211 is extended through elastic force.

According to one embodiment, the radius of the outer diameter of the elastic member 2211 is the radius of the outer diameter of the first area 2221 (e.g., the first radius D1), and the radius of the outer diameter of the second area 2222 (e.g., may be larger than the second radius (D2). For example, the elastic member 2211 may have an outer diameter of the third radius (D3), and the third radius (D3) is the first radius (D1) and the third radius (D3). 2 It can be greater than the radius (D2).

However, the elastic member 2211 may have an outer diameter of various radii. For example, the radius of the outer diameter of the elastic member 2211 may have a value between the first radius D1 and the second radius D2. For example, the outer diameter of the elastic member 2211 may be smaller than the first radius D1 and the second radius D2, respectively.

The arrangement relationship between the elastic member 2211 and the first part 2021 of the present disclosure is only an example and the elastic member 2211 may be arranged in various ways on the first part 2021 of the cover tube 2020. Hereinafter, in FIGS. 24 and 25, elastic members having various arrangement relationships and various radii of outer diameters are described.

Referring to FIG. 24, the elastic member 2411 according to one embodiment may be inserted into the first part 2021. The first side of the elastic member 2411 may be adhered to the optical window 2212, and the second side opposite to the first side may be adhered to the first portion 2021.

According to one embodiment, the inserted elastic member 2411 may be stretched when pressure is applied to the optical window 2212. For example, the elastic member 2411 may be elastically stretched as the probe tube 2015 contacts the optical window 2212 and applies pressure in a specified direction (e.g., a direction perpendicular to the optical window 2212). there is.

According to one embodiment, damage to the optical window 2212 may be reduced or prevented as the elastic member 2411 is extended through elastic force.

Comparing the elastic member 2411 of FIG. 24 of the present disclosure with the elastic member 2211 of FIG. 22, the elastic member 2411 of FIG. 24 is inserted into the first portion 2021, while the elastic member 2211 of FIG. 22 is inserted into the first portion 2021. ) may be disposed along the outer surface of the first area 2221 of the first portion 2021.

The description of the elastic member 2211 of FIG. 22 may be applied to the elastic member 2411 according to one embodiment as long as there is no contradiction. For example, the description of the arrangement relationship between the first and

second areas

2221 and 2222 and the elastic member 2411 may not be applicable. As another example, the description that the elastic member 2411 may be in contact with the first portion 2021 may be applied.

Referring to FIG. 25, the elastic member 2511 according to one embodiment may surround the entire outer surface of the first area 2221, and the elastic member 2511 may be attached to a portion of the second area 2222. You can. In one embodiment, the first area 2221 may have an outer diameter of a first radius D1, and the second area 2222 may have an outer diameter of a second radius D2 that is larger than the first radius D1. You can.

According to one example, the elastic member 2511 may have an outer diameter of a fourth radius D4 between the first radius D1 and the second radius D2.

According to one embodiment, the elastic member 2511 may be stretched when pressure is applied to the optical window 2212. For example, the elastic member 2511 may elastically stretch as the probe tube 2015 contacts the optical window 2212 and applies pressure in a specified direction (e.g., a direction perpendicular to the optical window 2212). there is.

According to one embodiment, damage to the optical window 2212 may be reduced or prevented as the elastic member 2511 is extended through elastic force.

Comparing the elastic member 2511 of FIG. 25 of the present disclosure with the elastic member 2211 of FIG. 3, the elastic member 2511 of FIG. 25 has a fourth radius between the first radius D1 and the second radius D2. While it has an outer diameter of the radius D4, the elastic member 2211 of FIG. 4 may have an outer diameter of a third radius D3 that is larger than each of the first radius D1 and the second radius D2.

The description of the elastic member 2211 of FIG. 22 may be applied to the elastic member 2511 according to one embodiment as long as there is no contradiction.

Referring to FIG. 26, the elastic member 2611 according to one embodiment may be adhered or coupled to the first portion 2021 of the cover tube 2020. For example, a portion of the first surface of the elastic member 2611 may be adhered to the second region 2222 of the first portion 2021. In one embodiment, the elastic member 2611 may not be adhered to the first area 2221. For example, the elastic member 2611 may surround the entire outer surface of the first region 2221 and may not be adhered to the outer surface of the first region 2221.

Comparing the elastic member 2611 of FIG. 26 of the present disclosure with the elastic member 2211 of FIG. 23, the elastic member 2611 of FIG. 26 has a height of the fifth height h5, whereas the elastic member 2611 of FIG. 23 has a height of the fifth height h5. (2211) may have a fourth height (h4) that is greater than the fifth height (h5).

In one embodiment, a separate adhesive member (e.g., adhesive tape) may be disposed between the elastic member 2611 and the first part 2021, and the elastic member 2611 and the first part 2021 may be connected by the adhesive member. ) can be glued or bonded.

According to one embodiment, the optical window 2612 may have an outer diameter of the third radius D3. Comparing the optical window 2612 of FIG. 26 of the present disclosure with the optical window 2212 of FIG. 3, the optical window 2612 of FIG. 26 has a second radius D2 that is larger than the outer diameter of the cover tube 2020. 3 may have a radius D3, whereas the optical window 2212 of FIG. 22 may have an outer diameter that is substantially the same as the second radius D2, which is the outer diameter of the cover tube 2020.

As a result, the optical window 2612 of FIG. 26 may have a larger outer diameter than the optical window 2212 of FIG. 22.

According to one embodiment, the elastic member 2611 and the optical window 2612 may have a relatively large contact area compared to the embodiment of FIG. 22. For example, unlike the embodiment of FIG. 22, the optical window 2612 may have an outer diameter of the third radius D3, and the optical window 2612 having a large radius has a relatively large area compared to the elastic member 2611. It can be glued in.

Therefore, when the probe cover 2001 includes the elastic member 2611 and the optical window 2612, the adhesive area between the elastic member and the optical window is smaller than when the probe cover 2001 includes the elastic member 2211 and the optical window 2212. It can increase. As the adhesive area increases, even if pressure is applied to the optical window 2612, the elastic member 2611 and the optical window 2612 are coupled relatively more strongly, thereby preventing damage to the optical window 2612.

Referring to a case in which the length of the elastic member 2641 according to an embodiment is increased, the elastic member 2641 may have a sixth height h6. The sixth height h6 according to one embodiment may be longer than the fourth height h4 of the elastic member 2231 and the fifth height h5 of the elastic member 2611.

According to one embodiment, the elastic member 2641 may be in contact with or coupled to the second region 2632 of the first portion 2621. The elastic member 2641 may surround the entire outer surface of the first region 2631 of the first portion 2621. The elastic member 2641 may be adhered to a portion of the second portion 2632 while contacting the entire outer surface of the first portion 2621. One area of the inner surface of the elastic member 2641 may be in contact with the entire outer surface of the first part 2621, and another area of the inner surface of the elastic member 2641 may not be in contact with the first part 2621. The first area 2631 and the optical window 2212 may be spaced apart by a designated distance, and the designated distance may correspond to a length corresponding to the other area.

The first part 2621, the first area 2631, and the second area 2632 of the present disclosure relate to the first part 2021, the first area 2221, and the second area 2222, unless contradictory. The explanation may apply.

According to one embodiment, as the height (or length) of the elastic member 2641 increases, the elastic force of the elastic member 2641 may increase, and even if pressure is applied to the optical window 2212, a relatively longer length It can be expanded as much as For example, the elastic member 2641 may be stretched to a relatively greater length than the elastic member 2611.

Referring to FIG. 27, the probe cover 2001 according to one embodiment may include an elastic member 2700, and the elastic member 2700 may include a body portion 2711 and a guide portion 2712. . In one embodiment, the body portion 2711 may correspond to the elastic member 2211 of FIG. 22 . The guide portion 2712 may be referred to as an extension portion extending from the body portion 2711 of the elastic member 2700 in the inner direction of the first portion 2021.

Comparing the elastic member 2700 of FIG. 27 of the present disclosure with the elastic member 2211 of FIG. 22, the elastic member 2700 may further include a guide portion 2712 compared to the elastic member 2211 of FIG. 22. there is.

According to one embodiment, the elastic member 2700 may be adhered to the first area 2221 and the second area 2222 of the first part 2021. For example, the guide portion 2712 of the elastic member 2700 may be adhered to the first region 2221, and the body portion 2711 of the elastic member 2700 may be at least partially adhered to the second region 2222. It can be. The elastic member 2700 may be adhered or coupled to the first step formed by the first region 2221 and the second step formed by the second region 2222. For example, the guide portion 2712 of the elastic member 2700 may be adhered to the first step formed by the first region 2221, and the body portion 2711 may be attached to the first step formed by the second region 2222. 2 Can be glued to stairs.

As a result, the elastic member 2211 of FIG. 22 is bonded only to the second region 2222, while the elastic member 8110 of FIG. 8 can be bonded to the first region 2221 and the second region 2222.

According to one embodiment, the elastic member 2700 may be bonded to the first part 2021 over a larger area than the elastic member 2211 of FIG. 22. Accordingly, even if pressure is applied to the optical window 2212, the elastic member 2700 can be prevented from being detached from the first portion 2021.

According to one embodiment, since the elastic member 2700 includes the guide portion 2712, even if pressure (or impact) is applied to the optical window 2212, the pressure (or impact) is absorbed by the elastic member 2700. This can be done, and as a result, damage or detachment of the optical window 2212 can be prevented or reduced.

Referring to FIG. 28, the first portion 2820 of the cover tube according to one embodiment may include a first area 2821 and a second area 2822.

According to one embodiment, the first area 2821 may be an area (or portion) having an inside diameter of the first radius D1. The second area 2822 may be an area having an inner diameter of the fifth radius D5.

Comparing the first part 2820 of FIG. 28 of the present disclosure with the first part 2021 of FIG. 3, the first area 2821 and the second area 2822 of the first part 2820 of FIG. 28 are They can have different inner diameters. On the other hand, the first area 2221 and the second area 2222 of the first portion 2021 of FIG. 3 may have substantially the same inner diameter.

For example, the first area 2821 and the second area 2822 of FIG. 28 have different inner diameters of the first radius D1 and the fifth radius D5, respectively, while the first area 2822 of FIG. 22 ( 2221) and the second area 2222 may have substantially the same inner diameter (eg, fourth width W4).

Additionally, the first area 2821 and the second area 2822 of the first portion 2820 of FIG. 28 may have substantially the same outer diameter. On the other hand, the first area 2221 and the second area 2222 of the first portion 2021 of FIG. 22 may have different outer diameters. For example, the outer diameter of the first area 2221 of the first part 2021 in FIG. 22 is the first radius D1, and the outer diameter of the second area 2222 of the first part 2021 is the second radius. It may be (D2).

As a result, the first part 2820 of FIG. 28 forms a lower step toward the inside of the cover tube 2020, while the first part 2021 of FIG. 22 forms a step toward the inside of the cover tube 2020. The higher you go, the higher the stairs can be formed.

According to one embodiment, the elastic member 2811 may be adhered to the first area 2821 and the second area 2822.

Referring to the elastic member 2830 including the guide portion 2832 according to one embodiment, the elastic member 2830 may include a body portion 2831 and a guide portion 2832 extending from the body portion 2831. You can. In one embodiment, the body portion 2831 of the elastic member 2830 may substantially correspond to the elastic member 2811.

According to one embodiment, the guide part 2832 may be referred to as an extension part extending from the body part 2831 of the elastic member 2830 in the inner direction of the first part 2820.

According to one embodiment, the elastic member 2830 may be adhered to the first area 2821 and the second area 2822 of the first part 2820.

According to one embodiment, since the elastic member 2830 includes a guide portion 2832, even if pressure is applied to the optical window 2212, the pressure (or impact) can be absorbed by the elastic member 2830, As a result, damage or detachment of the optical window 2212 may be prevented or reduced.

Referring to FIG. 29, the optical window 2912 according to one embodiment may be formed of an elastic member (eg, silicone, rubber, polypropylene). Accordingly, the optical window 2912 may not need to be coupled to the first portion 2021 through a separate elastic member.

According to one embodiment, the optical window 2912 may be directly coupled to the first portion 2021. For example, optical window 2912 may be combined with first region 2221 and second region 2222. The first area 2221 may be understood as an area whose outer diameter is the first radius D1, and the second area 2222 may be understood as an area whose outer diameter is the second radius D2.

Comparing the optical window 2912 of FIG. 29 of the present disclosure with the optical window 2612 of FIG. 7, the optical window 2612 of FIG. 26 has a first elastic member through a separate elastic member (e.g., elastic member 2611). Can be combined with part (2021). On the other hand, the optical window 2912 of FIG. 29 may not be coupled to the first part 2021 through a separate elastic member because at least a portion of the optical window 2912 is formed of an elastic member. That is, the optical window 2912 of FIG. 29 can be directly coupled to the first portion 2021.

As a result, the optical window 2912 in FIG. 26 may also be understood as an embodiment in which the optical window 2612 and the elastic member 2611 in FIG. 26 are integrally formed. The outer diameter of the optical window 2912 formed integrally with the elastic member may be the third radius D3.

According to one embodiment, since at least a portion of the optical window 2912 is formed of an elastic member, the optical window 2912 may be stretched relatively more elastically even when pressure is applied to the optical window 2912 . For example, when an optical window is combined with a separate elastic member, pressure is applied to the optical window, and the elastic member may be stretched by a tensile force according to the pressure. On the other hand, when at least a portion of the optical window 2912 is formed of an elastic member as shown in FIG. 29, the optical window 2912 may be immediately expanded in response to the pressure applied to the optical window. As a result, when at least a portion of the optical window 2912 is formed of an elastic member, the optical window 2912 can be more effectively prevented from being damaged.

Referring to FIG. 30, the optical window 3012 according to one embodiment may be formed of an elastic member (eg, silicone, rubber, polypropylene). Accordingly, the optical window 3012 may not need to be coupled to the first portion 2820 through a separate elastic member.

According to one embodiment, the optical window 3012 may be directly coupled to the second region 2822. For example, one side of the optical window 3012 may be coupled to the second region 2822 of the first portion 2820. The first area 2821 may be understood as an area whose inner diameter is the second radius D2, and the second area 2822 may be understood as an area whose internal diameter is the first radius D1. Both the outer diameter of the first area 2821 and the outer diameter of the second area 2822 may be the third radius D3.

According to one embodiment, the optical window 3012 may contact the first area 2821. For example, the optical window 3012 may contact along the inner surface of the first region 2821. In one embodiment, optical window 3012 may contact but not be coupled to first region 2821. For example, the optical window 3012 may not be glued or combined with the first region 2821 to further secure elasticity.

However, it is only an example that the optical window 3012 is not combined with the first area 2821, and in another embodiment, the optical window 3012 may be combined with the first area 2821. The outer diameter of the optical window 3012 formed integrally with the elastic member may be the second radius D2.

In the present disclosure, the optical window 3012 is described as being coupled to the second region 2822, but this is only an example, and the optical window 3012 may also be described as being inserted into the first portion 2820. You can.

According to one embodiment, since at least a portion of the optical window 3012 is formed of an elastic member, the optical window 3012 may be stretched relatively more elastically even when pressure is applied to the optical window 3012. For example, when an optical window is combined with a separate elastic member, pressure is applied to the optical window, and the elastic member may be stretched by a tensile force according to the pressure. On the other hand, when at least a portion of the optical window 3012 is formed of an elastic member as shown in FIG. 30, the optical window 3012 may be immediately expanded in response to the pressure applied to the optical window. As a result, when at least a portion of the optical window 3012 is formed of an elastic member, the optical window 3012 can be more effectively prevented from being damaged.

Referring to FIG. 31, the first part 3120 according to one embodiment may include a first area 3121 and a second area 3122. The first part 3120, the first area 3121, and the second area 3122 of FIG. 31 of the present disclosure are respectively in that order the first part 2820, the first area 2821, and the second area of FIG. 28 of the present disclosure. It may correspond to the second area 2822. Therefore, the description of the first part 2820, the first area 2821, and the second area 2822 of FIG. 28 is the same as the first part 3120, the first area 3121 and the second area 2822 of FIG. 31 unless there is a contradiction. It may be applied to the second area 3122. The first area 3121 may be understood as an area whose inner diameter is the second radius D2, and the second area 3122 may be understood as an area whose internal diameter is the first radius D1. Both the outer diameter of the first area 3121 and the outer diameter of the second area 3122 may be the third radius D3.

According to one embodiment, the optical window 3112 may have an outer diameter of the second radius D2. In one embodiment, optical window 3112 may be glued to second region 3122 of first portion 3120. In one embodiment, the optical window 3112 may contact the entire inner surface of the first region 3121 of the first portion 3120.

According to one embodiment, the optical window 3112 may be formed at least in part of an elastic material (eg, silicone, polypropylene). For example, the optical window 3112 may be formed of a transparent elastic material.

According to one embodiment, since at least a portion of the optical window 3112 is formed of an elastic member, it can be stretched relatively more elastically even when pressure is applied to the optical window 3112. For example, when an optical window is combined with a separate elastic member, pressure is applied to the optical window, and the elastic member may be stretched by a tensile force according to the pressure. On the other hand, when at least a portion of the optical window 3112 is formed of an elastic member as shown in FIG. 12, the optical window 3112 may be immediately expanded in response to the pressure applied to the optical window. As a result, when at least a portion of the optical window 3112 is formed of an elastic member, the optical window 3112 can be more effectively prevented from being damaged.

Referring to FIG. 32, the probe cover 2001 according to one embodiment may include a cover tube 2020, a cover tip 2023, a cover nut 2030, and/or a drape 2040.

According to one embodiment, the cover tip 2023 may include an optical window and/or an elastic member. The cover nut 2030 may be coupled or engaged to the cover tube 2020.

According to one embodiment, the drape 2040 may be heat-sealed and joined to the entire outer surface of the cover nut 2030. For example, the cover nut 2030 may be coupled or fastened to the cover tube 2020. The fastened cover nut 2030 may be combined with the drape 2040 through a heat fusion process.

Referring to FIG. 33, both ends of the cover tube 2020 according to one embodiment may have different outer diameters. For example, the first end 3301 of the cover tube 2020 may have an outer diameter of the first length E1, and the second end 3302 may have an outer diameter of the second length E2. You can have apocrypha.

According to one embodiment, the first end 3301 may correspond to the distal end, and the second end 3302 may correspond to the proximal end. For example, the first end 3301 may correspond to a user or an end relatively distant from the probe body (e.g., the probe body 2011 in FIG. 20) of the probe 2002 held by the user. there is. For example, the second end 3302 may correspond to a user or an end relatively close to the probe body 2011 of the probe 2002 held by the user.

According to one embodiment, the second length E2 may be greater than the first length E1. That is, the outer diameter of the cover tube 2020 may gradually increase from the distal end (eg, first end 3301) to the proximal end (eg, second end 3302).

Referring to FIG. 34, an optical system (or confocal endoscopic microscope) 3400 according to an embodiment may include a probe 3402 and a probe cover 3401 for accommodating (or covering) the probe 3402. You can.

According to one embodiment, the probe 2002 may include a probe body 3411, an optical fiber 3412, a probe nut 3414, and/or a probe tube 3415. In one embodiment, the optical fiber 3412 may be connected to one end of the probe body 3411. The probe body 3411 may be referred to as a part of the optical system (or confocal endoscopic microscope) 3400 that the user grips. The probe nut 3414 may be referred to as a component connecting the probe body 3411 and the probe tube 3415. At least a portion of the probe tube 3415 may be introduced into the body.

The probe 3402 of FIG. 34 of the present disclosure may be understood as a probe that does not include a bending portion 2013, unlike the probe 2002 of FIG. 20.

According to one embodiment, the probe cover 3401 may include a cover tube 3420 and a cover tip 3430. In one embodiment, the cover tube 3420 may include a first portion 3421 for receiving at least a portion of the probe tube 3415 and a second portion 3422 for receiving the probe nut 3414. .

According to one embodiment, the first part 3421 may include a first area 3421a and a second area 3421b. In one embodiment, the first area 3421a may have an outer diameter of a first radius, and the second area 3421b may have an outer diameter of a second radius. The first radius may be smaller than the second radius.

According to one embodiment, the cover tube 3420 may include a space 3423 for accommodating at least a portion of the probe tube 3415. Cover tube 3420 may include a space 1524 for receiving a probe nut 3414. In one embodiment, the cover tube 3420 may have a first length G1 (about 18.6 mm) in the longitudinal direction.

According to one embodiment, the cover tip 3430 may include an elastic member 3431 and an optical window 3432. In one embodiment, the elastic member 3431 may surround the entire outer surface of the first area 3421a. The elastic member 3431 may be adhered or combined with the second region 3421b. However, the elastic member 3431 may surround the entire outer surface of the first area 3421a but may not be adhered to the first area 3421a. That is, the elastic member 3431 may be adhered to a portion of the second region 3421b while contacting the entire outer surface of the first region 3421a.

According to one embodiment, the distal end of the cover tube 3420 may have an outer diameter of the second length G2 (approximately 7.0 mm). For another example, the second area 3421b of the cover tube 3420 may have an outer diameter of the second length G2.

According to one embodiment, the first portion 3421 may have a third length G3 (approximately: 7.0 mm) in the longitudinal direction.

The numerical examples of the first length (G1), the second length (G2), and the third length (G3) described in FIG. 34 of the present disclosure are only examples and do not limit the present disclosure.

According to one embodiment, although not shown in FIG. 34, the drape may be heat-sealed over the entire outer surface of the second portion 3422.

According to one embodiment, the optical window 3432 can be prevented from being damaged by the probe tube 3415 by being coupled or adhered to the optical window 3432 by the elastic member 3431. For example, in the process of putting the cover tube 3420 on the probe tube 3415, the probe tube 3415 may apply pressure to the optical window 3432 due to a user's error or mechanical limitations. If the elastic member 3431 is not coupled to the optical window 3432, the optical window 3432 may be damaged by applied pressure. On the other hand, as the elastic member 3431 according to one embodiment is coupled to the optical window 3432, even if pressure is applied to the optical window 3432, the elastic member 3431 moves in a specified direction (e.g., in the cover tube 3420). It can be stretched in the longitudinal direction. As the elastic member 3431 elastically extends in a specified direction, the optical window 3432 may not be damaged or broken.

A probe cover surrounding a probe of a confocal endomicroscope according to an embodiment of the present disclosure may include a cover tube. The cover tube may include a first part accommodating the probe tube of the probe and a second part accommodating a probe nut located at a proximal end of the probe tube. The first portion may include a first region having an outer diameter of a first length and a second region having an outer diameter of a second length longer than the first length. A first protruding part may be formed on the outer surface of the second part, and a plurality of second protruding parts may be formed on the inner surface of the second part. The probe cover is coupled to the distal end of the cover tube and may include a cover tip including an optical window and an elastic member. The elastic member may surround the entire outer surface of the first region, a first side of the elastic member may be adhered to a portion of the second region, and a second side of the elastic member may be bonded to a portion of the optical window. The probe cover may include a cover nut, and a receiving groove may be formed on an inner surface of the cover nut, and the receiving groove may be coupled to the first protrusion of the second portion. The probe cover may include a cover drape joined by heat fusion over the entire outer surface of the cover nut.

According to one embodiment, the cover tube, the elastic member, and the optical window may be formed as one body.

According to one embodiment, the cover tube and the elastic member may be formed integrally, and the optical window may be adhered to the distal end of the cover tube.

According to one embodiment, the second length corresponding to the outer diameter of the second region may gradually increase from the distal end of the cover tube to the proximal end of the cover tube.

According to one embodiment, the plurality of second protrusions may be perpendicular to the longitudinal direction of the second portion. A first protrusion among the plurality of second protrusions may be formed at a first point on the inner surface of the second portion. A second protrusion among the plurality of second protrusions may be formed at a second point symmetrical to the first point on the inner surface of the second portion.

The probe cover according to one embodiment may further include a marker attached to at least one of the cover tube, the cover nut, and the cover drape. The probe accommodated in the probe cover can be set to operate only when the probe cover is authenticated through the label.

According to one embodiment, the sign may include at least one of a near-field communication (NFC) tag or a barcode.

According to one embodiment, the length of the cover tube may be less than 200 m.

According to one embodiment, the first area having an outer diameter of the first length and the second area having an outer diameter of the second length may form an offset. The first area may form a first step, and the second area may form a second step.

According to one embodiment, the elastic member may be adhered to the second end formed by the second region.

According to one embodiment, the elastic member may have a second height that is longer than the first height from the second end to the first end.

According to one embodiment, the elastic member may be adhered to the second end. The elastic member may include a guide structure formed below the optical window to support the optical window.

According to one embodiment, the first protrusion may have the shape of a locking structure so as to be attached to the receiving groove.

According to one embodiment, the outer diameter of the elastic member may correspond to a third length that is longer than the second length.

According to one embodiment, the elastic member may include a third region and a fourth region having a step difference from the third region. The third region may form a third stage and the fourth region may form a fourth stage. The optical window may be located at the third end formed by the third region.

Figure 35 is a diagram for explaining a probe according to an embodiment.

Referring to FIG. 35, a confocal endoscopic microscope (or optical system) 3500 according to an embodiment may include a probe 3501 and/or an image processing device 3502 connected to the probe 3501.

The probe 3501 according to one embodiment may include a probe body 3510, a bending portion 3520, and/or a probe tube 3530. In one embodiment, the image processing device 3502 may include at least one processor 3503, and the at least one processor 3503 may process images received by the image processing device 3502. there is. For example, at least one processor 3503 may stitch images received by the image processing device 3502.

According to one embodiment, the probe body 3510 may be referred to as a part of the probe 3501 that the user holds. In one embodiment, probe body 3510 may include the proximal end of probe 3501. For example, the proximal end of the probe 3501 may be referred to as an end included in the probe body 3510 among the ends of the probe 3501.

According to one embodiment, the probe body 3510 may include various modules or circuits associated with the probe 3501. For example, the probe body 3510 may include a sensor module 3511 in portion A. The sensor module 3511 may include an acceleration sensor and/or a gyro sensor.

For another example, the sensor module 3511 may include an inertial measurement unit (IMU) sensor, a gesture sensor, a gyro sensor, a barometric pressure sensor, an acceleration sensor, a magnetic sensor, a grip sensor, an infrared (IR) sensor, a proximity sensor, a color sensor, It may include a humidity sensor, temperature sensor, biometric sensor, and/or illuminance sensor.

According to one embodiment, the bending portion 3520 may be bent by a specified angle, and the probe body 3510 and the probe tube 3530 may be connected through the bending portion 3520. In one embodiment, the probe body 3510 and the probe tube 3530 may form the specified angle.

According to one embodiment, the probe tube 3530 may include an optical fiber scanner 3531 and a lens (or light receiver) 3532. In one embodiment, the optical fiber scanner 3531 may radiate light to body tissues. Excitation light may be emitted from the tissue in response to irradiated light on the tissue (e.g., cell) of the body. The lens 3532 or the light receiving unit may receive the emitted excitation light.

According to one embodiment, the sensor module 3511 may include an acceleration sensor and may measure the acceleration of the probe 3501 using the acceleration sensor. For example, the acceleration sensor may identify a first axis (e.g., x-axis), a second axis (e.g., y-axis), and a third axis (e.g., z-axis) based on the probe 3501, and the probe (3501) Alternatively, when the probe body 3510 moves, acceleration values in each axial direction can be measured, acquired, or identified based on the three identified axes.

According to one embodiment, at least one processor 3503 of the image processing device 3502 electrically connected to the sensor module 3511 provides location information (e.g., location information) of the probe 3501 based on the acceleration value measured through the acceleration sensor. : The position of the probe 3501 or the movement of the probe 3501 can be identified. For example, when the probe 3501 moves in the first direction or the second direction, at least one processor 3503 may identify the movement of the probe 3501 using the sensor module 3511, and the probe 3501 may identify the movement of the probe 3501. The location of (3501) can be identified.

According to one embodiment, the sensor module 3511 may include a gyro sensor and measure the angular velocity of the probe 3501 using the gyro sensor. For example, the gyro sensor may identify a first axis (e.g., x-axis), a second axis (e.g., y-axis), and a third axis (e.g., z-axis) based on the probe 3501, and the probe When (3501) rotates, the angular velocity value in each axis can be measured based on the three identified axes.

According to one embodiment, at least one processor 3503 electrically connected to the sensor module 3511 may identify the rotation of the probe 3501 based on the angular velocity value measured through the gyro sensor.

According to one embodiment, the sensor module 3511 may be referred to as a hardware component for detecting, identifying, or determining the location of the probe 3501 or the probe body 3510. there is. Accordingly, the term sensor module 3511 can be replaced with sensor, sensor circuit, or sensing circuit.

In FIG. 35 of the present disclosure, it is explained that the image processing device 3502 includes at least one processor 3503, but this is only an example. For example, a processor for identifying the position or rotation of the probe body 3510 may be disposed within the probe body 3510. As another example, a processor for identifying the position of the probe body 3510 may be disposed within the probe body 3510, and the rotation of the probe body 3510 may be identified by at least one processor 3503. there is. That is, at least one processor for identifying the position and rotation of the probe body 3510 may be disposed in the probe body 3510 and/or the image processing device 3502.

Referring to FIG. 36, the sensor module 3511 located within the probe body 3510 according to one embodiment may have first location information. For example, the sensor module 3511 may acquire or measure location information of the sensor module 3511 at a first point in time. The acquired first position information of the sensor module 3511 includes three-dimensional coordinates (e.g., x-axis), a second axis (e.g., y-axis), and a third axis (e.g., z-axis). It can be indicated with three dimensional coordinates. For example, the first location information is o = (

,

) can be indicated.

According to one embodiment, the probe tip 3610 of the probe 3501 may have location information that is distinct from the first location information. For example, the position information of the probe tip 3610 is p = (

,

) can be indicated. Accordingly, the location of the sensor module 3511 and the location of the probe tip 3610 may be different.

According to one embodiment, the difference between the position of the sensor module 3511 and the position of the probe tip 3610 may be determined in advance. For example, the difference between the position of the sensor module 3511 and the position of the probe tip 3610 is the relative position information between the sensor module 3511 and the probe tip 3610 within the probe 3501 and the direction toward which the probe tip 3610 is directed. May contain information about direction.

For example, relative position information may include the length of the probe body 3510 including the sensor module 3511, the length of the probe tube 3530 including the probe tip 3610, and/or the length of the probe body 3510 and the probe tube. (3530) The angle between

) may include information about. In one example, the angle between the probe body 3510 and the probe tube 3530 may substantially correspond to the bending angle of the bending portion 3520.

For example, information about the direction in which the probe tip 3610 faces may be obtained from the gyro sensor of the sensor module 3511. For example, information about the direction in which the probe tip 3610 is facing may include an angle from a reference axis (e.g., x-axis), e.g.

) can be indicated.

According to one embodiment, the position of the probe tip 3610 is determined using the first point (o), the first vector (v1), and the second vector (v2) of the probe body 3510 where the sensor module 3511 is located. The coordinates of the second point (p) may be calculated. For example, from the first point (o) to the third point (m) of the bending part 3520 may be indicated by the first vector (v1), and from the third point (m) to the second point (p) It may be indicated by the second vector (v2). As a result, the coordinates of the second point (p) can be obtained by using the vector sum of the first point (o), the first vector (v1), and the second vector (v2). That is, even if only the location information of the sensor module 3511 (e.g., coordinates of the first point (o)) and the first vector (v1) and the second vector (v2) are identified, the location information of the probe tip 3610 (e.g., Coordinates of the second point (p) may be identified.

According to one embodiment, the first vector v1 is substantially the length of the probe body 3510 including the sensor module 3511, and the angle formed between the probe body 3510 and the probe tube 3530 (e.g.

) can be obtained through. The second vector v2 can be substantially obtained through information about the length of the probe tube 3530 and the direction in which the probe tip 3610 faces.

According to one embodiment, at least one processor 3503 of the image processing device 3502 may stitch a plurality of images by projecting or orthographically projecting the plurality of images acquired by the probe 3501 onto a virtual plane. there is. In order for at least one processor 3503 to stitch a plurality of images, it is necessary to obtain location information corresponding to each of the plurality of images.

However, since the sensor module 3511 in the probe 3501 is located in the probe body 3510, when at least one processor 3503 projects a plurality of images using the location information acquired by the sensor module 3511 Errors may occur.

Therefore, at least one processor 3503 needs to calibrate (or correct) the position information of the sensor module 3511 with the position information of the probe tip 3610 adjacent to the tissue in order to minimize or prevent the occurrence of errors. .

As a result, the at least one processor 3503 according to one embodiment provides calibrated location information of the sensor module 3511 based on the location information of the sensor module 3511 and the predetermined parameters described above. ) can be converted to . At least one processor 3503 may stitch a plurality of images using the corrected location information.

Referring to FIG. 37, the probe 3501 according to one embodiment can move, and images of tissues having different positions can be acquired. For example, at the first time point t1, the probe 3501 may acquire an image of the first region 311 of the tissue 3701. At the second time point t2, the probe 3501 may acquire an image of the second region 3712 of the tissue 3701. At a third time point t3, the probe 3501 may acquire an image of the third area 3713 of the tissue 3701, and at a fourth time point t4, the probe 3501 may acquire an image of the fourth area 3714. Images can be obtained.

Meanwhile, in order for a user to observe and diagnose a lesion in the tissue 3701, each region of the tissue 3701 may need to be stitched. For example, the probe 3501 may acquire the fifth image of the fifth area 3725 at the first time point t1. The probe 3501 may acquire the sixth image of the sixth area 3726 at the second time point t2. In one example, the sixth area 3726 may include at least a portion of the fifth area 3725. That is, the sixth image may correspond to an image in which the fifth image acquired at the first time point t1 and the simple image acquired at the second time point t3 are stitched.

For example, the probe 3501 may acquire the seventh image of the seventh area 3727 at the third time point t3. In one example, the seventh image may correspond to an image in which the sixth image acquired at the second time point t2 and the simple image acquired at the third time point t3 are stitched.

For example, the probe 3501 may acquire the eighth image of the eighth area 3728 at the fourth time point t4. In one example, the eighth image may correspond to an image in which the seventh image acquired at the third time point t3 and the simple image acquired at the fourth time point t4 are stitched.

A simple image in the present disclosure may be referred to as an unstitched image. For example, a simple image is an image acquired by the probe 3501 at each time point and may be referred to as an unstitched image. In other words, simple images can be understood as being referred to to distinguish them from stitched images.

Referring to FIG. 38, at least one processor 3503 according to an embodiment acquires a first image of a first region of the tissue at a first viewpoint (or corresponding to the first viewpoint) in operation 3801. You can. For example, at least one processor 3503 may acquire or capture a first image of a first region of tissue in the body at a first viewpoint using the probe 3501.

For example, the probe 3501 may receive a user's input (e.g., an input to a button) at a first point in time, and the probe 3501 may determine the location of tissue in the body at the first point in time based on the received user input. A first image of the first area may be acquired. In one example, receiving user input and/or acquiring the first image of the probe 3501 may be performed under the control of at least one processor 3503.

According to one embodiment, the first image is generated when the optical fiber scanner 3531 of the probe 3501 radiates light to the tissue and the lens (or light receiver) 3532 of the probe 3501 emits excitation light ( It can be obtained while receiving excitation light.

According to one embodiment, at least one processor 3503 may acquire first location information of the sensor module 3511 corresponding to the first viewpoint in operation 3803.

According to one embodiment, the sensor module 3511 may include an acceleration sensor. The acceleration sensor of the sensor module 3511 may acquire acceleration information of the probe 3501 at a first point in time. At least one processor 3503 or an acceleration sensor may obtain first location information of the sensor module 3511 based on acceleration information of the probe 3501.

For example, the acceleration sensor may obtain acceleration values (or acceleration information) of the sensor module 3511 corresponding to the first viewpoint. At least one processor 3503 may obtain location information of the sensor module 3511 by integrating acceleration values of the sensor module 3511. Position information obtained by integrating acceleration values may be indicated as coordinates according to three-dimensional coordinate systems. In one example, three-dimensional coordinate systems may include a first axis (eg, x-axis), a second axis (eg, y-axis), and a third axis (eg, z-axis).

According to one embodiment, the first location information of the sensor module 3511 may be information about the relative location with respect to the reference location. For example, at least one processor 3503 may acquire the reference location of the sensor module 3511 at a reference time point before the first time point. In one example, the sensor module 3511 may acquire the first position of the sensor module 3511 as a relative position with respect to the reference position at the reference time. In one example, the first location information may include information about the first location of the sensor module 3511 at a first point in time.

According to one embodiment, at least one processor 3503 may obtain first angular velocity information measured by the sensor module 3511 at a first point in time. At least one processor 3503 may obtain the inclination of the probe 3501 using the angular velocity values included in the first angular velocity information.

According to one embodiment, at least one processor 3503 may obtain first corrected location information based on the first location information obtained in operation 3805 and a predetermined parameter. For example, the acquired first location information may correspond to the location of the sensor module 3511 within the probe body 3510. The first corrected position information may correspond to the position of the probe tip 3610 of the probe 3501. In one example, the probe tip 3610 is a part of the probe 3501 adjacent to the tissue, so the location information of the probe tip 3610 may substantially correspond to the location information of the tissue.

According to one embodiment, the first corrected position information of the probe tip 3610 at a first viewpoint (or corresponding to the first viewpoint) includes a first axis (e.g., x-axis), a second axis (e.g., It may be indicated by three-dimensional coordinates including a y-axis) and a third axis (e.g., z-axis).

According to one embodiment, the first corrected location information may correspond to the location information of the first image. For example, the first corrected position information may correspond to the position information of the first image required when the first image is stitched.

According to one embodiment, the predetermined parameter is relative position information between the sensor module 3511 in the probe 3501 and the probe tip 3610 of the probe 3501 and/or direction information about the direction the probe tip 3610 is facing. may include. In one embodiment, the relative position information between the sensor module 3511 and the probe tip 3610 includes the length of the probe body 3510 including the sensor module 3511 and the probe tube 3530 including the probe tip 3610. It may include information about the length and/or the angle of the probe body 3510 and the probe tube 3530.

Probe tip 3610 of the present disclosure may be substantially referred to as the distal end of probe 3501. Accordingly, relative position information between the sensor module 3511 and the probe tip 3610 may be referred to as relative position information between the sensor module 3511 and the distal end of the probe 3501.

In the present disclosure, the probe 3501 is described as including a probe body 3510, a bending portion 3520, and a probe tube 3530, but this is only an example. For example, the probe 3501 may be conceptually comprised of a first part corresponding to the probe body 3510, a second part corresponding to the bending part 3520, and a third part corresponding to the probe tube 3530. It can be explained.

According to one embodiment, a process in which at least one processor 3503 obtains first corrected location information using the obtained first location information and a predetermined parameter may be as follows. For example, at least one processor 3503 determines the coordinates of the sensor module 3511 (e.g., o = (in FIG. 36) from the first location information.

,

)) can be obtained. In one example, the at least one processor 3503 uses information about the length of the probe body 3510 including the sensor module 3511 and the angle between the probe body 3510 and the probe tube 3530 to create a third The coordinates of the point (e.g. m = (in Figure 36)

,

)) can be obtained. In one example, at least one processor 3503 uses orientation information about the length of the probe tube 3530 and the direction in which the probe tip 3610 is facing to determine the coordinates of the probe tip 3610 (e.g., p = in FIG. 36 ). (

,

)) can be obtained. As a result, the at least one processor 3503 may obtain the first coordinates of the probe tip 3610 that are substantially the same as the coordinates of the tissue through the first position information and the predetermined parameter. The first coordinates of the probe tip 3610 may correspond to a first viewpoint, and the first coordinates of the probe tip 3610 may substantially correspond to the coordinates of the first region of the tissue.

Referring to FIG. 39, at least one processor 3503 according to an embodiment acquires a second image of a second region of the tissue at a second viewpoint (or corresponding to the second viewpoint) in operation 3907. You can.

For example, at least one processor 3503 may acquire or capture a second image of a second region of tissue in the body from a second viewpoint using the probe 3501. For example, probe 3501 may receive a user's input (e.g., an input to a button) at a second point in time, and probe 3501 may determine tissue within the body at a second point in time based on the received user input. A second image for the second area may be obtained. In one example, reception of a user input and/or acquisition of a second image by the probe 3501 may be performed under the control of at least one processor 3503.

According to one embodiment, the second image is generated when the optical fiber scanner 3531 of the probe 3501 radiates light to the tissue and the lens (or light receiver) 3532 of the probe 3501 emits excitation light ( It can be obtained while receiving excitation light.

According to one embodiment, the second viewpoint may be referred to as a viewpoint distinct from the first viewpoint. For example, the second time point may be a time point after the first time point.

According to one embodiment, the interval between the first viewpoint and the second viewpoint may correspond to the reciprocal of the image frame rate, which represents the speed at which images of tissue are captured.

According to one embodiment, the interval between the first time point and the second time point may be substantially the same. For example, when the image frame rate is set to a first value (eg, 30 fps), the interval between the first view and the second view may be 1/30 second. In one example, the interval between the second time point and the third time point after the second time point may be 1/30 of a second. That is, the interval at which the probe 3501 acquires or photographs images of tissue may be substantially the same.

According to one embodiment, the interval between the first time point and the second time point may vary. For example, at least one processor 3503 may set an image frame rate indicating the speed at which images of tissue are taken to a first value (eg, 30 fps). In one example, at least one processor 3503 may sense the movement speed of the probe 3501 via the sensor module 3511 while taking an image of tissue and adjust the image frame rate based on the detected movement speed. The value of can be maintained or changed.

In one example, the at least one processor 3503 may change the image frame rate to a second value (eg, 60 fps) greater than the first value when the detected movement speed is greater than or equal to the reference value. Therefore, the interval between the first time point and the second time point may be 1/60 second.

In one example, at least one processor 3503 may maintain the image frame rate at a first value (eg, 30 fps) when the detected movement speed is less than a reference value. Accordingly, the interval between the first viewpoint and the second viewpoint may be 1/30 second.

According to one embodiment, at least one processor 3503 may acquire second location information of the sensor module 3511 corresponding to the second viewpoint in operation 3909. At least one processor 3503 or an acceleration sensor may obtain second location information of the sensor module 3511 based on acceleration information of the probe 3501.

According to one embodiment, the second location information of the sensor module 3511 may be information about the relative location with respect to the reference location. For example, at least one processor 3503 may acquire the reference location of the sensor module 3511 at a reference time point before the first time point. In one example, the sensor module 3511 may acquire the second position of the sensor module 3511 as a relative position with respect to the reference position at the reference time. The second location information may include information about the second location of the sensor module 3511 corresponding to the second viewpoint.

According to one embodiment, the acceleration sensor may acquire acceleration values of the sensor module 3511 corresponding to the second viewpoint. At least one processor 3503 may obtain second location information of the sensor module 3511 by integrating acceleration values of the sensor module 3511. The second position information obtained by integrating the acceleration values may be indicated by coordinates according to three-dimensional coordinate systems. In one example, three-dimensional coordinate systems may include a first axis (eg, x-axis), a second axis (eg, y-axis), and a third axis (eg, z-axis).

According to one embodiment, at least one processor 3503 may obtain second corrected location information based on the second location information obtained in operation 3911 and a predetermined parameter. For example, the acquired second location information may correspond to the location of the sensor module 3511 within the probe body 3510. The second corrected position information may correspond to the position of the probe tip 3610 of the probe 3501. In one example, the probe tip 3610 is a part of the probe 3501 adjacent to the tissue, so the location information of the probe tip 3610 may substantially correspond to the location information of the tissue.

According to one embodiment, the second corrected position information of the probe tip 3610 at the second viewpoint (or corresponding to the second viewpoint) includes the first axis (e.g., x-axis) and the second axis (e.g., It may be indicated by three-dimensional coordinates including a y-axis) and a third axis (e.g., z-axis).

According to one embodiment, a process in which at least one processor 3503 obtains second corrected location information using the obtained second location information and a predetermined parameter may be as follows. For example, at least one processor 3503 determines the coordinates of the sensor module 3511 (e.g., o = (in FIG. 36) from the second location information.

,

)) can be obtained. As a result, the at least one processor 3503 may obtain the second coordinates of the probe tip 3610 that are substantially the same as the coordinates of the tissue through the second location information and the predetermined parameter. The second coordinates of the probe tip 3610 may correspond to the second viewpoint, and the second coordinates of the probe tip 3610 may substantially correspond to the coordinates of the second region of the tissue.

According to one embodiment, the second corrected location information may correspond to location information of the second image. For example, the second corrected position information may correspond to the position information of the second image required when the second image is stitched.

According to one embodiment, at least one processor 3503 may stitch the first image and the second image based on the first corrected location information and the second corrected location information in operation 3913. For example, the at least one processor 3503 may configure the first image so that the first image has first-axis coordinate information (e.g., x-coordinate) and second-axis coordinate information (e.g., y-coordinate) among the first corrected position information. Images can be projected or orthogonally projected onto a virtual plane. That is, the at least one processor 3503 may project or orthographically project the first image onto a virtual plane by excluding the third axis coordinate information (eg, z coordinate) from the first corrected position information. In one example. The virtual plane may consist of a first axis (eg, x-axis) and a second axis (eg, y-axis).

For example, the at least one processor 3503 may configure the second image so that the second image has coordinates of the second axis (e.g., x-coordinate) and coordinate information of the second axis (e.g., y-coordinate) among the second corrected position information. can be projected or orthogonally projected onto a virtual plane. That is, at least one processor 3503 may project or orthographically project the second image onto a virtual plane by excluding the third axis coordinate information (eg, z coordinate) from the second corrected position information.

For example, the first image is (

,

) may be projected (or orthogonally projected) onto a virtual plane to have coordinate information of (

,

) can be projected onto a virtual plane to have coordinate information. As a result, the at least one processor 3503 may obtain an image in which the first image and the second image are stitched, and the stitched image may include the first region and the second region of the tissue.

A method of stitching two-dimensional images is described in FIGS. 35 to 49 of the present disclosure, but this is only an example. The descriptions of FIGS. 35 to 49 can be equally applied to the method of stitching three-dimensional images. Hereinafter, in Figure 40, a method of stitching 3D images using corrected position information is explained.

Referring to FIG. 40, in operation 4001, at least one processor 3503 processes the first axis (e.g., x-axis), the second axis (e.g., y-axis), and A three-dimensional image of the first area may be obtained based on first coordinate information of the third axis (eg, z-axis) and first direction information toward which the probe tip 3610 of the probe 3501 is heading. In one embodiment, in order to acquire a 3D image of the first area, first coordinate information as well as first direction information of the probe tube 3530 may be required. For example, even when the first coordinate information is the same, the 3D image may vary depending on the first direction information of the probe tube 3530. In one example, the probe tube 3530 is tilted about 45 degrees and first coordinate information (e.g.,

,

), the 3D image has the probe tube 3530 tilted at about -45 degrees and first coordinate information (e.g. (

,

) may be different from the 3D image. As a result, direction information of the probe tube 3530 may be required to obtain a more accurate 3D image.

According to one embodiment, in operation 4003, the at least one processor 3503 processes a first axis (e.g., x-axis), a second axis (e.g., y-axis), and a third axis (e.g., A three-dimensional image of the second area may be obtained based on the second coordinate information of the z-axis) and the second direction information toward which the probe tip 3610 of the probe 3501 is heading.

According to one embodiment, at least one processor 3503 may stitch the 3D image of the first area and the 3D image of the second area in operation 4005.

Referring to FIG. 41, the probe 3501 can image the surface of the tissue in real time while moving along the surface of the tissue. The sensor module 3511 of the probe 3501 according to one embodiment is configured at a reference point (

) to the reference position for the sensor module 3511 (

) coordinates can be obtained. In one embodiment, the reference position (

) may include coordinates of each of the first axis (eg, x-axis), the second axis (eg, y-axis), and the third axis (eg, z-axis).

In one embodiment, the baseline time point (

) and reference position (

) can be replaced by the terms start point and start position, respectively. For example, at a reference point (

) is the point in time when the user of the probe 3501 starts image acquisition using the probe 3501, or the user of the probe 3501 inputs a button or UI (user interface) on the display for image acquisition using the probe 3501. It can be referenced at one point in time. For example, the starting position is the reference point (

) can be referred to as the location of the sensor module 3511 corresponding to.

According to one embodiment, at least one processor 3503 or sensor module 3511 is located at a reference position (

), the location of the sensor module 3511 corresponding to each time point can be identified. For example, the sensor module 3511 detects a first viewpoint (

) The first position of the sensor module 3511 corresponding to (

) can be identified. For example, the sensor module 3511 detects a second viewpoint (

) The second position of the sensor module 3511 corresponding to (

) can be identified. For example, the sensor module 3511 provides a third viewpoint (

) The third position of the sensor module 3511 corresponding to (

) can be identified. In one example, the first location (

), second position (

) and third position (

) is the reference position (

) may be a relative position.

), the position of the probe tip 3610 corresponding to each time point can be identified. For example, at least one processor 3503 operates at a first time point (

) The first corrected position of the probe tip 3610 corresponding to (

) can be identified. For example, at least one processor 3503 may perform a second time point (

) The second corrected position of the probe tip 3610 corresponding to (

) can be identified. For example, at least one processor 3503 may provide a third viewpoint (

) The third corrected position of the probe tip 3610 corresponding to (

) can be identified. In one example, the first corrected position (

), second corrected position (

) and the third corrected position (

) is the reference position (

) may be a relative position.

According to one embodiment, at least one processor 3503 may identify corrected positions of the probe tip 3610 based on the positions of the sensor module 3511. For example, at least one processor 3503 may determine the first location (

) and the first corrected position based on predetermined parameters (

) can be identified. For example, at least one processor 3503 may be located at a second location (

) and a second corrected position based on predetermined parameters (

) can be identified. For example, at least one processor 3503 may be located at a third location (

) and a third corrected position based on predetermined parameters (

) can be identified.

According to one embodiment, the predetermined parameter may include a three-dimensional relative position vector from the sensor module 3511 to the probe tip 3610 and direction information about the direction the probe tip 3610 faces.

According to one embodiment, at least one processor 3503 or sensor module 3511 may identify direction information of the probe tip 3610. For example, at least one processor 3503 or sensor module 3511 operates at a first viewpoint (

) corresponding to the first rotation angle (

), corresponding to the second rotation angle (

), corresponding to the third rotation angle (

) can be identified. In one example, at least one processor 3503 determines a first rotation angle (

), second rotation angle (

) and the third rotation angle (

), the direction information (or rotation information) of the probe tip 3610 can be identified.

For example, the direction information (or angle information) of the probe tip 3610 is information about the direction the probe tip 3610 faces based on a specified axis (e.g., the first axis, the second axis, and the third axis). Alternatively, it may be referred to as angle information formed by the probe tip 3610 based on a designated axis.

According to one embodiment, the first rotation angle (

), second rotation angle (

) and the third rotation angle (

) may each correspond to a rotation quaternion.

According to one embodiment, the at least one processor 3503 probes the location information (e.g., first location information) of the sensor module 3511 using the direction information of the probe tip 3610 obtained based on the rotation angle. It can be converted into corrected position information of the tip 3610 (eg, first corrected position information).

According to one embodiment, at least one processor 3503 uses direction information of the probe tip 3610 and information about the three-dimensional relative position vector between the sensor module 3511 and the probe tip 3610 to detect the sensor module ( The position information of the probe tip 3610 may be converted into the corrected position information of the probe tip 3610. According to one embodiment, at least one processor 3503 or sensor module 3511 may determine the first corrected position (3511).

), second corrected position (

) and the third corrected position (

), a plurality of images can be projected or orthogonally projected onto the virtual plane 4110. For example, the at least one processor 3503 may determine the first image at a first corrected position (

) The first image is placed on the virtual plane 4110 so that one coordinate value (e.g., the coordinate value of the third axis) among the coordinates (e.g., the coordinates of the first axis, the coordinate of the second axis, and the coordinate of the third axis) is removed. It can be projected. For example, at least one processor 3503 may determine the second image at a second corrected position (

) The second image is placed on the virtual plane 4110 so that one coordinate value (e.g., the coordinate value of the third axis) among the coordinates (e.g., the coordinates of the first axis, the coordinate of the second axis, and the coordinate of the third axis) is removed. It can be projected. For example, at least one processor 3503 may determine the third image to be at a third corrected position (

) The third image is placed on the virtual plane 4110 so that one coordinate value (e.g., the coordinate value of the third axis) among the coordinates (e.g., the coordinates of the first axis, the coordinate of the second axis, and the coordinate of the third axis) is removed. It can be projected. That is, the at least one processor 3503 is configured to match the coordinate values of one of the coordinates of the corrected positions of each of the first image, the second image, and the third image to each other. The second image and the third image can be projected onto the virtual plane 4110. For example, among the coordinates of the corrected positions of the first image, the second image, and the third image, the Z-axis coordinate values may all be the same.

According to one embodiment, the first image, second image, and third image projected on the virtual plane 4110 may be displayed on one plane (eg, the virtual plane 4110). In one embodiment, the plurality of images may be stitched as they are projected onto one plane (eg, virtual plane 4110).

According to one embodiment, when projecting a plurality of images onto the virtual plane 4110, the first corrected position (

), second corrected position (

) and the third corrected position (

) is used, the accuracy of the plurality of projected images can be increased. For example, at least one processor 3503 may select a first location that is not the corrected locations (

), second position (

) and third position (

), when projecting a plurality of images onto the virtual plane 4110, errors in the positions of the projected images may occur. This is the first position (

), second position (

) and third position (

) may be because the location of the sensor module 3511 is relatively spaced from the tissue.

On the other hand, at least one processor 3503 according to an embodiment may select the corrected positions (e.g., the first corrected position (

), second corrected position (

) and the third corrected position (

When a plurality of images are projected onto the virtual plane 4110 using )), errors in the positions of the projected images can be reduced or prevented. First corrected position (

), second corrected position (

) and the third corrected position (

) Each is the location of the probe tip 3610, and the probe tip 3610 may be relatively close to the tissue. That is, the location of the probe tip 3610 may substantially correspond to the location of the tissue. As a result, the first corrected position (

), second corrected position (

) and the third corrected position (

), at least one processor 3503 can reduce errors in the positions of projected images.

Hereinafter, a specific method for determining or identifying the corrected position (eg, first corrected position) using the above-described position (eg, first position) and a predetermined parameter (eg, direction information of the probe tip 3610). Explain. but. The specific method described below is only an example and does not limit the present disclosure.

Referring to FIG. 42, the probe 3501 according to one embodiment may include a sensor module 3511, and the probe 3501 may be connected to the light propagation module 4200 through an optical fiber. In one embodiment, the light propagation module 4200 may include a plurality of optical members (e.g., filters, beam splitters, lasers) and may be used as a propagation path for beams output from the lasers or reflected on tissue. It can be used as a propagation path for excitation light.

According to one embodiment, the image processing device 3502 may be electrically connected to the light propagation module 4200 and the probe 3501. In one embodiment, the image processing device 3502 may acquire images of tissue using the light propagation module 4200 and the probe 3501.

According to one embodiment, the image processing device 3502 may include a display 4210, and may display an image of the tissue on the display 4210 using programs mounted on the image processing device 3502.

According to one embodiment, the image processing device 3502 may be equipped with a first program 4201 and a second program 4202. In one embodiment, the first program 4201 and the second program 4202 are mounted on the image processing device 3502 and are organically connected to the hardware configuration (e.g., at least one processor 3503) within the image processing device 3502. can be combined. For example, the first program 4201 may transmit instructions to perform specified operations (eg, display display or image processing) to at least one processor 3503 in the image processing device 3502. At least one processor 3503 may perform designated operations based on delivered instructions.

According to one embodiment, the first program 4201 includes at least one processor 3503 to display the image of the tissue being acquired or photographed through the probe 3501 and the light propagation module 4200 on the display 4210 in real time. ) can be controlled. For example, the first program 4201 may control at least one processor 3503 to display an image of a tissue being acquired or photographed in real time in the first area 4211 of the display 4210.

According to one embodiment, the second program 4202 may control at least one processor 3503 to stitch a plurality of images received. The second program 4202 may control at least one processor 3503 to display the stitched image in the second area 4212 of the display 4210.

In FIG. 42 of the present disclosure, the first area 4211 and the second area 4212 are shown to share at least a portion of their edges, but this is only an example. The first area 4211 and the second area 4212 may be displayed on the display 4210 to be spaced apart from each other. As another example, the first area 4211 and the second area 4212 may share at least a portion of their edges and then become separated from each other in response to a user input. As another example, the sizes of the first area 4211 and the second area 4212 may each be adjusted by user input (eg, touch input).

According to one embodiment, a first program 4201 processes images received through the probe 3501 and displays them in real time in the first area 4211 of the display 4210, and a plurality of images received through the probe 3501 are provided. The second program 4202 for stitching the images into one image may be mounted on one device (eg, the image processing device 3502).

However, this is only an example, and the first program 4201 and the second program 4202 may be installed in different devices.

Referring to FIG. 43, the second program 4302 according to one embodiment may be mounted on the additional image processing device 4300. In one embodiment, the second program 4302 may be mounted on the additional image processing device 4300 and organically combined with a hardware component (eg, at least one processor) within the additional image processing device 4300. For example, the second program 4302 may transmit instructions to perform specified operations (eg, display display or image processing) to at least one processor in the additional image processing device 4300. At least one processor may perform specified operations based on delivered instructions.

According to one embodiment, the additional image processing device 4300 may be physically spaced from the image processing device 3502. In one embodiment, additional image processing device 4300 may establish a communication connection with image processing device 3502. For example, additional image processing device 4300 may establish a wired or wireless communication connection with image processing device 3502.

According to one embodiment, the additional image processing device 4300 may receive a plurality of images acquired through the probe 3501 from the image processing device 3502. In one embodiment, at least one processor 3503 of the image processing device 3502 may establish a first communication connection with the additional image processing device 4300 and a first radio access technology (RAT). At least one processor 3503 may establish a second communication connection between the additional image processing device 4300 and the second RAT in consideration of the number of images to be transmitted, the capacity of the transmitted images, and/or the communication state of the first RAT. there is. At least one processor 3503 may transmit a plurality of images through a second communication connection of the second RAT.

According to one embodiment, even if at least one processor 3503 establishes a second communication connection of the second RAT with the additional image processing device 4300, the first communication connection of the first RAT may be maintained. When the communication state of the second communication connection of the second RAT deteriorates, the at least one processor 3503 sends at least some of the plurality of images to the additional image processing device 4300 through the first communication connection of the first RAT. Can be transmitted. That is, some of the plurality of images may be transmitted to the additional image processing device 4300 through the first communication connection of the first RAT, and the remainder of the plurality of images may be additionally transmitted through the second communication connection of the second RAT. It may be transmitted to the image processing device 4300. As another example, when at least one processor 3503 establishes a second communication connection of the second RAT with the additional image processing device 4300, the first communication connection may be released.

According to one embodiment, at least one processor of the additional image processing device 4300 may identify a plurality of images received from the image processing device 3502. At least one processor may stitch a plurality of images received by instructions delivered by the second program 4302.

According to one embodiment, the additional image processing device 4300 may include an additional display 4310 and display a plurality of stitched images on the additional display 4310.

In the embodiment of FIG. 43 of the present disclosure, unlike the embodiment of FIG. 42, programs are mounted on different devices. For example, in the embodiment of FIG. 42, the first program 4201 and the second program 4202 may be mounted on one device (eg, image processing device 3502). On the other hand, in the embodiment of FIG. 43, the first program 4201 may be mounted on the image processing device 3502, and the second program 4202 may be mounted on the additional image processing device 4300.

The description of the operation of acquiring corrected location information described in FIGS. 35 to 42 may also be applied to the image processing device 3502 of FIG. 43 of the present disclosure. However, the description of the stitching operation described in the embodiments of FIGS. 35 to 42 may be applied to the additional image processing device 4300. That is, the image processing device 3502 can transmit the corrected location information and images to the additional image processing device 4300, and the additional image processing device 4300 can stitch the corrected location information and the received images. .

According to one embodiment, the at least one processor 3503 of the image processing device 3502 acquires a first image of a first region of tissue at a first viewpoint using a probe 3501, and First location information of the sensor module 3511 corresponding to can be obtained. At least one processor 3503 of the image processing device 3502 may acquire first calibrated location information based on the first location information and a predetermined parameter, and the first calibrated location information and The acquired first image may be transmitted to an additional image processing device 4300 that performs image stitching.

According to one embodiment, the at least one processor 3503 of the image processing device 3502 acquires a second image of the second region of the tissue at a second viewpoint using the probe 3501, and Second location information of the sensor corresponding to point 2 can be obtained. At least one processor 3503 acquires second corrected location information based on second location information and the predetermined parameter, and applies the second corrected location information and the acquired second image to the additional image processing device. It can be sent to (4300).

According to one embodiment, the additional image processing device 4300 may stitch the acquired first and second images based on the first corrected location information and the second corrected location information, respectively.

FIG. 44 is a diagram for explaining an organization displayed in a panoramic display in the example of FIG. 42 according to an embodiment.

Referring to FIG. 44 , at least one processor 3503 according to an embodiment may display the first image 4411 received from the probe 3501 in the first area 4211 of the display 4210. The first area 4211 can be understood as an area that displays the image that the probe 3501 is receiving (capturing) in real time. The second area 4212 can be understood as an area that displays a user interface for managing and setting captured images. However, the second area 4212 is not limited to the above-described functional area, and may function as an area for displaying a stitched image as mentioned in FIG. 42. For another example, the second area 4212 may switch between a screen displaying a stitched image and a screen displaying a user interface for managing and setting captured images according to a user's input. The first image 4411 may correspond to an image acquired or photographed by the probe 3501 at a first time point. The first image 4411 is an image in which no stitching has been performed, and can be understood as a real-time captured image of tissue.

According to one embodiment, at least one processor 3503 may identify that a second image that is different from the first image 4411 is received from the probe 3501. At least one processor 3503 may generate a second stitching image 4412 as it receives the second image. Although not shown in FIG. 44 , at least one processor 3503 may display the second stitching image 4412 in the second area 4212. The second image corresponds to an image acquired or photographed by the probe 3501 at a second time point and may form part of the second stitched image 4412.

As a result, the second stitched image 4412 can be understood as a stitched image created by stitching the first image 4411 corresponding to the first viewpoint and the second image corresponding to the second viewpoint.

According to one embodiment, at least one processor 3503 may identify that a third image that is distinct from the second image is received from the probe 3501. At least one processor 3503 may generate a third stitching image 4413 as it receives the third image. Although not shown in FIG. 44 , at least one processor 3503 may display the third stitching image 4413 in the second area 4212. The third image corresponds to an image acquired or photographed by the probe 3501 at a third viewpoint and may form part of the third stitched image 4413.

According to one embodiment, at least one processor 3503 may identify that a fourth image that is distinct from the third image is received from the probe 3501. At least one processor 3503 may generate a fourth stitching image 4414 upon receiving the fourth image. Although not shown in FIG. 44 , at least one processor 3503 may display the fourth stitching image 4414 in the second area 4212. The fourth image corresponds to an image acquired or photographed by the probe 3501 at a fourth viewpoint and may form part of the fourth stitched image 4414.

According to one embodiment, at least one processor 3503 may continuously display tissue images in a panoramic manner on the display 4210.

An image processing device for stitching a plurality of images acquired through a probe of a confocal endomicroscope in an in-vivo environment according to an embodiment of the present disclosure is included in the probe and includes location information It may include at least one processor electrically connected to a sensor that acquires. The at least one processor may acquire a first image of a first region of the tissue at a first viewpoint using the probe, and obtain first location information of the sensor corresponding to the first viewpoint. there is. The at least one processor acquires first calibrated location information as location information of the first image, based on the first location information and a predetermined parameter, and uses the probe to obtain a second viewpoint. A second image of the second region of the tissue may be obtained. The at least one processor acquires second location information of the sensor corresponding to the second viewpoint and, based on the second location information and the predetermined parameter, performs a second correction with the location information of the second image. Location information may be obtained, and the first image and the second image may be stitched based on the first corrected location information and the second corrected location information.

According to one embodiment, the first image and the second image are generated when the optical fiber scanner of the probe radiates light to the tissue and the light receiver of the probe receives excitation light emitted from the tissue. It can be obtained while receiving light.

According to one embodiment, the at least one processor acquires the reference position of the sensor at a reference point before the first point in time, and acquires the first position of the sensor, which is a relative position with respect to the reference position of the sensor. You can. At least one processor may obtain the second position of the sensor, which is a relative position with respect to the reference position of the sensor at the second viewpoint. The first position of the sensor may correspond to the first viewpoint, and the second position of the sensor may correspond to the second viewpoint.

According to one embodiment, the predetermined parameter may include relative position information between the sensor within the probe and the probe tip (or distal end) of the probe, and direction information regarding the direction in which the probe tip faces. The relative position information may include information about the length of the probe body including the sensor, the length of the probe tube including the probe tip, and the angle between the probe body and the probe tube.

According to one embodiment, the first calibrated location information may include a first calibrated location of the probe tip of the probe at the first viewpoint. The second corrected position information may include a second corrected position of the probe tip of the probe at the second viewpoint.

According to one embodiment, the first corrected position information of the probe tip at the first viewpoint and the second corrected position information of the probe tip at the second viewpoint are respectively a first axis, a second axis, and a second axis. It can be indicated by three dimensional coordinates including three axes.

According to one embodiment, the at least one processor is configured to display the first image on a virtual plane consisting of the first axis and the second axis, the coordinate information of the first axis among the first corrected position information, and the The first image may be projected to have coordinate information of the second axis. At least one processor projects a second image on the virtual plane so that the second image has coordinate information of the first axis and coordinate information of the second axis among the second corrected position information, and the projected The first image and the projected second image may be stitched.

According to one embodiment, the at least one processor is configured to include first coordinate information of the first axis, the second axis, and the third axis of the first corrected position information and first direction information toward which the probe tip is directed. Based on this, a 3D image of the first area can be obtained. At least one processor determines the second region based on second coordinate information of the first axis, the second axis, and the third axis of the second corrected position information and second direction information toward which the probe tip is directed. A 3D image may be acquired, and the 3D image of the first area and the 3D image of the second area may be stitched.

According to one embodiment, the first corrected position may correspond to the position of the first region of the tissue, and the second corrected position may correspond to the position of the second region of the tissue.

According to one embodiment, the sensor may include at least one of an inertial measurement unit (IMU) sensor, an acceleration sensor, or a gyro sensor.

The image processing device according to an embodiment may further include a display, and the at least one processor may display one of the first image, the second image, or an image stitched based on the first image and the second image. At least one can be displayed on the display.

According to one embodiment, the display may include a first display area where the image acquired by the probe is displayed in real time and a second display area where the stitched image is displayed.

According to one embodiment, the first area may share at least a portion of an edge with the second area. The at least one processor may display the first display area and the second display area to be spaced apart from each other on the display in response to a user input to the display.

According to one embodiment, the at least one processor sets an image frame rate indicating a speed of taking an image of the tissue to a first value, while taking an image of the tissue, The moving speed of the probe can be detected through a sensor. When the detected movement speed is greater than or equal to a reference value, at least one processor may change the image frame rate to a second value greater than the first value. When the detected movement speed is less than the reference value, the at least one processor may maintain the image frame rate at the first value.

According to one embodiment, the at least one processor may obtain first acceleration information and first angular velocity information measured by a sensor at a first point in time. Obtain location information of the sensor based on the acceleration values of the sensor included in the first acceleration information, and obtain inclination information of the probe based on the angular velocity values of the sensor included in the first angular velocity information. It can be obtained.

An image processing device that acquires a plurality of images through a probe of a confocal endomicroscope in an in-vivo environment according to an embodiment of the present disclosure includes a sensor that acquires location information included in the probe; It may include at least one processor that is electrically connected. The at least one processor acquires a first image of a first region of tissue at a first viewpoint using the probe, acquires first location information of the sensor corresponding to the first viewpoint, and obtains first position information of the sensor corresponding to the first viewpoint. First calibrated location information may be obtained based on the location information and predetermined parameters. At least one processor transmits the first corrected position information and the acquired first image to an external device that performs image stitching, and uses the probe to perform a second measurement on a second region of the tissue at a second viewpoint. An image may be acquired, and second location information of the sensor corresponding to the second viewpoint may be obtained. At least one processor may acquire second corrected location information based on the second location information and the predetermined parameter, and transmit the second corrected location information and the obtained second image to the external device. there is.

Claims

It is mounted on a confocal fluorescence microscope and irradiates a first laser that outputs a first beam of a first wavelength and a second laser that outputs a second beam of a second wavelength to the object. , in an optical system for acquiring emission light emitted from the object and processing the obtained emission light,

The first laser coupled to a first optical fiber and the second laser coupled to a second optical fiber;

The first optical fiber, the second optical fiber, and the third optical fiber such that the first beam propagating through the first optical fiber and the second beam propagating through the second optical fiber are simultaneously propagated through the third optical fiber. Combined fiber optic coupler; and

Comprising an optical propagation module through which the first beam and the second beam output from the optical fiber coupler propagate,

The optical propagation module:

an optical path along which the first beam, the second beam, and the emitted light propagate;

a plurality of optical members;

A first collimator coupled to the third optical fiber; and

An optical system comprising a second collimator coupled to a fourth optical fiber coupled to a probe for directing the first beam and the second beam to the object.
In claim 1,

The plurality of optical members of the light propagation module are:

A first beam splitter that does not transmit a beam having a wavelength corresponding to a wavelength band between the first wavelength and a second wavelength greater than the first wavelength, and

An optical system comprising a second beam splitter that does not transmit a beam having a wavelength corresponding to a wavelength band below a third wavelength that is greater than the second wavelength.
In claim 2,

The beam that is not transmitted through the first beam splitter is reflected by the first beam splitter,

An optical system wherein a beam that is not transmitted through the second beam splitter is reflected by the second beam splitter.
In claim 1,

The plurality of optical members of the light propagation module are:

a first filter that transmits only beams having a wavelength corresponding to a wavelength range between a fourth wavelength and a fifth wavelength greater than the fourth wavelength; and

An optical system comprising a second filter that transmits a beam having a wavelength corresponding to a sixth wavelength or greater than the fifth wavelength.
In claim 4,

The first emission light emitted from the object in response to the first beam being irradiated to the object has a wavelength corresponding to the wavelength band between the fourth wavelength and the fifth wavelength,

The optical system, wherein the second emission light emitted from the object in response to the second beam being irradiated to the object has a wavelength corresponding to a wavelength band of the sixth wavelength or higher.
In claim 1,

The light propagation module further includes a first photodetector and a second photodetector,

The optical path of the light propagation module is:

A first part connecting the first collimator and the second collimator;

a second part extending from the first part and connected to the first photodetector; and

An optical system comprising a third portion extending from the first portion and connected to the second photodetector.
In claim 6,

The first emission light emitted from the object in response to the first beam being irradiated to the object propagates to the first photodetector,

and wherein second emission light emitted from the object in response to irradiating the object with the second beam propagates to the second photodetector.
In claim 6,

The light propagation module includes a first connection portion capable of being coupled to the first collimator and a second connection portion capable of being coupled to the third collimator,

The optical path of the light propagation module includes a fourth part connecting the first part and the second connection part,

An optical system in which a collimator corresponding to the one connection part is coupled to one of the first connection part or the second connection part determined based on the optical characteristics of the first laser and the second laser.
In claim 6,

The plurality of optical members include a first beam splitter and a second beam splitter,

In the first portion of the optical path:

A first groove is formed to accommodate the first beam splitter,

An optical system, wherein a second groove is formed to receive the second beam splitter.
In claim 9,

A first rail is disposed in the second groove,

The second beam splitter is fixed on the first rail,

The first beam and the second beam are incident on the second beam splitter when the second beam splitter is in a first position on the first rail,

and wherein the first beam and the second beam are not incident on the second beam splitter when the second beam splitter moves a specified distance from the first position along the first rail.
In claim 10,

The position of the second beam splitter on the first rail is controlled by at least one processor included in the light propagation module or controlled according to user input.
In claim 1,

The light propagation module includes a first beam splitter, a first filter, a first lens for controlling focusing of an incident beam, a first pin hole, and a first photodetector,

The first filter is disposed between the first beam splitter and the first photodetector,

The first lens is disposed between the first filter and the first photodetector,

An optical system wherein the first pinhole through which the beam output from the first lens passes is disposed between the first lens and the first photodetector.
In claim 1,

The central wavelength of the first emission light emitted from the object in response to the first beam being irradiated to the object has a higher wavelength than the first wavelength of the first beam,

An optical system, wherein a central wavelength of second emission light emitted from the object in response to irradiation of the second beam on the object has a higher wavelength than the second wavelength of the second beam.
In claim 1,

The first wavelength of the first beam is a wavelength corresponding to between 450 nm and 500 nm,

The second wavelength of the second beam is a wavelength corresponding to between 750 nm and 800 nm.
An optical system mounted on a confocal fluorescence microscope radiates a first beam of a first wavelength to an object, acquires emission light emitted from the object, and processes the obtained emission light. Because,

a first laser coupled to the first optical fiber; and

Comprising a light propagation module through which the first beam output from the first laser propagates,

The optical propagation module:

an optical path along which the first beam and the emitted light propagate;

a plurality of optical members,

A first collimator coupled to the first optical fiber; and

An optical system comprising a second collimator coupled with a second optical fiber coupled with a probe for irradiating the first beam propagating through the light propagation module to the object.