WO2016195464A2 - Complex medical imaging system - Google Patents

Abstract

The present invention relates to a complex medical imaging system comprising: an electron multiplying CCD camera disposed on a first optical path; a visible light camera which is disposed on a second optical path and photographs a visible light image; a radiation-photon conversion module for converting a radiation emitted from a living body into photons and emitting the same; an optical path switching module installed so as to be switched between a first operation mode where, among near-infrared rays reflected from a living body and photons emitted from the radiation-photon conversion module, the photons are directed to the first optical path and visible light reflected from the living body is directed to the second optical path, and a first operation mode where, among near-infrared rays reflected from a living body and photons emitted from the radiation-photon conversion module, the near-infrared rays are directed to the first optical path and visible light reflected from the living body is directed to the second optical path; and a complex imaging control unit which operates in a first photographing mode where a near-infrared fluorescence image and a first visible light image are photographed by the electron multiplying CCD camera and the visible light camera, respectively, in a state where the optical path conversion module is placed in the first operation mode, and a second photographing mode where a radiographic image and a second visible light image are photographed by the electron multiplying CCD camera and the visible light camera, respectively, in a state where the optical path conversion module is placed in the second operation mode. Accordingly, the present invention can acquire and match a near-infrared fluorescence image, a radiographic image, and a visible light image through one optical system.

Description

Medical Complex Imaging System

The present invention relates to a medical complex imaging system, and more particularly, to a medical complex imaging system capable of acquiring and matching near infrared fluorescence images, radiographic images and visible light images through one optical system.

Sentinel lymph node (SLN) is a lymph node in which cancer cells preferentially metastasize in the primary tumor and is an important indicator for determining lymph node metastasis. If no cancer cells are found through the biopsy of the monitored lymph nodes, other lymph nodes may be metastatic and no further surgery will be performed.

In-vivo examination of lymph node through accurate search of the lymph node, which is an important indicator in determining the metastasis of cancer, can reduce postoperative sequelae such as lymphedema and minimize scarring on the patient's body. . As a result, surveillance lymph nodes using targeted drugs have been used as a standard technique in early breast cancer or melanoma surgery.

In order to detect the lymph nodes in the body by using a target drug, a method of obtaining a visible light image using a blue dye and a visible light camera, and a near infrared fluorescence image using a near infrared fluorescent dye and a near infrared camera A method of obtaining and a method of obtaining a radiographic image by photographing a radiopharmaceutical integrated in a surveillance lymph node with a gamma imaging device have been proposed.

FIG. 1 shows an example of an image of various monitoring lymph nodes in the body using a target drug, and FIG. 1 (a) is an image obtained by dyeing the monitoring lymph nodes using a blue dye. b) is a fusion image of a near-infrared fluorescent dye image and an optical image, and FIG. 1 (c) is an image of a radiopharmaceutical integrated in a monitoring lymph node, taken by a radiographic apparatus.

The dyeing method using blue dye has the advantage that the operator can visually distinguish it, but it can be used only to search for the monitoring lymph nodes where the surface is located, so in the case of deep organs, the Ex-vivo test should be performed. Various problems exist, including dyeing with dyes.

The near-infrared fluorescent dye method is useful for detecting lymph nodes of about 1cm in permeability, but it is still difficult to detect lymph nodes located deep in the body. In addition, the resolution is relatively high compared to the radiographic image, but unlike the visible light image, there is a disadvantage that it is insufficient to obtain anatomical information.

The method using radiopharmaceuticals is useful for detecting lymph nodes located at the deep part of the body because of high permeability, but it is difficult to accurately detect lymph nodes using only radiographic images, as shown in (c) of FIG. 1.

As described above, in order to compensate for the advantages and disadvantages of each image, a method of simultaneously photographing two or more images and searching for a surveillance lymph node using the images fused is recently proposed.

For example, in the apparatus and method for detecting near-infrared fluorescence of surveillance lymph nodes disclosed in Korean Patent Publication No. 10-1514204, a near-infrared fluorescence emitted by a fluorescent material such as indocyanine green and excitation light is reproduced together with a visible light image. A technique for implementing a composite image is disclosed.

Therefore, not only the visible light image with excellent anatomical information, the high signal-to-noise ratio and the near-infrared fluorescence image that provides excellent discrimination for the superficial lymph nodes located on the surface, but also the accurate position information of the superimposed lymph nodes located inside the body If the available gamma images can be used together, it is expected that the accuracy of the detection of the lymph node can be greatly improved.

Accordingly, an object of the present invention is to provide a medical complex imaging system capable of acquiring and matching a near infrared fluorescence image, a radiographic image, and a visible light image through one optical system. have.

According to the present invention, there is provided a medical complex imaging system, comprising: an electron multiplication CCD camera disposed on a first optical path; A visible light camera disposed on the second light path to photograph a visible light image; A radiation-photon conversion module for converting and radiating radiation emitted from the living body into photons; A first operating mode in which near infrared rays reflected from the living body and photons emitted from the radiation-photon conversion module are directed to the first optical path, and visible light reflected from the living body is directed to the second optical path; An optical path movably installed between a near infrared ray and a first operation mode in which photons of photons emitted from the radiation-photon conversion module are directed to the first optical path and visible light reflected from the living body is directed to the second optical path A conversion module; A first photographing mode in which a near infrared fluorescence image and a first visible light image are photographed by the electron multiplication CCD camera and the visible light camera while the optical path switching module is in the first operation mode, and the optical path switching module is And a composite imaging controller configured to operate in a second photographing mode in which a radiographic image and a second visible light image are respectively photographed by the electron multiplying CCD camera and the visible light camera in the second operating mode. Achieved by an imaging system.

Here, the optical path switching module is disposed in an intersection area where the first optical path and the second optical path cross each other in the first operation mode, and divides the light reflected from the living body to respectively divide the first optical path and the first optical path. A light splitting portion directed to a two light paths, the light splitting portion deviating from the crossing area in the second operation mode; Directing a light path of photons emitted from the radiation-photon conversion module in the second mode of operation to the first light path, and wherein the light path of photons emitted from the radiation-photon conversion module in the first mode of operation It may include a photon path control unit for blocking the entry to the first optical path.

The light splitter may include a dichroic light splitter that splits near infrared rays and visible light reflected from a living body to direct near infrared rays to the first light path and direct visible light to the second light path.

And wherein the photon path controller is arranged between the radiation-photon conversion module and the first light path in the second mode of operation to direct photons emitted from the radiation-photon conversion module to the first light path. It may include one reflective mirror.

And wherein the first optical path is located on the near-infrared light path reflected from the living body and transmitted through the dichroic light splitter; The second optical path is located on the optical path of visible light reflected from the living body and reflected from the dichroic light splitter; The reflection mirror comprises a first reflection mirror for reflecting photons emitted from the radiation-photon conversion module to the intersection area; And a second reflection mirror disposed at the crossing area to reflect photons reflected from the first reflection mirror in the direction of the first optical path to be directed to the electron multiplication CCD camera.

Wherein the second reflecting mirror comprises a first reflecting surface on which photons are reflected and a second reflecting surface formed on a rear surface of the first reflecting surface; When the second reflection mirror is disposed at the intersection area in the second operation mode, visible light reflected from the living body may be reflected from the second reflection surface in the direction of the second light path to the visible light camera.

The first optical path is also located on the near-infrared light path reflected from the living body and reflected from the dichroic light splitter; The second optical path is located on the optical path of visible light reflected from the living body and transmitted through the dichroic light splitter; The reflection mirror may reflect the photons emitted from the radiation-photon conversion module in the direction of the first optical path to the electron multiplication CCD camera.

In addition, the radiation-photon conversion module is disposed between the living area and the intersection area where the first optical path and the second optical path intersect; The optical path switching module may include: a first reflection mirror configured to reflect light reflected from the living body in the first operation mode and the second operation mode to an intersection area where the first optical path and the second optical path cross each other; Disposed at the intersection region in a first operating mode to direct light reflected by the first reflection mirror to the first optical path and the second optical path, respectively, and to deviate from the intersection region in the second operating mode It may include a light splitter.

The light splitter may include a dichroic light splitter that splits near-infrared light and visible light reflected from a living body to direct near-infrared light to the first light path and direct visible light to the second light path.

The first optical path is located on the near-infrared light path reflected by the first reflection mirror and reflected from the dichroic light splitter; The second optical path is located on the optical path of visible light reflected by the first reflective mirror and transmitted through the dichroic light splitter; The dichroic light splitter is separated from the crossing area in the second mode of operation such that light reflected by the first reflection mirror is directed to the visible light camera through the second light path, and the radiation-photon conversion module Photons emitted from the light beam may be directed to the electron multiplication CCD camera through the first optical path.

The first optical path is located on the near-infrared light path reflected by the first reflection mirror and transmitted through the dichroic light splitter; The second optical path is located on the optical path of visible light reflected by the first reflective mirror and reflected from the dichroic light splitter; The optical path switching module is disposed in the crossing area in the second operating mode, is separated from the crossing area in the first operating mode, and reflects light reflected by the first reflection mirror in the direction of the second optical path. A second reflection surface having a first reflection surface directed toward the visible light camera and a second reflection surface that reflects photons emitted from the radiation-photon conversion module in the direction of the first light path to be directed toward the electron multiplication CCD camera. It may further include a mirror.

The photonic device may further include a photon blocking unit disposed between the radiation-photon conversion module and the dichroic light splitter in the first operation mode to block photons toward the dichroic light splitter.

The apparatus may further include a near-infrared cutoff filter for blocking entrance of the near-infrared rays reflected from the living body to the visible light camera.

The radiation-photon conversion module may further include a collimator for selectively passing the radiation according to the incident direction of the radiation; In response to the radiation passing through the collimator may include a scintillator for emitting photons at a position corresponding to the radiation reaction position.

And the composite imaging controller compares the first visible light image with the second visible light image and extracts a deformation parameter when any one of the first visible light image and the second visible light image is matched with another one; One of the near infrared fluorescence image and the radiation image may be corrected based on the deformation parameter.

According to the present invention according to the configuration as described above, there is provided a medical complex imaging system that can acquire and match the near infrared fluorescence image, radiographic image and visible light image through one optical system.

In addition, by obtaining a radiographic image using an electron multiplication CCD camera, not only can minimize the weight and size of the system, but also reduce the manufacturing cost.

1 is a view showing an example of the image to search the various monitoring lymph nodes in the body using the target drug,

2 to 4 is a view showing the configuration of a medical complex imaging system according to a first embodiment of the present invention,

5 is a view for explaining a method of operating the optical path switching module according to a first embodiment of the present invention,

6 is a view for explaining the image registration method of the medical complex imaging system according to the first embodiment of the present invention,

7 and 8 are views showing the configuration of a medical complex imaging system according to a second embodiment of the present invention,

9 is a view for explaining a method of operating the optical path switching module according to a second embodiment of the present invention,

10 and 11 are views showing the configuration of a medical complex imaging system according to a third embodiment of the present invention,

12 is a view for explaining a method of operating the optical path switching module according to a third embodiment of the present invention;

13 and 14 are views showing the configuration of a medical complex imaging system according to a fourth embodiment of the present invention,

15 is a view for explaining a method of operating the optical path switching module according to a fourth embodiment of the present invention.

The present invention relates to a medical complex imaging system, comprising: an electron multiplication CCD camera disposed on a first optical path; A visible light camera disposed on the second light path to photograph a visible light image; A radiation-photon conversion module for converting and radiating radiation emitted from the living body into photons; A first operating mode in which near infrared rays reflected from the living body and photons emitted from the radiation-photon conversion module are directed to the first optical path, and visible light reflected from the living body is directed to the second optical path; An optical path movably installed between a near infrared ray and a first operation mode in which photons of photons emitted from the radiation-photon conversion module are directed to the first optical path and visible light reflected from the living body is directed to the second optical path A conversion module; A first photographing mode in which a near infrared fluorescence image and a first visible light image are photographed by the electron multiplication CCD camera and the visible light camera while the optical path switching module is in the first operation mode, and the optical path switching module is And a composite imaging controller configured to operate in a second photographing mode in which a radiographic image and a second visible light image are respectively photographed by the electron multiplication CCD camera and the visible light camera in the second operation mode.

Hereinafter, with reference to the accompanying drawings will be described embodiments of the present invention; Here, in describing the embodiments according to the present invention, the same reference numerals are used for components corresponding to each other, and description thereof may be omitted.

[First Embodiment]

2 to 4 are diagrams showing the configuration of the medical complex imaging system 100 according to the first embodiment of the present invention. Here, the thick solid line in FIGS. 2 and 3 shows photons, the thin solid line shows near infrared rays, and the thin broken line shows the optical path of visible light.

2 to 4, the medical complex imaging system 100 according to the first embodiment of the present invention includes an electron multiplication CCD camera 10, a visible light camera 20, and a radiation-photon conversion module 30. , The optical path switching module 40, 50, and the composite imaging controller 200.

The electron multiplication CCD camera 10 uses an electron multiplication CCD (Electron Multiplying Charge-Coupled Device, EMCCD) device as a photographing device. Electron Multiplying Charge-Coupled Device (EMCCD) devices are equipped with an electronic multiplication module installed in front of high-resolution CCD devices to minimize signal-to-noise ratios and to cool near-infrared fluorescence images. Decreases.

In addition, the electron multiplying charge-coupled device (EMCCD) device amplifies and photographs photons emitted from the radiation-photon conversion module 30 through the electron multiplication module, thereby enabling radiographic imaging.

The visible light camera 20 photographs a visible light image. In the present invention, a visible light image is provided in the form of a CCD camera.

In the present invention, the electron multiplication CCD camera 10 is disposed on the first optical path, and the visible light camera 20 is disposed on the second optical path. Here, the first optical path and the second optical path are formed to be substantially perpendicular to each other. In the first embodiment of the present invention, as shown in FIGS. For example, the first light path and the second light path are disposed vertically, and the visible light camera 20 is disposed on the side.

The radiation-photon conversion module 30 converts the radiation emitted from the living body into photons and emits them. In the present invention, the radiation-photon conversion module 30, as shown in Figures 2 and 3, the collimator 31 (Collimator) for selectively passing the radiation in accordance with the direction of incidence of the radiation line and the collimator 31 An example includes a scintillator 32 that emits photons at positions corresponding to the radiation-responsive positions in response to the radiation passing through.

2 and 3, the pin-hole type collimator 31 is applied as the collimator 31, but porous parallel collimator, a diverging type collimator, and a converging type collimator. Various collimators can be applied.

The optical path switching modules 40 and 50 are installed to be movable between the first operation mode and the second operation mode. 2 is a diagram illustrating a state in which the optical path switching modules 40 and 50 are moved to the first operation mode, and FIG. 3 is a diagram illustrating a state in which the optical path switching modules 40 and 50 are moved to the second operation mode. As a detailed description thereof will be described later with reference to FIG. 5.

In the state where the optical path switching modules 40 and 50 are moved to the first operation mode, as shown in FIG. 2, the near infrared light reflected from the living body and the photon output from the radiation-photon conversion module 30 are removed. You will be directed to 1 path. On the other hand, in the state where the optical path switching modules 40 and 50 are moved to the second operation mode, as shown in FIG. 3, photons among photons output from the near-infrared rays reflected from the living body and the radiation-photon conversion module 30 are shown. Is directed to the first optical path. Here, the optical path switching modules 40 and 50 direct visible light reflected from the living body to the second optical path in both the first operation mode and the second operation mode.

On the other hand, the composite imaging controller 200 is a near-infrared fluorescent image and the first visible light by the electron multiplication CCD camera 10 and the visible light camera 20, respectively, with the optical path switching module 40, 50 in the first operating mode. The first operation mode is to capture an image.

In addition, the composite imaging control unit 200 is a radiation image and a second visible light image by the electron multiplication CCD camera 10 and the visible light camera 20, respectively, with the optical path switching modules 40 and 50 in the second operation mode. The second mode of shooting is performed.

Here, the composite imaging controller 200 may control on / off of the near-infrared light source 61 and the infrared light source so that the near-infrared fluorescent image and the visible light image can be captured. In the case of the visible light source 62, for example, a white light source, the visible light source 62 may be controlled to be always in the first photographing mode and the second photographing mode, and the near-infrared light source 61 may be controlled to be turned on only in the first photographing mode. .

According to the above configuration, as the optical path switching module 40, 50 selectively moves to the first operation mode or the second operation mode, the near-infrared fluorescence image and the first visible light image are simultaneously captured (first imaging mode). Alternatively, the radiographic image and the second visible light image are simultaneously photographed (second photographing mode), so that the near infrared fluorescence image, the visible light image, and the radiographic image can be obtained through one optical system.

Here, reference numerals 81, 82, 83, and 84 of FIGS. 2 and 3 are lenses disposed on respective light paths, and lenses of various types, such as distance from a living body or parallel light formation, may be used. It can be installed according to the needs, and those skilled in the art having the ordinary skill in the art will be able to apply the appropriate lens configuration as necessary bar detailed description thereof will be omitted.

Hereinafter, the optical path switching modules 40 and 50 according to the first embodiment of the present invention will be described in detail with reference to FIGS. 2, 3 and 5.

The optical path switching modules 40 and 50 according to the first exemplary embodiment of the present invention may include a light splitter 40 and a photon path adjuster 50. Here, the spirituality processing unit, as shown in Figure 5, by driving the module driving unit 70, such as a linear motor, the optical splitting unit 40 and the photon path control unit (constituting the optical path switching module (40, 50) ( 50) can be disposed in the corresponding position in the first operation mode and the second operation mode.

The light splitter 40 is disposed in an intersection area where the first optical path and the second optical path intersect in the first operation mode. As shown in FIGS. 2 and 5A, the light splitter 40 splits the light reflected from the living body in a state in which the light splitter 40 is disposed in the intersection area in the first operation mode and the first light path. Direct to the second optical path. Here, the light splitter 40 is separated from the crossing area in the second operation mode, as shown in FIGS. 3 and 5B.

In the present invention, for example, the light splitter 40 is provided in the form of a dichroic beam splitter. Accordingly, the dichroic light splitter divides the near-infrared and visible light reflected from the living body according to its wavelength, directing the near-infrared light to the first light path and directing the visible light to the second light path, thereby reducing the near-infrared light by the electron multiplication CCE camera. The visible light is photographed by the knight camera.

The photon path adjusting unit 50 converts the optical path of photons emitted from the radiation-photon conversion module 30 into the first optical path in the second operation mode, as shown in FIGS. 3 and 5 (b). And block in the first mode of operation the entry of the light path of the photon emitted from the radiation-photon conversion module 30 into the first light path, as shown in FIGS. 2 and 5 (a). .

In the present invention, the photon path adjusting unit 50 includes at least one reflective mirror disposed between the radiation-photon conversion module 30 and the first light path in the second operation mode. In the first embodiment of the present invention, the photon path adjusting unit 50 includes the first reflecting mirror 51 and the second reflecting mirror 52.

More specifically, in the first embodiment of the present invention, as shown in Figs. 2 and 3, the first light path is located on the light path of the near infrared light reflected from the living body and transmitted through the dichroic light splitter, As an example, the second optical path is located on the optical path of the visible light reflected from the living body and reflected from the dichroic light splitter. That is, the near-infrared rays reflected from the living body pass through the dichroic light splitter and are directed to the electron multiplication CCD camera 10 through the first optical path, and the visible light reflected from the living body is reflected from the dichroic light splitter and then the second light. The path is directed to the visible light camera 20.

At this time, the first reflection mirror 51 reflects the photons emitted from the radiation-photon conversion module 30 to the cross region, as shown in FIGS. 3 and 5 (b). Then, the second reflection mirror 52 is disposed in the cross region and reflects the photons reflected from the first reflection mirror 51 in the direction of the first light path to be directed to the electron multiplication CCD camera 10, thereby causing the electron multiplication CCD camera. 10 makes it possible to take a radiographic image.

Here, the second reflecting mirror 52 may include a first reflecting surface on which photons are reflected and a second reflecting surface formed on a rear surface of the first reflecting surface. This allows the visible light reflected from the living body to be reflected from the second reflecting surface in the direction of the second light path when the second reflecting mirror 52 is disposed in the intersection area in the second operation mode, and then directed to the visible light camera 20. do.

According to the configuration as described above, the near-infrared fluorescence image, the complex imaging control unit 200 of the medical complex imaging system 100 according to the first embodiment of the present invention through the operation in the first imaging mode and the second imaging mode, A process of photographing a visible light image and a radiographic image will be described.

First, the complex imaging controller 200 moves the optical path switching modules 40 and 50 to the first operation mode in the first photographing mode. As described above, when the optical path switching module 40, 50 moves to the first operation mode, the light splitter 40 is disposed in the crossing area and the photon path adjusting unit 50 is separated from the optical path of the photon. do.

Here, when the near-infrared light source 61 and the visible light source 62 are turned on, the near-infrared light reflected from the living body passes through the light splitter 40, that is, the dichroic light splitter, and passes through the first optical path to form an electron multiplication CCD camera ( 10) is taken by. The visible light reflected from the living body is reflected by the light splitter 40, that is, the dichroic light splitter, and is captured by the visible light camera 20 through the second optical path.

At this time, the photon path adjusting unit 50 composed of the first mirror and the second mirror is separated from the radiation-photon conversion module 30 on the optical path of the photons emitted from the radiation-photon conversion module 30. The emitted photons are not directed to the electron multiplication CCD camera 10.

Accordingly, in the first photographing mode, the near infrared fluorescence image and the first visible light image are simultaneously photographed by the electron multiplication CCD camera 10 and the visible light camera 20.

Meanwhile, the composite imaging controller 200 moves the optical path switching modules 40 and 50 to the second operation mode in the second photographing mode. As described above, when the optical path switching module 40, 50 moves to the second operation mode, the optical splitter 40 is separated from the crossing area, and the photon path adjusting unit 50 is on the optical path of the photon. Are arranged as shown in FIG. 3.

Here, when the visible light source 62 is turned on, the visible light reflected from the living body is reflected from the second reflecting surface of the second reflecting mirror 52 to face the visible light camera 20. Further, photons emitted from the radiation-photon conversion module 30 are reflected by the first reflection mirror 51 and directed to the crossing area, that is, the second reflection mirror 52, and again from the second reflection mirror 52. It is reflected and directed to the electron multiplication CCD camera 10 through the first optical path.

Accordingly, in the second photographing mode, the radiation image and the second visible light image are simultaneously photographed by the electron multiplication CCD camera 10 and the visible light camera 20.

Here, as described above, the complex imaging controller 200 may turn off the NIR light source 61 to remove the NIR reflected from the living body in the second imaging mode. On the other hand, the near-infrared light source 61 of the near-infrared light reflected from the living body in order to block the near-infrared light that may be introduced into the visible light camera 20 due to other reasons, such as to maintain the on-infrared light source 61 in the second photographing mode. A near infrared cut filter 90 may be disposed to block entry to the c).

2 and 3, the near-infrared cut filter 90 is installed at the front end of the visible light camera 20, but does not affect the near-infrared toward the electron multiplication CCD camera 10. The near-infrared cut filter 90 may be installed at another position, and may be provided to block near-infrared rays flowing into the visible light camera 20 by moving together with the movement of the optical path switching modules 40 and 50. .

Meanwhile, the composite imaging controller 200 may match the near infrared fluorescence image photographed in the first photographing mode with the first visible light image, and the radiation image photographed with the second visible light image in the second photographing mode.

Here, the medical complex imaging system 100 according to the present invention is radiation-photon conversion so that the near-infrared fluorescence image photographed by the electron multiplication CCD camera 10 and the visible image captured by the visible light camera 20 match each other. The positions of the module 30, the light path switching modules 40 and 50, the electron multiplication CCD camera 10 and the visible light camera 20 are determined.

For example, the radiation-photon conversion module 30 may be matched with a visible light image or a near infrared fluorescence image by adjusting an angle of view of the pinhole collimator 31. Since it starts through the optical path, it can be matched by matching the distance between the electron multiplication CCD camera 10 and the visible light camera 20 from the crossing area.

In the matched state as described above, a mismatch may occur between the image photographed in the first photographing mode and the second photographing mode due to a difference in photographing time between the first photographing mode and the second photographing mode. In particular, in the case of taking a radiographic image, since it takes a few seconds to several minutes, a mismatch may occur due to a time difference between the two modes.

Referring to FIG. 6, FIG. 6A illustrates a second visible light image (left image) and a radiation image (right image) captured in the second photographing mode, and FIG. 6B illustrates a second image. 1 is a view showing a first visible light image (left image) and a near infrared fluorescence image (right image) photographed in a photographing mode.

As shown in (a) and (b) of FIG. 6, when a mismatch occurs due to a movement of a patient according to a time difference between the first and second imaging modes, the complex imaging controller 200 may be used. Compares the first visible light image with the second visible light image and extracts a deformation parameter when any one of the first visible light image and the second visible light image is matched with the other.

In FIG. 6, when the first visible light image shown in FIG. 6B is rotated by a predetermined angle, the second visible light image shown in FIG. 6A is matched with the second visible light image shown in FIG. 6C. Similarly, the near-infrared fluorescent image is corrected by the rotation angle of the first visible light image, that is, the deformation parameter.

FIG. 6D illustrates a mismatch generated when the second visible light image and the radiation image are merged without correcting the near infrared fluorescence image, and the right image of FIG. As shown in (c) of FIG. 6, a composite image generated by merging a near-infrared fluorescence image using deformation parameters and merging with a second visible light image and a radiation image is illustrated.

Second Embodiment

Hereinafter, a medical complex imaging system 100a according to a second exemplary embodiment of the present invention will be described in detail with reference to FIGS. 7 to 9. Here, the medical complex imaging system 100a according to the second exemplary embodiment of the present invention will be described with reference to a modification of the first exemplary embodiment, which is different from the first exemplary embodiment. In addition, the configuration of the control block diagram shown in FIG. 4 is also applied to the description of the second embodiment, and as in the first embodiment, the thick solid lines in FIGS. 7 and 8 are photons, the thin solid lines are near infrared rays, and the thin dashed lines. Shows the optical path of visible light.

7 to 9, the medical complex imaging system 100a according to the second exemplary embodiment of the present invention includes an electron multiplication CCD camera 10, a visible light camera 20, and a radiation-photon conversion module 30. And optical path switching modules 40a and 50a and composite imaging controller 200.

Here, in the second embodiment of the present invention, unlike the first embodiment, the visible light camera 20 is disposed on the upper part of the living body, and the electron multiplication CCD camera 10 is disposed on the side so that the first optical path and the second As an example, the optical path is formed in a vertical state.

Similar to the first embodiment, the optical path switching modules 40a and 50a are installed to be movable between the first operation mode and the second operation mode. FIG. 7 is a diagram illustrating a state in which the optical path switching modules 40a and 50a are moved to the first operation mode, and FIG. 8 is a diagram illustrating a state in which the optical path switching modules 40a and 50a are moved to the second operation mode. to be.

In the state where the optical path switching modules 40a and 50a are moved to the first operation mode, as shown in FIG. 7, the near infrared rays among the near infrared rays reflected from the living body and the photons output from the radiation-photon conversion module 30 are removed. You will be directed to 1 path On the other hand, in the state in which the optical path switching modules 40a and 50a are moved to the second operation mode, as shown in FIG. 8, photons of the near infrared rays reflected from the living body and the photons output from the radiation-photon conversion module 30 are shown. Is directed to the first optical path. Here, the optical path switching modules 40a and 50a direct visible light reflected from the living body to the second optical path in both the first operation mode and the second operation mode.

7 to 9, the optical path switching module 40a or 50a according to the second embodiment of the present invention may include a light splitter 40a and a photon path adjuster.

As in the first embodiment, the light splitter 40a is disposed in an intersection area where the first light path and the second light path intersect in the first operation mode. As illustrated in FIGS. 7 and 9A, the light splitter 40a divides the light reflected from the living body in a state in which the light splitter 40a is disposed at the intersection area in the first operation mode, and the first optical path and the first light path. Direct to the second optical path. Here, the light splitter 40a is separated from the crossing area in the second operation mode, as shown in FIGS. 8 and 9B.

As in the first embodiment, the light splitter 40a according to the second embodiment of the present invention is provided in the form of a dichroic beam splitter. Accordingly, the dichroic light splitter divides the near-infrared and visible light reflected from the living body according to its wavelength, directing the near-infrared light to the first light path and directing the visible light to the second light path, thereby reducing the near-infrared light by the electron multiplication CCE camera. The visible light is photographed by the knight camera.

The photon path controller directs the optical path of the photons emitted from the radiation-photon conversion module 30 to the first optical path in the second mode of operation, as shown in FIGS. 8 and 9 (b). In one mode of operation, as shown in FIGS. 7 and 9 (a), the photon emitted from the radiation-photon conversion module 30 blocks the optical path from entering the first optical path.

Here, the photon path control unit according to the second embodiment of the present invention is implemented by way of one reflective mirror 50a. More specifically, in the second embodiment of the present invention, as in the arrangement of the electron multiplication CCD camera 10 and the visible light camera 20 described above, the first light path is reflected from the living body and is separated from the dichroic light splitter. For example, it is located on the reflected light path of near infrared rays, and the second light path is located on the light path of visible light reflected from the living body and transmitted through the dichroic light splitter. That is, the near infrared rays reflected from the living body are reflected from the dichroic light splitter and then directed to the electron multiplication CCD camera 10 through the first optical path, and the visible light reflected from the living body passes through the dichroic light splitter and then the second light. The path is directed to the visible light camera 20.

At this time, the reflection mirror 50a reflects the photons emitted from the radiation-photon conversion module 30 in the direction of the first optical path, as shown in FIGS. 8 and 9 (b), to form an electron multiplication CCD camera. By pointing to 10, the electron multiplication CCD camera 10 makes it possible to take a radiographic image.

According to the configuration as described above, the near-infrared fluorescence image, the complex imaging control unit 200 of the medical complex imaging system 100a according to the second embodiment of the present invention through the operation in the first and second imaging mode, A process of photographing a visible light image and a radiographic image will be described.

First, the complex imaging controller 200 moves the optical path switching modules 40a and 50a to the first operation mode in the first photographing mode. As described above, when the optical path switching modules 40a and 50a move to the first operation mode, the light splitter 40a is disposed in the crossing area and the photon path adjusting part is separated on the optical path of the photons.

Here, when the near-infrared light source 61 and the visible light source 62 are turned on, the near-infrared light reflected from the living body is reflected from the light splitter 40a, that is, the dichroic light splitter, and is subjected to the electron multiplication CCD camera through the first optical path. 10) is taken by. The visible light reflected from the living body is photographed by the visible light camera 20 through the light splitter 40a, that is, the dichroic light splitter, through the second light path.

At this time, since the photon path control unit, that is, the reflection mirror 50a is separated from the photon path of the photons emitted from the radiation-photon conversion module 30, the photons emitted from the radiation-photon conversion module 30 are electrons. It cannot be directed to the multiplication CCD camera 10. Accordingly, in the first photographing mode, the near infrared fluorescence image and the first visible light image are simultaneously photographed by the electron multiplication CCD camera 10 and the visible light camera 20.

Meanwhile, the composite imaging controller 200 moves the optical path switching modules 40a and 50a to the second operation mode in the second photographing mode. As described above, when the optical path switching modules 40a and 50a move to the second operation mode, the light splitter 40a is separated from the crossing area, and the reflection mirror 50a constituting the photon path adjusting unit is a photon. On the optical path of, as shown in FIG. 8.

Here, when the visible light source 62 is turned on, the visible light reflected from the living body is directed toward the visible light camera 20 through the second light path. Further, photons emitted from the radiation-photon conversion module 30 are reflected by the reflection mirror 50a and directed to the electron multiplication CCD camera 10 through the first optical path. Accordingly, in the second photographing mode, the radiation image and the second visible light image are simultaneously photographed by the electron multiplication CCD camera 10 and the visible light camera 20.

As in the first exemplary embodiment, the complex imaging controller 200 may turn off the NIR light source 61 in the second photographing mode. Also, as in the first embodiment, a near infrared cut filter 90 may be disposed.

Third Embodiment

Hereinafter, a medical complex imaging system 100b according to a third exemplary embodiment of the present invention will be described in detail with reference to FIGS. 10 to 12. Here, the medical complex imaging system 100b according to the third exemplary embodiment of the present invention will be described with a modification of the first exemplary embodiment, focusing on a different part from the first exemplary embodiment. In addition, the configuration of the control block diagram shown in FIG. 4 is also applied to the description of the third embodiment, and as in the first embodiment, the thick solid lines in FIGS. 10 and 11 are photons, the thin solid lines are near infrared rays, and the thin dashed lines. Shows the optical path of visible light.

10 to 12, the medical complex imaging system 100b according to the third exemplary embodiment of the present invention includes an electron multiplication CCD camera 10, a visible light camera 20, and a radiation-photon conversion module 30. And optical path switching modules 41b and 42b and composite imaging controller 200.

Here, in the third embodiment of the present invention, as in the first embodiment, the electron multiplication CCD camera 10 is disposed on the upper part of the living body, and the visible light camera 20 is disposed on the side surface so that the first optical path and the second As an example, the optical path is formed in a vertical state.

10 and 11, the electron multiplication CCD camera 10 and the radiation-photon conversion module 30 are disposed on the same optical axis. That is, the radiation-photon conversion module 30 is disposed between the living body and the intersection area where the first light path and the second light path intersect.

Similar to the first embodiment, the optical path switching modules 41b and 42b are installed to be movable between the first operation mode and the second operation mode. FIG. 10 is a view illustrating a state in which the optical path switching modules 41b and 42b are moved to the first operation mode, and FIG. 11 is a view illustrating a state in which the optical path switching modules 41b and 42b are moved to the second operation mode. to be.

The optical path switching modules 41b and 42b according to the third exemplary embodiment of the present invention may include the first reflection mirror 41b and the light splitter 42b.

The first reflection mirror 41b reflects the light reflected from the living body, that is, the visible light and the near infrared ray, to the intersection area where the first light path and the second light path cross each other in the first and second operating modes.

In addition, the light splitter 42b is disposed at an intersection area in the first operation mode to direct the light reflected by the first reflection mirror 41b to the first light path and the second light path, respectively, and in the second operation mode. Deviates from the intersection region at.

The light splitter 42b according to the third exemplary embodiment of the present invention is provided in the form of a dichroic beam splitter similarly to the first and second embodiments. Accordingly, the dichroic light splitter splits the near infrared rays and the visible light reflected by the first reflection mirror 41b according to their wavelengths after being reflected from the living body, directing the near infrared rays to the first optical path and directing the visible light to the second optical path. By directing to, the near infrared ray is photographed by the electron multiplication CCE camera and the visible light is photographed by the knight light camera.

Here, in the third embodiment of the present invention, as in the arrangement of the electron multiplying CCD camera 10 and the visible light camera 20 described above, the first optical path is half-visible by the first reflection mirror 41b to be dichroic. An example is located on the light path of the near infrared rays reflected from the light splitter, and the second light path is located on the light path of the visible light reflected from the first reflection mirror 41b and transmitted through the dichroic light splitter. That is, the near infrared rays reflected from the first reflection mirror 41b are reflected from the dichroic light splitter and then directed to the electron multiplication CCD camera 10 through the first optical path, and the visible light reflected from the first reflection mirror 41b. After passing through the dichroic light splitter, it is directed to the visible light camera 20 through the second light path.

In the third embodiment of the present invention, the photon blocking part 43b is installed between the radiation-photon conversion module 30 and the dichroic light splitter in the first mode of operation. This prevents photons emitted from the radiation-photon conversion module 30 in the first operation mode from being directed to the dichroic light splitter, thereby radiating the photons in the first visible light image and the near-infrared fluorescent image captured in the first imaging mode. Photons emitted from the conversion module 30 can be blocked from affecting.

According to the configuration as described above, the near-infrared fluorescence image, the complex imaging control unit 200 of the medical complex imaging system 100b according to the third embodiment of the present invention through the operation in the first imaging mode and the second imaging mode, A process of photographing a visible light image and a radiographic image will be described.

First, the complex imaging controller 200 moves the optical path switching modules 41b and 42b to the first operation mode in the first photographing mode. As described above, when the optical path switching modules 41b and 42b move to the first operation mode, the light splitting section 42b is disposed in the crossing area.

Here, when the near-infrared light source 61 and the visible light source 62 are turned on, the near-infrared light reflected from the living body is reflected from the first reflection mirror 41b and directed to the light splitting section 42b, and thus, the light splitting section, that is, the dichroic color. It is reflected from the sex light splitter and taken by the electron multiplication CCD camera 10 through the first light path. Then, the visible light reflected from the living body is reflected by the first reflection mirror 41b, is transmitted by the light splitter 42b, that is, the dichroic light splitter, and photographed by the visible light camera 20 through the second light path.

At this time, the photons emitted from the radiation-photon conversion module 30 are blocked by the photon blocking part 43b and are not directed to the electron multiplication CCD camera 10. Accordingly, in the first photographing mode, the near infrared fluorescence image and the first visible light image are simultaneously photographed by the electron multiplication CCD camera 10 and the visible light camera 20.

Meanwhile, the composite imaging controller 200 moves the optical path switching modules 41b and 42b to the second operation mode in the second photographing mode. As described above, when the optical path switching modules 41b and 42b move to the second operation mode, the light splitting section 42b is separated from the crossing area, as shown in FIGS. 11 and 12 (b). Are arranged together.

Here, when the visible light source 62 is turned on, visible light reflected from the living body is reflected from the first reflection mirror 41b to face the visible light camera 20 through the second light path. Further, photons emitted from the radiation-photon conversion module 30 are directed to the electron multiplication CCD camera 10 through the first optical path. Accordingly, in the second photographing mode, the radiation image and the second visible light image are simultaneously photographed by the electron multiplication CCD camera 10 and the visible light camera 20.

As in the first and second embodiments, the complex imaging controller 200 may turn off the NIR light source 61 in the second photographing mode. Also, as in the first and second embodiments, the near infrared cut filter 90 may be disposed.

[Example 4]

Hereinafter, a medical complex imaging system 100c according to a fourth exemplary embodiment of the present invention will be described in detail with reference to FIGS. 13 to 15. Here, the medical complex imaging system 100c according to the fourth exemplary embodiment of the present invention will be described with reference to modifications of the first and third exemplary embodiments, which are different from those of the first and third exemplary embodiments. . In addition, the configuration of the control block diagram shown in FIG. 4 is also applied to the description of the third embodiment, and as in the first embodiment, the thick solid lines in FIGS. 13 and 14 are photons, the thin solid lines are near infrared rays, and the thin dashed lines. Shows the optical path of visible light.

Referring to FIGS. 13 to 15, the medical complex imaging system 100c according to the fourth exemplary embodiment of the present invention may include an electron multiplication CCD camera 10, a visible light camera 20, and a radiation-photon conversion module 30. , Optical path switching modules 41c, 42c, 52c, and composite imaging controller 200.

Here, in the fourth embodiment of the present invention, similarly to the second embodiment, the visible light camera 20 is disposed above the living body, and the electron multiplication CCD camera 10 is disposed on the side, so that the first optical path and the second As an example, the optical path is formed in a vertical state.

13 and 14, the visible light camera 20 and the radiation-photon conversion module 30 are disposed on the same optical axis. That is, the radiation-photon conversion module 30 is disposed between the living body and the intersection area where the first light path and the second light path intersect.

As in the above-described embodiments, the optical path switching modules 41c, 42c, and 52c are installed to be movable between the first operation mode and the second operation mode. FIG. 13 is a view illustrating a state in which the optical path switching modules 41c, 42c, and 52c move to the first operation mode, and FIG. 14 is a view illustrating a state in which the optical path switching modules 41c, 42c, and 52c move to the second operation mode. It is a figure which shows the state.

The optical path switching modules 41c, 42c, and 52c according to the fourth embodiment of the present invention may include a first reflection mirror 41c, a light splitter 42c, and a second reflection mirror 52c.

The first reflection mirror 41c reflects the light reflected from the living body, that is, the visible light and the near infrared ray, to the intersection area where the first light path and the second light path cross each other in the first and second operating modes.

In addition, the light splitter 42c is disposed at an intersection area in the first operation mode to direct the light reflected by the first reflection mirror 41c to the first light path and the second light path, respectively, and in the second operation mode. Deviates from the intersection region at.

The light splitter 42c according to the fourth exemplary embodiment of the present invention is provided in the form of a dichroic beam splitter similarly to the first and second embodiments. Accordingly, the dichroic light splitter splits the near-infrared and visible light reflected by the first reflection mirror 41c according to its wavelength after being reflected from the living body, directing the near-infrared light to the first optical path and directing the visible light to the second optical path. By directing to, the near infrared ray is photographed by the electron multiplication CCE camera and the visible light is photographed by the knight light camera.

Here, in the fourth embodiment of the present invention, as in the arrangement of the electron multiplication CCD camera 10 and the visible light camera 20 described above, the first optical path is half-visible by the first reflection mirror 41c and is dichroic. An example is located on the light path of the near infrared ray passing through the light splitter, and the second light path is located on the light path of visible light reflected from the dichroic light splitter reflected from the first reflection mirror 41c. That is, the near infrared rays reflected from the first reflection mirror 41c are directed to the electron multiplication CCD camera 10 through the first optical path after passing through the dichroic light splitter, and the visible light reflected from the first reflection mirror 41c. Is reflected from the dichroic light splitter and then directed to the visible light camera 20 through the second optical path.

In the fourth embodiment of the present invention, the photon blocking unit 43c is installed between the radiation-photon conversion module 30 and the dichroic light splitter in the first operation mode. This prevents photons emitted from the radiation-photon conversion module 30 in the first operation mode from being directed to the dichroic light splitter, thereby radiating the photons in the first visible light image and the near-infrared fluorescent image captured in the first imaging mode. Photons emitted from the conversion module 30 can be blocked from affecting.

On the other hand, the second reflecting mirror 52c is disposed in the intersection area in the second operation mode and is separated from the intersection area in the first operation mode. Here, the second reflecting mirror 52c may include a first reflecting surface reflecting the visible light reflected by the first reflecting mirror 41c in the second operation mode to the visible light camera 20 by reflecting it to the visible light camera 20, and the radiation. A second reflecting surface which reflects the photons emitted from the photon conversion module 30 in the direction of the first optical path and is directed towards the electron multiplication CCD camera 10.

According to the above configuration, the near-infrared fluorescence image of the complex imaging controller 200 of the medical complex imaging system 100c according to the fourth exemplary embodiment of the present invention is operated through the first imaging mode and the second imaging mode. A process of photographing a visible light image and a radiographic image will be described.

First, the complex imaging controller 200 moves the optical path switching modules 41c, 42c, and 52c to the first operation mode in the first photographing mode. As described above, when the optical path switching modules 41c, 42c, 52c move to the first operation mode, the light splitting section 42c is disposed in the intersection area.

Here, when the near-infrared light source 61 and the visible light source 62 are turned on, the near-infrared light reflected from the living body is reflected from the first reflection mirror 41c and directed to the light splitting section 42c, and thus, the light splitting section, that is, the dichroic color. It is taken by the electron multiplication CCD camera 10 through the first light path through the sex light splitter. Then, the visible light reflected from the living body is reflected from the first reflection mirror 41c, reflected from the light splitter 42c, that is, the dichroic light splitter, and photographed by the visible light camera 20 through the second light path.

At this time, the photons emitted from the radiation-photon conversion module 30 are blocked by the photon blocking part 43c and are not directed to the electron multiplication CCD camera 10. Accordingly, in the first photographing mode, the near infrared fluorescence image and the first visible light image are simultaneously photographed by the electron multiplication CCD camera 10 and the visible light camera 20.

Meanwhile, the composite imaging controller 200 moves the optical path switching modules 41c, 42c, and 52c to the second operation mode in the second photographing mode. As described above, when the optical path switching modules 41c, 42c, and 52c move to the second operation mode, the light splitter 42c is separated from the intersection area, and the second reflection mirror 52c is located at the intersection area. And as shown in Figs. 14 and 15 (b).

Here, when the visible light source 62 is turned on, the visible light reflected from the living body is reflected from the first reflecting mirror 41c and then reflected from the first reflecting surface of the second reflecting mirror 52c to the second light path. To face the visible light camera 20 through. Further, photons emitted from the radiation-photon conversion module 30 are reflected from the second reflecting surface of the second reflecting mirror 52c and directed to the electron multiplication CCD camera 10 through the first optical path. Accordingly, in the second photographing mode, the radiation image and the second visible light image are simultaneously photographed by the electron multiplication CCD camera 10 and the visible light camera 20.

As in the above-described embodiments, the complex imaging controller 200 may turn off the NIR light source 61 in the second photographing mode. In addition, the near-infrared cut filter 90 may be disposed as in the above-described embodiment.

Here, the image correction and registration of the composite imaging controller 200 described through the first embodiment may be applicable to the second to fourth embodiments, of course. In addition, in the above-described embodiment, the light splitter 42c is provided in the form of a dichroic light splitter. However, a conventional light splitter that splits and transmits and reflects incident light by approximately 50 to 50 may be applied. Of course.

Although some embodiments of the invention have been shown and described, it will be apparent to those skilled in the art that modifications may be made to the embodiment without departing from the spirit or spirit of the invention. . It is intended that the scope of the invention be defined by the claims appended hereto and their equivalents.

[Description of the code]

100,100a, 100b, 100c: Medical Complex Imaging System

10: electron multiplication CCD camera 20: visible light camera

30: radiation-photon conversion module 31: collimator

32: scintillator 40, 40a, 42b, 42c: light splitting part

43b, 43c: Photon blocking part 41b, 41c, 50a, 51, 52c: Reflective mirror

61: near infrared light source 62: visible light source

70: module driving unit 90: near infrared cut filter

200: composite imaging control unit

The present invention can be applied to medical imaging equipment, such as to check whether the lymph nodes of the lymph nodes metastasis.

Claims (15)

1. In a medical complex imaging system,

   An electron multiplication CCD camera disposed on the first optical path;

   A visible light camera disposed on the second light path to photograph a visible light image;

   A radiation-photon conversion module for converting and radiating radiation emitted from the living body into photons;

   A first operating mode in which near infrared rays reflected from the living body and photons emitted from the radiation-photon conversion module are directed to the first optical path, and visible light reflected from the living body is directed to the second optical path; An optical path movably installed between a near infrared ray and a first operation mode in which photons of photons emitted from the radiation-photon conversion module are directed to the first optical path and visible light reflected from the living body is directed to the second optical path A conversion module;

   A first photographing mode in which a near infrared fluorescence image and a first visible light image are photographed by the electron multiplication CCD camera and the visible light camera while the optical path switching module is in the first operation mode, and the optical path switching module is And a composite imaging controller configured to operate in a second photographing mode in which a radiographic image and a second visible light image are respectively photographed by the electron multiplying CCD camera and the visible light camera in the second operating mode. Imaging system.
2. The method of claim 1,

   The optical path switching module

   In the first mode of operation, the first light path and the second light path are disposed in an intersection area where the second light path intersects, and splits the light reflected from the living body to direct the first light path and the second light path, respectively, A light splitter that is separated from the crossing area in a second operation mode;

   Directing a light path of photons emitted from the radiation-photon conversion module in the second mode of operation to the first light path, and wherein the light path of photons emitted from the radiation-photon conversion module in the first mode of operation And a photon path controller for blocking entry to the first optical path.
3. The method of claim 2,

   The optical splitter includes a dichroic light splitter that splits near-infrared light and visible light reflected from a living body to direct near-infrared light to the first optical path and direct visible light to the second light path. .
4. The method of claim 3,

   The photon path control unit

   At least one reflective mirror disposed between the radiation-photon conversion module and the first light path in the second mode of operation to direct photons emitted from the radiation-photon conversion module to the first light path. A medical complex imaging system.
5. The method of claim 4, wherein

   The first optical path is located on a near-infrared light path reflected from a living body and transmitted through the dichroic light splitter;

   The second optical path is located on the optical path of visible light reflected from the living body and reflected from the dichroic light splitter;

   The reflection mirror is

   A first reflection mirror for reflecting photons emitted from said radiation-photon conversion module to said intersection area;

   And a second reflection mirror disposed at the intersection area to reflect photons reflected from the first reflection mirror in the direction of the first optical path to be directed to the electron multiplication CCD camera.
6. The method of claim 5,

   The second reflecting mirror includes a first reflecting surface on which photons are reflected and a second reflecting surface formed on a rear surface of the first reflecting surface;

   When the second reflection mirror is disposed in the cross region in the second mode of operation, visible light reflected from the living body is reflected in the direction of the second light path from the second reflecting surface to the visible light camera Complex Imaging System.
7. The method of claim 4, wherein

   The first optical path is located on a near infrared light path reflected from the living body and reflected from the dichroic light splitter;

   The second optical path is located on the optical path of visible light reflected from the living body and transmitted through the dichroic light splitter;

   And the reflective mirror reflects the photons emitted from the radiation-photon conversion module in the direction of the first optical path to the electron multiplication CCD camera.
8. The method of claim 1,

   The radiation-photon conversion module is disposed between the living body and the intersection area where the first optical path and the second optical path intersect;

   The optical path switching module

   A first reflection mirror for reflecting light reflected from the living body in the first and second operating modes to an intersection area where the first optical path and the second optical path cross each other;

   Disposed at the intersection region in the first operating mode to direct light reflected by the first reflection mirror to the first optical path and the second optical path, respectively, and to deviate from the intersection region in the second operating mode Medical composite imaging system comprising a light splitting.
9. The method of claim 8,

   The optical splitter includes a dichroic light splitter that splits near-infrared light and visible light reflected from a living body to direct near-infrared light to the first optical path and direct visible light to the second light path. .
10. The method of claim 9,

    The first optical path is located on the near-infrared light path reflected by the first reflection mirror and reflected from the dichroic light splitter;

    The second optical path is located on the optical path of visible light reflected by the first reflective mirror and transmitted through the dichroic light splitter;

    The dichroic light splitter is separated from the crossing area in the second mode of operation such that light reflected by the first reflection mirror is directed to the visible light camera through the second light path, and the radiation-photon conversion module And the photons emitted from the photomultiplier are directed to the electron multiplication CCD camera through the first optical path.
11. The method of claim 9,

    The first optical path is located on a near infrared light path reflected by the first reflection mirror and transmitted through the dichroic light splitter;

    The second optical path is located on the optical path of visible light reflected by the first reflective mirror and reflected from the dichroic light splitter;

    The optical path switching module

    Disposed at the intersection area in the second operation mode and separated from the intersection area in the first operation mode, reflecting light reflected by the first reflection mirror in the direction of the second light path to the visible light camera And a second reflecting mirror having a first reflecting surface and a second reflecting surface for reflecting photons emitted from the radiation-photon conversion module in the direction of the first light path to the electron multiplication CCD camera. A medical complex imaging system.
12. The method according to claim 10 or 11, wherein

    And a photon blocker disposed between the radiation-photon conversion module and the dichroic light splitter in the first mode of operation to block photons directed to the dichroic light splitter.
13. The method according to claim 5, 7, 10, or 11,

    And a near-infrared cut-off filter for blocking entry of the near-infrared reflected from the living body into the visible light camera.
14. The method of claim 1,

    The radiation-photon conversion module

    A collimator for selectively passing the radiation according to the incident direction of the radiation;

    And a scintillator for emitting photons at positions corresponding to the radiation response positions in response to radiation passing through the collimator.
15. The method of claim 1,

    The composite imaging controller

    Comparing the first visible light image with the second visible light image and extracting a deformation parameter when either one of the first visible light image and the second visible light image is matched to the other;

    The medical complex imaging system, characterized in that for correcting any one of the near infrared fluorescence image and the radiation image based on the deformation parameter.

Images