KR102167341B1 - Image picup module for endoscope and medical endoscope synchronized multiplex medical image based on separate imaging - Google Patents

Abstract

An endoscopic imaging module and a medical endoscope capable of accurately diagnosing lesions and reducing their size are provided by implementing an image in which a bright field image and a fluorescent image are synchronized with a minimum optical system.
The endoscope imaging module includes a light source unit that emits first and second imaging light; An image sensor unit that acquires the first imaging light to generate a first image, and obtains the second imaging light to generate a second image; An optical separation unit disposed in an optical path between the light source unit and the sensor module to separate the first imaging light from the second imaging light, and the image sensor unit obtaining the first imaging light. It characterized in that it comprises a first imaging area and a second imaging area for acquiring the second imaging light.

Description

IMAGE PICUP MODULE FOR ENDOSCOPE AND MEDICAL ENDOSCOPE SYNCHRONIZED MULTIPLEX MEDICAL IMAGE BASED ON SEPARATE IMAGING that synchronizes multiple medical images based on split imaging

The present invention relates to an endoscope imaging module and a medical endoscope for synchronizing multiple medical images based on divided imaging.

Imaging medicine is rapidly developing due to the development of medical technology and the development of various equipment for accurate disease diagnosis and convenient image acquisition. In particular, in endoscopic diagnosis for cancer diagnosis in the digestive tract, colon, and urinary tract, early cancer or precancerous lesions may have a similar color tone to the surrounding mucous membrane or may not have distinct ridges or depressions, and due to the limitation of morphological observation. Because the boundary of is not clear, it is often difficult to find and observe only with a bright field image acquired through light of a white wavelength.

Therefore, there is a demand for technology to enable well-detection of clinically meaningful lesions (Detection), to indicate characteristics and boundaries of lesions (Characterization), and to enable accurate diagnosis (Diagnosis).

With this solution, molecular imaging techniques such as narrowband, autofluorescence, and contrast media-based fluorescence images are fused to the endoscope to realize on-site diagnosis and precise medical treatment. biopsy) based system development is on the rise. In the case of diagnosis and surgery through fluorescence imaging, it is possible to minimize the margin when removing the tumor, and it is possible to precisely examine the presence of cancer cells after removal.

Furthermore, by synchronizing the brightfield image and the fluorescence image, an image with both the advantages of a brightfield image with good visibility and a fluorescence image that is good for diagnosing lesions can be realized.

However, in order to synchronize a bright field image and a fluorescent image, a general endoscope has a problem of increasing the size and manufacturing cost of a product due to the large number of optical components.

Republic of Korea Patent Publication No. 10-1323646, 2013.11.05 announcement

The problem to be solved by the present invention is to implement an image in which a bright field image and a fluorescence image are synchronized with a minimum optical system based on segmented imaging, so that the lesion can be accurately diagnosed, economical, and an endoscopic imaging capable of reducing the size. It is to provide a module and a medical endoscope.

The problems to be solved by the present invention are not limited to the problems mentioned above, and other problems that are not mentioned will be clearly understood by those skilled in the art from the following description.

An endoscope imaging module according to an aspect of the present invention for solving the above-described problems includes: a light source unit that emits a first imaging light and a second imaging light; An image sensor unit that acquires the first imaging light to generate a first image, and obtains the second imaging light to generate a second image; An optical separation unit disposed in an optical path between the light source unit and the sensor module to separate the first imaging light from the second imaging light, and the image sensor unit obtaining the first imaging light. It may include a first imaging area and a second imaging area for acquiring the second imaging light.

An endoscope imaging module according to another aspect of the present invention for solving the above-described problems includes: a light source unit that emits first and second imaging lights; And an image sensor unit that obtains the first imaging light to generate a first image, and obtains the second imaging light to generate a second image, wherein the image sensor units are disposed to be inclined to each other, and the first imaging A first imaging area for acquiring light and a second imaging area for acquiring the second imaging light may be included.

The light source unit is driven to periodically alternately emit the first and second imaging lights, and the image sensor unit is driven so that the first imaging area and the second imaging area are periodically alternately activated. , The driving period of the light source unit and the image sensor unit may be synchronized.

The driving cycle of the light source unit and the image sensor unit may be 15 Hz or more.

The first imaging light is emitted as excitation light from the light source unit, the second imaging light is emitted as light in a white wavelength band from the light source unit, the first image is a fluorescent image, and the second image is bright It can be a field of view image.

The first imaging light may be obtained as emission light in the first imaging area, and a filter for selectively transmitting the first imaging light may be disposed in the first imaging area.

The optical separation unit may be at least one of a micro prism and a MEMS prism array.

The first imaging area and the second imaging area may be symmetrically disposed adjacent to each other.

A medical endoscope according to an aspect of the present invention for solving the above-described problems may include the above-described endoscope imaging module.

The medical endoscope may reproduce an image in which the fluorescence image and the bright field image generated by the endoscope imaging module are synchronized.

In the present invention, by using divided imaging (for example, optical separation unit (micro prism, MMS prism array) or tilted arrangement of the image sensor unit), a bright field image and a fluorescence image are obtained, respectively, to obtain minimal optical components. By providing an image in which a bright field image and a fluorescence image are synchronized, an economical and reduced-size endoscope imaging module and a medical endoscope are provided.

The effects of the present invention are not limited to the effects mentioned above, and other effects not mentioned will be clearly understood by those skilled in the art from the following description.

1 is a conceptual diagram showing a medical endoscope of the present invention.
2 is a perspective view showing an imaging module for an endoscope of the present invention.
3 is a conceptual diagram illustrating that a first image and a second image are generated by an endoscope imaging module according to an aspect of the present invention.
4 is a conceptual diagram illustrating that a first image and a second image are generated by an endoscope imaging module according to another aspect of the present invention.
5 is a conceptual diagram showing that a fluorescent image and a bright field image are synchronized and reproduced in the medical endoscope of the present invention.

Advantages and features of the present invention, and a method of achieving them will become apparent with reference to the embodiments described below in detail together with the accompanying drawings. However, the present invention is not limited to the embodiments disclosed below, but may be implemented in a variety of different forms, only the present embodiments are intended to complete the disclosure of the present invention, It is provided to fully inform the technician of the scope of the present invention, and the present invention is only defined by the scope of the claims.

The terms used in the present specification are for describing exemplary embodiments and are not intended to limit the present invention. In this specification, the singular form also includes the plural form unless specifically stated in the phrase. As used in the specification, “comprises” and/or “comprising” do not exclude the presence or addition of one or more other elements other than the mentioned elements. Throughout the specification, the same reference numerals refer to the same elements, and “and/or” includes each and all combinations of one or more of the mentioned elements. Although "first", "second", and the like are used to describe various elements, it goes without saying that these elements are not limited by these terms. These terms are only used to distinguish one component from another component. Therefore, it goes without saying that the first component mentioned below may be the second component within the technical idea of the present invention.

Unless otherwise defined, all terms (including technical and scientific terms) used in the present specification may be used as meanings that can be commonly understood by those of ordinary skill in the art to which the present invention belongs. In addition, terms defined in a commonly used dictionary are not interpreted ideally or excessively unless explicitly defined specifically.

Spatially relative terms "below", "beneath", "lower", "above", "upper", etc., as shown in the figure It can be used to easily describe the correlation between a component and other components. Spatially relative terms should be understood as terms including different directions of components during use or operation in addition to the directions shown in the drawings. For example, if a component shown in a drawing is turned over, a component described as "below" or "beneath" of another component will be placed "above" the other component. I can. Accordingly, the exemplary term “below” may include both directions below and above. Components may be oriented in other directions, and thus spatially relative terms may be interpreted according to orientation.

Hereinafter, a medical endoscope 1000 of the present invention will be described with reference to FIG. 1. The medical endoscope 1000 of the present invention may include a cable 10, an operation module 20, a display module 30, and an electronic control module (not shown, an electric control module). Further, in the medical endoscope 1000 of the present invention, the imaging module 100 may be mounted at the end of the cable 10.

Hereinafter, a case where the imaging module 100 is interchangeably mounted on the front end of the cable 10 in the form of an adapter and a head will be described, but the endoscope 1000 and the imaging module of the present invention (100) is not limited thereto.

For example, the endoscope 1000 of the present invention may have a "microscope type", and the imaging module 100 may be disposed at a rear end of an image guide (cable, optical fiber, etc.). In addition, the endoscope 1000 of the present invention may have a "capsule type", and the imaging module 100 may be disposed inside the capsule.

The cable 10 is an insulated conductive line that transmits a bright field image and a fluorescence image in the form of an electronic signal generated by the imaging module 100 to an electronic control module or A function of transmitting the generated control signal to the imaging module 100 may be performed. In addition, the cable 10 may be inserted into the body of a subject (patient) to perform a function of transferring the imaging module 100 to an imaging area inside the living body.

The manipulation module 20 may be provided in, for example, a circulator type. The user (medical staff) may manually manipulate the operation module 20 to determine the insertion length and/or insertion direction of the cable 10.

The display module 30 may reproduce an image in which the fluorescent image and the bright field image are synchronized. The synchronized image can be reproduced by rapidly switching at a cycle that cannot be recognized by humans because the fluorescence image and the bright field image overlap (see Fig. 5(a)). Alternatively, the synchronized image may be reproduced as a stereo image using a fluorescent image and a bright field image (see (b) of FIG. 5).

The electronic control module (not shown) controls the imaging module 100, receives an image in the form of an electronic signal from the imaging module 100, and processes it (Image processing), so that the fluorescence image and the bright field image are synchronized. Can be converted. The image converted by the electronic control module may be reproduced through the display module 30. Meanwhile, the electronic control module may be provided in the medical endoscope 1000, may be provided in the imaging module 100, or may be provided separately in both the medical endoscope 1000 and the imaging module 100.

Hereinafter, an imaging module 100 according to an embodiment of the present invention will be described with reference to FIGS. 2 to 3. The imaging module 100 according to an aspect of the present invention may include a case 110, a light source unit 120, a lens unit 130, a light separation unit 140, and an image sensor unit 150.

The case 110 is an exterior member, and the case 110 may include a light source unit 120, a lens unit 130, a light separation unit 140, and an image sensor unit 150. The case 110 may be made of a synthetic resin material and/or a metal material having excellent biocompatibility.

The case 110 may be detachably mounted on the front end of the cable 10 in the form of an adapter and a head. That is, the imaging module 100 according to an aspect of the present invention may be provided to be applied exclusively to various types of existing endoscopes.

On the front surface of the case 110, a transmission window 111 through which the imaging light emitted from the light source unit 120 is transmitted (or a steering lens), and a transmission window 112 through which the imaging light passing through the imaging area is transmitted (or an objective lens) Can be formed.

The light source unit 120 may emit a first imaging light and a second imaging light. To this end, the light source unit 120 includes a first light source 121 that emits a first imaging light, a second light source 122 that emits a second imaging light, a first light source 121 and a second light source ( 122) may include a printed circuit board (PCB) 123 on which it is mounted.

The first light source 121 and the second light source 122 may emit a first image signal and a second image signal toward an imaging area (a lesion tissue and a living tissue near the lesion tissue, approximately anteriorly). The first and second imaging light emitted from the first light source 121 and the second light source 121 passes through the imaging area, passes through the lens unit 130, and is separated by the optical separation unit 140, It may be irradiated with the image sensor unit 150.

Various types of light sources may be used for the first light source 121 and the second light source 122. For example, the first light source 121 and the second light source 122 may be a light emitting diode (LED) or a light emitting diode (LD). diode).

Meanwhile, the first imaging light and the second imaging light may be different types of light. For example, the first imaging light may be emitted from the first light source 121 as excitation light in a blue wavelength band, and is converted into emission light in the process of passing through the imaging area treated with a contrast agent. It may be obtained as emission light in a green wavelength band from the sensor unit 150. In addition, the second imaging light may be emitted as light of a white wavelength band from the second light source 122, and passes through the imaging area (reflected from the imaging area), and is converted into light of the white wavelength band from the image sensor unit 150. Can be obtained. Accordingly, the first image generated by the first imaging light may be a fluorescent image, and the second image generated by the second imaging light may be a bright field image.

The lens unit 130 may be located in an optical path between the light source unit 120 and the image sensor unit 150. The lens unit 130 may be an optical lens array in which a plurality of optical lenses are arranged in an optical axis direction. The lens unit 130 may focus and guide the first imaging light and the second imaging light passed through the imaging area (converted into emission light in the imaging area or reflected in the imaging area) to the image sensor unit 150.

The light separation unit 140 may be located in an optical path between the light source unit 120 and the image sensor unit 150. The optical separation unit 140 may perform a function of separating the first imaging light and the second imaging light passing through the imaging area from each other. That is, the first imaging light and the second imaging light are separated by the optical separation unit 140 to form a mutually independent optical path. As a result, the first imaging light may be irradiated to the first imaging area 151 of the image sensor unit 150, and the second imaging light may be irradiated to the second imaging area 152 of the image sensor unit 150, respectively.

Various types of optical elements for separating the first imaging light and the second imaging light may be used in the optical separation unit 140. For example, as shown in FIG. 3A, a micro prism may be used as the optical separation unit 140. In addition, as shown in FIG. 3B, the optical separation unit 140 may be a MEMS prism array (MEMs refers to microelectronic control technology as a micro-electro mechanical system).

Meanwhile, the lens unit 130 and the optical separation unit 140 may be spaced apart from each other to have various optical arrangement relationships. For example, it may be arranged such that light passing through the lens unit 130 is irradiated to the optical separation unit 140, or light passing through the optical separation unit 140 is irradiated to the lens unit 130. That is, the optical arrangement relationship between the lens unit 130 and the optical separation unit 140 may be variously changed according to an optical design request.

The image sensor unit 150 may perform a function of generating a first image and a second image by acquiring the first imaging light and the second imaging light. In this case, the first image may be in a form in which the first imaging light is changed to an electronic signal, and the second image may be in a form in which the second image is transformed into an electronic signal. The first image and the second image may be transmitted to the electronic control module and image-processed in the electronic control module, so that the first image and the second image may be converted into a synchronized image.

As an example, the image sensor unit 150 may generate a fluorescence image using emission light in a green wavelength band passing through the imaging area, and generate a bright field image using light in a white wavelength band passing through the imaging area. can do. The fluorescence image and the bright field image are image-processed in the electronic control module, and the fluorescence image and the bright field image may be converted into a synchronized image.

The image sensor unit 150 includes a first imaging area 151 that generates a first image by acquiring a first imaging light, a second imaging area 152 that generates a second image by acquiring a second imaging light, , A printed circuit board (PCB) 153 on which the first and second imaging regions 151 and 152 are mounted may be included.

In this case, the first imaging area 151 and the second imaging area 152 may be an imaging area separately formed on a single image sensor chip, or may be an imaging area each provided on a dual image sensor chip. As the first imaging area 151 and the second imaging area 152, various imaging units may be used. For example, a charge-coupled device (CCD) and a complementary metal-oxide semiconductor (CMOS) may be used. have.

Meanwhile, a filter 154 that selectively transmits the first imaging light (emitted light) may be disposed in the first imaging area 151. In this case, the filter 154 may be a band pass filter (BPF) that selectively transmits light in a specific wavelength band (eg, light in a green wavelength band). Accordingly, only the first imaging light required for generating the first image is irradiated to the first imaging area 151, thereby improving the quality (noise blocking) of the first image.

Hereinafter, an endoscope imaging module 100-1 according to another aspect of the present invention will be described with reference to FIG. 4.

In the endoscope imaging module 100-1 according to another aspect of the present invention, the image separation unit is omitted and the dual image sensor is inclined as compared to the imaging module 100 according to the embodiment of the present invention. Excluding the difference in the (tilted) arrangement, the imaging module 100 according to an aspect of the present invention may be applied by analogy.

Hereinafter, in describing the endoscope imaging module 100-1 according to another aspect of the present invention, a description of a portion having substantially the same technical characteristics as the imaging module 100 according to an aspect of the present invention will be omitted. do.

The image sensor unit 150-1 may include a first image area 151-1 and a second image area 152-1 which are adjacent to each other and are arranged to be inclined symmetrically. In the endoscope imaging module 100-1 according to another aspect of the present invention, by tilting the first image area 151-1 and the second image area 152-1, the first imaging module 100-1 Without the need to separate the second imaging light (the image separation unit can be omitted), the first imaging light can be irradiated on the first image area 151-1 and the second imaging light is on the second image area 151-2. Light can be irradiated.

Meanwhile, in the endoscope imaging module 100-1 according to another aspect of the present invention, the lens unit 130-1 guides and focuses the first imaging light to the first image area 151-1. The unit 131-1 and a second lens unit 132-1 for guiding and focusing the second imaging light to the second image area 151-2 may be included.

That is, in order to compensate for the fact that the first imaging light and the second imaging light are not separated, lens units corresponding to the first image area 151-1 and the second image area 152-1 may be provided, respectively. have.

Meanwhile, in the endoscope imaging module 100-1 according to another aspect of the present invention, as in the imaging module 100 according to one aspect of the present invention, the filter 154-1 is formed in the first image area 151-1. ) Can be placed.

In the above, the imaging module 100 according to one aspect of the present invention and the imaging module 100-1 according to another aspect of the present invention have been described, respectively, but the imaging module of the present invention is not limited thereto. For example, the imaging module of the present invention may exist in a form in which the technical features of the imaging module 100 according to one aspect of the present invention and the technical features of the imaging module 100-1 according to another aspect of the present invention are combined. Yes (including the image separation unit and dual image sensors arranged at an angle to each other).

Hereinafter, referring to FIG. 5, an image in which a fluorescence image (a first image) and a bright field image (a second image) are synchronized in the medical endoscope 1000 of the present invention will be described.

As shown in (a) of FIG. 5, the synchronized image overlaps the fluorescent image and the bright-field image, and thus can be reproduced by rapidly alternating with a cycle that cannot be recognized by humans.

To this end, the light source unit 120 may be driven to periodically alternately emit first and second imaging light (periodically alternately driving the first light source and the second light source), and the image sensor unit 130 ) May be driven so that the first imaging area 131 and the second imaging area 132 are periodically alternately activated. In this case, the driving cycles of the light source unit 120 and the image sensor unit 130 may be synchronized.

That is, when the first imaging light is irradiated to the image sensor unit 130, the first imaging area 131 is activated and the second imaging area 132 is deactivated, thereby generating a fluorescence image (first image). . On the contrary, when the second imaging light is irradiated to the image sensor unit 130, the second imaging area 132 is activated and the first imaging area 131 is deactivated, thereby generating a bright field image (second image). I can. Therefore, the fluorescence image and the bright field image can be reproduced alternately.

Furthermore, the driving cycle of the light source unit 120 and the image sensor unit 130 may be 15 Hz or more. The purpose is to allow the user (medical staff) to recognize the fluorescence image and the brightfield image as observing the fluorescence image and the brightfield image at the same time by rapidly alternating the fluorescence image and the brightfield image in a cycle that cannot be recognized by humans.

On the other hand, if the fluorescence image and the brightfield image need to be aligned in order to overlap the fluorescent image and the brightfield image due to inversion of the fluorescent image and the brightfield image, the electronic control module performs software correction (for example, , Interpolation) or optical correction by adding a light guide element.

In addition, as shown in (b) of FIG. 5, the synchronized image may be reproduced as a stereo image for a fluorescent image and a bright field image captured at different viewpoints, respectively. Meanwhile, the endoscope imaging module 100-1 according to another aspect of the present invention may easily take a stereo image due to a dual image sensor structure disposed in an inclined manner.

As described above, in the present invention, the brightfield image and the fluorescence image are obtained by tilting the optical separation unit or the image sensor unit, respectively, and an image in which the brightfield image and the fluorescence image are synchronized with the minimum optical component. Can provide.

In the above, embodiments of the present invention have been described with reference to the accompanying drawings, but those of ordinary skill in the art to which the present invention pertains can be implemented in other specific forms without changing the technical spirit or essential features. You can understand. Therefore, the embodiments described above are illustrative in all respects, and should be understood as non-limiting.

Claims (10)

delete A light source unit for emitting the first imaging light and the second imaging light to the same imaging area; And
An image sensor unit that acquires the first imaging light to generate a first image, and obtains the second imaging light to generate a second image,
The image sensor unit includes a first imaging area acquiring the first imaging light and a second imaging area acquiring the second imaging light,
The first imaging light and the second imaging light are irradiated to the image sensor unit through the same imaging area,
The first imaging area and the second imaging area are included in one image sensor unit and are disposed to be inclined to each other.
The method of claim 2,
The light source unit is driven to periodically alternately emit the first imaging light and the second imaging light,
The image sensor unit is driven so that the first imaging area and the second imaging area are periodically alternately activated,
An endoscope imaging module in which driving cycles of the light source unit and the image sensor unit are synchronized.
The method of claim 3,
A driving period of the light source unit and the image sensor unit is 15 Hz or more.
The method of claim 2,
The first imaging light is emitted as excitation light from the light source unit, and the second imaging light is emitted as light of a white wavelength band from the light source unit,
The first image is a fluorescent image, and the second image is a bright field image.
The method of claim 5,
The first imaging module is obtained as emission light from the first imaging area, and a filter for selectively transmitting the first imaging light is disposed in the first imaging area.
delete The method of claim 2,
The first imaging area and the second imaging area are adjacent to each other and disposed in a symmetrical endoscope imaging module.
A medical endoscope comprising the endoscope imaging module of claim 2.
The method of claim 9,
The medical endoscope is a medical endoscope for reproducing an image in which a fluorescence image generated by the endoscope imaging module and a bright field image are synchronized.

Images