WO2023109850A1 - Illumination module, endoscope imaging system, endoscope, and imaging method thereof - Google Patents

Abstract

An illumination module (110), comprising a light source assembly (111) and an optical filtering assembly (112). The light source assembly (111) comprises a first light source (1111), a second light source (1112), and a control element (1113), the control element (1113) being used for controlling the first light source (1111) and/or the second light source (1112) to emit light. The optical filtering assembly (112) comprises a conversion member (1121), a first optical filter (1123), and a second optical filter (1124), wherein the first optical filter (1123) and the second optical filter (1124) alternate in the circumferential direction of the conversion member (1121); and the conversion member (1121) is used for rotating to selectively place the first optical filter (1123) and the second optical filter (1124) on a light-emitting path of the light source assembly (111), the first optical filter (1123) is used for transmitting light emitted by the first light source (1111) and blocking light emitted by the second light source (1112), and the second optical filter (1124) is used for transmitting the light emitted by the second light source (1112) and blocking the light emitted by the first light source (1111).

Description

Illumination module, endoscope imaging system, endoscope and imaging method thereof

related application

This application claims the priority of the Chinese patent application filed on December 14, 2021, with application number 2021115252359, entitled "Illumination Module, Endoscope Imaging System, Endoscope and Its Imaging Method", which is hereby incorporated It is incorporated by reference in its entirety.

technical field

The present application relates to the technical field of medical devices, in particular to an illumination module, an endoscope imaging system, an endoscope and an imaging method thereof.

Background technique

Traditional endoscopes usually include a white light imaging mode and a special light imaging mode. The white light imaging mode can form a color image of the measured object, thereby showing the true color of the measured object; The object is illuminated to form a grayscale image of the measured object, thereby revealing the lesion area and related vascular structures. However, in the actual application of traditional endoscopes, the image quality is not high. As a result, in the actual application of diagnostic testing and treatment, the image of the lesion area is not clear enough, the information display is not rich enough, and the boundary with normal tissue is not obvious enough, resulting in diagnosis. Not very accurate.

Contents of the invention

According to various embodiments of the present application, an illumination module, an endoscope imaging system, an endoscope and an imaging method thereof are provided.

A lighting module, comprising:

The light source assembly includes a first light source, a second light source and a control element, and the control element is used to control the first light source to emit light alone, or to control the second light source to emit light alone, or to control the first light source and the the second light source emits light at the same time; and

The filter assembly includes a conversion element, at least one first filter of the conversion element, and at least one second filter, and the first filter and the second filter alternate along the circumferential direction of the conversion element setting; the conversion member is used to rotate to selectively place the first filter or the second filter on the light output path of the light source assembly, and the first filter can pass through The light emitted by the first light source blocks the light emitted by the second light source, and the second filter can pass through the light emitted by the second light source and block the light emitted by the first light source.

In one of the embodiments, the filter assembly includes a plurality of the first filters and a plurality of the second filters, and a plurality of the first filters and a plurality of the second filters The light sheets are arranged alternately along the circumference of the conversion element, and the conversion element can rotate along the axis.

In one embodiment, the conversion member is provided with a plurality of mounting grooves along the circumference for mounting the first filter and the second filter.

In one of the embodiments, at least one of the first optical filters and at least one of the second optical filters are evenly distributed along the circumferential direction of the conversion element.

In one embodiment, in the direction from the center of the conversion element to the edge, the sizes of the first filter and the second filter gradually increase.

In one of the embodiments, the light source assembly further includes a dichroic mirror, the dichroic mirror is arranged on the light output paths of the first light source and the second light source, and is inclined to the first light source and the light emitting direction of the second light source, the dichroic mirror can reflect the light emitted by the first light source and transmit the light emitted by the second light source.

In one of the embodiments, the control element is configured to be able to control only one of the first light source and the second light source to emit light at the same time.

In one of the embodiments, one of the first light source and the second light source emits light continuously, and the control element is configured to control the other one to be turned on or off.

In one of the embodiments, the filter assembly further includes a stepping motor, the output shaft of the stepping motor is connected to the center position of the conversion element, and the stepping motor is configured to drive the conversion element around The output shaft rotates.

In one of the embodiments, the shape of the first filter and the second filter is a trapezoid with an upper base close to the center of the conversion piece and a lower base close to the edge of the conversion piece.

In one of the embodiments, the lighting module further includes a condensing lens, and the condensing lens is arranged on the light output path of the light source assembly.

An endoscopic imaging system, comprising a light guide module, a camera module, and the lighting module as described above, the camera module includes a first photosensitive element, a second photosensitive element, and a light splitting element, and the first light source emits The light from the light source passes through the light guide module and the light splitting element and reaches the first photosensitive element to form a color image, the light emitted by the second light source excites the measured object to form fluorescence, and the fluorescence passes through the light guide module After being combined with the light-splitting element, it reaches the second photosensitive element to form a grayscale image.

In one embodiment, the light-splitting element has a light-splitting surface, the light-splitting surface is inclined to the light incident direction of the camera module, and about 20%-50% of the light emitted by the first light source passes through the The light splitting element reaches the second photosensitive element to form a grayscale image, and the remaining light emitted by the first light source is reflected by the light splitting element to the first photosensitive element to form a color image.

In one of the embodiments, the light-splitting element is a light-splitting prism, the first photosensitive element and the second light-sensitive element are attached to two adjacent surfaces of the light-splitting prism, and the second light-sensitive element The photosensitive surface is opposite to the light entrance of the camera module, and the first photosensitive element is parallel to the light incident direction of the camera module.

In one of the embodiments, the camera module further includes a third filter, the third filter is arranged on the side of the light splitting element facing the light entrance of the camera module, the first The three optical filters can transmit light with a wavelength of about 810nm-900nm and light with a wavelength of about 400nm-650nm, and block light with a wavelength of about 700nm-800nm.

In one of these embodiments,

The emitted light of the first light source is a mixed light with a wavelength of about 400nm-700nm;

The emitted light of the second light source is light with a wavelength of about 750-810nm;

The spectroscopic element satisfies the following requirements: reflecting part of visible light with a wavelength of about 400nm-700nm, transmitting the rest of visible light with a wavelength of about 400nm-700nm, and transmitting light with a wavelength of about 810nm-910nm.

An endoscope includes the above-mentioned endoscope imaging system.

An imaging method, using the above-mentioned endoscopic imaging system, the imaging method includes the following steps:

Rotate the conversion member so that the first filter is located on the light output path of the light source assembly, control the light output of the first light source, obtain a color image through the first photosensitive element, and obtain a color image through the second photosensitive element Get a grayscale image;

fusing the color image with the grayscale image to form a first image;

Rotate the conversion member so that the second filter is located on the light output path of the light source assembly, control the light output of the second light source, and obtain the light emitted by the second light source through the second photosensitive element to be excited The image formed by the fluorescent light emitted by the test object;

processing the image captured by the second photosensitive element to form a second image;

Superimposing the first image and the second image.

In one of the embodiments, the step of fusing the color image and the grayscale image to form a first image comprises:

extracting the luminance channel of the grayscale image, extracting the color difference information of the color image, and superimposing and synthesizing the luminance channel of the grayscale image and the color difference information of the color image to form the first image.

The details of one or more embodiments of the invention are set forth in the accompanying drawings and the description below. Other features, objects and advantages of the invention will be apparent from the description, drawings and claims.

Description of drawings

In order to more clearly illustrate the technical solutions in the embodiments of the present application or the conventional technology, the following will briefly introduce the accompanying drawings that need to be used in the description of the embodiments or the traditional technology. Obviously, the accompanying drawings in the following description are only the present invention For the embodiments of the application, those skilled in the art can also obtain other drawings based on the disclosed drawings without creative effort.

Fig. 1 is a schematic structural diagram of an endoscopic imaging system in some embodiments;

Fig. 2 is a schematic structural diagram of a light source assembly in some embodiments;

Fig. 3 is a schematic structural diagram of an optical filter assembly in some embodiments;

Fig. 4 is a schematic structural diagram of a camera module in some embodiments;

Fig. 5 is a structural schematic diagram of another angle of the filter assembly in some embodiments;

Fig. 6 is the transmittance spectral line of the first optical filter in some embodiments;

Fig. 7 is the transmittance spectral line of the second optical filter in some embodiments;

Fig. 8 is the light transmittance spectral line of dichroic mirror in some embodiments;

Fig. 9 is the light transmittance spectral line of the light splitting element in some embodiments;

Fig. 10 is the transmittance spectral line of the third optical filter in some embodiments;

Figure 11 is a schematic flow chart of the imaging method in some embodiments;

Figure 12 is a schematic flow chart of processing color images and grayscale images in some embodiments;

Fig. 13 is a schematic flow chart of white light mode imaging in some embodiments.

Detailed ways

The following will clearly and completely describe the technical solutions in the embodiments of the application with reference to the drawings in the embodiments of the application. Apparently, the described embodiments are only some of the embodiments of the application, not all of them. Based on the embodiments in this application, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the scope of protection of this application.

In the description of the present application, it should be understood that the terms "center", "longitudinal", "transverse", "length", "width", "thickness", "upper", "lower", "front", " Back", "Left", "Right", "Vertical", "Horizontal", "Top", "Bottom", "Inner", "Outer", "Clockwise", "Counterclockwise", "Axial" , "radial", "circumferential" and other indicated orientations or positional relationships are based on the orientations or positional relationships shown in the drawings, and are only for the convenience of describing the application and simplifying the description, rather than indicating or implying the referred device or Elements must have certain orientations, be constructed and operate in certain orientations, and thus should not be construed as limiting the application.

In addition, the terms "first" and "second" are used for descriptive purposes only, and cannot be interpreted as indicating or implying relative importance or implicitly specifying the quantity of indicated technical features. Thus, the features defined as "first" and "second" may explicitly or implicitly include at least one of these features. In the description of the present application, "plurality" means at least two, such as two, three, etc., unless otherwise specifically defined.

In this application, terms such as "installation", "connection", "connection" and "fixation" should be interpreted in a broad sense, for example, it can be a fixed connection or a detachable connection, unless otherwise clearly specified and limited. , or integrated; it may be mechanically connected or electrically connected; it may be directly connected or indirectly connected through an intermediary, and it may be the internal communication of two components or the interaction relationship between two components, unless otherwise specified limit. Those of ordinary skill in the art can understand the specific meanings of the above terms in this application according to specific situations.

In the present application, unless otherwise clearly specified and limited, a first feature being "on" or "under" a second feature may mean that the first and second features are in direct contact, or that the first and second features are indirect through an intermediary. touch. Moreover, "above", "above" and "above" the first feature on the second feature may mean that the first feature is directly above or obliquely above the second feature, or simply means that the first feature is higher in level than the second feature. "Below", "beneath" and "beneath" the first feature may mean that the first feature is directly below or obliquely below the second feature, or simply means that the first feature is less horizontally than the second feature.

It should be noted that when an element is referred to as being “fixed on” or “disposed on” another element, it may be directly on the other element or there may be an intervening element. When an element is referred to as being "connected to" another element, it can be directly connected to the other element or intervening elements may also be present. As used herein, the terms "vertical", "horizontal", "upper", "lower", "left", "right" and similar expressions are for the purpose of illustration only and are not intended to represent the only embodiments.

Traditional endoscopes usually emit white light and special light at the same time to form mixed light and irradiate the measured object, and then split and image the mixed light reflected by the measured object. Among them, white light forms a color image, and fluorescence forms a grayscale image , and then process and superimpose the color image and the grayscale image. However, when the traditional endoscope splits the mixed light, it is usually unable to completely separate the white light and the fluorescence, resulting in mutual interference of the images formed by the white light and the fluorescence, which makes the optimization of the grayscale image formed by the fluorescence ineffective. , which is not conducive to improving the quality of grayscale images. At the same time, the color image formed by white light is limited by the color photosensitive element, and the image quality is difficult to improve.

In order to solve the above problems, the present application provides an endoscope.

Please refer to FIG. 1, FIG. 2, FIG. 3 and FIG. 4, FIG. 1 is a schematic diagram of an endoscope imaging system 10 in some embodiments, FIG. 2 is a schematic diagram of a light source assembly 111 in some embodiments, and FIG. 3 is a schematic diagram of some implementations. A schematic diagram of the filter assembly 112 in some embodiments, and FIG. 4 is a schematic diagram of the camera module 130 in some embodiments. In some embodiments, the endoscope imaging system 10 includes an illumination module 110, a light guide module 120, and a camera module 130. The light guide module 120 includes a light guide 121, a mirror body 122, and a mount 123. The light guide 121 The mirror body 122 is docked with the light outlet port of the lighting module 110 , the mirror body 122 is docked with the light inlet port of the camera module 130 through the bayonet 123 , and the other end of the mirror body 122 faces the measured object 20 . The light emitted by the lighting module 110 is coupled into the light guide 121, irradiates the measured object 20 through the light guide 121 and the mirror body 122, and then is reflected by the measured object 20 back to the mirror body 122, and enters through the bayonet 123. imaging in the camera module 130 . The measured object 20 may be a human body tissue, such as a tissue area where a disease occurs in the human body, and the endoscopic imaging system 10 may be used to obtain a color image and a grayscale image of the measured object 20 to diagnose the measured object 20 .

In some embodiments, the lighting module 110 includes a light source assembly 111 and a filter assembly 112, the light source assembly 111 includes a first light source 1111, a second light source 1112 and a control element 1113, and the control element 1113 is used to control the first light source 1111 and/or Or the second light source 1112 . In some embodiments, the first light source 1111 may be a white light source, in other words, the first light source 1111 can emit mixed light in the visible light band. The second light source 1112 may be an infrared laser light source, and the light emitted by the second light source 1112 can excite the measured object 20 to generate fluorescence. The control element 1113 can control the first light source 1111 and/or the second light source 1112 by using a modulation signal, for example, the control element 1113 can control the first light source 1111 and the second light source 1112 to have only one light source at the same time to be on, or the control element 1113 Only one light source is controlled to be turned on and off, and the other light source is not controlled by the control element 1113 to maintain a normally on state.

Referring to FIG. 1 , FIG. 3 and FIG. 5 , FIG. 5 is a schematic diagram of another angle of the filter assembly 112 in some embodiments. In some embodiments, the filter assembly 112 includes a conversion piece 1121 and a first filter 1123 and a second filter 1124 disposed on the conversion piece 1121, the first filter 1123 and the second filter 1124 are The conversion parts 1121 are arranged at intervals in the circumferential direction. The light output path of the light source assembly 111 corresponds to the position of the optical filter on the conversion piece 1121. When the conversion piece 1121 rotates, the first optical filter 1123 and the second optical filter 1124 can be located in the light output path of the light source assembly 111 in turn. superior. The first filter 1123 can transmit the light emitted by the first light source 1111 and block the light emitted by the second light source 1112. For example, the first filter 1123 can transmit visible light and block infrared light, and the second filter 1124 can transmit Pass the light emitted by the second light source 1112 and block the light emitted by the first light source 1111 , for example, the second filter 1124 can transmit infrared light and block visible light. It can be understood that due to the setting of the filter assembly 112, whether the first light source 1111 and the second light source 1112 emit light at the same time or one of them emits light alone, at the same time, the light emitted by the first light source 1111 and the second light source 1112 only One of them can be emitted from the lighting module 110 .

In the lighting module 110, the control element 1113 can control the first light source 1111 or the second light source 1112 to emit light independently, so that the illumination of the object 20 under test by the first light source 1111 and the second light source 1112 is separated from each other and does not affect each other. The color image formed by the reflection of the white light from the measured object 20 does not interfere with the grayscale image formed by the excited fluorescence of the measured object 20, which is beneficial to the image formed by the first light source 1111 and the second light source 1112 irradiating the measured object 20. The images are optimized separately, and the grayscale images will not be disturbed by the color images during optimization, which is beneficial to improving the quality of the grayscale images, and further helps to improve the diagnostic accuracy of the endoscopic imaging system 10 .

In addition, when the first light source 1111 emits light, the conversion member 1121 rotates until the first filter 1123 is located on the light output path of the light source assembly 111 , and the first filter 1123 passes through the white light emitted by the first light source 1111 and blocks infrared light. When the second light source 1112 emits light, the conversion member 1121 rotates until the second filter 1124 is located on the light output path of the light source assembly 111 , and the second filter 1124 transmits the infrared light emitted by the second light source 1112 to block white light. Thus, the filter assembly 112 can ensure that only one of the first light source 1111 and the second light source 1112 emits light from the lighting module 110 at the same time, preventing the first light source 1111 or the second light source 1112 from being in the control element 1113 The high-frequency modulation is continuously switched on and off, resulting in the situation that the light emitted by the two light sources is emitted from the lighting module 110 at the same time, which is conducive to further isolating the image formed by the first light source 1111 and the second light source 1112 illuminating the object 20 to be measured, thereby improving the Image Quality.

It can be understood that, in some embodiments, the filter assembly 123 can also include a stepping motor 1125, the output shaft of the stepping motor 1125 is connected to the center of the conversion member 1121, and the stepping motor 1125 can drive the conversion member 1121 around the output shaft. The rotation drives the first optical filter 1123 and the second optical filter 1124 to be located on the light output path of the light source assembly 111 in turn.

In some embodiments, the first light source 1111 can emit mixed light with a wavelength of about 400nm-700nm. The first light source 1111 may be a combination of one or more light sources, such as laser, light emitting diode (LED), xenon lamp, etc., as long as it can emit mixed light in the visible light band to form a color image. The second light source 1112 can emit 785nm infrared laser light, and the light emitted by the second light source 1112 can excite the measured object 20 to generate fluorescence with a wavelength of about 810nm-900nm. Of course, the second light source 1112 can also emit other infrared lasers with a wavelength of about 750nm-810nm, as long as the light emitted by the second light source 1112 can excite the measured object 20 to generate fluorescence, thereby forming a grayscale image.

According to the above examples of the wavelengths of light emitted by the first light source 1111 and the second light source 1112 , the light transmittance spectral lines of the first filter 1123 and the second filter 1124 are given. Shown with reference to Fig. 6 and Fig. 7, Fig. 6 and Fig. 7 are respectively the light transmittance spectrum line of the first optical filter 1123 and the second optical filter 1124, wherein, abscissa represents wavelength (Wavelengh), and ordinate represents corresponding The transmittance of different wavelengths of light (Transmission). As can be seen from Figures 6 and 7, in some embodiments, the first optical filter 1123 can transmit visible light with a wavelength of about 400nm-700nm and block infrared light with a wavelength of 785nm, for example, the first optical filter 1123 can be short-wavelength pass filter. The second filter 1124 can transmit infrared light with a wavelength of 785nm and block visible light with a wavelength of about 400nm-700nm. For example, the second filter 1124 can be a long-wave pass filter. It can be understood that when the wavelengths of light emitted by the first light source 1111 and the second light source 1112 change, the light transmittance spectral lines of the first filter 1123 and the second filter 1124 should also be adjusted accordingly.

It should be noted that in this application, the type of optical filter is not limited to absorbing optical filter or reflective optical filter. Light in this band is absorbed or reflected.

Please refer to FIG. 1, FIG. 3 and FIG. 5 again. In some embodiments, the conversion member 1121 is a wheel capable of rotating along an axis, and the filter assembly 112 includes a plurality of first filters 1123 and a plurality of second filters. The sheets 1124 , the first filter 1123 and the second filter 1124 are arranged alternately along the circumferential direction of the conversion member 1121 . For example, there are three first optical filters 1123 and three second optical filters 1124 respectively, and six optical filters are uniformly arranged along the circumferential direction of the conversion member 1121 . Therefore, when the conversion member 1121 rotates in a certain direction, the first filter 1123 and the second filter 1124 can be positioned on the light output path of the light source assembly 111 in turn, and the rotation path required by the conversion filter is small, This makes the adjustment of the filter assembly 112 more convenient. It can be understood that the two lines on the first optical filter 1123 shown in FIG. 5 are only virtual lines introduced to facilitate the distinction between the first optical filter 1123 and the second optical filter 1124 , and do not actually exist.

It should be noted that, in this application, the first optical filter 1123 is adjacent to the second optical filter 1124 on both sides along the circumferential direction of the conversion member 1121, or the first optical filter 1123 is adjacent to the second optical filter 1124 along the circumferential direction of the conversion member 1121. The two sides are respectively adjacent to the first optical filter 1123 and the second optical filter 1124, or a plurality of first optical filters 1123 are arranged adjacent to the circumferential direction of the conversion member 1121, and the first optical filter 1123 at the end is adjacent to the second optical filter 1123. The two optical filters 1124 are arranged adjacent to each other. It can be understood that the first optical filter 1123 and the second optical filter 1124 are arranged alternately along the circumferential direction of the conversion member 1121, as long as the conversion member 1121 can rotate the first optical filter 1123 Or the second filter 1124 can be placed on the light output path of the light source assembly 111 .

The installation method of the first optical filter 1123 and the second optical filter 1124 on the conversion member 1121 is not limited, as long as the first optical filter 1123 or the second optical filter 1124 can filter the light emitted by the light source assembly 111 . In some embodiments, the conversion member 1121 is provided with a plurality of installation grooves 1122 at intervals along the circumferential direction, and each first filter 1123 or second filter 1124 is embedded in a corresponding one of the installation grooves 1122 . In this way, the installation of the filter on the conversion member 1121 is stable, and it is not easy to deviate, which can improve the filter effect of the filter assembly 112 on the light source assembly 111 .

In some embodiments, the sizes of the first filter 1123 and the second filter 1124 gradually increase in the direction from the center of the conversion element 1121 to the edge. For example, in the embodiment shown in FIG. 5 , both the first optical filter 1123 and the second optical filter 1124 are approximately trapezoidal with an upper base close to the center of the conversion element 1121 and a lower base close to the edge of the conversion element 1121 . Such setting can make full use of the space of the conversion element 1121, and increase the area of the single first filter 1123 and the second filter 1124, so that the light emitted by the light source assembly 111 can be fully absorbed by the first filter 1123 or the second filter. The filter 1124 filters to improve the utilization rate of light.

In some embodiments, the light source assembly 111 further includes a dichroic mirror 1114, and the dichroic mirror 1114 is arranged on the light output paths of the first light source 1111 and the second light source 1112, and is inclined to the first light source 1111 and the second light source 1112. the direction of light output. For example, in some embodiments, the dichroic mirror 1114 forms an included angle of 45° with the light emitting directions of the first light source 1111 and the second light source 1112 . The dichroic mirror 1114 can reflect the light emitted by the first light source 1111 and transmit the light emitted by the second light source 1112 . Referring to FIG. 8 , FIG. 8 is a light transmittance spectrum line of the dichroic mirror 1114 . For example, in some embodiments, the dichroic mirror 1114 can transmit infrared light with a wavelength of 785 nm and reflect visible light with a wavelength of about 400 nm-700 nm. 2, it can be understood that the direction of the light emitted by the second light source 1112 remains unchanged after passing through the dichroic mirror 1114, while the direction of light emitted by the first light source 1111 changes by 90° after being reflected by the dichroic mirror 1114 Therefore, the light emitted by the first light source 1111 and the second light source 1112 passes through the dichroic mirror 1114 and exits the light source assembly 111 in the same direction, which is the light output direction of the light source assembly 111 . The arrangement of the dichroic mirror 1114 can make the light emitted by the first light source 1111 and the second light source 1112 with different light emitting directions exit the light source assembly 111 to the filter assembly 112 from the same direction, which facilitates the assembly of the light source assembly 111.

It can be understood that the dotted lines with arrows shown in FIGS. 1-4 are schematic diagrams of some light rays. It should be noted that if the light emitted by the second light source 1112 is laser light with good directivity, the propagation direction of the laser light can be regarded as the light emitting direction of the second light source 1112; if the light emitted by the first light source 1111 has a certain diffusion angle instead of If the light beam is linear, the direction of propagation of the central ray emitted by the first light source 1111 can be regarded as the light emitting direction of the first light source 1111, or the direction in which the light exit of the first light source 1111 points directly in front of the first light source 1111 can be regarded as the first light source 1111 the direction of light output.

In some embodiments, the illumination module 110 further includes a condenser lens 113 , and the condenser lens 113 is located on the light output path of the light source assembly 111 and between the filter assembly 112 and the light guide 121 . The condenser lens 113 can be a convex lens, or a combination of multiple lenses. The condenser lens 113 is used to couple the light filtered by the filter assembly 112 into the light guide 121, so that most of the light emitted by the lighting module 110 can pass through the light guide. 121 and the mirror body 122 irradiate the measured object 20 to improve the utilization rate of light.

Please refer to FIG. 1 and FIG. 4 again. In some embodiments, the camera module 130 includes a first photosensitive element 131 , a second photosensitive element 132 and a light splitting element 133 . The first photosensitive element 131 and the second photosensitive element 132 are respectively used to obtain the imaging after the first light source 1111 and the second light source 1112 illuminate the measured object 20, and both the first photosensitive element 131 and the second photosensitive element 132 can be complementary metal oxides. Complementary Metal Oxide Semiconductor (CMOS). For example, the first photosensitive element 131 is a color CMOS, and the second photosensitive element 132 is a black and white CMOS. The white light emitted by the first light source 1111 is reflected by the measured object 20 and reaches the first photosensitive element 131 to form a color image, and the infrared light emitted by the second light source 1112 excites the measured object 20 to generate fluorescence, and the fluorescent light reaches the second photosensitive element 132 to form a gray scale image.

It can be understood that both the white light and the fluorescent light enter the camera module 130 from the light entrance of the camera module 130 along the same direction, so the light splitting element 133 needs to be provided so that the white light and fluorescent light can reach the corresponding photosensitive elements. Also refer to FIG. 9 , which shows the transmittance spectrum of the light splitting element 133 in some embodiments. In some embodiments, the light-splitting element 133 has a light-splitting surface, which is inclined to the light incident direction of the camera module 130 and the light-sensing surfaces of the first photosensitive element 131 and the second photosensitive element 132 . For example, in some embodiments, the light splitting surface forms an included angle of 45° with the light incident direction of the camera module 130 , and also forms an included angle of 45° with the photosensitive surfaces of the first photosensitive element 131 and the second photosensitive element 132 . The light-splitting element 133 can reflect visible light with a wavelength of about 400nm-700nm at the light-splitting surface, and transmit fluorescent light with a wavelength of about 810nm-900nm. After the white light enters the camera module 130, it is reflected by the light-splitting element 133, and the optical path is changed by 90° to reach the first photosensitive element 131 to form a color image. image.

Further, in some embodiments, part of the light emitted by the first light source 1111 passes through the light splitting element 133 and reaches the second photosensitive element 132 to form a grayscale image, and part of it is reflected by the light splitting element 133 to the first photosensitive element 131 to form a color image. In this way, the white light emitted by the first light source 1111 can form a color image and a grayscale image at the same time, and the color image and the grayscale image can be processed and superimposed to improve the image quality of the color image formed by the white light, so that the color image formed by the white light The quality will not be limited by the first photosensitive element 131, which is beneficial to improve the diagnostic accuracy.

Referring to FIG. 9 , in some embodiments, the light splitting element 133 is a 30:70 splitting prism. In other words, the light splitting element 133 can transmit about 30% of white light and reflect about 70% of white light. Such setting can not only form a grayscale image on the second photosensitive element 132, but also ensure that the color image formed on the first photosensitive element 131 has sufficient brightness, which is beneficial to further improve the quality of the color image. Of course, in some other embodiments, the light splitting element 133 can also be a light splitting prism that transmits about 20%-50% and reflects about 50%-80%, and the ratio of transmission and reflection can be 70:30, 60:40 or 50 :50, as long as the white light can be simultaneously imaged on the first photosensitive element 131 and the second photosensitive element 132 after passing through the light splitting element 133.

Please refer to FIG. 1 and FIG. 4 again. In some embodiments, the light-splitting element 133 is a light-splitting prism, and the first photosensitive element 131 and the second light-sensitive element 132 are attached to two adjacent surfaces of the light-splitting element 133 respectively. The photosensitive surface of the element 132 is opposite to the light entrance of the camera module 130 , and the photosensitive surface of the first photosensitive element 131 is parallel to the light incident direction of the camera module 130 . The first photosensitive element 131 and the second photosensitive element 132 are bonded on the surface of the light splitting element 133 through optical glue, and the bonding installation process is simple, which can effectively solve the packaging problem of the two photosensitive elements. The first photosensitive element 131 and the second photosensitive element 132 are pasted on two adjacent surfaces of the light splitting element 133 , which is also beneficial to achieve pixel-level alignment between the first photosensitive element 131 and the second photosensitive element 132 . And after alignment, due to the fixing effect of the light splitting element 133, the first photosensitive element 131 and the second photosensitive element 132 are not easy to deviate relatively, which facilitates the accurate superposition of color images and grayscale images, and is conducive to improving the diagnostic accuracy of the endoscopic imaging system 10 Rate.

Of course, in some other embodiments, the light-splitting element 133 can also be other optical elements capable of splitting light, such as a light-splitting plate, and the positions of the first light-sensitive element 131 and the second light-sensitive element 132 can also be exchanged, or the second light-sensitive element 133 can also be replaced. The first photosensitive element 131 and the second photosensitive element 132 are bonded to other surfaces of the light-splitting element 133. At this time, the position of the light-splitting element 133 needs to be adjusted accordingly, as long as white light and fluorescent light can be respectively formed on the first light-sensing element 131 after passing through the light-splitting element 133. and the second photosensitive element 132.

In addition, it can be understood that when the infrared light emitted by the second light source 1112 excites the measured object 20 to generate fluorescence and enters the camera module 130, part of the infrared light emitted by the second light source 1112 will also be reflected by the measured object 20 and enter the camera module. Group 130. In order to prevent infrared light from affecting the imaging of white light and fluorescence, in some embodiments, the camera module 130 further includes a third filter 134, and the third filter 134 is arranged on the light entrance of the light splitting element 133 facing the camera module 130. One side is used to filter the light entering the camera module 130 . Referring to FIG. 10 , FIG. 10 shows the transmittance spectrum of the third filter 134 in some embodiments. The third filter 134 can pass through the fluorescent light and the light emitted by the first light source 1111 , and block the light emitted by the second light source 1112 . For example, the third filter 134 can transmit fluorescence with a wavelength of about 810nm-900nm and visible light with a wavelength of about 400nm-650nm, and block light with a wavelength of about 700nm-800nm, so that white light and fluorescence can enter the camera module 130 imaging, and prevent the infrared light emitted by the second light source 1112 from entering the camera module 130 to interfere with the normal imaging of white light and fluorescent light.

Of course, in some embodiments, the third optical filter 134 can also be bonded to the surface of the light splitting element 133 through optical glue, so that the light splitting element 133, the first photosensitive element 131, the second photosensitive element 132 and the third filter The sheet 134 is integrally formed, the lamination process is simple, and the volume of the camera module 130 can be reduced, which facilitates the assembly of the camera module 130 in the endoscope imaging system 10 .

Further, the present application also provides an endoscope (not shown in the figure), including a casing and the endoscope imaging system 10 as described in any one of the above embodiments, and the endoscope imaging system 10 is disposed in the casing. The casing can be a structure used for installing the endoscope imaging system 10 in the endoscope, for example, it can be the casing of the endoscope light source device, or the casing of the endoscope handle. By adopting the above-mentioned endoscope imaging system 10 in an endoscope, the endoscope can form a clear image, which is beneficial to improve the diagnostic accuracy.

Referring to Fig. 1, Fig. 5 and Fig. 11, based on the endoscopic imaging system 10 of any of the above-mentioned embodiments, the present application also provides an imaging method, using the endoscopic imaging system 10 described in any of the above-mentioned embodiments The imaging of the measured object 20 is, for example, applied to the diagnosis of human tissue. The imaging method includes the following steps:

S110. Turn the conversion member 1121 so that the first filter 1123 is located on the light output path of the light source assembly 111, control the first light source 1111 to output light through the control element 1113, obtain a color image through the first photosensitive element 131, and pass through the second photosensitive element 132 Get a grayscale image.

It can be understood that, by setting the control element 1113 and the filter assembly 112, the lighting module 110 can realize the independent light output of the first light source 1111 or the second light source 1112, and then make the first light source 1111 and the second light source 1112 have a positive impact on the measured light source. The lighting of the object 20 is separated from each other and does not affect each other. In step S110, the first light source 1111 alone illuminates the measured object 20, the first photosensitive element 131 can obtain the color image formed by the white light reflected by the measured object 20, and the second photosensitive element 132 can obtain the color image formed by the measured object 20. The grayscale image formed by the white light reflected by the test object 20.

The first light source 1111 emits white light with a wavelength of about 400nm-700nm, the white light is reflected by the dichroic mirror 1114 onto the filter assembly 112, filtered by the first filter 1123, coupled into the light guide 121 by the condenser lens 113, the first The filter 1123 can block the infrared rays emitted by the second light source 1112 being turned off continuously. The white light filtered by the first filter 1123 sequentially irradiates the measured object 20 through the light guide 121 and the mirror body 122, and then enters the mirror body 122 again after being reflected by the measured object 20, and then passes through the mirror body 122 from the bayonet port 123. When it enters the camera module 130 , is filtered by the third filter 134 and passes through the light splitting element 133 , part of it is reflected to the first photosensitive element 131 to form a color image, and part of it passes through the second photosensitive element 132 to form a grayscale image.

S120. Fuse the color image and the grayscale image to form a first image. Since in step S110, the first light source 1111 illuminates the measured object 20 alone, the image acquired by the first photosensitive element 131 does not include infrared or fluorescent components, and the color image formed by white light is processed and optimized separately, which is conducive to improving image quality .

Furthermore, in some embodiments, in step S110, when the white light reflected by the measured object 20 reaches the light-splitting element 133, part of it is reflected by the light-splitting element 133 to the first photosensitive element 131 to form a color image, and part of it passes through the light-splitting element 133 reaches the second photosensitive element 132 to form a grayscale image.

As shown in combination with FIG. 1 and FIG. 12 , FIG. 12 is a flow chart of processing color images and grayscale images in some embodiments. When in step S110 the color image and the grayscale image formed by the white light are respectively acquired through the first photosensitive element 131 and the second photosensitive element 132, in step S120, the grayscale image is processed by contrast enhancement and sharpening to obtain a high-resolution image. The brightness channel of the rate image. At the same time, the process of extracting the color difference channel and enhancing the color difference channel is performed on the color image to obtain the color difference information of the color image. Then, the brightness channel of the grayscale image and the color difference information of the color image are superimposed and synthesized, so that the resolution and dynamic range of the synthesized color image are increased, so that the information expressed by the synthesized color image is richer and the details are more prominent, thereby improving The image quality of the synthesized color image is conducive to improving the diagnostic accuracy of the endoscope.

To sum up, through the lighting module 110, the first light source 1111 emits light alone, and cooperates with the light splitting element 133, the first photosensitive element 131 and the second photosensitive element 132 to obtain the color image and grayscale image of white light, which can improve the quality of the synthesized color image. image quality, so that the image quality of the color image is no longer limited by the first photosensitive element 131 .

The imaging method above also includes the following steps:

S130. Rotate the conversion member 1121 so that the second filter 1124 is located on the light output path of the light source assembly 111, control the second light source 1112 to emit infrared light through the control element 1113, and obtain infrared light through the second photosensitive element 132 to excite the object 20 under test. Generated fluorescence to form a grayscale image.

It can be understood that, in step S130, the second light source 1112 separately illuminates the measured object 20, even if the first light source 1111 emits white light due to the high-frequency modulation being turned off, the light emitted by the first light source 1111 will be emitted by the second light source 1111. If the filter 1124 blocks it, the grayscale image acquired by the second photosensitive element 132 does not have visible light components. Furthermore, the gray-scale image formed by the fluorescence can be individually optimized, and the effect of the optimization process is better and more obvious, which is beneficial to improving the imaging quality of the gray-scale image.

In some embodiments, in step S130, the second light source 1112 emits infrared light with a wavelength of 785nm, the infrared light passes through the dichroic mirror 1114 and is filtered by the second filter 1124, and then coupled into the light guide 121 by the condenser lens 113 , while the white light emitted by the first light source 1111 is blocked by the second filter 1124 . Infrared light is irradiated onto the measured object 20 through the light guide 121 and the mirror body 122 in sequence, and the measured object 20 is excited to form fluorescence, and part of the infrared light is reflected by the measured object 20, enters the mirror body 122 together with the fluorescent light, and then is emitted from the card The port 123 enters the camera module 130. The light with a wavelength of about 700nm-800nm is blocked by the third filter 134, and the fluorescence with a wavelength of about 810nm-900nm sequentially passes through the third filter 134 and the light splitting element 133 to the second photosensitive element 132 to form a grayscale image.

Step S140 , processing the grayscale image acquired by the second photosensitive element 132 to form a second image. For example, the image contrast of the grayscale image is improved by using the histogram equalization algorithm, thereby improving the image quality of the grayscale image formed by fluorescence.

Step S150, superimposing the first image composed of the color image and the grayscale image in step S120 and the optimized second image in step S140. A high-resolution fluorescence image was obtained by summing the optimized second image with the G channel of the synthesized first image.

In the above-mentioned imaging method, the first light source 1111 and the second light source 1112 illuminate the measured object 20 independently, so that the grayscale image formed by fluorescence and the color image formed by white light can be separately processed and optimized to improve the grayscale image and color image. Image Quality. Among them, optimizing the grayscale image separately has a better optimization effect than optimizing the grayscale image with white light components, so that the image quality of the grayscale image can be improved. However, if the color image is optimized separately, the grayscale image and the color image of white light can be respectively obtained through the first photosensitive element 131 and the second photosensitive element 132, and then the grayscale image and the color image can be synthesized, so that the synthesized first image is no longer affected. Limited to the first photosensitive element 131, it is beneficial to improve the image quality of the first image. Thus, the separately optimized first image and the second image are superimposed to form a fluorescence image with better image quality, which can make the image of the lesion area clear enough and the information displayed rich enough when applied to actual diagnosis, detection and treatment, and The demarcation from normal tissue is obvious enough, which is conducive to improving the diagnostic accuracy.

Of course, in some embodiments, the above-mentioned imaging method does not need to perform step S130, step S140, and step S150, then the imaging method uses an endoscope to perform imaging in white light mode, and the obtained first image is a grayscale image superimposed on a color image The enhanced white light image has good imaging quality and can improve the diagnostic accuracy. Referring to FIG. 13, FIG. 13 is a method for imaging in white light mode in some embodiments, including the following steps:

Turn the conversion member 1121 so that the first filter 1123 is located on the light output path of the light source assembly 111, and control the first light source 1111 to output light through the control element 1113;

Obtain a color image through the first photosensitive element 131, and obtain a grayscale image through the second photosensitive element 132;

The color image is fused with the grayscale image to form a first image. Wherein, the method for fusing the color image and the grayscale image may be the same as that shown in FIG. 12 .

It should be noted that the order of the steps in the above imaging method is not limited, as long as the grayscale image and the color image can be optimized separately, and finally superimposed to obtain a high-resolution fluorescence image. For example, in some embodiments, the grayscale image formed by fluorescence can be acquired first, and then the color image formed by white light can be acquired, that is, step S130 and step S140 are performed first, and then step S110 and step S120 are performed. For another example, in step S110, the grayscale image and the color image are acquired synchronously, or the color image is acquired first, and then the grayscale image is acquired.

The technical features of the above-mentioned embodiments can be combined arbitrarily. To make the description concise, all possible combinations of the technical features in the above-mentioned embodiments are not described. However, as long as there is no contradiction in the combination of these technical features, should be considered as within the scope of this specification.

The above-mentioned embodiments only express several implementation modes of the present application, and the description thereof is relatively specific and detailed, but should not be construed as limiting the scope of the patent application. It should be noted that those skilled in the art can make several modifications and improvements without departing from the concept of the present application, and these all belong to the protection scope of the present application. Therefore, the scope of protection of the patent application should be based on the appended claims.

Claims (18)

1. A lighting module, characterized in that it comprises:

   The light source assembly includes a first light source, a second light source and a control element, and the control element is used to control the first light source to emit light alone, or to control the second light source to emit light alone, or to control the first light source and the the second light source emits light at the same time; and,

   The filter assembly includes a conversion element, at least one first filter and at least one second filter, the first filter and the second filter are arranged alternately along the circumference of the conversion element; The conversion member is used to rotate to selectively place the first filter or the second filter on the light output path of the light source assembly, and the first filter is used to pass through the the light emitted by the first light source and block the light emitted by the second light source, and the second filter is used to transmit the light emitted by the second light source and block the light emitted by the first light source.
2. The lighting module according to claim 1, wherein the filter assembly comprises a plurality of the first filters and a plurality of the second filters, and a plurality of the first filters The plurality of second optical filters are arranged alternately along the circumference of the conversion member, and the conversion member can rotate along an axis.
3. The lighting module according to claim 1, wherein a plurality of mounting grooves are defined in the conversion member along the circumference for mounting the first filter and the second filter.
4. The lighting module according to claim 1, wherein at least one of the first optical filters and at least one of the second optical filters are uniformly distributed along the circumferential direction of the conversion member.
5. The lighting module according to claim 1, characterized in that, in the direction from the center of the conversion member to the edge, the sizes of the first filter and the second filter gradually increase.
6. The lighting module according to claim 1, wherein the light source assembly further comprises a dichroic mirror, and the dichroic mirror is arranged on the light output paths of the first light source and the second light source, And inclined to the light emitting directions of the first light source and the second light source, the dichroic mirror can reflect the light emitted by the first light source and transmit the light emitted by the second light source.
7. The lighting module according to claim 1, wherein one of the first light source and the second light source emits light continuously, and the control element is configured to control the other one to be turned on or off.
8. The lighting module according to claim 1, wherein the filter assembly further includes a stepping motor, the output shaft of the stepping motor is connected to the center of the conversion member, and the stepping motor is configured In order to be able to drive the conversion member to rotate around the output shaft.
9. The lighting module according to claim 1, wherein the shape of the first filter and the second filter is such that the upper bottom is close to the center of the conversion piece, and the lower bottom is close to the edge of the conversion piece trapezoidal.
10. The lighting module according to claim 1, characterized in that the lighting module further comprises a condensing lens, and the condensing lens is arranged on the light output path of the light source assembly.
11. An endoscope imaging system, comprising a light guide module, a camera module, and an illumination module according to any one of claims 1-10, the camera module comprising a first photosensitive element, a second photosensitive element and A light splitting element, the light emitted by the first light source passes through the light guide module and the light splitting element, and then reaches the first photosensitive element to form a color image, and the light emitted by the second light source excites the measured object to form fluorescence , the fluorescent light reaches the second photosensitive element after passing through the light guide module and the light splitting element to form a gray scale image.
12. The endoscopic imaging system according to claim 11, wherein the light splitting element has a light splitting surface, and the light splitting surface is inclined to the light incident direction of the camera module, and about 20%-50% of the The light emitted by the first light source passes through the light-splitting element and reaches the second photosensitive element to form a grayscale image, and the remaining light emitted by the first light source is reflected by the light-splitting element to the first light-sensitive element to form a color image .
13. The endoscopic imaging system according to claim 12, wherein the beam splitting element is a beam splitting prism, and the first photosensitive element and the second photosensitive element are attached to two adjacent sides of the beam splitting prism respectively. On the surface, the photosensitive surface of the second photosensitive element is opposite to the light entrance of the camera module, and the first photosensitive element is parallel to the light incident direction of the camera module.
14. The endoscopic imaging system according to claim 11, wherein the camera module further comprises a third filter, and the third filter is arranged at the side of the light splitting element facing the camera module. On one side of the light entrance, the third filter can transmit light with a wavelength of about 810nm-900nm and light with a wavelength of about 400nm-650nm, and block light with a wavelength of about 700nm-800nm.
15. The endoscopic imaging system according to claim 11, wherein,

    The emitted light of the first light source is a mixed light with a wavelength of about 400nm-700nm;

    The emitted light of the second light source is light with a wavelength of about 750-810nm;

    The spectroscopic element satisfies the following requirements: reflecting part of visible light with a wavelength of about 400nm-700nm, transmitting the rest of visible light with a wavelength of about 400nm-700nm, and transmitting light with a wavelength of about 810nm-910nm.
16. An endoscope, characterized by comprising the endoscope imaging system according to any one of claims 11-15.
17. An imaging method, using the endoscopic imaging system according to any one of claims 11-15, characterized in that the imaging method comprises the steps of:

    Rotate the conversion member so that the first filter is located on the light output path of the light source assembly, control the light output of the first light source, obtain a color image through the first photosensitive element, and obtain a color image through the second photosensitive element Get a grayscale image;

    fusing the color image with the grayscale image to form a first image;

    Rotate the conversion member so that the second filter is located on the light output path of the light source assembly, control the light output of the second light source, and obtain the light emitted by the second light source through the second photosensitive element to be excited The image formed by the fluorescent light emitted by the test object;

    processing the image captured by the second photosensitive element to form a second image;

    Superimposing the first image and the second image.
18. The imaging method according to claim 17, wherein the step of fusing the color image and the grayscale image to form a first image comprises:

    extracting the luminance channel of the grayscale image, extracting the color difference information of the color image, and superimposing and synthesizing the luminance channel of the grayscale image and the color difference information of the color image to form the first image.

Images