CN117204795A - Real-time spectrum imaging endoscope, imaging system and method - Google Patents

Abstract

The application discloses a real-time spectrum imaging endoscope, an imaging system and a method in the technical field of endoscopes; the endoscope comprises a lens body, an image module is arranged in the lens body, and the image module extends to the end face of the lens body; the image module comprises a lens lantern ring, a lens assembly and an imaging assembly are arranged in the lens lantern ring, and the lens assembly is close to the object side; the imaging assembly comprises a protection flat plate and a sensor imaging surface which are sequentially arranged from an object side to an image side, and the sensor imaging surface is in signal connection with a controller; a chip spectrum imager composed of a spectrum spectrometer sensor and a spectrum spectrometer is arranged on one side of the sensor imaging surface, close to the protection flat plate; the end face of the lens body is also provided with an illumination lamp source, a flushing channel and an instrument channel, and the illumination lamp source, the flushing channel and the instrument channel are all arranged in a staggered mode. The application has simple structure, replaces the image sensing device of the traditional endoscope with the chip spectrometer to obtain the endoscope capable of realizing spectral imaging, and creatively utilizes the tissue spectrum with the fingerprint characteristic to help doctors to carry out clinical endoscopic diagnosis.

Description

Real-time spectrum imaging endoscope, imaging system and method

Technical Field

The application belongs to the technical field of endoscopes, and particularly relates to a real-time spectrum imaging endoscope, an imaging system and a method.

Background

The spectrum is taken as a fingerprint information of the substance, and a reliable and effective means can be provided for detecting the components and the content of the substance. In the medical field, spectroscopic detection can be used to identify subtle changes in human tissue, such as differences between tumors and healthy tissue, thus having bright clinical application prospects.

Conventional optical endoscopes collect reflected, scattered, or emitted light from a substance through a lens and then image the light through an image sensor such as a CCD or CMOS camera. However, this method can only acquire image information of a physical space, i.e., position distribution, shape, size, color, etc., and cannot obtain information of the substance essence, such as composition.

It is well known that a spectrum can carry "fingerprint" information of a substance, by which it can be identified. Therefore, it is necessary to provide a real-time spectrum imaging endoscope, an imaging system and a method, wherein an image sensing device of a traditional endoscope is replaced by a chip spectrometer, so that the endoscope capable of realizing spectrum imaging is obtained.

Disclosure of Invention

In order to solve the problem that the conventional optical endoscope cannot obtain the information of the substance essence, the application aims to provide a real-time spectrum imaging endoscope, an imaging system and a method, wherein an image sensing device of the conventional endoscope is replaced by a chip spectrometer, so that the endoscope capable of realizing spectrum imaging is obtained.

In order to achieve the above object, the technical scheme of the present application is as follows: the real-time spectrum imaging endoscope comprises a lens body, wherein an image module is arranged in the lens body and extends to the end face of the lens body, the image module comprises a lens sleeve ring, a lens assembly and an imaging assembly are arranged in the lens sleeve ring, the lens assembly is close to the object side, the imaging assembly comprises a protection flat plate and a sensor imaging surface which are sequentially arranged from the object side to the image side, and a controller is connected with the sensor imaging surface through signals;

a chip spectrum imager composed of a spectrum spectrometer sensor and a spectrum spectrometer is arranged on one side of the sensor imaging surface, close to the protection flat plate; the end face of the lens body is also provided with an illumination lamp source and an instrument channel, and the illumination lamp source, the flushing channel and the instrument channel are all arranged in a staggered manner.

The basic scheme is as follows: the lens component receives light rays and processes the light rays to be reflected to the protection flat plate and then to the sensor imaging surface to realize imaging, wherein the imaging of the endoscope is directly processed by the chip spectrum imager and is directly generated into a spectrum image because the spectrum beam splitter is arranged at the sensor imaging surface.

The basic scheme has the beneficial effects that: 1. the existing optical endoscope does not have a spectrum measurement function, and a huge traditional spectrometer is needed to be used for realizing spectrum measurement. The light splitting device such as grating, prism and the like of the traditional spectrometer is separated from the image sensor, so that the size is huge, and the clinical use of a small-sized and portable endoscope is not facilitated;

2. by integrating the chip spectrum imager in the endoscope, the functions of the traditional endoscope can be reserved, and spectrum imaging can be realized. Meanwhile, the endoscope has the functions of traditional endoscope white light imaging, spectrum identification and discrimination.

3. The problem that the existing endoscope does not have a spectrum measurement function is solved, the endoscope has a spectrum imaging function, and doctors can more effectively diagnose the illness state, so that the treatment scheme can be formulated.

Further, the lens assembly comprises a first negative lens, a second negative lens, a first positive lens, a diaphragm, a second lens, a second positive lens, a third negative lens, a third lens and an optical filter which are sequentially arranged from the object side to the image side, and one side of the optical filter, far from the third lens, is close to the protection plate;

the object side surface of the first negative lens is a convex surface, and the image side surface of the first negative lens is a concave mirror; the second negative lens is of a biconcave structure; the object side surface of the first positive lens is a convex surface, and the image side surface is a concave surface; the object side surface of the second lens is a concave surface, and the image side surface is a convex surface; the two sides of the second positive lens are convex; the object side surface of the third negative lens is a concave surface, and the image side surface is a convex surface; the paraxial side of the object side surface of the third lens is a convex surface, and the paraxial side of the image side surface is a concave surface.

The basic scheme has the beneficial effects that: the light passes through the first negative lens, the object side surface of the first negative lens is a convex surface, the image side surface of the first negative lens is a concave mirror, the light diverges through the first negative lens and the angle of the light becomes larger, then the light can play a certain role in astigmatism after passing through the second negative lens and the first positive lens, the second negative lens and the first positive lens are combined, the light diverges, the diverged light is refracted to the second lens through the diaphragm, the second lens plays a role in converging the light, the angle of the light after passing through the second lens becomes smaller, the light passes through the second positive lens and the third negative lens, the second positive lens and the third negative lens are combined, the converged light passes through the third lens and is refracted to the optical filter, and the optical filter filters the refracted light to a certain degree.

Further, the system comprises an acquisition module, a database module, an imaging module, a data extraction module, an AI comparison module and a marking module;

the acquisition module is used for acquiring spectra of the pathological tissues and the corresponding normal tissues during measurement and obtaining the spectra of the pathological tissues and the spectra of the normal tissues;

the database module is used for summarizing the acquired spectrum of the pathological tissue and the spectrum of the normal tissue to form a spectrum imaging database;

the imaging module is used for irradiating the tissue to be tested by utilizing a light source and then performing spectral imaging by a chip spectral imager in the endoscope;

the data extraction module is used for receiving the imaging formed by the imaging module and extracting the spectrum of each region in the spectrum imaging;

the AI comparison module is used for receiving the spectrum extracted by the data extraction module, comparing the extracted spectrum with the spectrum obtained by the acquisition module by utilizing artificial intelligence, and judging normal and pathological change spectrums;

and the marking module is used for receiving the contrast information at the AI contrast module and marking the contrast lesion spectrum.

The basic scheme has the beneficial effects that: in the system, a spectral image of a tissue can be acquired in the process of implementing an examination by an endoscope, a computer extracts the spectrum of each region in the image in real time, then artificial intelligence judges whether the region is diseased or not by utilizing spectral information, and finally the diseased region in the spectral image is marked by image processing, so that a doctor can better perform clinical diagnosis, and the operation is implemented efficiently and accurately. The application not only can realize the function of the traditional endoscope, but also has the spectrum resolution capability.

Further, the system also comprises an auditing module and a transmitting module;

the auditing module is used for receiving the comparison judgment information at the AI comparison module and auditing the judgment of the AI comparison module by combining the judged information with the judgment of the acquisition module and the doctor end so as to judge whether the comparison is correct or not;

and the transmission module is used for receiving the contrast information at the AI contrast module and transmitting the spectrum which is judged to be correct to the database module according to the contrast information.

The basic scheme has the beneficial effects that: the situation of error judgment at the AI comparison module is reduced, and meanwhile, the transmission module transmits the information with correct judgment to the database module, so that the database is richer, more cases are provided, and the corresponding pathological change tissues can be conveniently and scientifically identified later.

Further, the device also comprises an image processing module, wherein the image processing module comprises a peak value detection unit, a background correction unit, a wavelength calibration unit and a noise reduction unit;

the peak detection unit is used for identifying and measuring the position and the intensity of the peak value so as to realize fitting and integration to the spectrum peak value;

the background correction unit is used for eliminating background noise or baseline deviation, and the elimination method comprises polynomial fitting, baseline smoothing and background difference;

a wavelength calibration unit for calibrating the spectrometer using a standard sample of a known wavelength and converting the measured spectral data into a wavelength axis;

and the noise reduction unit is used for reducing noise interference and improving the signal to noise ratio so as to identify and quantify the spectral characteristics.

The basic scheme has the beneficial effects that: by background correction and noise reduction, the effects from noise and baseline drift can be eliminated or reduced, thereby improving the accuracy of the spectral data. This is critical to the reliability of quantitative analysis and experimental results; wavelength calibration may ensure an accurate match between the wavelength axis of the spectral data and the actual wavelength. This is important for determining the location of specific absorption peaks, and for comparing and calibrating samples; noise reduction techniques can significantly reduce noise levels in the spectrum, thereby improving signal-to-noise ratio. This helps to more clearly identify and measure features in the spectrum, especially for low signal strength data.

Further, the system also comprises a view interaction module and an image change module;

the checking interaction module is used for checking the marked spectral imaging by the doctor end by using the mobile equipment and judging the pathological change condition;

and the image change module is used for changing the imaging image in real time according to the actual condition when the doctor end uses the mobile equipment to view so as to attach the image observation condition of the doctor end.

The basic scheme has the beneficial effects that: on one hand, the method is convenient for doctors to check and diagnose, on the other hand, the probability of accurate diagnosis of the doctors can be increased, and the situation that the doctors see unchanged spectrograms for a long time to generate fatigue feeling is reduced.

Further, the view interaction module comprises a double-screen unit, an image scaling unit and an image overlapping unit;

the double-screen unit is used for synchronously importing normal spectrum images and lesion spectrum images into the mobile equipment by using gesture instructions and checking the normal spectrum images and the lesion spectrum images, and when the doctor triggers the double-screen instructions, the image change module receives the information and marks the colors of lesions on the two pictures as two different colors;

the image zooming unit is used for zooming in and out the spectrum image by utilizing the gesture instruction by a doctor for viewing, when the doctor triggers the zooming instruction, the image changing module is used for fading the color of the lesion part of the image according to the continuous expansion of the zooming scale of the doctor, and the edge of the lesion tissue is marked by a curve;

and the image overlapping unit is used for overlapping the spectrum imaging of other equipment on the image by using the gesture instruction by a doctor, and when the doctor triggers the overlapping instruction, the image change module marks the edges of the pathological tissues at the pathological positions of the two overlapped images by using solid lines with different colors respectively.

The basic scheme has the beneficial effects that: when the doctor performs corresponding viewing operation, the double-screen unit, the image scaling unit and the image overlapping unit can process the pictures to be suitable for the viewing habit of the doctor, and the fatigue feeling during viewing is reduced.

Further, an imaging method of a real-time spectral imaging endoscope includes the steps of:

step one, establishing a database: collecting spectra of the pathological tissues and the corresponding normal tissues during measurement by using a collecting module, and summarizing the collected spectra by using a database module to form a pathological tissue spectrum and a normal tissue spectrum database;

step two, spectrum imaging: an endoscope designed at the imaging module is utilized to collect images, and spectral imaging is carried out through a chip spectral imager in the endoscope;

step three, spectral data extraction: extracting the spectrum of each region in the spectrum imaging by using a data extraction module, and identifying specific wave peaks, wave troughs or spectral bands;

step four, AI assists the spectrum identification: comparing the extracted spectrum with the spectrum obtained in the first step by using an AI comparison module, judging normal and pathological change spectrums, judging whether the comparison is correct or not by an auditing module, and transmitting the judging spectrums to a database module for storage if the comparison is correct;

step five, lesion spectrum marking: marking a lesion spectrum region obtained by AI discrimination into a signal recognized by a doctor by using a marking module;

step six, the doctor looks at the interaction: when a doctor checks the corresponding lesion spectrogram, the checking interaction module and the image change module process the change of the spectrogram according to the change of the checking requirement of the doctor, so that the identification accuracy is improved.

The basic scheme has the beneficial effects that: the method can acquire the spectral information of each region in the endoscope spectral imaging image, and judge the focus by utilizing the spectral information by utilizing artificial intelligence, thereby helping doctors to more efficiently and accurately implement clinical diagnosis.

Drawings

FIG. 1 is an isometric view of a real-time spectral imaging endoscope in an embodiment of the application.

Fig. 2 is a schematic diagram of an image module in a real-time spectral imaging endoscope according to an embodiment of the present application.

FIG. 3 is a system diagram of an endoscopic imaging system for real-time spectroscopic imaging in accordance with an embodiment of the present application.

FIG. 4 is a system diagram of an endoscopic imaging system for real-time spectroscopic imaging in accordance with an embodiment of the present application.

Fig. 5 is a schematic diagram of a method of real-time spectroscopic imaging endoscopic imaging in an embodiment of the present application.

Detailed Description

The following is a further detailed description of the embodiments:

reference numerals in the drawings of the specification include: lens body 1, instrument channel 2, image module 3, first negative lens 301, second negative lens 302, first positive lens 303, diaphragm 804, second lens 305, second positive lens 306, third negative lens 307, third lens 308, optical filter 309, protection plate 310, spectral beamsplitter 311, sensor imaging surface 312, and illumination lamp source 4.

Example 1

Substantially as shown in figure 1: the real-time spectrum imaging endoscope comprises a lens body 1, wherein an image module 3 is arranged in the lens body 1, the image module 3 extends to the end face of the lens body 1, the image module 3 comprises a lens sleeve ring, a lens assembly and an imaging assembly are arranged in the lens sleeve ring, the lens assembly is close to an object side, the imaging assembly comprises a protection flat plate 310 and a sensor imaging surface 312 which are sequentially arranged from the object side to the image side, and the sensor imaging surface 312 is in signal connection with a controller;

a spectrum light splitter 311 is arranged on one side of the sensor imaging surface 312, which is close to the protection flat plate 310, and the connection relationship between the spectrum light splitter 311 and the sensor imaging surface 312 is that two-dimensional flat plate microcavities with different thicknesses are directly grown on the surface of the sensor imaging surface 312 in a micro-nano processing mode; the sensor and the spectrum spectrometer 311 form a chip spectrum imager; the end face of the lens body 1 is also provided with an illumination lamp source 4, a flushing channel and an instrument channel 2, and the illumination lamp source 4 and the instrument channel 2 are arranged in a staggered mode.

The specific implementation process is as follows: when an image is acquired, the endoscope is placed at a part of a patient to be imaged, then a lighting lamp source 4 provides a certain illumination condition for imaging, at the moment, a lens component receives light rays and processes the light rays to be reflected to a protection flat plate 310 and then to be reflected to a sensor imaging surface 312 to realize imaging, wherein the imaging of the endoscope is directly processed by a chip spectrum imager and directly generates a spectrum image because the sensor imaging surface 312 is provided with the spectrum spectroscope 311, and the function of a traditional endoscope can be reserved and the spectrum imaging can be realized through integrating the chip spectrum imager in the endoscope; and the produced spectrogram can further mark pathological tissue conditions, so that doctors can conveniently perform corresponding diagnosis and treatment.

Example 2

The difference from the above-described embodiment is that, as shown in fig. 2, the lens assembly includes a first negative lens 301, a second negative lens 302, a first positive lens 303, a stop 804, a second lens 305, a second positive lens 306, a third negative lens 307, a third lens 308, and a filter 309 disposed in this order from the object side to the image side, the filter 309 being located near the protection plate 310 on the side away from the third lens 308;

wherein the object side surface of the first negative lens 301 is a convex surface, and the image side surface is a concave mirror; the second negative lens 302 has a biconcave structure; the object-side surface of the first positive lens 303 is convex, and the image-side surface is concave; the second lens element 305 has a concave object-side surface and a convex image-side surface; the second positive lens 306 has convex surfaces on both sides; the third negative lens 307 has a concave object-side surface and a convex image-side surface; the paraxial side of the object-side surface of the third lens element 308 is convex, and the paraxial side of the image-side surface is concave.

The specific implementation process is as follows: when the lens assembly performs the collection light source to perform imaging, firstly, light passes through the first negative lens 301, and because the object side surface of the first negative lens 301 is a convex surface, the image side surface is a concave surface mirror, the light diverges through the first negative lens 301 and the angle thereof becomes larger, then the light can play a role of a certain astigmatism after passing through the second negative lens 302 and the first positive lens 303, the second negative lens 302 and the first positive lens 303 are combined, further the light diverges, the diverged light is refracted to the second lens 305 through the diaphragm 804, the second lens 305 plays a role of converging the light, further the angle of the light passing through the second lens 305 becomes smaller, then the light passes through the second positive lens 306 and the third negative lens 307, the second positive lens 306 and the third negative lens 307 are combined, the converged light passes through the third lens 308 and is refracted to the optical filter 309, and the optical filter 309 filters the refracted light to a certain degree.

Example 3

Unlike the above embodiments, as shown in fig. 3 and 4, an imaging system of a real-time spectral imaging endoscope includes an acquisition module, a database module, an imaging module, a data extraction module, an AI contrast module, and a marking module;

the acquisition module is used for acquiring spectra of the pathological tissues and the corresponding normal tissues during measurement and obtaining the spectra of the pathological tissues and the spectra of the normal tissues;

the database module is used for summarizing the acquired spectrum of the pathological tissue and the spectrum of the normal tissue to form a spectrum imaging database;

the imaging module is used for irradiating the tissue to be tested by utilizing a light source and then performing spectral imaging by a chip spectral imager in the endoscope;

the data extraction module is used for receiving the imaging formed by the imaging module and extracting the spectrum of each region in the spectrum imaging;

the AI comparison module is used for receiving the spectrum extracted by the data extraction module, comparing the extracted spectrum with the spectrum obtained by the acquisition module by utilizing artificial intelligence, and judging normal and pathological change spectrums;

and the marking module is used for receiving the contrast information at the AI contrast module and marking the contrast lesion spectrum.

The specific implementation process is as follows: when the system operates, a large number of pathological tissues and corresponding normal tissue spectrums are collected by the collecting module at first, then the pathological tissue spectrums and the normal tissue spectrums are formed by combining, then the data information at the collecting module is received by the database module and summarized into a database, the image of a patient is collected by the imaging module by using the endoscope, a spectrogram is generated, spectral data including specific peaks, troughs or spectral bands are extracted by the data extracting module, the intensity of absorption, reflection or emission is calculated, meanwhile, the extracted spectrums are identified by the AI comparison module by using artificial intelligence, and the pathological tissues on the image are identified by the marking module according to judgment information at the AI comparison module, so that clinical diagnosis can be implemented more efficiently and accurately by using the artificial intelligence through the spectral information, and doctors can diagnose the illness more effectively, thereby helping to specify a treatment scheme.

Example 4

The embodiment is different from the embodiment in that the system also comprises an auditing module and a transmitting module;

the auditing module is used for receiving the comparison judgment information at the AI comparison module and auditing the judgment of the AI comparison module by combining the judged information with the judgment of the acquisition module and the doctor end so as to judge whether the comparison is correct or not;

and the transmission module is used for receiving the contrast information at the AI contrast module and transmitting the spectrum which is judged to be correct to the database module according to the contrast information.

The specific implementation process is as follows: the design of the auditing module can further audit the comparison information at the AI comparison module, reduce the situation of error judgment at the AI comparison module, and meanwhile, the transmission module transmits the information with correct judgment to the database module, so that the database is richer, more cases are provided, and the corresponding pathological change organization can be conveniently and scientifically identified later.

Example 5

The difference from the above embodiment is that the device further comprises an image processing module, wherein the image processing module comprises a peak value detection unit, a background correction unit, a wavelength calibration unit and a noise reduction unit;

the peak detection unit is used for identifying and measuring the position and the intensity of the peak value so as to realize fitting and integration to the spectrum peak value;

the background correction unit is used for eliminating background noise or baseline deviation, and the elimination method comprises polynomial fitting, baseline smoothing and background difference;

a wavelength calibration unit for calibrating the spectrometer using a standard sample of a known wavelength and converting the measured spectral data into a wavelength axis;

and the noise reduction unit is used for reducing noise interference and improving the signal to noise ratio so as to identify and quantify the spectral characteristics.

The specific implementation process is as follows: in a spectral image, peaks generally represent the intensities or absorption peaks of light of different wavelengths, and the peak detection unit is able to identify and measure the positions and intensities of these peaks. This typically involves fitting and integration of spectral peaks; the spectral image may contain background noise or baseline shifts. The background correction unit may help to eliminate these disturbances, making the spectral data more accurate. Some methods include polynomial fitting, baseline smoothing, and background differencing; the wavelength calibration unit is capable of converting the measured spectral data into a wavelength axis; spectral data may be subject to noise. The noise reduction unit may help to improve the signal-to-noise ratio in order to better identify and quantify spectral features.

Example 6

Unlike the above embodiment, the system also comprises a view interaction module and an image change module,

the checking interaction module is used for checking the marked spectral imaging by the doctor end by using the mobile equipment and judging the pathological change condition;

and the image change module is used for changing the imaging image in real time according to the actual condition when the doctor end uses the mobile equipment to view so as to attach the image observation condition of the doctor end.

The specific implementation process is as follows: the checking interaction module can facilitate the doctor to check the corresponding spectrogram, and meanwhile, when checking the doctor through the image change module, the image is correspondingly changed, so that the doctor can check and diagnose conveniently, the probability of accurate diagnosis of the doctor can be increased, and the situation that the doctor looks at the spectrogram without change for a long time and then generates fatigue feeling is reduced.

Example 7

The difference with the embodiment is that the view interaction module comprises a double-screen unit, an image scaling unit and an image overlapping unit;

the double-screen unit is used for synchronously importing normal spectrum images and lesion spectrum images into the mobile equipment by using gesture instructions and checking the normal spectrum images and the lesion spectrum images, and when the doctor triggers the double-screen instructions, the image change module receives the information and marks the colors of lesions on the two pictures as two different colors;

the image zooming unit is used for zooming in and out the spectrum image by utilizing the gesture instruction by a doctor for viewing, when the doctor triggers the zooming instruction, the image changing module is used for fading the color of the lesion part of the image according to the continuous expansion of the zooming scale of the doctor, and the edge of the lesion tissue is marked by a curve;

and the image overlapping unit is used for overlapping the spectral imaging of other equipment on the image by using a gesture instruction by a doctor, for example, combining Magnetic Resonance Imaging (MRI) or Computed Tomography (CT) images, and when the doctor triggers the overlapping instruction, the image change module marks the lesion positions of the two overlapping images by using solid lines with different colors to mark the edges of lesion tissues.

The specific implementation process is as follows: when the two-screen unit displays two different pictures in a double-screen manner, the doctor can conveniently compare lesions with normal tissues, and the doctor can reduce the fatigue feeling generated when the doctor repeatedly checks and views the pictures through different color blocks on the two groups of pictures, so that the diagnosis efficiency is reduced; the design of the image overlapping unit can provide overlapping images of multiple spectral imaging modes to provide more comprehensive information.

Example 8

Unlike the above embodiment, as shown in fig. 5, an imaging method of a real-time spectral imaging endoscope includes the steps of:

step one, establishing a database: collecting spectra of the pathological tissues and the corresponding normal tissues during measurement by using a collecting module, and summarizing the collected spectra by using a database module to form a pathological tissue spectrum and a normal tissue spectrum database;

step two, spectrum imaging: an endoscope designed at the imaging module is utilized to collect images, and spectral imaging is carried out through a chip spectral imager in the endoscope;

step three, spectral data extraction: extracting the spectrum of each region in the spectrum imaging by using a data extraction module, and identifying specific wave peaks, wave troughs or spectral bands;

step four, AI assists the spectrum identification: comparing the extracted spectrum with the spectrum obtained in the first step by using an AI comparison module, judging normal and pathological change spectrums, judging whether the comparison is correct or not by an auditing module, and transmitting the judging spectrums to a database module for storage if the comparison is correct;

step five, lesion spectrum marking: marking a lesion spectrum region obtained by AI discrimination into a signal recognized by a doctor by using a marking module;

step six, the doctor looks at the interaction: when a doctor checks the corresponding lesion spectrogram, the checking interaction module and the image change module process the change of the spectrogram according to the change of the checking requirement of the doctor, so that the identification accuracy is improved.

It is noted that relational terms such as first and second, and the like are used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Moreover, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus.

The foregoing is merely an embodiment of the present application, and a specific structure and characteristics of common knowledge in the art, which are well known in the scheme, are not described herein, so that a person of ordinary skill in the art knows all the prior art in the application date or before the priority date, can know all the prior art in the field, and has the capability of applying the conventional experimental means before the date, and a person of ordinary skill in the art can complete and implement the present embodiment in combination with his own capability in the light of the present application, and some typical known structures or known methods should not be an obstacle for a person of ordinary skill in the art to implement the present application. It should be noted that modifications and improvements can be made by those skilled in the art without departing from the structure of the present application, and these should also be considered as the scope of the present application, which does not affect the effect of the implementation of the present application and the utility of the patent. The protection scope of the present application is subject to the content of the claims, and the description of the specific embodiments and the like in the specification can be used for explaining the content of the claims.

Claims (8)

1. A real-time spectral imaging endoscope, characterized by: the camera lens comprises a lens body, wherein an image module is arranged in the lens body and extends to the end face of the lens body, the image module comprises a lens sleeve ring, a lens assembly and an imaging assembly are arranged in the lens sleeve ring, the lens assembly is close to the object side, the imaging assembly comprises a protection flat plate and a sensor imaging surface which are sequentially arranged from the object side to the image side, and a controller is connected to the sensor imaging surface through signals;

a chip spectrum imager composed of a spectrum spectrometer sensor and a spectrum spectrometer is arranged on one side of the sensor imaging surface, close to the protection flat plate; the end face of the lens body is also provided with an illumination lamp source and an instrument channel, and the illumination lamp source, the flushing channel and the instrument channel are all arranged in a staggered manner.

2. The real-time spectral imaging endoscope according to claim 1, wherein: the lens assembly comprises a first negative lens, a second negative lens, a first positive lens, a diaphragm, a second lens, a second positive lens, a third negative lens, a third lens and an optical filter which are sequentially arranged from an object side to an image side, and one side of the optical filter, which is far away from the third lens, is close to the protection plate;

the object side surface of the first negative lens is a convex surface, and the image side surface of the first negative lens is a concave mirror; the second negative lens is of a biconcave structure; the object side surface of the first positive lens is a convex surface, and the image side surface is a concave surface; the object side surface of the second lens is a concave surface, and the image side surface is a convex surface; the two sides of the second positive lens are convex; the object side surface of the third negative lens is a concave surface, and the image side surface is a convex surface; the paraxial side of the object side surface of the third lens is a convex surface, and the paraxial side of the image side surface is a concave surface.

3. An imaging system for a real-time spectroscopic imaging endoscope, comprising: the system comprises an acquisition module, a database module, an imaging module, a data extraction module, an AI comparison module and a marking module;

the acquisition module is used for acquiring spectra of the pathological tissues and the corresponding normal tissues during measurement and obtaining the spectra of the pathological tissues and the spectra of the normal tissues;

the database module is used for summarizing the acquired spectrum of the pathological tissue and the spectrum of the normal tissue to form a spectrum imaging database;

the imaging module is used for irradiating the tissue to be tested by utilizing a light source and then performing spectral imaging by a chip spectral imager in the endoscope;

the data extraction module is used for receiving the imaging formed by the imaging module and extracting the spectrum of each region in the spectrum imaging;

the AI comparison module is used for receiving the spectrum extracted by the data extraction module, comparing the extracted spectrum with the spectrum obtained by the acquisition module by utilizing artificial intelligence, and judging normal and pathological change spectrums;

and the marking module is used for receiving the contrast information at the AI contrast module and marking the contrast lesion spectrum.

4. The imaging system of a real-time spectroscopic imaging endoscope according to claim 3, wherein: the system also comprises an auditing module and a transmitting module;

the auditing module is used for receiving the comparison judgment information at the AI comparison module and auditing the judgment of the AI comparison module by combining the judged information with the judgment of the acquisition module and the doctor end so as to judge whether the comparison is correct or not;

and the transmission module is used for receiving the contrast information at the AI contrast module and transmitting the spectrum which is judged to be correct to the database module according to the contrast information.

5. The imaging system of a real-time spectroscopic imaging endoscope according to claim 4, wherein: the device also comprises an image processing module, wherein the image processing module comprises a peak value detection unit, a background correction unit, a wavelength calibration unit and a noise reduction unit;

the peak detection unit is used for identifying and measuring the position and the intensity of the peak value so as to realize fitting and integration to the spectrum peak value;

the background correction unit is used for eliminating background noise or baseline deviation, and the elimination method comprises polynomial fitting, baseline smoothing and background difference;

a wavelength calibration unit for calibrating the spectrometer using a standard sample of a known wavelength and converting the measured spectral data into a wavelength axis;

and the noise reduction unit is used for reducing noise interference and improving the signal to noise ratio so as to identify and quantify the spectral characteristics.

6. The imaging system of a real-time spectroscopic imaging endoscope according to claim 5, wherein: the system also comprises a view interaction module and an image change module;

the checking interaction module is used for checking the marked spectral imaging by the doctor end by using the mobile equipment and judging the pathological change condition;

and the image change module is used for changing the imaging image in real time according to the actual condition when the doctor end uses the mobile equipment to view so as to attach the image observation condition of the doctor end.

7. The imaging system of a real-time spectroscopic imaging endoscope according to claim 6, wherein: the view interaction module comprises a double-screen unit, an image scaling unit and an image overlapping unit;

the double-screen unit is used for synchronously importing normal spectrum images and lesion spectrum images into the mobile equipment by using gesture instructions and checking the normal spectrum images and the lesion spectrum images, and when the doctor triggers the double-screen instructions, the image change module receives the information and marks the colors of lesions on the two pictures as two different colors;

the image zooming unit is used for zooming in and out the spectrum image by utilizing the gesture instruction by a doctor for viewing, when the doctor triggers the zooming instruction, the image changing module is used for fading the color of the lesion part of the image according to the continuous expansion of the zooming scale of the doctor, and the edge of the lesion tissue is marked by a curve;

and the image overlapping unit is used for overlapping the spectrum imaging of other equipment on the image by using the gesture instruction by a doctor, and when the doctor triggers the overlapping instruction, the image change module marks the edges of the pathological tissues at the pathological positions of the two overlapped images by using solid lines with different colors respectively.

8. An imaging method of a real-time spectrum imaging endoscope is characterized in that: the method comprises the following steps:

step one, establishing a database: collecting spectra of the pathological tissues and the corresponding normal tissues during measurement by using a collecting module, and summarizing the collected spectra by using a database module to form a pathological tissue spectrum and a normal tissue spectrum database;

step two, spectrum imaging: an endoscope designed at the imaging module is utilized to collect images, and spectral imaging is carried out through a chip spectral imager in the endoscope;

step three, spectral data extraction: extracting the spectrum of each region in the spectrum imaging by using a data extraction module, and identifying specific wave peaks, wave troughs or spectral bands;

step four, AI assists the spectrum identification: comparing the extracted spectrum with the spectrum obtained in the first step by using an AI comparison module, judging normal and pathological change spectrums, judging whether the comparison is correct or not by an auditing module, and transmitting the judging spectrums to a database module for storage if the comparison is correct;

step five, lesion spectrum marking: marking a lesion spectrum region obtained by AI discrimination into a signal recognized by a doctor by using a marking module;

step six, the doctor looks at the interaction: when a doctor checks the corresponding lesion spectrogram, the checking interaction module and the image change module process the change of the spectrogram according to the change of the checking requirement of the doctor, so that the identification accuracy is improved.