CN116712032A

CN116712032A - Hyperspectral microcirculation observer

Info

Publication number: CN116712032A
Application number: CN202310063695.7A
Authority: CN
Inventors: 何赛灵; 林子舰
Original assignee: Taizhou Anqiling Intelligent Technology Co ltd
Current assignee: Taizhou Anqiling Intelligent Technology Co ltd
Priority date: 2022-08-24
Filing date: 2023-02-06
Publication date: 2023-09-08

Abstract

The invention discloses a hyperspectral microcirculation observer, wherein the instrument comprises a human hand fixing module, a hyperspectral imaging module and a data processing and displaying module; the hand fixing module is used for fixing hands and reducing the influence of hand shake on microcirculation observation; the hyperspectral imaging module is used for hyperspectral imaging of the nail fold, and the imaging system relates to various imaging technical modes, including imaging technical modes such as common bright field hyperspectral imaging, orthogonal polarization hyperspectral imaging, dark field hyperspectral imaging and the like; the data processing and displaying module is used for controlling related hardware, is connected with the hyperspectral imaging module, processes hyperspectral data, and displays and analyzes the microcirculation system. The invention relates to the technical field of hyperspectral imaging and the technical field of medical instruments, integrates a plurality of imaging modes, can simultaneously obtain video images and spectrum information of a microcirculation system, and further promotes the development of the microcirculation detection and analysis field.

Description

Hyperspectral microcirculation observer

Technical Field

The invention relates to a hyperspectral microcirculation observer, which is applicable to the fields of hyperspectral imaging technology, medical instrument technology and the like.

Background

Microcirculation is the flow of blood, lymph and tissue fluid which directly participate in the transmission of substances, information and energy of tissues and cells, is a peripheral part of a circulatory system, and is one of basic characteristics of life, and an organism continuously transmits substances, energy and information with the surrounding environment through the microcirculation. Under normal conditions, the microcirculation blood flow is adapted to the metabolic level of human tissues and organs, so that the physiological functions of all organs in the human body can be normally carried out. If microcirculation is not smooth, diseases and aging can occur in viscera of human body due to abnormal metabolism. Therefore, the microcirculation is closely related to the occurrence and development of diseases, and has important significance for early diagnosis and treatment of various diseases.

At present, the main means for observing the microcirculation is a microcirculation microscopy instrument, and the hyperspectral imaging technology is less combined with the microcirculation microscopy instrument. A microcirculatory microscopic examination instrument based on a liquid crystal tunable filter for carrying out microcirculatory observation is available, and the fact that a multispectral image of a microvascular can show different details of microcirculatory in different wave bands, for example, the details of the microvascular with the wavelength of 430nm are the most abundant, but images with other wavelengths also have other details which are not available for images with the wavelength of 430 nm. However, the tunable filter of the liquid crystal is expensive, the tuning wave band is fixed, the conversion time for electrically tuning the liquid crystal reaches tens of milliseconds, the current dynamic observation of micro-circulation by applying the tunable filter of the liquid crystal is limited to a specific wave band, and the application of analyzing the micro-circulation system and the human health from hyperspectral data is less. The invention combines the multicolor LED light source as a main means for realizing hyperspectrum, and obviously reduces the hyperspectral detection cost of the microcirculation blood vessel on the basis of not sacrificing the spatial resolution and the spectral resolution. The micro-circulation hyperspectral image collected by the hyperspectral micro-circulation observer provides more abundant high-cost performance information for subsequent artificial intelligent analysis of micro-circulation, for example, after micro-circulation hyperspectral imaging is carried out on the nail fold part, the micro-circulation blood vessel hyperspectral image can be associated with SOFA scoring or other quantitative diagnosis results of sepsis through artificial intelligent training, and a proper network model is selected to analyze the micro-circulation state of a sepsis patient.

Disclosure of Invention

The invention aims at solving the problem that the combination of a hyperspectral technology, microcirculation observation and human health diagnosis is less, and provides a hyperspectral microcirculation observer with low cost.

In order to solve the technical problems, the technical scheme adopted by the invention is as follows:

the hyperspectral microcirculation observer comprises a human hand fixing module, a hyperspectral imaging module and a data processing and displaying module;

the hand fixing module is used for fixing hands, reducing hand shake, facilitating the imaging system to better image the microcirculation system of the nail fold part, and facilitating subsequent observation and analysis of the microcirculation system;

the hyperspectral imaging module comprises an incident light path and a reflecting light path, is used for imaging the nail fold, and can be a common hyperspectral imaging mode, a dark field hyperspectral imaging mode or an orthogonal polarization hyperspectral imaging mode, and the different hyperspectral imaging modes can be manually switched;

the data processing and displaying module is used for controlling hardware such as a camera and a light source, is connected with the hyperspectral imaging module, processes hyperspectral data, and displays and analyzes the microcirculation system.

The hyperspectral imaging module is provided with a multicolor LED light source, and the LED light source can be switched between LED lights in different wave bands through an LED control circuit. Switching between different bands of LED light is the primary means of the present invention to achieve hyperspectral measurements.

The hyperspectral imaging module comprises a uniform illumination unit, a polarizer, a beam splitting unit, an objective lens, an analyzer and an imaging unit.

The hand fixing module comprises a binding belt, a button, a shell, a transmission structure and a displacement table;

the binding belt, the button, the shell and the transmission mechanism can realize the fastening of the parts such as fingers;

the displacement platform can realize three-dimensional movement of the hand fixing module in the horizontal plane and the vertical direction by adjusting the knob of the displacement platform.

The polarizer and the analyzer are designed to be pluggable, and are inserted when the orthogonal polarization hyperspectral imaging is needed, and pulled out when the hyperspectral imaging is needed in other modes.

The light splitting unit comprises a bright field imaging light splitting sub-unit and a dark field imaging light splitting sub-unit.

The imaging module is a reflecting mirror, an achromatic wide field lens, a gray-scale camera, a color camera and a hyperspectral data transmission interface. Adjusting the position of the mirror can switch the entire device between a hyperspectral imaging mode and a high frame rate normal color video capture mode. The hyperspectral data transmission interface is connected with the data processing and display module.

The bright field imaging photon-splitting unit can be a flat beam splitter, a cube beam splitter prism, a thin film spectroscope or a two-term color spectroscope.

The dark field imaging light splitting subunit comprises a light transmitting barrel, an annular reflecting mirror and a dark field ring.

The dark field ring is vertically arranged in an incident light path;

the light-transmitting cylinder axially extends along the direction of the reflection light path and passes through the annular reflecting mirror;

the annular reflector is placed at an angle of 45 degrees with the incident light path and the reflecting light path and plays a role of rotating the refraction path.

The data processing and displaying module comprises a display screen, a computer and a software unit;

the display screen is an RGB display screen and is used for displaying color patterns of the microcirculation system and is connected with the computer;

the computer can be a single-chip microcomputer or a computer and is used for connecting the hyperspectral imaging module with the display screen, providing computing power and ensuring the operation of the software unit;

the software unit is responsible for controlling parameters such as an LED circuit and a camera, processing hyperspectral data sent by the hyperspectral imaging module, converting the hyperspectral data into true color images, transmitting the true color images to a display screen for display, storing the hyperspectral data and the image data, assisting pathological diagnosis according to the hyperspectral data, calculating blood oxygen saturation of a shooting part and the like, and integrating the hyperspectral data and the hyperspectral image data into a computer.

The invention has the beneficial effects that:

compared with the prior art, the invention realizes the hyperspectral observation of the microcirculation by utilizing the multicolor LED light source, obviously saves the cost, rapidly switches the LED wave band to obtain the real-time hyperspectral data of the microcirculation, and converts the data into the color RGB image to be displayed on a display screen. While a normal color camera is provided to provide high frame rate color video reflecting the micro-circulation flow condition. The method is beneficial to hyperspectral analysis of a microcirculation system, analyzes the relationship between the microcirculation and the human health in rich spectral information, and greatly promotes the development of hyperspectral imaging technology in the field of microcirculation observation.

Drawings

FIG. 1 is a schematic diagram of a hyperspectral microcirculation observer of the present invention.

Figure 2 is a schematic diagram of a human hand securing module of the present invention.

Fig. 3 is an optical path diagram of the hyperspectral imaging module of the present invention.

Fig. 4 is a schematic structural view of an image forming unit of the present invention.

FIG. 5 is a schematic diagram showing a structure of a spectroscopic unit according to the present invention

Fig. 6 is a schematic diagram of a dark field imaging subunit of the present invention.

In the figure, a hand fixing module 1, an imaging module 2, a display module 3, a binding band 4, a button 5, a housing 6, a displacement table 7, an LED light source 8, a collimator lens 9, a polarizer 10, a spectroscopic unit 11, an objective lens 12, a nail fold position 13, an analyzer 14, an imaging unit 15, a mirror 16, an achromatic wide field lens 17, a gray-scale camera 18, a color camera 19, a bright field imaging sub-unit 20, a dark field imaging sub-unit 21, a slide rod 22, a light transmitting cylinder 23, an annular mirror 24, and a dark field ring 25.

The invention is further described below with reference to the drawings and examples.

As shown in fig. 1, a hyperspectral microcirculation observer comprises a human hand fixing module 1, a hyperspectral imaging module 2 and a data processing and displaying module 3.

The hand fixing module is used for fixing hands, reducing hand shake, facilitating the imaging system of the invention to form a fixed and clear image for the microcirculation system of the nail fold part, obtaining meaningful highlight image or video data, and facilitating the subsequent observation and analysis of the microcirculation system.

The hyperspectral imaging module comprises an incident light path and a reflecting light path, is used for imaging a microcirculation system at a nail fold and relates to various imaging modes, including a common hyperspectral imaging mode, an orthogonal polarization hyperspectral imaging mode and a dark field hyperspectral imaging mode, and optical elements in the hyperspectral imaging module can be manually adjusted to switch in different hyperspectral imaging modes.

The data processing and displaying module is used for controlling hardware such as a camera, a light source and the like, is connected with the hyperspectral imaging module, processes hyperspectral data, and displays and analyzes the microcirculation system.

The hyperspectral imaging module is provided with a multicolor LED light source, and the LED light source can be switched between LED lights in different wave bands through an LED control circuit. Switching between different bands of LED light is the primary means of the present invention to achieve hyperspectral measurements. Through monochromatic light conversion in a plurality of wave bands, LEDs in different wave bands are used for irradiating the nail fold, the acquired hyperspectral data are LED into a data processing and displaying module for processing, a true color image is generated, and microcirculation hyperspectral observation is realized; meanwhile, the LED can emit white light or be fixed at a certain monochromatic wave band to obtain monochromatic or color high-frame-rate video of the flow condition of the microcirculation system under the white light or corresponding wave band.

As shown in fig. 3 and 4, the imaging module includes a uniform illumination unit 8-9, a polarizer 10, a spectroscopic unit 11, an objective 12, an analyzer 14, and an imaging unit 15.

As shown in fig. 3 and 4, the imaging module includes an incident light path and a reflected light path, the incident light beam emits light through the light source module, is collimated into a parallel light beam by the focusing lens, passes through the polarizer, is turned to the objective lens by the light splitting unit, and finally irradiates at the nail fold position 13, and the solid arrows in fig. 3 and 4 represent the propagation process of the incident light beam; the reflected light beam starts from the nail fold, passes through the objective lens, the light splitting unit and the analyzer, and reaches the imaging unit, and the dashed arrows in fig. 3 and 4 represent the propagation process of the reflected light beam.

As shown in fig. 2, the hand securing module includes a strap 4, a button 5, a housing 6, a transmission structure (not shown in fig. 2), and a displacement table 7;

the binding band, the button, the shell and the transmission mechanism can realize the fastening of the parts such as fingers. Wherein, the binding belt directly contacts with fingers, one end is connected with the transmission device, and the other end can be fixed at the button; the button is pressed to pop up the binding belt from the base; the shell is used for placing a human hand and internally comprises a transmission device; the transmission device is arranged in the hand fixing module and is used for adjusting the tightness of the binding belt;

the displacement platform can realize three-dimensional movement of the hand fixing module in the horizontal plane and the vertical direction by adjusting the knob of the displacement platform. After the finger is fixed by the binding belt, the displacement table can be adjusted to find a position suitable for observing the microcirculation system.

The polarizer and the analyzer are designed to be pluggable, and are inserted when the orthogonal polarization hyperspectral imaging is needed, and pulled out when the hyperspectral imaging is needed in other modes. The light transmission axes of the polarizer and the analyzer are fixed, and the directions of the light transmission axes of the polarizer and the analyzer are mutually perpendicular.

As shown in fig. 5, the beam splitting unit 11 includes a bright field imaging sub-unit 20 and a dark field imaging sub-unit 21, and can be switched between a bright field imaging mode and a dark field imaging mode by moving the slide bar 22 left and right.

As shown in fig. 4, the imaging modules are a mirror 16, an achromatic wide field lens 17, a grayscale camera 18, a color camera 19, and a hyperspectral data transfer interface (not shown in fig. 4). The 45-degree placement of the reflecting mirror is responsible for turning the light path, and the whole equipment can be switched between a hyperspectral imaging mode and a common color video shooting mode by adjusting the position of the reflecting mirror. The reflecting mirror is moved out of the light path, and the reflected light is directly injected into the gray-scale camera, and is in a hyperspectral imaging mode at the moment; the reflecting mirror is moved into the light path, and the reflected light is turned by the reflecting mirror and is injected into the color camera, and the color camera is in a high-frame-rate common color video shooting mode. The hyperspectral data transmission interface is used for transmitting the microcirculation hyperspectral data and the high-frame-rate color video data and is connected with the data processing and display module.

The bright field imaging beam splitting sub-unit can be a flat beam splitter, a cube beam splitting prism, a thin film beam splitter or a two-phase color beam splitter, and can be replaced according to different application occasions.

As shown in fig. 6, the dark field imaging spectroscopic subunit includes a light transmissive tube 23, an annular mirror 24, and a dark field ring 25, and incident light rays and reflected light rays are indicated by the implementation arrows and dashed arrows in fig. 6, respectively.

The dark field ring is vertically arranged in an incident light path, and incident light rays are blocked by the center of the dark field ring and can only pass through the periphery of the dark field ring;

the light-transmitting cylinder axially passes through the annular reflecting mirror along the direction of the reflected light path, and reflected light passes through the light-transmitting cylinder from the inside to the imaging unit;

the annular reflector is placed at an angle of 45 degrees to the incident light path and the reflected light path, turning the incident light filtered by the dark field ring.

As shown in fig. 4, the grayscale camera and the color camera may be a CCD camera or a CMOS camera, and the two cameras may be operated in respective imaging modes by adjusting the positions of the mirrors, respectively. The specific selection can be comprehensively considered according to various camera performances such as price, camera quantum efficiency, frame rate, image resolution, target surface size and the like.

the display screen is an RGB display screen and is used for displaying color patterns or videos of the micro-circulation system, and the display screen is connected with a computer to receive RGB image data or video data of a color camera calculated by the computer according to hyperspectral data of the micro-circulation system;

the software unit is responsible for controlling parameters such as an LED circuit and a camera, processing hyperspectral data sent by the hyperspectral imaging module, converting the hyperspectral data into true color images by utilizing an algorithm, transmitting the true color images to a display screen for display, storing the hyperspectral data, the image data and the video data, assisting pathological diagnosis according to the hyperspectral data, calculating the blood oxygen saturation of a shooting part according to the spectrum information of the part, and the like, and integrating the hyperspectral data, the image data and the video data in the computer.

Examples

As shown in fig. 1, 2, 3 and 5, a hyperspectral microcirculation observer comprises a human hand fixing module 1, an imaging module 2 and a data processing and displaying module 3; the hand fixing module comprises a binding belt 4, a button 5, a shell 6 and a displacement table 7; the hyperspectral imaging module comprises uniform illumination units 8-9, a polarizer 10, a light splitting unit 11, an objective 12, an analyzer 14 and an imaging unit 15; wherein the light splitting unit comprises a bright field imaging sub-unit 20 and a dark field imaging sub-unit 21; the imaging units are a mirror 16, an achromatic wide field lens 17, a grayscale camera 18, a color camera 19 and a hyperspectral data transmission interface (not shown in fig. 4). In this embodiment, the bright field beam splitter unit is a flat beam splitter; the grayscale camera and the color camera are CMOS cameras.

According to the embodiment, the micro-circulation hyperspectral observation is realized in a common hyperspectral imaging mode, and the hyperspectral information acquisition of the micro-circulation system is realized by converting between different wave bands of the LEDs.

In this embodiment, parameters such as the conversion wavelength of the LED and the image resolution of the camera are controlled by the software module, the hyperspectral information of the microcirculation at the nail fold is continuously collected, and the object lens and the imaging unit are used for imaging, and the data processing and displaying module displays RGB images and videos, so that the method can be used for judging the health condition of the body and performing hyperspectral analysis on the microcirculation and the health condition of the body.

The implementation steps of this embodiment are as follows:

(1) placing the finger on the hand fixing module, and fastening the binding belt into the button to determine that the finger is fixed and the tightness is proper;

(2) pulling out a polarizer and an analyzer of the imaging module, and sliding a sliding rod of the light splitting module to enable a bright field imaging subunit to be positioned in a light path for bright field imaging;

(3) moving the reflecting mirror into the light path, working the color camera, observing the image on the display screen, screwing the XYZ three-axis knob of the displacement table until the image on the display screen displays the image of the proper microcirculation system, and storing the video of the microcirculation system;

(4) the reflector is moved out of the light path, the gray level camera works, and hyperspectral data of the microcirculation system are collected and stored;

(5) and closing software after the observation is finished, pressing a button of a hand fixing module to loosen the binding belt, and closing the hyperspectral microcirculation observer.

Examples

As shown in fig. 1, 2, 4 and 5, the hyperspectral microcirculation observer comprises a human hand fixing module 1, an imaging module 2 and a data processing and displaying module 3; the hand fixing module comprises a binding belt 4, a button 5, a shell 6 and a displacement table 7; the hyperspectral imaging module comprises uniform illumination units 8-9, a polarizer 10, a light splitting unit 11, an objective 12, an analyzer 14 and an imaging unit 15; wherein the light splitting unit comprises a bright field imaging sub-unit 20 and a dark field imaging sub-unit 21; the imaging units are a mirror 16, an achromatic wide field lens 17, a grayscale camera 18, a color camera 19 and a hyperspectral data transmission interface (not shown in fig. 4). In this embodiment, the bright field beam splitter unit is a cube beam splitter prism; the grayscale camera and the color are CCD cameras.

According to the embodiment, the hyperspectral observation of the microcirculation is realized in an orthogonal polarization hyperspectral imaging mode, useless image information outside the microcirculation system is filtered, and the hyperspectral information acquisition of the microcirculation system is realized by converting between different wave bands of the LEDs.

In the embodiment, parameters such as the conversion wavelength of the LED, the image resolution of the camera and the like are controlled through the software module, the hyperspectral information of microcirculation at the nail fold is continuously collected, the orthogonal polarization hyperspectral imaging mode is utilized to highlight the microcirculation system, the observation is convenient, the objective lens and the imaging unit are utilized to image, the data processing and displaying module displays RGB images and videos, and meanwhile, the hyperspectral technology is combined to judge the health condition of the body and conduct hyperspectral analysis on the microcirculation and the health condition of the body.

The implementation steps of this embodiment are as follows:

(2) inserting a polarizer and an analyzer of the imaging module, sliding a sliding rod of the light splitting module to enable a bright field imaging subunit to be positioned in a light path, and performing bright field imaging;

Examples

As shown in fig. 1, 2, 4, 5 and 6, a hyperspectral microcirculation observer comprises a human hand fixing module 1, an imaging module 2 and a data processing and displaying module; the hand fixing module comprises a binding belt 4, a button 5, a shell 6 and a displacement table 7; the hyperspectral imaging module comprises uniform illumination units 8-9, a polarizer 10, a light splitting unit 11, an objective 12, an analyzer 14 and an imaging unit 15; wherein the light splitting unit comprises a bright field imaging sub-unit 20 and a dark field imaging sub-unit 21; the imaging units are a mirror 16, an achromatic wide field lens 17, a grayscale camera 18, a color camera 19 and a hyperspectral data transmission interface (not shown in fig. 4). In this embodiment, the bright field light splitting subunit is a thin film spectroscope; the grayscale camera and the color camera are CMOS cameras.

According to the embodiment, the hyperspectral observation of the microcirculation is realized in a dark field hyperspectral imaging mode, the deeper situation of the microcirculation system can be observed in the mode, and the hyperspectral information acquisition of the microcirculation system is realized by converting between different wave bands of the LEDs.

In this embodiment, parameters such as the conversion wavelength of the LED and the image resolution of the camera are controlled by the software module, the hyperspectral information of the microcirculation at the nail fold is continuously collected, the dark field hyperspectral imaging mode is used for deep observation of the microcirculation system, the objective lens and the imaging unit are used for imaging, the data processing and displaying module displays RGB images and videos, and meanwhile, the hyperspectral technology is combined to determine the health condition and perform hyperspectral analysis on the microcirculation and the health condition.

The implementation steps of this embodiment are as follows:

(2) pulling out a polarizer and an analyzer of the imaging module, and sliding a sliding rod of the light splitting module to enable a dark field imaging subunit to be positioned in a light path for dark field imaging;

Claims

1. The utility model provides a hyperspectral microcirculation observation appearance which characterized in that: the hyperspectral imaging system comprises a human hand fixing module, a hyperspectral imaging module and a data processing and displaying module;

the hyperspectral imaging module comprises an incident light path and a reflecting light path, is used for imaging the nail fold, and can be a common bright-field hyperspectral imaging mode, a dark-field hyperspectral imaging mode or an orthogonal polarization hyperspectral imaging mode, and the different hyperspectral imaging modes can be manually switched;

2. A hyperspectral microcirculation observer as claimed in claim 1 wherein: the hyperspectral imaging module is provided with a multicolor LED light source, and the LED light source can be switched between LED lights in different wave bands through an LED control circuit. Switching between different bands of LED light is the primary means of the present invention to achieve hyperspectral measurements.

3. A hyperspectral microcirculation observer as claimed in claim 1 wherein: the hyperspectral imaging module comprises a uniform illumination unit, a polarizer, a beam splitting unit, an objective lens, an analyzer and an imaging unit.

4. A hyperspectral microcirculation observer as claimed in claim 1 wherein: the hand fixing module comprises a binding belt, a button, a shell, a transmission structure and a displacement table;

5. A hyperspectral microcirculation observer as claimed in claim 3 wherein: the polarizer and the analyzer are designed to be pluggable, and are inserted when the orthogonal polarization hyperspectral imaging is needed, and pulled out when the hyperspectral imaging is needed in other modes.

6. A hyperspectral microcirculation observer as claimed in claim 3 wherein: the light splitting unit comprises a bright field imaging light splitting sub-unit and a dark field imaging light splitting sub-unit.

7. A hyperspectral microcirculation observer as claimed in claim 3 wherein: the imaging module is a reflecting mirror, an achromatic wide field lens, a gray-scale camera, a color camera and a hyperspectral data transmission interface; adjusting the position of the mirror can switch the entire device between a hyperspectral imaging mode and a high frame rate normal color video capture mode. The hyperspectral data transmission interface is connected with the data processing and display module.

8. The hyperspectral microcirculation observer as claimed in claim 6, wherein: the bright field imaging photon-splitting unit can be a flat beam splitter, a cube beam splitter prism, a thin film spectroscope or a two-term color spectroscope.

9. The hyperspectral microcirculation observer as claimed in claim 6, wherein: the dark field imaging light splitting subunit comprises a light transmission barrel, an annular reflecting mirror and a dark field ring;

the dark field ring is vertically arranged in an incident light path;

10. A hyperspectral microcirculation observer as claimed in claim 1 wherein: the data processing and displaying module comprises a display screen, a computer and a software unit;