WO2023273014A1 - Medical imaging device - Google Patents

Medical imaging device Download PDF

Info

Publication number
WO2023273014A1
WO2023273014A1 PCT/CN2021/123838 CN2021123838W WO2023273014A1 WO 2023273014 A1 WO2023273014 A1 WO 2023273014A1 CN 2021123838 W CN2021123838 W CN 2021123838W WO 2023273014 A1 WO2023273014 A1 WO 2023273014A1
Authority
WO
WIPO (PCT)
Prior art keywords
tissue
infrared camera
infrared
camera
visible light
Prior art date
Application number
PCT/CN2021/123838
Other languages
French (fr)
Chinese (zh)
Inventor
汪远
赵可为
周丰茂
Original Assignee
南京微纳科技研究院有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from CN202110725651.7A external-priority patent/CN115530995A/en
Priority claimed from CN202121462098.4U external-priority patent/CN215606349U/en
Application filed by 南京微纳科技研究院有限公司 filed Critical 南京微纳科技研究院有限公司
Publication of WO2023273014A1 publication Critical patent/WO2023273014A1/en

Links

Images

Classifications

    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B90/00Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups A61B1/00 - A61B50/00, e.g. for luxation treatment or for protecting wound edges

Definitions

  • the invention relates to the technical field of medical equipment, in particular to a medical imaging device.
  • Existing medical imaging devices generally include near-infrared photosensitive elements, and images of objects in lesions and organs are acquired through the near-infrared photosensitive elements.
  • fluorescent markers are injected into the human body, so that the fluorescent markers are gathered in the target in the lesion organ, and the two-dimensional fluorescent image of the target can be obtained by using the near-infrared photosensitive element through the fluorescence imaging technology, to assist the doctor in the target detection. operations such as tumor resection.
  • the above-mentioned existing medical imaging devices cannot detect the three-dimensional shape of the target object, which is not conducive to the observation of the target object by the doctor, and the effect of assisting the doctor in surgery is relatively poor.
  • the embodiment of the present application provides a medical imaging device, which can perform three-dimensional shape detection of the target object in the tissue to be measured, and has a better effect on assisting doctors in surgery.
  • the present application provides a medical imaging device, including a display component, a near-infrared camera component, a visible light camera and a processing terminal, the display component includes a first display terminal and a second display terminal, and the near-infrared camera component includes a first near-infrared camera component.
  • the infrared camera and the second near-infrared camera, the first display terminal and the second display terminal, the first near-infrared camera and the second near-infrared camera, and the visible light camera are all electrically connected to the processing terminal;
  • the visible light camera is used to acquire the visible light image of the tissue to be tested, and the first near-infrared camera and the second near-infrared camera are both used to acquire the fluorescence image of the target in the tissue to be tested;
  • the first display terminal is used to display the tissue image of the tissue to be measured, wherein the tissue image is used to display the position of the target object on the tissue to be measured, and the tissue image is based on the visible light image of the tissue to be measured and the first near-infrared camera Acquired fluorescence image generation;
  • the second display terminal is used to display the three-dimensional image of the target object, and the three-dimensional image is generated according to the fluorescent image acquired by the first near-infrared camera and the fluorescent image acquired by the second near-infrared camera.
  • the first near-infrared camera and the second near-infrared camera are arranged adjacently, and the imaging areas of the first near-infrared camera and the second near-infrared camera have an overlapping area, and the tissue body to be measured is located in the overlapping area. within the area.
  • a dichroic mirror is also included, the dichroic mirror is located between the first near-infrared camera and the tissue to be measured, and is used to transmit the fluorescence from the target to the first near-infrared camera ;
  • the visible light camera is located on the side of the dichroic mirror, and the dichroic mirror is also used to reflect the visible light from the tissue to be measured to the visible light camera.
  • the first near-infrared camera includes a first near-infrared lens
  • the visible light camera includes a visible light lens
  • an optical axis of the first near-infrared lens is perpendicular to an optical axis of the visible light lens.
  • it also includes a first near-infrared filter element, the first near-infrared filter element is arranged on the side of the first near-infrared lens facing the tissue to be measured; and/or the medical imaging device also A visible light filter element is included, and the visible light filter element is arranged on the side of the visible light lens facing the tissue body to be measured.
  • the second near-infrared camera includes a second near-infrared lens, and the second near-infrared lens is directed toward the tissue to be measured, so as to receive fluorescence from the tissue to be measured.
  • a second near-infrared filter element is also included, and the second near-infrared filter element is arranged on a side of the second near-infrared lens facing the tissue to be measured.
  • a distance measuring component is also included, and the distance measuring component is used to detect the working distance between the tissue to be measured and the distance measuring component.
  • the positions of the distance measuring component, the near-infrared camera component and the visible light camera are relatively fixed, and both the near-infrared camera component and the visible light camera perform focus adjustment according to the working distance between the tissue to be measured and the distance measuring component.
  • it also includes a first mounting bracket and a second mounting bracket, the first near-infrared camera and the visible light camera are set on the first mounting bracket, and the second near-infrared camera is set on the second mounting bracket .
  • the ranging component includes a first ranging sensor and a second ranging sensor, and the first ranging sensor and the second ranging sensor are placed in the first mounting bracket and the second mounting bracket respectively ;
  • the first ranging sensor is used to detect the first working distance between the tissue to be measured and the first ranging sensor;
  • the second ranging sensor is used to detect the second working distance between the tissue to be measured and the second ranging sensor;
  • the processing terminal is used to adjust the focus of the first near-infrared camera and the visible light camera according to the first working distance; and/or the processing terminal is used to adjust the focus of the second near-infrared camera according to the second working distance.
  • an excitation light source is also included, and the exit end of the excitation light source faces the tissue body to be measured, so that the excitation light beam generated by the excitation light source is transmitted to the tissue body to be measured.
  • an indicating light source is further included, and the indicating light source emits indicating light to the tissue body to be measured, and the indicating light is used to mark the target irradiation area of the excitation light beam.
  • the excitation light source includes a uniform light component, which is used to uniformly process the excitation light beam emitted by the excitation light source.
  • the excitation light beam emitted by the excitation light source has a wavelength of 700nm-800nm.
  • the power of the excitation light source is adjustable, and the power adjustment range of the excitation light source is 1mW-1000mW
  • the wavelength of near-infrared fluorescence excited by the tissue to be measured is 820nm-1700nm.
  • the medical imaging device of the present application includes a display component, a near-infrared camera component, a visible light camera, and a processing terminal, the display component includes a first display terminal and a second display terminal, and the near-infrared camera component includes a first near-infrared camera and a second near-infrared camera
  • the visible light camera is used to obtain the visible light image of the tissue to be tested, and the first near-infrared camera and the second near-infrared camera are both used to obtain the fluorescence image of the target object in the tissue to be tested
  • the first display terminal is used to display the tissue to be tested A tissue image of the body, wherein the tissue image is used to display the position of the target object on the tissue to be measured, and the tissue image is generated according to the visible light image of the tissue to be measured and the fluorescence image acquired by the first near-infrared camera
  • the second display terminal The three-dimensional image is used to display the target object, and the three-dimensional image is generated according to
  • the first near-infrared camera and the visible light camera are set to respectively acquire the fluorescence image of the target object in the tissue to be measured and the visible light image of the tissue to be measured, and display the tissue to be measured on the first display terminal.
  • the three-dimensional image of the target object in the tissue to be tested is displayed on the upper surface, that is, the shape of the target object is acquired in real time by a near-infrared binocular vision device formed by the cooperation of the second near-infrared camera and the first near-infrared camera.
  • the medical imaging device in the above solution can obtain the position of the target object in the tissue to be measured and the three-dimensional information of the target object, and visually display the relative position and shape of the target object and the tissue to be measured in real time on the display component , It is better for doctors to assist in surgery.
  • FIG. 1 is a schematic structural diagram of a medical imaging device provided by an embodiment of the present application.
  • FIG. 2 is a schematic diagram of a structure of a medical imaging device provided by an embodiment of the present application.
  • Fig. 3 is a schematic diagram of another structure of a medical imaging device provided by an embodiment of the present application.
  • 100-medical imaging device 10-display component; 11-first display terminal; 12-second display terminal; 21-first near-infrared camera; 211-first near-infrared lens; 212-first near-infrared photosensitive element; 213-the first near-infrared filter element; 22-the second near-infrared camera; 221-the second near-infrared lens; 222-the second near-infrared photosensitive element; 223-the second near-infrared filter element; 30-visible light camera; 301-visible light lens; 302-visible light photosensitive element; 303-visible light filter element; 40-processing terminal; 50-excitation light source; 60-dichroic mirror; - the second distance measuring sensor; 73 - the third distance measuring sensor; 80 - the housing; 81 - the first mounting bracket; 82 - the second mounting bracket; 90 - the tissue to be measured; 91 - the target.
  • Medical imaging technology generally uses near-infrared fluorescence to irradiate the tissue to be tested, and uses near-infrared photosensitive elements to obtain fluorescent images of the target in the tissue to be measured to determine the position of the target and help surgeons to remove the target, such as a tumor.
  • the fluorescent image acquired by the near-infrared photosensitive element cannot display the specific shape of the target object, which is not intuitive enough, and is not effective in assisting doctors.
  • the medical imaging device of the present application acquires the images of the tissue to be measured and the target by setting the first near-infrared camera, the second near-infrared camera, and the visible light camera, so that the position of the target in the tissue to be measured and the position of the target can be determined.
  • the three-dimensional specific shape is detected, so as to intuitively guide the doctor to perform the target resection operation and reduce the difficulty of the operation.
  • the near-infrared camera mentioned in this application refers to a near-infrared camera
  • near-infrared light is an electromagnetic wave between visible light (VI) and mid-infrared light (MIR).
  • VI visible light
  • MIR mid-infrared light
  • ASTM American Society for Testing and Materials Testing
  • FIG. 1 is a schematic structural diagram of a medical imaging device provided by an embodiment of the present application.
  • the medical imaging device 100 of the present application includes a display assembly 10, a near-infrared camera assembly, a visible light camera 30 and a processing terminal 40
  • the display assembly 10 includes a first display terminal 11 and a second display terminal 12
  • the near-infrared camera assembly includes The first near-infrared camera 21 and the second near-infrared camera 22, the first display terminal 11 and the second display terminal 12, the first near-infrared camera 21 and the second near-infrared camera 22, and the visible light camera 30 are all electrically connected to the processing terminal 40 connect;
  • the visible light camera 30 is used to acquire the visible light image of the tissue body 90 to be tested, and the first near-infrared camera 21 and the second near-infrared camera 22 are both used to acquire the fluorescence image of the target object 91 in the tissue body 90 to be tested;
  • the first display terminal 11 is used to display the tissue image of the tissue body 90 to be measured, wherein the tissue image is used to display the position of the target object 91 on the tissue body 90 to be measured, and the tissue image is based on the visible light image of the tissue body 90 to be measured and Generation of fluorescence images acquired by the first near-infrared camera 21;
  • the second display terminal 12 is used to display the three-dimensional image of the target object 91 , and the three-dimensional image is generated according to the fluorescent image acquired by the first near-infrared camera 21 and the fluorescent image acquired by the second near-infrared camera 22 .
  • the fluorescence image of the target object 91 in the tissue body 90 to be measured and the visible light image of the tissue body 90 to be measured are acquired respectively, and displayed on the first display terminal 11 displays the tissue image of the tissue body 90 to be measured, so as to obtain the position of the target object 91 on the tissue body 90 to be measured;
  • Another fluorescent image of the target object 91 in the tissue body 90 to be tested is displayed on the second display terminal 12, that is, the near-infrared image formed by the cooperation of the second near-infrared camera 22 and the first near-infrared camera 21 is used.
  • the binocular vision device acquires the three-dimensional information on the surface of the target object 91 in real time.
  • the medical imaging device 100 in the above scheme can obtain the position of the target object 91 in the tissue body 90 to be measured, as well as the three-dimensional information of the target object 91, and compare the relative position and shape of the target object 91 and the tissue body 90 to be measured in real time.
  • Visually displayed in the display unit 10 it has a better effect on assisting doctors in surgery.
  • the process of obtaining a three-dimensional image by using the first near-infrared camera 21 and the second near-infrared camera 22 is well known to those skilled in the art, and will not be repeated here.
  • the visible light camera 30 is used to acquire the visible light image of the tissue body 90 to be tested. Visible light image of organoid 90 .
  • Both the first near-infrared camera 21 and the second near-infrared camera 22 are used to acquire fluorescence images of the target object 91 in the tissue body 90 to be tested.
  • a medical fluorescent probe substance such as indocyanine green (Indocyanine green, ICG)
  • ICG indocyanine green
  • the fluorescent probe substance will be at the target object 91 of the tissue body 90 to be tested. , such as the accumulation at the site of a tumor.
  • the medical imaging system may also include an excitation light source 50, the exit end of the excitation light source 50 is directed towards the tissue body 90 to be measured, so that the excitation light beam generated by the excitation light source 50 is irradiated on the tissue body 90 to be measured, and the target object 91 Fluorescent imaging.
  • the excitation light beam generated by the excitation light source 50 irradiates the tissue body 90 to be tested, the aggregated fluorescent probe substances will be excited to generate fluorescence.
  • both the first near-infrared camera 21 and the second near-infrared camera 22 obtain fluorescence images of the target object 91 .
  • the first near-infrared camera 21 and the visible light camera 30 are electrically connected to the processing terminal 40, so that the processing terminal 40 receives the fluorescence image of the target object 91 sent by the first near-infrared camera 21, and receives the visible light image sent by the visible light camera 30, and
  • the fluorescence image of the target object 91 and the visible light image of the tissue to be tested 90 are superimposed and fused to obtain a tissue image of the tissue to be tested 90 , that is, an image including both the tissue to be tested 90 and the target 91 therein is obtained.
  • the tissue image is used to display the position of the target object 91 on the tissue body 90 to be measured.
  • the first display terminal 11 is used to display the tissue image of the tissue to be measured 90 , and the user can intuitively acquire the position of the target object 91 on the tissue to be measured 90 by viewing the tissue image.
  • the specific way of superimposing and fusing the fluorescent image of the target object 91 and the visible light image of the tissue body 90 to be tested may be to directly process the fluorescent image of the target object 91 and superimpose it on the tissue body 90 to be tested with a specific color.
  • a tissue image of the tissue body 90 to be tested is obtained, and the tissue image shows the position of the target object 91 on the tissue body 90 to be tested, for example, a distribution image of a tumor in a lesion organ.
  • the second near-infrared camera 22 is also electrically connected to the processing terminal 40, so that the processing terminal 40 receives the fluorescence image of the target object 91 sent by the second near-infrared camera 22, and combines the first near-infrared camera 21
  • the transmitted fluorescent image of the target object 91 generates a three-dimensional stereoscopic infrared image of the target object 91 .
  • the process of generating a three-dimensional image of the target object 91 according to the first near-infrared camera 21 and the second near-infrared camera 22, that is, binocular vision near-infrared imaging technology can obtain the specific shape of the target object 91 and the surface height of the target object 91 information, that is, to complete the three-dimensional detection of the target object 91 .
  • the second display terminal 12 is used to display the three-dimensional image of the target object 91 .
  • the user sees the three-dimensional image he can intuitively obtain the specific shape of the target object 91.
  • the information of the target object 91 can be accurately obtained in real time, which improves the intuitiveness of the operation and reduces the need for doctors.
  • the operation time is improved, and the efficiency of the operation is improved.
  • the first near-infrared camera 21 and the second near-infrared camera 22 are arranged adjacently, that is, the first near-infrared camera 21 and the second near-infrared camera 22 can be arranged in the same installation structure, or can be arranged separately in two mounting structures.
  • the imaging areas of the first near-infrared camera 21 and the second near-infrared camera 22 have an overlapping area, and the tissue body 90 to be tested can be located in the overlapping area, which can ensure the completion of binocular vision imaging.
  • the setting parameters of the first near-infrared camera 21 and the second near-infrared camera 22 may be the same.
  • the medical imaging device further includes a dichroic mirror 60, which is a passive device and does not require external energy, as long as there is input light.
  • the dichroic mirror 60 can separate the light source into a specific spectrum and change the light path direction of part of the spectrum, and can almost completely transmit certain wavelengths of light, while almost completely reflecting other wavelengths of light.
  • the dichroic mirror 60 is located between the first near-infrared camera 21 and the tissue body 90 to be measured, and is used to transmit the fluorescence from the target object 91 to the first near-infrared camera along the optical path A.
  • the camera 21 and the visible light camera 30 are located on the side of the dichroic mirror 60 , and the dichroic mirror 60 is also used to reflect the visible light from the tissue body 90 to be measured to the visible light camera 30 along the optical path B. In this way, the first near-infrared camera 21 and the visible light camera 30 can actually share part of the optical path.
  • the first near-infrared camera 21 includes a first near-infrared lens 211
  • the visible light camera 30 includes a visible light lens 301.
  • the optical axis of the first near-infrared lens 211 is perpendicular to the optical axis of the visible light lens 301.
  • the reflection angle of the dichroic mirror 60 can be set to 45°.
  • the first near-infrared camera 21 also includes a first near-infrared photosensitive element 212, and correspondingly, the medical imaging device 100 may include a first near-infrared filter element 213, and the first near-infrared lens 211 is located between the first near-infrared photosensitive element 212 and Between the first near-infrared filter elements 213 , the first near-infrared filter elements 213 are disposed on the side of the first near-infrared lens 211 facing the tissue body 90 to be measured.
  • the visible light camera 30 includes a visible light photosensitive element 302 and a visible light lens 301.
  • the medical imaging device 100 may include a visible light filter element 303.
  • the visible light lens 301 is located between the visible light photosensitive element 302 and the visible light filter element 303.
  • the visible light filter The element 303 is disposed on a side of the visible light lens 301 facing the tissue body 90 to be measured.
  • the second near-infrared camera 22 may include a second near-infrared photosensitive element 222 and a second near-infrared lens 221, and correspondingly, the medical imaging device 100 may include a second near-infrared filter element 223, and the second near-infrared lens 221 is located at Between the second near-infrared photosensitive element 222 and the second near-infrared filter element 223 , the second near-infrared filter element 223 is disposed on the side of the second near-infrared lens 221 facing the tissue body 90 to be measured. And the second near-infrared lens 221 faces the tissue to be measured to receive the fluorescence from the tissue to be measured. It should be noted that here the second near-infrared camera 22 directly acquires the fluorescence image of the tumor without passing through the dichroic mirror 60 .
  • the first near-infrared filter element 213 , the second near-infrared filter element 223 and the visible light filter element 303 may be filters, for example.
  • the first near-infrared filter element 213 and the second near-infrared filter element 223 can block light other than infrared light such as visible light, and only allow infrared light to pass through.
  • both the first near-infrared filter element 213 and the second near-infrared filter element 223 only allow infrared rays with a wavelength range of 820nm-1700nm to pass through, thereby filtering the excitation beam and visible light reflected by the tissue body 90 to be measured.
  • the wavelength range of light allowed by the first near-infrared filter element 213 and the second near-infrared filter element 223 is 820nm-1700nm, the penetration depth is large, therefore, the fluorescence image of the target object 91 with a high signal-to-noise ratio can be obtained . In practical applications, it can be used to visualize human lymph, blood vessels, etc. and monitor the perfusion of related tissues.
  • the first near-infrared photosensitive element 212, the second near-infrared photosensitive element 222 and the visible light photosensitive element 302 may all include a charge coupled device (Charge Coupled Device, referred to as CCD) and a metal oxide semiconductor element (Complementary Metal- Oxide Semiconductor, referred to as CMOS).
  • CCD Charge Coupled Device
  • CMOS Complementary Metal- Oxide Semiconductor
  • the number of the first near-infrared photosensitive element 212 and the second near-infrared photosensitive element 222 can be one or more. , to get different image information.
  • the medical imaging device 100 includes an excitation light source 50 for emitting an excitation light beam to the tissue body 90 to be measured.
  • the excitation light beam emitted by the excitation light source 50 has a wavelength of 700nm-800nm.
  • the wavelength of the fluorescence emitted by the tissue to be tested is in the near-infrared region, while in the present invention, the wavelength of the near-infrared fluorescence emitted by the tissue to be tested is 820nm-1700nm, That is to say, the light in the second near-infrared region can detect the target object 91 at a deeper depth under the infrared light of this frequency band, which is more conducive to the detection of the deeper target object 91 .
  • the power of the excitation light source 50 is adjustable, and the adjustable range is 1mW-1000mW. It can be understood that the excitation light source 50 is a semiconductor laser with adjustable power, which can help the device realize the detection of small tumors under its high luminous power; but The application is not limited to this adjustment range.
  • the medical imaging device 100 further includes an indication light source, which emits indication light to the tissue body 90 to be measured, and the indication light is used to mark the target irradiation area of the excitation beam.
  • the indicating light source is used to indicate the projected position of the exciting beam, and is used for outline during operation.
  • the excitation light source 50 may include a light homogenization component, which is used to uniformly process the excitation light beam emitted by the excitation light source 50 . That is, the homogenization module is used to make the intensity distribution of the light spot irradiated by the excitation light source 50 on the surface of the tissue body 90 to be measured more uniform.
  • the medical imaging device 100 may further include a distance measuring component 70 for detecting the working distance between the tissue body 90 to be measured and the distance measuring component 70 .
  • the positions of the distance measuring component 70 , the near-infrared camera component and the visible light camera 30 are relatively fixed, and both the near-infrared camera component and the visible light camera 30 perform focus adjustment according to the working distance between the tissue object 90 to be measured and the distance measuring component 70 .
  • the distance measuring assembly 70 can measure the working distance between the tissue to be measured 90 and the distance measuring assembly 70, the first approximation The distance between the infrared camera 21 and the tissue body 90 to be measured, the distance between the second near-infrared camera 22 and the tissue body 90 to be measured, and the distance between the visible light camera 30 and the tissue body 90 to be measured.
  • the focus of the first near-infrared lens 211 can be adjusted according to the distance between the first near-infrared camera 21 and the tissue body 90 to be measured until the image is clearest.
  • the second near-infrared lens 221 can focus according to the distance between the second near-infrared camera 22 and the tissue to be measured 90 until its imaging is clearest; Focus at a distance of 90 until the image is clearest.
  • both the first ranging sensor 71 and the second ranging sensor 72 are connected to the processor 40, and the processing terminal 40 is used to adjust the focus of the first near-infrared camera 21 and the visible light camera 30 according to the first working distance; and /or, the processing terminal 40 is used to adjust the focus of the second near-infrared camera 22 according to the second working distance.
  • FIG. 2 is a schematic diagram of a structure of a medical imaging device provided by an embodiment of the present application
  • FIG. 3 is a schematic diagram of another structure of a medical imaging device provided by an embodiment of the present application.
  • the first near-infrared camera 21 and the second near-infrared camera 22 may be arranged in the same installation structure, or may be arranged in two installation structures respectively.
  • the first near-infrared camera 21, the second near-infrared camera 22 and the visible light camera 30 can be arranged in the same installation structure, for example, the medical imaging device 100 includes a housing 80, the first A near-infrared camera 21 , a second near-infrared camera 22 , and a visible light camera 30 are all arranged in the casing 80 .
  • the ranging component 70 may include a third ranging sensor 73 , and the third ranging sensor 73 may be disposed on the exciting light source 50 .
  • the first distance measuring sensor, the second distance measuring sensor, and the third distance measuring sensor may use a laser distance meter, for example.
  • the medical imaging device 100 includes a first mounting bracket 81 and a second mounting bracket 82, the first near-infrared camera 21 and the visible light camera 30 are arranged on the first mounting bracket 81, The second near-infrared camera 22 is arranged on the second mounting bracket.
  • the ranging component 70 includes a first ranging sensor 71 and a second ranging sensor 72, the first ranging sensor 71 is used to detect the first working distance between the tissue object 90 to be measured and the first ranging sensor 71
  • the second ranging sensor 72 is used to detect the second working distance between the tissue body 90 to be measured and the second ranging sensor 72; the first near-infrared camera 21 and the visible light camera 30 are used for focusing according to the first working distance, and the second Two near-infrared cameras 22 are used for focusing according to the second working distance.
  • the position of the ranging component 70 will be described in detail below with reference to FIGS. 2 and 3 .
  • the first near-infrared camera 21, the second near-infrared camera 22, and the visible light camera 30 are fixed relative to the housing 80, and the distance-measuring component includes only one distance-measuring sensor, that is, the third distance-measuring sensor.
  • the distance sensor 73, the third distance sensor can be arranged on the excitation light source 50.
  • the ranging component 70 includes a first ranging sensor 71 and a second ranging sensor 72, and the first near-infrared camera 21 and the visible light camera 30 are relatively fixed to the first mounting bracket 81.
  • the ranging component is the second ranging sensor 72 .
  • first ranging sensor 71 and the second ranging sensor 72 are respectively placed in the first mounting bracket 81 and the second mounting bracket 82; that is, the first ranging sensor 71 can be installed on the first mounting bracket 81, and the second The ranging sensor 72 may be mounted on a second mounting bracket 82 .
  • the medical imaging device of the present application includes a display component, a near-infrared camera component, a visible light camera, and a processing terminal. Measuring the fluorescent image of the target in the tissue; the first display terminal is used to display the tissue image of the tissue to be measured, wherein the tissue image is used to display the position of the target on the tissue to be measured, and the tissue image is based on the tissue to be measured. The visible light image of the object and the fluorescence image acquired by the first near-infrared camera are generated; the second display terminal is used to display the three-dimensional image of the target object, and the three-dimensional image is based on the fluorescence image acquired by the first near-infrared camera and the fluorescence image acquired by the second near-infrared camera.
  • the first near-infrared camera and the visible light camera are set to respectively acquire the fluorescence image of the target object in the tissue to be measured and the visible light image of the tissue to be measured, and display the tissue to be measured on the first display terminal.
  • the three-dimensional image of the target object in the tissue to be tested is displayed on the upper surface, that is, the shape of the target object is acquired in real time by a near-infrared binocular vision device formed by the cooperation of the second near-infrared camera and the first near-infrared camera.
  • the medical imaging device in the above solution can obtain the position of the target object in the tissue to be measured and the three-dimensional information of the target object, and visually display the relative position and shape of the target object and the tissue to be measured in real time on the display component , It is better for doctors to assist in surgery.
  • connection should be understood in a broad sense, for example, it can be fixedly connected, or it can be connected through the middle
  • the media is indirectly connected, which can be the internal communication of two elements or the interaction relationship between two elements.

Landscapes

  • Health & Medical Sciences (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Surgery (AREA)
  • Medical Informatics (AREA)
  • Public Health (AREA)
  • Engineering & Computer Science (AREA)
  • Biomedical Technology (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Veterinary Medicine (AREA)
  • Molecular Biology (AREA)
  • Pathology (AREA)
  • Animal Behavior & Ethology (AREA)
  • General Health & Medical Sciences (AREA)
  • Biophysics (AREA)
  • Physics & Mathematics (AREA)
  • Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
  • Oral & Maxillofacial Surgery (AREA)
  • Endoscopes (AREA)

Abstract

A medical imaging device (100), comprising a display assembly (10), a near-infrared camera assembly, a visible light camera (30), and a processing terminal (40). The display assembly (10) comprises a first display terminal (11) and a second display terminal (12). The near-infrared camera assembly comprises a first near-infrared camera (21) and a second near-infrared camera (22). The visible light camera (30) is used for obtaining a visible light image of a tissue body to be tested (90). The first near-infrared camera (21) and the second near-infrared camera (22) are both used for obtaining a fluorescence image of a target object (91) in said tissue body (90). The first display terminal (11) is used for displaying a tissue image of said tissue body (90). The tissue image is used for displaying the position of the target object (91) on said tissue body (90). The second display terminal (12) is used for displaying a three-dimensional image of the target object (91). According to the medical imaging device (100), three-dimensional shape detection can be performed on the target object (91) in said tissue body (90), the target object (91) can be observed in real time, and the operation assisting effect on doctors is good.

Description

医学成像装置medical imaging device
本申请要求于2021年06月29日提交中国专利局、申请号为202110725651.7、申请名称为“医学成像装置”的中国专利申请的优先权,以及要求于2021年06月29日提交中国专利局、申请号为202121462098.4、申请名称为“医学成像装置”的中国专利申请的优先权,其全部内容通过引用结合在本申请中。This application claims the priority of the Chinese patent application with the application number 202110725651.7 and the application name "Medical Imaging Device" submitted to the China Patent Office on June 29, 2021, and the request to submit to the China Patent Office on June 29, 2021, The priority of the Chinese patent application with the application number 202121462098.4 and the application name "medical imaging device", the entire content of which is incorporated in this application by reference.
技术领域technical field
本发明涉及医疗设备技术领域,尤其涉及一种医学成像装置。The invention relates to the technical field of medical equipment, in particular to a medical imaging device.
背景技术Background technique
随着科技的发展,现代医学的外科手术中,经常需要利用医学成像技术对病变组织进行成像,以辅助手术切除过程的技术。With the development of science and technology, in modern medical surgery, it is often necessary to use medical imaging technology to image diseased tissue to assist the surgical resection process.
现有的医学成像装置一般包括近红外感光元件,通过近红外感光元件进行病灶器官中目标物图像的获取。具体的,向人体注射荧光标记物,使荧光标记物聚集在病灶器官中的目标物中,并可通过荧光显影技术,利用近红外感光元件获取目标物的二维荧光图像,来辅助医生进行目标物、例如肿瘤切除的操作。Existing medical imaging devices generally include near-infrared photosensitive elements, and images of objects in lesions and organs are acquired through the near-infrared photosensitive elements. Specifically, fluorescent markers are injected into the human body, so that the fluorescent markers are gathered in the target in the lesion organ, and the two-dimensional fluorescent image of the target can be obtained by using the near-infrared photosensitive element through the fluorescence imaging technology, to assist the doctor in the target detection. operations such as tumor resection.
然而,上述现有的医学成像装置并不能对目标物进行三维形态检测,不利于医生进行目标物的观察,对医生的手术辅助效果较差。However, the above-mentioned existing medical imaging devices cannot detect the three-dimensional shape of the target object, which is not conducive to the observation of the target object by the doctor, and the effect of assisting the doctor in surgery is relatively poor.
发明内容Contents of the invention
鉴于上述问题,本申请实施例提供一种医学成像装置,能够对待测组织体中的目标物进行三维形态检测,对医生的手术辅助效果较佳。In view of the above problems, the embodiment of the present application provides a medical imaging device, which can perform three-dimensional shape detection of the target object in the tissue to be measured, and has a better effect on assisting doctors in surgery.
为了实现上述目的,本申请提供一种医学成像装置,包括显示组件、近红外相机组件、可见光相机以及处理终端,显示组件包括第一显示终端和第二显示终端,近红外相机组件包括第一近红外相机和第二近红外相机,第一显示终端和第二显示终端、第一近红外相机和第二近红外相机、以及可见光 相机均与处理终端电连接;In order to achieve the above purpose, the present application provides a medical imaging device, including a display component, a near-infrared camera component, a visible light camera and a processing terminal, the display component includes a first display terminal and a second display terminal, and the near-infrared camera component includes a first near-infrared camera component. The infrared camera and the second near-infrared camera, the first display terminal and the second display terminal, the first near-infrared camera and the second near-infrared camera, and the visible light camera are all electrically connected to the processing terminal;
可见光相机用于获取待测组织体的可见光图像,第一近红外相机和第二近红外相机均用于获取待测组织体中目标物的荧光图像;The visible light camera is used to acquire the visible light image of the tissue to be tested, and the first near-infrared camera and the second near-infrared camera are both used to acquire the fluorescence image of the target in the tissue to be tested;
第一显示终端用于显示待测组织体的组织图像,其中,组织图像用于显示目标物在待测组织体上的位置,且组织图像根据待测组织体的可见光图像和第一近红外相机获取的荧光图像生成;The first display terminal is used to display the tissue image of the tissue to be measured, wherein the tissue image is used to display the position of the target object on the tissue to be measured, and the tissue image is based on the visible light image of the tissue to be measured and the first near-infrared camera Acquired fluorescence image generation;
第二显示终端用于显示目标物的三维图像,三维图像根据第一近红外相机的获取的荧光图像和第二近红外相机获取的荧光图像生成。The second display terminal is used to display the three-dimensional image of the target object, and the three-dimensional image is generated according to the fluorescent image acquired by the first near-infrared camera and the fluorescent image acquired by the second near-infrared camera.
在一种可选的实施方式中,第一近红外相机和第二近红外相机相邻设置,且第一近红外相机和第二近红外相机的成像区域具有重叠区域,待测组织体位于重叠区域内。In an optional embodiment, the first near-infrared camera and the second near-infrared camera are arranged adjacently, and the imaging areas of the first near-infrared camera and the second near-infrared camera have an overlapping area, and the tissue body to be measured is located in the overlapping area. within the area.
在一种可选的实施方式中,还包括二向色镜,二向色镜位于第一近红外相机和待测组织体之间,并用于使来自目标物的荧光透射至第一近红外相机;In an optional embodiment, a dichroic mirror is also included, the dichroic mirror is located between the first near-infrared camera and the tissue to be measured, and is used to transmit the fluorescence from the target to the first near-infrared camera ;
可见光相机位于二向色镜侧方,二向色镜还用于使来自待测组织体的可见光反射至可见光相机。The visible light camera is located on the side of the dichroic mirror, and the dichroic mirror is also used to reflect the visible light from the tissue to be measured to the visible light camera.
在一种可选的实施方式中,第一近红外相机包括第一近红外镜头,可见光相机包括可见光镜头,第一近红外镜头的光轴和可见光镜头的光轴垂直。In an optional implementation manner, the first near-infrared camera includes a first near-infrared lens, the visible light camera includes a visible light lens, and an optical axis of the first near-infrared lens is perpendicular to an optical axis of the visible light lens.
在一种可选的实施方式中,还包括第一近红外滤光元件,第一近红外滤光元件设置于第一近红外镜头朝向待测组织体的一侧;和/或医学成像装置还包括可见光滤光元件,可见光滤光元件设置于可见光镜头朝向待测组织体的一侧。In an optional embodiment, it also includes a first near-infrared filter element, the first near-infrared filter element is arranged on the side of the first near-infrared lens facing the tissue to be measured; and/or the medical imaging device also A visible light filter element is included, and the visible light filter element is arranged on the side of the visible light lens facing the tissue body to be measured.
在一种可选的实施方式中,第二近红外相机包括第二近红外镜头,第二近红外镜头朝向待测组织体,以接收来自待测组织体的荧光。In an optional embodiment, the second near-infrared camera includes a second near-infrared lens, and the second near-infrared lens is directed toward the tissue to be measured, so as to receive fluorescence from the tissue to be measured.
在一种可选的实施方式中,还包括第二近红外滤光元件,第二近红外滤光元件设置于第二近红外镜头朝向待测组织体的一侧。In an optional embodiment, a second near-infrared filter element is also included, and the second near-infrared filter element is arranged on a side of the second near-infrared lens facing the tissue to be measured.
在一种可选的实施方式中,还包括测距组件,测距组件用于检测待测组织体与测距组件的工作距离。In an optional embodiment, a distance measuring component is also included, and the distance measuring component is used to detect the working distance between the tissue to be measured and the distance measuring component.
在一种可选的实施方式中,测距组件与近红外相机组件、可见光相机的位置相对固定,近红外相机组件和可见光相机均根据待测组织体与测距组件的工作距离进行调焦。In an optional embodiment, the positions of the distance measuring component, the near-infrared camera component and the visible light camera are relatively fixed, and both the near-infrared camera component and the visible light camera perform focus adjustment according to the working distance between the tissue to be measured and the distance measuring component.
在一种可选的实施方式中,还包括第一安装支架和第二安装支架,第一 近红外相机和可见光相机设置在第一安装支架上,第二近红外相机设置在第二安装支架上。In an optional embodiment, it also includes a first mounting bracket and a second mounting bracket, the first near-infrared camera and the visible light camera are set on the first mounting bracket, and the second near-infrared camera is set on the second mounting bracket .
在一种可选的实施方式中,测距组件包括第一测距传感器和第二测距传感器,第一测距传感器和第二测距传感器分别置于第一安装支架和第二安装支架内;第一测距传感器用于检测待测组织体与第一测距传感器的第一工作距离;第二测距传感器用于检测待测组织体与第二测距传感器的第二工作距离;In an optional embodiment, the ranging component includes a first ranging sensor and a second ranging sensor, and the first ranging sensor and the second ranging sensor are placed in the first mounting bracket and the second mounting bracket respectively ; The first ranging sensor is used to detect the first working distance between the tissue to be measured and the first ranging sensor; the second ranging sensor is used to detect the second working distance between the tissue to be measured and the second ranging sensor;
处理终端用于根据第一工作距离对第一近红外相机和可见光相机进行调焦;和/或,处理终端用于根据第二工作距离对第二近红外相机进行调焦。The processing terminal is used to adjust the focus of the first near-infrared camera and the visible light camera according to the first working distance; and/or the processing terminal is used to adjust the focus of the second near-infrared camera according to the second working distance.
在一种可选的实施方式中,还包括激发光源,激发光源的出射端朝向待测组织体,以使激发光源产生的激发光束传输至待测组织体。In an optional embodiment, an excitation light source is also included, and the exit end of the excitation light source faces the tissue body to be measured, so that the excitation light beam generated by the excitation light source is transmitted to the tissue body to be measured.
在一种可选的实施方式中,还包括指示光源,指示光源向待测组织体发射指示光,指示光用于标记出激发光束的目标照射区域。In an optional embodiment, an indicating light source is further included, and the indicating light source emits indicating light to the tissue body to be measured, and the indicating light is used to mark the target irradiation area of the excitation light beam.
在一种可选的实施方式中,激发光源包括匀光组件,匀光组件用于对激发光源发射的激发光束进行均匀处理。In an optional implementation manner, the excitation light source includes a uniform light component, which is used to uniformly process the excitation light beam emitted by the excitation light source.
在一种可选的实施方式中,激发光源发射的激发光束的波长为700nm-800nm。In an optional embodiment, the excitation light beam emitted by the excitation light source has a wavelength of 700nm-800nm.
在一种可选的实施方式中,激发光源的功率可调,且激发光源的功率调节范围为1mW-1000mWIn an optional embodiment, the power of the excitation light source is adjustable, and the power adjustment range of the excitation light source is 1mW-1000mW
在一种可选的实施方式中,待测组织体被激发的近红外荧光的波长为820nm-1700nm。In an optional embodiment, the wavelength of near-infrared fluorescence excited by the tissue to be measured is 820nm-1700nm.
本申请的医学成像装置包括显示组件、近红外相机组件、可见光相机以及处理终端,显示组件包括第一显示终端和第二显示终端,近红外相机组件包括第一近红外相机和第二近红外相机;可见光相机用于获取待测组织体的可见光图像,第一近红外相机和第二近红外相机均用于获取待测组织体中目标物的荧光图像;第一显示终端用于显示待测组织体的组织图像,其中,组织图像用于显示目标物在待测组织体上的位置,且组织图像根据待测组织体的可见光图像和第一近红外相机获取的荧光图像生成;第二显示终端用于显示目标物的三维图像,三维图像根据第一近红外相机的获取的荧光图像和第二近红外相机获取的荧光图像生成。The medical imaging device of the present application includes a display component, a near-infrared camera component, a visible light camera, and a processing terminal, the display component includes a first display terminal and a second display terminal, and the near-infrared camera component includes a first near-infrared camera and a second near-infrared camera The visible light camera is used to obtain the visible light image of the tissue to be tested, and the first near-infrared camera and the second near-infrared camera are both used to obtain the fluorescence image of the target object in the tissue to be tested; the first display terminal is used to display the tissue to be tested A tissue image of the body, wherein the tissue image is used to display the position of the target object on the tissue to be measured, and the tissue image is generated according to the visible light image of the tissue to be measured and the fluorescence image acquired by the first near-infrared camera; the second display terminal The three-dimensional image is used to display the target object, and the three-dimensional image is generated according to the fluorescence image obtained by the first near-infrared camera and the fluorescence image obtained by the second near-infrared camera.
上述方案中,一方面通过设置第一近红外相机和可见光相机,以分别获 取待测组织体中目标物的荧光图像以及待测组织体的可见光图像,并在第一显示终端上显示待测组织体的组织图像,以此获得目标物在待测组织体上的位置;另一方面,通过设置第二近红外相机获取待测组织体中目标物的另一荧光图像,并在第二显示终端上显示待测组织体中目标物的三维图像,即利用由第二近红外相机和第一近红外相机配合而成的近红外双目视觉装置实时获取目标物的形态。换言之,上述方案中的医学成像装置可以获取目标物在待测组织体中的位置,以及目标物的三维信息,并实时将目标物与待测组织体的相对位置和形态直观显示在显示组件中,对医生的手术辅助效果较佳。In the above scheme, on the one hand, the first near-infrared camera and the visible light camera are set to respectively acquire the fluorescence image of the target object in the tissue to be measured and the visible light image of the tissue to be measured, and display the tissue to be measured on the first display terminal. The tissue image of the body to obtain the position of the target object on the tissue body to be measured; on the other hand, another fluorescence image of the target object in the tissue body to be measured is obtained by setting a second near-infrared camera, and displayed on the second display terminal The three-dimensional image of the target object in the tissue to be tested is displayed on the upper surface, that is, the shape of the target object is acquired in real time by a near-infrared binocular vision device formed by the cooperation of the second near-infrared camera and the first near-infrared camera. In other words, the medical imaging device in the above solution can obtain the position of the target object in the tissue to be measured and the three-dimensional information of the target object, and visually display the relative position and shape of the target object and the tissue to be measured in real time on the display component , It is better for doctors to assist in surgery.
本发明的构造以及它的其他发明目的及有益效果将会通过结合附图而对优选实施例的描述而更加明显易懂。The structure of the present invention as well as its other invention objectives and beneficial effects will be more clearly understood through the description of the preferred embodiments in conjunction with the accompanying drawings.
附图说明Description of drawings
图1为本申请实施例提供的医学成像装置的结构示意图;FIG. 1 is a schematic structural diagram of a medical imaging device provided by an embodiment of the present application;
图2为本申请实施例提供的医学成像装置的一种结构的示意图;FIG. 2 is a schematic diagram of a structure of a medical imaging device provided by an embodiment of the present application;
图3为本申请实施例提供的医学成像装置的另一种结构的示意图。Fig. 3 is a schematic diagram of another structure of a medical imaging device provided by an embodiment of the present application.
附图标记说明:Explanation of reference signs:
100-医学成像装置;10-显示组件;11-第一显示终端;12-第二显示终端;21-第一近红外相机;211-第一近红外镜头;212-第一近红外感光元件;213-第一近红外滤光元件;22-第二近红外相机;221-第二近红外镜头;222-第二近红外感光元件;223-第二近红外滤光元件;30-可见光相机;301-可见光镜头;302-可见光感光元件;303-可见光滤光元件;40-处理终端;50-激发光源;60-二向色镜;70-测距组件;71-第一测距传感器;72-第二测距传感器;73-第三测距传感器;80-壳体;81-第一安装支架;82-第二安装支架;90-待测组织体;91-目标物。100-medical imaging device; 10-display component; 11-first display terminal; 12-second display terminal; 21-first near-infrared camera; 211-first near-infrared lens; 212-first near-infrared photosensitive element; 213-the first near-infrared filter element; 22-the second near-infrared camera; 221-the second near-infrared lens; 222-the second near-infrared photosensitive element; 223-the second near-infrared filter element; 30-visible light camera; 301-visible light lens; 302-visible light photosensitive element; 303-visible light filter element; 40-processing terminal; 50-excitation light source; 60-dichroic mirror; - the second distance measuring sensor; 73 - the third distance measuring sensor; 80 - the housing; 81 - the first mounting bracket; 82 - the second mounting bracket; 90 - the tissue to be measured; 91 - the target.
具体实施方式detailed description
为使本发明的目的、技术方案和优点更加清楚,下面将结合本发明实施例中的附图,对本发明实施例中的技术方案进行清楚、完整地描述,显然,所描述的实施例是本发明一部分实施例,而不是全部的实施例。基于本发明中的实施例,本领域普通技术人员在没有做出创造性劳动前提下所获得的所 有其他实施例,都属于本发明保护的范围。In order to make the purpose, technical solutions and advantages of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below in conjunction with the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are the Some, but not all, embodiments are invented. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the protection scope of the present invention.
现代医学的外科手术中,需要依靠医学成像技术定位待测组织体中的目标物、例如肿瘤等的位置。医学成像技术一般使用近红外荧光照射待测组织体,并利用近红外感光元件获取待测组织体中目标物的荧光图像,以确定目标物的位置,帮助外科医生进行目标物、例如肿瘤切除。但是,由近红外感光元件获取的荧光图像无法显示目标物的具体形态,不够直观,对医生的辅助效果不佳。In surgical operations of modern medicine, it is necessary to rely on medical imaging technology to locate the target object, such as a tumor, in the tissue to be measured. Medical imaging technology generally uses near-infrared fluorescence to irradiate the tissue to be tested, and uses near-infrared photosensitive elements to obtain fluorescent images of the target in the tissue to be measured to determine the position of the target and help surgeons to remove the target, such as a tumor. However, the fluorescent image acquired by the near-infrared photosensitive element cannot display the specific shape of the target object, which is not intuitive enough, and is not effective in assisting doctors.
而本申请的医学成像装置通过设置第一近红外相机、第二近红外相机以及可见光相机对待测组织体及目标物的图像进行获取,可对目标物在待测组织体的位置和目标物的三维具体形态进行检测,从而直观指导医生进行目标物切除手术,降低手术难度。However, the medical imaging device of the present application acquires the images of the tissue to be measured and the target by setting the first near-infrared camera, the second near-infrared camera, and the visible light camera, so that the position of the target in the tissue to be measured and the position of the target can be determined. The three-dimensional specific shape is detected, so as to intuitively guide the doctor to perform the target resection operation and reduce the difficulty of the operation.
下面结合附图说明本申请实施例的医学成像装置。需要注意的是,本申请中所提到的近红外相机是指近红外光相机,近红外光(Near Infrared,NIR)是介于可见光(Ⅵ是)和中红外光(MIR)之间的电磁波,按ASTM(美国试验和材料检测协会)定义是指波长在780~2526nm范围内的电磁波。The medical imaging device according to the embodiment of the present application will be described below with reference to the accompanying drawings. It should be noted that the near-infrared camera mentioned in this application refers to a near-infrared camera, and near-infrared light (Near Infrared, NIR) is an electromagnetic wave between visible light (VI) and mid-infrared light (MIR). According to the definition of ASTM (American Society for Testing and Materials Testing), it refers to electromagnetic waves with a wavelength in the range of 780-2526nm.
图1为本申请实施例提供的医学成像装置的结构示意图。参照图1,本申请的医学成像装置100包括显示组件10、近红外相机组件、可见光相机30以及处理终端40,显示组件10包括第一显示终端11和第二显示终端12,近红外相机组件包括第一近红外相机21和第二近红外相机22,第一显示终端11和第二显示终端12、第一近红外相机21和第二近红外相机22、以及可见光相机30均与处理终端40电连接;FIG. 1 is a schematic structural diagram of a medical imaging device provided by an embodiment of the present application. Referring to Fig. 1, the medical imaging device 100 of the present application includes a display assembly 10, a near-infrared camera assembly, a visible light camera 30 and a processing terminal 40, the display assembly 10 includes a first display terminal 11 and a second display terminal 12, and the near-infrared camera assembly includes The first near-infrared camera 21 and the second near-infrared camera 22, the first display terminal 11 and the second display terminal 12, the first near-infrared camera 21 and the second near-infrared camera 22, and the visible light camera 30 are all electrically connected to the processing terminal 40 connect;
可见光相机30用于获取待测组织体90的可见光图像,第一近红外相机21和第二近红外相机22均用于获取待测组织体90中目标物91的荧光图像;The visible light camera 30 is used to acquire the visible light image of the tissue body 90 to be tested, and the first near-infrared camera 21 and the second near-infrared camera 22 are both used to acquire the fluorescence image of the target object 91 in the tissue body 90 to be tested;
第一显示终端11用于显示待测组织体90的组织图像,其中,组织图像用于显示目标物91在待测组织体90上的位置,且组织图像根据待测组织体90的可见光图像和第一近红外相机21获取的荧光图像生成;The first display terminal 11 is used to display the tissue image of the tissue body 90 to be measured, wherein the tissue image is used to display the position of the target object 91 on the tissue body 90 to be measured, and the tissue image is based on the visible light image of the tissue body 90 to be measured and Generation of fluorescence images acquired by the first near-infrared camera 21;
第二显示终端12用于显示目标物91的三维图像,三维图像根据第一近红外相机21的获取的荧光图像和第二近红外相机22获取的荧光图像生成。The second display terminal 12 is used to display the three-dimensional image of the target object 91 , and the three-dimensional image is generated according to the fluorescent image acquired by the first near-infrared camera 21 and the fluorescent image acquired by the second near-infrared camera 22 .
上述方案中,一方面通过设置第一近红外相机21和可见光相机30,以分别获取待测组织体90中目标物91的荧光图像以及待测组织体90的可见光图像,并在第一显示终端11上显示待测组织体90的组织图像,以此获得目标 物91在待测组织体90上的位置;另一方面,通过设置第二近红外相机22获取待测组织体90中目标物91的另一荧光图像,并在第二显示终端12上显示待测组织体90中目标物91的三维图像,即利用由第二近红外相机22和第一近红外相机21配合而成的近红外双目视觉装置实时获取目标物91表面三维信息。换言之,上述方案中的医学成像装置100可以获取目标物91在待测组织体90中的位置,以及目标物91的三维信息,并实时将目标物91与待测组织体90的相对位置和形态直观显示在显示组件10中,对医生的手术辅助效果较佳。需要注意的是,对于利用第一近红外相机21和第二近红外相机22获得三维图像的过程是本领域技术人员所熟知的,此处不再赘述。In the above scheme, on the one hand, by setting the first near-infrared camera 21 and the visible light camera 30, the fluorescence image of the target object 91 in the tissue body 90 to be measured and the visible light image of the tissue body 90 to be measured are acquired respectively, and displayed on the first display terminal 11 displays the tissue image of the tissue body 90 to be measured, so as to obtain the position of the target object 91 on the tissue body 90 to be measured; Another fluorescent image of the target object 91 in the tissue body 90 to be tested is displayed on the second display terminal 12, that is, the near-infrared image formed by the cooperation of the second near-infrared camera 22 and the first near-infrared camera 21 is used. The binocular vision device acquires the three-dimensional information on the surface of the target object 91 in real time. In other words, the medical imaging device 100 in the above scheme can obtain the position of the target object 91 in the tissue body 90 to be measured, as well as the three-dimensional information of the target object 91, and compare the relative position and shape of the target object 91 and the tissue body 90 to be measured in real time. Visually displayed in the display unit 10, it has a better effect on assisting doctors in surgery. It should be noted that the process of obtaining a three-dimensional image by using the first near-infrared camera 21 and the second near-infrared camera 22 is well known to those skilled in the art, and will not be repeated here.
本申请实施例中,可见光相机30用于获取待测组织体90的可见光图像,示例性的,可见光相机30接收待测组织体90反射的环境光、或者反射特定光源的光线,并获取待测组织体90的可见光图像。In the embodiment of the present application, the visible light camera 30 is used to acquire the visible light image of the tissue body 90 to be tested. Visible light image of organoid 90 .
第一近红外相机21和第二近红外相机22均用于获取待测组织体90中目标物91的荧光图像。示例性的,如果向待测组织体90中提前注射医用荧光探针物质,如吲哚菁绿(Indocyanine green,ICG),该荧光探针物质会在该待测组织体90的目标物91处、例如肿瘤的位置处聚集。可选的,医学成像系统还可以包括激发光源50,激发光源50的出射端朝向待测组织体90,以使激发光源50产生的激发光束照射到待测组织体90上,并使目标物91荧光显影。当该激发光源50产生的激发光束照射该待测组织体90时会激发这些聚集的荧光探针物质产生荧光。目标物91的荧光进入第一近红外相机21和第二近红外相机22后,第一近红外相机21和第二近红外相机22均获得目标物91的荧光图像。Both the first near-infrared camera 21 and the second near-infrared camera 22 are used to acquire fluorescence images of the target object 91 in the tissue body 90 to be tested. Exemplarily, if a medical fluorescent probe substance, such as indocyanine green (Indocyanine green, ICG), is injected into the tissue body 90 to be tested in advance, the fluorescent probe substance will be at the target object 91 of the tissue body 90 to be tested. , such as the accumulation at the site of a tumor. Optionally, the medical imaging system may also include an excitation light source 50, the exit end of the excitation light source 50 is directed towards the tissue body 90 to be measured, so that the excitation light beam generated by the excitation light source 50 is irradiated on the tissue body 90 to be measured, and the target object 91 Fluorescent imaging. When the excitation light beam generated by the excitation light source 50 irradiates the tissue body 90 to be tested, the aggregated fluorescent probe substances will be excited to generate fluorescence. After the fluorescence of the target object 91 enters the first near-infrared camera 21 and the second near-infrared camera 22 , both the first near-infrared camera 21 and the second near-infrared camera 22 obtain fluorescence images of the target object 91 .
第一近红外相机21和可见光相机30与处理终端40电连接,这样,处理终端40接收第一近红外相机21发送的目标物91的荧光图像,并接收可见光相机30发送的可见光图像,并将目标物91的荧光图像和待测组织体90的可见光图像进行叠加融合,从而得到待测组织体90的组织图像,即得到同时包含待测组织体90与其中目标物91的图像。其中,组织图像用于显示目标物91在待测组织体90上的位置。第一显示终端11用于显示待测组织体90的组织图像,使用人员看到该组织图像,可以直观获取目标物91在待测组织体90上的位置。The first near-infrared camera 21 and the visible light camera 30 are electrically connected to the processing terminal 40, so that the processing terminal 40 receives the fluorescence image of the target object 91 sent by the first near-infrared camera 21, and receives the visible light image sent by the visible light camera 30, and The fluorescence image of the target object 91 and the visible light image of the tissue to be tested 90 are superimposed and fused to obtain a tissue image of the tissue to be tested 90 , that is, an image including both the tissue to be tested 90 and the target 91 therein is obtained. Wherein, the tissue image is used to display the position of the target object 91 on the tissue body 90 to be measured. The first display terminal 11 is used to display the tissue image of the tissue to be measured 90 , and the user can intuitively acquire the position of the target object 91 on the tissue to be measured 90 by viewing the tissue image.
示例性地,将目标物91荧光图像和待测组织体90的可见光图像进行叠 加融合的具体方式,可以为直接将目标物91的荧光图像处理后以特定的颜色叠加到待测组织体90的可见光图像之上,获得待测组织体90的组织图像,组织图像显示了目标物91在待测组织体90上的位置,例如显示出肿瘤在病灶器官中的分布图像。Exemplarily, the specific way of superimposing and fusing the fluorescent image of the target object 91 and the visible light image of the tissue body 90 to be tested may be to directly process the fluorescent image of the target object 91 and superimpose it on the tissue body 90 to be tested with a specific color. On top of the visible light image, a tissue image of the tissue body 90 to be tested is obtained, and the tissue image shows the position of the target object 91 on the tissue body 90 to be tested, for example, a distribution image of a tumor in a lesion organ.
在上述方案的基础上,第二近红外相机22也与处理终端40电连接,这样,处理终端40接收第二近红外相机22发送的目标物91的荧光图像,并结合第一近红外相机21发送的目标物91的荧光图像,生成目标物91的三维立体红外图像。On the basis of the above scheme, the second near-infrared camera 22 is also electrically connected to the processing terminal 40, so that the processing terminal 40 receives the fluorescence image of the target object 91 sent by the second near-infrared camera 22, and combines the first near-infrared camera 21 The transmitted fluorescent image of the target object 91 generates a three-dimensional stereoscopic infrared image of the target object 91 .
像上述这样根据第一近红外相机21和第二近红外相机22生成目标物91的三维图像的过程即双目视觉近红外成像技术,可以获得目标物91的具体形态以及目标物91的表面高度信息,即完成目标物91的三维检测。第二显示终端12用于显示目标物91的三维图像。使用人员看到该三维图像,可以直观获取目标物91的具体形态,再结合待测组织体90的组织图像,可以实时准确地获取目标物91的信息,提高了手术的直观性,可以降低医生手术的时间,提高手术的效率。As mentioned above, the process of generating a three-dimensional image of the target object 91 according to the first near-infrared camera 21 and the second near-infrared camera 22, that is, binocular vision near-infrared imaging technology, can obtain the specific shape of the target object 91 and the surface height of the target object 91 information, that is, to complete the three-dimensional detection of the target object 91 . The second display terminal 12 is used to display the three-dimensional image of the target object 91 . When the user sees the three-dimensional image, he can intuitively obtain the specific shape of the target object 91. Combined with the tissue image of the tissue body 90 to be measured, the information of the target object 91 can be accurately obtained in real time, which improves the intuitiveness of the operation and reduces the need for doctors. The operation time is improved, and the efficiency of the operation is improved.
本申请实施例中,第一近红外相机21和第二近红外相机22相邻设置,即第一近红外相机21和第二近红外相机22可以设置在同一个安装结构中,也可以分别设置在两个安装结构中。第一近红外相机21和第二近红外相机22的成像区域具有重叠区域,待测组织体90可以位于重叠区域内,这样能够保证双目视觉成像的完成。可选的,第一近红外相机21和第二近红外相机22的设置参数可以相同。In the embodiment of the present application, the first near-infrared camera 21 and the second near-infrared camera 22 are arranged adjacently, that is, the first near-infrared camera 21 and the second near-infrared camera 22 can be arranged in the same installation structure, or can be arranged separately in two mounting structures. The imaging areas of the first near-infrared camera 21 and the second near-infrared camera 22 have an overlapping area, and the tissue body 90 to be tested can be located in the overlapping area, which can ensure the completion of binocular vision imaging. Optionally, the setting parameters of the first near-infrared camera 21 and the second near-infrared camera 22 may be the same.
本申请实施例中,医学成像装置还包括二向色镜60,二向色镜60是一种无源器件,不需要外部能量,只要有输入光即可。二向色镜60能够把光源分离出特定的光谱并改变部分光谱光路方向,能够对一定波长的光几乎完全透过,而对另一些波长的光几乎完全反射。示例性地,如图1所示,二向色镜60位于第一近红外相机21和待测组织体90之间,并用于使来自目标物91的荧光沿着光路A透射至第一近红外相机21;可见光相机30位于二向色镜60侧方,二向色镜60还用于使来自待测组织体90的可见光沿着光路B反射至可见光相机30。这样实际上使第一近红外相机21和可见光相机30可以共用部分光路。In the embodiment of the present application, the medical imaging device further includes a dichroic mirror 60, which is a passive device and does not require external energy, as long as there is input light. The dichroic mirror 60 can separate the light source into a specific spectrum and change the light path direction of part of the spectrum, and can almost completely transmit certain wavelengths of light, while almost completely reflecting other wavelengths of light. Exemplarily, as shown in FIG. 1 , the dichroic mirror 60 is located between the first near-infrared camera 21 and the tissue body 90 to be measured, and is used to transmit the fluorescence from the target object 91 to the first near-infrared camera along the optical path A. The camera 21 and the visible light camera 30 are located on the side of the dichroic mirror 60 , and the dichroic mirror 60 is also used to reflect the visible light from the tissue body 90 to be measured to the visible light camera 30 along the optical path B. In this way, the first near-infrared camera 21 and the visible light camera 30 can actually share part of the optical path.
本申请实施例中,第一近红外相机21包括第一近红外镜头211,可见光 相机30包括可见光镜头301,第一近红外镜头211的光轴和可见光镜头301的光轴垂直。并且,为了使用方便,可以设置该二向色镜60的反射角为45°。In the embodiment of the present application, the first near-infrared camera 21 includes a first near-infrared lens 211, and the visible light camera 30 includes a visible light lens 301. The optical axis of the first near-infrared lens 211 is perpendicular to the optical axis of the visible light lens 301. Moreover, for the convenience of use, the reflection angle of the dichroic mirror 60 can be set to 45°.
第一近红外相机21还包括第一近红外感光元件212,医学成像装置100与之对应地可以包括第一近红外滤光元件213,第一近红外镜头211位于第一近红外感光元件212和第一近红外滤光元件213之间,第一近红外滤光元件213设置于第一近红外镜头211朝向待测组织体90的一侧。The first near-infrared camera 21 also includes a first near-infrared photosensitive element 212, and correspondingly, the medical imaging device 100 may include a first near-infrared filter element 213, and the first near-infrared lens 211 is located between the first near-infrared photosensitive element 212 and Between the first near-infrared filter elements 213 , the first near-infrared filter elements 213 are disposed on the side of the first near-infrared lens 211 facing the tissue body 90 to be measured.
可见光相机30包括可见光感光元件302和可见光镜头301,与之对应的,医学成像装置100可以包括可见光滤光元件303,可见光镜头301位于可见光感光元件302和可见光滤光元件303之间,可见光滤光元件303设置于可见光镜头301朝向待测组织体90的一侧。The visible light camera 30 includes a visible light photosensitive element 302 and a visible light lens 301. Correspondingly, the medical imaging device 100 may include a visible light filter element 303. The visible light lens 301 is located between the visible light photosensitive element 302 and the visible light filter element 303. The visible light filter The element 303 is disposed on a side of the visible light lens 301 facing the tissue body 90 to be measured.
第二近红外相机22可以包括第二近红外感光元件222和第二近红外镜头221,与之对应的,医学成像装置100可以包括第二近红外滤光元件223,第二近红外镜头221位于第二近红外感光元件222和第二近红外滤光元件223之间,第二近红外滤光元件223设置于第二近红外镜头221朝向待测组织体90的一侧。并且第二近红外镜头221朝向待测组织体,以接收来自待测组织体的荧光。需要注意的是,这里第二近红外相机22未经过二向色镜60,直接对肿瘤的荧光图像进行获取。The second near-infrared camera 22 may include a second near-infrared photosensitive element 222 and a second near-infrared lens 221, and correspondingly, the medical imaging device 100 may include a second near-infrared filter element 223, and the second near-infrared lens 221 is located at Between the second near-infrared photosensitive element 222 and the second near-infrared filter element 223 , the second near-infrared filter element 223 is disposed on the side of the second near-infrared lens 221 facing the tissue body 90 to be measured. And the second near-infrared lens 221 faces the tissue to be measured to receive the fluorescence from the tissue to be measured. It should be noted that here the second near-infrared camera 22 directly acquires the fluorescence image of the tumor without passing through the dichroic mirror 60 .
第一近红外滤光元件213、第二近红外滤光元件223以及可见光滤光元件303例如可以是滤光片。The first near-infrared filter element 213 , the second near-infrared filter element 223 and the visible light filter element 303 may be filters, for example.
其中,第一近红外滤光元件213和第二近红外滤光元件223能够阻挡红外光之外的光线比如可见光,而只让红外光顺利通过。示例性地,第一近红外滤光元件213和第二近红外滤光元件223均只允许波长范围为820nm-1700nm的红外线通过,从而可以滤除待测组织体90反射的激发光束及可见光。并且由于第一近红外滤光元件213和第二近红外滤光元件223允许的光的波长范围为820nm-1700nm,穿透深度大,因此,能够获得高信噪比的目标物91的荧光图像。在实际应用中,可以用于对人体淋巴、血管等的显影以及相关组织灌注情况的监测。Wherein, the first near-infrared filter element 213 and the second near-infrared filter element 223 can block light other than infrared light such as visible light, and only allow infrared light to pass through. Exemplarily, both the first near-infrared filter element 213 and the second near-infrared filter element 223 only allow infrared rays with a wavelength range of 820nm-1700nm to pass through, thereby filtering the excitation beam and visible light reflected by the tissue body 90 to be measured. And because the wavelength range of light allowed by the first near-infrared filter element 213 and the second near-infrared filter element 223 is 820nm-1700nm, the penetration depth is large, therefore, the fluorescence image of the target object 91 with a high signal-to-noise ratio can be obtained . In practical applications, it can be used to visualize human lymph, blood vessels, etc. and monitor the perfusion of related tissues.
可选的,该第一近红外感光元件212、第二近红外感光元件222和该可见光感光元件302均可以包括电荷耦合元件(Charge Coupled Device,简称CCD)和金属氧化物半导体元件(Complementary Metal-Oxide Semiconductor,简称 CMOS)。Optionally, the first near-infrared photosensitive element 212, the second near-infrared photosensitive element 222 and the visible light photosensitive element 302 may all include a charge coupled device (Charge Coupled Device, referred to as CCD) and a metal oxide semiconductor element (Complementary Metal- Oxide Semiconductor, referred to as CMOS).
可选的,该第一近红外感光元件212、第二近红外感光元件222的数量可以为一个或多个,当该近红外感光元件的数量为多个时可以分别探测不同波段的近红外光,以获取不同的图像信息。Optionally, the number of the first near-infrared photosensitive element 212 and the second near-infrared photosensitive element 222 can be one or more. , to get different image information.
本申请实施例中,如前所述,医学成像装置100包括激发光源50,激发光源50用于向待测组织体90发出激发光束。可选的,激发光源50发射的激发光束的波长为700nm-800nm。常规医用激发光束照射待测组织体后,待测组织体发出的荧光的波长位于近红外一区内,而本发明中,待测组织体被激发出的近红外荧光的波长为820nm-1700nm,即近红外二区的光,在该频段的红外光下能够探测的目标物91的深度更深,更利于较深目标物91的探测。另外,激发光源50功率可调节,且可调范围为1mW-1000mW,可以理解是,激发光源50为功率可调的半导体激光器,在其高发光功率下可帮助装置实现对微小肿瘤的检测;但本申请不限于该调节范围。In the embodiment of the present application, as mentioned above, the medical imaging device 100 includes an excitation light source 50 for emitting an excitation light beam to the tissue body 90 to be measured. Optionally, the excitation light beam emitted by the excitation light source 50 has a wavelength of 700nm-800nm. After the conventional medical excitation beam irradiates the tissue to be tested, the wavelength of the fluorescence emitted by the tissue to be tested is in the near-infrared region, while in the present invention, the wavelength of the near-infrared fluorescence emitted by the tissue to be tested is 820nm-1700nm, That is to say, the light in the second near-infrared region can detect the target object 91 at a deeper depth under the infrared light of this frequency band, which is more conducive to the detection of the deeper target object 91 . In addition, the power of the excitation light source 50 is adjustable, and the adjustable range is 1mW-1000mW. It can be understood that the excitation light source 50 is a semiconductor laser with adjustable power, which can help the device realize the detection of small tumors under its high luminous power; but The application is not limited to this adjustment range.
本申请实施例中,可选的,医学成像装置100还包括指示光源,指示光源向待测组织体90发射指示光,指示光用于标记出激发光束的目标照射区域。换言之,指示光源用来指示激发光束的投射位置,用于操作过程中的示廓。In the embodiment of the present application, optionally, the medical imaging device 100 further includes an indication light source, which emits indication light to the tissue body 90 to be measured, and the indication light is used to mark the target irradiation area of the excitation beam. In other words, the indicating light source is used to indicate the projected position of the exciting beam, and is used for outline during operation.
本申请实施例中,激发光源50可以包括匀光组件,匀光组件用于对激发光源50发射的激发光束进行均匀处理。即匀光模块用于使激发光源50照射在待测组织体90表面的光斑的强度分布较为均匀。In the embodiment of the present application, the excitation light source 50 may include a light homogenization component, which is used to uniformly process the excitation light beam emitted by the excitation light source 50 . That is, the homogenization module is used to make the intensity distribution of the light spot irradiated by the excitation light source 50 on the surface of the tissue body 90 to be measured more uniform.
可选的,医学成像装置100还可以包括测距组件70,测距组件70用于检测待测组织体90与测距组件70的工作距离。Optionally, the medical imaging device 100 may further include a distance measuring component 70 for detecting the working distance between the tissue body 90 to be measured and the distance measuring component 70 .
示例性的,测距组件70与近红外相机组件、可见光相机30的位置相对固定,近红外相机组件和可见光相机30均根据待测组织体90与测距组件70的工作距离进行调焦。Exemplarily, the positions of the distance measuring component 70 , the near-infrared camera component and the visible light camera 30 are relatively fixed, and both the near-infrared camera component and the visible light camera 30 perform focus adjustment according to the working distance between the tissue object 90 to be measured and the distance measuring component 70 .
具体的,由于红外相机组件和可见光相机30均与测距组件70相对固定,并且测距组件70可以测量待测组织体90与测距组件70的工作距离,据此可以分别得出第一近红外相机21与待测组织体90的距离,第二近红外相机22与待测组织体90的距离,可见光相机30与待测组织体90的距离。Specifically, since both the infrared camera assembly and the visible light camera 30 are relatively fixed to the distance measuring assembly 70, and the distance measuring assembly 70 can measure the working distance between the tissue to be measured 90 and the distance measuring assembly 70, the first approximation The distance between the infrared camera 21 and the tissue body 90 to be measured, the distance between the second near-infrared camera 22 and the tissue body 90 to be measured, and the distance between the visible light camera 30 and the tissue body 90 to be measured.
可以理解的是,第一近红外镜头211可以根据第一近红外相机21与待测组织体90的距离进行调焦,直至其成像最为清晰。与之类似的,第二近红外镜头221可以根据第二近红外相机22与待测组织体90的距离进行调焦,直 至其成像最为清晰;可见光镜头301可以根据可见光相机30与待测组织体90的距离而进行调焦,直至其成像最为清晰。It can be understood that the focus of the first near-infrared lens 211 can be adjusted according to the distance between the first near-infrared camera 21 and the tissue body 90 to be measured until the image is clearest. Similarly, the second near-infrared lens 221 can focus according to the distance between the second near-infrared camera 22 and the tissue to be measured 90 until its imaging is clearest; Focus at a distance of 90 until the image is clearest.
示例性的,第一测距传感器71和第二测距传感器72均与处理器40连接,处理终端40用于根据第一工作距离对第一近红外相机21和可见光相机30进行调焦;和/或,处理终端40用于根据第二工作距离对第二近红外相机22进行调焦。Exemplarily, both the first ranging sensor 71 and the second ranging sensor 72 are connected to the processor 40, and the processing terminal 40 is used to adjust the focus of the first near-infrared camera 21 and the visible light camera 30 according to the first working distance; and /or, the processing terminal 40 is used to adjust the focus of the second near-infrared camera 22 according to the second working distance.
图2为本申请实施例提供的医学成像装置的一种结构的示意图,图3为本申请实施例提供的医学成像装置的另一种结构的示意图。FIG. 2 is a schematic diagram of a structure of a medical imaging device provided by an embodiment of the present application, and FIG. 3 is a schematic diagram of another structure of a medical imaging device provided by an embodiment of the present application.
本申请实施例中,如前所述,第一近红外相机21和第二近红外相机22可以设置在同一个安装结构中,也可以分别设置在两个安装结构中。参照图2,作为一种可选的方式,第一近红外相机21、第二近红外相机22和可见光相机30可以设置在同一个安装结构中,例如,医学成像装置100包括壳体80,第一近红外相机21、第二近红外相机22、可见光相机30均设置在壳体80中。此时测距组件70可以包括第三测距传感器73,第三测距传感器73可以设置在激发光源50上。可选的,第一测距传感器、第二测距传感器、第三测距传感器例如可以使用激光测距仪。In the embodiment of the present application, as mentioned above, the first near-infrared camera 21 and the second near-infrared camera 22 may be arranged in the same installation structure, or may be arranged in two installation structures respectively. 2, as an optional manner, the first near-infrared camera 21, the second near-infrared camera 22 and the visible light camera 30 can be arranged in the same installation structure, for example, the medical imaging device 100 includes a housing 80, the first A near-infrared camera 21 , a second near-infrared camera 22 , and a visible light camera 30 are all arranged in the casing 80 . At this time, the ranging component 70 may include a third ranging sensor 73 , and the third ranging sensor 73 may be disposed on the exciting light source 50 . Optionally, the first distance measuring sensor, the second distance measuring sensor, and the third distance measuring sensor may use a laser distance meter, for example.
参照图3,作为另一种可选的实施方式,医学成像装置100包括第一安装支架81和第二安装支架82,第一近红外相机21和可见光相机30设置在第一安装支架81上,第二近红外相机22设置在第安装二支架上。Referring to FIG. 3 , as another optional implementation manner, the medical imaging device 100 includes a first mounting bracket 81 and a second mounting bracket 82, the first near-infrared camera 21 and the visible light camera 30 are arranged on the first mounting bracket 81, The second near-infrared camera 22 is arranged on the second mounting bracket.
与之对应的,测距组件70包括第一测距传感器71和第二测距传感器72,第一测距传感器71用于检测待测组织体90与第一测距传感器71的第一工作距离;第二测距传感器72用于检测待测组织体90与第二测距传感器72的第二工作距离;第一近红外相机21和可见光相机30用于根据第一工作距离进行调焦,第二近红外相机22用于根据第二工作距离进行调焦。Correspondingly, the ranging component 70 includes a first ranging sensor 71 and a second ranging sensor 72, the first ranging sensor 71 is used to detect the first working distance between the tissue object 90 to be measured and the first ranging sensor 71 The second ranging sensor 72 is used to detect the second working distance between the tissue body 90 to be measured and the second ranging sensor 72; the first near-infrared camera 21 and the visible light camera 30 are used for focusing according to the first working distance, and the second Two near-infrared cameras 22 are used for focusing according to the second working distance.
下面参照图2和图3详细说明测距组件70的位置。The position of the ranging component 70 will be described in detail below with reference to FIGS. 2 and 3 .
参照图2,作为一个可选的实施方式,第一近红外相机21、第二近红外相机22以及可见光相机30相对于壳体80固定,测距组件只包括一个测距传感器,即第三测距传感器73,第三测距传感器可以设置在激发光源50上.2, as an optional implementation, the first near-infrared camera 21, the second near-infrared camera 22, and the visible light camera 30 are fixed relative to the housing 80, and the distance-measuring component includes only one distance-measuring sensor, that is, the third distance-measuring sensor. The distance sensor 73, the third distance sensor can be arranged on the excitation light source 50.
在图3中例示的医学成像装置中,测距组件70包括第一测距传感器71和第二测距传感器72,第一近红外相机21和可见光相机30与第一安装支架81相对固定,此处为第一近红外相机21和可见光相机30配置一个测距组件, 即第一测距传感器71,而第二近红外相机22和第二安装支架82相对固定,为第二近红外相机配置一个测距组件,即第二测距传感器72。并且第一测距传感器71和第二测距传感器72分别置于第一安装支架81和第二安装支架82内;即,第一测距传感器71可以安装在第一安装支架81上,第二测距传感器72可以安装在第二安装支架82上。In the medical imaging device illustrated in FIG. 3 , the ranging component 70 includes a first ranging sensor 71 and a second ranging sensor 72, and the first near-infrared camera 21 and the visible light camera 30 are relatively fixed to the first mounting bracket 81. Configure a ranging assembly for the first near-infrared camera 21 and the visible light camera 30, that is, the first ranging sensor 71, and the second near-infrared camera 22 and the second mounting bracket 82 are relatively fixed, and configure a second near-infrared camera The ranging component is the second ranging sensor 72 . And the first ranging sensor 71 and the second ranging sensor 72 are respectively placed in the first mounting bracket 81 and the second mounting bracket 82; that is, the first ranging sensor 71 can be installed on the first mounting bracket 81, and the second The ranging sensor 72 may be mounted on a second mounting bracket 82 .
本申请的医学成像装置包括显示组件、近红外相机组件、可见光相机以及处理终端,可见光相机用于获取待测组织体的可见光图像,第一近红外相机和第二近红外相机均用于获取待测组织体中目标物的荧光图像;第一显示终端用于显示待测组织体的组织图像,其中,组织图像用于显示目标物在待测组织体上的位置,且组织图像根据待测组织体的可见光图像和第一近红外相机获取的荧光图像生成;第二显示终端用于显示目标物的三维图像,三维图像根据第一近红外相机的获取的荧光图像和第二近红外相机获取的荧光图像生成。上述方案中,一方面通过设置第一近红外相机和可见光相机,以分别获取待测组织体中目标物的荧光图像以及待测组织体的可见光图像,并在第一显示终端上显示待测组织体的组织图像,以此获得目标物在待测组织体上的位置;另一方面,通过设置第二近红外相机获取待测组织体中目标物的另一荧光图像,并在第二显示终端上显示待测组织体中目标物的三维图像,即利用由第二近红外相机和第一近红外相机配合而成的近红外双目视觉装置实时获取目标物的形态。换言之,上述方案中的医学成像装置可以获取目标物在待测组织体中的位置,以及目标物的三维信息,并实时将目标物与待测组织体的相对位置和形态直观显示在显示组件中,对医生的手术辅助效果较佳。The medical imaging device of the present application includes a display component, a near-infrared camera component, a visible light camera, and a processing terminal. Measuring the fluorescent image of the target in the tissue; the first display terminal is used to display the tissue image of the tissue to be measured, wherein the tissue image is used to display the position of the target on the tissue to be measured, and the tissue image is based on the tissue to be measured The visible light image of the object and the fluorescence image acquired by the first near-infrared camera are generated; the second display terminal is used to display the three-dimensional image of the target object, and the three-dimensional image is based on the fluorescence image acquired by the first near-infrared camera and the fluorescence image acquired by the second near-infrared camera. Fluorescence image generation. In the above scheme, on the one hand, the first near-infrared camera and the visible light camera are set to respectively acquire the fluorescence image of the target object in the tissue to be measured and the visible light image of the tissue to be measured, and display the tissue to be measured on the first display terminal. The tissue image of the body to obtain the position of the target object on the tissue body to be measured; on the other hand, another fluorescence image of the target object in the tissue body to be measured is obtained by setting a second near-infrared camera, and displayed on the second display terminal The three-dimensional image of the target object in the tissue to be tested is displayed on the upper surface, that is, the shape of the target object is acquired in real time by a near-infrared binocular vision device formed by the cooperation of the second near-infrared camera and the first near-infrared camera. In other words, the medical imaging device in the above solution can obtain the position of the target object in the tissue to be measured and the three-dimensional information of the target object, and visually display the relative position and shape of the target object and the tissue to be measured in real time on the display component , It is better for doctors to assist in surgery.
在本发明的描述中,需要说明的是,除非另有明确的规定和限定,术语“安装”、“相连”、“连接”应作广义理解,例如,可以使固定连接,也可以是通过中间媒介间接相连,可以是两个元件内部的连通或者两个元件的相互作用关系。对于本领域的普通技术人员而言,可以根据具体情况理解上述术语在本发明中的具体含义。In the description of the present invention, it should be noted that unless otherwise specified and limited, the terms "installation", "connection" and "connection" should be understood in a broad sense, for example, it can be fixedly connected, or it can be connected through the middle The media is indirectly connected, which can be the internal communication of two elements or the interaction relationship between two elements. Those of ordinary skill in the art can understand the specific meanings of the above terms in the present invention according to specific situations.
在本发明的描述中,需要理解的是,术语“上”、“下”、“前”、“后”、“竖直”、“水平”、“顶”、“底”、“内”、“外”等指示的方位或者位置关系为基于附图所示的方位或位置关系,仅是为了便于描述本发明和简化描述,而不是指示或者暗示所指的装置或者元件必须 具有特定的方位、以特定的方位构造和操作,因此不能理解为对本发明的限制。In describing the present invention, it is to be understood that the terms "upper", "lower", "front", "rear", "vertical", "horizontal", "top", "bottom", "inner", The orientation or positional relationship indicated by "outside" is based on the orientation or positional relationship shown in the drawings, and is only for the convenience of describing the present invention and simplifying the description, rather than indicating or implying that the referred device or element must have a specific orientation, Constructed and operative in a particular orientation and therefore are not to be construed as limitations of the invention.
本申请的说明书和权利要求书及上述附图中的术语“第一”、“第二”、“第三”、“第四”等(如果存在)是用于区别类似的对象,而不必用于描述特定的顺序或先后次序。应该理解这样使用的数据在适当情况下可以互换,以便这里描述的本申请的实施例例如能够以除了在这里图示或描述的那些以外的顺序实施。The terms "first", "second", "third", "fourth", etc. (if any) in the specification and claims of the present application and the above drawings are used to distinguish similar objects, and not necessarily Used to describe a specific sequence or sequence. It is to be understood that the data so used are interchangeable under appropriate circumstances such that the embodiments of the application described herein, for example, can be practiced in sequences other than those illustrated or described herein.
此外,术语“包括”和“具有”以及他们的任何变形,意图在于覆盖不排他的包含,例如,包含了一系列步骤或单元的过程、方法、系统、产品或设备不必限于清楚地列出的那些步骤或单元,而是可包括没有清楚地列出的或对于这些过程、方法、产品或设备固有的其它步骤或单元。Furthermore, the terms "comprising" and "having", as well as any variations thereof, are intended to cover a non-exclusive inclusion, for example, a process, method, system, product or device comprising a sequence of steps or elements is not necessarily limited to the expressly listed instead, may include other steps or elements not explicitly listed or inherent to the process, method, product or apparatus.
最后应说明的是:以上各实施例仅用以说明本发明的技术方案,而非对其限制;尽管参照前述各实施例对本发明进行了详细的说明,本领域的普通技术人员应当理解:其依然可以对前述各实施例所记载的技术方案进行修改,或者对其中部分或者全部技术特征进行等同替换;而这些修改或者替换,并不使相应技术方案的本质脱离本发明各实施例技术方案的范围。Finally, it should be noted that: the above embodiments are only used to illustrate the technical solutions of the present invention, rather than limiting them; although the present invention has been described in detail with reference to the foregoing embodiments, those of ordinary skill in the art should understand that: It is still possible to modify the technical solutions described in the foregoing embodiments, or perform equivalent replacements for some or all of the technical features; and these modifications or replacements do not make the essence of the corresponding technical solutions deviate from the technical solutions of the various embodiments of the present invention. scope.

Claims (17)

  1. 一种医学成像装置,其特征在于,包括显示组件、近红外相机组件、可见光相机以及处理终端,所述显示组件包括第一显示终端和第二显示终端,所述近红外相机组件包括第一近红外相机和第二近红外相机,所述第一显示终端、所述第二显示终端、所述第一近红外相机、所述第二近红外相机以及所述可见光相机均与所述处理终端电连接;A medical imaging device, characterized in that it includes a display component, a near-infrared camera component, a visible light camera, and a processing terminal, the display component includes a first display terminal and a second display terminal, and the near-infrared camera component includes a first near-infrared camera component An infrared camera and a second near-infrared camera, the first display terminal, the second display terminal, the first near-infrared camera, the second near-infrared camera, and the visible light camera are all electrically connected to the processing terminal connect;
    所述可见光相机用于获取待测组织体的可见光图像,所述第一近红外相机和所述第二近红外相机均用于获取所述待测组织体中目标物的荧光图像;The visible light camera is used to acquire a visible light image of the tissue to be tested, and both the first near-infrared camera and the second near-infrared camera are used to acquire a fluorescence image of a target in the tissue to be tested;
    所述第一显示终端用于显示所述待测组织体的组织图像,其中,所述组织图像用于显示所述目标物在所述待测组织体上的位置,且所述组织图像根据所述待测组织体的可见光图像和所述第一近红外相机获取的荧光图像生成;The first display terminal is used to display the tissue image of the tissue to be measured, wherein the tissue image is used to display the position of the target on the tissue to be measured, and the tissue image is generation of the visible light image of the tissue to be measured and the fluorescence image acquired by the first near-infrared camera;
    所述第二显示终端用于显示所述目标物的三维图像,其中,所述三维图像根据所述第一近红外相机的获取的荧光图像和所述第二近红外相机获取的荧光图像生成。The second display terminal is configured to display a three-dimensional image of the target object, wherein the three-dimensional image is generated according to the fluorescence image acquired by the first near-infrared camera and the fluorescence image acquired by the second near-infrared camera.
  2. 根据权利要求1所述的医学成像装置,其特征在于,所述第一近红外相机和所述第二近红外相机相邻设置,且所述第一近红外相机和所述第二近红外相机的成像区域具有重叠区域,所述待测组织体位于所述重叠区域内。The medical imaging device according to claim 1, wherein the first near-infrared camera and the second near-infrared camera are arranged adjacently, and the first near-infrared camera and the second near-infrared camera The imaging area has an overlapping area, and the tissue body to be measured is located in the overlapping area.
  3. 根据权利要求1所述的医学成像装置,其特征在于,还包括二向色镜,所述二向色镜位于所述第一近红外相机和所述待测组织体之间,并用于使来自所述目标物的荧光透射至所述第一近红外相机;The medical imaging device according to claim 1, further comprising a dichroic mirror, the dichroic mirror is located between the first near-infrared camera and the tissue to be measured, and is used to make The fluorescence of the target is transmitted to the first near-infrared camera;
    所述可见光相机位于所述二向色镜侧方,所述二向色镜还用于使来自所述待测组织体的可见光反射至所述可见光相机。The visible light camera is located at the side of the dichroic mirror, and the dichroic mirror is also used to reflect the visible light from the tissue to be measured to the visible light camera.
  4. 根据权利要求3所述的医学成像装置,其特征在于,所述第一近红外相机包括第一近红外镜头,所述可见光相机包括可见光镜头,所述第一近红外镜头的光轴和所述可见光镜头的光轴相互垂直。The medical imaging device according to claim 3, wherein the first near-infrared camera includes a first near-infrared lens, the visible light camera includes a visible light lens, and the optical axis of the first near-infrared lens and the The optical axes of the visible light lenses are perpendicular to each other.
  5. 根据权利要求4所述的医学成像装置,其特征在于,还包括第一近红外滤光元件,所述第一近红外滤光元件设置于所述第一近红外镜头的朝向所述待测组织体的一侧;和/或所述医学成像装置还包括可见光滤光元件,所述可见光滤光元件设置于所述可见光镜头朝向所述待测组织体的一侧。The medical imaging device according to claim 4, further comprising a first near-infrared filter element, the first near-infrared filter element is arranged on the first near-infrared lens toward the tissue to be measured One side of the body; and/or the medical imaging device further includes a visible light filter element, the visible light filter element is arranged on the side of the visible light lens facing the tissue to be measured.
  6. 根据权利要求3所述的医学成像装置,其特征在于,所述第二近红外 相机包括第二近红外镜头,所述第二近红外镜头朝向所述待测组织体,并用于接收来自所述待测组织体的荧光。The medical imaging device according to claim 3, wherein the second near-infrared camera includes a second near-infrared lens, the second near-infrared lens is directed toward the tissue to be measured, and is used for receiving images from the Fluorescence of the tissue to be measured.
  7. 根据权利要求6所述的医学成像装置,其特征在于,还包括第二近红外滤光元件,所述第二近红外滤光元件设置于所述第二近红外镜头的朝向所述待测组织体的一侧。The medical imaging device according to claim 6, further comprising a second near-infrared filter element, the second near-infrared filter element is arranged on the second near-infrared lens toward the tissue to be measured side of the body.
  8. 根据权利要求1-7任一项所述的医学成像装置,其特征在于,还包括测距组件,所述测距组件用于检测所述待测组织体与所述测距组件的工作距离。The medical imaging device according to any one of claims 1-7, further comprising a distance measuring component configured to detect a working distance between the tissue to be measured and the distance measuring component.
  9. 根据权利要求8所述的医学成像装置,其特征在于,所述测距组件与所述近红外相机组件、可见光相机的位置相对固定,所述近红外相机组件和所述可见光相机均根据所述待测组织体与所述测距组件的工作距离进行调焦。The medical imaging device according to claim 8, characterized in that, the positions of the distance measuring component, the near-infrared camera component and the visible light camera are relatively fixed, and the near-infrared camera component and the visible light camera are both based on the The working distance between the tissue body to be measured and the distance measuring component is adjusted.
  10. 根据权利要求9所述的医学成像装置,其特征在于,还包括第一安装支架和第二安装支架,所述第一近红外相机和所述可见光相机设置在所述第一安装支架上,所述第二近红外相机设置在所述第二安装支架上。The medical imaging device according to claim 9, further comprising a first mounting bracket and a second mounting bracket, the first near-infrared camera and the visible light camera are arranged on the first mounting bracket, the The second near-infrared camera is arranged on the second mounting bracket.
  11. 根据权利要求10所述的医学成像装置,其特征在于,所述测距组件包括第一测距传感器和第二测距传感器,所述第一测距传感器和所述第二测距传感器分别置于所述第一安装支架和所述第二安装支架内;所述第一测距传感器用于检测所述待测组织体与所述第一测距传感器的第一工作距离;所述第二测距传感器用于检测所述待测组织体与所述第二测距传感器的第二工作距离;The medical imaging device according to claim 10, wherein the ranging component comprises a first ranging sensor and a second ranging sensor, and the first ranging sensor and the second ranging sensor are respectively placed In the first mounting bracket and the second mounting bracket; the first distance measuring sensor is used to detect the first working distance between the tissue body to be measured and the first distance measuring sensor; the second The distance measuring sensor is used to detect the second working distance between the tissue to be measured and the second distance measuring sensor;
    所述处理终端用于根据所述第一工作距离对所述第一近红外相机和所述可见光相机进行调焦;和/或,所述处理终端用于根据所述第二工作距离对所述第二近红外相机进行调焦。The processing terminal is used to adjust the focus of the first near-infrared camera and the visible light camera according to the first working distance; and/or, the processing terminal is used to focus the first near-infrared camera and the visible light camera according to the second working distance. The second near-infrared camera performs focus adjustment.
  12. 根据权利要求1-7任一项所述的医学成像装置,其特征在于,还包括激发光源,所述激发光源的出射端朝向所述待测组织体,以使所述激发光源产生的激发光束照射至所述待测组织体。The medical imaging device according to any one of claims 1-7, further comprising an excitation light source, the exit end of the excitation light source faces the tissue to be measured, so that the excitation light beam generated by the excitation light source Irradiating to the tissue body to be tested.
  13. 根据权利要求12所述的医学成像装置,其特征在于,还包括指示光源,所述指示光源向所述待测组织体发射指示光,所述指示光用于标记出所述激发光束的目标照射区域。The medical imaging device according to claim 12, further comprising an indication light source, the indication light source emits indication light to the tissue to be measured, and the indication light is used to mark the target irradiation of the excitation beam area.
  14. 根据权利要求12所述的医学成像装置,其特征在于,所述激发光源包括匀光组件,所述匀光组件用于对所述激发光源发射的激发光束进行均匀 处理。The medical imaging device according to claim 12, wherein the excitation light source comprises a light homogenization component, and the light uniformity component is used to uniformly process the excitation light beam emitted by the excitation light source.
  15. 根据权利要求12所述的医学成像装置,其特征在于,所述激发光源发射的所述激发光束的波长为700nm-800nm。The medical imaging device according to claim 12, characterized in that, the excitation light beam emitted by the excitation light source has a wavelength of 700nm-800nm.
  16. 根据权利要求12所述的医学成像装置,其特征在于,所述激发光源的功率可调,且所述激发光源的功率调节范围为1mW-1000mW。The medical imaging device according to claim 12, wherein the power of the excitation light source is adjustable, and the power adjustment range of the excitation light source is 1 mW-1000 mW.
  17. 根据权利要求12所述的医学成像装置,其特征在于,所述待测组织体被激发的近红外荧光的波长为820nm-1700nm。The medical imaging device according to claim 12, characterized in that the near-infrared fluorescence excited by the tissue to be measured has a wavelength of 820nm-1700nm.
PCT/CN2021/123838 2021-06-29 2021-10-14 Medical imaging device WO2023273014A1 (en)

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
CN202110725651.7 2021-06-29
CN202110725651.7A CN115530995A (en) 2021-06-29 2021-06-29 Medical imaging apparatus
CN202121462098.4U CN215606349U (en) 2021-06-29 2021-06-29 Medical imaging apparatus
CN202121462098.4 2021-06-29

Publications (1)

Publication Number Publication Date
WO2023273014A1 true WO2023273014A1 (en) 2023-01-05

Family

ID=84692438

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2021/123838 WO2023273014A1 (en) 2021-06-29 2021-10-14 Medical imaging device

Country Status (1)

Country Link
WO (1) WO2023273014A1 (en)

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103337071A (en) * 2013-06-19 2013-10-02 北京理工大学 Device and method for structure-reconstruction-based subcutaneous vein three-dimensional visualization
CN104757936A (en) * 2009-12-15 2015-07-08 爱默蕾大学 System and method for providing real-time anatomical guidance in diagnostic or therapeutic procedure
CN110236694A (en) * 2019-06-04 2019-09-17 广东欧谱曼迪科技有限公司 Same screen near-infrared bispectrum fluorescence imaging method and system based on spectral response characteristic
CN112414987A (en) * 2020-12-14 2021-02-26 华南师范大学 Fluorescence imaging device applying spectral detection and testing method
US20210127957A1 (en) * 2019-10-31 2021-05-06 Inthesmart Co., Ltd. Apparatus for intraoperative identification and viability assessment of tissue and method using the same

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104757936A (en) * 2009-12-15 2015-07-08 爱默蕾大学 System and method for providing real-time anatomical guidance in diagnostic or therapeutic procedure
CN103337071A (en) * 2013-06-19 2013-10-02 北京理工大学 Device and method for structure-reconstruction-based subcutaneous vein three-dimensional visualization
CN110236694A (en) * 2019-06-04 2019-09-17 广东欧谱曼迪科技有限公司 Same screen near-infrared bispectrum fluorescence imaging method and system based on spectral response characteristic
US20210127957A1 (en) * 2019-10-31 2021-05-06 Inthesmart Co., Ltd. Apparatus for intraoperative identification and viability assessment of tissue and method using the same
CN112414987A (en) * 2020-12-14 2021-02-26 华南师范大学 Fluorescence imaging device applying spectral detection and testing method

Similar Documents

Publication Publication Date Title
US11751971B2 (en) Imaging and display system for guiding medical interventions
US10314490B2 (en) Method and device for multi-spectral photonic imaging
RU2288636C2 (en) Method and systems for detecting parameters and mapping of tissue lesions
CN114599263A (en) System and method for medical imaging
WO2008109545A2 (en) Medical imaging lens system, and method with high-efficiency light collection and collinear illumination
KR20160013893A (en) Device and method for acquiring fusion image
CN108420532A (en) A kind of hand-held fluorescence image navigation positioning device
KR102009558B1 (en) Goggle system for image guide surgery
JP2012135368A (en) Photoacoustic imaging apparatus
WO2021212834A1 (en) Fluorescein angiography testing system based on 785 nm wavelength light source
KR101513032B1 (en) Microscope system and method of providing augmented reality image using microscope system
CN108542497A (en) Operation navigation device
WO2023273014A1 (en) Medical imaging device
WO2022179117A1 (en) Navigation method and apparatus based on fluorescence molecular imaging, and storage medium
CN207721883U (en) Active light excites operation guiding system and camera head
KR101021989B1 (en) Image acquisition apparatus of small animals for clinical trials
CN215606349U (en) Medical imaging apparatus
US9686484B2 (en) Apparatus for acquiring and projecting broadband image capable of implementing visible light optical image and invisible light fluorescence image together
CN106943193A (en) Common location operation guiding system and camera head
CN208610985U (en) Operation navigation device
CN115530995A (en) Medical imaging apparatus
CN218978889U (en) Three-dimensional imaging device and operation navigation system
KR102204426B1 (en) Image acquisition system and image acquisition method using the same
CN215606241U (en) Operation navigation device and system
CN214908029U (en) Navigation device based on fluorescent molecular imaging

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 21947941

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE