WO2017161535A1 - Système d'imagerie optique diffuse à fluorescence et son procédé - Google Patents

Système d'imagerie optique diffuse à fluorescence et son procédé Download PDF

Info

Publication number
WO2017161535A1
WO2017161535A1 PCT/CN2016/077225 CN2016077225W WO2017161535A1 WO 2017161535 A1 WO2017161535 A1 WO 2017161535A1 CN 2016077225 W CN2016077225 W CN 2016077225W WO 2017161535 A1 WO2017161535 A1 WO 2017161535A1
Authority
WO
WIPO (PCT)
Prior art keywords
image
laser
fluorescence
ccd camera
position information
Prior art date
Application number
PCT/CN2016/077225
Other languages
English (en)
Chinese (zh)
Inventor
童潇
陈昳丽
付楠
朱艳春
李荣茂
余绍德
陈鸣闽
谢耀钦
Original Assignee
中国科学院深圳先进技术研究院
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 中国科学院深圳先进技术研究院 filed Critical 中国科学院深圳先进技术研究院
Priority to PCT/CN2016/077225 priority Critical patent/WO2017161535A1/fr
Priority to CN201680000101.6A priority patent/CN105873501B/zh
Publication of WO2017161535A1 publication Critical patent/WO2017161535A1/fr

Links

Images

Classifications

    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/0059—Measuring for diagnostic purposes; Identification of persons using light, e.g. diagnosis by transillumination, diascopy, fluorescence
    • A61B5/0071—Measuring for diagnostic purposes; Identification of persons using light, e.g. diagnosis by transillumination, diascopy, fluorescence by measuring fluorescence emission
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/0059—Measuring for diagnostic purposes; Identification of persons using light, e.g. diagnosis by transillumination, diascopy, fluorescence
    • A61B5/0073—Measuring for diagnostic purposes; Identification of persons using light, e.g. diagnosis by transillumination, diascopy, fluorescence by tomography, i.e. reconstruction of 3D images from 2D projections
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/48—Other medical applications
    • A61B5/4887—Locating particular structures in or on the body
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B2503/00—Evaluating a particular growth phase or type of persons or animals
    • A61B2503/40—Animals

Definitions

  • the present invention relates to the field of medical imaging technology, and in particular, to a fluorescence scattering optical imaging system and method.
  • Fluorescence Diffuse Optical Tomography works by implanting tumors and corresponding targeted fluorescent reagents in small animals in advance, using a laser to scan in a certain plane in the area where small animals are located. Fluorescent reagents It is excited by laser, emits near-infrared light, and then obtains a picture of the excitation light through the detector. Finally, the position and distribution of the tumor in the animal body are determined by three-dimensional reconstruction. Compared with Magnetic Resonance Imaging (MRI), Computed Tomography (CT), and Positron Emission Tomography (PET), FDOT imaging has low cost, easy operation, no radiation, etc. Advantages, often used for small animal living imaging.
  • MRI Magnetic Resonance Imaging
  • CT Computed Tomography
  • PET Positron Emission Tomography
  • FDOT/PET dual-modality imaging combined with FDOT and PET can provide information on the different physiological processes of experimental objects. This combination can help to increase the molecular level information provided at a given point in time. Comparing the characteristics of the two modal imaging systems, the PET system gantry records the acquired signals from all possible angles. However, this FDOT/PET dual-modality imaging system is complicated in structure and high in cost.
  • the existing single-angle imaging FDOT system a CCD (Charge-coupled Device) camera is fixed on the top of the object to be tested, and the excitation light source performs plane scanning on the opposite side of the CCD camera, so the existing common FDOT system A single angle imaging acquisition structure.
  • the single-angle imaging FDOT system has fewer acquisition modes, less information acquisition, longer acquisition period, and more difficult reconstruction.
  • the single-angle acquisition of the image makes the FDOT imaging inferior to the longitudinal tomographic imaging along the line of the light source-CCD camera. Under normal circumstances, the geometry of the image acquisition system will in turn affect the quality of the reconstruction of the output image.
  • the invention provides a fluorescence scattering optical imaging system and method for improving the quality of fluorescence scattering optical tomography and shortening the imaging time.
  • the invention provides a fluorescence scattering optical imaging system, comprising: a laser, a micro-displacement stage, a stage, at least one plane mirror, a filter, a CCD camera and a processor; the fiber head of the laser is mounted on the micro a reflecting surface of the plane mirror facing the object to be tested on the stage; the micro-displacement stage and the CCD
  • the camera is respectively electrically connected to the processor; the micro-displacement station is configured to move in a set plane area below the stage according to a control signal of the processor; the laser is used for scanning a built-in fluorescent substance The area to be tested of the object to be tested is used to excite fluorescence; the CCD camera is configured to obtain a fluorescence image and a laser image from above the stage, and the obtaining manner comprises: directly collecting from the object to be tested and reflecting on the plane based on the object Mirror reflection acquisition; the processor is configured to acquire position information of the CCD camera, position information of the fiber tip, position information of the plane mirror, CT image or
  • an edge of the planar mirror is attached to the stage.
  • the system includes two of the planar mirrors; two sides of each of the planar mirrors that are in contact with the stage are parallel to each other, and two of the planar mirrors and the carrier The angle of the object is the same.
  • the filter comprises a fluorescent filter for filtering fluorescence and a laser filter for filtering laser light;
  • the fluorescent filter is a 488 nm narrow band pass filter, the laser
  • the filter is a long pass filter of 600 nm or more.
  • the invention also provides a fluorescence scattering optical imaging method, comprising: a micro-displacement stage driving a fiber head of a laser mounted thereon according to a control signal of a processor to move in a set plane region below the stage; the laser is to be tested
  • the two-dimensional laser scanning of the object to be tested is performed to induce fluorescence of the fluorescent substance in the area to be measured;
  • the CCD camera collects the composite fluorescent image and the composite laser image from above the stage, and the collection method includes: directly from the test Collecting and collecting based on the reflection of the plane mirror;
  • the processor acquires position information of the CCD camera, position information of the fiber tip, position information of the plane mirror, CT image or MRI image of the object to be tested, and the composite
  • a fluorescent image and a composite laser image are used to generate a three-dimensional fluorescence image of the region to be tested.
  • the processor acquires position information of the CCD camera, position information of the fiber tip, position information of the plane mirror, CT image or MRI image of the object to be tested, the composite fluorescence image, and the composite laser image, and thereby Generating the three-dimensional fluorescence image of the area to be tested, comprising: trimming the composite laser image and the composite fluorescence image into a plurality of single laser images and a plurality of single fluorescent images respectively; according to the position information of the optical fiber head
  • Position information of the CCD camera, position information of the plane mirror, CT or MRI image of the object to be tested, the single laser image, and the single fluorescence image are generated by the three-dimensional reconstruction software Three-dimensional fluorescence image of the area.
  • the method further includes: setting a fluorescent filter in front of the CCD camera to filter out fluorescence emitted by the fluorescent substance; and a CCD camera acquiring a composite laser image from above the stage, including: the CCD The camera directly collects the laser light emitted by the laser fiber head and passes through the object to be tested, generates a first laser image, and simultaneously collects laser light that passes through the object to be tested and is reflected by the plane mirror to generate a second A laser image, the first laser image and the second laser image constitute the composite laser image.
  • the method further includes: setting a laser filter in front of the CCD camera to filter out laser light emitted by the laser fiber tip; and collecting, by the CCD camera, a composite fluorescent image from above the stage, comprising: The CCD camera directly collects fluorescence emitted by the fluorescent substance in the area to be detected, generates a first fluorescent image, and simultaneously collects fluorescence emitted by the fluorescent substance in the area to be measured and reflected by the planar mirror to generate a second fluorescent image, the first fluorescent image and the second fluorescent image forming the composite fluorescent image.
  • the position information of the fiber head the position information of the CCD camera, the position information of the plane mirror, the CT or MRI image of the object to be tested, the single laser image and the
  • the three-dimensional fluorescence image is generated by the three-dimensional reconstruction software, and the CT image or the MRI image is meshed by the volume mesh generation software to generate the body of the to-be-tested area.
  • the position information of the optical fiber head, the position information of the CCD camera, the position information of the CCD camera image, the single laser image, the single fluorescent image, and the body surface network Inputting the data into the three-dimensional reconstruction software, calculating the three-dimensional fluorescence image, comprising: scaling and matching the laser image and the fluorescence image to an actual size of the to-be-measured area; Laser image, zoom-matched fluorescent image, position information of the fiber tip, position information of the CCD camera, position information of the CCD camera image, and the body surface mesh data are input to the three-dimensional reconstruction In the software, the three-dimensional fluorescence image is calculated.
  • one side of the planar mirror is attached to the stage; the composite laser image and the composite fluorescent image are respectively cut into a plurality of single laser images and a plurality of single fluorescent images, including : cutting the composite laser image into a plurality of the single laser images along an intersection of a plane of the plane mirror and a plane of the stage; along a plane of the plane mirror and the carrier An intersection line of the plane of the stage cuts the composite fluorescent image into a plurality of said single fluorescent images.
  • the fluorescence scattering optical imaging system and method of the embodiment of the invention can reflect the laser and the fluorescence from the object to be tested by using the plane mirror to reflect the laser and the fluorescence, thereby obtaining a richer object to be tested.
  • the two-dimensional fluorescence image and the two-dimensional laser image information can improve the image reconstruction accuracy and improve the intensity of the reconstructed signal, and can obtain a three-dimensional fluorescence image with higher imaging quality than the existing single-angle FDOT system.
  • the imaging system of the embodiment of the invention can realize multi-angle shooting and multi-angle imaging with only one real CCD camera Compared with the FDOT system, the system has the advantages of low equipment cost, and the real CCD camera and the at least one CCD camera image the laser image and the fluorescence image of the object to be tested at the same time, and the imaging system of the present invention has a faster imaging speed.
  • FIG. 1 is a schematic structural view of a fluorescence scattering optical imaging system according to an embodiment of the present invention
  • FIG. 2 is a schematic view showing imaging of a CCD camera in a plane mirror according to an embodiment of the present invention
  • FIG. 3 is a schematic diagram of a composite fluorescent image and a cut generated by the fluorescence scattering optical imaging system shown in FIG. 1;
  • FIG. 4 is a schematic view showing the position setting of a plane mirror according to an embodiment of the present invention.
  • FIG. 5 is a schematic flow chart of a fluorescence scattering optical imaging method according to an embodiment of the present invention.
  • FIG. 6 is a schematic flow chart of a method for imaging a three-dimensional fluorescence image according to an embodiment of the present invention
  • FIG. 7 is a flow chart showing a method of cropping a composite image into a single image according to an embodiment of the present invention.
  • FIG. 8 is a schematic flow chart of a method for imaging a three-dimensional fluorescence image according to an embodiment of the present invention.
  • FIG. 9 is a flow chart showing a method of performing three-dimensional fluorescence image imaging in an embodiment of the present invention.
  • the existing single-angle imaging FDOT system has the advantages of low cost and no radiation, but has the disadvantages of less acquisition mode, less information collection, difficulty in reconstruction, and longitudinal deterioration of quality.
  • the inventors have considered the influence of the geometry of the existing FDOT system on the quality of its output image, and through creative labor, improved the geometric structure of the existing single-angle imaging FDOT system to ensure imaging. Improve image quality while speed.
  • a fluorescence scattering optical imaging system may include a laser 101, a micro-displacement stage 102, a stage 103, at least one planar mirror 104, a filter 105, a CCD camera 106, and a processor. 107.
  • Fiber head of laser 101 It is mounted on the micro-stage 102.
  • the reflecting surface of the plane mirror 104 faces the object to be tested on the stage 103.
  • the micro-displacement stage 102 and the CCD camera 103 are electrically connected to the processor 107, respectively.
  • the laser 101 is used to scan a region to be tested of a test substance having a built-in fluorescent substance to excite fluorescence.
  • the test object may be a living small animal, and the test area may be a tissue or an organ of a small animal, such as a tumor area.
  • the laser light emitted by the laser 101 can be a near-infrared laser. As shown in FIG. 1, the laser 101 emits laser light from the bottom to the top, and the laser induces fluorescence of the fluorescent substance in the object to be tested on the stage 103, and the laser light and the fluorescence can be received by the CCD camera 106. In other embodiments, the laser 101 can illuminate the object to be tested from top to bottom, and accordingly, the CCD camera 106 can receive laser and fluorescence under the object to be tested.
  • the micro-displacement stage 102 is configured to move within a set plane area below the stage 103 according to a control signal of the processor 107.
  • the fiber head Under the driving of the micro-stage 102, for example, the fiber head is clamped on the micro-displacement stage, and the fiber head of the laser 101 can be moved along the set path in the xy plane for two-dimensional laser scanning.
  • the position of the laser scanning may be a position moving every other set distance along the x-axis, moving a total of N times, moving one position every other set distance along the y-axis, and moving a total of N times to form a laser (N+ 1) *(N+1) array.
  • the laser scanning may be centered on a certain set point, moved one position at a set angle along the circumferential direction, and moved M times to form a laser array.
  • the filter 105 may include a fluorescence filter for filtering out fluorescence and a laser filter for filtering laser light.
  • the fluorescent filter can be a 488 nm narrow band pass filter, which can only acquire 488 nm light from the CCD camera 106, and is suitable for collecting laser light of the corresponding wavelength.
  • the laser filter can be a long pass filter of 600 nm or more, and only the CCD camera 106 can collect light of 600 nm or more, and since the object to be tested can generally emit fluorescence of 600 to 700 nm under the excitation of the 488 nm laser, the The long pass filter of 600 nm or more can collect fluorescence well.
  • the CCD camera 106 is configured to acquire a fluorescence image and a laser image from above the stage 103.
  • the acquisition method includes: directly collecting from the object to be tested and collecting the reflection based on the plane mirror 104. Wherein, when the fluorescence image and the laser image are directly collected from the object to be tested, the laser and the fluorescence do not pass through the plane mirror 104, specifically, the laser light passing through the object to be tested directly enters the CCD camera 106, and is controlled by the object to be tested. The fluorescence emitted by the fluorescent material directly enters the CCD camera 106.
  • the fundamental difference between the two acquisition methods is that the path from the laser and the fluorescence that is directly emitted from the object to be tested to the CCD camera 106 is not changed, so the present invention is not limited to directly collecting images from the object to be tested. There are other elements between the object to be tested and the CCD camera 106 that do not change the optical path.
  • the CCD camera 106 can be an Electro-Multiplying CCD (EMCCD) camera or a liquid-cooled CCD, which can have a more image acquisition effect.
  • EMCD Electro-Multiplying CCD
  • the processor 107 is configured to acquire position information of the CCD camera 106, position information of the fiber head of the laser 101, position information of the plane mirror 104, CT image or MRI image of the object to be tested on the stage 103, fluorescence image, and laser image. And generating a three-dimensional fluorescence image of the above-mentioned test area.
  • the processor 107 may be various devices capable of calculating the above-described three-dimensional fluorescent image based on the input information described above, such as a computer.
  • the position information of the plane mirror 104 can be manually input to the processor 107 by hand.
  • the position information of the CCD camera image in the plane mirror 104 can be calculated by using the position information of the plane mirror 104 and the position information of the CCD camera 106.
  • the position information of the CCD camera image can be used to calculate the object to be tested.
  • the CT image or the MRI image of the object to be tested on the stage 103 may be a three-dimensional image of the area to be tested of the object to be tested, and may be acquired in advance by a corresponding device.
  • FIG. 2 is a schematic view of a CCD camera imaged in a plane mirror in accordance with an embodiment of the present invention.
  • the planar mirror 104 is used to reflect laser light and fluorescence to a real CCD camera 106 to form CCD camera images 106a, 106b, and a CCD camera image from a different angle than that of the real CCD camera 106.
  • the shooting angles of 106a, 106b capture two images of a two-dimensional laser image and a two-dimensional fluorescent image of the area to be tested.
  • the CCD camera 106 can be a CCD camera image in each of the plane mirrors 104.
  • a fluorescence scattering optical imaging system provided with a plurality of planar mirrors 104, a plurality of CCD camera images can be correspondingly formed, and each CCD camera image collects fluorescence and laser angles from the region to be tested of the object to be tested on the stage 103.
  • the two-dimensional fluorescence image and the two-dimensional laser image of the to-be-measured area photographed from at least two different angles can be obtained by the above-described CCD camera 106 and each CCD camera image.
  • two planar mirrors 104 are provided in the system.
  • This configuration is equivalent to three CCD cameras of the same optical characteristics (the CCD camera 106 on the top of the object and the virtual CCD on the left side of the object).
  • the camera 106b and the right virtual CCD camera 106a) simultaneously record fluorescent signals emitted within the object at three locations.
  • the multi-angle imaging system formed by the plane mirror greatly simplifies the system structure, and since it retains the original single-angle system structure, it can still be applied to the conventional FDOT image acquisition scheme. wide range.
  • each two-dimensional fluorescent image will be on a composite fluorescent image
  • each two-dimensional laser image will be in a composite laser image. on.
  • FIG. 3 is a schematic diagram of a composite fluorescent image and a cut generated by the fluorescence scattering optical imaging system shown in FIG. 1.
  • two planar mirrors 104 are disposed, and two plane mirrors 106 disposed on both sides of the mouse can be used to obtain one frame.
  • the composite fluorescent image 200 includes a fluorescent image 201 captured on the top of the mouse by the CCD camera 106 on the top of the mouse (subject) on the stage 103, and a CCD camera in the two planar mirrors 106 of the CCD camera 106.
  • the fluorescent images 202 and 203 on the side of the mouse were photographed separately.
  • the plane mirror 104 can be disposed in various ways, and can be located at various positions, and its angle with the horizontal plane (for example, the angles ⁇ , ⁇ ) can be various angles, and the plane mirror 104 and the to-be-tested
  • the distance L between the objects may be various values as long as the plane mirror 104 can reflect the laser light and fluorescence from the region to be tested of the object to be tested to the CCD camera 106.
  • the plane mirror 104 can be disposed on the stage 103. Specifically, an edge of the plane mirror 104 can be attached to the stage 103. Thus, the plane mirror 104 is conveniently disposed. And an image of the side of the object to be tested can be collected.
  • the fluorescence scattering optical imaging system can include two planar mirrors 104.
  • the sides of the two planar mirrors 104 that are respectively attached to the stage 103 may be parallel to each other, that is, the intersection of the planes of the two plane mirrors 104 and the plane of the stage 103 may be parallel to each other.
  • the angle between the two plane mirrors 104 and the stage 103 can be the same, that is, in the case where the plane mirror 104 faces the object to be tested, the plane of the two plane mirrors 104 and the plane of the stage 103 are located.
  • the angle of the angle can be the same. As shown in FIG. 1, the angles ⁇ and ⁇ of the two plane mirrors 104 and the stage 103 may be the same.
  • angles ⁇ and ⁇ may be different.
  • the magnitudes of the angles ⁇ and ⁇ can be various values. The inventors have found that the angles of the angles ⁇ and ⁇ are 30° by calculating the angle of the CCD camera image in the plane mirror 104. In the range of ⁇ 40°, in this way, more image information of the object to be tested can be obtained.
  • the laser and the fluorescence are reflected by the plane mirror, and the laser and the fluorescence from the object to be tested can be collected from the angle different from the real CCD camera, thereby obtaining a richer object to be tested.
  • Dimensional fluorescence image and two-dimensional laser image information according to which a three-dimensional fluorescence image with higher imaging quality than the existing single-angle FDOT system can be obtained.
  • the imaging system of the embodiment of the invention can realize multi-angle shooting only by a real CCD camera, and has the advantage of low equipment cost compared with the FDOT system of multi-angle imaging, and the real CCD camera and at least one CCD camera image are simultaneously taken.
  • the laser image and the fluorescence image of the object are measured, and the imaging system of the present invention has a faster imaging speed.
  • the embodiment of the present application also provides a fluorescence scattering optical imaging method, as described in the following embodiments. Since the principle of solving the problem by the fluorescence scattering optical imaging method is similar to that of the fluorescence scattering optical imaging system, the implementation of the fluorescence scattering optical imaging method can be referred to the implementation of the fluorescent scattering optical imaging system, and the repetition will not be repeated.
  • FIG. 5 is a schematic flow chart of a fluorescence scattering optical imaging method according to an embodiment of the present invention. As shown in FIG. 5, the fluorescence scattering optical imaging method of the embodiment of the present invention may include the following steps:
  • the micro-displacement station drives the fiber head of the laser mounted thereon to move in a set plane region below the stage according to a control signal of the processor;
  • S320 performing a two-dimensional laser scanning on the to-be-measured area of the object to be measured by the laser to induce fluorescence of the fluorescent substance in the area to be tested;
  • the CCD camera collects the composite fluorescent image and the composite laser image from above the above-mentioned stage, and the collecting manner includes: directly collecting from the object to be tested and collecting based on the reflection of the plane mirror;
  • the processor acquires position information of the CCD camera, position information of the fiber head, position information of the plane mirror, CT image or MRI image of the object to be tested, the composite fluorescent image and the composite laser image, and generates the above-mentioned test Three-dimensional fluorescence image of the area.
  • the fiber head is clamped on the micro-displacement stage, and the fiber head of the laser can be moved along the set path in the set two-dimensional plane for two-dimensional laser scanning.
  • the position of the laser scanning may be a position moving every other set distance along the x-axis, moving a total of N times, moving one position every other set distance along the y-axis, and moving a total of N times to form a laser. (N+1)*(N+1) array.
  • the laser scanning may be centered on a certain set point, moved one position at a set angle along the circumferential direction, and moved M times to form a laser array.
  • the laser emitted by the laser can be a near-infrared laser.
  • the object to be tested may be a living small animal, and the test area may be a tissue or an organ of a small animal, such as a tumor area.
  • a laser having a wavelength of 488 nm is used to illuminate the analyte, and the fluorescent material in the analyte can emit fluorescence of 600 to 700 nm.
  • the laser and the fluorescence are not reflected by the plane mirror, specifically, the laser light passing through the object to be tested directly enters the CCD camera.
  • the fluorescence emitted by the fluorescent substance in the analyte directly enters the CCD camera.
  • the fundamental difference between the two acquisition methods is that the path from the laser and the fluorescence that is emitted from the object to be tested directly to the CCD camera is not changed.
  • the composite laser image may include multiple two-dimensional laser images
  • the composite fluorescent image may include multiple two-dimensional fluorescence images. As shown in FIG. 3, the composite fluorescent image 200 includes three two-dimensional fluorescent images 201, 202, and 203. .
  • the CT image or the MRI image of the object to be tested may be a three-dimensional image of the to-be-measured area of the object to be tested, and may be acquired in advance by a corresponding device.
  • the image acquired by the FDOT imaging system may be merged with the CT image or merged with the MRI image, so that the functional image provided by the FDOT can be compared and processed in the process of comparing with the CT image or the MRI image.
  • the spatial structure provided by the CT image or the MRI image is more intuitively and accurately presented.
  • the fluorescence scattering optical imaging system of the embodiment of the present invention can reflect the laser and the fluorescence from the object to be tested by using a plane mirror to reflect the laser and the fluorescence, thereby obtaining a richer two-dimensionality of the object to be tested.
  • the fluorescence image and the two-dimensional laser image information can be used to obtain a three-dimensional fluorescence image with higher imaging quality than the existing single-angle FDOT system.
  • FIG. 6 is a flow chart showing a method of imaging a three-dimensional fluorescence image according to an embodiment of the present invention.
  • the processor acquires position information of the CCD camera, position information of the optical fiber head, position information of the plane mirror, CT image or MRI image of the object to be tested, the composite fluorescent image and the composite
  • the laser image, and the method for generating the three-dimensional fluorescent image of the above-mentioned test area may include the following steps:
  • S341 The composite laser image and the composite fluorescent image are respectively cut into a plurality of single laser images and a plurality of single fluorescent images;
  • S342 Perform three-dimensional reconstruction according to the position information of the fiber head, the position information of the CCD camera, the position information of the plane mirror, the CT or MRI image of the object to be tested, the single laser image, and the single fluorescence image.
  • the software generates a three-dimensional fluorescence image of the above-mentioned area to be tested.
  • step S341 under the driving of the micro-displacement stage, when the laser scans the object to be tested from different positions, the CCD image is collected and saved as a laser-excited laser image sequence and a fluorescence image sequence, and the composite laser image and the composite laser image are When the composite fluorescent image is separately cut into a plurality of single laser images and a plurality of single fluorescent images, the laser image sequence and the fluorescent image sequence are trimmed.
  • the single laser image and the single fluorescent image may be images of the area to be tested.
  • the composite laser image and the composite fluorescent image are respectively cut into a plurality of single laser images and a plurality of single fluorescent images, and only the image of the area to be tested can be retained, and when the three-dimensional fluorescent image is generated, only for the test
  • the reconstruction of the image of the area eliminates the need to reconstruct the non-target imaging area, which helps to save the reconstruction time of the three-dimensional fluorescence image, thereby improving the imaging speed.
  • FIG. 7 is a flow chart showing a method of cropping a composite image into a single image in an embodiment of the present invention.
  • One side of the plane mirror is attached to the stage, and as shown in FIG. 7, in the above step S341, the above
  • the method for respectively cutting a composite laser image and a composite fluorescent image into a plurality of single laser images and a plurality of single fluorescent images may include the following steps:
  • the composite image (composite laser image, composite fluorescent image) is cut into a plurality of single images (single laser image, single fluorescent image) along the intersection of the plane of the plane mirror and the plane of the stage. .
  • the composite fluorescent image 200 is cropped into three single fluorescent images 201, 202, and 203 along the intersection lines 2021, 2031.
  • the clipping area 2022 of the single fluorescent image 202 and the clipping area 2032 of the single fluorescent image 203 can be selected according to requirements. For example, the square areas 2022 and 2032 as shown in FIG. 3 can be cut out, and then the object to be tested is obtained.
  • the image area corresponding to the area to be tested, or the two-dimensional fluorescence image and the laser image of the area to be tested are cut out only by one process, and can be selected as needed.
  • the composite laser image and the composite fluorescence image obtained by the method shown in FIG. 7 can be further cut into the laser of the region to be tested before being used to generate the three-dimensional fluorescence image.
  • the image is cut into a fluorescent image of the area to be tested to reduce the data processing amount of the processor and improve the imaging time of the three-dimensional fluorescent image.
  • a fluorescent filter is disposed in front of the CCD camera to filter out fluorescence emitted by the fluorescent substance.
  • the analyte is excited at 488 nm, and emits fluorescence of 600-700 nm.
  • the first filter is 488 nm.
  • the narrow bandpass (passband 10nm) filter only allows the CCD to capture 488nm light.
  • the CCD camera directly collects the laser light emitted from the laser fiber head and passes through the object to be tested, generates a first laser image, and simultaneously collects the laser light that passes through the object to be tested and is reflected by the plane mirror to generate a second In the laser image, the first laser image and the second laser image constitute the composite laser image.
  • a laser filter is disposed in front of the CCD camera to filter out the laser light emitted by the laser fiber head.
  • the object to be tested is excited at 488 nm, emitting fluorescence of 600-700 nm, and changing the filter.
  • the filter is a long pass filter of 600 nm or more, and the CCD camera collects a fluorescent image.
  • the method for the CCD camera to collect the composite fluorescent image from above the above stage may include the following steps:
  • the CCD camera directly collects fluorescence emitted by the fluorescent substance in the area to be detected, generates a first fluorescent image, and simultaneously collects fluorescence emitted by the fluorescent substance in the area to be measured and reflected by the planar mirror, to generate In the second fluorescent image, the first fluorescent image and the second fluorescent image constitute the composite fluorescent image.
  • FIG. 8 is a flow chart showing a method of imaging a three-dimensional fluorescence image according to an embodiment of the present invention.
  • step S342 based on the position information of the optical fiber head, the position information of the CCD camera, the position information of the plane mirror, the CT or MRI image of the object to be tested, and the single laser image.
  • the method for generating the three-dimensional fluorescence image of the to-be-tested area by using the three-dimensional reconstruction software includes the following steps:
  • S3421 meshing the CT image or the MRI image by using a volume mesh generation software to generate body surface mesh data of the to-be-tested area;
  • S3422 calculating, according to the position information of the CCD camera and the position information of the plane mirror, the position information of the CCD camera image in the plane mirror by using a specular reflection principle;
  • S3423 input position information of the optical fiber head, position information of the CCD camera, position information of the CCD camera image, the single laser image, the single fluorescence image, and the body surface mesh data into the three-dimensional reconstruction software. The above three-dimensional fluorescence image is calculated.
  • the volume mesh generation software may be a plurality of different meshing software, such as iso2mesh software.
  • the three-dimensional reconstruction software may be a plurality of different reconstruction software, such as toast software.
  • a finite element reference iterative algorithm is used to generate a fluorescence image, wherein the reference iterative algorithm is based on a coupling diffusion equation describing excitation light propagation and scattered light in the region to be tested:
  • ⁇ x is the photon density of the excitation light x
  • ⁇ m is the photon density of the scattered light m
  • Is the diffusion coefficient of the excitation light x Is the diffusion coefficient
  • Is the absorption coefficient of the excitation light x Is the absorption coefficient of the scattered light m
  • Is the scattering coefficient of the attenuation of the excitation light x Is the attenuation coefficient of the scattered light m
  • a is the boundary correlation coefficient of the internal reflection
  • S 0 represents the intensity of the point source
  • ⁇ (rr 0 ) is the Dirac-delta function centered on the point source of position r 0
  • ⁇ is the edge diffusion coefficient.
  • equations (1) and (2) The equation matrix obtained by the finite element discrete relation is shown in equations (1) and (2), and further obtains a series of equations for solving the inverse problem:
  • the parameters of the matrix [A x,m ] and the terms in the column vector ⁇ b x,m ⁇ can represent a Lagrangian basis function by a set of spatial variations; J x,m is derived from ⁇ x,m The object observes the Jacobian matrix of ⁇ at each boundary; ⁇ is the optical and fluorescence property distribution update vector; I is the identity matrix; ⁇ can be a scale or diagonal matrix; Is the transposed matrix of the matrix J x,m ; ⁇ is the fluorescence characteristic distribution vector, expressing D x , or ⁇ x,m is the photon density of the excitation light x or the scattered light m; Is the observed photon density of the excitation light x or the scattered light m; It is the calculated photon density of the excitation light x or the scattered light m.
  • the laser image and the fluorescence image are formed by iteratively solved by the equations (3) to (5), and the optical fluorescence characteristic distribution is updated from the properties of the properties
  • FIG. 9 is a flow chart showing a method of performing three-dimensional fluorescence image imaging in an embodiment of the present invention.
  • the position information of the optical fiber head, the position information of the CCD camera, the position information of the CCD camera image, the single laser image, the single fluorescent image, and the body surface The grid data is input into the above three-dimensional reconstruction software, and the method for calculating the three-dimensional fluorescence image is calculated, which may include the following steps:
  • S34231 scaling and matching the above laser image and the fluorescent image to an actual size of the to-be-measured area
  • S34232 input, in the above, the laser image after the scaling matching, the fluorescence image after the scaling matching, the position information of the optical fiber head, the position information of the CCD camera, the position information of the CCD camera image, and the body surface mesh data.
  • the above three-dimensional fluorescence image is calculated.
  • the fluorescence scattering optical imaging method comprises the steps of:
  • the filter For example, when the object is excited by a 488 nm laser and emits fluorescence of 600-700 nm, the filter with a long pass of 600 nm or more can be changed, so that the CCD collects a fluorescent image;
  • the fluorescent image includes a fluorescent image of the front side of the segmented object and a fluorescent image of the side surface.
  • the specific trimming step may include: selecting a region of interest ROI region of the object, such as a mouse lung (for example, a size of 1.2 cm*1.2 cm), and combining the laser image and the fluorescence image after the selected ROI region The actual dimensions of the objects are matched, then the ROI area is clipped and the Jacobian matrix is generated by the 3D reconstruction software.
  • the position information includes: position information of the CCD (for example, the position information of the CCD camera is "12 14 40 0 0 -1", which sequentially represents the coordinates of the x-axis, the y-axis, and the z-axis, and the unit is mm, and 0 0 -1 indicates that the CCD is Under the acquisition), the position information of the laser source (for example, the laser source position information is, for example, "12 14 - 5 0 0 1", which sequentially represents the coordinates of the x-axis, the y-axis, and the z-axis, and the unit is mm, and 0 0 1 represents the laser source.
  • position information of the CCD for example, the position information of the CCD camera is "12 14 40 0 0 -1", which sequentially represents the coordinates of the x-axis, the y-axis, and the z-axis, and the unit is mm
  • 0 0 1 represents the laser source.
  • mesh information ie, three-dimensional coordinates of the body surface mesh, for example, 25.595, 60.6565, 20.565, representing the coordinates of the x-axis, y-axis, and z-axis, respectively
  • three-dimensional reconstruction software for example, calling toastMapSolToMesh, toastSolutionMask, IWT2_P0, FDOTAdj0p or tostQvec, etc.
  • the fluorescence scattering optical imaging method of the embodiment of the invention can reflect the laser and the fluorescence from the object to be tested from the angle different from the real CCD camera by reflecting the laser and the fluorescence by the plane mirror, thereby obtaining a richer object to be tested.
  • the dimensional fluorescence image and the two-dimensional laser image information can improve the image reconstruction accuracy and improve the intensity of the reconstructed signal, and obtain a three-dimensional fluorescence image with higher imaging quality than the existing single-angle FDOT system.
  • the imaging system of the embodiment of the invention can realize multi-angle shooting only by a real CCD camera, and has the advantage of low equipment cost compared with the FDOT system of multi-angle imaging, and the real CCD camera and at least one CCD camera image are simultaneously taken. The laser image and the fluorescence image of the object are measured, and the imaging system of the present invention has a faster imaging speed.
  • embodiments of the present invention can be provided as a method, system, or computer program product. Accordingly, the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment, or a combination of software and hardware. Moreover, the invention can take the form of a computer program product embodied on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) including computer usable program code.
  • computer-usable storage media including but not limited to disk storage, CD-ROM, optical storage, etc.
  • the computer program instructions can also be stored in a computer readable memory that can direct a computer or other programmable data processing device to operate in a particular manner, such that the instructions stored in the computer readable memory produce an article of manufacture comprising the instruction device.
  • the apparatus implements the functions specified in one or more blocks of a flow or a flow and/or block diagram of the flowchart.
  • These computer program instructions can also be loaded onto a computer or other programmable data processing device such that a series of operational steps are performed on a computer or other programmable device to produce computer-implemented processing for execution on a computer or other programmable device.
  • the instructions provide steps for implementing the functions specified in one or more of the flow or in a block or blocks of a flow diagram.

Abstract

L'invention a pour objet un système d'imagerie optique diffuse à fluorescence et son procédé, lequel système comprend : un laser (101), une plateforme de microdéplacement (102), une platine porte-objet (103), au moins un miroir réfléchissant plat (104), un filtre optique (105), une caméra à dispositif à transfert de charge (106) et un processeur (107). Une tête de fibre optique du laser (101) se trouve sur la plateforme de microdéplacement (102). La surface réfléchissante du miroir réfléchissant plat (104) est orientée vers un objet à tester reposant sur la platine porte-objet (103). La plateforme de microdéplacement (102) et la caméra à dispositif à transfert de charge (106) sont connectées au processeur (107), la plateforme de microdéplacement (102) se déplaçant sur un plan bidimensionnel conformément aux signaux de commande du processeur (107). Le laser (101) est destiné à balayer une région à tester sur laquelle se trouve l'objet à tester contenant des matériaux fluorescents et la caméra à dispositif à transfert de charge (106) sert à obtenir des images fluorescentes et des images laser directement ou selon la réflectance du miroir réfléchissant plat (104). Le processeur (107) est destiné à acquérir les informations sur le positionnement de la caméra à dispositif à transfert de charge (106), les informations sur l'emplacement de la tête de fibre optique, les informations sur l'emplacement du miroir réfléchissant plat (104), les images CT ou les images MRI de l'objet à tester, les images fluorescentes et les images laser, et génère une image fluorescente tridimensionnelle de la région à tester. L'invention permet d'améliorer la qualité d'imagerie et de simplifier la structure du système.
PCT/CN2016/077225 2016-03-24 2016-03-24 Système d'imagerie optique diffuse à fluorescence et son procédé WO2017161535A1 (fr)

Priority Applications (2)

Application Number Priority Date Filing Date Title
PCT/CN2016/077225 WO2017161535A1 (fr) 2016-03-24 2016-03-24 Système d'imagerie optique diffuse à fluorescence et son procédé
CN201680000101.6A CN105873501B (zh) 2016-03-24 2016-03-24 荧光散射光学成像系统及方法

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2016/077225 WO2017161535A1 (fr) 2016-03-24 2016-03-24 Système d'imagerie optique diffuse à fluorescence et son procédé

Publications (1)

Publication Number Publication Date
WO2017161535A1 true WO2017161535A1 (fr) 2017-09-28

Family

ID=56655489

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2016/077225 WO2017161535A1 (fr) 2016-03-24 2016-03-24 Système d'imagerie optique diffuse à fluorescence et son procédé

Country Status (2)

Country Link
CN (1) CN105873501B (fr)
WO (1) WO2017161535A1 (fr)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113109307A (zh) * 2021-04-01 2021-07-13 南京超维景生物科技有限公司 位移控制方法及装置、电子设备及多光子荧光成像设备

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106404736A (zh) * 2016-11-30 2017-02-15 百奥森（江苏）食品安全科技有限公司 一种鸭肉中雌二醇的专用检测方法及其设备
CN111353967B (zh) * 2020-03-06 2021-08-24 浙江杜比医疗科技有限公司 一种图像获取方法、装置和电子设备及可读存储介质
CN113765585B (zh) * 2020-06-04 2024-03-26 中国电子科技集团公司第十一研究所 一种建立通信链接的方法及系统

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20050215873A1 (en) * 2002-06-11 2005-09-29 Deutsches Krebsforschungszentrum Stiftung Des Offentlichen Rechts Imaging method and device for carrying out said method
CN101147673A (zh) * 2007-11-02 2008-03-26 华中科技大学 旋转式扩散荧光层析成像系统
CN101810465A (zh) * 2009-02-19 2010-08-25 广州中科恺盛医疗科技有限公司 三维成像数据采集装置
CN101810466A (zh) * 2009-02-19 2010-08-25 田捷 多光谱成像装置
CN201641971U (zh) * 2009-02-19 2010-11-24 广州中科恺盛医疗科技有限公司 多角度成像装置
CN103070673A (zh) * 2013-02-05 2013-05-01 西安电子科技大学 一种在体小动物荧光分子断层成像系统与方法

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20050215873A1 (en) * 2002-06-11 2005-09-29 Deutsches Krebsforschungszentrum Stiftung Des Offentlichen Rechts Imaging method and device for carrying out said method
CN101147673A (zh) * 2007-11-02 2008-03-26 华中科技大学 旋转式扩散荧光层析成像系统
CN101810465A (zh) * 2009-02-19 2010-08-25 广州中科恺盛医疗科技有限公司 三维成像数据采集装置
CN101810466A (zh) * 2009-02-19 2010-08-25 田捷 多光谱成像装置
CN201641971U (zh) * 2009-02-19 2010-11-24 广州中科恺盛医疗科技有限公司 多角度成像装置
CN103070673A (zh) * 2013-02-05 2013-05-01 西安电子科技大学 一种在体小动物荧光分子断层成像系统与方法

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113109307A (zh) * 2021-04-01 2021-07-13 南京超维景生物科技有限公司 位移控制方法及装置、电子设备及多光子荧光成像设备

Also Published As

Publication number Publication date
CN105873501B (zh) 2019-03-08
CN105873501A (zh) 2016-08-17

Similar Documents

Publication Publication Date Title
US8044996B2 (en) Surface construction using combined photographic and structured light information
US10130318B2 (en) Integrated microtomography and optical imaging systems
JP6192297B2 (ja) 被検体情報取得装置、表示制御方法、およびプログラム
WO2017161535A1 (fr) Système d'imagerie optique diffuse à fluorescence et son procédé
CA3009090C (fr) Systeme d'imagerie medicale ayant un reseau fixe de detecteurs de rayons x et un reseau fixe d'emetteurs de rayons x pour produire une image numerique tridimensionnelle
US20210224508A1 (en) Synchronized surface and internal tumor detection
JP6304970B2 (ja) 画像処理装置、画像処理方法
JP5917037B2 (ja) 被検体情報取得装置および被検体情報取得方法
JP5761935B2 (ja) 被検体情報取得装置、被検体情報取得方法および被検体情報取得プログラム
JP2011516849A (ja) ３ｄ撮像システム
JP5984547B2 (ja) 被検体情報取得装置およびその制御方法
US7692160B2 (en) Method and system of optical imaging for target detection in a scattering medium
JP5847454B2 (ja) 被検体情報取得装置、表示制御方法およびプログラム
JP6234518B2 (ja) 情報処理装置および情報処理方法
JP6072206B2 (ja) 被検体情報取得装置および表示方法
Guggenheim et al. Multi-view, multi-spectral bioluminescence tomography
JP6625182B2 (ja) 情報処理装置、情報処理方法およびプログラム
JP2018012027A (ja) 記録データのデータ構造
JP6400068B2 (ja) 情報処理装置および情報処理方法
FR3004807A1 (fr) Methode d'imagerie en luminescence
JP5907039B2 (ja) 蛍光像再構成方法及び装置

Legal Events

Date Code Title Description
NENP Non-entry into the national phase

Ref country code: DE

121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 16894890

Country of ref document: EP

Kind code of ref document: A1

122 Ep: pct application non-entry in european phase

Ref document number: 16894890

Country of ref document: EP

Kind code of ref document: A1