CN204181710U - Hand-held molecular image navigation system - Google Patents

Abstract

A kind of hand-held molecular image navigation system, comprises multispectral light source module, for according to control signal sequence, provides the light of multiple different spectral coverage with time-division control mode, to irradiate detected object; Time-division control module, for generation of described control signal sequence; Optical signalling acquisition module, for the control signal sequence provided according to described time-division control module, gathers near-infrared fluorescent image and the visible images of detected object with time-division control mode; Processing module, for carrying out image procossing according to the near-infrared fluorescent image of described control signal sequence pair collection and visible images, realize the fusion of visible images and fluoroscopic image and export fusion image, and according to the near-infrared fluorescent image gathered and visible images output feedback signal, to be optimized described control signal sequence.

Description

Hand-held molecular image navigation system

Technical field

This utility model relates to a kind of imaging system, particularly a kind of hand-held molecular image navigation system.

Background technology

As new method and the means of noinvasive visible technology, the organism physiological molecule level change that the change that molecular image reflects molecular regulation in itself causes and the change of allomeric function.Therefore, the vital movement studying gene, biomacromolecule and cell at body (in vivo) is on a molecular scale a kind of important technology, wherein based on the basic research of the In Vivo bioluminescent imaging technology of molecular engineering, tomography technology, optical image technology, simulation methodology, one of the focus and difficult point of molecular image area research are become.

Traditional medicine image technology combines with modern molecular biology by molecular image equipment, can from cell, molecule aspect observation physiology or pathological change, have hurtless measure, in real time, the advantage such as live body, high specific, high sensitivity and high-resolution video picture.Utilize molecular image technology, the development speed of medicine can be accelerated on the one hand, search time before shortening clinical drug; There is provided and diagnose more accurately, make therapeutic scheme mate the gene mapping of patient best.On the other hand, can apply at biomedical sector, realize the target such as quantitative analysis, image navigation, molecule parting at body.But profit system relative complex in this way, ease of handling and comfort aspect need to be improved further.

Therefore the utility model proposes a kind of hand-held molecular image navigation system, by the different fluorescence of spectrum of Time-sharing control method and the realtime imaging of visible ray, strengthen the scope of application of application.

Utility model content

This utility model embodiment provides a kind of hand-held molecular image navigation system, comprising:

Multispectral light source module, for according to control signal sequence, provides the light of multiple different spectral coverage, to irradiate detected object with time-division control mode;

Time-division control module, for generation of described control signal sequence;

Optical signalling acquisition module, for the control signal sequence provided according to described time-division control module, gathers near-infrared fluorescent image and the visible images of detected object with time-division control mode;

Processing module, for carrying out image procossing according to the near-infrared fluorescent image of described control signal sequence pair collection and visible images, realize the fusion of visible images and fluoroscopic image and export fusion image, and according to the near-infrared fluorescent image gathered and visible images output feedback signal, to be optimized described control signal sequence.

Preferably, hand-held molecule image system also comprises hand held system holding module, for holding described multispectral light source module, described time-division control module and described signal acquisition module.

Preferably, described multispectral light source module comprises:

Background light source, for providing visible ray;

Near-infrared light source, for providing near infrared light; And

First multispectral switch, for according to the time dividing control signal sequence from described time-division control module, control background light source and near-infrared light source alternately opening and closing, thus irradiate visible ray when optical signalling acquisition module gathers fluoroscopic image, and irradiate near infrared light when gathering visible ray background image.

Preferably, described optical signalling acquisition module comprises:

Camera, for gathering near-infrared fluorescent image and the visible images of detected object;

Second multispectral switch, is arranged at the front end of camera;

Clock signal controller, for receiving the control signal sequence from time-division control module, and controls the switching of the second multispectral switch according to the control signal sequence received, so that camera carries out the collection of corresponding visible images and fluoroscopic image.

Preferably, described time-division control module comprises:

Pulse signal generator, for producing control signal according to different optical signal sources; And

Signal controller, for the control signal from pulse signal generator being converted to the control signal sequence with system available formats, to control the operation of the first spectrum switch and the second spectrum switch.

Preferably, described processing module comprises:

Sequencing contro feedback module, for monitoring the control signal sequence that described time-division control module exports according to the visible images gathered and fluoroscopic image, determine whether the operation needing the multispectral switch of adjustment first and/or the second multispectral switch, and return feedback signal based on determination result to signal controller;

Image processing module, for carrying out image procossing to the visible images collected and fluoroscopic image in the interval of each sequential, merging the near-infrared fluorescent image after the visible images after process and process, and exporting fusion image.

Embodiment of the present utility model at least has following technique effect:

First, owing to adopting portable equipment to gather image, can simplify the operation in the process of biomedical applications, expansive approach scope.

Secondly, owing to adopting the method for Time-sharing control, the collection of image and process is made to achieve multispectral realtime imaging.In addition, by arranging multispectral switch and time-division control module, multispectral light source module is switched with sequencing contro with the use of, make it possible to effectively to realize molecular image navigation, detection light intensity reaches maximum, effectively retains useful information.In practical operation, not only can see stronger fluorescence information, observation personnel also can be made to see the information of visible ray, the light of two spectrum can't influence each other.

Accompanying drawing explanation

Fig. 1 shows the schematic appearance of the hand held system holding module according to this utility model embodiment;

Fig. 2 shows the block diagram of the hand-held molecular image navigation system according to this utility model embodiment;

Fig. 3 shows the Control timing sequence schematic diagram of the time-division control module in Fig. 2.

Detailed description of the invention

For making the purpose of this utility model, technical scheme and advantage clearly understand, below in conjunction with specific embodiment, and with reference to accompanying drawing, this utility model is further described.

This utility model embodiment, based on the fluorescence excitation imaging in molecular image, provides a kind of hand-held molecular image navigation system.

Fig. 1 is the schematic appearance of the hand held system holding module according to this utility model embodiment.Fig. 2 is the block diagram of the hand-held molecular image navigation system according to this utility model embodiment.As shown in Figure 2, this hand-held molecular image navigation system can comprise multispectral light source module 110, for providing the light of multiple different spectral coverage with time-division control mode, to irradiate detected object; Time-division control module 130, for generation of control signal sequence; Optical signalling acquisition module 120, for the control signal sequence provided according to described time-division control module, gathers near-infrared fluorescent image and the visible images of detected object with time-division control mode; Processing module 140, for carrying out the process such as Iamge Segmentation, feature extraction, image registration according to the near-infrared fluorescent image of described control signal sequence pair collection and visible images, realizing the fusion of visible images and fluoroscopic image and exporting fusion image; And according to the near-infrared fluorescent image gathered and visible images output feedback signal, to be optimized control signal sequence.Hand-held molecule image system also comprises the hand held system holding module shown in Fig. 1, for holding described multispectral light source module, described time-division control module and described signal acquisition module, so that carry out operating and ensure effectively carrying out of imaging.

Next the operation of multispectral light source module 110, optical signalling acquisition module 120, time-division control module 130 and processing module 140 will be described respectively in detail.

Multispectral light source module 110 can comprise background light source 111, first multispectral switch 112 and near infrared laser 113.Background light source 111 is for providing visible ray.Near-infrared light source 113 for providing near infrared light, and can be set to the LED that centre wavelength is 760nm.First multispectral switch 112 is according to the time dividing control signal sequence from time-division control module 130, control background light source 111 and near-infrared light source 113 alternately opening and closing, thus irradiate visible ray when optical signalling acquisition module 120 gathers fluoroscopic image, and irradiate near infrared light when optical signalling acquisition module 120 gathers visible ray background image.Near infrared filter can be placed in the front end of near-infrared light source 113, and wavelength is 707nm-780nm.Visible filter can be placed in the front end of background light source 111, and wavelength is 400nm-650nm.Preferably, when irradiating fluorescence sequence signal, the first multispectral switch 112 switches to optical filter position 1, and it is 707nm-780nm that bandpass filter wavelength is placed in this position.When irradiating visible light sequential signal, the first multispectral switch 112 switches to position optical filter 2, and optical filter is not placed in this position.Utilize and place in optical filter position 2 bandpass filter that wavelength is 400nm-650nm, the wavelength of the visible ray that background light source 111 irradiates can be optimized further.

Optical signalling acquisition module 120 can comprise camera 121, second multispectral switch 122 and clock signal controller 123.Camera 121 is for gathering near-infrared fluorescent image and visible images.All applicable for visible images major part technical grade camera.Can be by the relative parameters setting of camera: quantum efficiency should higher than 30% at 800nm place, and frame speed is greater than 30fps, and image source size is greater than 5 microns.Clock signal controller 123 is for receiving the time dividing control signal sequence from time-division control module 130, and control the second multispectral switch 122 according to the time dividing control signal sequence received and switch between position 1 ' and position 2 ', so that camera carries out the collection of corresponding visible images and fluoroscopic image.Second multispectral switch 122 is arranged at the front end of camera 121, for switching according to the delayed control signal sequence from clock signal controller.When fluorescence image signal arrives, the second multispectral switch 122 switches to position 1 ', and the wavelength that optical filter is placed at position 1 ' place is 808-880nm.When visible image signal reaches, the second multispectral switch 122 switches to position 2 ', position 2 ' place free of light filter.

Time-division control module 130 comprises pulse signal generator 131 and signal controller 132.Pulse signal generator 131 produces control signal according to different signal sources, and the control signal of generation is sent to signal controller 132.Control signal from pulse signal generator 131 is converted to the control signal sequence with system available formats by signal controller 132, and is sent to the first spectrum switch 112 and clock signal controller 123.The control signal sequence received suitably postpones by clock signal controller 123, and uses the control signal sequence postponed to control the operation of the second spectrum switch 122.Certainly, clock signal controller 123 can be omitted, directly produce control signal sequence and delayed control signal sequence by signal controller 132, control the operation of the first spectrum switch 112 and the second spectrum switch 122 respectively.

Processing module 140 comprises sequencing contro feedback module 141 and image processing module 142.Sequencing contro feedback module 141 monitors according to the visible images gathered by camera 121 and fluoroscopic image the control signal sequence that time-division control module 130 exports.Particularly, sequencing contro feedback module 141 receives the visible images and fluoroscopic image that are gathered by camera 121, image light intensity according to the visible images received and fluoroscopic image determines whether the operation needing the multispectral switch of adjustment first 112 and/or the second multispectral switch 122, and when determining to need to adjust the operation of the first multispectral switch 112 and/or the second multispectral switch 122, return feedback signal to signal controller 132.Signal controller 132 adjusts the control signal sequence that will be sent to corresponding first multispectral switch 112 and/or the second multispectral switch 122 according to the feedback signal received.

Such as sequencing contro feedback module 141 determines that the brightness of the visible images received is excessive, then return feedback signal to signal controller 132, instruction is shortened the opening time of background light source 111 or is increased the opening time of near-infrared light source 113, or the persistent period that camera 121 gathers visible images is shortened in instruction; When sequencing contro feedback module 141 determines that the brightness of the visible images received is too small, then return feedback signal to signal controller 132, instruction increases the opening time of background light source 111 or shortens the opening time of near-infrared light source 113, or instruction extends the persistent period that camera 121 gathers visible images.In addition, according to the brightness (light intensity parameter) of the visible images received and fluoroscopic image, sequencing contro feedback module 141 can also return feedback signal to signal controller 132, indicate the grating in the multispectral switch of change first 1 and/or the second multispectral switch 2, change the acquisition time of corresponding light exposure rate and/or respective image.It will be appreciated by those skilled in the art that, the operation of the first multispectral switch 112 and/or the second multispectral switch 122 other operative combination of the first multispectral switch 112 and the second multispectral switch 122 can also be adopted, as long as can be adjusted according to the image light intensity of the visible images received and fluoroscopic image.

In addition, sequencing contro feedback module 141 can also receive from the control signal sequence of signal controller 132, respectively from the first and second feedback control signal sequences of the first multispectral switch 112 and the second multispectral switch 122, and control signal sequence and the first and second feedback control signal sequences is compared respectively.Such as the corresponding beginning of each control signal sequence and end point can compare by sequencing contro feedback module 141.If timing skew is more than the first predetermined threshold but be less than the second predetermined threshold, then sequencing contro feedback module 141 is to signal controller 132 feedback information, so that the control signal sequence that adjustment exports.If timing skew is more than the second predetermined threshold, sequencing contro feedback module 141 is determined automatically to adjust error, then produce reporting errors, error reporting is sent to signal controller 132, stop gathering with control assembly, and sort run when restarting after timing synchronization.

Image processing module 142 is configured to process the visible images collected and fluoroscopic image in the interval of each sequential.Concrete processing procedure can comprise collecting near-infrared fluorescent Image Segmentation Using, feature extraction and pseudocolor transformation; Brightness adjustment and optimization are carried out to the visible images collected, the near-infrared fluorescent image after the visible images after process and process is merged, and exports fusion image.

Next, composition graphs 2 and Fig. 3 are described in detail the Control timing sequence of the molecular image navigation system according to this utility model embodiment.

Fig. 3 shows the Control timing sequence schematic diagram of time-division control module in Fig. 2.As shown in Figure 3, the first multispectral switch 112 is according to the control signal sequence from signal controller 132, and at moment t1, background light source 111 is closed and near-infrared light source 113 opens to irradiate fluorescence signal to detected object.Now, the first multispectral switch 112 switches to optical filter position 1, and it is the bandpass filter of 707nm-780nm that wavelength is placed in this position.Clock signal controller 123 in optical signalling acquisition module 120 receives the control signal sequence from signal controller 132, carry out phase delay, control the second multispectral switch 122, when arriving from the reflected fluorescence signal that detected object reflects with box lunch, second multispectral switch 122 switches to position 1 ', the wavelength that optical filter is placed at position 1 ' place is 808nm-880nm, thus obtains the fluoroscopic image of detected object, and outputs to processing module 140.

At moment t2, background light source 111 is opened and near-infrared light source 113 is closed, to irradiate visible fluorescence signal to detected object.Now, the first multispectral switch 112 switches to optical filter position 2, this position free of light filter, or the visible filter being provided with that wavelength is 400nm-650nm.Clock signal controller 123 in optical signalling acquisition module 120 is according to the multispectral switch 122 of sequencing contro second, when arriving from the reflect visible light signal that detected object reflects with box lunch, second multispectral switch 122 switches to position 2 ', this position free of light filter, thus obtain the visible images of detected object, and output to processing module 140.

For the detailed process of image procossing and fluorescence excitation imaging, comprise two processes that are mutually related: excitation process and emission process.Excitation process uses excitation source that is monochromatic or arrowband to irradiate specific imaging region, and exciting light enters inside by surface, and forms certain light distribution therein.Emission process refers to that inner fluorogen can absorb the energy of external exciting light, and is partially converted into the utilizing emitted light that wavelength is longer, energy is lower, and utilizing emitted light appears, can by the optical filter of specific wavelength and the incompatible acquisition of highly sensitive detector set.Excite and launch two processes and can be described by the coupling of two diffusion equations:

$-\▿\·(\mathrm{Dx}\left(r\right)\▿\mathrm{\Φx}\left(r\right))+\mathrm{\μax}\left(r\right)\mathrm{\Φx}\left(r\right)=\mathrm{\Θ\δ}(r-\mathrm{rl})---\left(3\right)$

$-\▿\·(\mathrm{Dm}\left(r\right)\▿\mathrm{\Φm}\left(r\right))+\mathrm{\μam}\left(r\right)\mathrm{\Φm}\left(r\right)=\mathrm{\Φx}\left(r\right)\mathrm{\η\μaf}\left(r\right)---\left(4\right)$

Wherein, Ω represents the three dimensions of imaging object, and subscript x and m represents respectively and excites and utilizing emitted light; Φ x and Φ m represents photon density; μ ax and μ am represents optical absorption coefficient, and μ sx and μ sm represents optical scattering coefficient, and Dx, m=(3 μ ax, am+3 μ sx, sm (1-g))-1 represents diffusion coefficient, g expression anisotropy coefficient.

Utilize diffusion equation will add Robin boundary condition to during the modeling of exciting tomography fluorescence imaging problem:

${2D}_{x,m}\left(r\right)\frac{{\∂\mathrm{\Φ}}_{x,m}\left(r\right)}{\∂\stackrel{\→}{n}\left(r\right)}+\mathrm{\υ}{\mathrm{\Φ}}_{x,m}\left(r\right)=0---\left(5\right)$

Wherein, represent imaged object surface border, the unit normal vector outside presentation surface border is pointed to, v is used in characterizing boundary and the deviation of refractive indices outside border.V=(1-R)/(1+R), wherein parameter R is drawn by following formula:

R≈-1.4399n-2+0.7099n-1+0.6681+0.0636n (6)

N represents Refractive Index of Biotissue, for contactless exciting tomography fluorescence imaging system (imaging object is in atmosphere), and n ≈ 1.4.

Formula (3) and (4), after finite element discretization, can obtain following matrix form equation:

K _xΦ _x＝Q _x(7)

K _mΦ _m＝FX (8)

Because excitation process external excitation light distribution can be drawn by (7) direct solution, therefore equation can be reduced to:

${\mathrm{\Φ}}_m^{\mathrm{measns}}=K_m^{-1}\mathrm{FX}=A^{\mathrm{means}}X---\left(9\right)$

Its least square solution is obtained by calculating (9):

$\underset{X}{\min }E\left(X\right)={\left|\right|\mathrm{AX}-\mathrm{\Φ}\left|\right|}_2^2---\left(10\right)$

By above-mentioned calculating, until the quantity of support set element exceedes certain threshold values or residual error is less than threshold values, obtain distribution of light sources.

Above-described specific embodiment; the purpose of this utility model, technical scheme and beneficial effect are further described; be understood that; the foregoing is only specific embodiment of the utility model; be not limited to this utility model; all within spirit of the present utility model and principle, any amendment made, equivalent replacement, improvement etc., all should be included within protection domain of the present utility model.

Claims (6)

1. a hand-held molecular image navigation system, comprising:

Multispectral light source module (110), for according to control signal sequence, provides the light of multiple different spectral coverage, to irradiate detected object with time-division control mode;

Time-division control module (130), for generation of described control signal sequence;

Optical signalling acquisition module (120), for the control signal sequence provided according to described time-division control module, gathers near-infrared fluorescent image and the visible images of detected object with time-division control mode;

Processing module (140), for carrying out image procossing according to the near-infrared fluorescent image of described control signal sequence pair collection and visible images, realize the fusion of visible images and fluoroscopic image and export fusion image, and according to the near-infrared fluorescent image gathered and visible images output feedback signal, to be optimized described control signal sequence.

2. hand-held molecule image system according to claim 1, also comprises hand held system holding module for holding described multispectral light source module, described time-division control module and described signal acquisition module.

3. hand-held molecule image system according to claim 1, wherein, described multispectral light source module comprises:

Background light source, for providing visible ray;

Near-infrared light source, for providing near infrared light; And

First multispectral switch, for according to the time dividing control signal sequence from described time-division control module, control background light source and near-infrared light source alternately opening and closing, thus irradiate visible ray when optical signalling acquisition module gathers fluoroscopic image, and irradiate near infrared light when gathering visible ray background image.

4. hand-held molecule image system according to claim 1, wherein, described optical signalling acquisition module comprises:

Camera, for gathering near-infrared fluorescent image and the visible images of detected object;

Second multispectral switch, is arranged at the front end of camera;

Clock signal controller, for receiving the control signal sequence from time-division control module, and controls the switching of the second multispectral switch according to the control signal sequence received, so that camera carries out the collection of corresponding visible images and fluoroscopic image.

5. hand-held molecule image system according to claim 4, wherein, described time-division control module comprises:

Pulse signal generator, for producing control signal according to different signal sources; And

Signal controller, for the control signal from pulse signal generator being converted to the control signal sequence with system available formats, to control the operation of the first spectrum switch and the second spectrum switch.

6. hand-held molecule image system according to claim 5, wherein, described processing module comprises:

Sequencing contro feedback module, for monitoring the control signal sequence that described time-division control module exports according to the visible images gathered and fluoroscopic image, determine whether the operation needing the multispectral switch of adjustment first and/or the second multispectral switch, and return feedback signal based on determination result to signal controller;

Image processing module, for carrying out image procossing to the visible images collected and fluoroscopic image in the interval of each sequential, merging the near-infrared fluorescent image after the visible images after process and process, and exporting fusion image.