CN102809429A - Multi-spectral imaging system and multi-spectral imaging method based on double cameras - Google Patents
Multi-spectral imaging system and multi-spectral imaging method based on double cameras Download PDFInfo
- Publication number
- CN102809429A CN102809429A CN2012102630073A CN201210263007A CN102809429A CN 102809429 A CN102809429 A CN 102809429A CN 2012102630073 A CN2012102630073 A CN 2012102630073A CN 201210263007 A CN201210263007 A CN 201210263007A CN 102809429 A CN102809429 A CN 102809429A
- Authority
- CN
- China
- Prior art keywords
- module
- optical
- light source
- image
- ccd camera
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 20
- 238000000701 chemical imaging Methods 0.000 title claims abstract description 9
- 230000003287 optical effect Effects 0.000 claims abstract description 114
- 238000003384 imaging method Methods 0.000 claims abstract description 41
- 238000012545 processing Methods 0.000 claims abstract description 41
- 238000001228 spectrum Methods 0.000 claims description 33
- 229910052736 halogen Inorganic materials 0.000 claims description 22
- 150000002367 halogens Chemical class 0.000 claims description 22
- 230000011664 signaling Effects 0.000 claims description 22
- 230000003595 spectral effect Effects 0.000 claims description 16
- 239000011159 matrix material Substances 0.000 claims description 15
- 239000002184 metal Substances 0.000 claims description 15
- NJPPVKZQTLUDBO-UHFFFAOYSA-N novaluron Chemical compound C1=C(Cl)C(OC(F)(F)C(OC(F)(F)F)F)=CC=C1NC(=O)NC(=O)C1=C(F)C=CC=C1F NJPPVKZQTLUDBO-UHFFFAOYSA-N 0.000 claims description 15
- 230000011218 segmentation Effects 0.000 claims description 11
- 238000005267 amalgamation Methods 0.000 claims description 10
- 230000003760 hair shine Effects 0.000 claims description 9
- 230000008569 process Effects 0.000 claims description 7
- 239000011521 glass Substances 0.000 claims description 6
- 238000010586 diagram Methods 0.000 claims description 4
- 239000013307 optical fiber Substances 0.000 claims description 4
- 238000001914 filtration Methods 0.000 claims description 3
- 230000001105 regulatory effect Effects 0.000 claims description 3
- 238000003466 welding Methods 0.000 claims description 3
- 238000011160 research Methods 0.000 abstract description 4
- 239000000523 sample Substances 0.000 abstract description 2
- 230000004888 barrier function Effects 0.000 abstract 1
- 239000004744 fabric Substances 0.000 description 4
- 230000009286 beneficial effect Effects 0.000 description 3
- 238000012505 colouration Methods 0.000 description 3
- 230000000694 effects Effects 0.000 description 3
- 238000002474 experimental method Methods 0.000 description 3
- 238000010521 absorption reaction Methods 0.000 description 2
- 238000003491 array Methods 0.000 description 2
- 230000008901 benefit Effects 0.000 description 2
- 238000011161 development Methods 0.000 description 2
- 230000018109 developmental process Effects 0.000 description 2
- 240000005528 Arctium lappa Species 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 229940079593 drug Drugs 0.000 description 1
- 239000003814 drug Substances 0.000 description 1
- 230000005284 excitation Effects 0.000 description 1
- 210000000887 face Anatomy 0.000 description 1
- 239000007850 fluorescent dye Substances 0.000 description 1
- 238000012632 fluorescent imaging Methods 0.000 description 1
- 230000004927 fusion Effects 0.000 description 1
- 238000003709 image segmentation Methods 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 239000007788 liquid Substances 0.000 description 1
- 230000007774 longterm Effects 0.000 description 1
- 238000002595 magnetic resonance imaging Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000003333 near-infrared imaging Methods 0.000 description 1
- 230000009467 reduction Effects 0.000 description 1
- 238000000926 separation method Methods 0.000 description 1
- 238000002603 single-photon emission computed tomography Methods 0.000 description 1
- 230000001360 synchronised effect Effects 0.000 description 1
- 238000003325 tomography Methods 0.000 description 1
- 238000012795 verification Methods 0.000 description 1
Images
Abstract
The invention discloses a multi-spectral imaging system and a multi-spectral imaging method based on double cameras. The system comprises a system supporting module, a light source module, an optical signal acquiring module and a computer module, wherein the system supporting module is used for supporting and connecting various components; the light source module is used for providing infrared light and visible light; the optical signal acquiring module is used for acquiring fluorescent light and visible light images; and the computer module is used for controlling the optical signal acquiring module to acquire images, processing the acquired images and displaying the processed images. Light which passes through a lens is divided into two parts by an optical beam splitter prism, the two parts of light are simultaneously acquired by the two charged coupled device (CCD) cameras in real time, problems in the prior art are solved effectively, the technological monopoly of foreign companies in China is broken, the barrier of multi-spectral video imaging research is lowered, the selectable space for optical molecular image probes is expanded, and the optical molecular image research and application range is also expanded.
Description
Technical field
The present invention relates to the optical image technology field, particularly about a kind of multi-optical spectrum imaging system and method based on double camera.
Background technology
In recent years; Because the continuous development that molecular image learns a skill; After radionuclide imaging, positron emission computerized tomography, single photon emission computed tomography and magnetic resonance imaging, high-resolution optical imagery has appearred, and wherein the near-infrared fluorescent imaging receives much attention.Because ability and the power of tissue absorption light, characteristic, mechanics of biological tissue and the physicochemical characteristics thereof of light wave of light penetrate tissue all have relation.Near infrared light (the Near-Infrared of 650～900nm; NIR) be called as " tissue optical window (Tissue Optical Window) "; Compare with visible light and to have: (1) biological tissue is minimum to the absorption and the scattering effect of this wave band near infrared light, compares the tissue of the penetrable more deep layer of near infrared light with visible light; (2) because biological tissue is less to the AF of this wave band near infrared light, signal-to-background ratio (Signal-to-background ratio, SBR) relative advantages of higher.
The relevant in the market product of surveying near infrared light all is to adopt single camera to carry out real time imagery, because the near infrared light naked eyes are invisible, so the image that image that generally collects and naked eyes are seen is different.According to the international latest developments of reporting " Nature Medicine " in September, 2011; People such as Holland scientist Gooitzen M van Dam adopt the method for three camera collaborative works to take, and can see fluoroscopic image, coloured image and amalgamation image simultaneously.Wherein three cameras mainly are made up of three CCD, are used for color image shot (spectral range 400nm-650nm), fluoroscopic image (spectral range 745nm-845nm) and background image (spectral range 740nm-760nm) respectively.Carry out collaborative work through two computing machines, the image that synchronous processing photographs reaches the purpose that fluorescence, colour and amalgamation three width of cloth images show.
Because this technology need utilize three cameras and two computing machines to carry out collaborative work when concrete the realization, its intractability is big, realizes that cost is also higher.
Summary of the invention
The technical matters that (one) will solve
In view of this; The present invention is according to the characteristics of near infrared light; And based on long-term research experience in the near infrared imaging field; A kind of multi-optical spectrum imaging system and method based on double camera is provided, adopted two cameras and computing machine to realize the function of obtaining of fluorescence, colour and amalgamation image, reached the purpose that three width of cloth images show equally.
(2) technical scheme
According to an aspect of the present invention, the invention provides a kind of multi-optical spectrum imaging system based on double camera, comprising: system support module 110 is used for supporting and being connected each parts; Light source module 120 is used to provide near infrared light and visible light; Optical signalling acquisition module 130 is used to gather fluorescence and visible images; And computer module 140, be used to control optical signalling acquisition module 130 images acquired, the image that processing collected arrives, and the image after the display process.
In the such scheme, said system support module 110 comprises light source bracket 111, optical table support 112 and system frame 113, and wherein: light source bracket 111 is used for supporting light sources module 120; Optical table support 112 is used for support of optical signal acquisition module 130; System frame 113 is used to support optical table support 112 and light source bracket 111, and guarantees and can move.
In the such scheme, said light source bracket 111 is the LED near-infrared light sources 121 in the supporting light sources module 120, and connected mode is the handle of LED near-infrared light source 121 to be inserted the front end of light source bracket 111.Said optical table support 112 is articulated in the upper end of system frame 113.Said system frame 113 vertical scalable, the whole height scope is 1500mm-1800mm.
In the such scheme, said light source module 120 comprises LED near-infrared light source 121, Halogen lamp LED white light source 123, first optical filter 122 and the 4th optical filter 125, and wherein: LED near-infrared light source 121 is used to provide the near infrared light signal; First optical filter 122 is connected in LED near-infrared light source 121, and the near infrared light that LED near-infrared light source 121 provides sees through first optical filter 122 and shines search coverage; Halogen lamp LED white light source 123 is used to provide the visible light light signal; The 4th optical filter 125 is connected in Halogen lamp LED white light source 123, and the visible light light signal that Halogen lamp LED white light source 123 provides sees through the 4th optical filter 125 and shines search coverage.
In the such scheme; Said LED near-infrared light source 121 is welded on the circular circuit board by 47 LED lamps, and circuit board is with metal sleeve outward, and the circuit board that welding is good is placed on the metal sleeve bottom; Internal thread is arranged at the top, can be tightened with the quoit of first optical filter 122; Power lead is drawn by the bottom aperture, external power adapter, voltage 24V, power 20W.
In the such scheme, said first optical filter 122 is bandpass filters, and spectral range is 710nm-770nm; First optical filter 122 is with quoit, and a circle external thread is arranged on the circle.Said the 4th optical filter 125 is bandpass filters, and spectral range is 400nm-650nm; The 4th optical filter 125 is placed in the optical filtering film trap 104 of Halogen lamp LED white light source 123, and the light signal that Halogen lamp LED white light source 123 produces is drawn through optical fiber 105.
In the such scheme; Said optical signalling acquisition module 130 comprises camera lens 131, Amici prism 132, second optical filter 133, the 3rd optical filter 124, Near Infrared CCD camera 101 and colorful CCD camera 102; Wherein second optical filter 133 places the light well place of colorful CCD camera 102; The 3rd optical filter 124 places the light well place of Near Infrared CCD camera 101, and camera lens 131, Amici prism 132, Near Infrared CCD camera 101 and colorful CCD camera 102 are fixed on the same optical table according to axis alignment principle.
In the such scheme, said camera lens 131 is used to regulate image definition, guarantees field range.Said Amici prism 132 is made up of cube glass 1324, pedestal 1325 and 1326 of a metal shell through plated film; Be used for and be divided into two bundles with a branch of light; Wherein the cube glass 1324 through plated film is placed on the pedestal 1325; Pedestal 1325 tops are with metal shell 1326, are fixed by screw with pedestal 1325.4 circular holes are arranged on the said metal shell 1326, first hole 1321 is docked with camera lens 131, dock with colorful CCD camera 102 in second hole 1322, and dock with Near Infrared CCD camera 101 in the 3rd hole 1323.
In the such scheme, said second optical filter 133 is bandpass filters, and spectral range is 810nm-870nm; The 3rd optical filter 124 is bandpass filters, and spectral range is 400nm-650nm.
In the such scheme; Said computer module 140 comprises software control module 141, image processing module 142 and display module 143; Wherein software control module 141 is controlled optical signalling acquisition modules 130 images acquired; The image that image processing module 142 processing collected arrive, display module 143 is used for the image after the display process.
In the such scheme, said software control module 141 is that the data line 106 through Near Infrared CCD camera 101 in the optical signalling acquisition module 130 and colorful CCD camera 102 links to each other with computer module 140.Said image processing module 142 is used for processing optical signals acquisition module 130 Near Infrared CCD cameras 101 and colorful CCD camera 102 shot image data, accomplishes cut-point computing and overplay.
According to another aspect of the present invention, the invention provides a kind of multispectral imaging method based on double camera, be applied to described multi-optical spectrum imaging system based on double camera, comprising: 123 pairs of search coverages 103 of Halogen lamp LED white light source are shone; System support module 110 Adjustment System supports 113 are to proper height; Optical signalling acquisition module 130 is regulated camera lens 131 focal lengths; Software control module 141 is gathered colorful CCD camera 102 video images, and display module 141 shows in real time in the computer module 140, is adjusted into blur-free imaging; 121 pairs of search coverages 103 of LED near-infrared light source are shone, and software control module 141 switches to exposal model in the computer module 140, obtain one group of calibration image; Software control module 141 is gathered Near Infrared CCD camera 101 video images in the computer module 140, carries out real-time monitored; Software control module 141 switches to exposal model in the computer module 140, obtains the set of diagrams picture, files; And the image of 142 pairs of files of image processing module carries out computing, the computed segmentation point, and image processing module 142 carries out the image amalgamation according to the cut-point that calculates, and the image after display module 143 will be handled is shown on the graphoscope.
In the such scheme; 121 pairs of search coverages 103 of said LED near-infrared light source are shone; Software control module 141 switches to exposal model in the computer module 140, obtains in the step of one group of calibration image, and obtaining one group of calibration image is to prepare for image processing module 142 computed segmentation point.
In the such scheme, the image of 142 pairs of files of said image processing module carries out computing, and in the step of computed segmentation point, image processing module 142 computed segmentation points specifically comprise:
Step 501:MATLAB reads two cameras gained gradation of image value matrix of taking pictures;
Step 502: for seeking cut-point, variable i is set, j is 0;
Step 503: learn that through hardware information Near Infrared CCD camera 101 chip areas are 1.3 inches, photo resolution is 1024 * 1024, and colorful CCD camera 102 chip areas are 2/3 inch, and resolution is 2136 * 2548; Kit interpolation arithmetic through MATLAB software; Image resolution ratio is converted into 534 * 637; Near Infrared CCD camera 101 is obtained in the image with i, and j is that the data matrix of one 534 * 637 of basic point choice is composed to A, and colorful CCD camera 102 image arrays are composed to B after the interpolation;
Step 504: the average of each point is composed to mA among the compute matrix A, calculates through formula
Step 505: the average of each point is composed to mB among the compute matrix B, calculates through formula
Step 506:, calculate according to matrix A, B and mA, mB
Calculate the related coefficient of A, B then
Step 507: obtain this related coefficient i=i+533 afterwards, j=j+636 repeats the 504-506 step again, and relatively the size of two related coefficients is got smaller value, and record i, the numerical value of j;
Step 508: interative computation 200 times, finally return i, the value of j.
(3) beneficial effect
Can find out that from technique scheme the present invention has following beneficial effect:
1, utilize the present invention,, reach the purpose that three width of cloth images show equally, so intractability and realization cost is than all reductions greatly of prior art owing to only adopt two cameras and computing machine just can realize the function of obtaining of fluorescence, colour and amalgamation image.
2, utilize the present invention,, realized dynamically observing continuously fluorescence because near infrared light in biological optical window field, in conjunction with the imaging basis of early stage in the molecular image field, utilizes the high resolution observations camera.
3, utilize the present invention, because the accurate algorithm of computing machine calculates with handling, so reached on the image of macroscopic colorama, the effect of stack fluoroscopic image information has realized the pinpoint purpose of fluorescence.
4, utilize the present invention, because the design of support, handled easily makes dynamic Continuous Observation become possibility, so on reality is used, greatly reduce the loaded down with trivial details degree of operation.
5, utilize the present invention, because the configuration of the Reasonable Parameters of optical filter makes that surveying light intensity reaches maximum, so the useful information that the most effectively keeps.
6, utilize the present invention; Because experiment needs lucifuge to carry out; So through the separation of light source light spectrum, make and in practical operation, not only can see stronger fluorescence information, the irradiation of white light also can be so that the observation personnel see visible information simultaneously; The light of two spectrum can't influence each other simultaneously, has the most effectively solved the difficulty that faces in the actual experiment.
Description of drawings
Fig. 1 is the structural representation based on the multi-optical spectrum imaging system of double camera according to the embodiment of the invention;
Fig. 2 is the schematic diagram based on the multi-optical spectrum imaging system of double camera according to the embodiment of the invention;
Fig. 3 is the structural representation based on prism in the multi-optical spectrum imaging system of double camera according to the embodiment of the invention;
Fig. 4 is the structural representation based on the multi-optical spectrum imaging system medium-height trestle of double camera according to the embodiment of the invention;
Fig. 5 is the algorithm flow chart based on image processing module cut-point calculating in the multi-optical spectrum imaging system of double camera according to the embodiment of the invention;
Fig. 6 a to Fig. 6 c is the figure as a result of case study on implementation of the present invention.
Embodiment
For making the object of the invention, technical scheme and advantage clearer, below in conjunction with specific embodiment, and with reference to accompanying drawing, to further explain of the present invention.
The present invention adopts the optics Amici prism to be divided into two through the light of camera lens, gathers in real time simultaneously with two CCD cameras.Before each camera, increase bandpass filter, make two cameras in different optical wavelength range, form images respectively, finally carry out Flame Image Process, the image of different spectral coverage is stitched to together, realize the image effect of fluorescence and visible light fusion through software.Most on the market at present near-infrared video imaging products all adopt single CCD camera to be carried out to picture, can only see fluoroscopic image when its shortcoming is to form images, and can't see the visible images of people's finding of naked eye.And the present invention has effectively solved this problem; Also broken simultaneously the technical monopoly situation of offshore company in China; Reduce the threshold of multispectral video imaging research, expanded the alternative space of optical molecular image probe, extended the scope of optical molecular imaging study and application.
As shown in Figure 1; Fig. 1 is the structural representation based on the multi-optical spectrum imaging system of double camera according to the embodiment of the invention; Should comprise system support module 110, light source module 120, optical signalling acquisition module 130 and computer module 140 based on the multi-optical spectrum imaging system of double camera, wherein system support module 110 is used for supporting and being connected each parts, and light source module 120 is used to provide near infrared light and visible light; Optical signalling acquisition module 130 is used to gather fluorescence and visible images; Computer module 140 is used to control optical signalling acquisition module 130 images acquired, the image that processing collected arrives, and the image after the display process.
System support module 110 comprises light source bracket 111, optical table support 112 and system frame 113, and wherein: light source bracket 111 is used for supporting light sources module 120; Optical table support 112 is used for support of optical signal acquisition module 130; System frame 113 is used to support optical table support 112 and light source bracket 111, and guarantees and can move.Said light source bracket 111 is the LED near-infrared light sources 121 in the supporting light sources module 120, and connected mode is the handle of LED near-infrared light source 121 to be inserted the front end of light source bracket 111.Said optical table support 112 is articulated in the upper end of system frame 113.Said system frame 113 vertical scalable, the whole height scope is 1500mm-1800mm.
Light source module 120 comprises LED near-infrared light source 121, Halogen lamp LED white light source 123, first optical filter 122 and the 4th optical filter 125, and wherein: LED near-infrared light source 121 is used to provide the near infrared light signal; First optical filter 122 is connected in LED near-infrared light source 121, and the near infrared light that LED near-infrared light source 121 provides sees through first optical filter 122 and shines search coverage; Halogen lamp LED white light source 123 is used to provide the visible light light signal; The 4th optical filter 125 is connected in Halogen lamp LED white light source 123, and the visible light light signal that Halogen lamp LED white light source 123 provides sees through the 4th optical filter 125 and shines search coverage.
LED near-infrared light source 121 is welded on the circular circuit board by 47 LED lamps, and circuit board is with metal sleeve outward, and the circuit board that welding is good is placed on the metal sleeve bottom, and internal thread is arranged at the top, can be tightened with the quoit of first optical filter 122; Power lead is drawn by the bottom aperture, external power adapter, voltage 24V, power 20W.First optical filter 122 is bandpass filters, and spectral range is 710nm-770nm; First optical filter 122 is with quoit, and a circle external thread is arranged on the circle.Said the 4th optical filter 125 is bandpass filters, and spectral range is 400nm-650nm; The 4th optical filter 125 is placed in the optical filtering film trap 104 of Halogen lamp LED white light source 123, and the light signal that Halogen lamp LED white light source 123 produces is drawn through optical fiber 105.
Optical signalling acquisition module 130 comprises camera lens 131, Amici prism 132, second optical filter 133, the 3rd optical filter 124, Near Infrared CCD camera 101 and colorful CCD camera 102; Wherein second optical filter 133 places the light well place of colorful CCD camera 102; The 3rd optical filter 124 places the light well place of Near Infrared CCD camera 101, and camera lens 131, Amici prism 132, Near Infrared CCD camera 101 and colorful CCD camera 102 are fixed on the same optical table according to axis alignment principle.
In a preferred embodiment; Optical signalling acquisition module 130 assembles according to shown in Figure 2; Optical signalling acquisition module 130 is fixed on the optical table support 112; Be articulated in the upper end of system frame 113 according to optical table support 112 shown in Figure 4, LED near-infrared light source 121 inserts in the light source brackets 111.System support module 110 moves to directly over the search coverage 103, and data line 106 connects with computer module 140 corresponding ports.Optical fiber 105 is fixed on the light source bracket 111 in the light source module 120, and Halogen lamp LED white light source 123 is aimed at search coverage 103 and shone.Colorful CCD camera 102 video images are gathered in software control module 141 controls, and optical signalling acquisition module 130 adjustment camera lenses 131 focal lengths guarantee blur-free imaging.Software control module 141 obtains Near Infrared CCD camera 101 and colorful CCD camera 102 images, and preserves.With gobo search coverage 103 being carried out lucifuge handles.The LED near-infrared light source is aimed at search coverage 103 and is shone.Near Infrared CCD camera 101 video images are gathered in software control module 141 controls, after shot object is placed best shooting angle, keep motionless, and software control module 141 is gathered Near Infrared CCD camera 101 and colorful CCD camera 102 images.Image processing module 142 calculates the Near Infrared CCD camera 101 and colorful CCD camera 102 image segmentation point that obtains.It is green that image processing module 142 obtains image increase puppet with Near Infrared CCD camera 101, gathers colorful CCD camera 102 images Near Infrared CCD camera 101 images green with increasing puppet in the image processing module 142 usefulness cut-point amalgamations 5.
To the multi-optical spectrum imaging system based on double camera shown in Figure 4, the present invention also provides a kind of multispectral imaging method based on double camera based on Fig. 1, and this method comprises:
123 pairs of search coverages 103 of Halogen lamp LED white light source are shone;
System support module 110 Adjustment System supports 113 are to proper height; Optical signalling acquisition module 130 is regulated camera lens 131 focal lengths; Software control module 141 is gathered colorful CCD camera 102 video images, and display module 141 shows in real time in the computer module 140, is adjusted into blur-free imaging;
121 pairs of search coverages 103 of LED near-infrared light source are shone, and software control module 141 switches to exposal model in the computer module 140, obtain one group of calibration image;
Software control module 141 is gathered Near Infrared CCD camera 101 video images in the computer module 140, carries out real-time monitored;
Software control module 141 switches to exposal model in the computer module 140, obtains the set of diagrams picture, files; And
The image of 142 pairs of files of image processing module carries out computing, the computed segmentation point, and image processing module 142 carries out the image amalgamation according to the cut-point that calculates, and the image after display module 143 will be handled is shown on the graphoscope.
Wherein, 121 pairs of search coverages 103 of said LED near-infrared light source are shone; Software control module 141 switches to exposal model in the computer module 140, obtains in the step of one group of calibration image, and obtaining one group of calibration image is to prepare for image processing module 142 computed segmentation point.
Step 501:MATLAB reads two cameras gained gradation of image value matrix of taking pictures;
Step 502: for seeking cut-point, variable i is set, j is 0;
Step 503: learn that through hardware information Near Infrared CCD camera 101 chip areas are 1.3 inches, photo resolution is 1024 * 1024, and colorful CCD camera 102 chip areas are 2/3 inch, and resolution is 2136 * 2548; Kit interpolation arithmetic through MATLAB software; Image resolution ratio is converted into 534 * 637; Near Infrared CCD camera 101 is obtained in the image with i, and j is that the data matrix of one 534 * 637 of basic point choice is composed to A, and colorful CCD camera 102 image arrays are composed to B after the interpolation;
Step 504: the average of each point is composed to mA among the compute matrix A, calculates through formula
Step 505: the average of each point is composed to mB among the compute matrix B, calculates through formula
Step 506:, calculate according to matrix A, B and mA, mB
Calculate the related coefficient of A, B then
Step 507: obtain this related coefficient i=i+533 afterwards, j=j+636 repeats the 504-506 step again, and relatively the size of two related coefficients is got smaller value, and record i, the numerical value of j;
Step 508: interative computation 200 times, finally return i, the value of j.
Experimental result is shown in Fig. 6 a to Fig. 6 c, and the present invention uses the CG fluorescent dye of 0.01mg/ml concentration to inject the EP pipe as experiment, the feasibility of verification system.Can see that Fig. 6 a is the image that Near Infrared CCD camera 101 photographed, Fig. 6 b is the image that colorful CCD camera 102 photographed.Fig. 6 c is the image after image processing module 142 calculates amalgamation.Can see; Though be transparency liquid among Fig. 6 b that sees through naked eyes; But after the excitation source irradiation; Find out that obviously Fig. 6 a has fluorescence to send, through image processing module 142 two width of cloth images are carried out amalgamation, we have just seen Fig. 6 b image information simultaneously on macroscopic Fig. 6 a image.
Above-described specific embodiment; The object of the invention, technical scheme and beneficial effect have been carried out further explain, and institute it should be understood that the above is merely specific embodiment of the present invention; Be not limited to the present invention; All within spirit of the present invention and principle, any modification of being made, be equal to replacement, improvement etc., all should be included within protection scope of the present invention.
Claims (20)
1. the multi-optical spectrum imaging system based on double camera is characterized in that, comprising:
System support module (110) is used for supporting and being connected each parts;
Light source module (120) is used to provide near infrared light and visible light;
Optical signalling acquisition module (130) is used to gather fluorescence and visible images; And
Computer module (140) is used to control optical signalling acquisition module (130) images acquired, the image that processing collected arrives, and the image after the display process.
2. the multi-optical spectrum imaging system based on double camera according to claim 1 is characterized in that, said system support module (110) comprises light source bracket (111), optical table support (112) and system frame (113), wherein:
Light source bracket (111) is used for supporting light sources module (120);
Optical table support (112) is used for support of optical signal acquisition module (130);
System frame (113) is used to support optical table support (112) and light source bracket (111), and guarantees and can move.
3. the multi-optical spectrum imaging system based on double camera according to claim 2; It is characterized in that; Said light source bracket (111) is the LED near-infrared light source (121) in the supporting light sources module (120), and connected mode is the handle of LED near-infrared light source (121) to be inserted the front end of light source bracket (111).
4. the multi-optical spectrum imaging system based on double camera according to claim 2 is characterized in that, said optical table support (112) is articulated in the upper end of system frame (113).
5. the multi-optical spectrum imaging system based on double camera according to claim 2 is characterized in that, said system frame (113) is scalable vertically, and the whole height scope is 1500mm-1800mm.
6. the multi-optical spectrum imaging system based on double camera according to claim 1; It is characterized in that; Said light source module (120) comprises LED near-infrared light source (121), Halogen lamp LED white light source (123), first optical filter (122) and the 4th optical filter (125), wherein:
LED near-infrared light source (121) is used to provide the near infrared light signal;
First optical filter (122) is connected in LED near-infrared light source (121), and the near infrared light that LED near-infrared light source (121) provides sees through first optical filter (122) and shines search coverage;
Halogen lamp LED white light source (123) is used to provide the visible light light signal;
The 4th optical filter (125) is connected in Halogen lamp LED white light source (123), and the visible light light signal that Halogen lamp LED white light source (123) provides sees through the 4th optical filter (125) and shines search coverage.
7. the multi-optical spectrum imaging system based on double camera according to claim 6; It is characterized in that; Said LED near-infrared light source (121) is welded on the circular circuit board by 47 LED lamps, and circuit board is with metal sleeve outward, and the circuit board that welding is good is placed on the metal sleeve bottom; Internal thread is arranged at the top, can be tightened with the quoit of first optical filter (122); Power lead is drawn by the bottom aperture, external power adapter, voltage 24V, power 20W.
8. the multi-optical spectrum imaging system based on double camera according to claim 6 is characterized in that, said first optical filter (122) is a bandpass filter, and spectral range is 710nm-770nm; First optical filter (122) is with quoit, and a circle external thread is arranged on the circle.
9. the multi-optical spectrum imaging system based on double camera according to claim 6 is characterized in that, said the 4th optical filter (125) is a bandpass filter, and spectral range is 400nm-650nm; The 4th optical filter (125) is placed in the optical filtering film trap (104) of Halogen lamp LED white light source (123), and the light signal that Halogen lamp LED white light source (123) produces is drawn through optical fiber (105).
10. the multi-optical spectrum imaging system based on double camera according to claim 1; It is characterized in that; Said optical signalling acquisition module (130) comprises camera lens (131), Amici prism (132), second optical filter (133), the 3rd optical filter (124), Near Infrared CCD camera (101) and colorful CCD camera (102); Wherein second optical filter (133) places the light well place of colorful CCD camera (102); The 3rd optical filter (124) places the light well place of Near Infrared CCD camera (101), and camera lens (131), Amici prism (132), Near Infrared CCD camera (101) and colorful CCD camera (102) are fixed on the same optical table according to axis alignment principle.
11. the multi-optical spectrum imaging system based on double camera according to claim 10 is characterized in that, said camera lens (131) is used to regulate image definition, guarantees field range.
12. the multi-optical spectrum imaging system based on double camera according to claim 10; It is characterized in that; Said Amici prism (132) is made up of cube glass (1324), pedestal (1325) and a metal shell (1326) through plated film, is used for be divided into two bundles with a branch of light, and the cube glass (1324) that wherein passes through plated film is placed on the pedestal (1325); Pedestal (1325) top is with metal shell (1326), is fixed by screw with pedestal (1325).
13. the multi-optical spectrum imaging system based on double camera according to claim 12; It is characterized in that; 4 circular holes are arranged on the said metal shell (1326); First hole (1321) are docked with camera lens (131), and dock with colorful CCD camera (102) second hole (1322), and dock with Near Infrared CCD camera (101) the 3rd hole (1323).
14. the multi-optical spectrum imaging system based on double camera according to claim 10 is characterized in that, said second optical filter (133) is a bandpass filter, and spectral range is 810nm-870nm; The 3rd optical filter (124) is a bandpass filter, and spectral range is 400nm-650nm.
15. the multi-optical spectrum imaging system based on double camera according to claim 1; It is characterized in that; Said computer module (140) comprises software control module (141), image processing module (142) and display module (143); Wherein software control module (141) is controlled optical signalling acquisition module (130) images acquired, the image that image processing module (142) processing collected arrives, and display module (143) is used for the image after the display process.
16. the multi-optical spectrum imaging system based on double camera according to claim 15; It is characterized in that said software control module (141) is that the data line (106) through Near Infrared CCD camera (101) in the optical signalling acquisition module (130) and colorful CCD camera (102) links to each other with computer module (140).
17. the multi-optical spectrum imaging system based on double camera according to claim 15; It is characterized in that; Said image processing module (142) is used for processing optical signals acquisition module (130) Near Infrared CCD camera (101) and colorful CCD camera (102) shot image data, accomplishes cut-point computing and overplay.
18. the multispectral imaging method based on double camera is applied to each described system in the claim 1 to 17, it is characterized in that, comprising:
Halogen lamp LED white light source (123) shines search coverage (103);
System support module (110) Adjustment System support (113) is to proper height; Optical signalling acquisition module (130) is regulated camera lens (131) focal length; Software control module (141) is gathered colorful CCD camera (102) video image; Display module (141) shows in real time in the computer module (140), is adjusted into blur-free imaging;
LED near-infrared light source (121) shines search coverage (103), and software control module (141) switches to exposal model in the computer module (140), obtains one group of calibration image;
Software control module (141) is gathered Near Infrared CCD camera (101) video image in the computer module (140), carries out real-time monitored;
Software control module (141) switches to exposal model in the computer module (140), obtains the set of diagrams picture, files; And
Image processing module (142) carries out computing to the image that files, the computed segmentation point, and image processing module (142) carries out the image amalgamation according to the cut-point that calculates, and the image after display module (143) will be handled is shown on the graphoscope.
19. the multispectral imaging method based on double camera according to claim 18; It is characterized in that; Said LED near-infrared light source (121) shines search coverage (103); Software control module (141) switches to exposal model in the computer module (140), obtains in the step of one group of calibration image, and obtaining one group of calibration image is to prepare for image processing module (142) computed segmentation point.
20. the multispectral imaging method based on double camera according to claim 18 is characterized in that, said image processing module (142) carries out computing to the image that files, and in the step of computed segmentation point, image processing module (142) computed segmentation point specifically comprises:
Step 501:MATLAB reads two cameras gained gradation of image value matrix of taking pictures;
Step 502: for seeking cut-point, variable i is set, j is 0;
Step 503: learn that through hardware information Near Infrared CCD camera (101) chip area is 1.3 inches, photo resolution is 1024 * 1024, and colorful CCD camera (102) chip area is 2/3 inch, and resolution is 2136 * 2548; Kit interpolation arithmetic through MATLAB software; Image resolution ratio is converted into 534 * 637; Near Infrared CCD camera (101) is obtained in the image with i, and j is that the data matrix of one 534 * 637 of basic point choice is composed to A, and colorful CCD camera after the interpolation (102) image array is composed to B;
Step 504: the average of each point is composed to mA among the compute matrix A, through formula calculates
Step 505: the average of each point is composed to mB among the compute matrix B, through formula calculates
Step 506: according to matrix A, B and mA, mB, calculating
calculates the related coefficient
of A, B then
Step 507: obtain this related coefficient i=i+533 afterwards, j=j+636 repeats the 504-506 step again, and relatively the size of two related coefficients is got smaller value, and record i, the numerical value of j;
Step 508: interative computation 200 times, finally return i, the value of j.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2012102630073A CN102809429A (en) | 2012-07-26 | 2012-07-26 | Multi-spectral imaging system and multi-spectral imaging method based on double cameras |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2012102630073A CN102809429A (en) | 2012-07-26 | 2012-07-26 | Multi-spectral imaging system and multi-spectral imaging method based on double cameras |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN102809429A true CN102809429A (en) | 2012-12-05 |
Family
ID=47233199
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN2012102630073A Pending CN102809429A (en) | 2012-07-26 | 2012-07-26 | Multi-spectral imaging system and multi-spectral imaging method based on double cameras |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN102809429A (en) |
Cited By (20)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103284681A (en) * | 2013-05-24 | 2013-09-11 | 中国科学院苏州生物医学工程技术研究所 | Double spectrum imaging device in blood vessels |
| CN103300812A (en) * | 2013-06-27 | 2013-09-18 | 中国科学院自动化研究所 | Endoscope-based multispectral video navigation system and method |
| CN103340601A (en) * | 2013-06-27 | 2013-10-09 | 中国科学院自动化研究所 | Multi-spectral imaging system and method based on endoscope |
| CN103411885A (en) * | 2013-07-18 | 2013-11-27 | 江苏大学 | Diffuse reflection illumination apparatus of multispectral imaging system |
| CN104116497A (en) * | 2014-07-22 | 2014-10-29 | 中国科学院自动化研究所 | Endoscopic optical molecular imaging guidance system and multi-spectral imaging method |
| CN104202587A (en) * | 2014-08-08 | 2014-12-10 | 娄定风 | Three-dimensional multispectral insect distinguishing device and identifying method thereof |
| WO2014205738A1 (en) * | 2013-06-27 | 2014-12-31 | 中国科学院自动化研究所 | Endoscope-based multispectral video navigation system and method |
| CN105054890A (en) * | 2015-09-07 | 2015-11-18 | 中国医学科学院生物医学工程研究所 | Tumor tissue detection device based on endoscope |
| WO2016029403A1 (en) * | 2014-08-28 | 2016-03-03 | 中国科学院自动化研究所 | Head-mounted molecular image navigation system |
| WO2016041155A1 (en) * | 2014-09-16 | 2016-03-24 | 中国科学院自动化研究所 | Three-dimensional optical molecular image navigation system and method |
| CN106124049A (en) * | 2016-06-20 | 2016-11-16 | 福州大学 | A kind of implementation method of Vegetation canopy multi-optical spectrum imaging system |
| CN107170015A (en) * | 2017-05-17 | 2017-09-15 | 海南大学 | A kind of giant clam outer embrane picture collection device and its application method |
| CN107230185A (en) * | 2017-05-03 | 2017-10-03 | 北京理工大学 | Alignment schemes for double camera image in Hyper spectral Imaging platform |
| CN107349433A (en) * | 2017-06-30 | 2017-11-17 | 中国科学院自动化研究所 | Near-infrared nano-probe, preparation method and holographic molecular image navigation system |
| CN107728421A (en) * | 2017-11-05 | 2018-02-23 | 信利光电股份有限公司 | A kind of calibration method and calibration system of multispectral multi-cam module |
| WO2018064903A1 (en) * | 2016-10-08 | 2018-04-12 | 杭州海康威视数字技术股份有限公司 | Camera lens and video camera |
| CN107911692A (en) * | 2017-11-05 | 2018-04-13 | 信利光电股份有限公司 | A kind of calibration method of multispectral multi-cam module |
| CN108896545A (en) * | 2018-05-09 | 2018-11-27 | 歌尔股份有限公司 | Gluing detection method, device and computer readable storage medium |
| CN109738069A (en) * | 2018-12-27 | 2019-05-10 | 浙江农林大学暨阳学院 | The method that multispectral imaging illuminates spatial heterogeneity correction |
| CN110031411A (en) * | 2019-04-17 | 2019-07-19 | 南京邮电大学 | A kind of spectrum imaging system |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2000006980A1 (en) * | 1998-07-27 | 2000-02-10 | Cedars-Sinai Medical Center | Spectral topography of mammalian matter |
| WO2011113162A1 (en) * | 2010-03-17 | 2011-09-22 | Haishan Zeng | Rapid multi-spectral imaging methods and apparatus and applications for cancer detection and localization |
| CN102397106A (en) * | 2011-10-03 | 2012-04-04 | 杨晓峰 | Multispectral light-splitting fused surgical operation guide system |
| WO2012041553A1 (en) * | 2010-09-28 | 2012-04-05 | Leica Geosystems Ag | Digital multi-spectral camera system having at least two independent digital cameras |
| CN102721469A (en) * | 2012-06-14 | 2012-10-10 | 中国科学院自动化研究所 | Multispectral imaging system and method based on two cameras |
-
2012
- 2012-07-26 CN CN2012102630073A patent/CN102809429A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2000006980A1 (en) * | 1998-07-27 | 2000-02-10 | Cedars-Sinai Medical Center | Spectral topography of mammalian matter |
| WO2011113162A1 (en) * | 2010-03-17 | 2011-09-22 | Haishan Zeng | Rapid multi-spectral imaging methods and apparatus and applications for cancer detection and localization |
| WO2012041553A1 (en) * | 2010-09-28 | 2012-04-05 | Leica Geosystems Ag | Digital multi-spectral camera system having at least two independent digital cameras |
| CN102397106A (en) * | 2011-10-03 | 2012-04-04 | 杨晓峰 | Multispectral light-splitting fused surgical operation guide system |
| CN102721469A (en) * | 2012-06-14 | 2012-10-10 | 中国科学院自动化研究所 | Multispectral imaging system and method based on two cameras |
Cited By (24)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103284681A (en) * | 2013-05-24 | 2013-09-11 | 中国科学院苏州生物医学工程技术研究所 | Double spectrum imaging device in blood vessels |
| WO2014205738A1 (en) * | 2013-06-27 | 2014-12-31 | 中国科学院自动化研究所 | Endoscope-based multispectral video navigation system and method |
| CN103300812A (en) * | 2013-06-27 | 2013-09-18 | 中国科学院自动化研究所 | Endoscope-based multispectral video navigation system and method |
| CN103340601A (en) * | 2013-06-27 | 2013-10-09 | 中国科学院自动化研究所 | Multi-spectral imaging system and method based on endoscope |
| CN103411885A (en) * | 2013-07-18 | 2013-11-27 | 江苏大学 | Diffuse reflection illumination apparatus of multispectral imaging system |
| CN104116497A (en) * | 2014-07-22 | 2014-10-29 | 中国科学院自动化研究所 | Endoscopic optical molecular imaging guidance system and multi-spectral imaging method |
| CN104202587A (en) * | 2014-08-08 | 2014-12-10 | 娄定风 | Three-dimensional multispectral insect distinguishing device and identifying method thereof |
| WO2016029403A1 (en) * | 2014-08-28 | 2016-03-03 | 中国科学院自动化研究所 | Head-mounted molecular image navigation system |
| WO2016041155A1 (en) * | 2014-09-16 | 2016-03-24 | 中国科学院自动化研究所 | Three-dimensional optical molecular image navigation system and method |
| CN105054890A (en) * | 2015-09-07 | 2015-11-18 | 中国医学科学院生物医学工程研究所 | Tumor tissue detection device based on endoscope |
| CN106124049A (en) * | 2016-06-20 | 2016-11-16 | 福州大学 | A kind of implementation method of Vegetation canopy multi-optical spectrum imaging system |
| EP3525443A4 (en) * | 2016-10-08 | 2019-11-27 | Hangzhou Hikvision Digital Technology Co., Ltd. | Camera lens and video camera |
| WO2018064903A1 (en) * | 2016-10-08 | 2018-04-12 | 杭州海康威视数字技术股份有限公司 | Camera lens and video camera |
| CN107920188A (en) * | 2016-10-08 | 2018-04-17 | 杭州海康威视数字技术股份有限公司 | A kind of camera lens and video camera |
| CN107230185A (en) * | 2017-05-03 | 2017-10-03 | 北京理工大学 | Alignment schemes for double camera image in Hyper spectral Imaging platform |
| CN107170015A (en) * | 2017-05-17 | 2017-09-15 | 海南大学 | A kind of giant clam outer embrane picture collection device and its application method |
| CN107349433A (en) * | 2017-06-30 | 2017-11-17 | 中国科学院自动化研究所 | Near-infrared nano-probe, preparation method and holographic molecular image navigation system |
| CN107728421A (en) * | 2017-11-05 | 2018-02-23 | 信利光电股份有限公司 | A kind of calibration method and calibration system of multispectral multi-cam module |
| CN107911692A (en) * | 2017-11-05 | 2018-04-13 | 信利光电股份有限公司 | A kind of calibration method of multispectral multi-cam module |
| CN107911692B (en) * | 2017-11-05 | 2020-02-14 | 信利光电股份有限公司 | Multispectral multi-camera module calibration method |
| CN108896545A (en) * | 2018-05-09 | 2018-11-27 | 歌尔股份有限公司 | Gluing detection method, device and computer readable storage medium |
| CN108896545B (en) * | 2018-05-09 | 2021-07-13 | 歌尔光学科技有限公司 | Gluing detection method and device and computer readable storage medium |
| CN109738069A (en) * | 2018-12-27 | 2019-05-10 | 浙江农林大学暨阳学院 | The method that multispectral imaging illuminates spatial heterogeneity correction |
| CN110031411A (en) * | 2019-04-17 | 2019-07-19 | 南京邮电大学 | A kind of spectrum imaging system |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN102809429A (en) | Multi-spectral imaging system and multi-spectral imaging method based on double cameras | |
| CN102721469B (en) | Multispectral imaging system and method based on two cameras | |
| CN103385696B (en) | Fluorescence excitation real-time imaging system and method | |
| CN103340601A (en) | Multi-spectral imaging system and method based on endoscope | |
| CN103300812A (en) | Endoscope-based multispectral video navigation system and method | |
| CN104116497B (en) | Spy optical molecular image-guidance system and multispectral imaging method | |
| CN101933417B (en) | Corn seed investigating device based on machine vision | |
| CN102151122B (en) | Laser fluorescent molecular imaging system and first fluorescent imaging method | |
| CN104367380B (en) | The visual field switchable double light path molecular image navigation system and formation method | |
| CN207283655U (en) | A kind of twin-lens black light camera | |
| KR20110125173A (en) | Imaging apparatus | |
| CN105342561B (en) | The wearable molecular image navigation system of Wireless sound control | |
| CN103973976B (en) | The conspicuousness extraction element and method of a kind of utilization optical imagery | |
| CN103126654A (en) | Detecting system for near-infared body surface blood vessel detector | |
| CN107518879A (en) | A kind of fluoroscopic imaging device and method | |
| CN109444056A (en) | A kind of underwater spectral reflectivity in-situ measurement device of binocular imaging formula and measurement method | |
| CN104992446B (en) | The image split-joint method of non-linear illumination adaptive and its realize system | |
| CN208954611U (en) | A kind of outdoor LED display screen gamma correction system | |
| CN110018122A (en) | Camouflage painting material testing apparatus and method based on multi-optical spectrum imaging technology | |
| CN106375742A (en) | Device and method of acquiring night vision true color image | |
| CN106331662A (en) | Image acquisition device and image acquisition method | |
| CN204318916U (en) | The visual field switchable double light path molecular image navigation system | |
| RU2726257C1 (en) | Apparatus for automatic measurement of plant parameters | |
| CN101627899A (en) | Microcirculation two-channel three-space simulation pseudocolor microscopy video imaging system | |
| CN111380843A (en) | Device design and imaging method of high-sensitivity visible-near infrared double-channel laser fluorescence microscope |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C02 | Deemed withdrawal of patent application after publication (patent law 2001) | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20121205 |