CN202204985U - Fast image expansion, fusion and dimensional imaging system of microscope - Google Patents
Fast image expansion, fusion and dimensional imaging system of microscope Download PDFInfo
- Publication number
- CN202204985U CN202204985U CN2011203215473U CN201120321547U CN202204985U CN 202204985 U CN202204985 U CN 202204985U CN 2011203215473 U CN2011203215473 U CN 2011203215473U CN 201120321547 U CN201120321547 U CN 201120321547U CN 202204985 U CN202204985 U CN 202204985U
- Authority
- CN
- China
- Prior art keywords
- image
- microscope
- fusion
- expansion
- imaging system
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related
Links
Images
Landscapes
- Microscoopes, Condenser (AREA)
Abstract
The utility model discloses a fast image expansion, fusion and dimensional imaging system of a microscope. The system comprises microscope image acquisition equipment, a computer CPU (central processing unit) and display equipment, wherein the microscope image acquisition equipment is used for collecting the static and dynamic images of a micro object. The system is characterized in that the system is also equipped with an image processor. The image processor is used for analyzing and processing the image, and outputting the processed result to the display equipment. The computer CPU is used for processing data and controlling the image processing of the image processor and the image acquisition of the microscope image acquisition equipment. A GPU (graphics processing unit) or a DSP (digital signal processor) image platform is adopted to analyze and process the image, complete the image processing work of microscopic image expansion, image fusion, dimensional reconstruction of a sequence image and the like, and complete other image processing functions instead of the computer CPU, therefore, the image processing ability of the microscope is improved, and the image processing speed of the microscope is accelerated. Combined with a controller, a stepping motor, a mobile carrying platform and the like, the system can operate automatically.
Description
Technical field
The utility model relates to a kind of microscope rapid image disposal system, specifically is the expansion of a kind of microscope rapid image, fusion and 3-D imaging system.
Background technology
In the microscope optical system, the microscopical visual field is limited, for bigger slightly object, can't all show at microscopically, and microscope can only be seen the part of object in each visual field, can't observe the overall picture of object.Image spreading is exactly the image that one group of adjacent image is had the overlapping region, pieces together wide-field panoramic picture according to the same characteristic features of overlapping region, its objective is that the image that makes after the expansion can represent the super large visual field.
In the microscope optical system, low power digital display micro mirror operating distance is long, and the depth of field is bigger, along with the growth of enlargement factor, and corresponding the reducing of depth of field meeting, only near the structure focussing plane just can be seen clearly.Even it is clear that this feasible structure object the simplest, the three dimensional depth relatively flat also has no idea in a width of cloth figure, to focus on fully.The micro-image integration technology is with several images at the different focal positions of Same Scene, is fused into a width of cloth dark image of panorama clearly all everywhere.
The demand for development microscope of biomedicine and material science not only will have higher resolution, and can carry out nondestructive analysis to sample, and then three-dimensional structure that can the micro-sample of complete accurate reproduction, and this just need carry out three-dimensionalreconstruction to sample.Three-dimensionalreconstruction for small items uses atomic force microscope (AFM) at present, flying-spot microscope (LSCM), laser interference range appearance (IM) and stereo electron microscope (3-DSEM) etc. are handed in the laser copolymerization, and these equipment not only cost an arm and a leg but also the adaptability aspect receives certain restriction.For example the atomic force microscope measuring accuracy is higher, but range is limited, powerless for the small items more than the most interested 5um of commercial Application; The laser copolymerization hands over flying-spot microscope relatively to be fit to the three-dimensional imaging of biologic grain; The interference measuring instrument lateral resolution is not high, and depth direction also is easy to generate distortion; Stereo electron microscope not only can lose colouring information, and the images match dyscalculia.These effects limit being widely used of above-mentioned instrument.Utilizing ordinary optical microscope to rebuild microscopically small items three-dimensional appearance is a kind of most economical, scope of application technology the most widely.The optical microscope three-dimensionalreconstruction is the different focusedimages that collect at differing heights from microscope; Identify each point focusing height and position the most clearly through focusing on evaluation algorithms; Recover micro-object surface elevation pattern; Full depth map in conjunction with focal position reconstructs the body surface three-dimensional shape characteristic.
Since more than comprise that image spreading, fusion and three-dimensionalreconstruction scheduling algorithm calculated amount are huge; The speed of jamming in computer CPU development at present can't satisfy above-mentioned processing quick calculating, reach processing capability in real time, the speed of processing can't satisfy modern industry, medical science and the biological field needs to fast detecting.
Along with the fast development of video card GPU technology, current GPU has had very strong computing power, floating-point operation ability even can reach with for more than 10 times of CPU.The technological release of CUDA (Compute Unified Device Architecture, unified calculation equipment framework) along with Nvidia company makes GPU have better programmability, in data processing, has wide practical use.
The DSP digital signal processor is a kind of microprocessor that is particularly suitable for carrying out the digital signal processing computing; It is mainly used is to realize various digital model Processing Algorithm fast; Relative CPU, the DSP digital signal processor wants much fast to the speed of Flame Image Process.
Replace traditional C PU to carry out graphical analysis and processing through GPU or dsp processor, can improve image spreading, image co-registration and image three-dimensional reconstruction speed, adapt to the adjust the telescope to one's eyes demand of image processing system of industry, biology and medical science.
Summary of the invention
In order to overcome above-mentioned deficiency; The utility model purpose is to provide the expansion of a kind of microscope rapid image, fusion and 3-D imaging system; This system can't satisfy the huge calculated amount in micro-image is handled to present computer CPU; Propose to use video card GPU or DSP substituting for computer CPU to carry out Flame Image Process as image processor; Accomplish the Flame Image Process work such as three-dimensionalreconstruction of micro-image expansion, image co-registration and sequence image, improve the MIcrosope image processing power, accelerate the MIcrosope image processing speed.
To achieve these goals, the technical scheme of the utility model employing is:
The expansion of a kind of microscope rapid image, fusion and 3-D imaging system; Comprise the MIcrosope image collecting device; Computer CPU and display device; The MIcrosope image collecting device is used to gather the static state or the dynamic image of micro-object, and it is characterized in that: this system also is provided with image processor; The depth of field in order to the expansion of the visual field of image, multi-layer image merges, the three-dimensional surface shape reconstruct of micro-object, the big visual field depth of field are merged, one or more Flame Image Process in big visual field surface three dimension reconstruct or other Flame Image Process, and result is outputed to display device; Said computer CPU in order to data processing, and is controlled the Flame Image Process of image processor and the IMAQ of MIcrosope image collecting device.
Said image processor is meant the special-purpose video card of supporting the GPU parallel computation.
Said image processor is meant the DSP image processor.
Said MIcrosope image collecting device is meant digital camera or analogue camera or video camera.
Said this system also comprises article carrying platform, and said article carrying platform is fixed article carrying platform or portable loading platform.
Said portable loading platform is to be driven by stepper motor; Be connected with controller on the stepper motor; Said controller can be embedded system, adopts single-chip microcomputer or DSP as platform, is used for control and drive stepping motor drive article carrying platform and moves or rotate at Z axle or other directions; And the umber of pulse that moves or rotate that will note is displacement, feeds back to computer CPU.
Said portable loading platform can be installed displacement measurement equipment such as grating chi, is used to measure distance or angle that article carrying platform moves in Z axle or other directions, and measurement data is passed to computer CPU.
Said MIcrosope image collecting device is provided with pulley, and the MIcrosope image collecting device moves through the track of pulley along X, Y, Z direction, in order to the testee on the fixed article carrying platform is carried out IMAQ.
The beneficial effect of the utility model: owing to use GPU or DSP image processing platform; Substituting for computer CPU carries out Flame Image Process; Accomplish the Flame Image Process work such as three-dimensionalreconstruction of micro-image expansion, image co-registration and sequence image; And the function of other Flame Image Process, improve the MIcrosope image processing power, accelerate the MIcrosope image processing speed.In conjunction with controller, stepper motor and removable article carrying platform etc., make the system works robotization.
Description of drawings
Below in conjunction with accompanying drawing the utility model is done further to specify.
Fig. 1 is the structured flowchart of the utility model;
Fig. 2 is the image spreading schematic diagram;
Fig. 3 is image co-registration and three-dimensionalreconstruction FB(flow block).
Embodiment
As shown in Figure 1, the expansion of a kind of microscope rapid image, fusion and 3-D imaging system comprise the MIcrosope image collecting device; Computer CPU, controller, portable loading platform, stepper motor and display device; Said MIcrosope image collecting device adopts video camera, is used to gather the static state or the dynamic image of micro-object, and this system also is provided with image processor; In order to one or more Flame Image Process in the visual field expansion of image, the depth of field fusion of multi-layer image, the three-dimensional surface shape reconstruct of micro-object, the depth of field fusion of the big visual field, the big visual field surface three dimension reconstruct; And result outputed to display device, image processor can be a special-purpose video card of supporting the GPU parallel computation, for example Nvidia series video card; Also can be the image processor based on DSP, for example TMS320C64xDSP;
Said computer CPU in order to data processing, and is controlled the Flame Image Process of image processor and the IMAQ of MIcrosope image collecting device.Said portable loading platform is to be driven by stepper motor; Be connected with controller on the stepper motor; Said controller can be embedded system, adopts single-chip microcomputer or DSP as platform, be used for control and drive stepping motor up and down or left and right directions move; And the umber of pulse that moves that will note is displacement, feeds back to computer CPU.
Principle of work: during image spreading, computer CPU transmits control signal to controller, and move drive stepping motor plane (front, rear, left and right); Camera images acquired signal, two width of cloth or many good fortune view data get into image processor, and be as shown in Figure 2; GPU seeks unique point to adjacent image image 1 and image 2 and compares; Calculate the displacement between the adjacent image, image is merged, expands, obtain the wide-field expanded images of micro-object.
During image co-registration, computer CPU transmits control signal to controller, and drive stepping motor moves up and down; Camera images acquired signal; Two width of cloth or many good fortune sequence image are sent into image processor, and as shown in Figure 3, image processor carries out focus analysis to sequence image; Get each location of pixels focuses on evaluation function value maximum position on sequence image pixel and carry out image co-registration, generate full depth map.
Image three-dimensional reconstruction, computer CPU transmit control signal to controller, and the controller drives stepper motor moves up and down; Camera images acquired model; Many good fortune sequence image is sent into image processor, and as shown in Figure 3, image processor carries out focus analysis to sequence image; Get each location of pixels focuses on evaluation function value maximum position on sequence image pixel and carry out image co-registration; Generate full depth map, get the Z axle altitude information of the height of focusing evaluation function maximum value position, merge the three-dimensional appearance figure of altitude information and full depth map generation micro-object as this location of pixels.
The big depth image expansion in the big visual field is merged.Computer CPU transmits control signal to controller; The controller drives stepper motor moves forward and backward up and down, and camera images acquired model is sent many good fortune sequence image into image processor; Image processor carries out image spreading and calculates with merging, and splices the micro-image of the big depth of field in the big visual field.
Big field of view three-dimensional restructuring graph; Computer CPU transmits control signal to controller; The controller drives stepper motor moves forward and backward up and down, and camera images acquired model is sent many good fortune sequence image into image processor; Image processor to image merge, expansion and three-dimensionalreconstruction, splice wide-field microscope three-dimensionalreconstruction figure.
Other Flame Image Process; Computer CPU transmits control signal to controller; The controller drives stepper motor moves forward and backward up and down, and camera images acquired model is sent many good fortune sequence image into image processor; Image processor to image analyze, computing such as processing, and output results to display device.
The above is the preferred implementation of the utility model, can not limit the interest field of the utility model certainly with this.Should be pointed out that for those skilled in the art, the technical scheme of the utility model is made amendment or is equal to replacement, do not break away from the protection domain of the utility model.
Claims (8)
1. microscope rapid image expansion, fusion and 3-D imaging system; Comprise the MIcrosope image collecting device; Computer CPU and display device; The MIcrosope image collecting device is used to gather the static state or the dynamic image of micro-object, and it is characterized in that: this system also is provided with image processor; The depth of field in order to the expansion of the visual field of image, multi-layer image merges, the three-dimensional surface shape reconstruct of micro-object, the big visual field depth of field are merged, one or more Flame Image Process in the big visual field surface three dimension reconstruct, and result is outputed to display device; Said computer CPU in order to data processing, and is controlled the Flame Image Process of image processor and the IMAQ of MIcrosope image collecting device.
2. microscope rapid image according to claim 1 expansion, fusion and 3-D imaging system is characterized in that: said image processor is meant the special-purpose video card of supporting the GPU parallel computation.
3. microscope rapid image according to claim 1 expansion, fusion and 3-D imaging system is characterized in that: said image processor is meant the DSP image processor.
4. microscope rapid image according to claim 1 expansion, fusion and 3-D imaging system is characterized in that: said MIcrosope image collecting device is meant digital camera or analogue camera or video camera.
5. microscope rapid image according to claim 1 expansion, fusion and 3-D imaging system is characterized in that: said this system also comprises article carrying platform, and said article carrying platform is fixed article carrying platform or portable loading platform.
6. microscope rapid image according to claim 5 expansion, fusion and 3-D imaging system; It is characterized in that: said portable loading platform is to be driven by stepper motor, is connected with controller on the stepper motor, and said controller can be embedded system; Adopt single-chip microcomputer or DSP as platform; Be used for control and drive stepping motor and drive article carrying platform and move or rotate, and the umber of pulse that moves or rotate that will note is displacement, feed back to computer CPU at Z axle or other directions.
7. microscope rapid image according to claim 5 expansion, fusion and 3-D imaging system; It is characterized in that: said portable loading platform is provided with displacement measuring equipment; In order to measuring microscope platform Z axle or other direction displacement or angle, and send the data to computer CPU.
8. microscope rapid image according to claim 5 expansion, fusion and 3-D imaging system; It is characterized in that: said MIcrosope image collecting device is provided with pulley; The MIcrosope image collecting device moves through the track of pulley along X, Y, Z direction, in order to the testee on the fixed article carrying platform is carried out IMAQ.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2011203215473U CN202204985U (en) | 2011-08-30 | 2011-08-30 | Fast image expansion, fusion and dimensional imaging system of microscope |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2011203215473U CN202204985U (en) | 2011-08-30 | 2011-08-30 | Fast image expansion, fusion and dimensional imaging system of microscope |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN202204985U true CN202204985U (en) | 2012-04-25 |
Family
ID=45969102
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN2011203215473U Expired - Fee Related CN202204985U (en) | 2011-08-30 | 2011-08-30 | Fast image expansion, fusion and dimensional imaging system of microscope |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN202204985U (en) |
Cited By (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102662410A (en) * | 2012-05-24 | 2012-09-12 | 南开大学 | Moving target tracking oriented vision system and control method thereof |
| CN104112294A (en) * | 2014-07-04 | 2014-10-22 | 中国科学院上海光学精密机械研究所 | Intensity-correlation-imaging high-speed three-dimensional reconstruction system and method based on sparse constraint |
| CN104807494A (en) * | 2015-04-28 | 2015-07-29 | 上海大学 | Object micro surface morphology optical five-degree-of-freedom measurement device and method |
| CN104935798A (en) * | 2015-06-30 | 2015-09-23 | 中国人民解放军南京军区福州总医院 | Precise numerical control experimental animal image collecting device |
| CN106646845A (en) * | 2016-10-26 | 2017-05-10 | 广西师范大学 | Microscopic system for realizing automatic focusing and three-dimensional reconstruction and image obtaining method thereof |
| CN107949800A (en) * | 2015-09-17 | 2018-04-20 | 国立研究开发法人科学技术振兴机构 | Microscope module, microscope, microscope module control device and multiphoton excitation microscope |
| CN109310278A (en) * | 2016-06-17 | 2019-02-05 | 索尼公司 | Image processing apparatus, image processing method, program and image processing system |
| CN109379518A (en) * | 2018-11-26 | 2019-02-22 | 苏州富莱智能科技有限公司 | Embedded intelligence image measurement camera system and detection method |
| CN109597336A (en) * | 2018-12-12 | 2019-04-09 | 湖南爱威医疗科技有限公司 | Microscope photograph acquisition method and system |
-
2011
- 2011-08-30 CN CN2011203215473U patent/CN202204985U/en not_active Expired - Fee Related
Cited By (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102662410A (en) * | 2012-05-24 | 2012-09-12 | 南开大学 | Moving target tracking oriented vision system and control method thereof |
| CN104112294A (en) * | 2014-07-04 | 2014-10-22 | 中国科学院上海光学精密机械研究所 | Intensity-correlation-imaging high-speed three-dimensional reconstruction system and method based on sparse constraint |
| CN104112294B (en) * | 2014-07-04 | 2017-04-05 | 中国科学院上海光学精密机械研究所 | Intensity correlation imaging high speed three-dimensional reconfiguration system and method based on sparse constraint |
| CN104807494A (en) * | 2015-04-28 | 2015-07-29 | 上海大学 | Object micro surface morphology optical five-degree-of-freedom measurement device and method |
| CN104935798A (en) * | 2015-06-30 | 2015-09-23 | 中国人民解放军南京军区福州总医院 | Precise numerical control experimental animal image collecting device |
| CN107949800A (en) * | 2015-09-17 | 2018-04-20 | 国立研究开发法人科学技术振兴机构 | Microscope module, microscope, microscope module control device and multiphoton excitation microscope |
| US11320639B2 (en) | 2015-09-17 | 2022-05-03 | Japan Science And Technology Agency | Microscope optical module, microscope, control device for microscope optical module, and multiphoton excitation microscope |
| CN109310278A (en) * | 2016-06-17 | 2019-02-05 | 索尼公司 | Image processing apparatus, image processing method, program and image processing system |
| CN106646845A (en) * | 2016-10-26 | 2017-05-10 | 广西师范大学 | Microscopic system for realizing automatic focusing and three-dimensional reconstruction and image obtaining method thereof |
| CN109379518A (en) * | 2018-11-26 | 2019-02-22 | 苏州富莱智能科技有限公司 | Embedded intelligence image measurement camera system and detection method |
| CN109597336A (en) * | 2018-12-12 | 2019-04-09 | 湖南爱威医疗科技有限公司 | Microscope photograph acquisition method and system |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN202204985U (en) | Fast image expansion, fusion and dimensional imaging system of microscope | |
| Chen et al. | Real-time identification system of asphalt pavement texture based on the close-range photogrammetry | |
| CN101666633B (en) | Non-contact detection system of hollow cylindrical part and detection method thereof | |
| CN103765277B (en) | Use the focusing of error signal and imaging system and technology | |
| CN104807494B (en) | The optics five degree of freedom measurement apparatus and measuring method of object micromorphology | |
| CN103134900B (en) | Ablation test method of thermal protection structure of high supersonic velocity aircraft | |
| CN202974843U (en) | Pathological section panoramic scanner | |
| CN103674977B (en) | Optical elements of large caliber element surface damage detection device and corresponding detection method | |
| CN104111524A (en) | Digital Microscope And Method For Optimising The Work Process In A Digital Microscope | |
| CN102042807B (en) | Flexible stereoscopic vision measuring unit for target space coordinate | |
| CN104502255A (en) | Three-dimensional imaging flow cytometer device | |
| CN101865673B (en) | Microcosmic optical field acquisition and three-dimensional reconstruction method and device | |
| CN104111485A (en) | Stereo imaging based observation method for raindrop size distribution and other rainfall micro physical characteristics | |
| CN103728315A (en) | Large-aperture element surface detection device and corresponding damage quick localization method | |
| CN106338524A (en) | Microscopic scanning imaging acquisition device for vertical optical element surface damage and method thereof | |
| CN110168609A (en) | For generating the method and digital microscope of the threedimensional model of sample in digital microscope | |
| CN104965302A (en) | Enhanced reality microscope | |
| CN111398274A (en) | Small target object 3D collection equipment | |
| CN101907490B (en) | Method for measuring small facula intensity distribution based on two-dimension subdivision method | |
| CN204116229U (en) | A kind of fluorescent microscopic imaging device with axial positioning function | |
| WO2015107872A1 (en) | Image acquisition apparatus and control method thereof | |
| CN106257323B (en) | The method of lamination Imaging imaging | |
| CN103940819A (en) | Image acquisition processing device and method for surfaces of medium yarns of fabric under microscale | |
| CN106773158A (en) | A kind of movable type seeks liquid crystal display pixel qualities analytical equipment and a method certainly | |
| CN2914032Y (en) | Optics non-contact type three-dimensional shaped measuring instrument |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| CF01 | Termination of patent right due to non-payment of annual fee | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20120425 Termination date: 20170830 |