CN109521557A - Signal control and processing unit and its method of confocal surface sweeping micro imaging system - Google Patents

Signal control and processing unit and its method of confocal surface sweeping micro imaging system Download PDF

Info

Publication number
CN109521557A
CN109521557A CN201811526995.XA CN201811526995A CN109521557A CN 109521557 A CN109521557 A CN 109521557A CN 201811526995 A CN201811526995 A CN 201811526995A CN 109521557 A CN109521557 A CN 109521557A
Authority
CN
China
Prior art keywords
signal
mirror
sync
slow speed
slow
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201811526995.XA
Other languages
Chinese (zh)
Inventor
张�杰
张金莲
杜华月
杭荟
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Nanjing Zhibo Medical Devices Co Ltd
Original Assignee
Nanjing Zhibo Medical Devices Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Nanjing Zhibo Medical Devices Co Ltd filed Critical Nanjing Zhibo Medical Devices Co Ltd
Publication of CN109521557A publication Critical patent/CN109521557A/en
Pending legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B21/00Microscopes
    • G02B21/0004Microscopes specially adapted for specific applications
    • G02B21/002Scanning microscopes
    • G02B21/0024Confocal scanning microscopes (CSOMs) or confocal "macroscopes"; Accessories which are not restricted to use with CSOMs, e.g. sample holders
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B21/00Microscopes
    • G02B21/0004Microscopes specially adapted for specific applications
    • G02B21/002Scanning microscopes
    • G02B21/0024Confocal scanning microscopes (CSOMs) or confocal "macroscopes"; Accessories which are not restricted to use with CSOMs, e.g. sample holders
    • G02B21/0036Scanning details, e.g. scanning stages
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B21/00Microscopes
    • G02B21/36Microscopes arranged for photographic purposes or projection purposes or digital imaging or video purposes including associated control and data processing arrangements
    • G02B21/365Control or image processing arrangements for digital or video microscopes

Landscapes

  • Physics & Mathematics (AREA)
  • Chemical & Material Sciences (AREA)
  • Analytical Chemistry (AREA)
  • General Physics & Mathematics (AREA)
  • Optics & Photonics (AREA)
  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Microscoopes, Condenser (AREA)

Abstract

The invention discloses a kind of controls of the signal of confocal surface sweeping micro imaging system and processing unit and its method, which includes: quick resonant mirror module, for motivating quick resonant mirror to make sinusoidal motion and generating a horizontal synchronizing pulse signal (H-sync);H-sync inputs field sync signal and at a slow speed scarnning mirror signal generator and data acquisition and D/A converter module respectively;Field sync signal and at a slow speed scarnning mirror signal generator, for generating field sync signal (V-sync) and at a slow speed scarnning mirror signal;Slow scanning mirror module, receives the scarnning mirror signal at a slow speed, and driving slow scanning mirror moves linearly;Data acquisition and D/A converter module receive multichannel image data video signal, H-sync and V-sync, and carry out digitized processing to above-mentioned signal.Using the present invention, the modulation of source signal of the dosage of control imaging source irradiation sample can be generated, quick resonant scanning mirror and the at a slow speed synchronization signal of linear scanning reflection mirror is controlled and realizes the control signal that image shows and handles.

Description

Signal control and processing unit and its method of confocal surface sweeping micro imaging system
Technical field
The present invention relates to confocal scanning optical imagery instrument technology more particularly to a kind of confocal surface sweeping micro imaging systems Signal control with processing unit and its method.
Background technique
Confocal surface sweeping micro-imaging optical system, usually using a quick resonant scanning mirror and in that orthogonal direction Using one, linear scanning reflection mirror, two latitudes for carrying out sample are scanned to obtain the two dimensional image of sample at a slow speed.
Figure 1A shows a typical scanning mirror working method.As shown in Figure 1A, quick resonant mirror 11 is sinusoidally It is uninterrupted that continuously scanned samples, any one sine sweep period can be decomposed into forward scan 111 in a first direction With reverse scanning 112.The sinusoidal amplitude of quick resonant mirror 11 directly determines that the optical field of view of fast scan direction is big It is small.
The every scanning a cycle of quick resonant mirror 11, linear scanning mirror 12 is orthogonal in the quick resonant mirror of second direction at a slow speed The direction of (90 °), displacement increase by a step 121.The step number and step size of linear scanning mirror forward scan 121 at a slow speed, directly Determine the optical field of view size in slow scanning direction.
After linear scanning mirror is provided with forward scan 121 according to system at a slow speed, reverse scanning 122 is then completed.It is inverse Step of the step often than forward scan 121 to scanning 122 is big, so that linear scanning mirror can quickly return to raw bits at a slow speed It sets and starts a new frame image.In this case, often only sampling comes from forward scan to the data acquisition module of imaging system 121 data.
At a slow speed linear scanning mirror forward scan 121 and the step of reverse scanning 122 and step number can also as big, this feelings Under condition, the data acquisition module of imaging system samples all data from positive slow scanning 121 and reverse scanning 122.
Figure 1B shows another typical scanning mirror working method.As shown in Figure 1B, similar to traditional television system In image intertexture operating mode.Quick resonant mirror 11 sinusoidally uninterrupted continuous scanned samples in a first direction, wherein Any one sine sweep period can be decomposed into forward scan 111 and reverse scanning 112.The odd-numbered line of image is from quick The forward scan 111 of resonant mirror, the even number line of image is from the reverse scanning 112 of quick resonant mirror.Quick resonant mirror 11 is sinusoidal The amplitude of curve directly determines the optical field of view size of fast scan direction.
The every scanning half period of quick resonant mirror 11, linear scanning mirror 12 is orthogonal with quick resonant mirror in second direction at a slow speed The direction of (90 °), displacement increase by a step 121.The step number and step size of linear scanning mirror forward scan 121 at a slow speed, directly Determine the optical field of view size in slow scanning direction.
After linear scanning mirror is provided with forward scan 121 according to system at a slow speed, reverse scanning 122 is then completed.It is inverse Step of the step often than forward scan 121 to scanning 122 is big, so that linear scanning mirror can quickly return to raw bits at a slow speed It sets and starts a new frame image.In this case, often only sampling comes from forward scan to the data acquisition module of imaging system 121 data.
At a slow speed linear scanning mirror forward scan 121 and the step of reverse scanning 122 and step number can also as big, imaging system The data acquisition module of system samples all data from mirror forward scan 121 and reverse scanning 122 at a slow speed.
The quick resonant mirror 11 of Figure 1A and Figure 1B one complete cycle of every scanning, corresponding electronic component export one in real time Row synchronizing clock signals (H-Sync).The scanning mirror 12 linear at a slow speed of Figure 1A and Figure 1B one complete cycle of every scanning, accordingly Electronic component export a field synchronization clock signal (V-Sync) in real time.
Row synchronizing clock signals (H-Sync) and field synchronization clock signal (V-Sync) are typically used as imaging system data and adopt The synchronous input signal for collecting mould, digitizes the image of analog signal.
The motion profile of quick resonant mirror can usually be stated with the time-space relationship of formula (1).
X (t)=A-Acos (ω t) (1)
Here, A is the amplitude of quick resonant mirror, and ω is the angular speed of quick resonant mirror, and t is time variable, and x (t) is fast The scanning space position of fast resonant mirror.
The time-space relationship of formula (1) can be expressed further with the cosine curve of Fig. 2A 10.Cosine curve 10 is shown The complete cycle of one quick resonant mirror, including forward scan window 11 and reverse scanning window 12.
In the both sides side position of scanning window, the movement rate of quick resonant mirror reduces and occurs inflection point mathematically, by It is distorted in the excessive tensile of image, the data acquisition module of picture system often cuts out the data of two sides or abandon to sample this The data of two sides, and part more linear among cosine curve is only sampled, as shown in the region 111 and 121 in Fig. 2A. Region 111 and 121 is usually defined as image window or sampling window.
It is available that difference mathematically is made to formula (1):
Δ x (t)=A ω sin (ω t) Δ t (2)
From the reverse-power of formula (2) available Δ x (t) and Δ t,
Δ t (x)=Δ x/ (A ω sin (ω t)) (3)
Assuming that the imaging source output firm power P for illuminating sample0(actually imaging source output power is constant 's.The stability of light source output power is to measure a whether outstanding important indicator of a light source performance), then scanned sample The amount of radiation that this unit space size receives are as follows:
Δ I (x)=P0Δ t (x)=P0Δx/(Aω·sin(ωt)) (4)
Formula (4) is rewritten into differential situation to obtain:
Fig. 2 B shows the formula (5) after normalization.1% spatial position of the leftmost side and the rightmost side is omitted in figure, this Two parts are considered sample reception light-pulse generator-and receive high amount of radiation in a very short period of time.But even if Only consider the scanning space of 99% part in figure, shown in Fig. 2 B, sample two sides 11,12 received amount of radiation are middles 10 7 times or more.
In the imaging process of biopsy sample (such as living animal retina), strict control imaging source is needed to irradiate sample Dosage.Imaging source, especially visible light, laser and ultraviolet band, phototoxic reaction is wideer than infrared, and strict control swashs Light dosage can guarantee biopsy sample always in the radiation scope of safety.Cofocus scanning optical imagery instrument needs before application The acceptable radiation load of biopsy sample is calculated to guarantee the safety of biopsy sample.
As described above, sample two sides 11, the received light dosage in 12 regions are 7 times of middle section 10 or more in Fig. 2 B.Light The calculating of poison needs to consider most unsafe irradiation area, that is, two end regions 11,12 of 7 multiple doses.This problem causes As a result, sample two sides are than that must receive the light dosage more than 7 times to obtain sample image signal good enough among sample. If only guaranteeing that the image of sample two sides has signal-to-noise ratio good enough with 1/7 dosage, then inevitable under-exposure among sample Cause picture quality that specified requirement is not achieved.The nonlinear scanning mechanism of quick resonant mirror causes as shown in Figure 2 B non-linear As a result.
Therefore, the signal control and processing unit for needing to research and develop a kind of confocal surface sweeping micro imaging system, for generating control Be formed as light source irradiation sample dosage modulation of source signal and show for realizing image and the control of image procossing believe Number, thus support to carry out two-dimensional scanning to biological sample (such as skin, eyeground biological tissue, may be simply referred to as " sample "), with To the high-resolution two dimensional image of sample.
Summary of the invention
In view of this, the main purpose of the present invention is to provide a kind of signal of confocal surface sweeping micro imaging system control with Processing unit and its method, the modulation of source signal of the dosage for generating control imaging source irradiation sample are controlled for generating Make quick resonant scanning mirror and the at a slow speed synchronization signal of linear scanning reflection mirror and control signal and for realizing image The control signal of display and image procossing.
In order to achieve the above objectives, technical scheme is as follows:
A kind of the signal control and processing unit of confocal surface sweeping micro imaging system, including quick resonant mirror module 10, field Synchronization signal and at a slow speed scarnning mirror signal generator 11, slow scanning mirror module 16 and data acquisition and D/A converter module 17; Wherein:
The quick resonant mirror module 10, for motivating quick resonant mirror to make sinusoidal motion and generating a horizontal synchronizing pulse Signal H-sync12;The horizontal synchronizing pulse signal H-sync12 inputs the field sync signal and at a slow speed scarnning mirror signal respectively Generator 11 and data acquisition and D/A converter module 17;
The field sync signal and at a slow speed scarnning mirror signal generator 11, for generating field sync signal V-sync14 and slow Fast scarnning mirror signal 15;
The slow scanning mirror module 16, for receiving the scarnning mirror signal 15 at a slow speed, driving is in quick scanning mirror Slow scanning mirror on orthogonal direction moves linearly;
The data acquisition and D/A converter module 17, for receiving multichannel image data video signal 13, row synchronizes Signal H-sync12 and field sync signal V-sync14, and digitized processing is carried out to above-mentioned signal, generate digitized image letter Number SLO-Data, horizontal synchronizing pulse signal h, field system chronizing impulse signal v and pixel clock signal p.
Wherein: the field sync signal and at a slow speed scarnning mirror signal generator 11, by including FPGA, DSP or other forms Electronic component circuit constitute.
The line synchronising signal H-sync12 is 8kHz resonance clock signal.
The line synchronising signal H-sync12 is sent in field sync signal and at a slow speed scarnning mirror signal generator 11 simultaneously Field synchronization generator and scarnning mirror signal generator at a slow speed, and send data acquisition and D/A converter module 17 to.
The field sync signal V-sync14 and at a slow speed that the field sync signal and at a slow speed scarnning mirror signal generator 11 generate Scarnning mirror signal 15 is respectively transmitted to data acquisition and D/A converter module 17 and slow scanning mirror module 16.
The field sync signal V-sync14 and pixel clock signal p passes through locking phase line synchronising signal H-sync12 and obtains It arrives.
The signal of scarnning mirror at a slow speed 15 is also used to that slow scanning will be driven again after signal amplification by power amplifier Mirror work.
The field sync signal V-sync14 locking phase of the field sync signal v and input terminal.
The pixel clock signal p and digitized line synchronising signal h is for locking phase control imaging source irradiation biology The modulation of source signal of the dosage of sample.
A kind of the signal control and processing method of confocal surface sweeping micro imaging system, this method comprises the following steps:
A, it using quick resonant mirror module (10), motivates quick resonant mirror to make sinusoidal motion and generates a horizontal synchronizing pulse Signal H-sync (12);The horizontal synchronizing pulse signal H-sync (12) is inputted to field sync signal respectively and scarnning mirror is believed at a slow speed Number generator (11) and data acquisition and D/A converter module (17);
B, using field sync signal and at a slow speed scarnning mirror signal generator (11) generate field sync signal V-sync (14) and Scarnning mirror signal (15) at a slow speed;
C, scarnning mirror signal (15) at a slow speed are received by slow scanning mirror module (16), driving is in quick scanning mirror Slow scanning mirror on orthogonal direction moves linearly;
D, using data acquisition and D/A converter module (17), multichannel image data video signal (13), row are received together Signal H-sync (12) and field sync signal V-sync (14) are walked, and digitized processing is carried out to above-mentioned signal, generates digitlization Picture signal SLO-Data, horizontal synchronizing pulse signal h, field system chronizing impulse signal v and pixel clock signal p.
Signal control and processing unit and its method of confocal surface sweeping micro imaging system of the invention have following beneficial Effect:
The modulation of source signal generated using the device, is modulated confocal surface sweeping microscope light source, specifically: it uses One quick resonant scanning mirror and orthogonal direction using a linear scanning reflection mirror at a slow speed confocal surface sweeping it is micro- at As system progress modulation of source, the two latitudes scanning of biological sample is carried out to obtain the two dimensional image of sample.It is swept due to quickly resonating The sinusoidal motion track for retouching reflecting mirror causes to fall on the amount of radiation of sample in nonlinear Distribution in fast scan direction light source;And it is slow The working method of fast linear scan reflecting mirror will lead to image capture module again and not acquire all images from slow scanning.
Using the present invention, by being modulated to the light source power on slow scanning direction, the slow scanning direction is utilized Modulated signal directly control light source, or by AOM modulated light source output end power, or above two modulation system is mutually tied It closes, meanwhile, figure is not acquired in the part that forward scan data are intercepted and the part that reverse scanning is intercepted using slow scanning Light source is closed when picture, to reduce the light radiation of sample surface, and then realizing makes sample light radiation achieve the purpose that minimum.
Detailed description of the invention
Figure 1A is the quick resonant scanning mirror of SLO and at a slow speed linear scanning mirror working method signal under the mode of non-interwoven Figure (the quick every scanning a cycle of resonant mirror, at a slow speed the linearly increasing step of mirror);
Figure 1B is the quick resonant scanning mirror of SLO and at a slow speed linear scanning mirror working method schematic diagram under the mode of intertexture (the quick every scanning half period of resonant mirror, at a slow speed the linearly increasing step of mirror);
Fig. 2A be quick resonant scanning mirror motion profile time-space relationship schematic diagram (it is shown in figure be normalization number Value);
Fig. 2 B is fast scan direction, the nonlinear dependence of sample unit area received light radiation and scanning space position It is schematic diagram;
Fig. 3 A is that a modulation is generated on electronic hardware according to quick resonant scanning mirror window and image sampling window Signal to open and close light source schematic diagram in real time;
Fig. 3 B is that a modulation is generated on electronic hardware according to quick resonant scanning mirror window and image sampling window Signal to open and close light source schematic diagram in real time (light source is only opened in forward scan position);
Fig. 3 C is that a modulation is generated on electronic hardware according to quick resonant scanning mirror window and image sampling window Signal to open and close light source schematic diagram in real time (light source is only opened in reverse scanning position);
Fig. 4 A is in resonance scan direction to light source output power, in scanning window, makees nonlinear forward scan and inverse To scanning while modulating schematic diagram;
Fig. 4 B is to make nonlinear forward scan modulation in scanning window to light source output power in resonance scan direction Schematic diagram;
Fig. 4 C is to make nonlinear reverse scanning modulation in scanning window to light source output power in resonance scan direction Schematic diagram;
Fig. 5 A is in resonance scan direction to light source output power, in image window, makees nonlinear forward scan and inverse To scanning while modulating schematic diagram;
Fig. 5 B is to make nonlinear forward scan modulation in image window to light source output power in resonance scan direction Schematic diagram;
Fig. 5 C is to make nonlinear reverse scanning modulation in image window to light source output power in resonance scan direction Schematic diagram;
Fig. 6 A is in resonance scan direction to light source output power, in image window, makees nonlinear forward scan and inverse To scanning while modulating schematic diagram (while implementing light source switch debugging);
Fig. 6 B is to make nonlinear forward scan modulation in image window to light source output power in resonance scan direction Schematic diagram (while implementing light source switch debugging);
Fig. 6 C is to make nonlinear reverse scanning modulation in image window to light source output power in resonance scan direction Schematic diagram (while implementing light source switch debugging);
Fig. 7 is the modulation of source schematic diagram of linear scanning direction at a slow speed;
Fig. 8 is that the signal control of the confocal surface sweeping micro imaging system of the embodiment of the present invention and the principle of processing unit are illustrated Figure;
Fig. 9 is that the pixel clock signal p and line synchronising signal h from ADC or dedicated phase-locked loop circuit are used to generate light Source modulated signal process schematic;
Figure 10 is the generation process schematic of the modulation of source signal of linear scanning direction at a slow speed;
Figure 11 is to accumulate pixel value using the mode of integral to obtain the image schematic diagram of sinusoidal distortion.
Specific embodiment
With reference to the accompanying drawing and the embodiment of the present invention is to the signal control of confocal surface sweeping micro imaging system and processing unit And its method is described in further detail.
[embodiment 1]
With reference to Fig. 2A, scanning window 11, the intermediate alternative line of scanning window 12 are taken in image window 111, image window 121 A part of property, due to the sample two sides low in quick resonant mirror rate, sample image seriously stretches distortion, will lead to image not It is applicable in.
In above-described embodiment 1, using superluminescent diode (SLD, Super Luminescent Diode) as at In the case where as light source, this mode is easier to realize.Typical SLD usually has the light of built-in bandwidth 100kHz~200kHz Electric isolator, and the resonant frequency of common quick resonant mirror is generally between 4kHz to 16kHz.Therefore SLD has 100kHz The bandwidth of~200kHz reflects rapidly the switching frequency from quick resonant mirror enough, is sampled according to Nyquist (Nyquist) It is theoretical, it is ensured that be not in sampling distortion phenomenon.
It can be in electricity which show one according to quick resonant scanning mirror window and image sampling window with reference to Fig. 3 A Sub- hardware, such as field programmable gate array (FPGA, Field Programming Gate Array) or digital signal processor A modulated signal 20 is generated on (DSP, Digital Signal Processor) or other electronic components to open in real time Or close light source.
Modulation parameter is inputted according to the light source of SLD, modulated signal 20 can be transistor-transistor logic circuit (TTL) Signal is also possible to complementary metal oxide semiconductor (CMOS) signal, can also be low voltage difference (LVDS) signal.It is this In the case of, data acquisition module obtains the image data of forward scan and reverse scanning simultaneously.
It is hard in electronics which show one according to quick resonant scanning mirror window and image sampling window with reference to Fig. 3 B Part, as generated another modulation on field programmable gate array (FPGA), digital signal processor (DSP) or other electronic devices Signal 20 opens or closes light source in real time, but only in the position of forward scan.Modulation ginseng is inputted according to the light source of SLD Number, modulated signal 20 can be TTL signal, can be cmos signal, be also possible to LVDS signal.In this case, data are adopted Collection module only obtains the image data of forward scan.
It is hard in electronics which show one according to quick resonant scanning mirror window and image sampling window with reference to Fig. 3 C Part, as generated another modulation on field programmable gate array (FPGA), digital signal processor (DSP) or other electronic devices Signal 20 opens or closes light source in real time, but only in the position of reverse scanning.According to the input modulation parameter of SLD, adjust Signal 20 processed can be TTL signal, cmos signal, be also possible to LVDS signal.In this case, data acquisition module only obtains To the image data of reverse scanning.The FPGA supports user arbitrarily to change internal circuit logic, customization according to their own needs Generate the digital signal that user needs.
As shown in Fig. 3 A, Fig. 3 B, Fig. 3 C, modulated signal 20 indicates that high level light source is opened, and low level light source is closed.According to The parameter of light source input modulating signal, modulated signal 20 can switch high level and low level, to realize light source when high level It closes, light source is opened when low level.
In the embodiment 1, the light spoke of reduction sample surface can be reached by closing light source except image window The effect for the amount of penetrating.
[embodiment 2]
The method used in the present embodiment is using light source power modulator, and a typical case is to utilize acousto-optic modulator (AOM, Acousto-Opto Modulator) is modulated light source.Modulator approach is used as point of penetration from formula (5).In formula (5) in, if to the transmitting terminal power P of light source0By AOM, non-linear modulation then is carried out to AOM, is obtained:
Wherein, k is the attenuation coefficient of AOM, is a constant.Formula (6) substitution formula (5) is obtained:
I ' (x)=Δ I (x)/Δ x=kP0/ω (7)
That is, light source becomes one often in the amount of radiation distribution of sample space by the algorithm for power modulation of formula (6) Number.
Formula (6) is further simplified to obtain,
With reference to Fig. 4 A, shows to light source output end in the forward scan sampling window 11 of quick resonant mirror and inversely sweep It retouches sampling window 12 and carries out algorithm for power modulation 21,22 simultaneously.
With reference to Fig. 4 B, display carries out algorithm for power modulation 21 in forward scan sampling window 11 to light source output end.
With reference to Fig. 4 C, display carries out algorithm for power modulation 22 in reverse scanning sampling window 12 to light source output end.
Another modulation system is, it is contemplated that sample image seriously stretches distortion except image window.As shown in Figure 5A, right Light source output end carries out power simultaneously in the forward scan image window 111 and reverse scanning image window 121 of quick resonant mirror Modulation 211,221.
As shown in Figure 5 B, algorithm for power modulation 211 is carried out in forward scan image window 111 to light source output end.
As shown in Figure 5 C, algorithm for power modulation 221 is carried out in reverse scanning image window 121 to light source output end.
The embodiment is modulated light source using above-mentioned modulation system, also can achieve the light for reducing biological sample surface The effect of amount of radiation.
[embodiment 3]
The method used in the present embodiment is, in combination with the method for embodiment 1 and embodiment 2, except image window While closing SLD light source, then power modulators are superimposed, such as AOM carries out algorithm for power modulation to light source output end.
As shown in Figure 6A, to light source quick resonant mirror forward scan image window 111 and reverse scanning image window 121 carry out algorithm for power modulation 211,221 simultaneously and light source switch modulation 311,321 by AOM.
As shown in Figure 6B, the forward scan image window 111 to light source in quick resonant mirror carries out function simultaneously by AOM Rate modulation 211 and light source switch modulation 311.
As shown in Figure 6 C, the reverse scanning image window 121 to light source in quick resonant mirror carries out function simultaneously by AOM Rate modulation 221 and light source switch modulation 321.
Three above-mentioned embodiments can individually be implemented.
[embodiment 4]
The method used in the present embodiment is to implement the modulation of source in slow scanning direction.
In the slow scanning mechanism shown in Figure 1A, Figure 1B, mirror forward scan 121 at a slow speed is acquired using image capture module Most linear part is left final image data.
With reference to Fig. 7, using slow scanning forward scan data are intercepted part 13 and reverse scanning data are intercepted Whole 14.Since all 14 parts that forward scan data are intercepted part 13, reverse scanning data are intercepted do not acquire image, This part light source is closed.The modulated signal in slow scanning direction can directly control light in the section of Fig. 7 15, the modulated signal Source (such as built-in photoelectric isolating device), can also by AOM modulated light source output end power, can also two kinds of modulation systems it is same When implement.
The modulator approach of embodiment described above 4 can be used alone, can also with the above embodiments 1,
Any one superposition of embodiment 2, modulator approach in embodiment 3 uses.
Further, it is the accurate modulated signal generated in the modulator approach that embodiment described above is recorded, keeps it final It is converted into picture signal, the present invention also uses the synchronization signal of data acquisition module.Data acquisition module typically inputs defeated Signal out please refers to Fig. 8.
Fig. 8 is that the signal control of the confocal surface sweeping micro imaging system of the embodiment of the present invention and the principle of processing unit are illustrated Figure.
As shown in Figure 8, it is shown that in the signal control of confocal surface sweeping micro imaging system and processing unit, data acquisition module The synchronization signal of the components such as block outputs and inputs process.The signal of the confocal surface sweeping micro imaging system controls and processing unit, It mainly include quick resonant mirror module 10, field sync signal and scarnning mirror signal generator 11, slow scanning mirror module 16 at a slow speed With data acquisition and D/A converter module 17.
Wherein, quick resonant mirror module 10 excites isolated operation by internal oscillator.In the operating condition, quick resonant mirror On the one hand module 10 motivates quick resonant mirror to make sinusoidal motion, on the other hand can generate a horizontal synchronizing pulse signal (H- sync)12.The horizontal synchronizing pulse signal (H-sync) 12 inputs the field sync signal and at a slow speed scarnning mirror signal generator 11, Generate field sync signal (V-sync) 14 and at a slow speed scarnning mirror signal 15.14 input data of the field sync signal acquisition and digital-to-analogue Conversion module 17, it is orthogonal thereto with quick scanning mirror that the signal of scarnning mirror at a slow speed 15 inputs the driving of slow scanning mirror module 16 Slow scanning mirror on direction moves linearly.The horizontal synchronizing pulse signal (H-sync) 12 also inputs the data acquisition and number Mould conversion module 17 generates digitized horizontal synchronizing pulse signal h.
The field sync signal and at a slow speed scarnning mirror signal generator 11 be digital circuit form, can by include FPGA, The circuit of DSP or the electronic component of other forms is constituted.The field sync signal (V-sync) 14 is digital signal, described Scarnning mirror signal 15 is analog signal at a slow speed, and analog-digital converter DAC is needed to be converted into digital signal.In the present embodiment, institute Stating analog-digital converter can be realized using the DAC5672 analog-digital converter of Texas Instrument.The field system chronizing impulse Signal (V-sync) 14 and the at a slow speed phase of scarnning mirror signal 15 by the horizontal synchronizing pulse signal (H-sync) 12 into Horizontal lock.
Scarnning mirror analog signal 15 at a slow speed, for directly driving slow scanning mirror, or by power amplifier by signal Slow scanning mirror is driven to work after amplification again.
As shown in figure 8, multichannel SLO (multichannel image data) vision signal 13, the horizontal synchronizing pulse signal 12 With field system chronizing impulse signal 14, after inputting data acquisition and D/A converter module 17, by digital-to-analogue conversion to above-mentioned three A signal carries out digitized processing, exports set of number signal 18, including digitized picture signal (SLO-Data), row are together Step pulse signal h, digitized field system chronizing impulse signal v and pixel clock signal p.
Wherein, the pixel clock signal p, can be by programming the number in the data acquisition and D/A converter module 17 Phase-locked loop circuit (PLL, Phase Lock Loop) built in mode converter ADC generates.In the present embodiment, the digital-to-analogue conversion Device ADC uses the AD9984a chip of Analog Device Inc.The pixel clock signal p is from horizontal synchronizing pulse signal (H- Sync it) 12 obtains, can generally be determined by mathematical relationship below:
fp=N × fH (9)
Wherein, fpIt is the frequency of pixel clock signal, fHIt is the frequency of horizontal synchronizing pulse, N is an integer for determining Need to generate how many a pixel clocks in one horizontal synchronizing pulse.The size of N is determined by user by programming.
As shown in figure 8, pixel clock signal p can also be generated by programming dedicated phase-locked loop circuit.In this implementation In example, the 501A phase-locked loop chip of IDT is can be used in the phase-locked loop circuit.Pixel clock signal p and horizontal synchronizing pulse signal h, Equally meet the condition of formula (9).
In the present embodiment, ADC (such as Texas is used as by the pixel clock signal p that dedicated phase-locked loop circuit generates The ADS58C48 analog-digital chip of Instrument) external pixel clock, for digitize from SLO analog image letter Number.
Field sync signal (V-sync) 14 as shown in Figure 8 and pixel clock signal p are by locking phase line synchronising signal (H-sync) it 12 obtains.
Above-described pixel clock p and digitized line synchronising signal h is used for locking phase embodiment described above 1~implementation The modulation of source signal of modulator approach described in example 3.
In addition, optical system applies Cambridge in the embodiment of confocal imaging system of the present invention The quick resonant scanning mirror of the 8kHz of Technology Inc, model CRS8k.
Quick resonant mirror module 10 as shown in Figure 8 describes the mechanically and electrically sub-device of the resonant scanning mirror, generation Line synchronising signal is 8kHz clock, that is, the line synchronising signal (H- of resonance clock described above and imaging system sync)12.The clock signal is concurrently delivered to field sync signal and the field synchronization of scarnning mirror signal generator 11 occurs at a slow speed Device and at a slow speed scarnning mirror signal generator and data acquisition and D/A converter module 17.
In the present embodiment, the field sync signal and at a slow speed scarnning mirror signal generator 11, can be used Xilinx's Fpga chip, model ML507 (Virtex-5) or SP605 (Spartan-6) are generated from line synchronising signal (H-sync) 12 The field sync signal (V-sync) 14 (referring to Fig. 8 and Figure 10) and at a slow speed scarnning mirror signal 15 (referring to Figure 10).The field Synchronization signal 14 can be immediately communicated to data acquisition and D/A converter module 17.
In the present embodiment, slow scanning signal 15 and a number that the fpga chip is generated by custom circuit Word signal is converted into analog signal by the analog-digital chip DAC5672 of Texas Instruments, for controlling at a slow speed The mechanical movement of scanning mirror.The analog signal obtained after digital-to-analogue conversion i.e. at a slow speed scarnning mirror signal 15 by directly or through Slow scanning mirror module 16 is transmitted to after the amplification of AD8421 chip.In the slow scanning mirror module 16, Cambridge is applied One axis of one group of Scan mirror 6220H, two kinematic axis of Technology Inc.
In the present invention, the multichannel SLO vision signal 13 comes from SLO system.It uses in the present embodiment The avalanche photodide (APD, Avalanche Photo Diode) of the model C10508-01 of Hamamatsu is used as light Electric explorer receives the optical signal that biological sample returns.The multichannel SLO vision signal 13 of APD output is transmitted directly to institute State data acquisition and D/A converter module 17.The SLO system can support by one or more APD receive it is one or more from The optical signal that biological sample returns.
The data acquisition and D/A converter module 17, using the modulus conversion chip of Analog Device, model AD9984a;The line synchronising signal (H-sync) 12 and field sync signal (V-sync) 14 that can be provided according to system, will be described The multi-channel analog signal that APD is sent is one-to-one to be converted to corresponding digital signal, while the pixel clock of output system Signal p, digitized line synchronising signal h and digitized field sync signal v.Wherein, the row of line synchronising signal h and input terminal The locking phase of the field sync signal (V-sync) 14 of 12 genlock of synchronization signal (H-sync), field sync signal v and input terminal.
Wherein, the fpga chip is also programmed for generating the modulation of source signal of Fig. 9 and Figure 10, which is number Word signal.The fpga chip can be programmed to transmit the digitized image letter of the set of number signal 18 Number, it is transmitted to host (Host PC) from ML507 or SP605 by PCIe, is shown for realizing image, image procossing sum number According to functions such as records.
Signal 10 in Fig. 9 shows the quick complete sinusoidal motion track scatter plot of resonant mirror, any of them one The position of the corresponding pixel clock of a point.The signal 11 of Fig. 9 shows line synchronising signal (H-sync) output of quick resonant mirror. Often there is the adjustable phase delay of user in line synchronising signal (H-sync) and sinusoidal motion track.The signal 12 of Fig. 9 is aobvious Show line synchronising signal (H-sync) by digitlization after as a result, being equivalent to the signal h of Fig. 8.The signal 11 and 12 of Fig. 9 it Between also have one can be with the phase delay of user setting, phase delay is equal to the positive integer times of pixel clock signal p.
The trough or wave crest and signal 12 of 10 quick resonant mirror sinusoidal motion track of signal in Fig. 9 have a user can The phase delay of tune.
Embodiment described above 1, embodiment 2, embodiment are generated with electronic hardware, such as FPGA, DSP or other electronic equipments When modulator approach described in 3, electronic hardware can with direct detection to be Fig. 9 12 pulse of signal rising edge or failing edge.
Modulator approach in embodiment described above 1 is generated with electronic hardware, such as FPGA, DSP or other electronic equipments When, a digit counter is established in electronic hardware.The every numerical value for increasing by a step of digit counter corresponds to a pixel clock p。
In Fig. 9 the display of modulated signal 13 since 12 pulse falling edge of signal reset and start counting.Once counting Device has added up 131 preset value, and modulated signal, which is begun turning, is used to open light source, sees 132 parts of Fig. 9.In Fig. 9 132 parts correspond to the image window of resonant mirror forward scan.The size of image window is set by the user.The image of forward scan After window terminates, counter overturns modulated signal and closes light source, until the image window of resonant mirror reverse scanning arrives it Before, see 133 parts of Fig. 9.The 133 part sizes of Fig. 9 are set by the user.After the 133 of Fig. 9 terminate, counter continues to overturn Modulated signal opens light source, until 134 data sampling of image window of reverse scanning terminates.
According to the demand of user, 132 and the 134 of Fig. 9 can only open 132 with standard-sized sheet, can also only open 134.This feelings The case where condition respective corresponding diagram 3A, Fig. 3 B and Fig. 3 C.
With electronic hardware counter technique, approach described above is phase-locked to the signal 13 of modulation of source signal graph 9 The pixel clock signal p and line synchronising signal h of ADC, to avoid flating.
131 in Fig. 9 be a hardware constant, disposable to set for adjusting forward scan image shift amount.Fig. 9's 133 be also a hardware constant, disposable to set for adjusting reverse scanning image shift amount.
For the modulation of source signal for generating modulator approach two in the embodiment 2, the generation of modulated signal and the phase of Fig. 9 Seemingly.But it needs exist for the sufficiently high analog-digital converter of application resolution (DAC) and generates analog signal modulation AOM.In sample window In mouth 132,134, the curve of analog signal and being consistent for Fig. 4.131 offsets of Fig. 9 are needed according to the delay of AOM again Adjustment.
In conjunction with the implementation steps of the modulator approach two in the modulator approach one and embodiment 2 in embodiment described above 1, It can produce the modulator approach three in above embodiments 3, i.e., modulation of source signal shown in fig. 6.
The v of the h and digitlization field sync signal Fig. 8 of above-described digitlization line synchronising signal Fig. 8 are for more than locking phase The modulation of source signal of the inventive method four.
Figure 10 shows the process that the modulation of source signal of modulator approach four in embodiment described above 4 generates.
As shown in Figure 10, the every scanning a cycle 11 (111,112) of fast vibration mirror generates a horizontal synchronizing pulse letter Number, by electronic counter and analog-digital converter DAC, the driving signal of slow scanning mirror increases by a step 12.Slow scanning mirror Driving signal divide forward scan 121 and reverse scanning 122.Forward scan 121 is related to data acquisition, and reverse scanning 122 makes Obtain the initial position that slow scanning mirror is quickly returning to forward scan.121 and 122 can also be equidistant, so as to image capture module The data of the forward scan of slow scanning mirror and reverse scanning are sampled simultaneously.
For the modulation of source signal for generating a slow scanning direction, an electronic counter can be equally used, it is on the scene same Start to reset counter that time that the failing edge (or rising edge) of pace pulse (V-sync) arrives.The list of this counter Position is horizontal synchronizing pulse (H-sync).Start synchronous of count accumulation row at once after offset 141 set by user Number, that is, capable quantity, while modulated signal is overturn.It needs to acquire in image acquisition region 142, that is, each frame image Line number, modulated signal open light source.Once terminating image acquisition region 142, modulated signal is turned into closing light source, arrives region 143。
The modulation of source signal 14 in the slow scanning direction that Figure 10 is generated guarantees that light source is only adopted in the image that user specifies Collect region to open, image capture module light source in not sampled data is closed.
After modulation of source method two described above and method three, the product for removing sinusoidal distortion implementation Figure 11 of image Divide algorithm.In Figure 11, the place 11,12,13 of resonant mirror slow running, light source is directly closed, and image capture module does not acquire Image.In sine curve middle section, linear space domain Δ xiImage pixel value by nonlinear time domain Δ tiThe pixel of covering Value is accumulated.Equally, linear space domain Δ xjImage pixel value by nonlinear time domain Δ tjThe pixel value of covering accumulate and At.Linear and nonlinear described here is opposite.In sample space, if pixel clock (time-domain) is considered linear , it is nonlinear that each pixel, which falls in scanned sample space,.In scanned sample space, by sinusoidal twist correcting Image afterwards be it is linear, such as the Δ x of Figure 11iWith Δ xj, but the pixel range Δ t in corresponding sampling (time) spaceiWith ΔtjIt is exactly nonlinear.
Integral process in Figure 11 is usually completed by the CPU of host, can also be completed by FPGA, can also be by image procossing Device (GPU, Graphics Processing Unit) is completed.In the present embodiment, integral process is by taking the CPU of Intel PC as an example It is completed in CPU.
The foregoing is only a preferred embodiment of the present invention, is not intended to limit the scope of the present invention.

Claims (10)

1. a kind of signal of confocal surface sweeping micro imaging system controls and processing unit, which is characterized in that including quick resonant mirror Module (10), field sync signal and at a slow speed scarnning mirror signal generator (11), slow scanning mirror module (16) and data acquisition and D/A converter module (17);Wherein:
The quick resonant mirror module (10), for motivating quick resonant mirror to make sinusoidal motion and generating a horizontal synchronizing pulse letter Number H-sync (12);The horizontal synchronizing pulse signal H-sync (12) inputs the field sync signal respectively and scarnning mirror is believed at a slow speed Number generator (11) and data acquisition and D/A converter module (17);
The field sync signal and at a slow speed scarnning mirror signal generator (11), for generating field sync signal V-sync (14) and slow Fast scarnning mirror signal (15);
The slow scanning mirror module (16), for receiving scarnning mirror signal (15) at a slow speed, driving is in quick scanning mirror Slow scanning mirror on orthogonal direction moves linearly;
The data acquisition and D/A converter module (17), for receiving multichannel image data video signal (13), row synchronizes Signal H-sync (12) and field sync signal V-sync (14), and digitized processing is carried out to above-mentioned signal, generate digital map As signal SLO-Data, horizontal synchronizing pulse signal h, field system chronizing impulse signal v and pixel clock signal p.
2. the signal of confocal surface sweeping micro imaging system according to claim 1 controls and processing unit, which is characterized in that The field sync signal and at a slow speed scarnning mirror signal generator (11), by the electronic component for including FPGA, DSP or other forms Circuit constitute.
3. the signal of confocal surface sweeping micro imaging system according to claim 1 controls and processing unit, which is characterized in that The line synchronising signal H-sync (12) is 8kHz resonance clock signal.
4. the signal of confocal surface sweeping micro imaging system according to claim 1 or 3 controls and processing unit, feature exist In the line synchronising signal H-sync (12) sends in field sync signal and at a slow speed scarnning mirror signal generator (11) simultaneously Field synchronization generator and at a slow speed scarnning mirror signal generator, and send data acquisition and D/A converter module (17) to.
5. the signal of confocal surface sweeping micro imaging system according to claim 1 controls and processing unit, which is characterized in that The field sync signal V-sync (14) and mirror is swept at a slow speed that the field sync signal and at a slow speed scarnning mirror signal generator (11) generate Signal (15) are retouched, are respectively transmitted to data acquisition and D/A converter module (17) and slow scanning mirror module (16).
6. the signal of confocal surface sweeping micro imaging system according to claim 1 controls and processing unit, which is characterized in that The field sync signal V-sync (14) and pixel clock signal p pass through locking phase line synchronising signal H-sync (12) and obtain.
7. the signal of confocal surface sweeping micro imaging system according to claim 1 controls and processing unit, which is characterized in that The signal of scarnning mirror at a slow speed (15) is also used to that slow scanning mirror work will be driven again after signal amplification by power amplifier Make.
8. the signal of confocal surface sweeping micro imaging system according to claim 1 controls and processing unit, which is characterized in that Field sync signal V-sync (14) locking phase of the field sync signal v and input terminal.
9. the signal of confocal surface sweeping micro imaging system according to claim 1 controls and processing unit, which is characterized in that Agent of the pixel clock signal p and digitized line synchronising signal h for locking phase control imaging source irradiation biological sample The modulation of source signal of amount.
10. a kind of signal of confocal surface sweeping micro imaging system controls and processing method, which is characterized in that this method includes as follows Step:
A, it using quick resonant mirror module (10), motivates quick resonant mirror to make sinusoidal motion and generates a horizontal synchronizing pulse signal H-sync(12);The horizontal synchronizing pulse signal H-sync (12) is inputted to field sync signal respectively and scarnning mirror signal is sent out at a slow speed Raw device (11) and data acquisition and D/A converter module (17);
B, using field sync signal and at a slow speed, scarnning mirror signal generator (11) generates field sync signal V-sync (14) and at a slow speed Scarnning mirror signal (15);
C, scarnning mirror signal (15) at a slow speed are received by slow scanning mirror module (16), driven orthogonal thereto with quick scanning mirror Slow scanning mirror on direction moves linearly;
D, using data acquisition and D/A converter module (17), multichannel image data video signal (13), the synchronous letter of row are received Number H-sync (12) and field sync signal V-sync (14), and digitized processing is carried out to above-mentioned signal, generate digitized image Signal SLO-Data, horizontal synchronizing pulse signal h, field system chronizing impulse signal v and pixel clock signal p.
CN201811526995.XA 2018-11-30 2018-12-13 Signal control and processing unit and its method of confocal surface sweeping micro imaging system Pending CN109521557A (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201811458808 2018-11-30
CN2018114588089 2018-11-30

Publications (1)

Publication Number Publication Date
CN109521557A true CN109521557A (en) 2019-03-26

Family

ID=65796259

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201811526995.XA Pending CN109521557A (en) 2018-11-30 2018-12-13 Signal control and processing unit and its method of confocal surface sweeping micro imaging system

Country Status (1)

Country Link
CN (1) CN109521557A (en)

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20020057492A1 (en) * 1999-03-19 2002-05-16 Olympus Optical Co., Ltd. Scanning confocal microscope
CN103190889A (en) * 2013-04-17 2013-07-10 北京大学 Real-time tunable confocal microscopic imaging system
US20150157204A1 (en) * 2013-12-06 2015-06-11 University Of Rochester Light Source Modulation for a Scanning Microscope
CN106226894A (en) * 2016-08-08 2016-12-14 中国科学院苏州生物医学工程技术研究所 A kind of two-photon hardware synchronization controls device
CN108652581A (en) * 2018-04-28 2018-10-16 中国科学院苏州生物医学工程技术研究所 Laser stimulation system and method based on line confocal imaging
CN209542942U (en) * 2018-11-30 2019-10-25 南京智博医疗器械有限公司 The signal of confocal surface sweeping micro imaging system controls and processing unit

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20020057492A1 (en) * 1999-03-19 2002-05-16 Olympus Optical Co., Ltd. Scanning confocal microscope
CN103190889A (en) * 2013-04-17 2013-07-10 北京大学 Real-time tunable confocal microscopic imaging system
US20150157204A1 (en) * 2013-12-06 2015-06-11 University Of Rochester Light Source Modulation for a Scanning Microscope
CN106226894A (en) * 2016-08-08 2016-12-14 中国科学院苏州生物医学工程技术研究所 A kind of two-photon hardware synchronization controls device
CN108652581A (en) * 2018-04-28 2018-10-16 中国科学院苏州生物医学工程技术研究所 Laser stimulation system and method based on line confocal imaging
CN209542942U (en) * 2018-11-30 2019-10-25 南京智博医疗器械有限公司 The signal of confocal surface sweeping micro imaging system controls and processing unit

Similar Documents

Publication Publication Date Title
US12076189B2 (en) Ultrasonic imaging devices, systems and methods
CN111758047B (en) Single chip RGB-D camera
US8531651B2 (en) Distance measuring device, distance measuring method, program, and integrated circuit
Massey et al. Polar shapelets
CA2900268C (en) Intra-oral scanning device with illumination frames interspersed with image frames
CN103190889B (en) Real-time tunable confocal microscopic imaging system
AU2014233190A1 (en) Image sensor synchronization without input clock and data transmission clock
CN209542942U (en) The signal of confocal surface sweeping micro imaging system controls and processing unit
CN1578153A (en) System capable of adjusting clock phase of ad converter
CN109557652A (en) A kind of confocal surface sweeping microscope light source modulator approach
CN109521557A (en) Signal control and processing unit and its method of confocal surface sweeping micro imaging system
CN109445082A (en) A kind of confocal surface sweeping microscope light source modulator approach
CN109917537A (en) A kind of confocal surface sweeping microscope light source modulator approach
CN109917538A (en) A kind of confocal surface sweeping microscope light source modulator approach
CN107065157B (en) Confocal imaging distortion correction system and method
Conroy et al. Range imager performance comparison in homodyne and heterodyne operating modes
CN105187701A (en) Spectrometer electronic display system
US20050234667A1 (en) System and method for processing a periodic or cyclostationary signal
EP2950745B1 (en) Intra-oral scanning device with illumination frames interspersed with image frames
US12007544B2 (en) Method and apparatus for capturing an image of an object using a scanning microscope
Riccardo et al. Event-driven SPAD camera with 60 ps IRF and up to 1.6· 10^ 8 photon time-tagging measurements per second
Jongenelen et al. Development and characterisation of an easily configurable range imaging system
JP2012134846A (en) Sampling clock generation device and sampling clock generation system
CN208598424U (en) A kind of interface arrangement of ultrasound image data real-time Transmission
Jongenelen et al. Development of a real-time full-field range imaging system

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
CB02 Change of applicant information

Address after: 210000 first floor, building 2, No. 2, Qiande Road, Jiangning District, Nanjing, Jiangsu Province (Jiangning Gaoxin Park)

Applicant after: NANJING BOSHI MEDICAL TECHNOLOGY Co.,Ltd.

Address before: 210000 610 north of D2, Kechuang City, No. 32, Dazhou Road, Yuhuatai District, Nanjing, Jiangsu Province

Applicant before: NANJING ZHIBO MEDICAL DEVICES Co.,Ltd.

CB02 Change of applicant information