CN106897969B - A kind of data processing equipment and method for super-resolution positioning micro-imaging - Google Patents
A kind of data processing equipment and method for super-resolution positioning micro-imaging Download PDFInfo
- Publication number
- CN106897969B CN106897969B CN201710089310.9A CN201710089310A CN106897969B CN 106897969 B CN106897969 B CN 106897969B CN 201710089310 A CN201710089310 A CN 201710089310A CN 106897969 B CN106897969 B CN 106897969B
- Authority
- CN
- China
- Prior art keywords
- subregion
- currently processed
- output end
- pixel
- fluorogram
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T3/00—Geometric image transformation in the plane of the image
- G06T3/40—Scaling the whole image or part thereof
- G06T3/4053—Super resolution, i.e. output image resolution higher than sensor resolution
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T1/00—General purpose image data processing
- G06T1/20—Processor architectures; Processor configuration, e.g. pipelining
Abstract
The invention discloses a kind of data processing equipments and method for super-resolution positioning micro-imaging, and data processing equipment includes data prediction circuit and first processor.Data prediction circuit includes prober interface circuit, multiplex electronics, FPGA and first interface circuit.Prober interface circuit quick obtaining simultaneously exports the fluorogram acquired by detector.Multiplex electronics replicate the fluorogram of detector acquisition, are all the way at least access, do not influence primary circuit structure.FPGA extracts fluorescent molecule subregion from fluorogram, and fluorescent molecule subregion is transferred to first processor by first interface circuit.First processor carries out localization process to fluorescent molecule subregion, obtains Super-resolution Reconstruction figure.Fluorescent molecule subregion is quickly extracted from fluorogram since FPGA can be realized, and transmits it to first processor, Super-resolution Reconstruction image is obtained by first processor, so that data processing equipment realizes high-precision super resolution image real-time reconstruction.
Description
Technical field
The invention belongs to super-resolution to position micro-imaging technique field, position more particularly, to one kind for super-resolution
The data processing equipment and method of micro-imaging.
Background technique
Super-resolution positioning imaging technique can realize the spatial resolution for reaching 20nm, can be from Molecular level study cell
The working mechanism of interior complexity, it has also become the indispensable research tool in life science field.It is fast with detector technology
Speed development, it is desirable in the case where not sacrificing imaging viewing field and spatial resolution, improve the time of super-resolution positioning imaging
Resolution ratio.To improve the temporal resolution that super-resolution positions micro-imaging, fast-developing Weak photodetector (sCMOS) has been done
To the image acquisition rates of theoretical 420M pixel/s.However, at present computer for collected data calculating speed it is remote not
It can accomplish to handle in real time.Current Major Systems framework is that the collected data of sCMOS detector are directly connected to calculating
Machine, by the central processing unit (CPU) and graphics processor (GPU) combined calculation of computer, by super-resolution location algorithm come real
The processing of existing image.According to different algorithms, the accuracy and speed of obtained super-resolution figure has very big difference.But it cannot be real
It is handled when real.For sCMOS detector, the computation rate of the remote supercomputer method of the rate of image data acquiring.Even smart
Lower Algebraic Algorithm is spent, also needs just obtain a Super-resolution Reconstruction figure by the data processing of long period, greatly make
The about development of super-resolution positioning micro-imaging technique.Therefore, it invents one kind and had not only been able to satisfy high-precision spatial resolution but also energy
The method for meeting real time data processing becomes the urgent need of this field.
Summary of the invention
In view of the drawbacks of the prior art, a kind of data processing dress for super-resolution positioning micro-imaging provided by the invention
It sets, it is intended to solve existing processing unit and cannot take into account high-precision spatial resolution and be able to satisfy the technology of real time data processing again to ask
Topic.
To achieve the above object, the present invention provides it is a kind of for super-resolution positioning micro-imaging data processing equipment,
Including data prediction circuit and first processor；
Data prediction circuit includes:
Prober interface circuit, for acquiring and transmitting fluorogram；
FPGA, input terminal is connect with the output end of prober interface circuit, for extracting fluorescent molecule from fluorogram
Subregion；And
The output end of first interface circuit, input terminal and FPGA connects, for fluorescent molecule subregion to be transmitted to the
One processor；
First processor includes:
Memory, first end are connect with the output end of first interface circuit, for storing fluorescent molecule subregion；
CPU for sending positioning instruction to GPU, and receives the Super-resolution Reconstruction figure of GPU output；
The first end of GPU, first end and CPU connect, and the second end of second end and memory connects, for according to fixed
Bit instruction carries out localization process to fluorescent molecule subregion, obtains Super-resolution Reconstruction figure, and Super-resolution Reconstruction figure is transmitted to
CPU, Super-resolution Reconstruction figure on image display by finally showing.
Data processing equipment provided by the invention extracts fluorescent molecule sub-district by data prediction circuit from fluorogram
Fluorescent molecule subregion is transmitted to first processor by domain, and the CPU in first processor and GPU are only completed to fluorescent molecule
The localization process in region can be improved the efficiency that first processor obtains Super-resolution Reconstruction figure.It is fast by prober interface circuit
Speed obtains fluorogram from detector, by the hardware circuit provided inside FPGA, can extract from a large amount of fluorogram in real time
The fluorescent molecule subregion of small data quantity, and fluorescent molecule subregion is quickly transferred to the first processing by first interface circuit
Device.Therefore, data processing equipment provided by the invention had both been able to achieve high-precision super resolution image real-time reconstruction.
Further, in data prediction circuit further include: multiplex electronics, input terminal and prober interface circuit
The input terminal of output end connection, the first output end and FPGA connect, and second output terminal is used to fluorogram being transmitted to second
Processor, multiplex electronics are for receiving and fluorogram being copied as the output of two-way fluorogram.
Multiplex electronics, which are realized, is divided into multichannel fluorogram for fluorogram, and fluorogram is sent to data prediction electricity all the way
Road, fluorogram is sent to second processor all the way, super-resolution localization process is carried out to fluorogram by second processor, so that this hair
The data processing equipment of bright offer can be compatible with existing data processing equipment, and user can retain original image processing mode.
Further in data prediction circuit further include: multiplex electronics, input terminal and prober interface circuit
The input terminal of output end connection, the first output end and FPGA connect, and second output terminal is used to fluorogram being transmitted to second
Processor, third end to N-terminal are used to be used as expansion interface, and multiplex electronics are for receiving and copying as fluorogram more
Road fluorogram output, wherein N >=3.
Further, FPGA includes:
Fluorogram read module, input terminal are connect with the output end of prober interface circuit, for obtaining fluorogram, and
Fluorogram is divided into the output of three road fluorograms；
Noise reduction process module, input terminal are connect with the first output end of the fluorogram read module, for fluorescence
Figure carries out noise reduction process, exports the first image；
Background processing module is gone, input terminal is connect with the output end of noise reduction process module, for carrying out to the first image
Background process is gone, the second image is exported；
Background fluctuations intensity obtains module, including third subregion obtains circuit, input terminal and fluorogram read module
Second output terminal connection, for extracting the currently processed subregion of third from fluorogram；Background fluctuations intensity obtains circuit,
Input terminal is connect with the output end that third subregion obtains circuit, for obtaining the local standard of the currently processed subregion of third
Difference, and using the Local standard deviation of the currently processed subregion of third as the background fluctuations intensity of the currently processed subregion of third, it uses
Make the threshold value of fluorescent molecule subregion judgement；And
Subregion judgement and extraction module, including the 4th subregion obtain circuit, input terminal and go background processing module
Output end connection, for from the second image extract the 4th currently processed subregion；Subregion decision circuitry, the first input
The output end for obtaining circuit with the 4th subregion is held to connect, the output end of the second input terminal and background fluctuations intensity acquisition circuit
Connection, using the background fluctuations intensity of the currently processed subregion of third as the background fluctuations intensity of the 4th currently processed sub-district, root
Determine that the 4th is current according to the background fluctuations intensity of the 4th currently processed subregion and the signal strength of the 4th currently processed subregion
Handling subregion whether there is fluorescent molecule, and exports subregion and extract control signal；Alternative subregion obtains circuit, input
End is connect with the fluorogram read module third output end, for extracting alternative subregion from fluorogram；Subregion extracts
Circuit, input terminal are connect with the output end that alternative subregion extracts circuit, control terminal and subregion decision circuitry output end
Connection extracts control signal according to subregion and determines whether alternative subregion is fluorescent molecule subregion.
Background fluctuations intensity obtains in module and carries out Local standard deviation processing to the currently processed subregion of third, obtains third
The background fluctuations intensity of currently processed subregion, only uses local image information, so that each subregion has a background
Cymomotive force, rather than all subregions share a background fluctuations intensity in whole image, can have not in entire image
Make extracted fluorescent molecule subregion more accurate in the case where homogeneous background, there is better adaptability, by FPGA
Circuit is completed to extract fluorescent molecule subregion from fluorogram, is combined using CPU with GPU compared to existing data processing equipment
Fluorogram is handled, data processing rate is obviously improved.
Further, background fluctuations intensity acquisition circuit includes:
Pixel comparator, input terminal are connect with the output end that the third subregion obtains circuit, for according to third
The gray value of currently processed each pixel of subregion obtains screening pixel from the currently processed subregion of third；
Mean value adder, input terminal are connect with the output end of the pixel comparator, for obtaining the flat of screening pixel
Mean value；
Subtracter, first input end are connect with the output end of the pixel comparator, and the second input terminal adds with mean value
The output end of musical instruments used in a Buddhist or Taoist mass connects, for obtaining the difference of each screening pixel and the average value for screening pixel；And
The output end of Local standard deviation adder, input terminal and subtracter connects, and is used for each screening pixel and screening
The difference of the average value of pixel is summed, and the Local standard deviation of the currently processed subregion of third is obtained.
Background fluctuations intensity provided by the invention obtains circuit, by pixel comparator according to the currently processed subregion of third
Gray value obtain screening pixel, carries out Local standard deviation calculating with screening pixel, can be improved background fluctuations intensity obtain it is electric
Road processing speed.
Further, subregion decision circuitry includes:
First pixel comparator, input terminal is connect with the output end that the 4th subregion obtains circuit, for judging
Whether the center pixel gray value of the 4th currently processed subregion is maximum in the 4th currently processed each grey scale pixel value of subregion
Value, and the first level value is exported according to judging result；
Second pixel comparator, one input end obtains circuit output end with the 4th subregion and connect, another defeated
Enter end to connect with background fluctuations intensity acquisition circuit output end, for the center pixel according to the 4th currently processed subregion
The background fluctuations intensity of the currently processed subregion of sum of the grayscale values the 4th exports second electrical level value；
Four neighborhood pixel addition devices, input terminal and the 4th subregion obtain circuit output end and connects, are used for the
The center pixel gray scale of four neighborhood grey scale pixel values and the 4th currently processed subregion of four currently processed subregion center pixels
Value carries out accumulation process and exports the first cumulative gray value；
Eight neighborhood pixel addition device, input terminal and the 4th subregion obtain circuit output end and connects, are used for the
The eight neighborhood grey scale pixel value of four currently processed subregion center pixels and the center pixel gray scale of the 4th currently processed subregion
Value carries out accumulation process and obtains the second cumulative gray value；
Compared with device, one input end is connect four neighborhood pixel ratios with the output end of the four neighborhoods pixel addition device, another
Input terminal obtains circuit output end with the background fluctuations intensity and connect, for currently being located according to the first cumulative sum of the grayscale values the 4th
The background fluctuations intensity for managing subregion exports third level value；
Eight neighborhood pixel comparator, one input end is connect with the eight neighborhood pixel addition device output end, another defeated
Enter end to connect with background fluctuations intensity acquisition circuit output end, for currently processed according to the second cumulative sum of the grayscale values the 4th
The background fluctuations intensity of subregion exports the 4th level value；And
Logical AND gate, first input end are connect with the output end of the first pixel comparator, the second input terminal with
The output end of the second pixel comparator connects, and third input terminal and the four neighborhoods pixel ratio connect compared with the output end of device
It connects, the 4th input terminal is connect with the output end of the eight neighborhood pixel comparator, for according to the first level value to the 4th electricity
Level values export subregion and extract control signal.
Subregion judgement provided by the invention and extraction module, by the center pixel for judging the 4th currently processed subregion
Gray value whether be that determine that fluorescent molecule is located at the 4th current for the maximum value of all gray values of the 4th currently processed subregion
The center for handling subregion, using the background fluctuations intensity of the 4th currently processed subregion as threshold value, by the 4th current place
The gray value for managing the gray value of the center pixel of subregion and the gray value of four neighborhood territory pixels, eight neighborhood pixel is worked as with the 4th
The currently processed subregion of background fluctuations intensity multilevel iudge the 4th of pre-treatment subregion whether there is fluorescent molecule, eliminate background
Influence to fluorescent molecule judgement, so that judging result is more accurate.
As another aspect of the present invention, the present invention provides the data prediction sides for super-resolution positioning micro-imaging
Method includes the following steps:
(1) noise reduction sonication is carried out to fluorogram and exports the first image, and ambient noise is carried out to the first image and is handled,
Export the second image；
The currently processed subregion of third is extracted from fluorogram, and Local standard deviation is carried out to the currently processed subregion of third
Processing obtains the Local standard deviation of the currently processed subregion of third, and the Local standard deviation of the currently processed subregion of third is made
For the background fluctuations intensity of the currently processed subregion of third；The currently processed subregion of third is updated, each pixel in fluorogram is obtained
Background fluctuations intensity, using the background fluctuations intensity of fluorogram all pixels as the background fluctuations of all pixels in the second image
Intensity；
(2) the 4th currently processed subregion is extracted from the second image, by the background fluctuations of the currently processed subregion of third
Background fluctuations intensity of the intensity as the 4th currently processed sub-district is worked as according to the 4th currently processed subregion signal strength and the 4th
The background fluctuations intensity of pre-treatment subregion judge the 4th currently processed subregion with the presence or absence of fluorescent molecule subregion, and according to
Judging result determine whether using in fluorogram with the 4th currently processed subregion in the second image the identical region in position as
Fluorescent molecule subregion；The 4th currently processed subregion is updated, all fluorescent molecule subregions in fluorogram are extracted；
(3) fluorescent molecule subregion is subjected to localization process, obtains Super-resolution Reconstruction image.
Provided by the present invention for the data preprocessing method of super-resolution positioning micro-imaging, by what is extracted from fluorogram
Each currently processed subregion of third carries out Local standard deviation processing, and the background fluctuations for obtaining the currently processed subregion of third is strong
Degree, and the 4th currently processed subregion is extracted from the second image, the background fluctuations intensity of the currently processed subregion of third is made
For the background fluctuations intensity of the 4th currently processed subregion, and worked as according to the signal strength and the 4th of the 4th currently processed subregion
The background fluctuations intensity of pre-treatment subregion determines that the 4th currently processed subregion, can be in whole picture figure with the presence or absence of fluorescent molecule
As with making extracted fluorescent molecule subregion more accurate in the case where uneven background, there is better adaptability,
Obtain accurate Super-resolution Reconstruction image.
Further, step (2) includes the following steps:
(21) the 4th currently processed subregion is extracted from the second image, if the center pixel of the 4th currently processed subregion
Gray value be the 4th currently processed subregion all pixels gray value maximum value,
And the 4th currently processed subregion center pixel gray value be greater than the 4th currently processed subregion background wave
2 times of fatigue resistance；
And the 4th currently processed subregion center pixel gray value and the 4th currently processed subregion center pixel four
The sum of gray value of neighborhood territory pixel is greater than 9 times of the background fluctuations intensity of the 4th currently processed subregion,
And the 4th currently processed subregion center pixel gray value and the 4th currently processed subregion center pixel
The sum of gray value of eight neighborhood pixel is greater than 11 times of the background fluctuations intensity of the 4th currently processed subregion；
Then using in fluorogram with the 4th currently processed subregion in the second image the identical region in position as fluorescence point
Sub- subregion extracts, and enters step (22)；Otherwise it does not extract in fluorogram with the 4th currently processed subregion in the second image
The identical region in middle position, enters step (22)；
(22) judge whether all 4th currently processed subregions have all been extracted, if so, terminating；Otherwise, into
Enter step (21)；
4th currently processed subregion is the subregion greater than 7 × 7 extracted from the second image.
The 4th currently processed subregion is extracted from the second image, by the gray scale of each pixel in the 4th currently processed subregion
Value determines whether the 4th currently processed subregion is fluorescence point compared with the background fluctuations intensity of the 4th currently processed subregion
Son, by judge the 4th currently processed subregion center pixel gray value whether be maximum value judge fluorescent molecule whether
The center of 4th currently processed subregion can accurately judge fluorescent molecule region in fluorogram.
Detailed description of the invention
Fig. 1 is the structural schematic diagram provided by the present invention for the data processing equipment of super-resolution positioning micro-imaging；
Fig. 2 is FPGA pretreatment circuit in the data processing equipment provided by the present invention for super-resolution positioning micro-imaging
Schematic diagram；
Fig. 3 is the structural schematic diagram that background fluctuations intensity obtains circuit in FPGA；
Fig. 4 is that the present invention provides the structural schematic diagram of FPGA neutron region decision circuit；
Fig. 5 is FPGA device structural schematic diagram provided by the invention, and (a) is the knot that fluorogram is obtained from sCMOS detector
Structure schematic diagram is (b) structural schematic diagram of the image pre-processor in FPGA；
Fig. 6 is to obtain screening pixel principle from the currently processed subregion of third in data processing method provided by the invention
Figure；
Fig. 7 is that the present invention provides the data prediction circuit progress pretreated effect diagram of fluorogram, wherein (a) is
By the effect diagram for the fluorogram that sCOMS camera acquires, (b) effect for that will fluorogram progress noise reduction process and go background process
Fruit schematic diagram is (d) from glimmering (c) for fluorogram is carried out the filtered background fluctuations intensity effect schematic diagram of Local standard deviation
The effect diagram of all fluorescent molecule subregions extracted in light figure.
Specific embodiment
In order to make the objectives, technical solutions, and advantages of the present invention clearer, with reference to the accompanying drawings and embodiments, right
The present invention is further elaborated.It should be appreciated that the specific embodiments described herein are merely illustrative of the present invention, and
It is not used in the restriction present invention.
Fig. 1 is the structural schematic diagram that the data processing equipment of micro-imaging is positioned provided by the present invention for super-resolution, number
It include data prediction circuit, the input terminal of the output end connection first processor of data prediction circuit, number according to processing unit
Data preprocess circuit is used to extract fluorescent molecule subregion from the fluorogram that detector acquires, and first processor is used for fluorescence
Molecule subregion carries out localization process and obtains Super-resolution Reconstruction figure.Data prediction circuit includes prober interface circuit, is used for
The fluorogram that detector acquires quickly is transmitted to multiplex electronics.Prober interface circuit can connect for cameralink
The various switchable interfaces such as mouth, USB interface, FMC module.
Multiplex electronics are for receiving fluorogram and fluorogram being copied as the output of multichannel fluorogram, input terminal and spy
The connection of device interface circuit output end is surveyed, for multiplex electronics there are two output end, one of output end is access, which uses
It is connected in the input terminal of same second processor, the another output of multiplex electronics is connect with FPGA input terminal, at second
The input terminal of the output end and image display of managing device connects, and second processor is used to fluorogram carrying out super-resolution localization process
Super resolution image is obtained, which allows user to retain original fluorogram processing mode.
As another implementation of multiplex electronics, multiplex electronics have N number of output end, wherein N >=3, the
The input terminal of the connection of the input terminal of one output end and FPGA, second output terminal and second processor connects, third output end to N
Output end is used to extension output.So that other processing chips or processor are connected by third output end to N output end
Into data prediction circuit, processing chip can be dsp chip.
The input terminal of FPGA output end and first interface circuit, FPGA extracts fluorescent molecule subregion from fluorogram, glimmering
For optical molecule subregion by first interface circuit transmission to first processor, first processor includes memory, CPU and GPU, is deposited
The first end of reservoir and first interface circuit output end, the first end of CPU and the first end of GPU connect, the second end of GPU with deposit
The second end of reservoir connects, and memory is used to send positioning instruction to GPU for storing fluorescent molecule subregion, CPU, and GPU connects
Fluorescent molecule sub-district numeric field data is received from memory after receiving positioning instruction, and localization process is carried out to fluorescent molecule subregion
Super-resolution Reconstruction figure is obtained, super-resolution figure is transmitted to CPU, and Super-resolution Reconstruction figure is shown by image display.
Since the characteristic of sparse excitation is imaged in super-resolution positioning, by only only being wrapped in the fluorogram of pick-up probe acquisition
Subregion containing fluorescent molecule be it is effective, therefore, data processing equipment provided by the invention, by data prediction circuit from fluorescence
In figure extract fluorescent molecule subregion, fluorescent molecule subregion is transmitted to first processor, the CPU in first processor with
GPU is only completed the localization process to fluorescent molecule subregion, can be improved the efficiency that first processor obtains Super-resolution Reconstruction figure.
Fluorogram is quickly obtained from detector by prober interface circuit, and realizes that extract real-time goes out fluorescence in fluorogram by FPGA
Molecule subregion proposes fluorescent molecule subregion useful in fluorogram, can guarantee the precision for obtaining Super-resolution Reconstruction figure,
By the hardware circuit provided inside FPGA, fluorescent molecule subregion can be extracted from a large amount of fluorogram in real time, and by first
Fluorescent molecule subregion is quickly transferred to first processor by interface circuit.Therefore, it is positioned provided by the present invention for super-resolution
The data processing equipment of micro-imaging realizes high-precision super resolution image real-time reconstruction.
Fig. 2 is FPGA structure signal in the data processing equipment provided by the present invention for super-resolution positioning micro-imaging
Figure, FPGA include fluorogram read module 5, noise reduction process module 1, background processing module 2, background fluctuations intensity are gone to obtain module
3 and subregion judgement with extraction module 4.
Fluorogram read module 5 is divided into the output of three road fluorograms for obtaining fluorogram, and by fluorogram, and fluorogram is read
First output end of modulus block 5 is connect with the input terminal of noise reduction process module 1, and noise reduction process module 1 is used to carry out fluorogram
Noise reduction process, exports the first image, and the output end of noise reduction process module 1 connect with the input terminal of background processing module 2 is removed, is used for
Background process is carried out to the first image, exports the second image.
Background fluctuations intensity obtains module 3, including third subregion obtains circuit 301 and background fluctuations intensity obtains circuit
302, the input terminal that third subregion obtains circuit 301 is connect with the output end of fluorogram read module 5, in real time from fluorescence
The currently processed subregion of third is extracted in figure, background fluctuations intensity obtains the input terminal of circuit 302 and third subregion obtains
The output end of circuit 301 connects, and currently locates for exporting the Local standard deviation of the currently processed subregion of third in real time, and by third
Background fluctuations intensity of the Local standard deviation of subregion as the currently processed subregion of third is managed, background fluctuations intensity is used for fluorescence
The threshold value of molecule subregion judgement.
Subregion judgement and extraction module 4, including the 4th subregion obtain circuit 401, subregion decision circuitry 402, standby
It selects subregion to obtain circuit 403 and subregion and extracts circuit 404, the 4th subregion obtains the input terminal of circuit 401 and goes to carry on the back
The output end of scape processing module 2 connects, for extracting the 4th currently processed subregion, subregion judgement from the second image in real time
402 first input end of circuit is connect with the output end that the 4th subregion obtains circuit 401, and subregion decision circuitry 402 second is defeated
Enter end and connect with the output end that background fluctuations intensity obtains circuit 302, the 4th subregion is allowed to obtain circuit 401 and third subregion
It obtains circuit 301 to cooperate in timing, makes the center pixel of the 4th currently processed subregion position and third in the second image
The center pixel of currently processed subregion position in fluorogram is identical, i.e., the background fluctuations of the currently processed subregion of third is strong
The background fluctuations intensity as the 4th currently processed subregion is spent, subregion decision circuitry 402 is according to the 4th currently processed sub-district
Domain and the background fluctuations intensity real-time judge that the currently processed subregion of third that exports of circuit 302 is obtained by background fluctuations intensity
Four currently processed subregions whether there is fluorescent molecule, and exports subregion and extract control signal.
The input terminal that alternative subregion obtains circuit 403 is connect with the third output end of fluorogram read module 5, alternative son
Region obtains circuit 403 and extracts 404 input terminal of circuit and alternative sub-district for extracting alternative subregion, subregion from fluorogram
Domain obtains the output end connection of circuit 403, and subregion extracts the control terminal and 402 output end of subregion decision circuitry of circuit 404
Connection extracts control signal according to subregion and determines whether alternative subregion is fluorescent molecule subregion in real time.Allow alternative sub-district
Domain is extracted circuit 403 and is cooperated in timing with the 4th subregion acquisition circuit 401, and the middle imago of the 4th currently processed subregion is made
The position in fluorogram is identical with the center pixel of alternative subregion for position in the second image for element.
Circuit 301 is obtained by third subregion, the 4th subregion obtains circuit 401 and alternative subregion extracts circuit
403 constantly update the currently processed subregion of third, the 4th currently processed subregion and the alternative subregion of output, realize to fluorescence
Figure all pixels are pre-processed, and are handled in real time by data prediction circuit fluorogram, are cut down in fluorogram and are schemed to reconstruction
As nonsensical or there are the data of bad influence, fluorescent molecule subregion is used for image reconstruction, image reconstruction meter is effectively reduced
The calculation amount of calculation reduces the time of reconstruction image.
Meanwhile background fluctuations intensity obtains module and is currently located according to the gray value of the currently processed subregion of third acquisition third
The Local standard deviation for managing subregion, only uses local image information, and by the Local standard deviation of the currently processed subregion of third
As the background fluctuations intensity of the currently processed subregion of third, so that each pixel has the value of a background fluctuations intensity, and
It is not the value that whole image shares a background fluctuations intensity, can makes in the case where entire image has uneven background
Extracted fluorescent molecule subregion is more accurate, has better adaptability.Therefore, fixed provided by the present invention for super-resolution
The data processing equipment of position micro-imaging can be realized real-time and high-precision spatial resolution reconstruction image.
Noise reduction process module includes noise reduction line buffer group, the first noise reduction register group, drop in FPGA provided by the invention
It makes an uproar summation circuit and the second noise reduction register of being multiplied, noise reduction line buffer group is worked as extracting from fluorogram and exporting first
The input terminal of pre-treatment subregion, the first noise reduction register group is connect with noise reduction line buffer group output end, the deposit of the first noise reduction
Device group is exported for storing the first currently processed subregion, the input terminal of noise reduction multiplication summation circuit and the first noise reduction register group
End connection, noise reduction multiplication summation circuit is for mutually being multiplied accumulating the first currently processed subregion with default noise reduction convolution mask
Processing, and the gray value after the first currently processed subregion noise reduction is exported, the input terminal of the second noise reduction register is multiplied with noise reduction
Summation circuit output end connection, for store by noise reduction multiplication summation circuit export noise reduction after image.
Background processing module is gone in FPGA provided by the invention, including goes background line buffer group, and first goes background to deposit
Device group removes background multiplication summation circuit and second removes background register, goes background line buffer group for from the figure after noise reduction
The first currently processed subregion is extracted and exported as in, and first removes the input terminal of background register device group and remove background line buffer
Group output end connection, first go background register group for store the first currently processed subregion, remove background multiplication summation circuit
Input terminal go background register group output end to connect with first, go background multiplication summation circuit for by the first currently processed son
Region goes background convolution mask to carry out the accumulation process that is multiplied with default, and exports the first currently processed subregion and remove the ash after background
Angle value, second goes the input terminal of background register to connect with background multiplication summation circuit output end is removed, for storing by going background
The image data of multiplication summation circuit output gone after background and after noise reduction.
As shown in figure 3, it includes pixel comparator that background fluctuations intensity, which obtains circuit 302, in FPGA provided by the invention
3021, mean value adder 3022, subtracter 3023 and Local standard deviation adder 3024,3021 input terminal of pixel comparator with
Third subregion obtains the output end connection of circuit 301, for being obtained according to the gray value of each pixel of the currently processed subregion of third
Pixel must be screened, 3022 input terminal of mean value adder is connect with the output end of pixel comparator 3021, for obtaining screening pixel
Average value, 3023 first input end of subtracter connect with the output end of pixel comparator 3021, and subtracter 3,023 second inputs
End is connect with the output end of mean value adder 3022, for obtaining the difference of each screening pixel and the average value for screening pixel, office
3024 input terminal of ministerial standard difference adder is connect with 3023 output end of subtracter, for by each screening pixel and screening the flat of pixel
The difference of mean value is summed, and the Local standard deviation of the currently processed subregion of third is obtained.It is current from third in pixel comparator 3021
When handling acquisition screening pixel in subregion, the outermost of the currently processed subregion of third can be owned according to the position of pixel
Pixel is divided into two parts, and a half-pix is selected from each part as screening pixel, and the ash of pixel is filtered out from the part
Angle value is respectively less than the gray value for not filtering out pixel in the part arbitrarily.Background fluctuations intensity provided by the invention obtains electricity
Road obtains screening pixel according to the gray value of the currently processed subregion of third by pixel comparator, carries out office with screening pixel
Ministerial standard difference calculates, and the processing of circuit speed can be improved.
As shown in figure 4, the present invention provide FPGA neutron region decision and extraction module include the first pixel comparator 4021,
Second pixel comparator 4022, four neighborhood pixel addition devices 4023, eight neighborhood pixel addition device 4025, four neighborhood pixel ratios are compared with device
4024, eight neighborhood pixel comparator 4026 and logical AND gate 4027,4021 input terminal of the first pixel comparator and the 4th sub-district
Domain obtains the output end connection of circuit 401, for judging whether the center pixel gray value of the 4th currently processed subregion is the
Maximum value in each grey scale pixel value in four current sub-regions, and the first level is exported according to judging result, when the 4th currently processed son
The center pixel gray value in region is maximum value in the 4th each grey scale pixel value in current sub-region, then the first level is high level,
Otherwise, it is low level, can determines whether fluorescent molecule is located at the centre bit of the 4th currently processed subregion by the first level
It sets.
One input terminal of the second pixel comparator 4022 obtains 401 output end of circuit with the 4th subregion and connect, the second picture
Another input terminal of plain comparator 4022 obtains 302 output end of circuit with background fluctuations intensity and connect, current by comparing the 4th
The background fluctuations intensity for handling the currently processed subregion of center pixel sum of the grayscale values the 4th of subregion exports second electrical level, if the
The center pixel gray value of four currently processed subregions is greater than twice of the background fluctuations intensity of the 4th currently processed subregion, then
Second electrical level is high level, and otherwise, second electrical level is low level.
Four neighborhood pixel addition devices, 4023 input terminal and the 4th subregion obtain 401 output end of circuit and connects, are used for the
Four neighborhood grey scale pixel values of the center pixel of four currently processed subregions and the center pixel ash of the 4th currently processed subregion
Angle value carries out accumulation process and obtains the first cumulative gray value.4025 input terminal of eight neighborhood pixel addition device and the 4th subregion obtain
401 output end of circuit connection, for by the eight neighborhood grey scale pixel value and the 4th of the center pixel of the 4th currently processed subregion
The center pixel gray value of currently processed subregion carries out accumulation process and obtains the second cumulative gray value.
Four neighborhood pixel ratios are connect compared with 4,024 1 input terminal of device with the output end of four neighborhood pixel addition devices 4023, four neighborhoods
Another input terminal of pixel comparator 4024 obtains 302 output end of circuit with background fluctuations intensity and connect, and compares the first cumulative gray scale
The background fluctuations intensity of value and the 4th currently processed subregion, and third level is exported according to comparison result, if the first cumulative element
Gray value is greater than 9 times of the background fluctuations intensity of the 4th currently processed subregion, then third level is high level, otherwise, third
Level is low level.
4,026 1 input terminal of eight neighborhood pixel comparator is connect with the output end of eight neighborhood pixel addition device 4025, eight neighborhood
Another input terminal of pixel comparator 4026 obtains 302 output end of circuit with background fluctuations intensity and connect, and compares the second cumulative gray scale
The background fluctuations intensity of value and the 4th currently processed subregion, and the 4th level is exported according to comparison result, if the second cumulative element
Gray value is greater than 11 times of the background fluctuations intensity of the 4th currently processed subregion, then the 4th level is high level, otherwise, the 4th
Level is low level.
4027 first input end of logical AND gate is connect with the output end of the first pixel comparator 4021, logical AND gate 4,027
Two input terminals are connect with the output end of the second pixel comparator 4022,4027 third input terminal of logical AND gate and four neighborhood pixel ratios
Output end compared with device 4024 connects, and the output end of the 4th input terminal of logical AND gate 4027 and eight neighborhood pixel comparator 4026 connects
It connects, subregion is exported according to the first level to the 4th level and extracts control signal.
When the first level is high level to the 4th level, then it represents that there are fluorescence point for the 4th currently processed subregion
Son, the subregion that logical AND gate 4027 exports control signal, and alternative subregion is made to obtain the alternative subregion conduct of circuit output
Fluorescent molecule subregion extracts circuit output via subregion.When it is not high level that the first level to the 4th level, which has one,
Then indicate that fluorescent molecule is not present in the 4th currently processed subregion, the subregion that logical AND gate 4027 exports controls signal, makes standby
The alternative subregion for selecting subregion to obtain circuit output does not extract circuit output via subregion.By to the 4th currently processed son
Four neighborhood territory pixels in region, eight neighborhood pixel are compared with the background fluctuations intensity of the 4th currently processed subregion, can be disappeared
Except the influence that background fluctuations intensity judges fluorescent molecule, so that the fluorescent molecule subregion of output is more accurate.
In the embodiment of data processing equipment provided by the invention, detector is sCMOS detector, and sCMOS detector is adopted
Fluorogram, i.e., the data of each 5 pixels of clock simultaneous transmission are transmitted with the camera link transport protocol of 80bits.Therefore it connects
Mouth selects cameralink interface circuit, and Fig. 5 is the device architecture schematic diagram of PFGA, in order to correctly obtain by camera
The image data of link interface transmission obtains fluorogram from sCMOS detector using circuit structure shown in 5 (a).SCMOS is visited
The transmission mode that device generallys use Rolling shutter is surveyed, i.e. fluorogram is read from intermediate toward both sides line by line, passes through write state
Fluorogram is respectively stored into odd rows of picture FIFO and even number line image FIFO by machine, while often in view of fluorogram processing
Several pixels less than edge are handled, if carry out simple odd even segmentation, among finally obtained super resolution image
Have a black-tape.Therefore, 6 row data among upper half detector are also transmitted to lower half detector by us, and lower half is visited
The 6 row data for surveying device bottom are lost.Similar operation is also carried out to upper half detector data, not only the black-tape of centre is gone in this way
It removes, and because image size is constant, ensure that the speed of image procossing is constant, and according to the line number parity handle of fluorogram
Fluorogram is divided into the data of upper and lower two halves detector.
As shown in Fig. 5 (b), each half detector data distributes an image processor and is handled, each image procossing
Device includes noise reduction process module, background processing module, background fluctuations intensity is gone to obtain module and subregion judgement and extract mould
Block includes line buffer group and register group interconnected in aforementioned four module, in a line buffer, each
Clock pixel is moved along a lattice, removes the pixel of current line buffer while flowing into next line buffer and register, posts
Gray value of the storage group full of the pixel flowed into, that is, obtain currently processed subregion, by line buffer group in noise reduction process module
The accumulation process that is multiplied is carried out with default noise reduction convolution mask with the currently processed subregion that register group is extracted from fluorogram, is obtained
Gray value after obtaining currently processed pixel noise reduction obtains that is, by carrying out Gassian low-pass filter processing to currently processed subregion
Gray value after currently processed pixel noise reduction, the gray value after each pixel noise reduction are stored by register group, and register group is by each picture
Gray value after plain noise reduction is exported to background processing module is gone, similarly, by line buffer group and register group from the first image
Currently processed subregion is extracted, the currently processed subregion that register group exports in background processing module is gone to go background to roll up with default
Product module plate carries out multiplication accumulation process, obtains currently processed pixel and removes the gray value after background and noise reduction, i.e., to currently processed picture
Element carries out loop filtering processing, obtains current pixel and removes the gray value after background and noise reduction, after each pixel removes background and noise reduction
Gray value is stored by register, and the gray value after removing background and noise reduction is transmitted to subregion judgement and extracts mould by register group
Block.Background fluctuations intensity obtains line buffer group and register group in module and extracts currently processed subregion from fluorogram, and
The Local standard deviation for obtaining currently processed subregion, using the Local standard deviation of currently processed subregion as currently processed subregion
Background fluctuations intensity, in the background fluctuations intensity storage register of currently processed subregion, and be transmitted to subregion judgement with
Extraction module.Image of the subregion judgement with the line buffer group and register group in extraction module after going background and noise reduction
It is middle to extract currently processed subregion, and subregion is exported by subregion decision circuitry and extracts control signal, and subregion is mentioned
Control signal is taken to be transmitted to the control terminal that subregion extracts circuit, subregion judgement and another line buffer group in extraction module
Alternative subregion is extracted from fluorogram with another register group, and alternative subregion is transmitted to subregion and extracts circuit, son
Extracted region circuit extracts control signal according to subregion and determines whether alternative subregion is fluorescent molecule subregion in real time, if
It is then to store alternative subregion into sub-district numeric field data FIFO, by being merged to sub- area data FIFO, after merging
Sub-district numeric field data cut, the sub-district numeric field data of arbitrary size can be obtained, by the glimmering of two image pre-processors output
Optical molecule region data summarized after by USB3.0 be transferred to localization process unit and image reconstruction unit into
Row processing.Because the interface that sCOMS camera taps into FPGA is camera link interface, each clock transfer of this interface is to FPGA
Data be 5 pixels, that is, 5*16bit data volume.Therefore by five noise reduction process modules, five in each image pre-processor
It is a that background processing module, five background fluctuations intensity is gone to obtain module and the judgement of five sub-regions and extraction module.
Since the characteristic of sparse excitation is imaged in super-resolution positioning, only only the region comprising fluorescent molecule be it is effective,
These fluorescent molecule region data are only extracted and transmitted, the data volume of transimission and storage will be substantially reduced, while significantly simple
Change the workload of subsequent processing.Fluorescent molecule sub-district numeric field data is transferred to PC by USB3.0 interface.Due to using local standard
Difference obtains the background fluctuations intensity of each pixel and the mode for being used as threshold value has adaptivity, therefore has and input without user
Parameter, advantage easy to use.
The data processing equipment for super-resolution positioning micro-imaging provided through the invention can be realized 800MB/s
Image data reduce to 300MB/s or less.Fluorescent molecule region data are easily and effectively transferred to USB3.0 interface
User computer, the GPU through user computer realize figure acceleration processing, accomplish the real-time reconstruction of super resolution image, realize that finding is
Gained.
Provided by the present invention for the data processing method of super-resolution positioning micro-imaging, include the following steps:
(1) fluorogram acquired by optical signal detector is subjected to Gassian low-pass filter processing, reduces making an uproar in fluorogram
Acoustical signal exports the first image.When choosing 5 × 5 region progress Gassian low-pass filter centered on currently processed pixel,
Convolution mask are as follows:
First image is subjected to loop filtering processing, removes the ambient noise in the first image, exports the second image.It is elected
When 7 × 7 region centered on currently processed pixel being taken to carry out loop filtering, convolution mask are as follows:
The currently processed subregion of third is extracted from the fluorogram acquired by optical signal detector, it is currently processed to third
Subregion carries out Local standard deviation filtering processing, obtains the Local standard deviation of the currently processed subregion of third, third is currently located
Manage background fluctuations intensity of the Local standard deviation of subregion as the currently processed subregion of third.
If 7 × 7 regions centered on choosing currently processed pixel are as the currently processed subregion of third, as shown in fig. 6, will
Outermost 24 pixels are divided into 4 regions, then to region 1 and the two regions of region 2 totally 12 pixels gray value into
Row sequence from small to large, chooses preceding 6 pixels, to 12 grey scale pixel values in 4 the two regions of region 3 and region from it is small to
Big sequence, is compared one by one, chooses preceding 6 pixels, and finishing screen selects 12 pixels.
According to formula
Calculate the Local standard deviation of the currently processed subregion of third.
In formula, xiFor the gray value for the ith pixel that finishing screen is selected,
(2) all fluorescent molecule subregions in fluorogram are extracted according to fluorogram, the second image and background fluctuations intensity,
Include:
(21) the 4th currently processed subregion is extracted from the second image, when the center pixel of the currently processed subregion of third
The position in the second image is identical with the center pixel of the 4th currently processed subregion for position in fluorogram, then third is current
Handle background fluctuations intensity of the background fluctuations intensity of subregion as the 4th currently processed subregion；
If the gray value of the center pixel of the 4th currently processed subregion is the 4th currently processed subregion all pixels
The maximum value of gray value；
And the 4th currently processed subregion center pixel gray value be greater than the 4th currently processed subregion background wave
2 times of fatigue resistance；
And the 4th currently processed subregion center pixel gray value and the 4th currently processed subregion center pixel four
The sum of gray value of neighborhood territory pixel is greater than 9 times of the background fluctuations intensity of the 4th currently processed subregion；
And the 4th currently processed subregion center pixel gray value and the 4th currently processed subregion center pixel
The sum of gray value of eight neighborhood pixel is greater than 11 times of the background fluctuations intensity of the 4th currently processed subregion；
Then using in fluorogram with the 4th currently processed subregion in the second image the identical region in position as fluorescence point
Sub- subregion extracts, and enters step (22)；Otherwise it does not extract in fluorogram with the 4th currently processed subregion in the second image
The identical region in middle position,
4 neighborhoods of center pixel include the pixel of center pixel left 1, the pixel of center pixel right 1, on center pixel
1 pixel below 1 pixel in side and center pixel；8 neighborhoods of center pixel include with the pixel of left 2 of center pixel,
2 pixels of 2 pixels and center pixel lower section above the pixel of center pixel right 2, center pixel；
4th currently processed subregion is the subregion greater than 7 × 7 extracted from the second image.
(22) judge whether all 4th currently processed subregions have all been extracted, if so, terminating；Otherwise, into step
Suddenly (21)；
(3) localization process is carried out according to fluorescent molecule subregion, obtains Super-resolution Reconstruction image.
Provided by the present invention for the data preprocessing method of super-resolution positioning micro-imaging, provided by the present invention for super
The data preprocessing method for differentiating positioning micro-imaging, by the currently processed subregion part of each third extracted from fluorogram
Standard deviation processing obtains the background fluctuations intensity of the currently processed subregion of third, and from extraction the 4th currently in the second image
Subregion is managed, the background fluctuations intensity of the currently processed subregion of third is strong as the background fluctuations of the 4th currently processed subregion
Degree, and determine that the 4th is currently processed according to the background fluctuations intensity of the 4th currently processed subregion and the 4th currently processed subregion
Subregion whether there is fluorescent molecule, and extracted fluorescence point can be made in the case where entire image has uneven background
Sub- subregion is more accurate, has better adaptability, obtains accurate Super-resolution Reconstruction image.Is extracted from the second image
Four currently processed subregions, by the back of the gray value and the 4th currently processed subregion of each pixel in the 4th currently processed subregion
Scape cymomotive force compares, and determines whether the 4th currently processed subregion is fluorescent molecule, by judging the 4th currently processed sub-district
The gray value of the center pixel in domain whether be maximum value judge fluorescent molecule whether the 4th currently processed subregion centre bit
It sets, can accurately judge fluorescent molecule region in fluorogram.Localization process is carried out according to fluorescent molecule, it is accurate to obtain
Super-resolution Reconstruction image.
Fig. 7 is that the present invention provides the data prediction circuit progress pretreated effect diagram of fluorogram, and Fig. 7 (a) serves as reasons
The effect diagram of the fluorogram of sCOMS camera acquisition, Fig. 7 (b) are that fluorogram is carried out to noise reduction process and goes background process
Effect diagram, Fig. 7 (c) are the effect diagram that fluorogram is carried out to the filtered background fluctuations intensity of Local standard deviation, Fig. 7
It (d) is the effect diagram of all fluorescent molecule subregions extracted from fluorogram.
As it will be easily appreciated by one skilled in the art that the foregoing is merely illustrative of the preferred embodiments of the present invention, not to
The limitation present invention, any modifications, equivalent substitutions and improvements made within the spirit and principles of the present invention should all include
Within protection scope of the present invention.
Claims (7)
1. a kind of data processing equipment for super-resolution positioning micro-imaging characterized by comprising data prediction circuit
And first processor；
The data prediction circuit includes:
Prober interface circuit, for acquiring and transmitting fluorogram；
FPGA, input terminal is connect with the output end of the prober interface circuit, for extracting fluorescent molecule from fluorogram
Subregion；And first interface circuit, input terminal are connect with the output end of the FPGA, for fluorescent molecule subregion to be passed
Transport to first processor；
The first processor includes:
Memory, first end are connect with the output end of first interface circuit, for storing fluorescent molecule subregion；
CPU for sending positioning instruction to GPU, and receives the Super-resolution Reconstruction figure of GPU output；
GPU, first end are connect with the first end of the CPU, the second end connection of second end and memory, for according to institute
It states positioning instruction and localization process is carried out to fluorescent molecule subregion, obtain Super-resolution Reconstruction figure, and Super-resolution Reconstruction figure is transmitted
To the CPU, the Super-resolution Reconstruction figure is shown by final image display；
The FPGA includes:
Fluorogram read module (5), input terminal are connect with the output end of prober interface circuit, for obtaining fluorogram, and
Fluorogram is divided into the output of three road fluorograms；
Noise reduction process module (1), input terminal are connect with the first output end of the fluorogram read module (5), for glimmering
Light figure carries out noise reduction process, exports the first image；
Go to background processing module (2), input terminal is connect with the output end of noise reduction process module (1), for the first image into
Row goes background process, exports the second image；
Background fluctuations intensity obtains module (3), including third subregion obtains circuit (301), and input terminal and fluorogram are read
Module (5) second output terminal connection, for extracting the currently processed subregion of third from fluorogram；Background fluctuations intensity obtains
Circuit (302), input terminal is connect with the output end that third subregion obtains circuit (301), currently processed for obtaining third
The Local standard deviation of subregion, and using the Local standard deviation of the currently processed subregion of third as the currently processed subregion of third
Background fluctuations intensity, the threshold value as the judgement of fluorescent molecule subregion；And
Subregion judgement and extraction module (4), including the 4th subregion obtain circuit (401), input terminal and go background process
The output end of module (2) connects, for extracting the 4th currently processed subregion from the second image；Subregion decision circuitry
(402), first input end is connect with the output end that the 4th subregion obtains circuit (401), the second input terminal and background wave
Fatigue resistance obtains the output end connection of circuit (302), and the background fluctuations intensity of the currently processed subregion of third is worked as the 4th
The background fluctuations intensity of pre-treatment sub-district, according to the background fluctuations intensity and the 4th currently processed son of the 4th currently processed subregion
The signal strength in region determines that the 4th currently processed subregion whether there is fluorescent molecule, and exports subregion and extract control letter
Number；Alternative subregion obtains circuit (403), and input terminal connect with fluorogram read module (5) the third output end, is used for
Alternative subregion is extracted from fluorogram；Subregion extracts circuit (404), and input terminal and alternative subregion extract circuit
(403) output end connection, control terminal connect with subregion decision circuitry (402) output end, are extracted and controlled according to subregion
Signal determines whether alternative subregion is fluorescent molecule subregion.
2. data processing equipment as described in claim 1, which is characterized in that in data prediction circuit further include:
Multiplex electronics, input terminal are connect with prober interface circuit output end, and the first output end is with the FPGA's
Input terminal connection, second output terminal are used to for fluorogram being transmitted to second processor, and multiplex electronics are used to receive and will
Fluorogram copies as the output of two-way fluorogram.
3. data processing equipment as described in claim 1, which is characterized in that in data prediction circuit further include:
Multiplex electronics, input terminal are connect with prober interface circuit output end, and the first output end is with the FPGA's
Input terminal connection, second output terminal are used to fluorogram being transmitted to second processor, and third end to N-terminal is used to conduct
Expansion interface, multiplex electronics are for receiving and fluorogram being copied as the output of multichannel fluorogram, wherein N >=3.
4. data processing equipment as described in claim 1, which is characterized in that the background fluctuations intensity obtains circuit (302)
Include:
Pixel comparator (3021), input terminal are connect with the output end that the third subregion obtains circuit (301), are used for root
Screening pixel is obtained from the currently processed subregion of third according to the gray value of each pixel of the currently processed subregion of third；
Mean value adder (3022), input terminal are connect with the output end of the pixel comparator (3021), for being screened
The average value of pixel；
Subtracter (3023), first input end are connect with the output end of the pixel comparator (3021), the second input terminal
It is connect with the output end of mean value adder (3022), for obtaining the difference of each screening pixel and the average value for screening pixel；With
And
Local standard deviation adder (3024), input terminal are connect with the output end of subtracter (3023), are used for each screening picture
The difference of element and the average value of screening pixel is summed, and the Local standard deviation of the currently processed subregion of third is obtained.
5. data processing equipment as described in claim 1, which is characterized in that the subregion decision circuitry (402) includes:
First pixel comparator (4021), input terminal are connect with the output end that the 4th subregion obtains circuit (401), are used
In the center pixel gray value for judging the 4th currently processed subregion whether be the 4th currently processed each grey scale pixel value of subregion
Middle maximum value, and the first level value is exported according to judging result；
Second pixel comparator (4022), one input end obtain circuit (401) output end with the 4th subregion and connect,
Another input terminal obtains circuit (302) output end with the background fluctuations intensity and connect, for according to the 4th currently processed sub-district
The background fluctuations intensity of the currently processed subregion of center pixel sum of the grayscale values the 4th in domain exports second electrical level value；
Four neighborhood pixel addition devices (4023), input terminal obtain circuit (401) output end with the 4th subregion and connect, use
In by the middle imago of four neighborhood grey scale pixel values and the 4th currently processed subregion of the 4th currently processed subregion center pixel
Plain gray value carries out accumulation process and exports the first cumulative gray value；
Eight neighborhood pixel addition device (4025), input terminal obtain circuit (401) output end with the 4th subregion and connect, use
In by the middle imago of the eight neighborhood grey scale pixel value of the 4th currently processed subregion center pixel and the 4th currently processed subregion
Plain gray value carries out accumulation process and obtains the second cumulative gray value；
Four neighborhood pixel ratios are compared with device (4024), the output end company of one input end and the four neighborhoods pixel addition device (4023)
It connects, another input terminal obtains circuit (302) output end with the background fluctuations intensity and connect, for according to the first cumulative gray scale
Value and the background fluctuations intensity of the 4th currently processed subregion export third level value；
Eight neighborhood pixel comparator (4026), one input end are connect with eight neighborhood pixel addition device (4025) output end,
Its another input terminal obtains circuit (302) output end with the background fluctuations intensity and connect, for according to the second cumulative gray value
The 4th level value is exported with the background fluctuations intensity of the 4th currently processed subregion；And
Logical AND gate (4027), first input end are connect with the output end of the first pixel comparator (4021), and second
Input terminal is connect with the output end of the second pixel comparator (4022), third input terminal and the four neighborhoods pixel ratio compared with
The output end of device (4024) connects, and the 4th input terminal is connect with the output end of the eight neighborhood pixel comparator (4026), uses
Control signal is extracted in exporting subregion according to the first level value to the 4th level value.
6. a kind of data processing method based on any data processing equipment of claim 1 to 5, which is characterized in that packet
Include following steps:
(1) noise reduction sonication is carried out to fluorogram and exports the first image, and ambient noise is carried out to the first image and is handled, exported
Second image；
The currently processed subregion of third is extracted from fluorogram, and the currently processed subregion of third is carried out at Local standard deviation
Reason, obtain the currently processed subregion of third Local standard deviation, and using the Local standard deviation of the currently processed subregion of third as
The background fluctuations intensity of the currently processed subregion of third；
(2) the 4th currently processed subregion is extracted from the second image, by the background fluctuations intensity of the currently processed subregion of third
It is current according to the signal strength of the 4th currently processed subregion and the 4th as the background fluctuations intensity of the 4th currently processed sub-district
The background fluctuations intensity of processing subregion judge that the 4th currently processed subregion whether there is fluorescent molecule subregion, and according to sentencing
Disconnected result determine whether using in fluorogram with the 4th currently processed subregion in the second image the identical region in position as glimmering
Optical molecule subregion；The 4th currently processed subregion is updated, all fluorescent molecule subregions in fluorogram are extracted；
(3) fluorescent molecule subregion is subjected to localization process, obtains Super-resolution Reconstruction figure.
7. data processing method as claimed in claim 6, which is characterized in that include the following steps: in the step (2)
(21) the 4th currently processed subregion is extracted from the second image, if the ash of the center pixel of the 4th currently processed subregion
Angle value is the maximum value in the gray value of the 4th currently processed subregion all pixels,
And the 4th currently processed subregion center pixel gray value be greater than the 4th currently processed subregion background fluctuations it is strong
2 times of degree；
And the 4th currently processed subregion center pixel gray value and the 4th currently processed subregion center pixel four neighborhoods
The sum of gray value of pixel is greater than 9 times of the background fluctuations intensity of the 4th currently processed subregion；
And the 4th currently processed subregion center pixel gray value and the 4th currently processed subregion center pixel it is eight adjacent
The sum of gray value of domain pixel is greater than 11 times of the background fluctuations intensity of the 4th currently processed subregion；
Then using in fluorogram with the 4th currently processed subregion in the second image the identical region in position as fluorescent molecule
Extracted region, and enter step (22)；Otherwise the position in the second image is not extracted in fluorogram with the 4th currently processed subregion
Identical region is set, and enters step (22)
(22) judge whether all 4th currently processed subregions have all been extracted, if so, terminating；Otherwise, it enters step
(21)；
4th currently processed subregion is the subregion greater than 7 × 7 extracted from the second image.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710089310.9A CN106897969B (en) | 2017-02-20 | 2017-02-20 | A kind of data processing equipment and method for super-resolution positioning micro-imaging |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710089310.9A CN106897969B (en) | 2017-02-20 | 2017-02-20 | A kind of data processing equipment and method for super-resolution positioning micro-imaging |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN106897969A CN106897969A (en) | 2017-06-27 |
| CN106897969B true CN106897969B (en) | 2019-08-30 |
Family
ID=59185412
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710089310.9A Active CN106897969B (en) | 2017-02-20 | 2017-02-20 | A kind of data processing equipment and method for super-resolution positioning micro-imaging |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106897969B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108765283B (en) * | 2018-05-02 | 2020-11-24 | 华中科技大学 | Device and method for processing super-resolution positioning microscopic imaging mixed density data |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1942901A (en) * | 2005-02-23 | 2007-04-04 | 索尼计算机娱乐公司 | Image processing device and image processing method |
| CN102254331A (en) * | 2011-06-03 | 2011-11-23 | 华中科技大学 | High-throughput super-resolution imaging system and method based on monomolecular positioning |
| CN102739948A (en) * | 2012-07-16 | 2012-10-17 | 华中科技大学 | Data reduction based super-resolution located imaging system and method |
| EP2966492A1 (en) * | 2012-05-02 | 2016-01-13 | Centre National De La Recherche Scientifique | Method and apparatus for single-particle localization using wavelet analysis |
| CN106023121A (en) * | 2016-04-29 | 2016-10-12 | 中国科学院生物物理研究所 | BGA position back bore manufacture method |
-
2017
- 2017-02-20 CN CN201710089310.9A patent/CN106897969B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1942901A (en) * | 2005-02-23 | 2007-04-04 | 索尼计算机娱乐公司 | Image processing device and image processing method |
| CN102254331A (en) * | 2011-06-03 | 2011-11-23 | 华中科技大学 | High-throughput super-resolution imaging system and method based on monomolecular positioning |
| EP2966492A1 (en) * | 2012-05-02 | 2016-01-13 | Centre National De La Recherche Scientifique | Method and apparatus for single-particle localization using wavelet analysis |
| CN102739948A (en) * | 2012-07-16 | 2012-10-17 | 华中科技大学 | Data reduction based super-resolution located imaging system and method |
| CN106023121A (en) * | 2016-04-29 | 2016-10-12 | 中国科学院生物物理研究所 | BGA position back bore manufacture method |
Non-Patent Citations (1)
| Title |
|---|
| Large second-order optical nonlinearities of s-triazine derivatives: View from micro molecules to macro crystals;FANG Qi 等;《Science in China(Series B:Chemistry)》;20050610;第203-209页 |
Also Published As
| Publication number | Publication date |
|---|---|
| CN106897969A (en) | 2017-06-27 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| Oh et al. | Crowd counting with decomposed uncertainty | |
| CN107133943B (en) | A kind of visible detection method of stockbridge damper defects detection | |
| CN108875821A (en) | The training method and device of disaggregated model, mobile terminal, readable storage medium storing program for executing | |
| CN108777815A (en) | Method for processing video frequency and device, electronic equipment, computer readable storage medium | |
| CN108460362A (en) | A kind of system and method for detection human body | |
| CN102693528B (en) | Noise suppressed in low light images | |
| CN109029381A (en) | A kind of detection method of tunnel slot, system and terminal device | |
| CN108921830A (en) | A kind of demographic method based on image retrieval | |
| CN115497005A (en) | YOLOV4 remote sensing target detection method integrating feature transfer and attention mechanism | |
| CN116071243B (en) | Infrared image super-resolution reconstruction method based on edge enhancement | |
| CN110633698A (en) | Infrared picture identification method, equipment and medium based on loop generation countermeasure network | |
| Zhao et al. | ADRN: Attention-based deep residual network for hyperspectral image denoising | |
| Song et al. | MSFYOLO: Feature fusion-based detection for small objects | |
| CN111654694B (en) | Quality evaluation method and device of image processing algorithm and electronic equipment | |
| CN109688382A (en) | A kind of underwater picture processing system of underwater robot | |
| CN111401215A (en) | Method and system for detecting multi-class targets | |
| CN115170475A (en) | Non-woven fabric defect detection method based on deep learning method | |
| CN106897969B (en) | A kind of data processing equipment and method for super-resolution positioning micro-imaging | |
| CN109167998A (en) | Detect method and device, the electronic equipment, storage medium of camera status | |
| CN115661459A (en) | 2D mean teacher model using difference information | |
| Wu et al. | Improved YOLOX foreign object detection algorithm for transmission lines | |
| CN111104976B (en) | Blue algae coverage calculating method based on time sequence images | |
| CN111767826A (en) | Timing fixed-point scene abnormity detection method | |
| Yeswanth et al. | Sovereign critique network (SCN) based super-resolution for chest X-rays images | |
| CN106954029A (en) | A kind of panoramic video joining method and system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |