WO2017028341A1 - Method for generating single-cell three-dimensional image based on optical flow analysis - Google Patents

Method for generating single-cell three-dimensional image based on optical flow analysis Download PDF

Info

Publication number
WO2017028341A1
WO2017028341A1 PCT/CN2015/088945 CN2015088945W WO2017028341A1 WO 2017028341 A1 WO2017028341 A1 WO 2017028341A1 CN 2015088945 W CN2015088945 W CN 2015088945W WO 2017028341 A1 WO2017028341 A1 WO 2017028341A1
Authority
WO
WIPO (PCT)
Prior art keywords
cell
ito glass
dimensional image
optical flow
flow analysis
Prior art date
Application number
PCT/CN2015/088945
Other languages
French (fr)
Chinese (zh)
Inventor
李志�
张光烈
李文荣
Original Assignee
深圳大学
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 深圳大学 filed Critical 深圳大学
Publication of WO2017028341A1 publication Critical patent/WO2017028341A1/en

Links

Images

Classifications

    • CCHEMISTRY; METALLURGY
    • C12BIOCHEMISTRY; BEER; SPIRITS; WINE; VINEGAR; MICROBIOLOGY; ENZYMOLOGY; MUTATION OR GENETIC ENGINEERING
    • C12QMEASURING OR TESTING PROCESSES INVOLVING ENZYMES, NUCLEIC ACIDS OR MICROORGANISMS; COMPOSITIONS OR TEST PAPERS THEREFOR; PROCESSES OF PREPARING SUCH COMPOSITIONS; CONDITION-RESPONSIVE CONTROL IN MICROBIOLOGICAL OR ENZYMOLOGICAL PROCESSES
    • C12Q1/00Measuring or testing processes involving enzymes, nucleic acids or microorganisms; Compositions therefor; Processes of preparing such compositions
    • C12Q1/02Measuring or testing processes involving enzymes, nucleic acids or microorganisms; Compositions therefor; Processes of preparing such compositions involving viable microorganisms
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01NINVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N27/00Investigating or analysing materials by the use of electric, electrochemical, or magnetic means
    • G01N27/26Investigating or analysing materials by the use of electric, electrochemical, or magnetic means by investigating electrochemical variables; by using electrolysis or electrophoresis
    • G01N27/416Systems
    • G01N27/447Systems using electrophoresis
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T17/00Three dimensional [3D] modelling, e.g. data description of 3D objects

Definitions

  • the invention relates to the field of cell imaging, and in particular to a single cell three-dimensional image generation method based on optical flow analysis.
  • 3D imaging of living cells presents a more detailed and more accurate spatial view of the cells and their components.
  • Technological advances have made 3D imaging an important tool for many applications, such as cell biology, developmental biology, neuroscience, and cancer research.
  • Current technology is more accurate than ever, providing data in real time with virtually no cell preparation.
  • the prior art single-cell three-dimensional methods mainly include the following:
  • Laser scanning confocal microscope The laser beam is used to form a point light source through the illumination pinhole to scan every point in the intracellular focal plane.
  • the illuminated spot on the cell is imaged at the probe pinhole, and the photomultiplier is detected after the pinhole is detected.
  • a tube (PMT) or a cold-coupled device (cCCD) is received point by point or line by line, rapidly forming a fluorescent image on the computer monitor screen.
  • the illumination pinhole and the detection pinhole are conjugate with respect to the focal plane of the objective lens, and the point on the focal plane is simultaneously focused on the illumination pinhole and the emission pinhole, and the point outside the focal plane is not imaged at the probe pinhole, thus obtained
  • a confocal image is the optical cross section of a cell.
  • Laser scanning confocal microscopy can form a three-dimensional structure image of cells by real-time scanning imaging of different layers of the same cell.
  • white light diffraction tomography imaging technology This technology can image transparent samples such as living cells and unlabeled cells, based on traditional microscopes and white light, providing high-resolution 3D rendered images in the natural state of the cells.
  • the objective lens scans the entire axial focal plane of the cell, produces a stack of phase-resolved images, and then reconstructs the three-dimensional structure of the object by the sparse deconvolution algorithm. A lateral resolution of 350 nm and an axial resolution of 900 nm can be obtained.
  • Lattice light microscope has two orthogonal lenses; one lens focuses the light to produce a very thin pen-like light source that illuminates a biological sample with fluorescent molecules to produce fluorescence; Fluorescence is collected using wide field imaging, and surface scanning is used to quickly acquire 3D high definition biological images.
  • the spatial light modulator is used to simultaneously form more than 100 pen-shaped beams to increase the scanning speed and reduce the damage to biological samples; and to control the distance and shape of each beam.
  • the first method requires special equipment, which is too costly; and it produces phototoxic effects: under laser irradiation, many fluorescent dye molecules produce cytotoxins such as singlet oxygen or free radicals, limiting the scanning time and excitation light intensity. Maintaining the activity of the sample; photobleaching of the marking dye: in order to obtain a sufficient signal-to-noise ratio, the intensity of the laser must be increased; and high-intensity lasers can quickly fade the dye during continuous scanning.
  • the second method is not applicable to non-translucent samples.
  • the requirements for samples are relatively high; special equipment is required, the cost is too high; and the imaging flexibility is low.
  • an object of the present invention is to provide a single-cell three-dimensional image generation method based on optical flow analysis, which aims to solve the problem of high cost, phototoxicity, harsh conditions, etc. of the existing three-dimensional image generation method of cells. problem.
  • a single-cell three-dimensional image generation method based on optical flow analysis comprising the steps of:
  • a photo-induced dielectrophoresis chip is prepared.
  • the photo-induced dielectrophoresis chip has a three-layer structure: a three-layer structure: the lower layer is ITO glass coated with a hydrogenated amorphous silicon coating, and the upper layer is ITO glass without coating.
  • a microfluidic channel is encapsulated between the upper and lower layers of ITO glass for injecting a solution for the desired operation;
  • A2 depositing a hydrogenated amorphous silicon coating on the ITO glass substrate
  • a conductive adhesive is applied to the area of the ITO glass substrate that is not covered with the hydrogenated amorphous silicon coating.
  • F DEP is the average dielectrophoretic force acting on the cell
  • R is the radius of the cell
  • ⁇ m is the dielectric constant of the solution in which the cell is located
  • E rms is the root mean square value of the applied AC signal
  • f CM is Clausius-Mossotti Factor, the real part of the factor Re[f CM ] is taken when calculating the average dielectrophoretic force.
  • ⁇ p * and ⁇ m * are the complex dielectric constants of the cells and solutions, respectively.
  • the single-cell three-dimensional image generating method based on optical flow analysis, wherein the complex permittivity can be expressed as:
  • is the dielectric constant of the solution
  • is the conductivity
  • is the applied AC signal Frequency of.
  • E is the electric field strength
  • is the viscosity of the solution
  • IM[f CM ] is the imaginary part of the Clausius-Mossotti factor
  • K is the coefficient
  • the single-cell three-dimensional image generating method based on optical flow analysis wherein the pre-processing comprises: Gaussian filtering processing, brightness adjustment, and template matching.
  • the single-cell three-dimensional image generating method based on the optical flow analysis wherein in the step D, the maximum likelihood estimation of the model parameters is performed using a machine learning algorithm, and the parameter values minimized by the following formula are:
  • R i m i +T i is a three-dimensional rotational motion model of a point m from i to i+1 on the cell, ie mi+1 , mapping It is to project the three-dimensional information of the cell at time i to a certain frame I i of the cell rotation image.
  • the method of the present invention has the following advantages: 1) a feedback control function of a light-inducing dielectrophoresis steerable platform realized by a microscopic vision algorithm; 2) a three-dimensional motion of a cell using a motion detection method based on an optical flow field Tracking to complete parameter estimation of the cell dynamics model; 3) obtaining cell two-dimensional by controlling the rotation of individual cells Image sequence, using the maximum likelihood estimation method to realize three-dimensional image generation technology of cells based on two-dimensional image sequences of controllable single cells.
  • the method of the invention has simple equipment, low cost, no phototoxic effect, low requirements on samples, and improved operability.
  • FIG. 1 is a flow chart of a preferred embodiment of a single cell three-dimensional image generation method based on optical flow analysis according to the present invention.
  • FIG. 2 is a schematic view showing the structure of a light-induced dielectrophoresis platform in the present invention.
  • the present invention provides a single-cell three-dimensional image generation method based on optical flow analysis.
  • the present invention will be further described in detail below in order to clarify and clarify the objects, technical solutions and effects of the present invention. It is understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.
  • FIG. 1 is a flowchart of a preferred embodiment of a single-cell three-dimensional image generation method based on optical flow analysis according to the present invention. As shown in the figure, the method includes the following steps:
  • a light-induced dielectrophoresis chip (ODEP chip), wherein the light-induced dielectrophoresis chip has a three-layer structure: the lower layer is ITO glass coated with a hydrogenated amorphous silicon coating, and the upper layer is uncoated (ie, does not contain hydrogenation) ITO glass coated with amorphous silicon, encapsulating a microfluidic channel between the upper and lower ITO glass for injecting the solution required for operation;
  • S400 Preprocessing the acquired image, then performing feature extraction and speed calculation, and finally reconstructing the 3D cell image.
  • the step of fabricating the light-induced dielectrophoresis chip specifically includes:
  • a layer of hydrogenated amorphous silicon was deposited on the surface of the ITO glass substrate to a thickness of 1 micron.
  • the stencil is to make a cover according to the specified pattern, the cover is placed on the surface of the photoresist, and the cover is irradiated with ultraviolet rays, and the uncovered photoresist is dissolved under the action of ultraviolet rays, and finally the photoresist having the same shape as the cover is obtained.
  • Floor is to make a cover according to the specified pattern, the cover is placed on the surface of the photoresist, and the cover is irradiated with ultraviolet rays, and the uncovered photoresist is dissolved under the action of ultraviolet rays, and finally the photoresist having the same shape as the cover is obtained.
  • a microfluidic channel (100 micron high) is packaged between the upper and lower ITO glass, specifically a microfluidic channel is encapsulated by PDMS or double-sided tape.
  • a light-induced dielectrophoresis platform is first constructed.
  • the platform also requires an optical microscope 10, an optical projector (high resolution), a programmable signal generation circuit, and a host system.
  • the host system includes: an image acquisition module, a microscopic vision algorithm processing module, a biochip drive controller, a virtual electrode generation module, and a display output module.
  • the image acquisition module is configured to collect an image of the optical microscope 20, and is processed by a microscopic vision algorithm processing module and displayed by a display output module, wherein the microscopic vision algorithm processing module further drives the biochip driver controller and
  • the virtual electrode generation module signals to control the operation of both.
  • the biochip drive controller is coupled to the programmable signal generation circuit to vary the signal frequency and magnitude.
  • the programmable signal generating circuit connects the ODEP chip 20 through electrodes.
  • the optical projector is disposed below the ODEP chip 20 for illuminating the incident light.
  • the virtual electrode generating module is coupled to the optical projector.
  • optical microscope parameters are as follows:
  • Electric focus can move up and down (upper 13mm / 2mm);
  • Concentrator waterproof, working distance: 7.2mm;
  • Objective lens 20x, highly achromatic lens, nanocrystalline coating
  • Fluorescence filter set FITC/GFP.
  • the biochip driver controller can send a signal to the programmable signal generation circuit, and then the programmable signal generation circuit inputs the variable frequency AC signal to the electrodes of the upper and lower layers of the ITO glass, and the optical projector utilizes the incident.
  • the programmable signal generation circuit inputs the variable frequency AC signal to the electrodes of the upper and lower layers of the ITO glass, and the optical projector utilizes the incident.
  • step S300 by changing the frequency and size of the alternating current signal, the direction and size of the dielectrophoretic force received by the cell are changed to control the direction of cell movement, and the image of the cell (2D cell image) is acquired to realize high-speed manipulation. Micro-nano entities.
  • step S400 the acquired image is pre-processed, then feature extraction and velocity calculation are performed, and finally the 3D cell image is reconstructed.
  • F DEP is the average dielectrophoretic force acting on the cell
  • R is the radius of the cell
  • ⁇ m is the dielectric constant of the solution in which the cell is located
  • E rms is the root mean square value of the applied electric field (AC signal)
  • f CM is Clausius-Mossotti factor
  • Re[f CM ] is taken when calculating the average dielectrophoretic force, which is defined as follows:
  • Equation 2 ⁇ p * and ⁇ m * are the complex permittivity of the cell and the solution, respectively, and the complex permittivity (including ⁇ p * and ⁇ m *) in Equation 2 can be expressed as:
  • is the dielectric constant of the solution
  • is the conductivity
  • is the frequency of the applied electric field (alternating current signal).
  • f CM is a frequency dependent variable factor. Considering the alternating electric field with different frequencies, when the dielectrophoretic force and the electric field intensity change direction are the same, it is called positive dielectrophoresis; when the dielectrophoretic force and the electric field intensity change direction are opposite, it is called negative dielectrophoresis. Therefore, by changing the frequency of the applied electric field, the direction of the dielectrophoretic force to which the cells are subjected can be changed to achieve the purpose of controlling the direction of cell movement.
  • E is the electric field strength
  • is the viscosity of the solution
  • IM[f CM ] is the imaginary part of the Clausius-Mossotti factor
  • K is the coefficient.
  • the strength and direction of the dielectrophoretic force that a cell receives depends primarily on the dielectric properties of the medium and the cell, such as shape, size, and electric field frequency.
  • the present invention utilizes light-induced dielectrophoretic force (ODEP) (when a certain frequency band is applied, a dominant force in electro-hydraulics) to identify and manipulate organisms cell.
  • ODEP light-induced dielectrophoretic force
  • the ODEP chip is driven by a variable frequency AC signal, and the AC signal is input through the conductive contacts of the upper and lower layers of ITO glass. At this time, only a small portion of the solution layer is divided and a uniform electric field is generated in the solution layer.
  • a-Si:H When incident light illuminates the ODEP chip, the optical conductivity of a-Si:H increases by several orders of magnitude due to the increase in the number of electron-hole pairs. Since the resistance of the incident light region is reduced, the partial pressure in the solution layer is greatly increased, so that a:Si:H in the incident light region will become an effective virtual electrode to generate a non-uniform electric field.
  • This light-induced, non-uniform electric field produces a dielectrophoretic force, ie, light-induced dielectrophoretic force (ODEP), of the particles in the polarized region.
  • Programmatic dynamic motion is achieved through optical microscopy and host systems, and automated capture, manipulation, separation and assembly of micro-nano entities are achieved without any manual interface.
  • the principle of generating a three-dimensional image of a cell is as follows: when a polarized object is placed in a non-uniform electric field, the object moves toward the strongest or weakest part of the electric field under the action of the dipole moment, and the direction depends on the relative of the object.
  • the polarity of the medium According to the kinetic model of the cell under the dielectrophoretic force field, the cell is controlled by light-induced dielectric by changing the size and frequency of the AC signal that drives the light-induced dielectrophoresis biochip and matching the incident light projected onto the ODEP chip. Rotational motion under the influence of swimming force.
  • the refactoring process includes:
  • is the width parameter of the function, which controls the radial extent of the function.
  • g(x,y) c+k(f(x,y)-a) (6)
  • f(x,y) and g(x,y) are respectively a point (x,y) in the image Original brightness and transformed brightness
  • a is the background brightness
  • k is the transform coefficient
  • c is the brightness compensation.
  • Cov(X, Y) is the covariance of X and Y
  • D(X) and D(Y) are the variances of X and Y, respectively.
  • the optical flow method analyzes the motion vector of the pixel.
  • the luminance value at time t is I(x, y, t)
  • u(x, y) and v(x, y) represent light at (x, y)
  • V (A T W 2 A) -1 A T W 2 b (9)
  • the correction coefficient is calculated.
  • a and b are the x-axis and y-axis correction coefficients, respectively.
  • the resulting three-dimensional motion velocity V Kv 3D .
  • the rotation matrix and the translation vector be R k and T k , respectively, then the three-dimensional rotational motion model of the cell is:
  • M represents a collection of all points on the cell, projecting the three-dimensional information of the cell at time i to a certain frame I i of the rotated image of the cell. Therefore, the three-dimensional image generation of the cells is reduced to the maximum likelihood estimation of the model parameters, and the maximum likelihood estimation of the model generation is performed using a machine learning algorithm, and the parameter values minimized by the following formula are taken.
  • R i m i +T i is a three-dimensional rotational motion model of a point m on the cell from i to i+1, ie, mi+1 . Mapping It is to project the three-dimensional information of the cell at time i to a certain frame I i of the cell rotation image.
  • the 3D cell model mapped to the current frame can be reconstructed from the two-dimensional image of the cell rotation.
  • the cell rotational motion information obtained by the optical flow method of the present invention will more accurately estimate the rotation matrix Rk, thereby optimizing the three-dimensional model of cell rotation.
  • the method of the invention has the following advantages: 1) the feedback control function of the enhanced light-induced dielectrophoresis controllable platform realized by the microscopic vision algorithm; 2) the motion detection method based on the optical flow field is used to track the three-dimensional motion of the cell, thereby Complete the parameter estimation of the cell dynamics model; 3) Obtain the two-dimensional image sequence of the cell by controlling the rotation of the single cell, and realize the three-dimensional image generation technology of the cell based on the controllable single cell two-dimensional image sequence by the maximum likelihood estimation method.
  • the method of the invention has simple equipment, low cost, no phototoxic effect, low requirements on samples, and improved operability.

Abstract

A method for generating a single-cell three-dimensional image based on an optical flow analysis, comprising the steps: A. fabricating a light-induced dielectrophoresis chip (20), wherein the light-induced dielectrophoresis chip (20) is composed of a three-layer structure: the lower layer being ITO glass coated with a hydrogenated amorphous silicon coating layer, the upper layer being ITO glass without a coating layer, and a micro-fluidic channel being encapsulated between the upper and lower ITO glass layers for injecting a solution required for operations; B. injecting a cell and the solution into the micro-fluidic channel, and inputting a variable frequency alternating current signal to electrodes of the upper and lower ITO glass layers, and at the same time using incident light to irradiate the light-induced dielectrophoresis chip, so as to generate a non-uniform electric field in an irradiated area; C. changing the frequency and magnitude of the alternating current signal so as to control a cell motion direction, and at the same time collecting an image of the cell; and D. pre-processing the collected image, then performing feature extraction and velocity calculation, and finally reconstructing a 3D cell image. In the method, a cell two-dimensional image sequence is acquired by controlling the rotation of a single cell, and a maximum likelihood estimation method is used to realize a cell three-dimensional image generation technique based on a two-dimensional image sequence of a controllable single cell. The device used in the method is simple and low in cost, does not bring about a phototoxic function and has a relatively low requirement for a sample, thereby improving the operability.

Description

一种基于光流分析的单细胞三维图像生成方法Single cell three-dimensional image generation method based on optical flow analysis 技术领域Technical field
本发明涉及细胞成像领域,尤其涉及一种基于光流分析的单细胞三维图像生成方法。The invention relates to the field of cell imaging, and in particular to a single cell three-dimensional image generation method based on optical flow analysis.
背景技术Background technique
与早期的成像系统相比,活细胞的3D成像呈现了细胞及其组分的更详细、也更准确的空间视图。技术进步让3D成像成为许多应用的重要工具,如细胞生物学、发育生物学、神经科学以及癌症研究。当前的技术比以往更加准确,能实时给出数据,几乎不需要细胞制备。现有技术的单细胞三维方法主要有以下几种:Compared to earlier imaging systems, 3D imaging of living cells presents a more detailed and more accurate spatial view of the cells and their components. Technological advances have made 3D imaging an important tool for many applications, such as cell biology, developmental biology, neuroscience, and cancer research. Current technology is more accurate than ever, providing data in real time with virtually no cell preparation. The prior art single-cell three-dimensional methods mainly include the following:
1、激光扫描共聚焦显微镜:利用激光束经照明针孔形成点光源对细胞内焦平面的每一点扫描,细胞上的被照射点,在探测针孔处成像,由探测针孔后的光电倍增管(PMT)或冷电耦器件(cCCD)逐点或逐线接收,迅速在计算机监视器屏幕上形成荧光图像。照明针孔与探测针孔相对于物镜焦平面是共轭的,焦平面上的点同时聚焦于照明针孔和发射针孔,焦平面以外的点不会在探测针孔处成像,这样得到的共聚焦图像是细胞的光学横断面。激光扫描共聚焦显微镜通过对同一细胞不同层面的实时扫描成像,进行图像叠加可构成细胞的三维结构图像。 1. Laser scanning confocal microscope: The laser beam is used to form a point light source through the illumination pinhole to scan every point in the intracellular focal plane. The illuminated spot on the cell is imaged at the probe pinhole, and the photomultiplier is detected after the pinhole is detected. A tube (PMT) or a cold-coupled device (cCCD) is received point by point or line by line, rapidly forming a fluorescent image on the computer monitor screen. The illumination pinhole and the detection pinhole are conjugate with respect to the focal plane of the objective lens, and the point on the focal plane is simultaneously focused on the illumination pinhole and the emission pinhole, and the point outside the focal plane is not imaged at the probe pinhole, thus obtained A confocal image is the optical cross section of a cell. Laser scanning confocal microscopy can form a three-dimensional structure image of cells by real-time scanning imaging of different layers of the same cell.
2、白色光衍射断层扫描成像技术:该技术能够为透明样本如活细胞和未标记的细胞成像,基于传统显微镜和白光,在细胞的自然状态下提供高分辨率的3D渲染图像。物镜镜头扫描细胞的整个轴向焦面,产生一叠相位分辨图像,然后通过sparse反卷积算法重建物体的三维结构。能得到350nm的侧向分辨率以及900nm的轴向分辨率。2, white light diffraction tomography imaging technology: This technology can image transparent samples such as living cells and unlabeled cells, based on traditional microscopes and white light, providing high-resolution 3D rendered images in the natural state of the cells. The objective lens scans the entire axial focal plane of the cell, produces a stack of phase-resolved images, and then reconstructs the three-dimensional structure of the object by the sparse deconvolution algorithm. A lateral resolution of 350 nm and an axial resolution of 900 nm can be obtained.
3、晶格光片显微镜:晶格光片显微镜有两个正交的镜头;一个镜头将光聚焦产生一条非常细的笔状光源,照射在有萤光分子的生物样品,产生荧光;另一个采用宽场成像收集荧光,由面扫描以快速取得3D高清晰度生物影像。依靠空间光调制器同时形成100多条笔状的光束,来增加扫描速度,降低对生物样品的伤害;而且能控制每条光束的距离及形状。3. Lattice light microscope: The lattice light microscope has two orthogonal lenses; one lens focuses the light to produce a very thin pen-like light source that illuminates a biological sample with fluorescent molecules to produce fluorescence; Fluorescence is collected using wide field imaging, and surface scanning is used to quickly acquire 3D high definition biological images. The spatial light modulator is used to simultaneously form more than 100 pen-shaped beams to increase the scanning speed and reduce the damage to biological samples; and to control the distance and shape of each beam.
但上述方法均存在不足:However, the above methods are insufficient:
第一种方式需要专用的设备,成本太高;且会产生光毒作用:在激光照射下,许多荧光染料分子会产生单态氧或自由基等细胞毒素,限制扫描时间、激发光强度,以保持样品的活性;标记染料的光漂白:为了获得足够的信噪比必须提高激光的强度;而高强度的激光会使染料在连续扫描过程中迅速褪色。The first method requires special equipment, which is too costly; and it produces phototoxic effects: under laser irradiation, many fluorescent dye molecules produce cytotoxins such as singlet oxygen or free radicals, limiting the scanning time and excitation light intensity. Maintaining the activity of the sample; photobleaching of the marking dye: in order to obtain a sufficient signal-to-noise ratio, the intensity of the laser must be increased; and high-intensity lasers can quickly fade the dye during continuous scanning.
第二种方式不适用于非半透明样本,对于样本的要求比较高;需要专用设备,成本过高;成像灵活度低。The second method is not applicable to non-translucent samples. The requirements for samples are relatively high; special equipment is required, the cost is too high; and the imaging flexibility is low.
第三种方式设备成本过高;需要对样本进行荧光处理,降低了可操作性;光毒作用依然存在。In the third way, the equipment cost is too high; the sample needs to be fluorescently treated to reduce the operability; the phototoxic effect still exists.
因此,现有技术还有待于改进和发展。 Therefore, the prior art has yet to be improved and developed.
发明内容Summary of the invention
鉴于上述现有技术的不足,本发明的目的在于提供一种基于光流分析的单细胞三维图像生成方法,旨在解决现有的细胞三维图像生成方法成本高、有光毒作用、条件苛刻等问题。In view of the above deficiencies of the prior art, an object of the present invention is to provide a single-cell three-dimensional image generation method based on optical flow analysis, which aims to solve the problem of high cost, phototoxicity, harsh conditions, etc. of the existing three-dimensional image generation method of cells. problem.
本发明的技术方案如下:The technical solution of the present invention is as follows:
一种基于光流分析的单细胞三维图像生成方法,其中,包括步骤:A single-cell three-dimensional image generation method based on optical flow analysis, comprising the steps of:
A、制作光诱导介电泳芯片,所述光诱导介电泳芯片有三层结构组成:有三层结构组成:下层为涂有氢化非晶硅涂层的ITO玻璃,上层是不含涂层的ITO玻璃,在上下两层ITO玻璃之间封装有一个微流体通道,用于注射所需操作的溶液;A. A photo-induced dielectrophoresis chip is prepared. The photo-induced dielectrophoresis chip has a three-layer structure: a three-layer structure: the lower layer is ITO glass coated with a hydrogenated amorphous silicon coating, and the upper layer is ITO glass without coating. A microfluidic channel is encapsulated between the upper and lower layers of ITO glass for injecting a solution for the desired operation;
B、将细胞和溶液注射到微流体通道,并向上下两层ITO玻璃的电极输入可变频率的交流信号,同时利用入射光照射所述光诱导介电泳芯片,从而在被照射的区域产生非均匀电场;B. Injecting the cells and the solution into the microfluidic channel, and inputting a variable frequency alternating current signal to the electrodes of the upper and lower ITO glass, and irradiating the photoinduced dielectrophoresis chip with the incident light, thereby generating a non-irradiated region in the irradiated region. Uniform electric field;
C、改变交流信号的频率及大小,以控制细胞运动方向,同时采集细胞的图像;C. Change the frequency and size of the AC signal to control the direction of cell movement while collecting images of the cells;
D、对采集的图像进行预处理,然后进行特征提取以及速度计算,最后重构3D细胞图像。D. Pre-process the acquired image, then perform feature extraction and velocity calculation, and finally reconstruct the 3D cell image.
所述的基于光流分析的单细胞三维图像生成方法,其中,所述步骤A中,制作光诱导介电泳芯片的步骤具体包括:The single-cell three-dimensional image generation method based on the optical flow analysis, wherein the step of fabricating the light-induced dielectrophoresis chip in the step A specifically includes:
A1、清理ITO玻璃基质;A1, cleaning the ITO glass substrate;
A2、在ITO玻璃基质上沉积氢化非晶硅涂层; A2 depositing a hydrogenated amorphous silicon coating on the ITO glass substrate;
A3、在氢化非晶硅涂层上涂光刻胶;A3, coating a photoresist on the hydrogenated amorphous silicon coating;
A4、在光刻胶上进行板印;A4, performing plate printing on the photoresist;
A5、接触腐蚀至ITO玻璃基质;A5, contact corrosion to the ITO glass substrate;
A6、去除光刻胶;A6, removing the photoresist;
A7、在ITO玻璃基质上未覆盖氢化非晶硅涂层的区域涂导电粘合剂。A7. A conductive adhesive is applied to the area of the ITO glass substrate that is not covered with the hydrogenated amorphous silicon coating.
所述的基于光流分析的单细胞三维图像生成方法,其中,所述细胞在非均匀电场中的所受到的平均介电泳力用如下公式描述:The single-cell three-dimensional image generation method based on optical flow analysis, wherein the average dielectrophoretic force of the cells in a non-uniform electric field is described by the following formula:
Figure PCTCN2015088945-appb-000001
Figure PCTCN2015088945-appb-000001
其中FDEP是作用到细胞上的平均介电泳力,R是细胞的半径,εm是细胞所在溶液的介电常数,Erms为所施加交流信号的均方根值,fCM为Clausius-Mossotti因子,在计算平均介电泳力时取该因子的实部Re[fCM]。Where F DEP is the average dielectrophoretic force acting on the cell, R is the radius of the cell, ε m is the dielectric constant of the solution in which the cell is located, E rms is the root mean square value of the applied AC signal, and f CM is Clausius-Mossotti Factor, the real part of the factor Re[f CM ] is taken when calculating the average dielectrophoretic force.
所述的基于光流分析的单细胞三维图像生成方法,其中,fCM因子定义如下:The single-cell three-dimensional image generation method based on optical flow analysis, wherein the f CM factor is defined as follows:
Figure PCTCN2015088945-appb-000002
Figure PCTCN2015088945-appb-000002
εp*和εm*分别是细胞和溶液的复介电常数。ε p * and ε m * are the complex dielectric constants of the cells and solutions, respectively.
所述的基于光流分析的单细胞三维图像生成方法,其中,所述复介电常数可表示为:The single-cell three-dimensional image generating method based on optical flow analysis, wherein the complex permittivity can be expressed as:
Figure PCTCN2015088945-appb-000003
Figure PCTCN2015088945-appb-000003
其中,ε是溶液的介电常数,σ是导电率,ω是所施加交流信号 的频率。Where ε is the dielectric constant of the solution, σ is the conductivity, and ω is the applied AC signal Frequency of.
所述的基于光流分析的单细胞三维图像生成方法,其中,细胞旋转速度为:The single-cell three-dimensional image generating method based on optical flow analysis, wherein the cell rotation speed is:
Figure PCTCN2015088945-appb-000004
Figure PCTCN2015088945-appb-000004
其中E是电场强度,η是溶液的黏稠度,IM[fCM]是Clausius-Mossotti因子的虚部,K为系数。Where E is the electric field strength, η is the viscosity of the solution, IM[f CM ] is the imaginary part of the Clausius-Mossotti factor, and K is the coefficient.
所述的基于光流分析的单细胞三维图像生成方法,其中,所述预处理包括:高斯滤波处理、亮度调整及模板匹配。The single-cell three-dimensional image generating method based on optical flow analysis, wherein the pre-processing comprises: Gaussian filtering processing, brightness adjustment, and template matching.
所述的基于光流分析的单细胞三维图像生成方法,其中,所述步骤D中,使用机器学习算法对模型参数进行最大似然估计,按下式最小化的参数取值:The single-cell three-dimensional image generating method based on the optical flow analysis, wherein in the step D, the maximum likelihood estimation of the model parameters is performed using a machine learning algorithm, and the parameter values minimized by the following formula are:
Figure PCTCN2015088945-appb-000005
Figure PCTCN2015088945-appb-000005
其中Ii+1是细胞旋转图像序列I={Ii,i=1,…,n}中的一帧,M代表细胞上所有点的集合,Ri和Ti分别是旋转矩阵和平移向量,Rimi+Ti是细胞上一点m从i时刻到i+1时刻的三维旋转运动模型,即mi+1,映射
Figure PCTCN2015088945-appb-000006
是将细胞在i时刻的三维信息投影到细胞旋转图像的某一帧Ii
Where I i+1 is a frame in the cell rotation image sequence I={I i , i=1, . . . , n}, where M represents a set of all points on the cell, and R i and T i are a rotation matrix and a translation vector, respectively. , R i m i +T i is a three-dimensional rotational motion model of a point m from i to i+1 on the cell, ie mi+1 , mapping
Figure PCTCN2015088945-appb-000006
It is to project the three-dimensional information of the cell at time i to a certain frame I i of the cell rotation image.
有益效果:本发明的方法具有如下优点:1)通过显微视觉算法实现的增强光诱导介电泳可操控平台的反馈控制功能;2)采用基于光流场的运动检测方法实现对细胞三维运动的跟踪,从而完成细胞动力学模型的参数估计;3)通过控制单个细胞的旋转,获取细胞二维 图像序列,利用最大似然估计方法实现基于可控单细胞的二维图像序列的细胞的三维图像生成技术。本发明的方法,其所用设备简单,成本低,不会产生光毒作用,对样本的要求也较低,提高了可操作性。Advantageous Effects: The method of the present invention has the following advantages: 1) a feedback control function of a light-inducing dielectrophoresis steerable platform realized by a microscopic vision algorithm; 2) a three-dimensional motion of a cell using a motion detection method based on an optical flow field Tracking to complete parameter estimation of the cell dynamics model; 3) obtaining cell two-dimensional by controlling the rotation of individual cells Image sequence, using the maximum likelihood estimation method to realize three-dimensional image generation technology of cells based on two-dimensional image sequences of controllable single cells. The method of the invention has simple equipment, low cost, no phototoxic effect, low requirements on samples, and improved operability.
附图说明DRAWINGS
图1为本发明一种基于光流分析的单细胞三维图像生成方法较佳实施例的流程图。1 is a flow chart of a preferred embodiment of a single cell three-dimensional image generation method based on optical flow analysis according to the present invention.
图2为本发明中光诱导介电泳平台的结构示意图。2 is a schematic view showing the structure of a light-induced dielectrophoresis platform in the present invention.
具体实施方式detailed description
本发明提供一种基于光流分析的单细胞三维图像生成方法,为使本发明的目的、技术方案及效果更加清楚、明确,以下对本发明进一步详细说明。应当理解,此处所描述的具体实施例仅仅用以解释本发明,并不用于限定本发明。The present invention provides a single-cell three-dimensional image generation method based on optical flow analysis. The present invention will be further described in detail below in order to clarify and clarify the objects, technical solutions and effects of the present invention. It is understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.
请参阅图1,图1为本发明一种基于光流分析的单细胞三维图像生成方法较佳实施例的流程图,如图所示,其包括步骤:Please refer to FIG. 1. FIG. 1 is a flowchart of a preferred embodiment of a single-cell three-dimensional image generation method based on optical flow analysis according to the present invention. As shown in the figure, the method includes the following steps:
S100、制作光诱导介电泳芯片(ODEP芯片),所述光诱导介电泳芯片有三层结构组成:下层为涂有氢化非晶硅涂层的ITO玻璃,上层是不含涂层(即不含氢化非晶硅涂层)的ITO玻璃,在上下两层ITO玻璃之间封装有一个微流体通道,用于注射所需操作的溶液;S100, preparing a light-induced dielectrophoresis chip (ODEP chip), wherein the light-induced dielectrophoresis chip has a three-layer structure: the lower layer is ITO glass coated with a hydrogenated amorphous silicon coating, and the upper layer is uncoated (ie, does not contain hydrogenation) ITO glass coated with amorphous silicon, encapsulating a microfluidic channel between the upper and lower ITO glass for injecting the solution required for operation;
S200、向上下两层ITO玻璃的电极输入可变频率的交流信号,同时利用入射光照射所述光诱导介电泳芯片,从而在被照射的区域产 生非均匀电场;可先向微流体通道注入细胞和介质(介质即所需操作的溶液,也即细胞所在溶液)。然后输入交流信号。S200, inputting an alternating frequency signal of a variable frequency to the electrodes of the upper and lower ITO glass, and irradiating the light-induced dielectrophoresis chip with the incident light, thereby producing the irradiated region A non-uniform electric field is generated; cells and media can be injected into the microfluidic channel first (the medium is the solution to be operated, that is, the solution in which the cells are located). Then enter the AC signal.
S300、改变交流信号的频率及大小,以控制细胞运动方向,同时采集细胞的图像;S300, changing the frequency and size of the alternating signal to control the direction of cell movement while collecting images of the cells;
S400、对采集的图像进行预处理,然后进行特征提取以及速度计算,最后重构3D细胞图像。S400: Preprocessing the acquired image, then performing feature extraction and speed calculation, and finally reconstructing the 3D cell image.
进一步,所述的步骤S100中,制作光诱导介电泳芯片的步骤具体包括:Further, in the step S100, the step of fabricating the light-induced dielectrophoresis chip specifically includes:
S101、清理ITO玻璃基质;S101, cleaning the ITO glass substrate;
清理ITO玻璃基质的表面,保证接触面的洁净度。Clean the surface of the ITO glass substrate to ensure the cleanliness of the contact surface.
S102、在ITO玻璃基质上沉积氢化非晶硅涂层(a-Si:H);S102, depositing a hydrogenated amorphous silicon coating (a-Si:H) on the ITO glass substrate;
在ITO玻璃基质表面沉积一层氢化非晶硅,厚度为1微米。A layer of hydrogenated amorphous silicon was deposited on the surface of the ITO glass substrate to a thickness of 1 micron.
S103、在氢化非晶硅涂层上涂光刻胶;S103, coating a photoresist on the hydrogenated amorphous silicon coating;
S104、在光刻胶上进行板印;S104, performing a plate printing on the photoresist;
板印是按照指定图形制作遮盖物,将遮盖物放在光刻胶表面,用紫外线照射遮盖物,没有被遮盖的光刻胶在紫外线作用下溶解,最终得到与遮盖物形状相同的光刻胶层。The stencil is to make a cover according to the specified pattern, the cover is placed on the surface of the photoresist, and the cover is irradiated with ultraviolet rays, and the uncovered photoresist is dissolved under the action of ultraviolet rays, and finally the photoresist having the same shape as the cover is obtained. Floor.
S105、接触腐蚀至ITO玻璃基质;具体是用草酸腐蚀制作的芯片表层,以去除没有覆盖光刻胶的氢化非晶硅涂层。S105, contact etching to the ITO glass substrate; specifically, etching the prepared chip surface layer with oxalic acid to remove the hydrogenated amorphous silicon coating without covering the photoresist.
S106、去除光刻胶;即将光刻胶从氢化非晶硅涂层表面去除。S106, removing the photoresist; removing the photoresist from the surface of the hydrogenated amorphous silicon coating.
S107、在ITO玻璃基质上未覆盖氢化非晶硅涂层的区域涂导电粘合剂。即在ITO玻璃的表面没有覆盖氢化非晶硅涂层的位置添加一 个导电触点。S107. Applying a conductive adhesive to a region of the ITO glass substrate that is not covered with the hydrogenated amorphous silicon coating. That is, a position is added at a position where the surface of the ITO glass is not covered with the hydrogenated amorphous silicon coating. Conductive contacts.
而上层的ITO玻璃清理干净之后,涂导电粘合剂即可。After the upper ITO glass is cleaned, apply a conductive adhesive.
在上下两层ITO玻璃之间封装有一个微流体通道(100微米高),具体是通过PDMS或是双面胶封装出一个微流体通道。A microfluidic channel (100 micron high) is packaged between the upper and lower ITO glass, specifically a microfluidic channel is encapsulated by PDMS or double-sided tape.
在步骤S200中,如图2所示,首先搭建光诱导介电泳平台。除了步骤S100制作的ODEP芯片20,平台还需要一台光学显微镜10、一台光学投影仪(高分辨率)、一个可编程信号发生电路和主机系统。所述主机系统包括:图像采集模块、显微视觉算法处理模块、生物芯片驱动控制器、虚拟电极生成模块以及显示输出模块。所述图像采集模块用来采集光学显微镜20的图像,并交由显微视觉算法处理模块来进行处理并通过显示输出模块来显示,所述显微视觉算法处理模块还向生物芯片驱动控制器及虚拟电极生成模块发出信号用来控制二者工作。所述生物芯片驱动控制器连接所述可编程信号发生电路来改变信号频率和大小。所述可编程信号发生电路通过电极连接所述ODEP芯片20。所述光学投影仪设置在ODEP芯片20下方,用来对其进行入射光照射。所述虚拟电极生成模块连接所述光学投影仪。In step S200, as shown in FIG. 2, a light-induced dielectrophoresis platform is first constructed. In addition to the ODEP chip 20 produced in step S100, the platform also requires an optical microscope 10, an optical projector (high resolution), a programmable signal generation circuit, and a host system. The host system includes: an image acquisition module, a microscopic vision algorithm processing module, a biochip drive controller, a virtual electrode generation module, and a display output module. The image acquisition module is configured to collect an image of the optical microscope 20, and is processed by a microscopic vision algorithm processing module and displayed by a display output module, wherein the microscopic vision algorithm processing module further drives the biochip driver controller and The virtual electrode generation module signals to control the operation of both. The biochip drive controller is coupled to the programmable signal generation circuit to vary the signal frequency and magnitude. The programmable signal generating circuit connects the ODEP chip 20 through electrodes. The optical projector is disposed below the ODEP chip 20 for illuminating the incident light. The virtual electrode generating module is coupled to the optical projector.
其中光学显微镜参数如下:The optical microscope parameters are as follows:
尼康CFI60无限远光学系统;Nikon CFI60 infinity optical system;
电动对焦,可上下移动(上13mm/下2mm);Electric focus, can move up and down (upper 13mm / 2mm);
三目镜筒,光分布:目镜/相机100%/0,20%/100%,0/100%;Trinocular tube, light distribution: eyepiece / camera 100% / 0, 20% / 100%, 0/100%;
目镜放大倍率:10x;Eyepiece magnification: 10x;
聚光器:防水,工作距离:7.2mm; Concentrator: waterproof, working distance: 7.2mm;
物镜:20x,高度消色透镜,纳米结晶涂层;Objective lens: 20x, highly achromatic lens, nanocrystalline coating;
载物台:电动X轴和Y轴,分辨率:0.1微米;Stage: electric X-axis and Y-axis, resolution: 0.1 micron;
紫外线截止滤光块;Ultraviolet cut filter block;
荧光滤波套装:FITC/GFP。Fluorescence filter set: FITC/GFP.
在平台搭建好后,可通过生物芯片驱动控制器向可编程信号发生电路发出信号,然后可编程信号发生电路向上下两层ITO玻璃的电极输入可变频率的交流信号,同时光学投影仪利用入射光照射所述光诱导介电泳芯片,从而在被照射的区域产生非均匀电场。After the platform is built, the biochip driver controller can send a signal to the programmable signal generation circuit, and then the programmable signal generation circuit inputs the variable frequency AC signal to the electrodes of the upper and lower layers of the ITO glass, and the optical projector utilizes the incident. Light illuminates the light-inducing dielectrophoresis chip to produce a non-uniform electric field in the illuminated area.
在所述步骤S300中,通过改变交流信号的频率及大小,来改变细胞所受到的介电泳力的方向与大小,以控制细胞运动方向,同时采集细胞的图像(2D细胞图像),实现高速操纵微纳米实体。In the step S300, by changing the frequency and size of the alternating current signal, the direction and size of the dielectrophoretic force received by the cell are changed to control the direction of cell movement, and the image of the cell (2D cell image) is acquired to realize high-speed manipulation. Micro-nano entities.
最后在步骤S400中,对采集的图像进行预处理,然后进行特征提取以及速度计算,最后重构3D细胞图像。Finally, in step S400, the acquired image is pre-processed, then feature extraction and velocity calculation are performed, and finally the 3D cell image is reconstructed.
下面先着重介绍下,如何实现由改变交流信号的频率及大小来控制细胞运动方向。Let's focus on how to control the direction of cell movement by changing the frequency and size of the AC signal.
细胞在非均匀电场中的所受到的平均介电泳力可以用如下公式描述:The average dielectrophoretic force experienced by a cell in a non-uniform electric field can be described by the following formula:
Figure PCTCN2015088945-appb-000007
Figure PCTCN2015088945-appb-000007
其中FDEP是作用到细胞上的平均介电泳力,R是细胞的半径,εm是细胞所在溶液的介电常数,Erms为所施加电场(交流信号)的均方根值,fCM为Clausius-Mossotti因子,在计算平均介电泳力时取该因子的实部Re[fCM],该因子定义如下: Where F DEP is the average dielectrophoretic force acting on the cell, R is the radius of the cell, ε m is the dielectric constant of the solution in which the cell is located, E rms is the root mean square value of the applied electric field (AC signal), f CM is Clausius-Mossotti factor, the real part of the factor Re[f CM ] is taken when calculating the average dielectrophoretic force, which is defined as follows:
Figure PCTCN2015088945-appb-000008
Figure PCTCN2015088945-appb-000008
εp*和εm*分别是细胞和溶液的复介电常数,公式2中的复介电常数(包括εp*和εm*)可表示为:ε p * and ε m * are the complex permittivity of the cell and the solution, respectively, and the complex permittivity (including ε p * and ε m *) in Equation 2 can be expressed as:
Figure PCTCN2015088945-appb-000009
Figure PCTCN2015088945-appb-000009
其中,ε是溶液的介电常数,σ是导电率,ω是所加电场(交流信号)的频率。Where ε is the dielectric constant of the solution, σ is the conductivity, and ω is the frequency of the applied electric field (alternating current signal).
可以看出fCM是一个和频率相关的可变因子。考虑在施加不同频率的交变电场下,当介电泳力与电场强度变化方向相同时,称为正介电泳现象;当所受到的介电泳力与电场强度变化方向相反,称为负介电泳现象。因而可以通过改变所施加的电场的频率,来改变细胞所受到的介电泳力的方向,达到控制细胞运动方向的目的。It can be seen that f CM is a frequency dependent variable factor. Considering the alternating electric field with different frequencies, when the dielectrophoretic force and the electric field intensity change direction are the same, it is called positive dielectrophoresis; when the dielectrophoretic force and the electric field intensity change direction are opposite, it is called negative dielectrophoresis. Therefore, by changing the frequency of the applied electric field, the direction of the dielectrophoretic force to which the cells are subjected can be changed to achieve the purpose of controlling the direction of cell movement.
由于生物细胞受到非均匀电场的极化作用而产生偶极矩,根据其介电泳力所产生的转矩与所在介质中受到的摩擦力矩达到平衡,细胞旋转速度为:Since the biological cells are subjected to the polarization of the non-uniform electric field to generate the dipole moment, the torque generated by the dielectrophoretic force is balanced with the friction torque received in the medium, and the cell rotation speed is:
Figure PCTCN2015088945-appb-000010
Figure PCTCN2015088945-appb-000010
其中E是电场强度,η是溶液的黏稠度,IM[fCM]是Clausius-Mossotti因子的虚部,K为系数。根据细胞的旋转速度与细胞的介电常数的关系可以对细胞的介电特性进行估算。Where E is the electric field strength, η is the viscosity of the solution, IM[f CM ] is the imaginary part of the Clausius-Mossotti factor, and K is the coefficient. The dielectric properties of the cells can be estimated based on the relationship between the rotational speed of the cells and the dielectric constant of the cells.
细胞受到的介电泳力强度与方向主要取决于介质与细胞的介电特性,如形状、尺寸与电场频率。本发明利用光诱导介电泳力(ODEP)(当施加某频段,电液动力学的一种主导力)以识别与操纵生物 细胞。ODEP芯片由可变频率的交流信号驱动,交流信号通过上下两层ITO玻璃的导电触点输入,此时在溶液层只有一小部分分压,并在溶液层中产生均匀电场。当入射光照射ODEP芯片,a-Si:H的光导率由于电子空穴对数的增多而增加几个数量级。由于入射光区域电阻减小,在溶液层中的分压会大大增大,于是入射光区域的a:Si:H将成为一个有效的虚拟电极产生非均匀电场。这种光诱导的非均匀电场会极化区域内的颗粒产生介电泳力,也就是光诱导介电泳力(ODEP)。通过光学显微镜与主机系统可实现程序化的动态运动,且不需要任何手工界面而实现微纳米实体的自动化捕获、操纵、分离与组装。The strength and direction of the dielectrophoretic force that a cell receives depends primarily on the dielectric properties of the medium and the cell, such as shape, size, and electric field frequency. The present invention utilizes light-induced dielectrophoretic force (ODEP) (when a certain frequency band is applied, a dominant force in electro-hydraulics) to identify and manipulate organisms cell. The ODEP chip is driven by a variable frequency AC signal, and the AC signal is input through the conductive contacts of the upper and lower layers of ITO glass. At this time, only a small portion of the solution layer is divided and a uniform electric field is generated in the solution layer. When incident light illuminates the ODEP chip, the optical conductivity of a-Si:H increases by several orders of magnitude due to the increase in the number of electron-hole pairs. Since the resistance of the incident light region is reduced, the partial pressure in the solution layer is greatly increased, so that a:Si:H in the incident light region will become an effective virtual electrode to generate a non-uniform electric field. This light-induced, non-uniform electric field produces a dielectrophoretic force, ie, light-induced dielectrophoretic force (ODEP), of the particles in the polarized region. Programmatic dynamic motion is achieved through optical microscopy and host systems, and automated capture, manipulation, separation and assembly of micro-nano entities are achieved without any manual interface.
对于步骤S400中,细胞三维图像生成的原理如下:当一个极化的物体置于非均匀电场时,在偶极矩的作用下物体会向电场最强或者最弱处运动,方向取决于物体相对于介质的极性。根据细胞在介电泳力场下的动力学模型,通过改变驱动光诱导介电泳生物芯片的交流信号的大小与频率,并配合相应的投射到ODEP芯片上的入射光,控制细胞在光诱导介电泳力的作用下的旋转运动。细胞旋转至不同位置的图像序列I={Ii,i=1,…,n},n为时刻点,细胞的三维图像是从二维图像序列重构细胞的三维结构。重构过程包括:For the step S400, the principle of generating a three-dimensional image of a cell is as follows: when a polarized object is placed in a non-uniform electric field, the object moves toward the strongest or weakest part of the electric field under the action of the dipole moment, and the direction depends on the relative of the object. The polarity of the medium. According to the kinetic model of the cell under the dielectrophoretic force field, the cell is controlled by light-induced dielectric by changing the size and frequency of the AC signal that drives the light-induced dielectrophoresis biochip and matching the incident light projected onto the ODEP chip. Rotational motion under the influence of swimming force. The image sequence rotated by the cells to different positions I={I i , i=1, . . . , n}, where n is the time point, and the three-dimensional image of the cells is a three-dimensional structure in which the cells are reconstructed from the two-dimensional image sequence. The refactoring process includes:
一、在获得二维图像后,先进行预处理:First, after obtaining a two-dimensional image, first pre-process:
1、先对图像进行高斯滤波处理,滤除掉图像中噪声。高斯滤波的核心公式如下:1. Perform Gaussian filtering on the image to filter out noise in the image. The core formula of Gaussian filtering is as follows:
Figure PCTCN2015088945-appb-000011
Figure PCTCN2015088945-appb-000011
其中σ为函数的宽度参数,控制了函数的径向作用范围。 Where σ is the width parameter of the function, which controls the radial extent of the function.
2、然后进行亮度调整处理。滤除噪声后,以背景色为基准,对图像整体亮度作线性变换:2. Then perform brightness adjustment processing. After filtering out the noise, the overall brightness of the image is linearly transformed based on the background color:
g(x,y)=c+k(f(x,y)-a)   (6)其中,f(x,y)和g(x,y)分别为图像中某点(x,y)的原始亮度和变换后的亮度,a为背景亮度,k为变换系数,c为亮度补偿。g(x,y)=c+k(f(x,y)-a) (6) where f(x,y) and g(x,y) are respectively a point (x,y) in the image Original brightness and transformed brightness, a is the background brightness, k is the transform coefficient, and c is the brightness compensation.
3、再进行模板匹配处理。对图像中的细胞进行模板匹配,比对同一窗口中的块在上下两帧的差异,计算相关系数ρXY3. Perform template matching processing again. The template matching is performed on the cells in the image, and the correlation coefficient ρ XY is calculated by comparing the difference between the upper and lower frames of the block in the same window.
Figure PCTCN2015088945-appb-000012
Figure PCTCN2015088945-appb-000012
其中X和Y分别为上下两帧中的块,Cov(X,Y)为X和Y的协方差,D(X)和D(Y)分别为X和Y的方差。Where X and Y are the blocks in the upper and lower frames, Cov(X, Y) is the covariance of X and Y, and D(X) and D(Y) are the variances of X and Y, respectively.
二、然后进行特征提取。Second, then feature extraction.
1、找到相关系数的局部最大值以跟踪峰点,从一个峰点到下一个峰点即代表旋转一圈,根据峰点的索引估算出旋转的圈数。1. Find the local maximum of the correlation coefficient to track the peak point. From one peak point to the next peak point, it represents one rotation, and the number of rotations is estimated according to the index of the peak point.
2、光流法分析像素的运动向量。对于图像上的一个像素点X(x,y)在t时刻的亮度值为I(x,y,t),u(x,y)和v(x,y)表示(x,y)处光流在x和y方向的运动分量。根据图像序列,计算
Figure PCTCN2015088945-appb-000013
Figure PCTCN2015088945-appb-000014
Figure PCTCN2015088945-appb-000015
W=diag(W(X1),…,W(Xn)),
Figure PCTCN2015088945-appb-000016
其中n为点的个数,diag()为构造对角矩阵,W为高斯函数:
2. The optical flow method analyzes the motion vector of the pixel. For a pixel point X(x, y) on the image, the luminance value at time t is I(x, y, t), u(x, y) and v(x, y) represent light at (x, y) The motion component in the x and y directions. Calculate based on image sequence
Figure PCTCN2015088945-appb-000013
with
Figure PCTCN2015088945-appb-000014
make
Figure PCTCN2015088945-appb-000015
W=diag(W(X 1 ),...,W(X n )),
Figure PCTCN2015088945-appb-000016
Where n is the number of points, diag() is the constructed diagonal matrix, and W is the Gaussian function:
Figure PCTCN2015088945-appb-000017
Figure PCTCN2015088945-appb-000017
令V=(u,v)T,那么其计算公式如下: Let V = (u, v) T , then the formula is as follows:
V=(ATW2A)-1ATW2b   (9)V=(A T W 2 A) -1 A T W 2 b (9)
三、再进行速度计算。Third, then calculate the speed.
1、根据得到的自转圈数以及相邻两个图像序列的拍摄间隔计算细胞的自转速度ω,结合细胞的旋转模型,即可得到细胞自转的旋转矩阵K。因此旋转后的细胞上所有点的集合M'=MK,其中M为细胞上所有点的原始坐标。每个点的运动速度
Figure PCTCN2015088945-appb-000018
1. Calculate the rotation speed ω of the cell according to the obtained number of rotation laps and the shooting interval of two adjacent image sequences, and combine the rotation model of the cell to obtain the rotation matrix K of the cell rotation. Thus the set of all points on the rotated cells M' = MK, where M is the original coordinates of all points on the cell. Speed of movement at each point
Figure PCTCN2015088945-appb-000018
2、利用光流法得到的细胞二维运动速度,修正上一步得到的三维运动速度。对于某一点a,其三维运动速度为v3D=(x3D,y3D,z3D),二维运动速度为v2D=(x2D,y2D),计算修正系数
Figure PCTCN2015088945-appb-000019
其中a和b分别为x轴和y轴修正系数。最终得到的三维运动速度V=Kv3D
2. Using the optical flow method to obtain the two-dimensional motion velocity of the cell, and correct the three-dimensional motion velocity obtained in the previous step. For a point a, the three-dimensional motion velocity is v 3D = (x 3D , y 3D , z 3D ), the two-dimensional motion velocity is v 2D = (x 2D , y 2D ), and the correction coefficient is calculated.
Figure PCTCN2015088945-appb-000019
Where a and b are the x-axis and y-axis correction coefficients, respectively. The resulting three-dimensional motion velocity V = Kv 3D .
四、最后进行细胞重构。Fourth, the final cell reconstitution.
具体的,根据细胞的刚体模型,细胞上一点m从时刻tk的位置(xk,yk,zk)经过旋转和平移,运动到时刻tk+1的位置(xk+1,yk+1,zk+1)。设旋转矩阵和平移向量分别是Rk和Tk,则细胞三维旋转运动模型为:Specifically, according to the rigid body model cells, the cells that m from the time t position k (x k, y k, z k) after a rotational and translational motion to time t k + 1 position (x k + 1, y k+1 , z k+1 ). Let the rotation matrix and the translation vector be R k and T k , respectively, then the three-dimensional rotational motion model of the cell is:
mk+1=Rkmk+Tk   (10)m k+1 =R k m k +T k (10)
定义映射其中M代表细胞上所有点的集合,将细胞在i时刻的三维信息投影到细胞旋转图像的某一帧Ii。因此,细胞的三维图像生成归结为模型参数的最大似然估计,使用机器学习算法对模型产生进行最大似然估计,按下式最小化的参数取值。Definition mapping Where M represents a collection of all points on the cell, projecting the three-dimensional information of the cell at time i to a certain frame I i of the rotated image of the cell. Therefore, the three-dimensional image generation of the cells is reduced to the maximum likelihood estimation of the model parameters, and the maximum likelihood estimation of the model generation is performed using a machine learning algorithm, and the parameter values minimized by the following formula are taken.
Figure PCTCN2015088945-appb-000021
Figure PCTCN2015088945-appb-000021
其中Ii+1是细胞旋转图像序列I={Ii,i=1,…,n}中的一帧,M代表细胞上所有点的集合,Ri和Ti分别是旋转矩阵和平移向量,Rimi+Ti是细胞上一点m从i时刻到i+1时刻的三维旋转运动模型,即mi+1。映射
Figure PCTCN2015088945-appb-000022
是将细胞在i时刻的三维信息投影到细胞旋转图像的某一帧Ii
Where I i+1 is a frame in the cell rotation image sequence I={I i , i=1, . . . , n}, where M represents a set of all points on the cell, and R i and T i are a rotation matrix and a translation vector, respectively. R i m i +T i is a three-dimensional rotational motion model of a point m on the cell from i to i+1, ie, mi+1 . Mapping
Figure PCTCN2015088945-appb-000022
It is to project the three-dimensional information of the cell at time i to a certain frame I i of the cell rotation image.
利用训练好的参数,即可根据细胞旋转的二维图像重构映射为当前帧的3D细胞模型。本发明通过光流的方法获得的细胞旋转运动信息将更准确的估计旋转矩阵Rk,进而优化细胞旋转的三维模型。Using the trained parameters, the 3D cell model mapped to the current frame can be reconstructed from the two-dimensional image of the cell rotation. The cell rotational motion information obtained by the optical flow method of the present invention will more accurately estimate the rotation matrix Rk, thereby optimizing the three-dimensional model of cell rotation.
本发明的方法具有如下优点:1)通过显微视觉算法实现的增强光诱导介电泳可操控平台的反馈控制功能;2)采用基于光流场的运动检测方法实现对细胞三维运动的跟踪,从而完成细胞动力学模型的参数估计;3)通过控制单个细胞的旋转,获取细胞二维图像序列,利用最大似然估计方法实现基于可控单细胞的二维图像序列的细胞的三维图像生成技术。本发明的方法,其所用设备简单,成本低,不会产生光毒作用,对样本的要求也较低,提高了可操作性。The method of the invention has the following advantages: 1) the feedback control function of the enhanced light-induced dielectrophoresis controllable platform realized by the microscopic vision algorithm; 2) the motion detection method based on the optical flow field is used to track the three-dimensional motion of the cell, thereby Complete the parameter estimation of the cell dynamics model; 3) Obtain the two-dimensional image sequence of the cell by controlling the rotation of the single cell, and realize the three-dimensional image generation technology of the cell based on the controllable single cell two-dimensional image sequence by the maximum likelihood estimation method. The method of the invention has simple equipment, low cost, no phototoxic effect, low requirements on samples, and improved operability.
应当理解的是,本发明的应用不限于上述的举例,对本领域普通技术人员来说,可以根据上述说明加以改进或变换,所有这些改进和变换都应属于本发明所附权利要求的保护范围。 It is to be understood that the application of the present invention is not limited to the above-described examples, and those skilled in the art can make modifications and changes in accordance with the above description, all of which are within the scope of the appended claims.

Claims (8)

  1. 一种基于光流分析的单细胞三维图像生成方法,其特征在于,包括步骤:A single-cell three-dimensional image generation method based on optical flow analysis, comprising the steps of:
    A、制作光诱导介电泳芯片,所述光诱导介电泳芯片有三层结构组成:有三层结构组成:下层为涂有氢化非晶硅涂层的ITO玻璃,上层是不含涂层的ITO玻璃,在上下两层ITO玻璃之间封装有一个微流体通道,用于注射所需操作的溶液;A. A photo-induced dielectrophoresis chip is prepared. The photo-induced dielectrophoresis chip has a three-layer structure: a three-layer structure: the lower layer is ITO glass coated with a hydrogenated amorphous silicon coating, and the upper layer is ITO glass without coating. A microfluidic channel is encapsulated between the upper and lower layers of ITO glass for injecting a solution for the desired operation;
    B、将细胞和溶液注射到微流体通道,并向上下两层ITO玻璃的电极输入可变频率的交流信号,同时利用入射光照射所述光诱导介电泳芯片,从而在被照射的区域产生非均匀电场;B. Injecting the cells and the solution into the microfluidic channel, and inputting a variable frequency alternating current signal to the electrodes of the upper and lower ITO glass, and irradiating the photoinduced dielectrophoresis chip with the incident light, thereby generating a non-irradiated region in the irradiated region. Uniform electric field;
    C、改变交流信号的频率及大小,以控制细胞运动方向,同时采集细胞的图像;C. Change the frequency and size of the AC signal to control the direction of cell movement while collecting images of the cells;
    D、对采集的图像进行预处理,然后进行特征提取以及速度计算,最后重构3D细胞图像。D. Pre-process the acquired image, then perform feature extraction and velocity calculation, and finally reconstruct the 3D cell image.
  2. 根据权利要求1所述的基于光流分析的单细胞三维图像生成方法,其特征在于,所述步骤A中,制作光诱导介电泳芯片的步骤具体包括:The method for generating a single-cell three-dimensional image based on the optical flow analysis according to claim 1, wherein the step of fabricating the light-induced dielectrophoresis chip in the step A comprises:
    A1、清理ITO玻璃基质;A1, cleaning the ITO glass substrate;
    A2、在ITO玻璃基质上沉积氢化非晶硅涂层;A2 depositing a hydrogenated amorphous silicon coating on the ITO glass substrate;
    A3、在氢化非晶硅涂层上涂光刻胶;A3, coating a photoresist on the hydrogenated amorphous silicon coating;
    A4、在光刻胶上进行板印;A4, performing plate printing on the photoresist;
    A5、接触腐蚀至ITO玻璃基质; A5, contact corrosion to the ITO glass substrate;
    A6、去除光刻胶;A6, removing the photoresist;
    A7、在ITO玻璃基质上未覆盖氢化非晶硅涂层的区域涂导电粘合剂。A7. A conductive adhesive is applied to the area of the ITO glass substrate that is not covered with the hydrogenated amorphous silicon coating.
  3. 根据权利要求1所述的基于光流分析的单细胞三维图像生成方法,其特征在于,所述细胞在非均匀电场中的所受到的平均介电泳力用如下公式描述:The single-cell three-dimensional image generating method based on optical flow analysis according to claim 1, wherein the average dielectrophoretic force of the cells in the non-uniform electric field is described by the following formula:
    Figure PCTCN2015088945-appb-100001
    Figure PCTCN2015088945-appb-100001
    其中FDEP是作用到细胞上的平均介电泳力,R是细胞的半径,εm是细胞所在溶液的介电常数,Erms为所施加交流信号的均方根值,fCM为Clausius-Mossotti因子,在计算平均介电泳力时取该因子的实部Re[fCM]。Where F DEP is the average dielectrophoretic force acting on the cell, R is the radius of the cell, ε m is the dielectric constant of the solution in which the cell is located, E rms is the root mean square value of the applied AC signal, and f CM is Clausius-Mossotti Factor, the real part of the factor Re[f CM ] is taken when calculating the average dielectrophoretic force.
  4. 根据权利要求1所述的基于光流分析的单细胞三维图像生成方法,其特征在于,fCM因子定义如下:The method according to claim 1, wherein the f CM factor is defined as follows:
    Figure PCTCN2015088945-appb-100002
    Figure PCTCN2015088945-appb-100002
    εp*和εm*分别是细胞和溶液的复介电常数。ε p * and ε m * are the complex dielectric constants of the cells and solutions, respectively.
  5. 根据权利要求1所述的基于光流分析的单细胞三维图像生成方法,其特征在于,所述复介电常数可表示为:The method according to claim 1, wherein the complex permittivity is expressed as:
    Figure PCTCN2015088945-appb-100003
    Figure PCTCN2015088945-appb-100003
    其中,ε是溶液的介电常数,σ是导电率,ω是所施加交流信号的频率。Where ε is the dielectric constant of the solution, σ is the conductivity, and ω is the frequency of the applied AC signal.
  6. 根据权利要求1所述的基于光流分析的单细胞三维图像生成 方法,其特征在于,细胞旋转速度为:Single-cell three-dimensional image generation based on optical flow analysis according to claim The method is characterized in that the cell rotation speed is:
    Figure PCTCN2015088945-appb-100004
    Figure PCTCN2015088945-appb-100004
    其中E是电场强度,η是溶液的黏稠度,IM[fCM]是Clausius-Mossotti因子的虚部,K为系数。Where E is the electric field strength, η is the viscosity of the solution, IM[f CM ] is the imaginary part of the Clausius-Mossotti factor, and K is the coefficient.
  7. 根据权利要求1所述的基于光流分析的单细胞三维图像生成方法,其特征在于,所述预处理包括:高斯滤波处理、亮度调整及模板匹配。The single-cell three-dimensional image generating method based on optical flow analysis according to claim 1, wherein the pre-processing comprises: Gaussian filtering processing, brightness adjustment, and template matching.
  8. 根据权利要求1所述的基于光流分析的单细胞三维图像生成方法,其特征在于,所述步骤D中,使用机器学习算法对模型参数进行最大似然估计,按下式最小化的参数取值:The single-cell three-dimensional image generating method based on optical flow analysis according to claim 1, wherein in the step D, a maximum likelihood estimation of the model parameters is performed using a machine learning algorithm, and a parameter of the following formula is minimized. value:
    Figure PCTCN2015088945-appb-100005
    Figure PCTCN2015088945-appb-100005
    其中Ii+1是细胞旋转图像序列I={Ii,i=1,…,n}中的一帧,M代表细胞上所有点的集合,Ri和Ti分别是旋转矩阵和平移向量,Rimi+Ti是细胞上一点m从i时刻到i+1时刻的三维旋转运动模型,即mi+1,映射
    Figure PCTCN2015088945-appb-100006
    是将细胞在i时刻的三维信息投影到细胞旋转图像的某一帧Ii
    Where I i+1 is a frame in the cell rotation image sequence I={I i , i=1, . . . , n}, where M represents a set of all points on the cell, and R i and T i are a rotation matrix and a translation vector, respectively. , R i m i +T i is a three-dimensional rotational motion model of a point m from i to i+1 on the cell, ie mi+1 , mapping
    Figure PCTCN2015088945-appb-100006
    It is to project the three-dimensional information of the cell at time i to a certain frame I i of the cell rotation image.
PCT/CN2015/088945 2015-08-14 2015-09-06 Method for generating single-cell three-dimensional image based on optical flow analysis WO2017028341A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201510500965.1A CN105184853B (en) 2015-08-14 2015-08-14 A kind of unicellular three-dimensional image generating method based on optical flow analysis
CN201510500965.1 2015-08-14

Publications (1)

Publication Number Publication Date
WO2017028341A1 true WO2017028341A1 (en) 2017-02-23

Family

ID=54906903

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2015/088945 WO2017028341A1 (en) 2015-08-14 2015-09-06 Method for generating single-cell three-dimensional image based on optical flow analysis

Country Status (2)

Country Link
CN (1) CN105184853B (en)
WO (1) WO2017028341A1 (en)

Families Citing this family (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105092679B (en) * 2015-08-14 2018-07-03 深圳大学 A kind of unicellular control method based on light-induction dielectrophoresis technology
DE102017201252A1 (en) 2017-01-26 2018-07-26 Universität Ulm Method and device for the examination of cells
CN107858289B (en) * 2017-12-25 2019-06-21 上海大学 A kind of cell scratch chip, device and method
CN112005278A (en) * 2018-04-27 2020-11-27 惠普发展公司,有限责任合伙企业 Non-rotating non-uniform electric field object rotation
CN109925597B (en) * 2019-02-01 2023-06-09 广州唯思冠电子科技有限公司 Cell presentation method based on Heng Tong instrument
CN110314714B (en) * 2019-07-09 2021-06-25 大连海事大学 Cell activity state characterization monitoring device and method based on three-dimensional image characteristics

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20070187248A1 (en) * 2005-12-13 2007-08-16 Dalibor Hodko Three dimensional dielectrophoretic separator and methods of use
CN101135680A (en) * 2007-07-13 2008-03-05 东南大学 Light-induction dielectrophoresis auxiliary unicellular dielectric spectrum automatic test equipment and testing method
US20080289965A1 (en) * 2005-12-21 2008-11-27 The Trustees Of The University Of Pennsylvania System and Method for Controlling Nanoparticles Using Dielectrophoretic Forces
CN101697236A (en) * 2009-10-21 2010-04-21 南昌航空大学 Method for three-dimensional reconstruction of straight-line optical flow field based on intelligent optimization algorithm
CN102449163A (en) * 2009-04-03 2012-05-09 加利福尼亚大学董事会 Methods and devices for sorting cells and other biological particulates
CN102539484A (en) * 2010-10-29 2012-07-04 索尼公司 Dielectric cytometric apparatus and dielectric-cytometric cell sorting method

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
GB0211068D0 (en) * 2002-05-14 2002-06-26 Amersham Biosciences Uk Ltd Method for assessing biofilms
US9013692B2 (en) * 2008-06-12 2015-04-21 East Carolina University Flow cytometer apparatus for three dimensional difraction imaging and related methods
CN102692416A (en) * 2012-06-26 2012-09-26 天津师范大学 Automatic embryonic cell migration tracking system and method based on micromanipulation robot
CN104212706B (en) * 2014-09-19 2016-03-02 成都劲宏科技有限公司 A kind of cell microfluidic image capturing system based on phase lock amplifying technology
CN104567682B (en) * 2015-01-14 2017-08-08 天津大学 Particulate three-dimensional position nanoscale resolution measurement method under liquid environment

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20070187248A1 (en) * 2005-12-13 2007-08-16 Dalibor Hodko Three dimensional dielectrophoretic separator and methods of use
US20080289965A1 (en) * 2005-12-21 2008-11-27 The Trustees Of The University Of Pennsylvania System and Method for Controlling Nanoparticles Using Dielectrophoretic Forces
CN101135680A (en) * 2007-07-13 2008-03-05 东南大学 Light-induction dielectrophoresis auxiliary unicellular dielectric spectrum automatic test equipment and testing method
CN102449163A (en) * 2009-04-03 2012-05-09 加利福尼亚大学董事会 Methods and devices for sorting cells and other biological particulates
CN101697236A (en) * 2009-10-21 2010-04-21 南昌航空大学 Method for three-dimensional reconstruction of straight-line optical flow field based on intelligent optimization algorithm
CN102539484A (en) * 2010-10-29 2012-07-04 索尼公司 Dielectric cytometric apparatus and dielectric-cytometric cell sorting method

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
WANG, SHU'E ET AL.: "Automatic Manipulation of Polystyrene Beads via Optically-Induced Dielectrophoresis", MICRONANOELECTRONIC TECHNOLOGY, vol. 48, no. 2, 28 February 2011 (2011-02-28), pages 133 - 136, ISSN: 1671-4776 *

Also Published As

Publication number Publication date
CN105184853B (en) 2018-04-10
CN105184853A (en) 2015-12-23

Similar Documents

Publication Publication Date Title
WO2017028341A1 (en) Method for generating single-cell three-dimensional image based on optical flow analysis
WO2017028340A1 (en) Single cell control method based on light-induced dielectrophoresis technique
JP6364074B2 (en) Multi-view light sheet microscopy
Buist et al. Real time two‐photon absorption microscopy using multi point excitation
US9892812B2 (en) Fourier ptychographic x-ray imaging systems, devices, and methods
Backer et al. A bisected pupil for studying single-molecule orientational dynamics and its application to three-dimensional super-resolution microscopy
EP1413911B1 (en) Method and device for 3 dimensional imaging of suspended micro-objects providing high-resolution microscopy
CN113102892B (en) System and method for processing nano convex structure on titanium surface by femtosecond laser
WO2017028342A1 (en) Cell classification method based on light-induced dielectrophoresis technique
CN106526823B (en) A kind of non-fluorescence non-intuitive microscopic imaging device of DNA nanospheres and method
CN110068918B (en) Optical super-resolution imaging system based on superimposed double-microsphere lens
CN110246083A (en) A kind of fluorescence microscope images super-resolution imaging method
CN111474179A (en) Lens surface cleanliness detection device and method
CN107782744A (en) A kind of eyeglass defect automatic detection device of Grating Modulation
US11543356B2 (en) Rotation and flat-form imaging for microscopic objects
CN102586092B (en) Cell impedance imaging system and cell impedance imaging method for dynamically monitoring wound healing
CN205193097U (en) Micro - imaging system is fixed a position altogether to atomic force / fluorescence
US11422355B2 (en) Method and system for acquisition of fluorescence images of live-cell biological samples
CN111908421B (en) Micro-nano self-assembly operation method and system based on photoinduction dielectrophoresis
Grammatikopoulou et al. Depth estimation of optically transparent microrobots using convolutional and recurrent neural networks
Jia et al. Fabrication of a probe-lens device for scanning super-resolution imaging platform
CN215050149U (en) Cell sorting and identifying system based on micro-fluidic chip
CN112834786B (en) Nanoparticle three-dimensional control method based on scanning probe
CN110631992A (en) Optical tweezers longitudinal positioning feedback device and method based on fluorescence coupling emergence
Huszka et al. Custom adapter for extended field-of-view microsphere-based scanning super-resolution microscopy

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 15901545

Country of ref document: EP

Kind code of ref document: A1

DPE2 Request for preliminary examination filed before expiration of 19th month from priority date (pct application filed from 20040101)
NENP Non-entry into the national phase

Ref country code: DE

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205 DATED 12/07/2018)

122 Ep: pct application non-entry in european phase

Ref document number: 15901545

Country of ref document: EP

Kind code of ref document: A1