EP3756165A1 - Nonrotating nonuniform electric field object rotation - Google Patents
Nonrotating nonuniform electric field object rotationInfo
- Publication number
- EP3756165A1 EP3756165A1 EP18915955.1A EP18915955A EP3756165A1 EP 3756165 A1 EP3756165 A1 EP 3756165A1 EP 18915955 A EP18915955 A EP 18915955A EP 3756165 A1 EP3756165 A1 EP 3756165A1
- Authority
- EP
- European Patent Office
- Prior art keywords
- electric field
- nonrotating
- electrode
- dimensional
- nonuniform electric
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Withdrawn
Links
- 230000005684 electric field Effects 0.000 title claims abstract description 48
- 238000000034 method Methods 0.000 claims abstract description 28
- 230000001413 cellular effect Effects 0.000 claims description 52
- 238000003384 imaging method Methods 0.000 claims description 17
- 239000012530 fluid Substances 0.000 claims description 11
- 230000003287 optical effect Effects 0.000 claims description 11
- 210000004027 cell Anatomy 0.000 description 14
- 238000010586 diagram Methods 0.000 description 14
- 210000000056 organ Anatomy 0.000 description 6
- 210000003463 organelle Anatomy 0.000 description 6
- 239000004020 conductor Substances 0.000 description 4
- 238000004458 analytical method Methods 0.000 description 3
- 238000003708 edge detection Methods 0.000 description 3
- 210000004940 nucleus Anatomy 0.000 description 3
- 210000002220 organoid Anatomy 0.000 description 3
- 238000007781 pre-processing Methods 0.000 description 3
- 239000000725 suspension Substances 0.000 description 3
- 210000000170 cell membrane Anatomy 0.000 description 2
- 210000003855 cell nucleus Anatomy 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- AMGQUBHHOARCQH-UHFFFAOYSA-N indium;oxotin Chemical compound [In].[Sn]=O AMGQUBHHOARCQH-UHFFFAOYSA-N 0.000 description 2
- 230000003278 mimic effect Effects 0.000 description 2
- 230000008569 process Effects 0.000 description 2
- 230000031018 biological processes and functions Effects 0.000 description 1
- 210000002421 cell wall Anatomy 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 238000001514 detection method Methods 0.000 description 1
- 239000003814 drug Substances 0.000 description 1
- 229940079593 drug Drugs 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000001914 filtration Methods 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 239000000017 hydrogel Substances 0.000 description 1
- 239000007788 liquid Substances 0.000 description 1
- 230000007246 mechanism Effects 0.000 description 1
- 210000000130 stem cell Anatomy 0.000 description 1
- 210000001519 tissue Anatomy 0.000 description 1
Classifications
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B21/00—Microscopes
- G02B21/36—Microscopes arranged for photographic purposes or projection purposes or digital imaging or video purposes including associated control and data processing arrangements
- G02B21/365—Control or image processing arrangements for digital or video microscopes
- G02B21/367—Control or image processing arrangements for digital or video microscopes providing an output produced by processing a plurality of individual source images, e.g. image tiling, montage, composite images, depth sectioning, image comparison
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/50—Depth or shape recovery
- G06T7/55—Depth or shape recovery from multiple images
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N15/00—Investigating characteristics of particles; Investigating permeability, pore-volume or surface-area of porous materials
- G01N15/10—Investigating individual particles
- G01N15/14—Optical investigation techniques, e.g. flow cytometry
- G01N15/1425—Optical investigation techniques, e.g. flow cytometry using an analyser being characterised by its control arrangement
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N15/00—Investigating characteristics of particles; Investigating permeability, pore-volume or surface-area of porous materials
- G01N15/10—Investigating individual particles
- G01N15/14—Optical investigation techniques, e.g. flow cytometry
- G01N15/1429—Signal processing
- G01N15/1433—Signal processing using image recognition
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N15/00—Investigating characteristics of particles; Investigating permeability, pore-volume or surface-area of porous materials
- G01N15/10—Investigating individual particles
- G01N15/14—Optical investigation techniques, e.g. flow cytometry
- G01N15/1434—Optical arrangements
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N33/00—Investigating or analysing materials by specific methods not covered by groups G01N1/00 - G01N31/00
- G01N33/48—Biological material, e.g. blood, urine; Haemocytometers
- G01N33/483—Physical analysis of biological material
- G01N33/4833—Physical analysis of biological material of solid biological material, e.g. tissue samples, cell cultures
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B21/00—Microscopes
- G02B21/32—Micromanipulators structurally combined with microscopes
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B21/00—Microscopes
- G02B21/36—Microscopes arranged for photographic purposes or projection purposes or digital imaging or video purposes including associated control and data processing arrangements
- G02B21/365—Control or image processing arrangements for digital or video microscopes
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T17/00—Three dimensional [3D] modelling, e.g. data description of 3D objects
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/66—Remote control of cameras or camera parts, e.g. by remote control devices
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N15/00—Investigating characteristics of particles; Investigating permeability, pore-volume or surface-area of porous materials
- G01N15/10—Investigating individual particles
- G01N2015/1006—Investigating individual particles for cytology
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N15/00—Investigating characteristics of particles; Investigating permeability, pore-volume or surface-area of porous materials
- G01N15/10—Investigating individual particles
- G01N15/14—Optical investigation techniques, e.g. flow cytometry
- G01N15/1434—Optical arrangements
- G01N2015/144—Imaging characterised by its optical setup
- G01N2015/1445—Three-dimensional imaging, imaging in different image planes, e.g. under different angles or at different depths, e.g. by a relative motion of sample and detector, for instance by tomography
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/30—Subject of image; Context of image processing
- G06T2207/30004—Biomedical image processing
- G06T2207/30024—Cell structures in vitro; Tissue sections in vitro
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2210/00—Indexing scheme for image generation or computer graphics
- G06T2210/41—Medical
Definitions
- Objects are sometimes analyzed or simulated through the use of three-dimensional image reconstructions or three-dimensional modeling of the objects such three-dimensional models are sometimes made using multiple images captured while the object is rotating.
- Figure 1 is a schematic diagram illustrating portions of an example object rotation system.
- Figure 2 is a diagram illustrating the example rotation system of
- Figure 1 applying a nonrotating nonuniform electric field to rotate an example object.
- Figure 3 is a diagram illustrating an example rotation system applying a nonrotating nonuniform electric field to rotate an example object.
- Figure 4 is a schematic diagram illustrating portions of an example three-dimensional object modeling system.
- Figure 5 is a flow diagram of an example three-dimensional object modeling method.
- Figure 6 a flow diagram of an example three-dimensional volume modeling method.
- Figure 7 is a diagram schematically illustrating the capture of two-dimensional image frames of a rotating object at different angles.
- Figure 8 is a diagram depicting an example image frame including the identification of features of an object at a first angular position.
- Figure 9 is a diagram depicting an example image frame including the identifications of the features of the object at a second different angular position.
- Figure 10 is a diagram illustrating triangulation of the different identified features for the merging and alignment of features from the frames.
- Figure 11 is a diagram illustrating an example three-dimensional volumetric parametric model produced from the example image frames of Figures 7 and 8.
- Disclosed herein are example systems and methods for rotating very small objects to facilitate three-dimensional imaging or modeling of such objects.
- Disclosed herein are example systems and methods that rotate objects for three-dimensional imaging or modeling with less complexity and cost.
- Disclosed herein are example systems and methods that apply a non- rotating nonuniform electric field so as to apply a die electrophoretic torque to a three-dimensional object so as to rotate the three-dimensional object.
- the example systems and methods facilitate rotation of the very small objects by suspending the very small objects in a fluid, such as a liquid. As a result, the system the methods are well suited for the imaging of objects where direct physical contact and direct manipulation the objects is difficult.
- the example systems and methods for rotating objects may employ as few as to spaced electrodes to form the nonrotating nonuniform electric field that creates a dielectrophoretic torque and that rotate the three-dimensional object.
- the example systems and methods for rotating objects facilitate rotation of the object about a rotational axis that is parallel to planes of the electrodes. In some implementations, this facilitates rotation of the objects about a rotational axis that is also parallel to a plane of a microfluidic chip, slide or a platform/stage containing the fluid that suspends the object during their rotation.
- the rotation of the object by the nonrotating nonuniform electric field facilitates rotation the object about the rotational axis that is
- the overall imaging system may be more compact and less complex.
- the three-dimensional object being rotated, imaged and modeled may comprise biological elements, such as cells.
- three-dimensional object being rotated may comprise a cellular object.
- a cellular object comprises a 3D culture or an organoid.
- 3D cultures are cells grown in droplets or hydrogels that mimic a physiologically relevant environment.
- Organoids are miniature organs grown in a lab derived from stem cells and clusters of tissue, wherein the specific cells mimic the function of the organ they model.
- 3-D cultures and organaids may be used to study basic biological processes within specific organs or to understand the effects of particular drugs. 3-D cultures and organoids may provide crucial insight into mechanisms of cells and organs in a more native environment.
- the method may include applying a nonrotating nonuniform electric field to apply a dielectrophoretic torque to a three-dimensional object to rotate the three-dimensional object. Images are captured of the object at different angles during rotation of the object. A three-dimensional model of the object is formed based on the captured images.
- the system may include a first electrode, a second electrode, a power supply connected to the first electrode and the second electrode, a camera and a controller.
- the controller may output control signals controlling the power supply such that the first electrode and the second electrode cooperate to apply a nonrotating nonuniform electric field to an object suspended in the fluid so as to rotate the object.
- the controller may further output control signals controlling the camera to capture images of the object at different angles during rotation of the object, wherein the controller is to form a three-dimensional model of the object based on the captured images.
- the cellular object rotation system may include a first electrode, a second electrode, a power supply connected to the first electrode and the second electrode and a controller to output control signals controlling the power supply such that the first electrode and the second electrode cooperate to apply a nonrotating nonuniform electric field to a cellular object suspended in the fluid so as to rotate the object.
- Figure 1 schematically illustrates portions of an example object rotation system 20 for use with a three-dimensional imaging system.
- the object rotation system 20 comprises a cellular object rotation system for use with a cellular object imaging system.
- Object rotation system 20 facilitate low cost and less complex rotation of objects, such as cellular objects, as such object are being imaged for three-dimensional modeling.
- Object rotation system 20 comprises electrodes 60, power supply 61 and controller 62.
- Electrodes 60 comprise a pair of spaced electrodes that cooperate to form a nonrotating nonuniform electric field through a cellular object suspension region 50.
- the cellular object suspension region 50 comprises a volume of fluid 54 in which a three-dimensional object, such as a cellular object 52 is suspended.
- electrodes 60 comprise a pair of electrodes located on one side of the cellular object 52.
- such electrodes 60 may be formed from a transparent electrically conductive material such as indium tin oxide.
- electrodes may be formed from other electrically conductive materials.
- electrodes 62 each comprise a flat planar electrode, wherein the electrodes 60 are coplanar. As a result, object rotation system 20 may be more compact.
- Power supply 61 comprise a source of power for allegedly charging at least one of electrodes 60.
- power supply 61 supplies power to electrodes 60 under the control of controller 62.
- Controller 62 comprises a processing unit that follows instructions contained in a non-transitory computer-readable medium.
- controller 62 may comprise an application-specific integrated circuit.
- controller 62 serves as a signal generator controlling the frequency and voltage of the nonrotating nonuniform electric field.
- Figure 2 is a schematic diagram illustrating the application of the nonrotating nonuniform electric field to the example cellular object 52. As indicated by arrow 63, the electric field applies a dielectrophoretic torque to object 52 so as to rotate object 52 about a rotational axis 65. Such rotation facilitates the capturing of images of the cellular object 52 at different angles to facilitate three-dimensional reconstruction or modeling of cellular object 52 for analysis.
- controller 62 outputs control signals such that electrodes 60 apply a sinusoidal nonrotating nonuniform alternating current electric field having a frequency of at least 30 kHz and no greater than 500 kHz.
- the nonrotating nonuniform electric field has a voltage of at least 0.1 V rms and no greater than 100 V rms.
- the cellular object must have rotated a distance that at least equals to the diffraction limit dlim of the imaging optics.
- the cellular object cannot rotate too much that there is no overlap between consecutive image frames. So the maximum rotating angle between
- the nonuniform nonrotating electric field produces a dielectrophoretic torque on the cellular object so as to rotate the cellular object at a speed such that an image or may capture images every 2.4 degrees while producing output in a reasonably timely manner.
- the captured speed of the imager is 30 frames per second
- the produced dielectrophoretic torque rotates the cellular object at a rotational speed of at least 12 rpm and no greater than 180 rpm.
- the produced dielectrophoretic torque rotates the cellular object at least one pixel shift between adjacent frames, but where the picture shift is not so great so as to not be captured by the imager 280.
- cellular object 52 may be rotated at other rotational speeds.
- Figure 3 illustrates portions of another example three- dimensional object rotation system 120.
- object rotation system 120 is well-suited for rotating very small objects while such small objects are suspended in a fluid.
- object rotation system 120 well-suited for rotating cellular objects as such objects are being imaged to form three-dimensional reconstructions or models of the cellular objects.
- System 120 is similar to system 20 described above except that system 120 comprises an alternative arrangement having electrodes 160 in lieu of electrodes 60. Those remaining components of system 120 which correspond to components of system 20 are numbered similarly in Figure 3 or are shown in Figure 1.
- Electrodes 160 comprise a pair of electrodes that cooperate to form a nonrotating nonuniform electric field through the cellular object suspension region 50.
- electrodes 160 comprise a pair of electrodes located on opposite sides of the cellular object 52 with the electrodes 160 facing one another.
- such electrodes may be formed from a transparent or translucent electrically conductive material such as indium tin oxide. In other implementations, electrodes 160 may form from other electrically conductive materials.
- object rotation system 120 may perform in a similar fashion as compared object rotation system 20.
- Controller 62 (shown in Figure 1 ) outputs control signals or generate signals such that electrodes 160 apply a nonrotating nonuniform electric field about the suspended object, shown as cellular object 52.
- controller! 62 outputs control signals such that electrodes 160 apply a sinusoidal nonrotating nonuniform alternating current electric field having a frequency of at least 30 kFIz and no greater than 500 kFIz.
- the nonrotating nonuniform electric field has a voltage of at least 0.1 V rms and no greater than 100 V rms.
- the electric field is applied such that it applies a dialect referred to torque to the object 52 so as to rotate the object 52 as indicated by arrow 163 about an axis 165.
- the rotational axes 165 of object 52 is parallel to the slide, stage or platform containing the fluid and may be perpendicular to the optical axis of the image or camera capturing images of object 52 at different angular positions. Because the rotation axis perpendicular to the optical axis, the overall imaging system may be more compact and less complex.
- Modeling system 210 facilitates the rotation of an object, such as a cellular object, as the object is being imaged to facilitate the output of a three-dimensional reconstruction or model of the object.
- Modeling system 210 facilitates such rotation of the object with an architecture that is less complex and more compact, potentially reducing cost.
- Modeling system 210 comprises object rotation system 220, controller 270 and imager 280, in the form of a camera.
- Object rotation system 220 is similar to object rotation system 20 described above except that controller 270 controls power supply 61 and imager 280.
- Controller 270 comprises processing unit 272 and a non- transitory computer readable medium in the form of memory 274.
- Processing unit 272 follows instructions contained in memory 274.
- Memory 274 contains instructions that direct processing unit 272 to control the operation of electrodes 60, 160 and imager 280.
- controller 270 outputs control signals controlling the rate at which so the object 52 is rotated during imaging.
- controller 270 serves as a signal generator controlling the frequency and voltage of the nonrotating nonuniform electric field such as shown in Figures 2 or 3. The electric field applies a
- controller 270 outputs control signals such that electrodes 60, 160 apply a sinusoidal nonrotating nonuniform alternating current electric field having a frequency of at least 30 kHz and no greater than 500 kHz.
- the nonrotating nonuniform electric field has a voltage of at least 0.1 V rms and no greater than 100 V rms.
- the cellular object must have rotated a distance that at least equals to the diffraction limit dn m of the imaging optics.
- the cellular object cannot rotate too much that there is no overlap between consecutive image frames. So the maximum rotating angle between consecutive images
- the nonuniform nonrotating electric field produces a dielectrophoretic torque on the cellular object so as to rotate the cellular object at a speed such that an image or may capture images every 2.4 degrees while producing output in a reasonably timely manner.
- the captured speed of the imager is 30 frames per second
- the produced dielectrophoretic torque rotates the cellular object at a rotational speed of at least 12 rpm and no greater than 180 rpm.
- the produced dielectrophoretic torque rotates the cellular object at least one pixel shift between adjacent frames, but where the picture shift is not so great so as to not be captured by the imager 280.
- cellular object 52 may be rotated at other rotational speeds.
- Imager 280 comprise at least one camera to capture images of the rotating cellular object 52 at different angles during rotation of cellular object 52 about axis 65.
- Imager 280 has an optical axis 282 which is perpendicular to axis 65.
- imager 280 may comprise multiple cameras.
- Imager 280 captures images of the rotating cellular object 52 at different angular positions during his rotation to facilitate subsequent three-dimensional image reconstruction of the cellular object 52 as will be described hereafter.
- imager 280 may comprise a camera having an optical lens 282 facility microscopic viewing and imaging of cellular object 52.
- controller 270 may additionally control imager 280. Controller 270 receives images or image signals from imager 280. Based upon the different images of the rotating cellular object 52 captured at different rotational angles, controller 270 triangulates identified points of the image to form a three- dimensional reconstruction or model 290 of cellular object 52 for analysis.
- FIG. 5 is a flow diagram of an example three-dimensional object modeling method 300.
- Modeling method 300 captures images of an object rotated with a nonrotating nonuniform electric field. Modeling method 300 may be implemented with less complex and lower-cost components.
- method 300 is described in the contest of being carried out by three- dimensional object modeling system 210 having object rotation system 220, it should be appreciated that method 300 may likewise be carried out with other similar modeling systems and other similar object rotation systems, such as object rotation systems 20 or 120.
- a nonrotating nonuniform electric field is applied so as to apply a dielectrophoretic torque to a three-dimensional object, such as a cellular object, to rotate the three-dimensional object.
- a sinusoidal nonrotating nonuniform alternating current electric field having a frequency of at least 30 kHz and no greater than 500 kHz is applied to the object or the object suspended in a fluid.
- the nonrotating nonuniform electric field has a voltage of at least 0.1 V rms and no greater than 100 V rms.
- controller 270 outputs control signals causing camera 282 capture images of the object 52 at different angles during rotation of object 52.
- controller 270 upon receiving the captured images from imager 280, controller 270 formed a three-dimensional reconstruction or model of the object 52 based upon the captured images.
- FIG. 6 is a flow diagram of an example three-dimensional volumetric modeling method 500 that may be carried out by controller 470 using captured two-dimensional images of the rotating object 52.
- a controller such as controller 470, receives video frames or two-dimensional images captured by the imager/camera 60 during rotation of object 52.
- various preprocessing actions are taken with respect to each of the received two-dimensional image video frames. Such preprocessing may include filtering, binarization, edge detection, circle fitting and the like.
- controller 470 retrieves and consults a predefined three- dimensional volumetric template of the object 52, to identify various internal structures of the object are various internal points in the object.
- the three- dimensional volumetric template may identify the shape, size and general expected position of internal structures which may then be matched to those of the two-dimensional images taken at the different angles.
- a single cell may have a three-dimensional volumetric template comprising a sphere having a centroid and a radius. The three-dimensional location of the centroid and radius are determined by analyzing multiple two-dimensional images taken at different angles.
- controller 470 may model in three-dimensional space the size and internal depth/location of internal structures, such as the nucleus and organelles. For example, with respect to cells, controller 470 may utilize a predefined template of a cell to identify the cell wall and the nucleus As indicated by block 518, using a predefined template, controller 470 additionally identifies regions or points of interest, such as organs or organelles of the cell. As indicated by block 524, controller 470 matches the centroid of the cell membrane, nucleus and organelles amongst or between the consecutive frames so as to estimate the relative movement (R, T) between the consecutive frames per block 528.
- R, T relative movement
- controller 470 reconstructs the centroid coordinates in three-dimensional space. As indicated by block 538, the centroid three-dimensional coordinates reconstructed from every two frames are merged and aligned. A single copy of the same organelle is preserved. As indicated by block 542, controller 470 outputs a three- dimensional volumetric parametric model of object 52.
- Figures 7-11 illustrate one example modeling process 600 that may be utilized by 3-D modeler 70 or controller 470 in the three-dimensional volumetric modeling of the biological object.
- Figure 7-11 illustrate an example three-dimensional volumetric modeling of an individual cell.
- the modeling process depicted in Figures 7-11 may likewise be carried out with other biological objects.
- two-dimensional video/camera images or frames 604A, 604B and 604C are captured at different angles during rotation of object 52.
- the frame rate of the imager or camera is chosen such as the object is to rotate no more than 5° per frame by no less than 0.1 °.
- a single camera captures each of the three frames during rotation of object 52 (schematically illustrated with three instances of the same camera a different angular positions about object 52) in other implementations, multiple cameras may be utilized.
- FIG. 7 and 8 after image preprocessing set forth in block 508 in Figure 5, edge detection, circle fitting another feature detection techniques are utilized to distinguish between distinct structures on the surface and within object 52, wherein the structures are further identified through the use of a predefined template for the object 52.
- controller 470 identifies wall 608, its nucleus 610 and internal points of interest, such as cell organs or organelles 612 in each of the frames (two of which are shown by Figures 7 and 8).
- controller 470 matches a centroid of a cell membrane, nucleus and organelles between consecutive frames, such as between frame 604A and 604B. Controller 470 further estimates a relative movement between the consecutive frames, reconstructs a centroid’s coordinates in three-dimensional space and then utilizes the reconstructed centroid coordinates to merge and align the centroid coordinates from all of the frames.
- the relationship for the relative movement parameters R and T is derived, assuming that the rotation axis is kept still, and the speed is constant all the time. Then, just the rotation speed is utilized to determine R and T
Landscapes
- Physics & Mathematics (AREA)
- Engineering & Computer Science (AREA)
- Chemical & Material Sciences (AREA)
- General Physics & Mathematics (AREA)
- Health & Medical Sciences (AREA)
- Life Sciences & Earth Sciences (AREA)
- Analytical Chemistry (AREA)
- Multimedia (AREA)
- Optics & Photonics (AREA)
- General Health & Medical Sciences (AREA)
- Biochemistry (AREA)
- Immunology (AREA)
- Pathology (AREA)
- Biomedical Technology (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Dispersion Chemistry (AREA)
- Theoretical Computer Science (AREA)
- Signal Processing (AREA)
- Biophysics (AREA)
- Hematology (AREA)
- Molecular Biology (AREA)
- Urology & Nephrology (AREA)
- Food Science & Technology (AREA)
- Medicinal Chemistry (AREA)
- Computer Graphics (AREA)
- Geometry (AREA)
- Software Systems (AREA)
- Investigating Or Analysing Materials By Optical Means (AREA)
- Microscoopes, Condenser (AREA)
Abstract
Description
Claims
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
PCT/US2018/030037 WO2019209347A1 (en) | 2018-04-27 | 2018-04-27 | Nonrotating nonuniform electric field object rotation |
Publications (2)
Publication Number | Publication Date |
---|---|
EP3756165A1 true EP3756165A1 (en) | 2020-12-30 |
EP3756165A4 EP3756165A4 (en) | 2021-10-13 |
Family
ID=68295712
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP18915955.1A Withdrawn EP3756165A4 (en) | 2018-04-27 | 2018-04-27 | Nonrotating nonuniform electric field object rotation |
Country Status (4)
Country | Link |
---|---|
US (1) | US20210033842A1 (en) |
EP (1) | EP3756165A4 (en) |
CN (1) | CN112005278A (en) |
WO (1) | WO2019209347A1 (en) |
Family Cites Families (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP1413911B1 (en) * | 2002-10-25 | 2004-12-22 | Evotec Technologies GmbH | Method and device for 3 dimensional imaging of suspended micro-objects providing high-resolution microscopy |
US20090268214A1 (en) * | 2006-05-26 | 2009-10-29 | Miljenko Lucic | Photogrammetric system and techniques for 3d acquisition |
US20120085649A1 (en) * | 2010-03-09 | 2012-04-12 | Virginia Tech Intellectual Properties, Inc. | Dielectrophoresis devices and methods therefor |
US20160044301A1 (en) * | 2014-08-06 | 2016-02-11 | Dejan JOVANOVICH | 3d modeling of imaged objects using camera position and pose to obtain accuracy with reduced processing requirements |
CN105184853B (en) * | 2015-08-14 | 2018-04-10 | 深圳大学 | A kind of unicellular three-dimensional image generating method based on optical flow analysis |
-
2018
- 2018-04-27 WO PCT/US2018/030037 patent/WO2019209347A1/en unknown
- 2018-04-27 CN CN201880092782.2A patent/CN112005278A/en active Pending
- 2018-04-27 US US16/606,239 patent/US20210033842A1/en active Pending
- 2018-04-27 EP EP18915955.1A patent/EP3756165A4/en not_active Withdrawn
Also Published As
Publication number | Publication date |
---|---|
CN112005278A (en) | 2020-11-27 |
WO2019209347A1 (en) | 2019-10-31 |
US20210033842A1 (en) | 2021-02-04 |
EP3756165A4 (en) | 2021-10-13 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
Fan et al. | Pothole detection based on disparity transformation and road surface modeling | |
Barnard | Interpreting perspective images | |
CN110096925B (en) | Enhancement method, acquisition method and device of facial expression image | |
EP3273412B1 (en) | Three-dimensional modelling method and device | |
Aloimonos et al. | Estimating the heading direction using normal flow | |
KR20200087757A (en) | Full convolutional point of interest detection and description through homographic adaptation | |
CN108399634B (en) | RGB-D data generation method and device based on cloud computing | |
CN105631859B (en) | Three-degree-of-freedom bionic stereo visual system | |
Huang et al. | Perspectivenet: 3d object detection from a single rgb image via perspective points | |
CN104077808A (en) | Real-time three-dimensional face modeling method used for computer graph and image processing and based on depth information | |
Feng et al. | 360 depth estimation in the wild-the depth360 dataset and the segfuse network | |
CN109658448A (en) | A kind of product introduction method and system based on body feeling interaction | |
Ma et al. | Stereo imaging of crystal growth | |
EP3756165A1 (en) | Nonrotating nonuniform electric field object rotation | |
Zhao et al. | Determination of the three-dimensional rate of cancer cell rotation in an optically-induced electrokinetics chip using an optical flow algorithm | |
US11481964B2 (en) | Three dimensional volume imaging | |
CN109859255B (en) | Multi-view non-simultaneous acquisition and reconstruction method for large-motion moving object | |
Harjoko et al. | Low-cost 3D surface reconstruction using Stereo camera for small object | |
Petkova et al. | 3D face reconstruction and verification using multi-view RGB-D data | |
CN110314714A (en) | A kind of cell activity state representation monitoring device and method based on 3-D image feature | |
TWI518442B (en) | Three-dimensional scanner | |
Dong et al. | A low-cost photorealistic CG dataset rendering pipeline for facial landmark localization | |
Yang et al. | Shape from shading-based study of silica fusion characterization problems | |
Gong et al. | Multi view 3D reconstruction method for weak texture objects based on" eye-in-hand" model | |
CN110060307B (en) | Method for calibrating parabolic catadioptric camera by utilizing opposite expansion relation of spherical projection |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE INTERNATIONAL PUBLICATION HAS BEEN MADE |
|
PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE |
|
17P | Request for examination filed |
Effective date: 20200923 |
|
AK | Designated contracting states |
Kind code of ref document: A1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
AX | Request for extension of the european patent |
Extension state: BA ME |
|
DAV | Request for validation of the european patent (deleted) | ||
DAX | Request for extension of the european patent (deleted) | ||
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R079 Free format text: PREVIOUS MAIN CLASS: G06T0017000000 Ipc: G02B0021320000 |
|
A4 | Supplementary search report drawn up and despatched |
Effective date: 20210909 |
|
RIC1 | Information provided on ipc code assigned before grant |
Ipc: G01N 15/10 20060101ALN20210903BHEP Ipc: G06T 7/55 20170101ALI20210903BHEP Ipc: G01N 15/14 20060101ALI20210903BHEP Ipc: G02B 21/36 20060101ALI20210903BHEP Ipc: G02B 21/32 20060101AFI20210903BHEP |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: EXAMINATION IS IN PROGRESS |
|
17Q | First examination report despatched |
Effective date: 20230504 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE APPLICATION IS DEEMED TO BE WITHDRAWN |
|
18D | Application deemed to be withdrawn |
Effective date: 20230915 |