US20170156598A9 - System and Method For Determining Modified States of Health of Living Tissue - Google Patents
System and Method For Determining Modified States of Health of Living Tissue Download PDFInfo
- Publication number
- US20170156598A9 US20170156598A9 US13/760,827 US201313760827A US2017156598A9 US 20170156598 A9 US20170156598 A9 US 20170156598A9 US 201313760827 A US201313760827 A US 201313760827A US 2017156598 A9 US2017156598 A9 US 2017156598A9
- Authority
- US
- United States
- Prior art keywords
- feature
- drug
- spectrogram
- response
- spectrograms
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 53
- 230000036541 health Effects 0.000 title description 4
- 239000003814 drug Substances 0.000 claims abstract description 102
- 229940079593 drug Drugs 0.000 claims abstract description 101
- 230000004044 response Effects 0.000 claims abstract description 93
- 239000013598 vector Substances 0.000 claims abstract description 70
- 239000011159 matrix material Substances 0.000 claims abstract description 62
- 230000006461 physiological response Effects 0.000 claims abstract description 23
- 230000001640 apoptogenic effect Effects 0.000 claims description 25
- 239000002547 new drug Substances 0.000 claims description 24
- 238000013459 approach Methods 0.000 claims description 18
- 238000010586 diagram Methods 0.000 claims description 13
- 238000007877 drug screening Methods 0.000 claims description 12
- 238000002922 simulated annealing Methods 0.000 claims description 3
- 230000004904 long-term response Effects 0.000 claims description 2
- 239000012528 membrane Substances 0.000 abstract description 15
- 230000009056 active transport Effects 0.000 abstract description 7
- 210000004027 cell Anatomy 0.000 description 33
- 210000001519 tissue Anatomy 0.000 description 30
- 206010028980 Neoplasm Diseases 0.000 description 24
- 230000033001 locomotion Effects 0.000 description 23
- 210000003463 organelle Anatomy 0.000 description 18
- 150000001875 compounds Chemical class 0.000 description 16
- 230000003595 spectral effect Effects 0.000 description 15
- 206010021143 Hypoxia Diseases 0.000 description 14
- 238000003384 imaging method Methods 0.000 description 14
- 230000032258 transport Effects 0.000 description 14
- 230000006907 apoptotic process Effects 0.000 description 13
- 230000001146 hypoxic effect Effects 0.000 description 13
- IAKHMKGGTNLKSZ-INIZCTEOSA-N (S)-colchicine Chemical compound C1([C@@H](NC(C)=O)CC2)=CC(=O)C(OC)=CC=C1C1=C2C=C(OC)C(OC)=C1OC IAKHMKGGTNLKSZ-INIZCTEOSA-N 0.000 description 12
- 230000002927 anti-mitotic effect Effects 0.000 description 12
- 230000002062 proliferating effect Effects 0.000 description 12
- KYRVNWMVYQXFEU-UHFFFAOYSA-N Nocodazole Chemical compound C1=C2NC(NC(=O)OC)=NC2=CC=C1C(=O)C1=CC=CS1 KYRVNWMVYQXFEU-UHFFFAOYSA-N 0.000 description 10
- 229950006344 nocodazole Drugs 0.000 description 10
- JVHIPYJQMFNCEK-UHFFFAOYSA-N cytochalasin Natural products N1C(=O)C2(C(C=CC(C)CC(C)CC=C3)OC(C)=O)C3C(O)C(=C)C(C)C2C1CC1=CC=CC=C1 JVHIPYJQMFNCEK-UHFFFAOYSA-N 0.000 description 9
- ZMAODHOXRBLOQO-UHFFFAOYSA-N cytochalasin-A Natural products N1C(=O)C23OC(=O)C=CC(=O)CCCC(C)CC=CC3C(O)C(=C)C(C)C2C1CC1=CC=CC=C1 ZMAODHOXRBLOQO-UHFFFAOYSA-N 0.000 description 9
- JDNTWHVOXJZDSN-UHFFFAOYSA-N iodoacetic acid Chemical compound OC(=O)CI JDNTWHVOXJZDSN-UHFFFAOYSA-N 0.000 description 9
- 230000008569 process Effects 0.000 description 9
- 230000001413 cellular effect Effects 0.000 description 8
- SDZRWUKZFQQKKV-JHADDHBZSA-N cytochalasin D Chemical compound C([C@H]1[C@@H]2[C@@H](C([C@@H](O)[C@H]\3[C@]2([C@@H](/C=C/[C@@](C)(O)C(=O)[C@@H](C)C/C=C/3)OC(C)=O)C(=O)N1)=C)C)C1=CC=CC=C1 SDZRWUKZFQQKKV-JHADDHBZSA-N 0.000 description 8
- 238000009792 diffusion process Methods 0.000 description 8
- 230000004899 motility Effects 0.000 description 8
- 238000004611 spectroscopical analysis Methods 0.000 description 8
- 230000000875 corresponding effect Effects 0.000 description 7
- 230000009120 phenotypic response Effects 0.000 description 7
- 229930012538 Paclitaxel Natural products 0.000 description 6
- 238000004458 analytical method Methods 0.000 description 6
- 229960001338 colchicine Drugs 0.000 description 6
- 230000003111 delayed effect Effects 0.000 description 6
- 230000007246 mechanism Effects 0.000 description 6
- 229960001592 paclitaxel Drugs 0.000 description 6
- RCINICONZNJXQF-MZXODVADSA-N taxol Chemical compound O([C@@H]1[C@@]2(C[C@@H](C(C)=C(C2(C)C)[C@H](C([C@]2(C)[C@@H](O)C[C@H]3OC[C@]3([C@H]21)OC(C)=O)=O)OC(=O)C)OC(=O)[C@H](O)[C@@H](NC(=O)C=1C=CC=CC=1)C=1C=CC=CC=1)O)C(=O)C1=CC=CC=C1 RCINICONZNJXQF-MZXODVADSA-N 0.000 description 6
- 238000002952 image-based readout Methods 0.000 description 5
- 210000003127 knee Anatomy 0.000 description 5
- 102000004243 Tubulin Human genes 0.000 description 4
- 108090000704 Tubulin Proteins 0.000 description 4
- 239000002246 antineoplastic agent Substances 0.000 description 4
- 229940041181 antineoplastic drug Drugs 0.000 description 4
- 230000006399 behavior Effects 0.000 description 4
- 230000008859 change Effects 0.000 description 4
- 238000009826 distribution Methods 0.000 description 4
- 238000002474 experimental method Methods 0.000 description 4
- 230000034659 glycolysis Effects 0.000 description 4
- 238000004264 monolayer culture Methods 0.000 description 4
- 230000003562 morphometric effect Effects 0.000 description 4
- 238000013425 morphometry Methods 0.000 description 4
- 230000009471 action Effects 0.000 description 3
- 230000005735 apoptotic response Effects 0.000 description 3
- 230000015572 biosynthetic process Effects 0.000 description 3
- 230000003247 decreasing effect Effects 0.000 description 3
- 230000001419 dependent effect Effects 0.000 description 3
- 238000002296 dynamic light scattering Methods 0.000 description 3
- 230000000694 effects Effects 0.000 description 3
- 230000007613 environmental effect Effects 0.000 description 3
- 230000014509 gene expression Effects 0.000 description 3
- 231100000652 hormesis Toxicity 0.000 description 3
- 230000003834 intracellular effect Effects 0.000 description 3
- 238000007491 morphometric analysis Methods 0.000 description 3
- 230000017074 necrotic cell death Effects 0.000 description 3
- 230000001338 necrotic effect Effects 0.000 description 3
- 238000010606 normalization Methods 0.000 description 3
- 230000003287 optical effect Effects 0.000 description 3
- 108090000623 proteins and genes Proteins 0.000 description 3
- 230000002829 reductive effect Effects 0.000 description 3
- 238000000926 separation method Methods 0.000 description 3
- 230000002123 temporal effect Effects 0.000 description 3
- 206010009944 Colon cancer Diseases 0.000 description 2
- 230000002378 acidificating effect Effects 0.000 description 2
- 238000000137 annealing Methods 0.000 description 2
- QVGXLLKOCUKJST-UHFFFAOYSA-N atomic oxygen Chemical compound [O] QVGXLLKOCUKJST-UHFFFAOYSA-N 0.000 description 2
- 238000005311 autocorrelation function Methods 0.000 description 2
- 238000004113 cell culture Methods 0.000 description 2
- 210000000170 cell membrane Anatomy 0.000 description 2
- 239000000470 constituent Substances 0.000 description 2
- 230000002596 correlated effect Effects 0.000 description 2
- YPHMISFOHDHNIV-FSZOTQKASA-N cycloheximide Chemical compound C1[C@@H](C)C[C@H](C)C(=O)[C@@H]1[C@H](O)CC1CC(=O)NC(=O)C1 YPHMISFOHDHNIV-FSZOTQKASA-N 0.000 description 2
- 230000003436 cytoskeletal effect Effects 0.000 description 2
- 230000007423 decrease Effects 0.000 description 2
- 230000028023 exocytosis Effects 0.000 description 2
- 238000001914 filtration Methods 0.000 description 2
- 230000006698 induction Effects 0.000 description 2
- 239000003112 inhibitor Substances 0.000 description 2
- 238000003064 k means clustering Methods 0.000 description 2
- 210000003470 mitochondria Anatomy 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 229910052760 oxygen Inorganic materials 0.000 description 2
- 239000001301 oxygen Substances 0.000 description 2
- 230000010363 phase shift Effects 0.000 description 2
- 230000035790 physiological processes and functions Effects 0.000 description 2
- 238000011002 quantification Methods 0.000 description 2
- 238000005070 sampling Methods 0.000 description 2
- 238000012216 screening Methods 0.000 description 2
- 230000035945 sensitivity Effects 0.000 description 2
- 230000006641 stabilisation Effects 0.000 description 2
- 238000011105 stabilization Methods 0.000 description 2
- 230000008961 swelling Effects 0.000 description 2
- PRDFBSVERLRRMY-UHFFFAOYSA-N 2'-(4-ethoxyphenyl)-5-(4-methylpiperazin-1-yl)-2,5'-bibenzimidazole Chemical compound C1=CC(OCC)=CC=C1C1=NC2=CC=C(C=3NC4=CC(=CC=C4N=3)N3CCN(C)CC3)C=C2N1 PRDFBSVERLRRMY-UHFFFAOYSA-N 0.000 description 1
- MCSXGCZMEPXKIW-UHFFFAOYSA-N 3-hydroxy-4-[(4-methyl-2-nitrophenyl)diazenyl]-N-(3-nitrophenyl)naphthalene-2-carboxamide Chemical compound Cc1ccc(N=Nc2c(O)c(cc3ccccc23)C(=O)Nc2cccc(c2)[N+]([O-])=O)c(c1)[N+]([O-])=O MCSXGCZMEPXKIW-UHFFFAOYSA-N 0.000 description 1
- 102000007469 Actins Human genes 0.000 description 1
- 108010085238 Actins Proteins 0.000 description 1
- BMZRVOVNUMQTIN-UHFFFAOYSA-N Carbonyl Cyanide para-Trifluoromethoxyphenylhydrazone Chemical compound FC(F)(F)OC1=CC=C(NN=C(C#N)C#N)C=C1 BMZRVOVNUMQTIN-UHFFFAOYSA-N 0.000 description 1
- 102000004127 Cytokines Human genes 0.000 description 1
- 108090000695 Cytokines Proteins 0.000 description 1
- 108090000790 Enzymes Proteins 0.000 description 1
- 102000004190 Enzymes Human genes 0.000 description 1
- 206010027476 Metastases Diseases 0.000 description 1
- 208000007571 Ovarian Epithelial Carcinoma Diseases 0.000 description 1
- 206010033128 Ovarian cancer Diseases 0.000 description 1
- ULHRKLSNHXXJLO-UHFFFAOYSA-L Yo-Pro-1 Chemical compound [I-].[I-].C1=CC=C2C(C=C3N(C4=CC=CC=C4O3)C)=CC=[N+](CCC[N+](C)(C)C)C2=C1 ULHRKLSNHXXJLO-UHFFFAOYSA-L 0.000 description 1
- 208000009956 adenocarcinoma Diseases 0.000 description 1
- 230000004075 alteration Effects 0.000 description 1
- 238000010171 animal model Methods 0.000 description 1
- 239000003080 antimitotic agent Substances 0.000 description 1
- 230000008901 benefit Effects 0.000 description 1
- 239000003560 cancer drug Substances 0.000 description 1
- 230000015556 catabolic process Effects 0.000 description 1
- 230000032823 cell division Effects 0.000 description 1
- 230000009087 cell motility Effects 0.000 description 1
- 230000001427 coherent effect Effects 0.000 description 1
- 208000029742 colonic neoplasm Diseases 0.000 description 1
- 230000000052 comparative effect Effects 0.000 description 1
- 238000004624 confocal microscopy Methods 0.000 description 1
- 230000009193 crawling Effects 0.000 description 1
- 210000000805 cytoplasm Anatomy 0.000 description 1
- 230000021040 cytoplasmic transport Effects 0.000 description 1
- 210000004292 cytoskeleton Anatomy 0.000 description 1
- 238000013144 data compression Methods 0.000 description 1
- 238000000354 decomposition reaction Methods 0.000 description 1
- 238000006731 degradation reaction Methods 0.000 description 1
- 230000000368 destabilizing effect Effects 0.000 description 1
- 230000001066 destructive effect Effects 0.000 description 1
- 238000001514 detection method Methods 0.000 description 1
- 230000004069 differentiation Effects 0.000 description 1
- 201000010099 disease Diseases 0.000 description 1
- 208000037265 diseases, disorders, signs and symptoms Diseases 0.000 description 1
- 238000007876 drug discovery Methods 0.000 description 1
- 239000000975 dye Substances 0.000 description 1
- 238000001962 electrophoresis Methods 0.000 description 1
- 230000008030 elimination Effects 0.000 description 1
- 238000003379 elimination reaction Methods 0.000 description 1
- 230000012202 endocytosis Effects 0.000 description 1
- 238000002924 energy minimization method Methods 0.000 description 1
- 230000007705 epithelial mesenchymal transition Effects 0.000 description 1
- 238000000605 extraction Methods 0.000 description 1
- 238000013467 fragmentation Methods 0.000 description 1
- 238000006062 fragmentation reaction Methods 0.000 description 1
- 230000002068 genetic effect Effects 0.000 description 1
- 239000001963 growth medium Substances 0.000 description 1
- 206010073071 hepatocellular carcinoma Diseases 0.000 description 1
- 231100000844 hepatocellular carcinoma Toxicity 0.000 description 1
- 230000007954 hypoxia Effects 0.000 description 1
- 238000007654 immersion Methods 0.000 description 1
- 238000000338 in vitro Methods 0.000 description 1
- 230000005764 inhibitory process Effects 0.000 description 1
- 238000007689 inspection Methods 0.000 description 1
- 238000005305 interferometry Methods 0.000 description 1
- 238000012804 iterative process Methods 0.000 description 1
- 230000002147 killing effect Effects 0.000 description 1
- 238000002372 labelling Methods 0.000 description 1
- 150000002611 lead compounds Chemical class 0.000 description 1
- 230000014759 maintenance of location Effects 0.000 description 1
- 238000013507 mapping Methods 0.000 description 1
- 230000002503 metabolic effect Effects 0.000 description 1
- 230000009401 metastasis Effects 0.000 description 1
- 230000001394 metastastic effect Effects 0.000 description 1
- 206010061289 metastatic neoplasm Diseases 0.000 description 1
- 238000000386 microscopy Methods 0.000 description 1
- 230000002438 mitochondrial effect Effects 0.000 description 1
- 230000000394 mitotic effect Effects 0.000 description 1
- 239000000203 mixture Substances 0.000 description 1
- 238000009126 molecular therapy Methods 0.000 description 1
- 238000012544 monitoring process Methods 0.000 description 1
- 239000013642 negative control Substances 0.000 description 1
- 210000004940 nucleus Anatomy 0.000 description 1
- 231100000590 oncogenic Toxicity 0.000 description 1
- 230000002246 oncogenic effect Effects 0.000 description 1
- 238000012014 optical coherence tomography Methods 0.000 description 1
- 230000037361 pathway Effects 0.000 description 1
- 238000003909 pattern recognition Methods 0.000 description 1
- 230000035515 penetration Effects 0.000 description 1
- 238000005325 percolation Methods 0.000 description 1
- 230000004962 physiological condition Effects 0.000 description 1
- 238000006116 polymerization reaction Methods 0.000 description 1
- 238000000513 principal component analysis Methods 0.000 description 1
- 230000035755 proliferation Effects 0.000 description 1
- 230000001737 promoting effect Effects 0.000 description 1
- XJMOSONTPMZWPB-UHFFFAOYSA-M propidium iodide Chemical compound [I-].[I-].C12=CC(N)=CC=C2C2=CC=C(N)C=C2[N+](CCC[N+](C)(CC)CC)=C1C1=CC=CC=C1 XJMOSONTPMZWPB-UHFFFAOYSA-M 0.000 description 1
- 102000004169 proteins and genes Human genes 0.000 description 1
- 230000008707 rearrangement Effects 0.000 description 1
- 230000000717 retained effect Effects 0.000 description 1
- 238000012552 review Methods 0.000 description 1
- 238000005204 segregation Methods 0.000 description 1
- 230000019491 signal transduction Effects 0.000 description 1
- 239000002356 single layer Substances 0.000 description 1
- 238000001228 spectrum Methods 0.000 description 1
- 230000000087 stabilizing effect Effects 0.000 description 1
- 230000001629 suppression Effects 0.000 description 1
- 230000004083 survival effect Effects 0.000 description 1
- 230000009897 systematic effect Effects 0.000 description 1
- 238000012360 testing method Methods 0.000 description 1
- 238000002560 therapeutic procedure Methods 0.000 description 1
- 239000003053 toxin Substances 0.000 description 1
- 231100000765 toxin Toxicity 0.000 description 1
- 210000004881 tumor cell Anatomy 0.000 description 1
- 238000010200 validation analysis Methods 0.000 description 1
- 230000028973 vesicle-mediated transport Effects 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
- XLYOFNOQVPJJNP-UHFFFAOYSA-N water Substances O XLYOFNOQVPJJNP-UHFFFAOYSA-N 0.000 description 1
- 230000003313 weakening effect Effects 0.000 description 1
Images
Classifications
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/0059—Measuring for diagnostic purposes; Identification of persons using light, e.g. diagnosis by transillumination, diascopy, fluorescence
- A61B5/0075—Measuring for diagnostic purposes; Identification of persons using light, e.g. diagnosis by transillumination, diascopy, fluorescence by spectroscopy, i.e. measuring spectra, e.g. Raman spectroscopy, infrared absorption spectroscopy
-
- G—PHYSICS
- G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
- G03H—HOLOGRAPHIC PROCESSES OR APPARATUS
- G03H1/00—Holographic processes or apparatus using light, infrared or ultraviolet waves for obtaining holograms or for obtaining an image from them; Details peculiar thereto
- G03H1/04—Processes or apparatus for producing holograms
- G03H1/0443—Digital holography, i.e. recording holograms with digital recording means
-
- G—PHYSICS
- G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
- G03H—HOLOGRAPHIC PROCESSES OR APPARATUS
- G03H1/00—Holographic processes or apparatus using light, infrared or ultraviolet waves for obtaining holograms or for obtaining an image from them; Details peculiar thereto
- G03H1/04—Processes or apparatus for producing holograms
- G03H1/08—Synthesising holograms, i.e. holograms synthesized from objects or objects from holograms
-
- G—PHYSICS
- G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
- G03H—HOLOGRAPHIC PROCESSES OR APPARATUS
- G03H2210/00—Object characteristics
- G03H2210/62—Moving object
Definitions
- the present disclosure relates generally to the assessment of the health of living tissue and the profiling of the phenotypic response of tissue to perturbations, both environmental and pharmaceutical.
- HCS Biochemical target-based high-content screening
- Phenotypic profiling presents a systems-biology approach that has more biological relevance by capturing multimodal influence of therapeutics.
- phenotypic profiling predates genomics that provided isolated targets, it remains today one of the most successful approaches for the discovery of new drugs.
- Imaging form An alternative approach to imaging form is to image function, and in particular functional motions.
- Motion is ubiquitous in all living things and occurs across broad spatial and temporal scales. At one extreme, motions of molecules during Brownian diffusion occur across nanometers at microsecond scales, while at the other extreme motions of metastatic crawling cells occur across millimeters taking many hours.
- Imaging motion in three-dimensional tissue is simpler than imaging structure or performing molecular imaging, because motion modulates coherent light through phase modulation.
- the phase of the light is modified. If the light has coherence, then the motion-induced phase shifts of one light path interfere with the phase shifts of other light paths in constructive and destructive interference. Even light that is multiply scattered in tissue carries a record of the different types of motions that the light encountered.
- the fluctuating phase of light scattered from living tissue By measuring the fluctuating phase of light scattered from living tissue, the different types of motion across the different space and time scales can be measured.
- the trade-off for greater depth of penetration into three-dimensional tissue is reduced spatial imaging resolution. But volumetric imaging of intracellular motions in tissue is still possible, within limits, by using low-coherence interferometry that can select light from specified depths by using coherence-gating approaches [17].
- the 2D imaging techniques have been applied to drug screening and in particular to evaluating efficacy of a drug in disease treatment, such as anticancer drugs.
- Traditional 2D techniques can lead to false positives when a drug is more effective in 2D than in 3D, resulting in promising early drug leads that fail in animal models because the drug is more effective at killing tumor cells grown as monolayer cultures than as cells within multicellular tissues.
- An even greater impact is the false negative in drug screening in which a drug that would otherwise be effective in 3D yields a negative result at the 2D screening stage, thereby leading to the elimination of the drug.
- the end result of false positives and false negatives is that new drug discovery halves every nine years (in contrast to Moore's Law of the electronics industry in which chip capacity doubles every 18 months).
- Phenotypic profiling can provide a significant advance in drug screening when based on 3D cultures. What is needed is a system and method for extracting high-content phenotypic responses from inside heterogeneous tissue and for accurately and meaningfully analyzing the resulting information to build a phenotype database to improve the efficiency of future drug screening.
- the present system and method relies upon feature recognition to segment the information in time-frequency tissue-response spectrograms to construct N-dimensional feature vectors.
- the feature vectors are used to generate a correlation matrix among a large number of different stimuli in the form of drugs, doses and conditions.
- Multi-dimensional scaling is applied to the correlation matrix to form a two-dimensional map of response relationships that retains rank distances from the higher-dimensionality feature matrix.
- the two-dimensional phenotypic profile space displays compact regions indicative of particular physiological responses, such as regions of enhanced active transport, membrane undulations and blebbing.
- the feature vectors can be used to generate feature masks against which new drugs and drug responses can be compared.
- a library of feature masks can be maintained and applied to the spectrogram of a new drug to find a corollary drug in the library that produces a similar physiological response.
- FIG. 1 includes motility contrast images of three nominal tumors, namely a fully proliferating tumor and tumors with a hypoxic and a necrotic core.
- FIG. 2 includes the spectrograms for 28 different stimuli, namely drugs, doses and conditions.
- FIGS. 3 a , 3 b and 3 c are similarity matrices for, respectively, shell-shell, core-core and shell-core correlations of the spectrograms of FIG. 2
- FIG. 4 is a clustered similarity matrix for the combination core and shell responses to 56 stimuli.
- FIG. 5 is a map of spectral frequency responses corresponding to certain physiological responses of the tumor.
- FIG. 6 is a graph of characteristic frequency (temporal scale) in relation to size (spatial scale) for certain physiological responses obtained from prior studies.
- FIG. 7 includes feature masks generated from the feature vector of stimuli pH 9 obtained from the spectrogram of FIG. 2 .
- FIG. 8 a is a spectrogram for a particular feature illustrating a frequency knee characteristic.
- FIG. 8 b is a plot of zero-crossings isolated from the spectrogram of FIG. 8 a showing he knee frequency.
- FIGS. 9 a and 9 b are graphs corresponding to a morphometric analysis in which FIG. 9 a is the raw differential spectrogram and FIG. 9 b is the raw spectrogram modified according to a morphometric algorithm.
- FIG. 10 shows a feature vector obtained from a spectrogram for the stimuli pH 9.
- FIG. 11 a is a spectrogram of feature vectors for 28 stimuli.
- FIG. 11 b is a similarity matrix for the feature vector spectrogram of FIG. 11 a.
- FIG. 12 a is a spectrogram of feature vectors for 28 stimuli after unsupervised hierarchical clustering.
- FIG. 12 b is a similarity matrix for the feature vector spectrogram of FIG. 12 a.
- FIG. 13 is a network diagram of illustrating strong similarities among multiple stimuli.
- FIG. 14 is a Venn diagram generated by multi-dimensional scaling of the spectrogram of FIG. 12 .
- FIG. 15 is a diagram showing trajectories of pH and osmolarity in a MDS space of several Raf inhibitors acting on adenocarcinomas DLD-1 and HT-29.
- FIG. 16 includes spectrograms of a proliferating shell and hypoxic core of a tumor responding to particular stimuli, namely cytochalasin D at 50 ⁇ g/ml.
- FIG. 17 a is a graph of apoptotic indexes for the shell and core of a tumor responding to eight stimuli.
- FIG. 17 b is graph comparing data for three stimuli obtained from the tissue dynamic spectroscopy described herein and prior art data.
- FIG. 18 is a graph of entropy data for fourteen feature vectors.
- FIGS. 19 a and 19 b are maps of two-variable joint and mutual entropies for the fourteen feature vectors shown in FIG. 18 .
- FIG. 20 shows a feature vector and hierarchical clustering similarity matrix for 144 different stimuli.
- FIG. 21 is a graph of joint entropy for 170 drugs/doses/conditions including separate shell and core responses.
- the present invention determines the internal health of living tissue by defining and monitoring internal states of health based on motility spectrograms that are used to classify phenotypic response of tissue to perturbations.
- the systems and methods of present disclosure utilize motility contrast imaging to map and evaluate cellular activity.
- the imaging may be performed using the optical configuration disclosed in co-pending application Ser. No. 13/704,438, which is based on published PCT application WO 2011/160064 (the '064 Publication), or as disclosed in co-pending application Ser. No.
- the '064 Publication further describes the use of motility contrast imaging (MCI) to produce spectrogram responses of cell compounds.
- MCI motility contrast imaging
- the '064 Publication describes extracting a spectrogram fingerprint of a differential response of a tissue sample in which a drug has been administered.
- the motility contrast images of several nominal tumors are shown in
- the core can be strong proliferating (on the left) or strongly hypoxic (on the right), depending on the pre-condition of the tumor spheroids.
- hypoxic it is ATP depleted and responds differently to stimuli, such as drugs or changing environmental conditions, than a healthy shell that has normal ATP levels.
- a power spectrum in the frequency domain can be determined and more particularly changes in the power spectral density as a function of time through the shift in characteristic parameters are evaluated.
- the result is a differential spectrogram, such as the spectrograms shown in FIG. 2 , which plots the differential relative spectral density for a given frequency at a time t relative to the initial time t 0 .
- This differential spectrogram thus captures the changes in spectral content as a function of time after a dose, condition or other stimuli (or combination of stimuli) are applied to the target 3D body.
- the differential spectrogram is sensitive to shifts in the magnitudes of the spectral densities (dependent upon the number of moving constituents) and to shifts in the characteristic frequencies (i.e., the speed of the moving constituents).
- the spectrograms for these drugs/stimuli are complex, showing many different types of features in response to the applied drugs. Similar drugs produced similar spectrograms, while widely differing spectrograms could be elicited from drugs with very different mechanisms of action.
- the spectrograms of the 28 different drugs/doses/conditions, separated by shell (top) and core (bottom), are shown in FIG. 2 . For each spectrogram, frequency is along the vertical axis from 0.005 Hz to 5 Hz, while time is plotted along the horizontal axis corresponding to a duration of 6 hours after the dose or stimuli is applied. In the spectrograms of FIG.
- a cross-correlation coefficient between spectrograms is calculated, as specified by:
- S (x) (v,t) is the spectrogram of drug/condition x
- S (y) (v,t) is the spectrogram of drug/condition y and the sum is over both frequency and time.
- the correlation coefficient was calculated among the 28 conditions, treating the proliferating shell and the core of the tumor spheroid separately.
- a similarity matrix provides the basis for a hierarchical clustering algorithm that can group different stimuli by their similar drug-response spectrograms.
- Each row of the N ⁇ N similarity matrix is an N-dimensional vector (where N corresponds to the number of compounds, doses and conditions applied to the tumor spheroid).
- the inner product of each row defines a measure of distance:
- Inner products near unity correspond to “close” associations between stimuli
- inner products near negative unity correspond to “far” associations
- the stimuli given in Table I can be grouped according to the hierarchical clustering of the drug responses based on the spectrograms of the proliferating shell.
- a hierarchical clustering algorithm at each stage the two closest vectors are identified and grouped into an average vector, and then the number of vectors decreases by one. The sequence of the vectors that are grouped in this way are retained until all vectors have been grouped. The sequential grouping of vectors produces a clustering of similar drug responses.
- the similarity matrix can be rearranged according to the sequence of grouping according to the shell-shell correlations with the result shown in upper left matrix of FIG. 3 a .
- the similarity matrix shows structure with an approximately “block diagonal” appearance.
- the clustering would consist of groups of unique behaviors with no correlation between stimuli.
- the drug responses there is considerable off-diagonal structure, which indicates that different groups of drug responses do share some aspects in common. Nevertheless, the drug response groupings exhibit “themes” of similar behavior.
- many of the anti-mitotic drugs such as Nocodazole, Colchicine and Taxol, cluster in the bottom right of the figure, the cytochalasin and hypotonic osmolarity results are approximately in the middle, and the metabolic and hypertonic osmolarity responses are at the upper left.
- each drug response can be referenced to its own EC50, which would remove the dose dependence in the clustering.
- Multicellular tumor spheroids have different conditions for the proliferating shell relative to the core, which tends to be hypoxic and ATP depleted. Furthermore, large tumors (larger than 500 micron diameter) have increasingly necrotic cores. Tissue dynamics spectroscopy is volumetric (depth-gated) so the response of the (deeper) core can be compared to the different response of the (shallower) shell.
- the core-core correlations are shown in the lower right FIG. 3 b for the same ordering as for the clustered data using the shell-shell correlations. There are many similarities in the core-core correlations, but with notable differences, and with several of the shell-shell blocks missing, such as the blocks in the upper right of the shell-shell matrix of FIG. 3 a .
- FIG. 3 c shows the correlation of the shell spectrograms with the core spectrograms.
- the diagonal elements of this similarity matrix are not all near unity, showing significant differences in the response of the core relative to the shell, even responding in the same tumor to the same conditions.
- the 28 conditions can be doubled to 56 conditions, which can be cross-correlated into a similarity matrix and clustered according to all 56 conditions.
- the resulting clustered similarity matrix is shown in FIG. 4 .
- the stimuli applied to the core are so designated and the stimuli applied to the shell carry no separate identifier.
- Many of the shell and core spectrograms are clustered together (highly similar), but there are many other pairs that are separated in the clustering process because their respective spectrograms are not highly similar. This is likely a consequence of the ATP-depleted conditions of the core relative to the proliferating shell.
- an apoptotic response requires normal ATP concentrations and can occur in the shell, while the cells in the core would be forced to follow a necrotic path.
- This difference between apoptosis and necrosis based on ATP concentrations may be one of the differentiators between the spectrograms of the shell relative to the core.
- a more systematic study of these differences between the shell and the core may uncover specific spectrogram signatures for processes like apoptosis.
- TDS tissue dynamics spectroscopy
- the intermediate Region G in green represents little or no change in spectral content.
- the response occurs in approximately three frequency bands that show distinctly different behavior: low-frequency (0.005 Hz to 0.1 Hz), mid-frequency (0.1 Hz to 1 Hz) and high-frequency (1 Hz to 5 Hz).
- the proliferating shell shows enhancements in the third frequency band after about an hour, while the core shows nearly an opposite response. At low frequencies, the shell is mostly unchanged until a strong onset at a much later time, while the core shows enhanced low frequencies for most of the duration of the experiment.
- the velocity range is well within the range of intracellular motion in which molecular motors move organelles at speeds of microns per second [18-22]. Diffusion of very small organelles, as well as molecular diffusion, are too fast to be resolved by an expected maximum frame rate of 10 fps.
- Membrane undulations are a common feature of cellular motions, leading to the phenomenon of flicker [23-27]. The characteristic frequency for membrane undulations tends to be in the range around 0.01 to 0.1 Hz [21, 24, 28, 29]. Results from the literature are summarized in FIG. 6 .
- the graph captures the general connection of spatial scale with temporal scale.
- the features used in the feature mask relate to a position in time and frequency on the spectrogram. For instance, a membrane undulation response is a mid-frequency response, while an organelle response is a high frequency response. Cell shape changes are low frequency. A hormetic response is a combined high/low frequency shift that occurs immediately upon application of the drug, but then decays quickly. All drug/condition spectrograms can be analyzed in terms of these features.
- the drug-response spectrograms exhibit recognizable features that occur in characteristic frequency ranges at characteristic times after a dose is applied.
- Two approaches are applied to feature recognition and quantification of the drug-response spectrograms.
- One approach is based on projections of the spectrograms onto feature masks.
- feature masks such as binary masks versus continuous-valued masks, local masks versus global masks, and orthonormal feature masks versus non-orthonormal.
- the time axis on the spectrograms primarily captures relaxation which is typically exponential.
- the frequency axis is the Fourier transform of the autocorrelation function, which also is typically exponentially correlated.
- both the time and frequency axes are characterized by Laplace transforms for which there is no orthonormal basis. Therefore, an approach of matched filtering [30] can be used in which characteristic regions of the spectrograms can be interpreted mechanistically. For instance, it has been shown that low frequencies correspond to large-scale motion like blebbing or the formation of apoptotic bodies, while high frequencies correspond to membrane vesicles or internal organelle motions. [31] These processes and frequencies present natural frequency ranges within the data that are used to generate feature masks to extract these specific features.
- Masks M 1 -M 3 capture the average spectral power change
- masks M 4 -M 6 capture low-frequency
- masks M 7 -M 9 measure the shift of the spectral weight to higher frequencies
- masks M 10 -M 12 capture high frequency motions
- masks M 13 -M 15 capture enhanced mid frequencies.
- overlaying a particular drug/dose spectrogram onto each of feature masks can reveal the expected response for the drug based on the feature mask or masks that generally correspond to the spectrogram.
- overlaying the spectrogram of FIG. 5 onto the feature masks of FIG. 7 shows a general correspondence with mask M 6 indicative of large scale motion of the cell and with M 8 indicative of organelle transport that starts at a later time.
- time-frequency feature mask approach is the choice of frequency cutoffs for the different features. For instance, it is clear by assessing many of the spectrograms that there is a typical frequency knee, or edge, around 0.1 Hz. This frequency would be a natural frequency to define the boundary of a feature mask. To precisely establish this frequency, a level-set algorithm can be applied to an ensemble of many spectrograms from the same cell line responding to many different types of drugs. The level is set to the zero-crossings of the spectrogram. These zero-crossings are isolated in each of the spectrograms and then averaged. The result is shown in FIGS. 8( a )-8( b ) .
- the second approach to feature extraction of spectrogram features is based on morphometric analysis. This analysis is based on the overall shape and position of certain features.
- the spectrogram in FIG. 9 a is the raw differential spectrogram. This is used as the starting point of a morphometric algorithm that seeks broad areas of common response.
- the algorithm is based on percolation cluster labeling combined with level sets.
- the resulting identified regions are shown in FIG. 9 b .
- This morphometric approach can lead to feature vectors that are similar, while the more rigid approach to feature recognition described above might create feature vectors that are not highly similar because of frequency shifts between the two spectrograms. Therefore, the morphometric approach is considered to provide more robust comparisons of qualitatively similar features and hence more stable clustering results based on these feature vectors.
- each feature in the feature masks can be assigned a numerical value related to the strength and sign of the response for that feature in a particular spectrogram.
- the collection of feature values constitutes a feature vector. Therefore, each spectrogram has an associated feature vector.
- the value of a feature is obtained by the inner product of the k-th feature mask M k (v,t) with the j-th differential spectrogram D j (v,t)
- V k j D j ( v,t ), M k ( v,t )
- N norm ⁇ p , q ⁇ M pq ⁇ M pq ⁇ ⁇ i , j ⁇ D pq ⁇ D pq
- D pq is taken only in the associated time region of the mask. This normalization captures the shape of features, but de-emphasizes the magnitude. This procedure is well suited to recognizing signature features and for clustering drug responses according to their features rather than the strength of their response.
- FIG. 10 An example of a feature vector is shown in FIG. 10 associated with a spectrogram for pH 9.
- a collection of feature vectors for each of the 28 stimuli/conditions is shown in FIG. 11 a.
- Each feature vector is like an N-dimensional vector.
- each drug or condition has a 10-dimensional vector that captures ten features of the spectrograms.
- the key features include transparency, membrane/contacts, undulations, expansion, organelle transport, delayed membrane, delayed undulations, delayed expansion, delayed organelle transport and hormetic response.
- the strength of the responses are color-coded from red for a strong positive response to blue for a strong negative response.
- the similarity between two feature vectors for two different spectrograms is obtained as the inner, or dot, product between the two vectors. After the feature vectors are generated as shown in FIG. 11 a , they are used to generate a similarity matrix among all the different drugs and conditions.
- the similarity of the i-th and j-th spectrogram is defined as the normalized correlation:
- FIGS. 11 a - b The feature vectors V k j and the similarity matrix S ij for the 28 doses and conditions of Table I above, plus two negative controls, are shown in FIGS. 11 a - b.
- the proliferating shell and the core are treated independently, leading to 60 feature vectors and a 60 ⁇ 60 similarity matrix.
- the similarity matrix in the present example is shown in FIG. 11 b and is unity along the main diagonal.
- the ordering in FIG. 11 b is by drug and dose, with the shell alternating with the core. While there is some clustering of similarities, the similarity matrix and feature vectors do not show strong clustering, except for the tubulin destabilizing compounds that share many features in common.
- FIG. 12 a - 12 b The similarity matrix and feature vectors after unsupervised hierarchical clustering according to “distance” are shown in FIG. 12 a - 12 b.
- the “non-clustered” similarity matrix of FIG. 11 b With the matrix of FIG. 12 b it can be seen that the latter similarity matrix is nearly block-diagonal in which similar spectrograms are grouped together, with low cross-talk among the groups.
- the feature vectors are also grouped in FIG. 12 a , showing groups of spectrograms that share features in common.
- the selected features have putative physiological interpretations (such as blebbing, undulations and organelle motions)[31], so the groupings of features also group the physiological responses into a phenotypic profile for these standard compounds and conditions.
- the clustered similarity matrix of FIG. 12 b is higher in information content than the similarity matrix of FIG. 11 b , and therefore more useful in screening a new drug.
- the spectrogram of a new drug/dose/stimuli can be reduced to a feature vector, as explained above, and then combined with feature vectors of known drug/dose/stimuli, in the manner of the feature vector matrix of FIG. 11 a , and ultimately incorporated into a similarity matrix, such as the matrix of FIG. 11 b .
- a clustered similarity matrix such as the matrix of FIG. 12 b can be used to identify the group in which the new drug/dose/stimuli resides.
- the new drug can then be expected to produce the physiological responses of that group.
- Hierarchical clustering produces a linear arrangement that does not faithfully represent distance between nodes (in which a node corresponds to a drug/dose/stimuli).
- it is an ordering algorithm rather than a clustering algorithm.
- a k-means clustering and level-set clustering can be applied on the raw similarity matrix in FIG. 4 .
- the resulting ordering of the drugs and conditions change in detail, but the overall groupings and block-diagonal structure of the reordered similarity matrix remain nearly the same with respect to the similarity matrix shown in FIG. 12 b .
- none of these ordering or clustering algorithms faithfully represent the distance relationships that are contained within the original similarity matrix.
- subclusters are combined into larger clusters, especially in hierarchical clustering, it is possible to have two adjacent nodes that have very low similarity and hence should be far apart.
- the final ordering is linear, and distance relationships are not represented.
- the groups of clustered cases can be converted to a network diagram, as shown in FIG. 13 .
- Each numbered node represents a particular stimuli (i.e., compound, drug or condition). Strong similarity is denoted by a line connecting two nodes. Close proximity of nodes signifies similar phenotypic response.
- the network diagram of FIG. 13 provides a clear visual indication of groupings according to phenotypic response that can be useful in drug screening.
- MDS multidimensional scaling
- a low-dimensional representation is sought in which similar response nodes are placed close to one another and dissimilar response nodes are placed far apart.
- the spatial near-far relationships in a low-dimensional graph preserve the high-dimensional near-far relationships of the original feature vectors.
- Multidimensional scaling is not a “projection” to a lower dimensional plane, but is instead a one-to-one mapping that retains ordering of distances. As with all data compression the actual metric distances are lost in the process; however, the general relationships of nearness or similarity are preserved.
- the MDS algorithm assigns a cost function that is to be minimized.
- the cost function is the difference between the distance of the two-dimensional location of nodes and the distance defined from the similarity matrix.
- the cost function is:
- the simulated annealing proceeds through 1000 iterations, with a 0.1% decrease in effective temperature at each iteration.
- the final positions that emerge from the MDS algorithm appear in the low-dimensional space in a pattern that preserves the trend of distances d ij from the high-dimensional space spanned by the feature vectors.
- FIG. 14 The results of multidimensional scaling of the data in FIG. 12 are shown in FIG. 14 .
- This low-dimensional phenotypic space has two dimensions. The axes do not have direct physical meaning, but the distribution of nodes retains the ordering of distances that occur in the similarity matrix of FIG. 12 . Similar drug responses are grouped closely, and far from other unrelated drug responses. Because of this spatial grouping and separation, it is possible to draw a Venn diagram based on the physiological features in the feature vectors.
- the Venn diagram of FIG. 14 shows the drug responses with enhanced mid-frequency (membrane undulations), enhanced low frequency (shape changes and blebbing) and enhanced high frequency/active (vesicle and organelle transport).
- the network connections drawn on the figure are from k-means clustering and show local clusters.
- the dashed line shows a separation between core response (outside the line) and shell response (inside the line).
- shell response inside the line.
- An interesting region is the overlap between blebbing and active organelle/vesicle transport. Taken together, these may be expected if there is apoptosis during which apoptotic bodies are separated from the main cell, and active organelle transport drives the cellular decomposition. There are no drug responses in this overlap region from the hypoxic core which is ATP depleted and cannot support apoptosis.
- the information content of the map of FIG. 14 far exceeds the content of the original similarity matrix of FIG. 4 .
- the map resulting from the multidimensional scaling can be easily used to identify similar physiological responses among drugs and more importantly to identify expected physiological responses of new drugs being screened. It can be appreciated that the all of the steps leading from the original spectrogram for a new drug to the map of FIG. 14 can be performed with software.
- multicellular tumor spheroids provide a natural format to study phenotypic differences in the drug response between normoxic and hypoxic tissue.
- tumor spheroids have a diameter larger than approximately 400 microns, the transport of oxygen into the core of the spheroid is impeded, resulting in hypoxic tissue and a band of quiescent cells inside the outer shell of proliferating cells.
- the phenomenon of multicellular resistance to anticancer drugs displayed by avascular solid tumors is caused, in part, by the population of quiescent cells.
- hypoxia is a factor in oncogenic progression [38, 39] and may participate in the epithelial to mesenchymal transition that ultimately leads to metastasis. [40-43] For these reasons, comparing the effect of anticancer drugs on the hypoxic core relative to the quiescent or proliferating shells may shed light on multicellular resistance.
- FIG. 16 An understanding of the shell-core differences can be gained by analyzing the shell and core spectrograms responding to cytochalasin D at 50 ⁇ g/ml shown in FIG. 16 .
- the core spectrogram at the bottom of FIG. 16 shows an initially strong mid-frequency enhancement (shortly after time 0) caused by the weakening of the actin cortex that reduces the stiffness of the cell membrane. After two hours, there is a strong onset of low-frequency enhancement for both the shell and the core.
- the shell shown in the top spectrogram in FIG. 16 , shows a strong enhancement of the high-frequencies (starting just before two hours) associated with vesicle and organelle transport that is missing in the core spectrogram response.
- This index is constructed from the feature masks appropriate to the low- and high-frequency features, which are masks M 6 and M 12 of FIG. 7 .
- the apoptotic index can be defined by:
- V 6 i and V 12 i are the feature vector values for masks M 6 and M 12 (determined as discussed above).
- the difference between the real and the imaginary parts generates the logical AND with positive apoptotic indexes only for features that themselves are both positive.
- the apoptotic index was calculated for the shell and the core spectrograms and ranked in decreasing order by the shell.
- the apoptotic index of the shell response for the top eight apoptotic indexes is shown in FIG. 17 a above the zero line.
- the strongest apoptotic index is for the shell responding to cytochalasin at 50 ⁇ g/ml.
- Also shown in FIG. 17 a below the zero line are the corresponding apoptotic indexes for the core responses in each case.
- the apoptotic index of the cores are all negative.
- the core is missing one or the other of these features. Upon closer inspection, the missing feature is the active transport band at high frequency in all cases.
- the key physiological aspect of the core is the lack of ATP to drive active processes, such as the formation of sequestering vesicles and apoptotic bodies.
- the negative apoptotic indexes of the core region for each of these drugs reflects the quiescent/hypoxic resistance of solid tumors to anti-cancer drugs.
- the anti-actin anti-mitotic drug cytochalasin D shows the strongest apoptotic index for the shell, but the strongest negative mitotic index for the core. Taxol and Colchicine also show strong differences in the apoptotic index between the shell and the core.
- the independent validation for apoptotic processes to confirm their participation in the drug response was obtained through a series of multiphoton confocal microscopy experiments carried out using the UMR-106 spheroids.
- Spheroids were cultured at 37° C. in the presence of 10 ⁇ g/mL cytochalasin D, paclitaxel, and Colchicine for 4 hours and Iodoacetate for 3 hours.
- the live, apoptotic, and dead cells in the spheroid outer shell were visualized by optical section using a 20 ⁇ water immersion objective up to a depth of 100 ⁇ m using Hoechst 33342 (live), Yo-Pro-1 (apoptotic), and propidium iodide (dead) (Invitrogen, Grand Island, N.Y.) vital dyes on a Nikon AIR multiphoton microscope with Mai Tai DeepSee tunable IR laser at 750 nm.
- the percentage of live, apoptotic, and dead cells in the spheroid outer shell was determined for six different spheroids.
- the data are ranked by decreasing apoptotic ratio. These data show that Nocodazole, cytochalasin and Iodoacetate all induce an apoptotic response in the tumor spheroids.
- the strongest apoptotic response is for 10 ⁇ g/ml Iodoacetate, which has the strongest apoptotic index in FIG. 17 b .
- the bottom line in the graph of FIG. 17 b shows the corresponding data for the tissue dynamic spectroscopy shown in FIG. 17 a.
- a key question about the drug-response spectrograms is how much information is contained in these data structures.
- intracellular motions including organelle transport, endo- and exocytosis, membrane undulations, cytoplasmic streaming, cytoskeletal rearrangements, force relaxation and shape changes, among others. While general trends in the spectrograms are understood in terms of these types of motion, it needs to be established how much information can be obtained from tissue dynamics spectroscopy.
- H ⁇ ( x ) - ⁇ i ⁇ p ⁇ ( x i ) ⁇ log ⁇ ⁇ p ⁇ ( x i )
- the probability distribution for the feature vectors of phenotypic profiling by tissue dynamics spectroscopy is obtained as the histogram of the values among the individual features.
- the entropy for the data in FIGS. 12 a -12 b is shown in FIG. 18 for the fifteen features comparing the shell and core responses versus shell alone.
- the horizontal axis corresponds to the 15 features while the vertical axis represents the Shannon entropy value, which if applied to the feature vectors identifies how much information is obtained from the vectors.
- the entropy values for shell and core feature vectors are all moderately higher than for only shell feature vectors.
- the average entropy per channel is approximately two bits.
- J ⁇ ( x , y ) - ⁇ ij ⁇ p ⁇ ( x i , y j ) ⁇ log ⁇ ⁇ p ⁇ ( x i , y j )
- FIGS. 19 a and 19 b Examples of two-variable joint and mutual entropies are plotted in FIGS. 19 a and 19 b for the fourteen features of the 60 drugs, doses and conditions of the spectrograms of FIGS. 12 a -12 b . From the mutual entropy figure, there are cases of strong mutual information content among some pairs of channels, for instance channel 11 and channel 2 share almost 2 bits of information. (See, FIG. 19 b ).
- J ⁇ ( x , y , z ) - ⁇ ijk ⁇ p ⁇ ( x i , y j , z k ) ⁇ log ⁇ ⁇ p ⁇ ( x i , y j , z k )
- J ⁇ ( x n ) - ⁇ 1 ⁇ ⁇ ... ⁇ ⁇ n ⁇ p ⁇ ( x n ) ⁇ log ⁇ ⁇ p ⁇ ( x n )
- tissue dynamics spectroscopy To calculate the total information content of tissue dynamics spectroscopy, an expanded data set of 170 different drugs, doses and conditions (and hence 170 spectrograms) is shown in FIG. 20 .
- the asymptotic value in the limit of large n is 6.8 for the 170 spectrograms. Therefore, in the drug-response spectrograms, there are 6.8 bits of information per spectrogram.
- high-content screening typically uses approximately this many channels. Therefore, tissue dynamics spectroscopy qualifies as a high-content screening approach for drug phenotypic profiling.
- the drug-response spectrograms described above exhibit recognizable features that occur at characteristic frequency ranges at characteristic times after a dose and/or other stimuli is applied. Each spectrogram acts like a fingerprint, or more appropriately a voice print, showing a distinct pattern in response to the applied stimuli that is unique to the particular stimuli, which may be a particular drug and cell line.
- An analysis of the information content of the drug-response spectrograms based on Shannon entropy indicates that more than 144 distinct spectrograms can be distinguished from one another, which can thereby be used to establish 144 different “classes” for compound/cell-line classifiers.
- the present disclosure contemplates feature recognition and quantification of the drug-response spectrograms from projections of the spectrograms onto feature masks.
- the time axis of spectrograms primarily captures relaxation which is typically exponential.
- the frequency axis is the Fourier transform of the autocorrelation function, which is typically exponentially correlated.
- both the time and frequency axes are characterized by Laplace transforms for which there is no orthonormal basis. Consequently, in one aspect the systems and methods disclosed herein apply matched filtering in which characteristic regions of the spectrograms can be interpreted mechanistically.
- low frequencies correspond to slow cellular shape changes like blebbing
- mid frequencies correspond to membrane undulations
- high frequencies correspond to membrane vesicles or internal organelle motions.
- each mask with a drug response spectrogram generates a feature vector that serves as the fingerprint for that particular drug.
- the feature vector for pH 9 is shown in FIG. 10 .
- the feature vector illuminates the sensitivity of some features of the associated spectrogram, such as the organelle transport in the high frequency range after one hour, mid-frequency suppression of delayed undulations after four hours, delayed membrane at the low frequencies after 31 ⁇ 2 hours and an initial hormetic response.
- the feature masks capture these changes in the feature vector for the particular stimuli response.
- 15 feature vectors can be used corresponding to five frequency ranges across three time frames (although other frequency and time frame divisions can be utilized) and a similarity matrix is constructed from the correlation coefficients among the many pairs of feature vectors for different drugs and cell lines.
- a clustering algorithm (such as unsupervised hierarchical clustering) can be applied to the similarity matrix to order the tissue-response spectrograms of the different drugs and cell lines into groups based on the similarity of their response. The result is a clustered matrix that exhibits a block diagonal structure which is indicative that groups with high similarity have little overlap with other groups.
- By comparing a feature vector with the groupings it is possible to assign physiological attributes to the different groups. It is this quasi-orthogonality among the groups that provides the basis for phenotypic classification schemes in which a new lead compound of unknown mechanism may be compared against a reference compound library of dynamic tissue response spectrograms having known mechanisms of action.
- the present system and method contemplates the use of multidimensional scaling to more faithfully represent the closeness and farness of compound/cell type groupings and to display the information in a readily understandable format.
- the result is a two dimensional map with nodes corresponding to stimuli distributed in a manner that retains the order of distances found in the similarity matrix, such as the Venn diagram shown in FIG. 14 .
- Similar drug responses are grouped closely and farther from other unrelated drug responses.
- the map or Venn diagram thus provides a ready means to determine the expected phenotypic response of a new drug based on its proximity to other drugs in a grouping. For instance, if a new condition is OSM 154, a quick review of the map of FIG. 14 would reveal that the phenotypic response is blebbing and similar to the response of pH6, among other drugs/doses.
- the feature masks, feature vectors, similarity matrices, clustering and multi-dimensional scaling all readily lend themselves to implementation in software.
- the drug screening process can be significantly automated from the generation of the spectrogram for a new drug/stimuli to the presentation of a Venn diagram similar to FIG. 14 from which the expected physiological response of a new drug can be readily discerned.
- the systems and methods disclosed herein can thus significantly reduce the amount of time required to assess a new drug. More importantly the multi-dimensional scaling approaches implemented herein more accurately align drugs/conditions having similar physiological responses, which can significantly reduce, if not eliminate, the risk of false positives and false negatives.
- a library of known drugs/conditions and associated spectrograms can provide the foundation for the analysis of a new drug/stimuli/condition. All of the known drugs/conditions can be incorporated into a similarity matrix with the spectrogram of one or more new drugs/conditions to produce the clustered matrices and maps described above. In other words, as new drugs are categorized based on their physiological response they can be added to the library from which comparisons can be made for future drugs/conditions. Since the methods described herein can be readily implemented in software, the time required to validate or screen a new drug can be significantly reduced.
Landscapes
- Physics & Mathematics (AREA)
- Life Sciences & Earth Sciences (AREA)
- Health & Medical Sciences (AREA)
- General Physics & Mathematics (AREA)
- Engineering & Computer Science (AREA)
- Computing Systems (AREA)
- Theoretical Computer Science (AREA)
- Biomedical Technology (AREA)
- Biophysics (AREA)
- Pathology (AREA)
- Spectroscopy & Molecular Physics (AREA)
- Heart & Thoracic Surgery (AREA)
- Medical Informatics (AREA)
- Molecular Biology (AREA)
- Surgery (AREA)
- Animal Behavior & Ethology (AREA)
- General Health & Medical Sciences (AREA)
- Public Health (AREA)
- Veterinary Medicine (AREA)
- Investigating Or Analysing Biological Materials (AREA)
Abstract
Description
- This application is a continuation-in-part of and claims priority to co-pending application Ser. No. 12/874,855, filed on Sep. 2, 2010, and entitled “Method and Apparatus for Motility Contrast Imaging,” which claims priority to PCT/US2009/036124 filed on Mar. 5, 2009, which further claims priority to U.S. provisional application No. 61/034,028, filed on Mar. 5, 2008. This application is also a continuation-in-part of and claims priority to co-pending application Ser. No. 13/704,464 and to co-pending application Ser. No. 13/704,438, both filed on Dec. 14, 2012, and entitled “Digital Holographic Method of Measuring Cellular Activity and of Using Results to Screen Compounds,” and both claiming priority to PCT/US2011/040954, filed on Jun. 17, 2011, which claims priority to U.S. provisional application No. 61/397,885, filed on Jun. 17, 2010. The entire disclosure of the co-pending application Ser. Nos. 12/874,855; 13/704,438; and 13/704,464 are incorporated herein by reference.
- This invention was made with government support under grant CBET 0756005 awarded by the National Science Foundation. The government has certain rights in the invention.
- The present disclosure relates generally to the assessment of the health of living tissue and the profiling of the phenotypic response of tissue to perturbations, both environmental and pharmaceutical.
- Cellular systems are highly complex, with high redundancy and dense cross-talk among signaling pathways. [1] (Note: Bracketed numbers refer to general reference publications listed at the end of the disclosure). Biochemical target-based high-content screening (HCS) can isolate single mechanisms in important pathways, but often fails to capture integrated system-wide responses. Phenotypic profiling, on the other hand, presents a systems-biology approach that has more biological relevance by capturing multimodal influence of therapeutics. [2] Although phenotypic profiling predates genomics that provided isolated targets, it remains today one of the most successful approaches for the discovery of new drugs. [3]
- At present most phenotypic profiling is performed on two-dimensional culture, even though two-dimensional monolayer culture on flat hard surfaces does not respond to applied drugs in the same way as cells in their natural three-dimensional environment. This is in part because genomic profiles are not preserved in primary monolayer cultures. [4-6] There have been several comparative transcriptomic studies that have tracked the expression of genes associated with cell survival, proliferation, differentiation and resistance to therapy that are expressed differently in 2D cultures relative to three-dimensional culture. For example, three-dimensional culture from cell lines of epithelial ovarian cancer [7, 8], hepatocellular carcinoma [9-11] or colon cancer [12] display expression profiles more like those from tumor tissues than when grown in 2D. In addition, the three-dimensional environment of 3D culture presents different pharmacokinetics than 2D monolayer culture and produce differences in cancer drug sensitivities. [13-16]
- An alternative approach to imaging form is to image function, and in particular functional motions. Motion is ubiquitous in all living things and occurs across broad spatial and temporal scales. At one extreme, motions of molecules during Brownian diffusion occur across nanometers at microsecond scales, while at the other extreme motions of metastatic crawling cells occur across millimeters taking many hours. As one spans these scales, many different functional processes are taking place: molecular diffusion, molecular polymerization or depolymerization of the cytoskeleton, segregation of enzymes into vesicles, exocytosis and endocytosis, shepherding of vesicles by molecular motors, active transport of mitochondria, cytoskeletal forces pushing and pulling on the nucleus, undulations of the cell membrane, cell-to-cell adhesions, deformation of the cell, cell division and ultimately to movement of individual cells through tissue. All of these very different types of cellular dynamics can be active and useful indicators of the functioning behavior of cells. The functional response of target cells to applied drugs is of particular relevance in drug screening.
- Imaging motion in three-dimensional tissue is simpler than imaging structure or performing molecular imaging, because motion modulates coherent light through phase modulation. When light scatters from an object that is displacing, the phase of the light is modified. If the light has coherence, then the motion-induced phase shifts of one light path interfere with the phase shifts of other light paths in constructive and destructive interference. Even light that is multiply scattered in tissue carries a record of the different types of motions that the light encountered. By measuring the fluctuating phase of light scattered from living tissue, the different types of motion across the different space and time scales can be measured. The trade-off for greater depth of penetration into three-dimensional tissue is reduced spatial imaging resolution. But volumetric imaging of intracellular motions in tissue is still possible, within limits, by using low-coherence interferometry that can select light from specified depths by using coherence-gating approaches [17].
- The 2D imaging techniques have been applied to drug screening and in particular to evaluating efficacy of a drug in disease treatment, such as anticancer drugs. Traditional 2D techniques can lead to false positives when a drug is more effective in 2D than in 3D, resulting in promising early drug leads that fail in animal models because the drug is more effective at killing tumor cells grown as monolayer cultures than as cells within multicellular tissues. An even greater impact is the false negative in drug screening in which a drug that would otherwise be effective in 3D yields a negative result at the 2D screening stage, thereby leading to the elimination of the drug. The end result of false positives and false negatives is that new drug discovery halves every nine years (in contrast to Moore's Law of the electronics industry in which chip capacity doubles every 18 months).
- Phenotypic profiling can provide a significant advance in drug screening when based on 3D cultures. What is needed is a system and method for extracting high-content phenotypic responses from inside heterogeneous tissue and for accurately and meaningfully analyzing the resulting information to build a phenotype database to improve the efficiency of future drug screening.
- The present system and method relies upon feature recognition to segment the information in time-frequency tissue-response spectrograms to construct N-dimensional feature vectors. The feature vectors are used to generate a correlation matrix among a large number of different stimuli in the form of drugs, doses and conditions. Multi-dimensional scaling is applied to the correlation matrix to form a two-dimensional map of response relationships that retains rank distances from the higher-dimensionality feature matrix. The two-dimensional phenotypic profile space displays compact regions indicative of particular physiological responses, such as regions of enhanced active transport, membrane undulations and blebbing.
- In a further attribute, the feature vectors can be used to generate feature masks against which new drugs and drug responses can be compared. A library of feature masks can be maintained and applied to the spectrogram of a new drug to find a corollary drug in the library that produces a similar physiological response.
-
FIG. 1 includes motility contrast images of three nominal tumors, namely a fully proliferating tumor and tumors with a hypoxic and a necrotic core. -
FIG. 2 includes the spectrograms for 28 different stimuli, namely drugs, doses and conditions. -
FIGS. 3a, 3b and 3c are similarity matrices for, respectively, shell-shell, core-core and shell-core correlations of the spectrograms ofFIG. 2 -
FIG. 4 is a clustered similarity matrix for the combination core and shell responses to 56 stimuli. -
FIG. 5 is a map of spectral frequency responses corresponding to certain physiological responses of the tumor. -
FIG. 6 is a graph of characteristic frequency (temporal scale) in relation to size (spatial scale) for certain physiological responses obtained from prior studies. -
FIG. 7 includes feature masks generated from the feature vector ofstimuli pH 9 obtained from the spectrogram ofFIG. 2 . -
FIG. 8a is a spectrogram for a particular feature illustrating a frequency knee characteristic. -
FIG. 8b is a plot of zero-crossings isolated from the spectrogram ofFIG. 8a showing he knee frequency. -
FIGS. 9a and 9b are graphs corresponding to a morphometric analysis in whichFIG. 9a is the raw differential spectrogram andFIG. 9b is the raw spectrogram modified according to a morphometric algorithm. -
FIG. 10 shows a feature vector obtained from a spectrogram for thestimuli pH 9. -
FIG. 11a is a spectrogram of feature vectors for 28 stimuli. -
FIG. 11b is a similarity matrix for the feature vector spectrogram ofFIG. 11 a. -
FIG. 12a is a spectrogram of feature vectors for 28 stimuli after unsupervised hierarchical clustering. -
FIG. 12b is a similarity matrix for the feature vector spectrogram ofFIG. 12 a. -
FIG. 13 is a network diagram of illustrating strong similarities among multiple stimuli. -
FIG. 14 is a Venn diagram generated by multi-dimensional scaling of the spectrogram ofFIG. 12 . -
FIG. 15 is a diagram showing trajectories of pH and osmolarity in a MDS space of several Raf inhibitors acting on adenocarcinomas DLD-1 and HT-29. -
FIG. 16 includes spectrograms of a proliferating shell and hypoxic core of a tumor responding to particular stimuli, namely cytochalasin D at 50 μg/ml. -
FIG. 17a is a graph of apoptotic indexes for the shell and core of a tumor responding to eight stimuli. -
FIG. 17b is graph comparing data for three stimuli obtained from the tissue dynamic spectroscopy described herein and prior art data. -
FIG. 18 is a graph of entropy data for fourteen feature vectors. -
FIGS. 19a and 19b are maps of two-variable joint and mutual entropies for the fourteen feature vectors shown inFIG. 18 . -
FIG. 20 shows a feature vector and hierarchical clustering similarity matrix for 144 different stimuli. -
FIG. 21 is a graph of joint entropy for 170 drugs/doses/conditions including separate shell and core responses. - For the purposes of promoting an understanding of the principles of the invention, reference will now be made to the embodiments illustrated in the drawings and described in the following written specification. It is understood that no limitation to the scope of the invention is thereby intended. It is further understood that the present invention includes any alterations and modifications to the illustrated embodiments and includes further applications of the principles of the invention as would normally occur to one skilled in the art to which this invention pertains.
- The present invention determines the internal health of living tissue by defining and monitoring internal states of health based on motility spectrograms that are used to classify phenotypic response of tissue to perturbations. In one aspect, the systems and methods of present disclosure utilize motility contrast imaging to map and evaluate cellular activity. In one embodiment, the imaging may be performed using the optical configuration disclosed in co-pending application Ser. No. 13/704,438, which is based on published PCT application WO 2011/160064 (the '064 Publication), or as disclosed in co-pending application Ser. No. 12/874,855, published as US2020/0331672, in which a depth-resolved holographic technique, namely holographic optical coherence imaging (OCI), is utilized to extract information concerning cellular and subcellular motion. The disclosure of the imaging systems and techniques in the published application Nos. US2020/0331672 and WO 2011/160064 are incorporated herein by reference.
- The '064 Publication further describes the use of motility contrast imaging (MCI) to produce spectrogram responses of cell compounds. In particular, the '064 Publication describes extracting a spectrogram fingerprint of a differential response of a tissue sample in which a drug has been administered. The motility contrast images of several nominal tumors are shown in
-
FIG. 1 . The core can be strong proliferating (on the left) or strongly hypoxic (on the right), depending on the pre-condition of the tumor spheroids. When the core is hypoxic, it is ATP depleted and responds differently to stimuli, such as drugs or changing environmental conditions, than a healthy shell that has normal ATP levels. - The '064 Publication further discloses that a power spectrum in the frequency domain can be determined and more particularly changes in the power spectral density as a function of time through the shift in characteristic parameters are evaluated. The result is a differential spectrogram, such as the spectrograms shown in
FIG. 2 , which plots the differential relative spectral density for a given frequency at a time t relative to the initial time t0. This differential spectrogram thus captures the changes in spectral content as a function of time after a dose, condition or other stimuli (or combination of stimuli) are applied to the target 3D body. The differential spectrogram is sensitive to shifts in the magnitudes of the spectral densities (dependent upon the number of moving constituents) and to shifts in the characteristic frequencies (i.e., the speed of the moving constituents). - In one procedure, 28 different drugs, concentrations and conditions were applied to 28 different tumor spheroids, and spectrograms were obtained in each case using the imaging system and techniques described in the above-identified published applications. Table I below lists the different compounds, doses or conditions (hereinafter referred to as “stimuli”) applied to the tumor spheroids, together with the expected physiological response.
-
TABLE I Reference Compounds, Doses and Conditions Compound or Condition Action Temperature 24 to 37° C. Increased motility pH 6 Weak acidic KCN 20 μg/ml Inhibit electron transport Iodoacetate 1 μg/ml Inhibits glycolysis Osm 508 Hypertonic cell desiccation Osm 428 Hypertonic cell desiccation Iodoacetate 10 μg/ml Inhibit glycolysis KCN 200 μg/ml Inhibit electron transport TNF 5 μg/ml Cytokine apoptosis induction Cytochalasin 10 μg/ml Anti-actin, anti-mitotic Cytochalasin 1 μg/ml Anti-actin, anti-mitotic Iodoacetate 40 μg/ml Inhibit glycolysis pH 9 Strong basic Nocodazole 0.01 μg/ml Anti-tubulin, anti-mitotic Osm 154 Strong Hypotonic cell swelling Osm 77 Strong Hypotonic cell swelling Cytochalasin 50 μg/ml Anti-actin, anti-mitotic, apoptosis pH 5 Strong acidic Colchicine 10 μg/ml Anti-tubulin, anti-mitotic Iodoacetate 20 μg/ml Inhibit glycolysis Nocodazole 1 μg/ml Anti-tubulin, anti-mitotic Taxol 10 μg/ml Tubulin stabilization, anti-mitotic Cycloheximide Apoptosis induction Nocodazole 0.1 μg/ml Anti-tubulin, anti-mitotic Colchicine 1 μg/ml Anti-tubulin, anti-mitotic Nocodazole 10 μg/ml Anti-tubulin, anti-mitotic Taxol 1 μg/ml Tubulin stabilization, anti-mitotic pH 8 Weak basic - The spectrograms for these drugs/stimuli are complex, showing many different types of features in response to the applied drugs. Similar drugs produced similar spectrograms, while widely differing spectrograms could be elicited from drugs with very different mechanisms of action. The spectrograms of the 28 different drugs/doses/conditions, separated by shell (top) and core (bottom), are shown in
FIG. 2 . For each spectrogram, frequency is along the vertical axis from 0.005 Hz to 5 Hz, while time is plotted along the horizontal axis corresponding to a duration of 6 hours after the dose or stimuli is applied. In the spectrograms ofFIG. 2 , increases in spectral density over the initial condition are represented by increasing shades of red while decreasing spectral density are represented by increasing shades of blue. For instance, for the drug/dose Nocodazole 0.01 μg/ml the spectral density shows a moderate increase over time at the low frequencies, while at the dose 0.1 μg/ml the increase is much more pronounced. - To initially capture the similarity or dissimilarity of the drug response spectrograms, a cross-correlation coefficient between spectrograms is calculated, as specified by:
-
- where S(x)(v,t) is the spectrogram of drug/condition x, S(y)(v,t) is the spectrogram of drug/condition y and the sum is over both frequency and time. The correlation coefficient was calculated among the 28 conditions, treating the proliferating shell and the core of the tumor spheroid separately.
- A similarity matrix provides the basis for a hierarchical clustering algorithm that can group different stimuli by their similar drug-response spectrograms. Each row of the N×N similarity matrix is an N-dimensional vector (where N corresponds to the number of compounds, doses and conditions applied to the tumor spheroid). The inner product of each row defines a measure of distance:
-
- where C is the cross-correlation coefficient calculated above.
- Inner products near unity correspond to “close” associations between stimuli, and inner products near negative unity correspond to “far” associations.
- The stimuli given in Table I can be grouped according to the hierarchical clustering of the drug responses based on the spectrograms of the proliferating shell. In a hierarchical clustering algorithm, at each stage the two closest vectors are identified and grouped into an average vector, and then the number of vectors decreases by one. The sequence of the vectors that are grouped in this way are retained until all vectors have been grouped. The sequential grouping of vectors produces a clustering of similar drug responses. The similarity matrix can be rearranged according to the sequence of grouping according to the shell-shell correlations with the result shown in upper left matrix of
FIG. 3a . The similarity matrix shows structure with an approximately “block diagonal” appearance. If the matrix were truly block diagonal, the clustering would consist of groups of unique behaviors with no correlation between stimuli. However, in the case of the drug responses, there is considerable off-diagonal structure, which indicates that different groups of drug responses do share some aspects in common. Nevertheless, the drug response groupings exhibit “themes” of similar behavior. For instance, many of the anti-mitotic drugs, such as Nocodazole, Colchicine and Taxol, cluster in the bottom right of the figure, the cytochalasin and hypotonic osmolarity results are approximately in the middle, and the metabolic and hypertonic osmolarity responses are at the upper left. - The compounds were applied at multiple different doses, some below and some above EC50. Therefore, the clustering does not automatically group similar drugs together, but instead clusters responses. If a higher dose induces apoptosis, but a lower dose does not, then the higher dose will be grouped with other drugs or conditions that induce apoptosis. In an alternative analysis, each drug response can be referenced to its own EC50, which would remove the dose dependence in the clustering.
- Multicellular tumor spheroids have different conditions for the proliferating shell relative to the core, which tends to be hypoxic and ATP depleted. Furthermore, large tumors (larger than 500 micron diameter) have increasingly necrotic cores. Tissue dynamics spectroscopy is volumetric (depth-gated) so the response of the (deeper) core can be compared to the different response of the (shallower) shell. The core-core correlations are shown in the lower right
FIG. 3b for the same ordering as for the clustered data using the shell-shell correlations. There are many similarities in the core-core correlations, but with notable differences, and with several of the shell-shell blocks missing, such as the blocks in the upper right of the shell-shell matrix ofFIG. 3a . The differences are because the shell and the core respond differently to the applied conditions. This is seen more clearly in upper rightFIG. 3c which shows the correlation of the shell spectrograms with the core spectrograms. The diagonal elements of this similarity matrix are not all near unity, showing significant differences in the response of the core relative to the shell, even responding in the same tumor to the same conditions. - Because the core is under a different condition than the shell, the 28 conditions can be doubled to 56 conditions, which can be cross-correlated into a similarity matrix and clustered according to all 56 conditions. The resulting clustered similarity matrix is shown in
FIG. 4 . (Note that the stimuli applied to the core are so designated and the stimuli applied to the shell carry no separate identifier). Many of the shell and core spectrograms are clustered together (highly similar), but there are many other pairs that are separated in the clustering process because their respective spectrograms are not highly similar. This is likely a consequence of the ATP-depleted conditions of the core relative to the proliferating shell. For instance, an apoptotic response requires normal ATP concentrations and can occur in the shell, while the cells in the core would be forced to follow a necrotic path. This difference between apoptosis and necrosis based on ATP concentrations may be one of the differentiators between the spectrograms of the shell relative to the core. A more systematic study of these differences between the shell and the core may uncover specific spectrogram signatures for processes like apoptosis. - The information content of each spectrogram can be represented as feature maps that capture the signatures of the different drugs. These features can be related to physiological processes that occur inside the cells and generally in the tissue. For instance, the trend in the TDS (tissue dynamics spectroscopy) spectral frequencies are shown in
FIG. 5 for motions of the organelles, membrane and general shape changes. The spectral frequency is along the y-axis and spans three decades of dynamic range, while time is along the x-axis. The baseline is set prior to t=0, and is used as the quantity in the denominator of spectral density equation for normalization. The change in the spectral content is plotted in false color, with Region R in deep red equal to 70% enhancement, and the Region B in deep blue equal to 70% inhibition. The intermediate Region G in green represents little or no change in spectral content. The response occurs in approximately three frequency bands that show distinctly different behavior: low-frequency (0.005 Hz to 0.1 Hz), mid-frequency (0.1 Hz to 1 Hz) and high-frequency (1 Hz to 5 Hz). The proliferating shell shows enhancements in the third frequency band after about an hour, while the core shows nearly an opposite response. At low frequencies, the shell is mostly unchanged until a strong onset at a much later time, while the core shows enhanced low frequencies for most of the duration of the experiment. - To interpret spectrograms, it is necessary to establish a correspondence of the frequencies observed in DLS (dynamic light scattering) with frequencies (and velocities and diffusion coefficients) obtained from the literature that are connected with specific biological targets and mechanisms. The lowest frequency in the experimental spectrograms described above is 0.005 Hz, and the highest frequency is 5 Hz. The general relationships for single backscattering under heterodyne (holographic) detection is given by: q2D=ωD for diffusion, and qv=ωd for directed transport, where D is the diffusion coefficient and v is a directed speed. The smallest and largest frequencies that can be captured in the experiments define the physical ranges for directed transport and diffusion, respectively, which are 0.006<v<2 μm/sec, and 4×10−4<D<0.1 μm2/sec.
- The velocity range is well within the range of intracellular motion in which molecular motors move organelles at speeds of microns per second [18-22]. Diffusion of very small organelles, as well as molecular diffusion, are too fast to be resolved by an expected maximum frame rate of 10 fps. Membrane undulations are a common feature of cellular motions, leading to the phenomenon of flicker [23-27]. The characteristic frequency for membrane undulations tends to be in the range around 0.01 to 0.1 Hz [21, 24, 28, 29]. Results from the literature are summarized in
FIG. 6 . The graph captures the general connection of spatial scale with temporal scale. Experiments on vesicles and the cytoplasm give the highest backscatter frequencies generally above 1 Hz and extending to tens of Hz. Larger mitochondria and organelles have slightly lower backscattering frequencies, but these are still in the range of the upper band frequencies of TDS shown inFIG. 5 . Membrane motions are much slower, coinciding with the frequencies of the lower band in TDS. This spatial-temporal trend is only semi-quantitative, but it provides a general principle that may help disentangle the mixtures of frequencies that arise from multiple dynamic light scattering mechanisms. - Therefore, there is a general trend of higher frequencies for smaller objects, and also trends in time with higher doses producing faster responses. These trends in frequency and time are captured by using feature masks that look at isolated regions of the frequency-time spectrogram. One embodiment of these feature masks is illustrated in
FIG. 7 . - The features used in the feature mask relate to a position in time and frequency on the spectrogram. For instance, a membrane undulation response is a mid-frequency response, while an organelle response is a high frequency response. Cell shape changes are low frequency. A hormetic response is a combined high/low frequency shift that occurs immediately upon application of the drug, but then decays quickly. All drug/condition spectrograms can be analyzed in terms of these features.
- The drug-response spectrograms exhibit recognizable features that occur in characteristic frequency ranges at characteristic times after a dose is applied. Two approaches are applied to feature recognition and quantification of the drug-response spectrograms. One approach is based on projections of the spectrograms onto feature masks. There are many possible choices for feature masks, such as binary masks versus continuous-valued masks, local masks versus global masks, and orthonormal feature masks versus non-orthonormal. The time axis on the spectrograms primarily captures relaxation which is typically exponential. The frequency axis is the Fourier transform of the autocorrelation function, which also is typically exponentially correlated. Therefore, both the time and frequency axes are characterized by Laplace transforms for which there is no orthonormal basis. Therefore, an approach of matched filtering [30] can be used in which characteristic regions of the spectrograms can be interpreted mechanistically. For instance, it has been shown that low frequencies correspond to large-scale motion like blebbing or the formation of apoptotic bodies, while high frequencies correspond to membrane vesicles or internal organelle motions. [31] These processes and frequencies present natural frequency ranges within the data that are used to generate feature masks to extract these specific features.
- Along the time axis, an increasing sampling for the feature masks is applied, sampling at short times (T1=0 to 50 minutes) for fast response, mid times (T2=50 to 150 minutes) for slower response and long times (T3=150 to 350 minutes) for long-term response. Along the frequency axis there are several characteristic frequencies that divide the response into natural frequency bands. These occur at 0.01 Hz (low), 0.1 Hz (mid) and 1 Hz (high). The resulting feature masks are shown in
FIG. 7 . The three time frames and five frequency signatures generate 15 feature masks. Masks M1-M3 capture the average spectral power change, masks M4-M6 capture low-frequency, masks M7-M9 measure the shift of the spectral weight to higher frequencies, masks M10-M12 capture high frequency motions, and masks M13-M15 capture enhanced mid frequencies. - In one rudimentary approach, overlaying a particular drug/dose spectrogram onto each of feature masks can reveal the expected response for the drug based on the feature mask or masks that generally correspond to the spectrogram. For instance overlaying the spectrogram of
FIG. 5 onto the feature masks ofFIG. 7 shows a general correspondence with mask M6 indicative of large scale motion of the cell and with M8 indicative of organelle transport that starts at a later time. - One important aspect of the time-frequency feature mask approach is the choice of frequency cutoffs for the different features. For instance, it is clear by assessing many of the spectrograms that there is a typical frequency knee, or edge, around 0.1 Hz. This frequency would be a natural frequency to define the boundary of a feature mask. To precisely establish this frequency, a level-set algorithm can be applied to an ensemble of many spectrograms from the same cell line responding to many different types of drugs. The level is set to the zero-crossings of the spectrogram. These zero-crossings are isolated in each of the spectrograms and then averaged. The result is shown in
FIGS. 8(a)-8(b) . There is a strong knee feature at a frequency around 0.1 Hz that is shared by most of the spectrograms. This becomes the bounding frequency of mid- or low-frequency masks. There is also a knee frequency around 1 Hz that defines the lower bound of the high-frequency mask that is associated with organelle transport. - The second approach to feature extraction of spectrogram features is based on morphometric analysis. This analysis is based on the overall shape and position of certain features. An example of a morphometric analysis is shown in
FIGS. 9a-9b for the mitochondrial toxin FCCP applied to a DLD-1 cell-line tumor spheroid. Time is the vertical axis, increasing downwards on a linear scale. The horizontal axis is frequency increasing to the right on a log scale. The drug is applied at t=10 on the vertical axis. The spectrogram inFIG. 9a is the raw differential spectrogram. This is used as the starting point of a morphometric algorithm that seeks broad areas of common response. The algorithm is based on percolation cluster labeling combined with level sets. The resulting identified regions are shown inFIG. 9b . There are 7 regions I-VII that were found in this case to be distinct. These regions become the masks that are applied to the spectrogram inFIG. 9a to extract the average values inside that time-frequency region. It is important to note that different spectrograms may differ quantitatively, but share common features. This morphometric approach can lead to feature vectors that are similar, while the more rigid approach to feature recognition described above might create feature vectors that are not highly similar because of frequency shifts between the two spectrograms. Therefore, the morphometric approach is considered to provide more robust comparisons of qualitatively similar features and hence more stable clustering results based on these feature vectors. - In one aspect of the present disclosure, each feature in the feature masks can be assigned a numerical value related to the strength and sign of the response for that feature in a particular spectrogram. The collection of feature values constitutes a feature vector. Therefore, each spectrogram has an associated feature vector.
- The value of a feature is obtained by the inner product of the k-th feature mask Mk(v,t) with the j-th differential spectrogram Dj(v,t)
- that produces a k-dimensional vector component Vk j where j is the index for a condition (drug or dose or perturbation), and k is the index for a feature (time-frequency signature). The brackets denote the inner product through:
-
- where the indexes p, q are along the frequency and time axes, respectively. The normalization Nnorm is
-
- where Dpq is taken only in the associated time region of the mask. This normalization captures the shape of features, but de-emphasizes the magnitude. This procedure is well suited to recognizing signature features and for clustering drug responses according to their features rather than the strength of their response.
- An example of a feature vector is shown in
FIG. 10 associated with a spectrogram forpH 9. A collection of feature vectors for each of the 28 stimuli/conditions (seeFIGS. 3a -c,FIG. 4 ), and including shell and core response separately, is shown inFIG. 11 a. Each feature vector is like an N-dimensional vector. In the example ofFIG. 11a , each drug or condition has a 10-dimensional vector that captures ten features of the spectrograms. There can be any number of dimensions, depending on the image masks that are generated to capture specific features. In this example, the key features include transparency, membrane/contacts, undulations, expansion, organelle transport, delayed membrane, delayed undulations, delayed expansion, delayed organelle transport and hormetic response. The strength of the responses are color-coded from red for a strong positive response to blue for a strong negative response. - The similarity between two feature vectors for two different spectrograms is obtained as the inner, or dot, product between the two vectors. After the feature vectors are generated as shown in
FIG. 11a , they are used to generate a similarity matrix among all the different drugs and conditions. The similarity of the i-th and j-th spectrogram is defined as the normalized correlation: -
- where the similarity is normalized to unity when i=j. The feature vectors Vk j and the similarity matrix Sij for the 28 doses and conditions of Table I above, plus two negative controls, are shown in
FIGS. 11a -b. In these figures, the proliferating shell and the core are treated independently, leading to 60 feature vectors and a 60×60 similarity matrix. The similarity matrix in the present example is shown inFIG. 11b and is unity along the main diagonal. The ordering inFIG. 11b is by drug and dose, with the shell alternating with the core. While there is some clustering of similarities, the similarity matrix and feature vectors do not show strong clustering, except for the tubulin destabilizing compounds that share many features in common. - Despite the grouping of increasing doses of some drugs (e. g., Nocodazole, Iodoacetate, cytochalasin, etc.), there is little structure to the matrix in
FIG. 11b so the informational content is of little value in drug screening. One of the goals of phenotypic profiling is to re-order the similarity matrix to group common drug responses together. There is no unique way to order similarity, and there are several common algorithms that lead to similar, but not identical, orderings. One known approach is unsupervised hierarchical clustering. [32] (See another example in “Unsupervised Hierarchical Clustering via a Genetic Algorithm”, William A. Greene (Proc. IEEE Cong. Evol. Comput., Canberra , Australia, 2003, pp. 998-1005), the entire disclosure of which is incorporated herein by reference). This is an iterative process that sequentially groups pairs of similar responses to produce tree structures. Unsupervised ordering has the advantage that no predefined structures or substructures are defined for the process, leading to an objective grouping of similar responses. - The similarity matrix and feature vectors after unsupervised hierarchical clustering according to “distance” are shown in
FIG. 12a -12 b. In comparing the “non-clustered” similarity matrix ofFIG. 11b with the matrix ofFIG. 12b it can be seen that the latter similarity matrix is nearly block-diagonal in which similar spectrograms are grouped together, with low cross-talk among the groups. The feature vectors are also grouped inFIG. 12a , showing groups of spectrograms that share features in common. The selected features have putative physiological interpretations (such as blebbing, undulations and organelle motions)[31], so the groupings of features also group the physiological responses into a phenotypic profile for these standard compounds and conditions. - It can thus be appreciated that the clustered similarity matrix of
FIG. 12b is higher in information content than the similarity matrix ofFIG. 11b , and therefore more useful in screening a new drug. In one aspect, the spectrogram of a new drug/dose/stimuli can be reduced to a feature vector, as explained above, and then combined with feature vectors of known drug/dose/stimuli, in the manner of the feature vector matrix ofFIG. 11a , and ultimately incorporated into a similarity matrix, such as the matrix ofFIG. 11b . After clustering a clustered similarity matrix such as the matrix ofFIG. 12b can be used to identify the group in which the new drug/dose/stimuli resides. The new drug can then be expected to produce the physiological responses of that group. - There are several aspects to note in the ordered list of the vector in
FIG. 12a . In general, similar compound classes are clustered together, such as the anti-tubulin drugs Nocodazole and Colchicine. But these compounds cluster separately from Taxol which is a tubulin stabilizing drug. In addition, similar environmental conditions cluster together, such as hypotonic osmolarity and low pH separately from hypertonic osmolarity and high pH. One aspect that is striking in its absence is the low correlation between the shell and the core response of the same tumor spheroid to the same compound or condition. This phenotypic difference between the shell and the core of a single spheroid is discussed in more detail herein. - The disadvantage of hierarchical clustering is that it produces a linear arrangement that does not faithfully represent distance between nodes (in which a node corresponds to a drug/dose/stimuli). In addition, it is an ordering algorithm rather than a clustering algorithm. [33] To test the results of hierarchical clustering, a k-means clustering and level-set clustering can be applied on the raw similarity matrix in
FIG. 4 . The resulting ordering of the drugs and conditions change in detail, but the overall groupings and block-diagonal structure of the reordered similarity matrix remain nearly the same with respect to the similarity matrix shown inFIG. 12b . However, none of these ordering or clustering algorithms faithfully represent the distance relationships that are contained within the original similarity matrix. As subclusters are combined into larger clusters, especially in hierarchical clustering, it is possible to have two adjacent nodes that have very low similarity and hence should be far apart. The final ordering is linear, and distance relationships are not represented. - As one solution to this “distance” problem, the groups of clustered cases can be converted to a network diagram, as shown in
FIG. 13 . Each numbered node represents a particular stimuli (i.e., compound, drug or condition). Strong similarity is denoted by a line connecting two nodes. Close proximity of nodes signifies similar phenotypic response. The network diagram ofFIG. 13 provides a clear visual indication of groupings according to phenotypic response that can be useful in drug screening. - A more quantitative solution to this “distance” problem is provided by multidimensional scaling (MDS). [32] In multidimensional scaling, a low-dimensional representation is sought in which similar response nodes are placed close to one another and dissimilar response nodes are placed far apart. The spatial near-far relationships in a low-dimensional graph preserve the high-dimensional near-far relationships of the original feature vectors. Multidimensional scaling is not a “projection” to a lower dimensional plane, but is instead a one-to-one mapping that retains ordering of distances. As with all data compression the actual metric distances are lost in the process; however, the general relationships of nearness or similarity are preserved.
- To apply multidimensional scaling to a similarity matrix, such as the matrix of
FIG. 4 , a distance matrix is defined as dij=1−Sij. The MDS algorithm assigns a cost function that is to be minimized. The cost function is the difference between the distance of the two-dimensional location of nodes and the distance defined from the similarity matrix. The cost function is: -
- where ri is a vector in the low-dimensional target space. Using a simple Euclidean distance norm this cost function is minimized using simulated annealing [34], starting from a set of initial positions in two dimensions determined by the first two principal components from principal component analysis. [32] (Examples are also shown in “Pairwise data clustering by deterministic annealing”, T. Hofmann, J. M. Buhmann, Pattern Analysis and Machine Intelligence, IEEE Transactions, Vol. 19, no. 1, pp. 1-14, January 1997; and “Multidimensional Scaling by Deterministic Annealing,” H. Klock, J. Buhmann, Proc. Int'l Workshop Energy Minimization Methods in Computer Vision and Pattern Recognition, pp. 245-260, 197; both disclosures of which are incorporated herein by reference). The simulated annealing proceeds through 1000 iterations, with a 0.1% decrease in effective temperature at each iteration. The final positions that emerge from the MDS algorithm appear in the low-dimensional space in a pattern that preserves the trend of distances dij from the high-dimensional space spanned by the feature vectors.
- The results of multidimensional scaling of the data in
FIG. 12 are shown inFIG. 14 . This low-dimensional phenotypic space has two dimensions. The axes do not have direct physical meaning, but the distribution of nodes retains the ordering of distances that occur in the similarity matrix ofFIG. 12 . Similar drug responses are grouped closely, and far from other unrelated drug responses. Because of this spatial grouping and separation, it is possible to draw a Venn diagram based on the physiological features in the feature vectors. The Venn diagram ofFIG. 14 shows the drug responses with enhanced mid-frequency (membrane undulations), enhanced low frequency (shape changes and blebbing) and enhanced high frequency/active (vesicle and organelle transport). The network connections drawn on the figure are from k-means clustering and show local clusters. The dashed line shows a separation between core response (outside the line) and shell response (inside the line). There are exceptions in this shell-core separation for hypotonic osmolarity, high pH and high-dosage cytochalasin, but in general the shell responses lie closer together near the center of the phenotypic space than the outlying core responses. - An interesting region is the overlap between blebbing and active organelle/vesicle transport. Taken together, these may be expected if there is apoptosis during which apoptotic bodies are separated from the main cell, and active organelle transport drives the cellular decomposition. There are no drug responses in this overlap region from the hypoxic core which is ATP depleted and cannot support apoptosis.
- It can be seen that the information content of the map of
FIG. 14 far exceeds the content of the original similarity matrix ofFIG. 4 . The map resulting from the multidimensional scaling can be easily used to identify similar physiological responses among drugs and more importantly to identify expected physiological responses of new drugs being screened. It can be appreciated that the all of the steps leading from the original spectrogram for a new drug to the map ofFIG. 14 can be performed with software. - Former applications of multidimensional scaling have had the drawback that the axes do not relate to physically meaningful quantities. However, the application of specific conditions to living tissues can be performed with conditions that have continuously variable values that are continuously tuned through normal physiological conditions. By including these data in the multidimensional scaling, one obtains a so-called trajectory for that condition through the MDS space. One example of such a condition is the pH of the culture medium that can be tuned from pH=5 to pH=9 passing through physiological normal pH=7.3. Another example is the osmolarity that can be tuned from 150 mOsm through physiological 300 mOsm to 450 mOsm. Examples of these trajectories on the MDS phenotypic profile of a group of Raf inhibitors is shown in
FIG. 15 . The pH and osmolarity data define trajectories through the MDS space. These trajectories enable the axes of the MDS space to acquire physiological meaning in relation to the drug responses. - As an example of phenotypic profiling based on hypoxic phenotypes, multicellular tumor spheroids provide a natural format to study phenotypic differences in the drug response between normoxic and hypoxic tissue. When tumor spheroids have a diameter larger than approximately 400 microns, the transport of oxygen into the core of the spheroid is impeded, resulting in hypoxic tissue and a band of quiescent cells inside the outer shell of proliferating cells. [35] There is evidence that the phenomenon of multicellular resistance to anticancer drugs displayed by avascular solid tumors is caused, in part, by the population of quiescent cells. [36, 37] In addition, hypoxia is a factor in oncogenic progression [38, 39] and may participate in the epithelial to mesenchymal transition that ultimately leads to metastasis. [40-43] For these reasons, comparing the effect of anticancer drugs on the hypoxic core relative to the quiescent or proliferating shells may shed light on multicellular resistance.
- An understanding of the shell-core differences can be gained by analyzing the shell and core spectrograms responding to cytochalasin D at 50 μg/ml shown in
FIG. 16 . The core spectrogram at the bottom ofFIG. 16 shows an initially strong mid-frequency enhancement (shortly after time 0) caused by the weakening of the actin cortex that reduces the stiffness of the cell membrane. After two hours, there is a strong onset of low-frequency enhancement for both the shell and the core. However, the shell, shown in the top spectrogram inFIG. 16 , shows a strong enhancement of the high-frequencies (starting just before two hours) associated with vesicle and organelle transport that is missing in the core spectrogram response. This represents a significant physiological difference in the role of the drug for normoxic vs. hypoxic tissue. Based on the physiological processes of apoptosis (active transport requiring ATP and hence normal oxygen levels) relative to necrosis (passive degradation of the cell without need for ATP), this phenotypic difference can be tentatively ascribed to apoptosis in the shell as opposed to necrosis in the core. This assignment of high-frequency fluctuations associated with apoptosis is consistent with decorrelation times measured using OCT in vitro [44], and is also supported by confocal two-photon microscopy of these drugs on spheroids of these cell types. - The active transport that is present in the shell but missing in the core, combined with the presence of low-frequency enhancement that is common to both, suggests a metric that is the logical AND of both of the features to create an “apoptotic” index that quantitatively captures this feature. This index is constructed from the feature masks appropriate to the low- and high-frequency features, which are masks M6 and M12 of
FIG. 7 . The apoptotic index can be defined by: -
M i=sqrt(V 6 i)sqrt(V 12 i) -
A i =Rc{M i }−Im{M i} - in which V6 i and V12 i are the feature vector values for masks M6 and M12 (determined as discussed above). The difference between the real and the imaginary parts generates the logical AND with positive apoptotic indexes only for features that themselves are both positive.
- The apoptotic index was calculated for the shell and the core spectrograms and ranked in decreasing order by the shell. The apoptotic index of the shell response for the top eight apoptotic indexes is shown in
FIG. 17a above the zero line. The strongest apoptotic index is for the shell responding to cytochalasin at 50 μg/ml. Also shown inFIG. 17a below the zero line are the corresponding apoptotic indexes for the core responses in each case. For this set of 8 drug doses, that produced the strongest positive apoptotic indexes in the shell, the apoptotic index of the cores are all negative. In the cases when the shell has strong active transport in addition to strong low-frequency enhancements, the core is missing one or the other of these features. Upon closer inspection, the missing feature is the active transport band at high frequency in all cases. The key physiological aspect of the core is the lack of ATP to drive active processes, such as the formation of sequestering vesicles and apoptotic bodies. The negative apoptotic indexes of the core region for each of these drugs reflects the quiescent/hypoxic resistance of solid tumors to anti-cancer drugs. For instance, the anti-actin anti-mitotic drug cytochalasin D shows the strongest apoptotic index for the shell, but the strongest negative mitotic index for the core. Taxol and Colchicine also show strong differences in the apoptotic index between the shell and the core. - The independent validation for apoptotic processes to confirm their participation in the drug response was obtained through a series of multiphoton confocal microscopy experiments carried out using the UMR-106 spheroids. Spheroids were cultured at 37° C. in the presence of 10 μg/mL cytochalasin D, paclitaxel, and Colchicine for 4 hours and Iodoacetate for 3 hours. The live, apoptotic, and dead cells in the spheroid outer shell were visualized by optical section using a 20× water immersion objective up to a depth of 100 μm using Hoechst 33342 (live), Yo-Pro-1 (apoptotic), and propidium iodide (dead) (Invitrogen, Grand Island, N.Y.) vital dyes on a Nikon AIR multiphoton microscope with Mai Tai DeepSee tunable IR laser at 750 nm. The percentage of live, apoptotic, and dead cells in the spheroid outer shell was determined for six different spheroids. The results for Nocodazole, cytochalasin and Iodoacetate, all at 10 μg/ml, correspond to the upper line in the graph of
FIG. 17b . The data are ranked by decreasing apoptotic ratio. These data show that Nocodazole, cytochalasin and Iodoacetate all induce an apoptotic response in the tumor spheroids. The strongest apoptotic response is for 10 μg/ml Iodoacetate, which has the strongest apoptotic index inFIG. 17b . The bottom line in the graph ofFIG. 17b shows the corresponding data for the tissue dynamic spectroscopy shown inFIG. 17 a. - A key question about the drug-response spectrograms is how much information is contained in these data structures. There are many types of intracellular motions, including organelle transport, endo- and exocytosis, membrane undulations, cytoplasmic streaming, cytoskeletal rearrangements, force relaxation and shape changes, among others. While general trends in the spectrograms are understood in terms of these types of motion, it needs to be established how much information can be obtained from tissue dynamics spectroscopy.
- Information can be measured in terms of Shannon entropy. For a probability distribution p(x), the Shannon entropy is defined as:
-
- The probability distribution for the feature vectors of phenotypic profiling by tissue dynamics spectroscopy is obtained as the histogram of the values among the individual features. The entropy for the data in
FIGS. 12a-12b is shown inFIG. 18 for the fifteen features comparing the shell and core responses versus shell alone. The horizontal axis corresponds to the 15 features while the vertical axis represents the Shannon entropy value, which if applied to the feature vectors identifies how much information is obtained from the vectors. The entropy values for shell and core feature vectors are all moderately higher than for only shell feature vectors. The average entropy per channel is approximately two bits. - An important aspect of information analysis of a data structure like a drug-response spectrogram is the definition of joint and mutual entropies for joint probability distributions. These entropy measures arise when there is shared information among numerous channels. For instance, for two channels, the joint entropy is:
-
- and the mutual entropy is:
-
- where p(xi,yj) is the joint probability of two variables. The mutual entropy is equal to zero for independent variables, while M(x,y)=H(x)=H(y) for linearly dependent variables. Similarly, J(x,y)=H(x)+H(y) for independent variables, and J(x,y)=H(x)=H(y) for linearly dependent variables. In other words, when there are two channels that have perfect correlation, the total information content is simply the information content of a single channel.
- Examples of two-variable joint and mutual entropies are plotted in
FIGS. 19a and 19b for the fourteen features of the 60 drugs, doses and conditions of the spectrograms ofFIGS. 12a-12b . From the mutual entropy figure, there are cases of strong mutual information content among some pairs of channels, forinstance channel 11 andchannel 2 share almost 2 bits of information. (See,FIG. 19b ). - The joint entropy among three channels is:
-
- and by extension for n channels is:
-
- Therefore, the total information content of the drug-response spectrograms is obtained in the limit:
-
- To calculate the total information content of tissue dynamics spectroscopy, an expanded data set of 170 different drugs, doses and conditions (and hence 170 spectrograms) is shown in
FIG. 20 . The joint entropy for n=2, 3, 4 and 5 is shown inFIG. 21 . The asymptotic value in the limit of large n is 6.8 for the 170 spectrograms. Therefore, in the drug-response spectrograms, there are 6.8 bits of information per spectrogram. It is important to note that high-content screening (HCS) typically uses approximately this many channels. Therefore, tissue dynamics spectroscopy qualifies as a high-content screening approach for drug phenotypic profiling. - The drug-response spectrograms described above exhibit recognizable features that occur at characteristic frequency ranges at characteristic times after a dose and/or other stimuli is applied. Each spectrogram acts like a fingerprint, or more appropriately a voice print, showing a distinct pattern in response to the applied stimuli that is unique to the particular stimuli, which may be a particular drug and cell line. An analysis of the information content of the drug-response spectrograms based on Shannon entropy (as described in more detail above) indicates that more than 144 distinct spectrograms can be distinguished from one another, which can thereby be used to establish 144 different “classes” for compound/cell-line classifiers.
- The present disclosure contemplates feature recognition and quantification of the drug-response spectrograms from projections of the spectrograms onto feature masks. The time axis of spectrograms primarily captures relaxation which is typically exponential. The frequency axis is the Fourier transform of the autocorrelation function, which is typically exponentially correlated. Thus, both the time and frequency axes are characterized by Laplace transforms for which there is no orthonormal basis. Consequently, in one aspect the systems and methods disclosed herein apply matched filtering in which characteristic regions of the spectrograms can be interpreted mechanistically. For instance, as discussed above low frequencies correspond to slow cellular shape changes like blebbing, mid frequencies correspond to membrane undulations and high frequencies correspond to membrane vesicles or internal organelle motions. These processes and frequencies present natural frequency ranges that are used to generate the feature masks, such as the masks shown in
FIG. 7 . - The inner product of each mask with a drug response spectrogram generates a feature vector that serves as the fingerprint for that particular drug. For instance, the feature vector for
pH 9 is shown inFIG. 10 . The feature vector illuminates the sensitivity of some features of the associated spectrogram, such as the organelle transport in the high frequency range after one hour, mid-frequency suppression of delayed undulations after four hours, delayed membrane at the low frequencies after 3½ hours and an initial hormetic response. The feature masks capture these changes in the feature vector for the particular stimuli response. - As described above, 15 feature vectors can be used corresponding to five frequency ranges across three time frames (although other frequency and time frame divisions can be utilized) and a similarity matrix is constructed from the correlation coefficients among the many pairs of feature vectors for different drugs and cell lines. A clustering algorithm (such as unsupervised hierarchical clustering) can be applied to the similarity matrix to order the tissue-response spectrograms of the different drugs and cell lines into groups based on the similarity of their response. The result is a clustered matrix that exhibits a block diagonal structure which is indicative that groups with high similarity have little overlap with other groups. By comparing a feature vector with the groupings it is possible to assign physiological attributes to the different groups. It is this quasi-orthogonality among the groups that provides the basis for phenotypic classification schemes in which a new lead compound of unknown mechanism may be compared against a reference compound library of dynamic tissue response spectrograms having known mechanisms of action.
- To improve on the results from the clustering approach, the present system and method contemplates the use of multidimensional scaling to more faithfully represent the closeness and farness of compound/cell type groupings and to display the information in a readily understandable format. The result is a two dimensional map with nodes corresponding to stimuli distributed in a manner that retains the order of distances found in the similarity matrix, such as the Venn diagram shown in
FIG. 14 . Similar drug responses are grouped closely and farther from other unrelated drug responses. The map or Venn diagram thus provides a ready means to determine the expected phenotypic response of a new drug based on its proximity to other drugs in a grouping. For instance, if a new condition isOSM 154, a quick review of the map ofFIG. 14 would reveal that the phenotypic response is blebbing and similar to the response of pH6, among other drugs/doses. - The feature masks, feature vectors, similarity matrices, clustering and multi-dimensional scaling all readily lend themselves to implementation in software. Thus, the drug screening process can be significantly automated from the generation of the spectrogram for a new drug/stimuli to the presentation of a Venn diagram similar to
FIG. 14 from which the expected physiological response of a new drug can be readily discerned. The systems and methods disclosed herein can thus significantly reduce the amount of time required to assess a new drug. More importantly the multi-dimensional scaling approaches implemented herein more accurately align drugs/conditions having similar physiological responses, which can significantly reduce, if not eliminate, the risk of false positives and false negatives. - A library of known drugs/conditions and associated spectrograms can provide the foundation for the analysis of a new drug/stimuli/condition. All of the known drugs/conditions can be incorporated into a similarity matrix with the spectrogram of one or more new drugs/conditions to produce the clustered matrices and maps described above. In other words, as new drugs are categorized based on their physiological response they can be added to the library from which comparisons can be made for future drugs/conditions. Since the methods described herein can be readily implemented in software, the time required to validate or screen a new drug can be significantly reduced.
- While the invention has been illustrated and described in detail in the drawings and foregoing description, the same should be considered as illustrative and not restrictive in character. It is understood that only the preferred embodiments have been presented and that all changes, modifications and further applications that come within the spirit of the invention are desired to be protected.
-
- [1] C. Ainsworth, “NETWORKING FOR NEW DRUGS,” Nature Medicine, vol. 17, pp. 1166-1168, October 2011.
- [2] C. T. Keith, A. A. Borisy, and B. R. Stockwell, “Multicomponent therapeutics for networked systems,” Nature Reviews Drug Discovery, vol. 4, pp. 71-U10, January 2005.
- [3] D. C. Swinney and J. Anthony, “How were new medicines discovered?,” Nature Reviews Drug Discovery, vol. 10, pp. 507-519, July 2011.
- [4] P. Hamer, S. Leenstra, C. J. F. Van Noorden, and A. H. Zwinderman, “Organotypic Glioma Spheroids for Screening of Experimental Therapies: How Many Spheroids and Sections are Required?,” Cytometry Part A, vol. 75A, pp. 528-534, June 2009.
- [5] J. Poland, P. Sinha, A. Siegert, M. Schnolzer, U. Korf, and S. Hauptmann, “Comparison of protein expression profiles between monolayer and spheroid cell culture of HT-29 cells revealed fragmentation of CK18 in three-dimensional cell culture,” Electrophoresis, vol. 23, pp. 1174-1184, April 2002.
- [6] K. Dardousis, C. Voolstra, M. Roengvoraphoj, A. Sekandarzad, S. Mesghenna, J. Winkler, Y. Ko, J. Hescheler, and A. Sachinidis, “Identification of differentially expressed genes involved in the formation of multicellular tumor spheroids by HT-29 colon carcinoma cells,” Molecular Therapy, vol. 15, pp. 94-102, January 2007.
- [7] N. A. L. Cody, M. Zietarska, A. Filali-Mouhim, D. M. Provencher, A. M. Mes-Masson, and P. N. Tonin, “Influence of monolayer, spheroid, and tumor growth conditions on
chromosome 3 gene expression in tumorigenic epithelial ovarian cancer cell lines,” Bmc Medical Genomics, vol. 1, Aug. 7, 2008. - [8] M. Zietarska, C. M. Maugard, A. Filali-Mouhim, M. Alam-Fahmy, P. N. Tonin, D. M. Provencher, and A. M. Mes-Masson, “Molecular description of a 3D in vitro model for the study of epithelial ovarian cancer (EOC),” Molecular Carcinogenesis, vol. 46, pp. 872-885, October 2007.
- [9] T. T. Chang and M. Hughes-Fulford, “Monolayer and Spheroid Culture of Human Liver Hepatocellular Carcinoma Cell Line Cells Demonstrate Distinct Global Gene Expression Patterns and Functional Phenotypes,” Tissue Engineering Part A, vol. 15, pp. 559-567, March 2009.
- [10] M. Shimada, Y. Yamashita, S. Tanaka, K. Shirabe, K. Nakazawa, H. Ijima, R. Sakiyama, J. Fukuda, K. Funatsu, and K. Sugimachi, “Characteristic gene expression induced by polyurethane foam/spheroid culture of hepatoma cell line, Hep G2 as a promising cell source for bioartificial liver,” Hepato-Gastroenterology, vol. 54, pp. 814-820, April-May 2007.
- [11] Y. Yamashita, M. Shimada, N. Harimoto, S. Tanaka, K. Shirabe, H. Ijima, K. Nakazawa, J. Fukuda, K. Funatsu, and Y. Maehara, “cDNA microarray analysis in hepatocyte differentiation in
Huh 7 cells,” Cell Transplantation, vol. 13, pp. 793-799, 2004. - [12] L. Gaedtke, L. Thoenes, C. Culmsee, B. Mayer, and E. Wagner, “Proteomic analysis reveals differences in protein expression in spheroid versus monolayer cultures of low-passage colon carcinoma cells,” Journal of Proteome Research, vol. 6, pp. 4111-4118, November 2007.
- [13] A. Frankel, R. Buckman, and R. S. Kerbel, “Abrogation of taxol-induced G(2)-M arrest and apoptosis in human ovarian cancer cells grown as multicellular tumor spheroids,” Cancer Research, vol. 57, pp. 2388-2393, Jun. 15, 1997.
- [14] L. A. Hazlehurst, T. H. Landowski, and W. S. Dalton, “Role of the tumor microenvironment in mediating de novo resistance to drugs and physiological mediators of cell death,” Oncogene, vol. 22, pp. 7396-7402, Oct. 20, 2003.
- [15] I. Serebriiskii, R. Castello-Cros, A. Lamb, E. A. Golemis, and E. Cukierman, “Fibroblast-derived 3D matrix differentially regulates the growth and drug-responsiveness of human cancer cells,” Matrix Biology, vol. 27, pp. 573-585, July 2008.
- [16] L. David, V. Dulong, D. Le Cerf, L. Cazin, M. Lamacz, and J. P. Vannier, “Hyaluronan hydrogel: An appropriate three-dimensional model for evaluation of anticancer drug sensitivity,” Acta Biomaterialia, vol. 4, pp. 256-263, March 2008.
- [17] R. C. Youngquist, S. Carr, and D. E. N. Davies, “Optical coherence-domain reflectometry: a new optical evaluation technique,” Opt. Lett., vol. 12, p. 158, 1987.
- [18] M. Suissa, C. Place, E. Goillot, and E. Freyssingeas, “Internal dynamics of a living cell nucleus investigated by dynamic light scattering,” European Physical Journal E, vol. 26, pp. 435-448, August 2008.
- [19] X. L. Nan, P. A. Sims, and X. S. Xie, “Organelle tracking in a living cell with microsecond time resolution and nanometer spatial precision,” Chemphyschem, vol. 9, pp. 707-712, Apr. 4, 2008.
- [20] K. J. Karnaky, L. T. Garretson, and R. G. Oneil, “Video-Enhanced Microscopy of Organelle Movement in an Intact Epithelium,” Journal of Morphology, vol. 213, pp. 21-31, July 1992.
- [21] N. A. Brazhe, A. R. Brazhe, A. N. Pavlov, L. A. Erokhova, A. I. Yusipovich, G. V. Maksimov, E. Mosekilde, and O. V. Sosnovtseva, “Unraveling cell processes: Interference imaging interwoven with data analysis,” Journal of Biological Physics, vol. 32, pp. 191-208, October 2006.
- [22] B. Trinczek, A. Ebneth, and E. Mandelkow, “Tau regulates the attachment/detachment but not the speed of motors in microtubule-dependent transport of single vesicles and organelles,” Journal of Cell Science, vol. 112, pp. 2355-2367, July 1999.
- [23] F. Brochard and J. F. Lennon, “Frequency Spectrum of Flicker Phenomenon in Erythrocytes,” Journal De Physique, vol. 36, pp. 1035-1047, 1975.
- [24] H. Strey and M. Peterson, “Measurement of Erythrocyte-Membrane Elasticity by Flicker Eigenmode Decomposition,” Biophysical Journal, vol. 69, pp. 478-488, August 1995.
- [25] A. Zilker, M. Ziegler, and E. Sackmann, “Spectral-Analysis of Erythrocyte Flickering in the 0.3-4-Mu-M-1 Regime by Microinterferometry Combined with Fast Image-Processing,” Physical Review A, vol. 46, pp. 7998-8002, Dec. 15, 1992.
- [26] M. A. Peterson, H. Strey, and E. Sackmann, “Theoretical and Phase-Contrast Microscopic Eigenmode Analysis of Erythrocyte Flicker—Amplitudes,” Journal De Physique Ii, vol. 2, pp. 1273-1285, May 1992.
- [27] Y. Z. Yoon, H. Hong, A. Brown, D. C. Kim, D. J. Kang, V. L. Lew, and P. Cicuta, “Flickering Analysis of Erythrocyte Mechanical Properties: Dependence on Oxygenation Level, Cell Shape, and Hydration Level,” Biophysical Journal, vol. 97, pp. 1606-1615, Sep. 16, 2009.
- [28] J. Evans, W. Gratzer, N. Mohandas, K. Parker, and J. Sleep, “Fluctuations of the red blood cell membrane: Relation to mechanical properties and lack of ATP dependence,” Biophysical Journal, vol. 94, pp. 4134-4144, May 15, 2008.
- [29] V. Racine, M. Sachse, J. Salamero, V. Fraisier, A. Trubuil, and J. B. Sibarita, “Visualization and quantification of vesicle trafficking on a three-dimensional cytoskeleton network in living cells,” Journal Of Microscopy-Oxford, vol. 225, pp. 214-228, March 2007.
- [30] Ifeachor, E. and B. Jervis (2001). Digital Signal Processing: A Practical Approach, Prentice Hall.
- [31] Nolte, D. D., R. An, et al. (2011). “Holographic tissue dynamics spectroscopy.” Journal of Biomedical Optics 16(8): 087004-087013.
- [32] Johnson, R. A. (2001). Applied Multivariate Statistical Analysis, Prentice Hall.
- [33] Andreopoulos, B., A. J. An, et al. (2009). “A roadmap of clustering algorithms: finding a match for a biomedical application.” Briefings in Bioinformatics 10(3): 297-314.
- [34] Lampert, T. A. and S. E. M. O'Keefe (2010). “A survey of spectrogram track detection algorithms.” Applied Acoustics 71(2): 87-100.
- [35] Venkatasubramanian, R., M. A. Henson, et al. (2006). “Incorporating energy metabolism into a growth model of multicellular tumor spheroids.” Journal of Theoretical Biology 242(2): 440-453.
- [36] Mellor, H. R., D. J. P. Ferguson, et al. (2005). “A model of quiescent tumour microregions for evaluating multicellular resistance to chemotherapeutic drugs.” British Journal of Cancer 93(3): 302-309.
- [37] Fayad, W., L. Rickardson, et al. (2011). “Identification of Agents that Induce Apoptosis of Multicellular Tumour Spheroids: Enrichment for Mitotic Inhibitors with Hydrophobic Properties.” Chemical Biology & Drug Design 78(4): 547-557.
- [38] Zhou, J., T. Schmid, et al. (2006). “Tumor hypoxia and cancer progression.” Cancer Letters 237(1): 10-21.
- [39] Gillies, R. J. and R. A. Gatenby (2007). “Hypoxia and adaptive landscapes in the evolution of carcinogenesis.” Cancer and Metastasis Reviews 26(2): 311-317.
- [40] Sullivan, R. and C. H. Graham (2007). “Hypoxia-driven selection of the metastatic phenotype.” Cancer and Metastasis Reviews 26(2): 319-331.
- [41] Gort, E. H., A. J. Groot, et al. (2008). “Hypoxic regulation of metastasis via hypoxia-inducible factors.” Current Molecular Medicine 8(1): 60-67.
- [42] Klymkowsky, M. W. and P. Savagner (2009). “Epithelial-Mesenchymal Transition A Cancer Researcher's Conceptual Friend and Foe.” American Journal of Pathology 174(5): 1588-1593.
- [43] Yan, W., Y. Fu, et al. (2009). “PI3 kinase/Akt signaling mediates epithelial-mesenchymal transition in hypoxic hepatocellular carcinoma cells.” Biochemical and Biophysical Research Communications 382(3): 631-636.
- [44] Farhat, G., A. Mariampillai, et al. (2011). “Detecting apoptosis using dynamic light scattering with optical coherence tomography.” Journal of Biomedical Optics 16(7).
Claims (27)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US13/760,827 US10426348B2 (en) | 2008-03-05 | 2013-02-06 | Using differential time-frequency tissue-response spectroscopy to evaluate living body response to a drug |
Applications Claiming Priority (9)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US3402808P | 2008-03-05 | 2008-03-05 | |
PCT/US2009/036124 WO2009111609A2 (en) | 2008-03-05 | 2009-03-05 | Method and apparatus for motility contrast imaging |
US39788510P | 2010-06-17 | 2010-06-17 | |
US12/874,855 US8886295B2 (en) | 2008-03-05 | 2010-09-02 | Method and apparatus for motility contrast imaging |
PCT/US2011/040954 WO2011160064A1 (en) | 2010-06-17 | 2011-06-17 | Digital holographic method of measuring cellular activity and of using results to screen compounds |
PCT/US2011/040959 WO2011160068A1 (en) | 2010-06-17 | 2011-06-17 | Digital holographic method of measuring cellular activity and measuring apparatus with improved stability |
US201213704464A | 2012-12-14 | 2012-12-14 | |
US201213704438A | 2012-12-14 | 2012-12-14 | |
US13/760,827 US10426348B2 (en) | 2008-03-05 | 2013-02-06 | Using differential time-frequency tissue-response spectroscopy to evaluate living body response to a drug |
Related Parent Applications (6)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US12/874,855 Continuation-In-Part US8886295B2 (en) | 2008-03-05 | 2010-09-02 | Method and apparatus for motility contrast imaging |
US13/704,464 Continuation-In-Part US9977859B2 (en) | 2010-06-17 | 2011-06-17 | Digital holographic method of measuring cellular activity and of using results to screen compounds |
PCT/US2011/040959 Continuation-In-Part WO2011160068A1 (en) | 2008-03-05 | 2011-06-17 | Digital holographic method of measuring cellular activity and measuring apparatus with improved stability |
PCT/US2011/040954 Continuation-In-Part WO2011160064A1 (en) | 2008-03-05 | 2011-06-17 | Digital holographic method of measuring cellular activity and of using results to screen compounds |
US13/704,438 Continuation-In-Part US9514271B2 (en) | 2010-06-17 | 2011-06-17 | Digital holographic method of measuring cellular activity and measuring apparatus with improved stability |
US13/760,827 Continuation-In-Part US10426348B2 (en) | 2008-03-05 | 2013-02-06 | Using differential time-frequency tissue-response spectroscopy to evaluate living body response to a drug |
Related Child Applications (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US12/874,855 Continuation US8886295B2 (en) | 2008-03-05 | 2010-09-02 | Method and apparatus for motility contrast imaging |
US13/760,827 Continuation-In-Part US10426348B2 (en) | 2008-03-05 | 2013-02-06 | Using differential time-frequency tissue-response spectroscopy to evaluate living body response to a drug |
Publications (3)
Publication Number | Publication Date |
---|---|
US20130144151A1 US20130144151A1 (en) | 2013-06-06 |
US20170156598A9 true US20170156598A9 (en) | 2017-06-08 |
US10426348B2 US10426348B2 (en) | 2019-10-01 |
Family
ID=48524491
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US13/760,827 Active 2030-05-28 US10426348B2 (en) | 2008-03-05 | 2013-02-06 | Using differential time-frequency tissue-response spectroscopy to evaluate living body response to a drug |
Country Status (1)
Country | Link |
---|---|
US (1) | US10426348B2 (en) |
Families Citing this family (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2009039303A1 (en) * | 2007-09-19 | 2009-03-26 | State University Of New York At Stony Brook | Optical coherence tomography systems and methods |
US11195119B2 (en) | 2018-01-05 | 2021-12-07 | International Business Machines Corporation | Identifying and visualizing relationships and commonalities amongst record entities |
JP7462191B2 (en) * | 2020-02-07 | 2024-04-05 | 株式会社Essホールディングス | Search method and search device |
CN115099287B (en) * | 2022-08-24 | 2022-11-11 | 山东大学 | Space variable gene identification and analysis system based on graph Fourier transform |
Family Cites Families (40)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US4674824A (en) | 1985-06-14 | 1987-06-23 | Stanford University | System for enhancement of optical features |
US6016223A (en) | 1992-08-31 | 2000-01-18 | Canon Kabushiki Kaisha | Double bessel beam producing method and apparatus |
US5682262A (en) | 1995-12-13 | 1997-10-28 | Massachusetts Institute Of Technology | Method and device for generating spatially and temporally shaped optical waveforms |
EP0876595B1 (en) | 1996-01-26 | 2002-11-27 | Roche Diagnostics GmbH | Low-coherence interferometric device |
US6014204A (en) | 1998-01-23 | 2000-01-11 | Providence Health System | Multiple diameter fiber optic device and process of using the same |
US6053613A (en) | 1998-05-15 | 2000-04-25 | Carl Zeiss, Inc. | Optical coherence tomography with new interferometer |
FR2783323B1 (en) | 1998-09-10 | 2000-10-13 | Suisse Electronique Microtech | INTERFEROMETRIC DEVICE TO DETECT THE CHARACTERISTICS OF OPTICAL REFLECTION AND / OR TRANSMISSION IN DEPTH OF AN OBJECT |
US6262818B1 (en) | 1998-10-07 | 2001-07-17 | Institute Of Applied Optics, Swiss Federal Institute Of Technology | Method for simultaneous amplitude and quantitative phase contrast imaging by numerical reconstruction of digital holograms |
US6195168B1 (en) | 1999-07-22 | 2001-02-27 | Zygo Corporation | Infrared scanning interferometry apparatus and method |
US6744909B1 (en) | 1999-08-19 | 2004-06-01 | Physical Optics Corporation | Authentication system and method |
US6556305B1 (en) | 2000-02-17 | 2003-04-29 | Veeco Instruments, Inc. | Pulsed source scanning interferometer |
EP1356268A2 (en) | 2001-02-01 | 2003-10-29 | The Johns Hopkins University | Mass spectrometric analysis of complex mixtures of immune system modulators |
US6980299B1 (en) | 2001-10-16 | 2005-12-27 | General Hospital Corporation | Systems and methods for imaging a sample |
IL148664A0 (en) | 2002-03-13 | 2002-09-12 | Yeda Res & Dev | Auto-focusing method and device |
AU2003245458A1 (en) | 2002-06-12 | 2003-12-31 | Advanced Research And Technology Institute, Inc. | Method and apparatus for improving both lateral and axial resolution in ophthalmoscopy |
WO2004073501A2 (en) | 2003-02-20 | 2004-09-02 | Gutin Mikhail | Optical coherence tomography with 3d coherence scanning |
ATE356968T1 (en) | 2003-05-16 | 2007-04-15 | Univ Bruxelles | DIGITAL HOLOGRAPHIC MICROSCOPE FOR THREE-DIMENSIONAL IMAGING AND METHOD OF USE THEREOF |
US7057720B2 (en) | 2003-06-24 | 2006-06-06 | Corning Incorporated | Optical interrogation system and method for using same |
WO2005054780A1 (en) | 2003-11-28 | 2005-06-16 | The General Hospital Corporation | Method and apparatus for three-dimensional spectrally encoded imaging |
US20050239111A1 (en) * | 2004-04-14 | 2005-10-27 | Icagen, Inc. | Method for screening compounds using consensus selection and multiple descriptor sets |
US7327463B2 (en) | 2004-05-14 | 2008-02-05 | Medrikon Corporation | Low coherence interferometry utilizing magnitude |
US7763112B2 (en) | 2005-04-29 | 2010-07-27 | Transform Pharmaceuticals, Inc. | Methods and systems for co-crystal synthesis |
US7452681B2 (en) | 2005-05-05 | 2008-11-18 | The Regents Of The University Of California | Diagnostic methods for the detection of autism spectrum disorder |
GB0515758D0 (en) | 2005-07-30 | 2005-09-07 | Univ Hospital Of North Staffor | Improvements in and relating to optical coherence tomography |
KR20080043843A (en) | 2005-08-16 | 2008-05-19 | 스킨 캔서 스캐닝 리미티드 | Combined visual-optic and passive infrared technologies and the corresponding system for detection and idetification of skin cancer precursors, nevi and tumors for early diagnosis |
EP1840623B1 (en) | 2006-03-31 | 2013-05-08 | Yokogawa Electric Corporation | Microscope comprising a focus error detecting optical system |
US20080097183A1 (en) | 2006-09-06 | 2008-04-24 | Donald Martin Monro | Passive in vivo substance spectroscopy |
US8180134B2 (en) | 2006-09-26 | 2012-05-15 | Oregon Health & Science University | In vivo structural and flow imaging |
US20080277595A1 (en) | 2007-05-10 | 2008-11-13 | Pacific Biosciences Of California, Inc. | Highly multiplexed confocal detection systems and methods of using same |
US8647272B2 (en) | 2007-06-21 | 2014-02-11 | Rf Science & Technology Inc | Non-invasive scanning apparatuses |
JP5070995B2 (en) | 2007-08-29 | 2012-11-14 | 横河電機株式会社 | Confocal microscope |
JP5476659B2 (en) | 2007-09-14 | 2014-04-23 | 株式会社リコー | Multi-beam optical scanning device and image forming apparatus |
US8983580B2 (en) | 2008-01-18 | 2015-03-17 | The Board Of Trustees Of The University Of Illinois | Low-coherence interferometry and optical coherence tomography for image-guided surgical treatment of solid tumors |
WO2009111609A2 (en) | 2008-03-05 | 2009-09-11 | Purdue Research Foundation | Method and apparatus for motility contrast imaging |
US8440952B2 (en) | 2008-11-18 | 2013-05-14 | The Regents Of The University Of California | Methods for optical amplified imaging using a two-dimensional spectral brush |
US8004688B2 (en) | 2008-11-26 | 2011-08-23 | Zygo Corporation | Scan error correction in low coherence scanning interferometry |
US7952723B2 (en) | 2008-12-05 | 2011-05-31 | Kowa Company Ltd. | Optical coherence tomography apparatus |
WO2011037980A2 (en) | 2009-09-22 | 2011-03-31 | Bioptigen, Inc. | Systems for extended depth frequency domain optical coherence tomography (fdoct) and related methods |
US8508746B2 (en) | 2010-03-30 | 2013-08-13 | Duke University | Interferometric systems having reflective chambers and related methods |
US8913245B2 (en) | 2010-06-29 | 2014-12-16 | Kla-Tencor Corporation | System and method for interferometric autofocusing |
-
2013
- 2013-02-06 US US13/760,827 patent/US10426348B2/en active Active
Also Published As
Publication number | Publication date |
---|---|
US10426348B2 (en) | 2019-10-01 |
US20130144151A1 (en) | 2013-06-06 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
Nolte et al. | Tissue dynamics spectroscopy for phenotypic profiling of drug effects in three-dimensional culture | |
Hejna et al. | High accuracy label-free classification of single-cell kinetic states from holographic cytometry of human melanoma cells | |
Choi et al. | Biodynamic digital holography of chemoresistance in a pre-clinical trial of canine B-cell lymphoma | |
Silvestri et al. | Quantitative neuroanatomy of all Purkinje cells with light sheet microscopy and high-throughput image analysis | |
Helmstaedter et al. | L2/3 interneuron groups defined by multiparameter analysis of axonal projection, dendritic geometry, and electrical excitability | |
US10426348B2 (en) | Using differential time-frequency tissue-response spectroscopy to evaluate living body response to a drug | |
Strbkova et al. | Automated classification of cell morphology by coherence-controlled holographic microscopy | |
CN111194407A (en) | Label-free method and system for measuring pharmacokinetics of three-dimensional cellular structures | |
Du et al. | Interactive segmentation of clustered cells via geodesic commute distance and constrained density weighted Nyström method | |
Martinez-Sanchez et al. | A ridge-based framework for segmentation of 3D electron microscopy datasets | |
Yu et al. | Mesoscale correlation structure with single cell resolution during visual coding | |
Guo et al. | iSegMSI: an interactive strategy to improve spatial segmentation of mass spectrometry imaging data | |
Gardner et al. | Two-dimensional and three-dimensional time-of-flight secondary ion mass spectrometry image feature extraction using a spatially aware convolutional autoencoder | |
Zepeda O et al. | Untying the gordian KNOT: Unbiased single particle tracking using point clouds and adaptive motion analysis | |
Orlov et al. | Automatic detection of melanoma progression by histological analysis of secondary sites | |
Bhanu et al. | Video bioinformatics | |
Li et al. | Detection and tracking of overlapping cell nuclei for large scale mitosis analyses | |
Kazmar et al. | Learning cellular texture features in microscopic cancer cell images for automated cell-detection | |
Mirzapoiazova et al. | Monitoring and determining mitochondrial network parameters in live lung cancer cells | |
US20150124259A1 (en) | Method For Biodynamic Spectroscope Imaging | |
Li et al. | Density center-based fast clustering of widefield fluorescence imaging of cortical mesoscale functional connectivity and relation to structural connectivity | |
McKeen Polizzotti et al. | Novel image analysis approach quantifies morphological characteristics of 3D breast culture acini with varying metastatic potentials | |
Liu et al. | Full-Spectrum Neuronal Diversity and Stereotypy through Whole Brain Morphometry | |
Ruan et al. | Image-derived models of cell organization changes during differentiation and drug treatments | |
Koestinger et al. | Translaminar circuits formed by the pyramidal cells in the superficial layers of cat visual cortex |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AS | Assignment |
Owner name: PURDUE RESEARCH FOUNDATION, INDIANA Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:NOLTE, DAVID;TUREK, JOHN J.;SIGNING DATES FROM 20130205 TO 20130206;REEL/FRAME:031060/0189 |
|
AS | Assignment |
Owner name: NATIONAL SCIENCE FOUNDATION, VIRGINIA Free format text: CONFIRMATORY LICENSE;ASSIGNOR:PURDUE UNIVERSITY;REEL/FRAME:035751/0113 Effective date: 20130214 |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: NON FINAL ACTION MAILED |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: RESPONSE TO NON-FINAL OFFICE ACTION ENTERED AND FORWARDED TO EXAMINER |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: NOTICE OF ALLOWANCE MAILED -- APPLICATION RECEIVED IN OFFICE OF PUBLICATIONS |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: PUBLICATIONS -- ISSUE FEE PAYMENT VERIFIED |
|
STCF | Information on status: patent grant |
Free format text: PATENTED CASE |
|
FEPP | Fee payment procedure |
Free format text: SURCHARGE FOR LATE PAYMENT, SMALL ENTITY (ORIGINAL EVENT CODE: M2554); ENTITY STATUS OF PATENT OWNER: SMALL ENTITY |
|
MAFP | Maintenance fee payment |
Free format text: PAYMENT OF MAINTENANCE FEE, 4TH YR, SMALL ENTITY (ORIGINAL EVENT CODE: M2551); ENTITY STATUS OF PATENT OWNER: SMALL ENTITY Year of fee payment: 4 |