CA3053009A1 - Optics, device, and system for assaying - Google Patents
Optics, device, and system for assayingInfo
- Publication number
- CA3053009A1 CA3053009A1 CA3053009A CA3053009A CA3053009A1 CA 3053009 A1 CA3053009 A1 CA 3053009A1 CA 3053009 A CA3053009 A CA 3053009A CA 3053009 A CA3053009 A CA 3053009A CA 3053009 A1 CA3053009 A1 CA 3053009A1
- Authority
- CA
- Canada
- Prior art keywords
- sample
- optical
- optical assembly
- light
- imaging
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000003384 imaging method Methods 0.000 claims abstract description 255
- 230000003287 optical effect Effects 0.000 claims description 445
- 238000005286 illumination Methods 0.000 claims description 144
- 125000006850 spacer group Chemical group 0.000 claims description 118
- 239000007788 liquid Substances 0.000 claims description 76
- 239000000835 fiber Substances 0.000 claims description 32
- 239000013307 optical fiber Substances 0.000 claims description 31
- 230000005284 excitation Effects 0.000 claims description 26
- 239000000758 substrate Substances 0.000 claims description 21
- 239000006096 absorbing agent Substances 0.000 claims description 20
- 238000012545 processing Methods 0.000 claims description 19
- 230000037361 pathway Effects 0.000 claims description 16
- 230000005540 biological transmission Effects 0.000 claims description 6
- 238000010521 absorption reaction Methods 0.000 claims description 4
- 238000000799 fluorescence microscopy Methods 0.000 claims description 4
- 230000004044 response Effects 0.000 claims description 4
- 230000000903 blocking effect Effects 0.000 claims description 2
- 230000001419 dependent effect Effects 0.000 claims description 2
- 230000010287 polarization Effects 0.000 claims description 2
- 239000010409 thin film Substances 0.000 claims description 2
- 238000000034 method Methods 0.000 abstract description 141
- 239000000523 sample Substances 0.000 description 560
- 238000010186 staining Methods 0.000 description 76
- 239000003795 chemical substances by application Substances 0.000 description 61
- 238000001514 detection method Methods 0.000 description 60
- 239000012491 analyte Substances 0.000 description 58
- 210000001519 tissue Anatomy 0.000 description 57
- 238000004422 calculation algorithm Methods 0.000 description 38
- 230000008859 change Effects 0.000 description 30
- 238000003825 pressing Methods 0.000 description 30
- 230000001105 regulatory effect Effects 0.000 description 29
- 238000000151 deposition Methods 0.000 description 26
- WZUVPPKBWHMQCE-UHFFFAOYSA-N Haematoxylin Chemical compound C12=CC(O)=C(O)C=C2CC2(O)C1C1=CC=C(O)C(O)=C1OC2 WZUVPPKBWHMQCE-UHFFFAOYSA-N 0.000 description 24
- 210000004027 cell Anatomy 0.000 description 23
- 230000008569 process Effects 0.000 description 23
- -1 reservoirs Substances 0.000 description 22
- 238000012360 testing method Methods 0.000 description 22
- 238000012549 training Methods 0.000 description 21
- 238000010295 mobile communication Methods 0.000 description 20
- 238000003860 storage Methods 0.000 description 18
- 230000009977 dual effect Effects 0.000 description 17
- 239000000427 antigen Substances 0.000 description 16
- 102000036639 antigens Human genes 0.000 description 16
- 108091007433 antigens Proteins 0.000 description 16
- 239000000243 solution Substances 0.000 description 15
- 238000004458 analytical method Methods 0.000 description 14
- 210000004369 blood Anatomy 0.000 description 14
- 239000008280 blood Substances 0.000 description 14
- 238000013461 design Methods 0.000 description 13
- 238000007901 in situ hybridization Methods 0.000 description 13
- 238000003325 tomography Methods 0.000 description 13
- 239000002981 blocking agent Substances 0.000 description 12
- 238000012546 transfer Methods 0.000 description 11
- 101000863856 Homo sapiens Shiftless antiviral inhibitor of ribosomal frameshifting protein Proteins 0.000 description 10
- 230000006870 function Effects 0.000 description 10
- RBTBFTRPCNLSDE-UHFFFAOYSA-N 3,7-bis(dimethylamino)phenothiazin-5-ium Chemical compound C1=CC(N(C)C)=CC2=[S+]C3=CC(N(C)C)=CC=C3N=C21 RBTBFTRPCNLSDE-UHFFFAOYSA-N 0.000 description 9
- 239000003153 chemical reaction reagent Substances 0.000 description 9
- 230000008021 deposition Effects 0.000 description 9
- 230000004807 localization Effects 0.000 description 9
- 229960000907 methylthioninium chloride Drugs 0.000 description 9
- 108091032973 (ribonucleotides)n+m Proteins 0.000 description 8
- 238000003556 assay Methods 0.000 description 8
- 238000007398 colorimetric assay Methods 0.000 description 8
- 238000013527 convolutional neural network Methods 0.000 description 8
- 238000000386 microscopy Methods 0.000 description 8
- 230000009466 transformation Effects 0.000 description 8
- 238000004737 colorimetric analysis Methods 0.000 description 7
- YQGOJNYOYNNSMM-UHFFFAOYSA-N eosin Chemical compound [Na+].OC(=O)C1=CC=CC=C1C1=C2C=C(Br)C(=O)C(Br)=C2OC2=C(Br)C(O)=C(Br)C=C21 YQGOJNYOYNNSMM-UHFFFAOYSA-N 0.000 description 7
- 239000003550 marker Substances 0.000 description 7
- 230000008901 benefit Effects 0.000 description 6
- 210000001175 cerebrospinal fluid Anatomy 0.000 description 6
- 210000002939 cerumen Anatomy 0.000 description 6
- 238000003745 diagnosis Methods 0.000 description 6
- 238000009826 distribution Methods 0.000 description 6
- 230000033001 locomotion Effects 0.000 description 6
- 238000010801 machine learning Methods 0.000 description 6
- 239000012188 paraffin wax Substances 0.000 description 6
- 239000008191 permeabilizing agent Substances 0.000 description 6
- 241000894007 species Species 0.000 description 6
- NALREUIWICQLPS-UHFFFAOYSA-N 7-imino-n,n-dimethylphenothiazin-3-amine;hydrochloride Chemical compound [Cl-].C1=C(N)C=C2SC3=CC(=[N+](C)C)C=CC3=NC2=C1 NALREUIWICQLPS-UHFFFAOYSA-N 0.000 description 5
- 108020004414 DNA Proteins 0.000 description 5
- 108020005187 Oligonucleotide Probes Proteins 0.000 description 5
- 239000000975 dye Substances 0.000 description 5
- ZBQZBWKNGDEDOA-UHFFFAOYSA-N eosin B Chemical compound O1C(=O)C2=CC=CC=C2C21C1=CC([N+]([O-])=O)=C(O)C(Br)=C1OC1=C2C=C([N+]([O-])=O)C(O)=C1Br ZBQZBWKNGDEDOA-UHFFFAOYSA-N 0.000 description 5
- SEACYXSIPDVVMV-UHFFFAOYSA-L eosin Y Chemical compound [Na+].[Na+].[O-]C(=O)C1=CC=CC=C1C1=C2C=C(Br)C(=O)C(Br)=C2OC2=C(Br)C([O-])=C(Br)C=C21 SEACYXSIPDVVMV-UHFFFAOYSA-L 0.000 description 5
- GNBHRKFJIUUOQI-UHFFFAOYSA-N fluorescein Chemical compound O1C(=O)C2=CC=CC=C2C21C1=CC=C(O)C=C1OC1=CC(O)=CC=C21 GNBHRKFJIUUOQI-UHFFFAOYSA-N 0.000 description 5
- 230000002055 immunohistochemical effect Effects 0.000 description 5
- 230000031700 light absorption Effects 0.000 description 5
- 239000000463 material Substances 0.000 description 5
- 230000007246 mechanism Effects 0.000 description 5
- 238000012544 monitoring process Methods 0.000 description 5
- 239000002751 oligonucleotide probe Substances 0.000 description 5
- 108090000623 proteins and genes Proteins 0.000 description 5
- YBJHBAHKTGYVGT-ZKWXMUAHSA-N (+)-Biotin Chemical compound N1C(=O)N[C@@H]2[C@H](CCCCC(=O)O)SC[C@@H]21 YBJHBAHKTGYVGT-ZKWXMUAHSA-N 0.000 description 4
- OCKKUZVCJCWWHM-UHFFFAOYSA-L (7-amino-8-methylphenoxazin-3-ylidene)-diethylazanium;dichlorozinc;dichloride Chemical compound [Cl-].[Cl-].[Cl-].[Cl-].[Zn+2].CC1=C(N)C=C2OC3=CC(=[N+](CC)CC)C=CC3=NC2=C1.CC1=C(N)C=C2OC3=CC(=[N+](CC)CC)C=CC3=NC2=C1 OCKKUZVCJCWWHM-UHFFFAOYSA-L 0.000 description 4
- FFRBMBIXVSCUFS-UHFFFAOYSA-N 2,4-dinitro-1-naphthol Chemical compound C1=CC=C2C(O)=C([N+]([O-])=O)C=C([N+]([O-])=O)C2=C1 FFRBMBIXVSCUFS-UHFFFAOYSA-N 0.000 description 4
- JKYKXTRKURYNGW-UHFFFAOYSA-N 3,4-dihydroxy-9,10-dioxo-9,10-dihydroanthracene-2-sulfonic acid Chemical compound O=C1C2=CC=CC=C2C(=O)C2=C1C(O)=C(O)C(S(O)(=O)=O)=C2 JKYKXTRKURYNGW-UHFFFAOYSA-N 0.000 description 4
- AXDJCCTWPBKUKL-UHFFFAOYSA-N 4-[(4-aminophenyl)-(4-imino-3-methylcyclohexa-2,5-dien-1-ylidene)methyl]aniline;hydron;chloride Chemical compound Cl.C1=CC(=N)C(C)=CC1=C(C=1C=CC(N)=CC=1)C1=CC=C(N)C=C1 AXDJCCTWPBKUKL-UHFFFAOYSA-N 0.000 description 4
- ALJHHTHBYJROOG-UHFFFAOYSA-N 7-(dimethylamino)phenothiazin-3-one Chemical compound C1=CC(=O)C=C2SC3=CC(N(C)C)=CC=C3N=C21 ALJHHTHBYJROOG-UHFFFAOYSA-N 0.000 description 4
- MPVDXIMFBOLMNW-ISLYRVAYSA-N 7-hydroxy-8-[(E)-phenyldiazenyl]naphthalene-1,3-disulfonic acid Chemical compound OC1=CC=C2C=C(S(O)(=O)=O)C=C(S(O)(=O)=O)C2=C1\N=N\C1=CC=CC=C1 MPVDXIMFBOLMNW-ISLYRVAYSA-N 0.000 description 4
- CKLBXIYTBHXJEH-UHFFFAOYSA-J 75881-23-1 Chemical compound [Cl-].[Cl-].[Cl-].[Cl-].[Cu+2].[N-]1C(N=C2C3=CC=C(CSC(N(C)C)=[N+](C)C)C=C3C(N=C3C4=CC=C(CSC(N(C)C)=[N+](C)C)C=C4C(=N4)[N-]3)=N2)=C(C=C(CSC(N(C)C)=[N+](C)C)C=C2)C2=C1N=C1C2=CC(CSC(N(C)C)=[N+](C)C)=CC=C2C4=N1 CKLBXIYTBHXJEH-UHFFFAOYSA-J 0.000 description 4
- QFIIYGZAUXVPSZ-UHFFFAOYSA-N 8-(2,4-dihydroxy-6-methylanilino)-2-(2,4-dihydroxy-6-methylphenyl)imino-7-hydroxy-1,9-dimethyldibenzofuran-3-one Chemical compound CC1=CC(=CC(=C1NC2=C(C3=C(C=C2O)OC4=CC(=O)C(=NC5=C(C=C(C=C5C)O)O)C(=C43)C)C)O)O QFIIYGZAUXVPSZ-UHFFFAOYSA-N 0.000 description 4
- 208000005443 Circulating Neoplastic Cells Diseases 0.000 description 4
- XXACTDWGHQXLGW-UHFFFAOYSA-M Janus Green B chloride Chemical compound [Cl-].C12=CC(N(CC)CC)=CC=C2N=C2C=CC(\N=N\C=3C=CC(=CC=3)N(C)C)=CC2=[N+]1C1=CC=CC=C1 XXACTDWGHQXLGW-UHFFFAOYSA-M 0.000 description 4
- WWKGVZASJYXZKN-UHFFFAOYSA-N Methyl violet 2B Chemical compound [Cl-].C1=CC(N(C)C)=CC=C1C(C=1C=CC(N)=CC=1)=C1C=CC(=[N+](C)C)C=C1 WWKGVZASJYXZKN-UHFFFAOYSA-N 0.000 description 4
- 239000004218 Orcein Substances 0.000 description 4
- PLXBWHJQWKZRKG-UHFFFAOYSA-N Resazurin Chemical compound C1=CC(=O)C=C2OC3=CC(O)=CC=C3[N+]([O-])=C21 PLXBWHJQWKZRKG-UHFFFAOYSA-N 0.000 description 4
- FHNINJWBTRXEBC-UHFFFAOYSA-N Sudan III Chemical compound OC1=CC=C2C=CC=CC2=C1N=NC(C=C1)=CC=C1N=NC1=CC=CC=C1 FHNINJWBTRXEBC-UHFFFAOYSA-N 0.000 description 4
- AXIKDPDWFVPGOD-UHFFFAOYSA-O [7-(dimethylamino)phenothiazin-3-ylidene]-dimethylazanium;2-(2,4,5,7-tetrabromo-3,6-dihydroxyxanthen-10-ium-9-yl)benzoic acid Chemical compound C1=CC(=[N+](C)C)C=C2SC3=CC(N(C)C)=CC=C3N=C21.OC(=O)C1=CC=CC=C1C1=C(C=C(Br)C(O)=C2Br)C2=[O+]C2=C1C=C(Br)C(O)=C2Br AXIKDPDWFVPGOD-UHFFFAOYSA-O 0.000 description 4
- ZHAFUINZIZIXFC-UHFFFAOYSA-N [9-(dimethylamino)-10-methylbenzo[a]phenoxazin-5-ylidene]azanium;chloride Chemical compound [Cl-].O1C2=CC(=[NH2+])C3=CC=CC=C3C2=NC2=C1C=C(N(C)C)C(C)=C2 ZHAFUINZIZIXFC-UHFFFAOYSA-N 0.000 description 4
- RZUBARUFLYGOGC-MTHOTQAESA-L acid fuchsin Chemical compound [Na+].[Na+].[O-]S(=O)(=O)C1=C(N)C(C)=CC(C(=C\2C=C(C(=[NH2+])C=C/2)S([O-])(=O)=O)\C=2C=C(C(N)=CC=2)S([O-])(=O)=O)=C1 RZUBARUFLYGOGC-MTHOTQAESA-L 0.000 description 4
- DGOBMKYRQHEFGQ-UHFFFAOYSA-L acid green 5 Chemical compound [Na+].[Na+].C=1C=C(C(=C2C=CC(C=C2)=[N+](CC)CC=2C=C(C=CC=2)S([O-])(=O)=O)C=2C=CC(=CC=2)S([O-])(=O)=O)C=CC=1N(CC)CC1=CC=CC(S([O-])(=O)=O)=C1 DGOBMKYRQHEFGQ-UHFFFAOYSA-L 0.000 description 4
- CQPFMGBJSMSXLP-UHFFFAOYSA-M acid orange 7 Chemical compound [Na+].OC1=CC=C2C=CC=CC2=C1N=NC1=CC=C(S([O-])(=O)=O)C=C1 CQPFMGBJSMSXLP-UHFFFAOYSA-M 0.000 description 4
- JPIYZTWMUGTEHX-UHFFFAOYSA-N auramine O free base Chemical compound C1=CC(N(C)C)=CC=C1C(=N)C1=CC=C(N(C)C)C=C1 JPIYZTWMUGTEHX-UHFFFAOYSA-N 0.000 description 4
- QZKHGYGBYOUFGK-UHFFFAOYSA-L azocarmine B Chemical compound [Na+].[Na+].[O-]S(=O)(=O)C1=CC(S(=O)(=O)[O-])=CC=C1NC(C1=CC(=CC=C1C1=NC2=CC=CC=C22)S([O-])(=O)=O)=CC1=[N+]2C1=CC=CC=C1 QZKHGYGBYOUFGK-UHFFFAOYSA-L 0.000 description 4
- LUERODMRBLNCFK-UHFFFAOYSA-M azocarmine G Chemical compound [Na+].C1=CC(S(=O)(=O)[O-])=CC=C1NC(C1=CC(=CC=C1C1=NC2=CC=CC=C22)S([O-])(=O)=O)=CC1=[N+]2C1=CC=CC=C1 LUERODMRBLNCFK-UHFFFAOYSA-M 0.000 description 4
- BDFZFGDTHFGWRQ-UHFFFAOYSA-N basic brown 1 Chemical compound NC1=CC(N)=CC=C1N=NC1=CC=CC(N=NC=2C(=CC(N)=CC=2)N)=C1 BDFZFGDTHFGWRQ-UHFFFAOYSA-N 0.000 description 4
- 210000001124 body fluid Anatomy 0.000 description 4
- 238000000339 bright-field microscopy Methods 0.000 description 4
- 229960001506 brilliant green Drugs 0.000 description 4
- 235000012730 carminic acid Nutrition 0.000 description 4
- XRPLBRIHZGVJIC-UHFFFAOYSA-L chembl3182776 Chemical compound [Na+].[Na+].NC1=CC(N)=CC=C1N=NC1=CC=C(C=2C=CC(=CC=2)N=NC=2C(=CC3=CC(=C(N=NC=4C=CC=CC=4)C(O)=C3C=2N)S([O-])(=O)=O)S([O-])(=O)=O)C=C1 XRPLBRIHZGVJIC-UHFFFAOYSA-L 0.000 description 4
- IQFVPQOLBLOTPF-HKXUKFGYSA-L congo red Chemical compound [Na+].[Na+].C1=CC=CC2=C(N)C(/N=N/C3=CC=C(C=C3)C3=CC=C(C=C3)/N=N/C3=C(C4=CC=CC=C4C(=C3)S([O-])(=O)=O)N)=CC(S([O-])(=O)=O)=C21 IQFVPQOLBLOTPF-HKXUKFGYSA-L 0.000 description 4
- 239000013078 crystal Substances 0.000 description 4
- OOYIOIOOWUGAHD-UHFFFAOYSA-L disodium;2',4',5',7'-tetrabromo-4,5,6,7-tetrachloro-3-oxospiro[2-benzofuran-1,9'-xanthene]-3',6'-diolate Chemical compound [Na+].[Na+].O1C(=O)C(C(=C(Cl)C(Cl)=C2Cl)Cl)=C2C21C1=CC(Br)=C([O-])C(Br)=C1OC1=C(Br)C([O-])=C(Br)C=C21 OOYIOIOOWUGAHD-UHFFFAOYSA-L 0.000 description 4
- IINNWAYUJNWZRM-UHFFFAOYSA-L erythrosin B Chemical compound [Na+].[Na+].[O-]C(=O)C1=CC=CC=C1C1=C2C=C(I)C(=O)C(I)=C2OC2=C(I)C([O-])=C(I)C=C21 IINNWAYUJNWZRM-UHFFFAOYSA-L 0.000 description 4
- UKZQEOHHLOYJLY-UHFFFAOYSA-M ethyl eosin Chemical compound [K+].CCOC(=O)C1=CC=CC=C1C1=C2C=C(Br)C(=O)C(Br)=C2OC2=C(Br)C([O-])=C(Br)C=C21 UKZQEOHHLOYJLY-UHFFFAOYSA-M 0.000 description 4
- IDAQSADEMXDTKN-UHFFFAOYSA-L ethyl green Chemical compound [Cl-].[Br-].C1=CC([N+](C)(C)CC)=CC=C1C(C=1C=CC(=CC=1)N(C)C)=C1C=CC(=[N+](C)C)C=C1 IDAQSADEMXDTKN-UHFFFAOYSA-L 0.000 description 4
- MNEJSIQJOSRAAA-UHFFFAOYSA-O ethyl-[4-[[4-[ethyl-[(3-sulfophenyl)methyl]amino]phenyl]-(4-hydroxy-3-sulfophenyl)methylidene]cyclohexa-2,5-dien-1-ylidene]-[(3-sulfophenyl)methyl]azanium Chemical compound C=1C=C(C(=C2C=CC(C=C2)=[N+](CC)CC=2C=C(C=CC=2)S(O)(=O)=O)C=2C=C(C(O)=CC=2)S(O)(=O)=O)C=CC=1N(CC)CC1=CC=CC(S(O)(=O)=O)=C1 MNEJSIQJOSRAAA-UHFFFAOYSA-O 0.000 description 4
- 238000001914 filtration Methods 0.000 description 4
- KHLVKKOJDHCJMG-QDBORUFSSA-L indigo carmine Chemical compound [Na+].[Na+].N/1C2=CC=C(S([O-])(=O)=O)C=C2C(=O)C\1=C1/NC2=CC=C(S(=O)(=O)[O-])C=C2C1=O KHLVKKOJDHCJMG-QDBORUFSSA-L 0.000 description 4
- 229960003988 indigo carmine Drugs 0.000 description 4
- 235000012738 indigotine Nutrition 0.000 description 4
- 239000004179 indigotine Substances 0.000 description 4
- 238000004020 luminiscence type Methods 0.000 description 4
- 229940107698 malachite green Drugs 0.000 description 4
- FDZZZRQASAIRJF-UHFFFAOYSA-M malachite green Chemical compound [Cl-].C1=CC(N(C)C)=CC=C1C(C=1C=CC=CC=1)=C1C=CC(=[N+](C)C)C=C1 FDZZZRQASAIRJF-UHFFFAOYSA-M 0.000 description 4
- 229940012189 methyl orange Drugs 0.000 description 4
- STZCRXQWRGQSJD-GEEYTBSJSA-M methyl orange Chemical compound [Na+].C1=CC(N(C)C)=CC=C1\N=N\C1=CC=C(S([O-])(=O)=O)C=C1 STZCRXQWRGQSJD-GEEYTBSJSA-M 0.000 description 4
- 238000001000 micrograph Methods 0.000 description 4
- PGSADBUBUOPOJS-UHFFFAOYSA-N neutral red Chemical compound Cl.C1=C(C)C(N)=CC2=NC3=CC(N(C)C)=CC=C3N=C21 PGSADBUBUOPOJS-UHFFFAOYSA-N 0.000 description 4
- XJCPMUIIBDVFDM-UHFFFAOYSA-M nile blue A Chemical compound [Cl-].C1=CC=C2C3=NC4=CC=C(N(CC)CC)C=C4[O+]=C3C=C(N)C2=C1 XJCPMUIIBDVFDM-UHFFFAOYSA-M 0.000 description 4
- 235000019248 orcein Nutrition 0.000 description 4
- AFAIELJLZYUNPW-UHFFFAOYSA-N pararosaniline free base Chemical compound C1=CC(N)=CC=C1C(C=1C=CC(N)=CC=1)=C1C=CC(=N)C=C1 AFAIELJLZYUNPW-UHFFFAOYSA-N 0.000 description 4
- NTGBUUXKGAZMSE-UHFFFAOYSA-N phenyl n-[4-[4-(4-methoxyphenyl)piperazin-1-yl]phenyl]carbamate Chemical compound C1=CC(OC)=CC=C1N1CCN(C=2C=CC(NC(=O)OC=3C=CC=CC=3)=CC=2)CC1 NTGBUUXKGAZMSE-UHFFFAOYSA-N 0.000 description 4
- 102000004169 proteins and genes Human genes 0.000 description 4
- CXZRDVVUVDYSCQ-UHFFFAOYSA-M pyronin B Chemical compound [Cl-].C1=CC(=[N+](CC)CC)C=C2OC3=CC(N(CC)CC)=CC=C3C=C21 CXZRDVVUVDYSCQ-UHFFFAOYSA-M 0.000 description 4
- INCIMLINXXICKS-UHFFFAOYSA-M pyronin Y Chemical compound [Cl-].C1=CC(=[N+](C)C)C=C2OC3=CC(N(C)C)=CC=C3C=C21 INCIMLINXXICKS-UHFFFAOYSA-M 0.000 description 4
- 238000011002 quantification Methods 0.000 description 4
- 230000010076 replication Effects 0.000 description 4
- OARRHUQTFTUEOS-UHFFFAOYSA-N safranin Chemical compound [Cl-].C=12C=C(N)C(C)=CC2=NC2=CC(C)=C(N)C=C2[N+]=1C1=CC=CC=C1 OARRHUQTFTUEOS-UHFFFAOYSA-N 0.000 description 4
- 108700024661 strong silver Proteins 0.000 description 4
- 239000000126 substance Substances 0.000 description 4
- YCUVUDODLRLVIC-VPHDGDOJSA-N sudan black b Chemical compound C1=CC(=C23)NC(C)(C)NC2=CC=CC3=C1\N=N\C(C1=CC=CC=C11)=CC=C1\N=N\C1=CC=CC=C1 YCUVUDODLRLVIC-VPHDGDOJSA-N 0.000 description 4
- 229940099373 sudan iii Drugs 0.000 description 4
- ANRHNWWPFJCPAZ-UHFFFAOYSA-M thionine Chemical compound [Cl-].C1=CC(N)=CC2=[S+]C3=CC(N)=CC=C3N=C21 ANRHNWWPFJCPAZ-UHFFFAOYSA-M 0.000 description 4
- 229950003937 tolonium Drugs 0.000 description 4
- HNONEKILPDHFOL-UHFFFAOYSA-M tolonium chloride Chemical compound [Cl-].C1=C(C)C(N)=CC2=[S+]C3=CC(N(C)C)=CC=C3N=C21 HNONEKILPDHFOL-UHFFFAOYSA-M 0.000 description 4
- XOSXWYQMOYSSKB-UHFFFAOYSA-L water blue Chemical compound [Na+].[Na+].[O-]S(=O)(=O)C1=C(N)C(C)=CC(C(=C2C=CC(C=C2)=NC=2C=CC(=CC=2)S([O-])(=O)=O)C=2C=CC(NC=3C=CC(=CC=3)S(O)(=O)=O)=CC=2)=C1 XOSXWYQMOYSSKB-UHFFFAOYSA-L 0.000 description 4
- 206010050337 Cerumen impaction Diseases 0.000 description 3
- 101000649946 Homo sapiens Vacuolar protein sorting-associated protein 29 Proteins 0.000 description 3
- 206010062717 Increased upper airway secretion Diseases 0.000 description 3
- 208000005228 Pericardial Effusion Diseases 0.000 description 3
- 206010036790 Productive cough Diseases 0.000 description 3
- 238000001069 Raman spectroscopy Methods 0.000 description 3
- 241000219061 Rheum Species 0.000 description 3
- 102100028290 Vacuolar protein sorting-associated protein 29 Human genes 0.000 description 3
- 239000000853 adhesive Substances 0.000 description 3
- 230000001070 adhesive effect Effects 0.000 description 3
- 210000004381 amniotic fluid Anatomy 0.000 description 3
- 210000003567 ascitic fluid Anatomy 0.000 description 3
- 239000012472 biological sample Substances 0.000 description 3
- 210000001268 chyle Anatomy 0.000 description 3
- 230000001276 controlling effect Effects 0.000 description 3
- 238000013135 deep learning Methods 0.000 description 3
- 238000009792 diffusion process Methods 0.000 description 3
- 201000010099 disease Diseases 0.000 description 3
- 208000037265 diseases, disorders, signs and symptoms Diseases 0.000 description 3
- 230000000694 effects Effects 0.000 description 3
- 238000005401 electroluminescence Methods 0.000 description 3
- 210000003060 endolymph Anatomy 0.000 description 3
- 230000007613 environmental effect Effects 0.000 description 3
- 210000003608 fece Anatomy 0.000 description 3
- 239000010408 film Substances 0.000 description 3
- 239000000834 fixative Substances 0.000 description 3
- 235000013305 food Nutrition 0.000 description 3
- 210000004211 gastric acid Anatomy 0.000 description 3
- 210000004051 gastric juice Anatomy 0.000 description 3
- 230000036541 health Effects 0.000 description 3
- 210000004251 human milk Anatomy 0.000 description 3
- 235000020256 human milk Nutrition 0.000 description 3
- 210000002751 lymph Anatomy 0.000 description 3
- 238000004519 manufacturing process Methods 0.000 description 3
- 239000011159 matrix material Substances 0.000 description 3
- 238000005259 measurement Methods 0.000 description 3
- 210000003097 mucus Anatomy 0.000 description 3
- 150000007523 nucleic acids Chemical class 0.000 description 3
- 210000004912 pericardial fluid Anatomy 0.000 description 3
- 210000004049 perilymph Anatomy 0.000 description 3
- 208000026435 phlegm Diseases 0.000 description 3
- 238000005424 photoluminescence Methods 0.000 description 3
- 210000002381 plasma Anatomy 0.000 description 3
- 210000004910 pleural fluid Anatomy 0.000 description 3
- 210000004915 pus Anatomy 0.000 description 3
- 210000003296 saliva Anatomy 0.000 description 3
- 210000002374 sebum Anatomy 0.000 description 3
- 210000000582 semen Anatomy 0.000 description 3
- 210000002966 serum Anatomy 0.000 description 3
- 210000003802 sputum Anatomy 0.000 description 3
- 208000024794 sputum Diseases 0.000 description 3
- 210000004243 sweat Anatomy 0.000 description 3
- 210000001179 synovial fluid Anatomy 0.000 description 3
- 210000001138 tear Anatomy 0.000 description 3
- 210000002700 urine Anatomy 0.000 description 3
- 210000004916 vomit Anatomy 0.000 description 3
- 230000008673 vomiting Effects 0.000 description 3
- WZUVPPKBWHMQCE-XJKSGUPXSA-N (+)-haematoxylin Chemical compound C12=CC(O)=C(O)C=C2C[C@]2(O)[C@H]1C1=CC=C(O)C(O)=C1OC2 WZUVPPKBWHMQCE-XJKSGUPXSA-N 0.000 description 2
- 102000040650 (ribonucleotides)n+m Human genes 0.000 description 2
- 102100028175 Abasic site processing protein HMCES Human genes 0.000 description 2
- 102000002260 Alkaline Phosphatase Human genes 0.000 description 2
- 108020004774 Alkaline Phosphatase Proteins 0.000 description 2
- 241000196324 Embryophyta Species 0.000 description 2
- 101001006387 Homo sapiens Abasic site processing protein HMCES Proteins 0.000 description 2
- 101100537375 Homo sapiens TMEM107 gene Proteins 0.000 description 2
- 108010001336 Horseradish Peroxidase Proteins 0.000 description 2
- 108020004711 Nucleic Acid Probes Proteins 0.000 description 2
- 108091028043 Nucleic acid sequence Proteins 0.000 description 2
- 102100036728 Transmembrane protein 107 Human genes 0.000 description 2
- 230000003321 amplification Effects 0.000 description 2
- 238000013459 approach Methods 0.000 description 2
- 238000013528 artificial neural network Methods 0.000 description 2
- 239000000090 biomarker Substances 0.000 description 2
- 229960002685 biotin Drugs 0.000 description 2
- 235000020958 biotin Nutrition 0.000 description 2
- 239000011616 biotin Substances 0.000 description 2
- 230000002759 chromosomal effect Effects 0.000 description 2
- 210000000349 chromosome Anatomy 0.000 description 2
- 238000004891 communication Methods 0.000 description 2
- 238000007405 data analysis Methods 0.000 description 2
- 238000010586 diagram Methods 0.000 description 2
- 238000001035 drying Methods 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 210000003743 erythrocyte Anatomy 0.000 description 2
- MHMNJMPURVTYEJ-UHFFFAOYSA-N fluorescein-5-isothiocyanate Chemical compound O1C(=O)C2=CC(N=C=S)=CC=C2C21C1=CC=C(O)C=C1OC1=CC(O)=CC=C21 MHMNJMPURVTYEJ-UHFFFAOYSA-N 0.000 description 2
- 238000003364 immunohistochemistry Methods 0.000 description 2
- 210000000265 leukocyte Anatomy 0.000 description 2
- 108020004999 messenger RNA Proteins 0.000 description 2
- 210000002569 neuron Anatomy 0.000 description 2
- 238000003199 nucleic acid amplification method Methods 0.000 description 2
- 239000002853 nucleic acid probe Substances 0.000 description 2
- 108020004707 nucleic acids Proteins 0.000 description 2
- 102000039446 nucleic acids Human genes 0.000 description 2
- 230000000737 periodic effect Effects 0.000 description 2
- 238000002310 reflectometry Methods 0.000 description 2
- 239000010865 sewage Substances 0.000 description 2
- 239000007787 solid Substances 0.000 description 2
- 238000007447 staining method Methods 0.000 description 2
- 210000003813 thumb Anatomy 0.000 description 2
- FWBHETKCLVMNFS-UHFFFAOYSA-N 4',6-Diamino-2-phenylindol Chemical compound C1=CC(C(=N)N)=CC=C1C1=CC2=CC=C(C(N)=N)C=C2N1 FWBHETKCLVMNFS-UHFFFAOYSA-N 0.000 description 1
- QRXMUCSWCMTJGU-UHFFFAOYSA-N 5-bromo-4-chloro-3-indolyl phosphate Chemical compound C1=C(Br)C(Cl)=C2C(OP(O)(=O)O)=CNC2=C1 QRXMUCSWCMTJGU-UHFFFAOYSA-N 0.000 description 1
- 102100031650 C-X-C chemokine receptor type 4 Human genes 0.000 description 1
- 102100022210 COX assembly mitochondrial protein 2 homolog Human genes 0.000 description 1
- 108020004635 Complementary DNA Proteins 0.000 description 1
- 108020004394 Complementary RNA Proteins 0.000 description 1
- 241000255581 Drosophila <fruit fly, genus> Species 0.000 description 1
- 108090000790 Enzymes Proteins 0.000 description 1
- 102000004190 Enzymes Human genes 0.000 description 1
- LFQSCWFLJHTTHZ-UHFFFAOYSA-N Ethanol Chemical compound CCO LFQSCWFLJHTTHZ-UHFFFAOYSA-N 0.000 description 1
- 102100029203 F-box only protein 8 Human genes 0.000 description 1
- 101100321670 Fagopyrum esculentum FA18 gene Proteins 0.000 description 1
- 238000010867 Hoechst staining Methods 0.000 description 1
- 101000922348 Homo sapiens C-X-C chemokine receptor type 4 Proteins 0.000 description 1
- 101000900446 Homo sapiens COX assembly mitochondrial protein 2 homolog Proteins 0.000 description 1
- 101100280298 Homo sapiens FAM162A gene Proteins 0.000 description 1
- 101100334493 Homo sapiens FBXO8 gene Proteins 0.000 description 1
- 101100257194 Homo sapiens SMIM8 gene Proteins 0.000 description 1
- 101000741917 Homo sapiens Serine/threonine-protein phosphatase 1 regulatory subunit 10 Proteins 0.000 description 1
- 101000911790 Homo sapiens Sister chromatid cohesion protein DCC1 Proteins 0.000 description 1
- 101000631695 Homo sapiens Succinate dehydrogenase assembly factor 3, mitochondrial Proteins 0.000 description 1
- 241001465754 Metazoa Species 0.000 description 1
- 206010028980 Neoplasm Diseases 0.000 description 1
- CTQNGGLPUBDAKN-UHFFFAOYSA-N O-Xylene Chemical compound CC1=CC=CC=C1C CTQNGGLPUBDAKN-UHFFFAOYSA-N 0.000 description 1
- 101100170008 Oryza sativa subsp. japonica DBB1 gene Proteins 0.000 description 1
- 229930040373 Paraformaldehyde Natural products 0.000 description 1
- 102100023788 Protein FAM162A Human genes 0.000 description 1
- 108020004518 RNA Probes Proteins 0.000 description 1
- 239000003391 RNA probe Substances 0.000 description 1
- 101100127688 Saccharomyces cerevisiae (strain ATCC 204508 / S288c) FAA1 gene Proteins 0.000 description 1
- 101100127690 Saccharomyces cerevisiae (strain ATCC 204508 / S288c) FAA2 gene Proteins 0.000 description 1
- 241000490025 Schefflera digitata Species 0.000 description 1
- 102100038743 Serine/threonine-protein phosphatase 1 regulatory subunit 10 Human genes 0.000 description 1
- 102100027040 Sister chromatid cohesion protein DCC1 Human genes 0.000 description 1
- 102100024789 Small integral membrane protein 8 Human genes 0.000 description 1
- 102100028996 Succinate dehydrogenase assembly factor 3, mitochondrial Human genes 0.000 description 1
- GYDJEQRTZSCIOI-UHFFFAOYSA-N Tranexamic acid Chemical compound NCC1CCC(C(O)=O)CC1 GYDJEQRTZSCIOI-UHFFFAOYSA-N 0.000 description 1
- 235000012544 Viola sororia Nutrition 0.000 description 1
- 241001106476 Violaceae Species 0.000 description 1
- 238000010817 Wright-Giemsa staining Methods 0.000 description 1
- 230000001133 acceleration Effects 0.000 description 1
- 239000011324 bead Substances 0.000 description 1
- 239000011230 binding agent Substances 0.000 description 1
- 239000012148 binding buffer Substances 0.000 description 1
- 230000033228 biological regulation Effects 0.000 description 1
- 238000001574 biopsy Methods 0.000 description 1
- 210000000601 blood cell Anatomy 0.000 description 1
- 238000009534 blood test Methods 0.000 description 1
- 239000011449 brick Substances 0.000 description 1
- 239000007853 buffer solution Substances 0.000 description 1
- 238000010804 cDNA synthesis Methods 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 201000011510 cancer Diseases 0.000 description 1
- 230000001413 cellular effect Effects 0.000 description 1
- 238000006243 chemical reaction Methods 0.000 description 1
- 239000003086 colorant Substances 0.000 description 1
- 239000002299 complementary DNA Substances 0.000 description 1
- 239000003184 complementary RNA Substances 0.000 description 1
- 239000002361 compost Substances 0.000 description 1
- 150000001875 compounds Chemical class 0.000 description 1
- 238000004590 computer program Methods 0.000 description 1
- 239000004567 concrete Substances 0.000 description 1
- 238000010276 construction Methods 0.000 description 1
- 239000003599 detergent Substances 0.000 description 1
- 238000002405 diagnostic procedure Methods 0.000 description 1
- 238000006073 displacement reaction Methods 0.000 description 1
- 239000003651 drinking water Substances 0.000 description 1
- 235000020188 drinking water Nutrition 0.000 description 1
- 210000002257 embryonic structure Anatomy 0.000 description 1
- 229920005570 flexible polymer Polymers 0.000 description 1
- 238000007667 floating Methods 0.000 description 1
- 238000002509 fluorescent in situ hybridization Methods 0.000 description 1
- 210000005224 forefinger Anatomy 0.000 description 1
- 239000011521 glass Substances 0.000 description 1
- PCHJSUWPFVWCPO-UHFFFAOYSA-N gold Chemical compound [Au] PCHJSUWPFVWCPO-UHFFFAOYSA-N 0.000 description 1
- 238000005534 hematocrit Methods 0.000 description 1
- 238000009396 hybridization Methods 0.000 description 1
- 238000011532 immunohistochemical staining Methods 0.000 description 1
- 238000011065 in-situ storage Methods 0.000 description 1
- 239000004615 ingredient Substances 0.000 description 1
- 238000005305 interferometry Methods 0.000 description 1
- 235000015250 liver sausages Nutrition 0.000 description 1
- 108091070501 miRNA Proteins 0.000 description 1
- 239000002679 microRNA Substances 0.000 description 1
- 238000012015 optical character recognition Methods 0.000 description 1
- 238000005457 optimization Methods 0.000 description 1
- 230000008520 organization Effects 0.000 description 1
- 229920002866 paraformaldehyde Polymers 0.000 description 1
- 239000002245 particle Substances 0.000 description 1
- 238000005192 partition Methods 0.000 description 1
- 238000010827 pathological analysis Methods 0.000 description 1
- 239000004033 plastic Substances 0.000 description 1
- 229910052704 radon Inorganic materials 0.000 description 1
- SYUHGPGVQRZVTB-UHFFFAOYSA-N radon atom Chemical compound [Rn] SYUHGPGVQRZVTB-UHFFFAOYSA-N 0.000 description 1
- 238000012124 rapid diagnostic test Methods 0.000 description 1
- 239000000376 reactant Substances 0.000 description 1
- 102000005962 receptors Human genes 0.000 description 1
- 108020003175 receptors Proteins 0.000 description 1
- 230000009467 reduction Effects 0.000 description 1
- 235000021067 refined food Nutrition 0.000 description 1
- PYWVYCXTNDRMGF-UHFFFAOYSA-N rhodamine B Chemical compound [Cl-].C=12C=CC(=[N+](CC)CC)C=C2OC2=CC(N(CC)CC)=CC=C2C=1C1=CC=CC=C1C(O)=O PYWVYCXTNDRMGF-UHFFFAOYSA-N 0.000 description 1
- 239000011435 rock Substances 0.000 description 1
- 239000004576 sand Substances 0.000 description 1
- 238000010845 search algorithm Methods 0.000 description 1
- 230000035945 sensitivity Effects 0.000 description 1
- 239000002689 soil Substances 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
- 239000008399 tap water Substances 0.000 description 1
- 235000020679 tap water Nutrition 0.000 description 1
- JGVWCANSWKRBCS-UHFFFAOYSA-N tetramethylrhodamine thiocyanate Chemical compound [Cl-].C=12C=CC(N(C)C)=CC2=[O+]C2=CC(N(C)C)=CC=C2C=1C1=CC=C(SC#N)C=C1C(O)=O JGVWCANSWKRBCS-UHFFFAOYSA-N 0.000 description 1
- 230000036962 time dependent Effects 0.000 description 1
- 238000000844 transformation Methods 0.000 description 1
- 239000001993 wax Substances 0.000 description 1
- 239000002023 wood Substances 0.000 description 1
- 239000008096 xylene Substances 0.000 description 1
Classifications
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N21/00—Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
- G01N21/84—Systems specially adapted for particular applications
- G01N21/8483—Investigating reagent band
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B01—PHYSICAL OR CHEMICAL PROCESSES OR APPARATUS IN GENERAL
- B01L—CHEMICAL OR PHYSICAL LABORATORY APPARATUS FOR GENERAL USE
- B01L3/00—Containers or dishes for laboratory use, e.g. laboratory glassware; Droppers
- B01L3/50—Containers for the purpose of retaining a material to be analysed, e.g. test tubes
- B01L3/502—Containers for the purpose of retaining a material to be analysed, e.g. test tubes with fluid transport, e.g. in multi-compartment structures
- B01L3/5027—Containers for the purpose of retaining a material to be analysed, e.g. test tubes with fluid transport, e.g. in multi-compartment structures by integrated microfluidic structures, i.e. dimensions of channels and chambers are such that surface tension forces are important, e.g. lab-on-a-chip
- B01L3/502715—Containers for the purpose of retaining a material to be analysed, e.g. test tubes with fluid transport, e.g. in multi-compartment structures by integrated microfluidic structures, i.e. dimensions of channels and chambers are such that surface tension forces are important, e.g. lab-on-a-chip characterised by interfacing components, e.g. fluidic, electrical, optical or mechanical interfaces
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B01—PHYSICAL OR CHEMICAL PROCESSES OR APPARATUS IN GENERAL
- B01L—CHEMICAL OR PHYSICAL LABORATORY APPARATUS FOR GENERAL USE
- B01L9/00—Supporting devices; Holding devices
- B01L9/52—Supports specially adapted for flat sample carriers, e.g. for plates, slides, chips
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N21/00—Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
- G01N21/62—Systems in which the material investigated is excited whereby it emits light or causes a change in wavelength of the incident light
- G01N21/63—Systems in which the material investigated is excited whereby it emits light or causes a change in wavelength of the incident light optically excited
- G01N21/64—Fluorescence; Phosphorescence
- G01N21/645—Specially adapted constructive features of fluorimeters
- G01N21/6456—Spatial resolved fluorescence measurements; Imaging
- G01N21/6458—Fluorescence microscopy
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N21/00—Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
- G01N21/75—Systems in which material is subjected to a chemical reaction, the progress or the result of the reaction being investigated
- G01N21/77—Systems in which material is subjected to a chemical reaction, the progress or the result of the reaction being investigated by observing the effect on a chemical indicator
- G01N21/78—Systems in which material is subjected to a chemical reaction, the progress or the result of the reaction being investigated by observing the effect on a chemical indicator producing a change of colour
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N21/00—Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
- G01N21/84—Systems specially adapted for particular applications
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N33/00—Investigating or analysing materials by specific methods not covered by groups G01N1/00 - G01N31/00
- G01N33/48—Biological material, e.g. blood, urine; Haemocytometers
- G01N33/483—Physical analysis of biological material
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B21/00—Microscopes
- G02B21/0004—Microscopes specially adapted for specific applications
- G02B21/0008—Microscopes having a simple construction, e.g. portable microscopes
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B21/00—Microscopes
- G02B21/0004—Microscopes specially adapted for specific applications
- G02B21/002—Scanning microscopes
- G02B21/0024—Confocal scanning microscopes (CSOMs) or confocal "macroscopes"; Accessories which are not restricted to use with CSOMs, e.g. sample holders
- G02B21/0052—Optical details of the image generation
- G02B21/0076—Optical details of the image generation arrangements using fluorescence or luminescence
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B21/00—Microscopes
- G02B21/06—Means for illuminating specimens
- G02B21/08—Condensers
- G02B21/12—Condensers affording bright-field illumination
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B21/00—Microscopes
- G02B21/16—Microscopes adapted for ultraviolet illumination ; Fluorescence microscopes
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B21/00—Microscopes
- G02B21/24—Base structure
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B7/00—Mountings, adjusting means, or light-tight connections, for optical elements
- G02B7/02—Mountings, adjusting means, or light-tight connections, for optical elements for lenses
- G02B7/023—Mountings, adjusting means, or light-tight connections, for optical elements for lenses permitting adjustment
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/50—Constructional details
- H04N23/51—Housings
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/50—Constructional details
- H04N23/55—Optical parts specially adapted for electronic image sensors; Mounting thereof
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/56—Cameras or camera modules comprising electronic image sensors; Control thereof provided with illuminating means
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/57—Mechanical or electrical details of cameras or camera modules specially adapted for being embedded in other devices
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/67—Focus control based on electronic image sensor signals
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B01—PHYSICAL OR CHEMICAL PROCESSES OR APPARATUS IN GENERAL
- B01L—CHEMICAL OR PHYSICAL LABORATORY APPARATUS FOR GENERAL USE
- B01L2200/00—Solutions for specific problems relating to chemical or physical laboratory apparatus
- B01L2200/02—Adapting objects or devices to another
- B01L2200/025—Align devices or objects to ensure defined positions relative to each other
Landscapes
- Physics & Mathematics (AREA)
- Chemical & Material Sciences (AREA)
- Health & Medical Sciences (AREA)
- General Physics & Mathematics (AREA)
- Analytical Chemistry (AREA)
- Engineering & Computer Science (AREA)
- Life Sciences & Earth Sciences (AREA)
- Optics & Photonics (AREA)
- Signal Processing (AREA)
- Multimedia (AREA)
- General Health & Medical Sciences (AREA)
- Biochemistry (AREA)
- Immunology (AREA)
- Pathology (AREA)
- Chemical Kinetics & Catalysis (AREA)
- Hematology (AREA)
- Biomedical Technology (AREA)
- Clinical Laboratory Science (AREA)
- Molecular Biology (AREA)
- Biophysics (AREA)
- Plasma & Fusion (AREA)
- Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
- Dispersion Chemistry (AREA)
- Urology & Nephrology (AREA)
- Food Science & Technology (AREA)
- Medicinal Chemistry (AREA)
- Investigating, Analyzing Materials By Fluorescence Or Luminescence (AREA)
- Microscoopes, Condenser (AREA)
- Investigating Or Analysing Materials By Optical Means (AREA)
Abstract
The present invention provides, among other thing, devices and methods for simple, fast, and sensitive assaying, including imaging.
Description
Optics, Device, and System for Assaying CROSS-REFERENCE TO RELATED APPLICATIONS
This application claims priority to U.S. Provisional Patent Application Serial Nos. 62/456.590, filed on February 8, 2017, 62/459,554, filed on February 15, 2017, and 62/460,075, filed on February 16, 2017, Serial Number: 62/456,504, filed Feb.
8, 2017 (ESX045PRV), Serial Number: 62/460,062, filed Feb. 16, 2017 (ESX045PRV2) and Serial Number: 62/457,133, filed Feb. 9, 2017 (ESX046PRV) the entire contents of which are hereby incorporated by reference for all purposes.
FIELD
Among other things, the present invention is related to devices and methods of performing biological and chemical assays, and computational imaging.
BACKGROUND
In biological and chemical assays (e.g. diagnostic testing), often it needs to simple, fast, and sensitive assaying, including imaging. The present invention provides, among other thing, devices and methods for simple, fast, and sensitive assaying, including imaging.
BRIEF DESCRIPTION OF THE DRAWINGS
The skilled artisan will understand that the drawings, described below, are for illustration purposes only. The drawings are not intended to limit the scope of the present teachings in any way. The drawings are not entirely in scale. In the figures that present experimental data points, the lines that connect the data points are for guiding a viewing of the data only and have no other means.
FIG. 1-A, 1-B and 1-C are the schematic illustration of system testing sample in fluorescent illumination mode, according to some embodiments of the present invention.
FIG. 2-A, 2-B and 2-C are the schematic illustration of system testing sample in bright-field illumination mode, according to some embodiments of the present invention.
FIG. 3 is the schematic exploded view of optical adaptor device in system and system 20, according to some embodiments of the present invention.
FIG. 4 is the schematic sectional view showing details of system testing sample in bright-field illumination mode, and particularly of device, according to some embodiments of the present invention.
FIG. 5 is the schematic sectional view showing details of system testing sample in fluorescent illumination mode, and particularly of device, according to some embodiments of the present invention.
FIG. 6-A and FIG. 6-B is the schematic sectional viewing showing the design to make lever stop at the pre-defined position when being pulled outward from the device, according to some embodiments of the present invention.
FIG. 7 is the schematic illustration of the structure of the sample slider holding the QMAX
device, according to some embodiments of the present invention.
FIG. 8 is the schematic illustration of the moveable arm switching between two pre-defined stop positions, according to some embodiments of the present invention.
FIG.9 is the schematic illustration of how the slider indicates if QMAX device is inserted in right direction, according to some embodiments of the present invention.
FIG. 10-A, 10-B and 10-C are the schematic illustration of system for smartphone colorimetric reader, according to some embodiments of the present invention.
FIG. 11 is the schematic exploded view of optical adaptor device in system, according to some embodiments of the present invention.
FIG. 12 is the schematic sectional view showing details of system reading a colorimetric card, and particularly of device, according to some embodiments of the present invention.
FIG. 13-A, 13-B and 13-C are the schematic illustrations of system for smartphone colorimetric reader, according to some embodiments of the present invention.
FIG. 14 is the schematic exploded view of optical adaptor device in system, according to some embodiments of the present invention.
FIG. 15-A, 15-B and 15-C are the schematic views showing details of system reading a colorimetric card, and particularly of device, according to some embodiments of the present invention.
Fig. 16-A shows a tomography device that consists of an imaging sensor, a lens, and a QMAX structure, according to some embodiments of the present invention.
Fig. 16-B shows an example of the pillar array pattern of the letter E.
This application claims priority to U.S. Provisional Patent Application Serial Nos. 62/456.590, filed on February 8, 2017, 62/459,554, filed on February 15, 2017, and 62/460,075, filed on February 16, 2017, Serial Number: 62/456,504, filed Feb.
8, 2017 (ESX045PRV), Serial Number: 62/460,062, filed Feb. 16, 2017 (ESX045PRV2) and Serial Number: 62/457,133, filed Feb. 9, 2017 (ESX046PRV) the entire contents of which are hereby incorporated by reference for all purposes.
FIELD
Among other things, the present invention is related to devices and methods of performing biological and chemical assays, and computational imaging.
BACKGROUND
In biological and chemical assays (e.g. diagnostic testing), often it needs to simple, fast, and sensitive assaying, including imaging. The present invention provides, among other thing, devices and methods for simple, fast, and sensitive assaying, including imaging.
BRIEF DESCRIPTION OF THE DRAWINGS
The skilled artisan will understand that the drawings, described below, are for illustration purposes only. The drawings are not intended to limit the scope of the present teachings in any way. The drawings are not entirely in scale. In the figures that present experimental data points, the lines that connect the data points are for guiding a viewing of the data only and have no other means.
FIG. 1-A, 1-B and 1-C are the schematic illustration of system testing sample in fluorescent illumination mode, according to some embodiments of the present invention.
FIG. 2-A, 2-B and 2-C are the schematic illustration of system testing sample in bright-field illumination mode, according to some embodiments of the present invention.
FIG. 3 is the schematic exploded view of optical adaptor device in system and system 20, according to some embodiments of the present invention.
FIG. 4 is the schematic sectional view showing details of system testing sample in bright-field illumination mode, and particularly of device, according to some embodiments of the present invention.
FIG. 5 is the schematic sectional view showing details of system testing sample in fluorescent illumination mode, and particularly of device, according to some embodiments of the present invention.
FIG. 6-A and FIG. 6-B is the schematic sectional viewing showing the design to make lever stop at the pre-defined position when being pulled outward from the device, according to some embodiments of the present invention.
FIG. 7 is the schematic illustration of the structure of the sample slider holding the QMAX
device, according to some embodiments of the present invention.
FIG. 8 is the schematic illustration of the moveable arm switching between two pre-defined stop positions, according to some embodiments of the present invention.
FIG.9 is the schematic illustration of how the slider indicates if QMAX device is inserted in right direction, according to some embodiments of the present invention.
FIG. 10-A, 10-B and 10-C are the schematic illustration of system for smartphone colorimetric reader, according to some embodiments of the present invention.
FIG. 11 is the schematic exploded view of optical adaptor device in system, according to some embodiments of the present invention.
FIG. 12 is the schematic sectional view showing details of system reading a colorimetric card, and particularly of device, according to some embodiments of the present invention.
FIG. 13-A, 13-B and 13-C are the schematic illustrations of system for smartphone colorimetric reader, according to some embodiments of the present invention.
FIG. 14 is the schematic exploded view of optical adaptor device in system, according to some embodiments of the present invention.
FIG. 15-A, 15-B and 15-C are the schematic views showing details of system reading a colorimetric card, and particularly of device, according to some embodiments of the present invention.
Fig. 16-A shows a tomography device that consists of an imaging sensor, a lens, and a QMAX structure, according to some embodiments of the present invention.
Fig. 16-B shows an example of the pillar array pattern of the letter E.
2 Fig. 16-C shows the thin lens model, which explains the effect of focal distance on the captured image.
Fig. 16-0 shows a captured image of the example pillar array in Fig. 16-B by the imaging sensor.
Fig. 16-E shows the diagram of phase image retrieval based scheme.
Fig. 17-A shows analyte detection and localization workflow, which consists of two stages, training and prediction, according to some embodiments of the present invention.
Fig. 17-B shows the process to remove one item from an ordered list, according to some embodiments of the present invention.
Fig. 18-A shows an embodiment of a QMAX device used for cell imaging.
DETAILED DESCRIPTION OF EXEMAPLARY EMBODIMENTS
The following detailed description illustrates some embodiments of the invention by way of example and not by way of limitation. The section headings and any subtitles used herein are for organizational purposes only and are not to be construed as limiting the subject matter described in any way. The contents under a section heading and/or subtitle are not limited to the section heading and/or subtitle, but apply to the entire description of the present invention.
The citation of any publication is for its disclosure prior to the filing date and should not be construed as an admission that the present claims are not entitled to antedate such publication by virtue of prior invention. Further, the dates of publication provided can be different from the actual publication dates which can need to be independently confirmed.
Seven exemplary embodiments are illustrated as followed: one embodiment of optical adaptor for bright-field and fluorescent microscopy imaging attached to a smartphone; one embodiment of optical adaptor for colorimetric measurement attached to a smartphone using tilted fiber end face as light source; one embodiment of optical adaptor for colorimetric measurement attached to a smartphone using side-illumination of a ring-shape fiber as light source; one embodiment of device and methods of tomography; one embodiment of machine learning assisted assay and imaging; one embodiment of device and methods of tissue staining and cell imaging; one embodiment of dual-lens imaging system.
Fig. 16-0 shows a captured image of the example pillar array in Fig. 16-B by the imaging sensor.
Fig. 16-E shows the diagram of phase image retrieval based scheme.
Fig. 17-A shows analyte detection and localization workflow, which consists of two stages, training and prediction, according to some embodiments of the present invention.
Fig. 17-B shows the process to remove one item from an ordered list, according to some embodiments of the present invention.
Fig. 18-A shows an embodiment of a QMAX device used for cell imaging.
DETAILED DESCRIPTION OF EXEMAPLARY EMBODIMENTS
The following detailed description illustrates some embodiments of the invention by way of example and not by way of limitation. The section headings and any subtitles used herein are for organizational purposes only and are not to be construed as limiting the subject matter described in any way. The contents under a section heading and/or subtitle are not limited to the section heading and/or subtitle, but apply to the entire description of the present invention.
The citation of any publication is for its disclosure prior to the filing date and should not be construed as an admission that the present claims are not entitled to antedate such publication by virtue of prior invention. Further, the dates of publication provided can be different from the actual publication dates which can need to be independently confirmed.
Seven exemplary embodiments are illustrated as followed: one embodiment of optical adaptor for bright-field and fluorescent microscopy imaging attached to a smartphone; one embodiment of optical adaptor for colorimetric measurement attached to a smartphone using tilted fiber end face as light source; one embodiment of optical adaptor for colorimetric measurement attached to a smartphone using side-illumination of a ring-shape fiber as light source; one embodiment of device and methods of tomography; one embodiment of machine learning assisted assay and imaging; one embodiment of device and methods of tissue staining and cell imaging; one embodiment of dual-lens imaging system.
3 A. Optical adaptor for bright-field and fluorescent microscope attachment to smartphone Bright-field and fluorescent microscopy are very powerful techniques to let people examine some property of a sample, which have wide applications in health monitoring, disease diagnostic, science education and so on. Conventionally, the taking microscopy images requires, however, expensive microscope and experienced personnel which common people have limited access to. Even though there some recent invented accessories which can turn a smartphone into a bright-field microscope, the bright-field microscopy images only give very limited information of the sample.
The present invention that is described herein address this problem by providing a system comprising an optical adaptor and a smartphone. The optical adaptor device fits over a smartphone converting it into a microscope which can take both fluorescent and bright-field images of a sample. This system can be operated conveniently and reliably by a common person at any location. The optical adaptor takes advantage of the existing resources of the smartphone, including camera, light source, processor and display screen, which provides a low-cost solution let the user to do bright-field and fluorescent microscopy.
In this invention, the optical adaptor device comprises a holder frame fitting over the upper part of the smartphone and an optical box attached to the holder having sample receptacle slot and illumination optics. In some prior arts (U.S. Pat. No. 2016/029091 and U.S. Pat. No.
2011/0292198), their optical adaptor design is a whole piece including both the clip-on mechanics parts to fit over the smartphone and the functional optics elements. This design has the problem that they need to redesign the whole-piece optical adaptor for each specific model of smartphone.
But in this present invention, the optical adaptor is separated into a holder frame only for fitting a smartphone and a universal optical box containing all the functional parts.
For the smartphones with different dimensions, as long as the relative positions of the camera and the light source are the same, only the holder frame need to be redesigned, which will save a lot of cost of design and manufacture.
The optical box of the optical adaptor comprises: a receptacle slot which receives and position the sample in a sample slide in the field of view and focal range of the smartphone camera; a bright-field illumination optics for capturing bright-field microscopy images of a sample;
a fluorescent illumination optics for capturing fluorescent microscopy images of a sample; a lever
The present invention that is described herein address this problem by providing a system comprising an optical adaptor and a smartphone. The optical adaptor device fits over a smartphone converting it into a microscope which can take both fluorescent and bright-field images of a sample. This system can be operated conveniently and reliably by a common person at any location. The optical adaptor takes advantage of the existing resources of the smartphone, including camera, light source, processor and display screen, which provides a low-cost solution let the user to do bright-field and fluorescent microscopy.
In this invention, the optical adaptor device comprises a holder frame fitting over the upper part of the smartphone and an optical box attached to the holder having sample receptacle slot and illumination optics. In some prior arts (U.S. Pat. No. 2016/029091 and U.S. Pat. No.
2011/0292198), their optical adaptor design is a whole piece including both the clip-on mechanics parts to fit over the smartphone and the functional optics elements. This design has the problem that they need to redesign the whole-piece optical adaptor for each specific model of smartphone.
But in this present invention, the optical adaptor is separated into a holder frame only for fitting a smartphone and a universal optical box containing all the functional parts.
For the smartphones with different dimensions, as long as the relative positions of the camera and the light source are the same, only the holder frame need to be redesigned, which will save a lot of cost of design and manufacture.
The optical box of the optical adaptor comprises: a receptacle slot which receives and position the sample in a sample slide in the field of view and focal range of the smartphone camera; a bright-field illumination optics for capturing bright-field microscopy images of a sample;
a fluorescent illumination optics for capturing fluorescent microscopy images of a sample; a lever
4 to switch between bright-field illumination optics and fluorescent illumination optics by sliding inward and outward in the optical box.
The receptacle slot has a rubber door attached to it, which can fully cover the slot to prevent the ambient light getting into the optical box to be collected by the camera. In the prior art (U.S. Pat. 2016/0290916), its sample slot is always exposed to the ambient light which won't cause too much problem because it only does bright-field microscopy. But the present invention can take the advantage of this rubber door when doing fluorescent microscopy because the ambient light would bring a lot of noise to the image sensor of the camera.
To capture good fluorescent microscopy image, it is desirable that nearly no excitation light goes into the camera and only the fluorescent emitted by the sample is collected by the camera. For all common smartphones, however, the optical filter putting in front of the camera cannot block the undesired wavelength range of the light emitted from the light source of a smartphone very well due to the large divergence angle of the beams emitted by the light source and the optical filter not working well for un-collimated beams. Collimation optics can be designed to collimated the beam emitted by the smartphone light source to address this issue, but this approach increase the size and cost of the adaptor. Instead, in this present invention, fluorescent illumination optics enables the excitation light to illuminate the sample partially from the waveguide inside the sample slide and partially from the backside of the sample side in large oblique incidence angle so that excitation light will nearly not be collected by the camera to reduce the noise signal getting into the camera.
The bright-field illumination optics in the adaptor receive and turn the beam emitted by the light source so as to back-illuminated the sample in normal incidence angle.
Typically, the optical box also comprises a lens mounted in it aligned with the camera of the smartphone, which magnifies the images captured by the camera. The images captured by the camera can be further processed by the processor of smartphone and outputs the analysis result on the screen of smartphone.
To achieve both bright-field illumination and fluorescent illumination optics in a same optical adaptor, in this present invention, a slidable lever is used. The optical elements of the fluorescent illumination optics are mounted on the lever and when the lever fully slides into the .. optical box, the fluorescent illumination optics elements block the optical path of bright-field illumination optics and switch the illumination optics to fluorescent illumination optics. And when the lever slides out, the fluorescent illumination optics elements mounted on the lever move out of the optical path and switch the illumination optics to bright-field illumination optics. This lever
The receptacle slot has a rubber door attached to it, which can fully cover the slot to prevent the ambient light getting into the optical box to be collected by the camera. In the prior art (U.S. Pat. 2016/0290916), its sample slot is always exposed to the ambient light which won't cause too much problem because it only does bright-field microscopy. But the present invention can take the advantage of this rubber door when doing fluorescent microscopy because the ambient light would bring a lot of noise to the image sensor of the camera.
To capture good fluorescent microscopy image, it is desirable that nearly no excitation light goes into the camera and only the fluorescent emitted by the sample is collected by the camera. For all common smartphones, however, the optical filter putting in front of the camera cannot block the undesired wavelength range of the light emitted from the light source of a smartphone very well due to the large divergence angle of the beams emitted by the light source and the optical filter not working well for un-collimated beams. Collimation optics can be designed to collimated the beam emitted by the smartphone light source to address this issue, but this approach increase the size and cost of the adaptor. Instead, in this present invention, fluorescent illumination optics enables the excitation light to illuminate the sample partially from the waveguide inside the sample slide and partially from the backside of the sample side in large oblique incidence angle so that excitation light will nearly not be collected by the camera to reduce the noise signal getting into the camera.
The bright-field illumination optics in the adaptor receive and turn the beam emitted by the light source so as to back-illuminated the sample in normal incidence angle.
Typically, the optical box also comprises a lens mounted in it aligned with the camera of the smartphone, which magnifies the images captured by the camera. The images captured by the camera can be further processed by the processor of smartphone and outputs the analysis result on the screen of smartphone.
To achieve both bright-field illumination and fluorescent illumination optics in a same optical adaptor, in this present invention, a slidable lever is used. The optical elements of the fluorescent illumination optics are mounted on the lever and when the lever fully slides into the .. optical box, the fluorescent illumination optics elements block the optical path of bright-field illumination optics and switch the illumination optics to fluorescent illumination optics. And when the lever slides out, the fluorescent illumination optics elements mounted on the lever move out of the optical path and switch the illumination optics to bright-field illumination optics. This lever
5 design makes the optical adaptor work in both bright-field and fluorescent illumination modes without the need for designing two different single-mode optical boxes.
The lever comprises two planes at different planes at different heights.
In some embodiments, two planes can be joined together with a vertical bar and move together in or out of the optical box. In some embodiments, two planes can be separated and each plane can move individually in or out of the optical box.
The upper lever plane comprises at least one optical element which can be, but not limited to be an optical filter. The upper lever plane moves under the light source and the preferred distance between the upper lever plane and the light source is in the range of 0 to 5mm.
Part of the bottom lever plane is not parallel to the image plane. And the surface of the non-parallel part of the bottom lever plane has mirror finish with high reflectivity larger than 95%.
The non-parallel part of the bottom lever plane moves under the light source and deflects the light emitted from the light source to back-illuminate the sample area right under the camera. The preferred tilt angle of the non-parallel part of the bottom lever plane is in the range of 45 degree to 65 degree and the tilt angle is defined as the angle between the non-parallel bottom plane and the vertical plane.
Part of the bottom lever plane is parallel to the image plane and is located under and 1mm to lOmm away from the sample. The surface of the parallel part of the bottom lever plane is highly light absorptive with light absorption larger than 95%. This absorptive surface is to eliminate the reflective light back-illuminating on the sample in small incidence angle.
To slide in and out to switch the illumination optics using the lever, a stopper design comprising a ball plunger and a groove on the lever is used in order to stop the lever at a pre-defined position when being pulled outward from the adaptor. This allow the user to use arbitrary force the pull the lever but make the lever to stop at a fixed position where the optical adaptor's working mode is switched to bright-filed illumination.
A sample slider is mounted inside the receptacle slot to receive the QMAX
device and position the sample in the QMAX device in the field of view and focal range of the smartphone camera.
The sample slider comprises a fixed track frame and a moveable arm:
The frame track is fixedly mounted in the receptacle slot of the optical box.
And the track frame has a sliding track slot that fits the width and thickness of the QMAX
device so that the QMAX device can slide along the track. The width and height of the track slot is carefully configured to make the QMAX device shift less than 0.5mm in the direction perpendicular to the
The lever comprises two planes at different planes at different heights.
In some embodiments, two planes can be joined together with a vertical bar and move together in or out of the optical box. In some embodiments, two planes can be separated and each plane can move individually in or out of the optical box.
The upper lever plane comprises at least one optical element which can be, but not limited to be an optical filter. The upper lever plane moves under the light source and the preferred distance between the upper lever plane and the light source is in the range of 0 to 5mm.
Part of the bottom lever plane is not parallel to the image plane. And the surface of the non-parallel part of the bottom lever plane has mirror finish with high reflectivity larger than 95%.
The non-parallel part of the bottom lever plane moves under the light source and deflects the light emitted from the light source to back-illuminate the sample area right under the camera. The preferred tilt angle of the non-parallel part of the bottom lever plane is in the range of 45 degree to 65 degree and the tilt angle is defined as the angle between the non-parallel bottom plane and the vertical plane.
Part of the bottom lever plane is parallel to the image plane and is located under and 1mm to lOmm away from the sample. The surface of the parallel part of the bottom lever plane is highly light absorptive with light absorption larger than 95%. This absorptive surface is to eliminate the reflective light back-illuminating on the sample in small incidence angle.
To slide in and out to switch the illumination optics using the lever, a stopper design comprising a ball plunger and a groove on the lever is used in order to stop the lever at a pre-defined position when being pulled outward from the adaptor. This allow the user to use arbitrary force the pull the lever but make the lever to stop at a fixed position where the optical adaptor's working mode is switched to bright-filed illumination.
A sample slider is mounted inside the receptacle slot to receive the QMAX
device and position the sample in the QMAX device in the field of view and focal range of the smartphone camera.
The sample slider comprises a fixed track frame and a moveable arm:
The frame track is fixedly mounted in the receptacle slot of the optical box.
And the track frame has a sliding track slot that fits the width and thickness of the QMAX
device so that the QMAX device can slide along the track. The width and height of the track slot is carefully configured to make the QMAX device shift less than 0.5mm in the direction perpendicular to the
6 sliding direction in the sliding plane and shift less than less than 0.2mm along the thickness direction of the QMAX device.
The frame track has an opened window under the field of view of the camera of smartphone to allow the light back-illuminate the sample.
A moveable arm is pre-built in the sliding track slot of the track frame and moves together with the QMAX device to guide the movement of QMAX device in the track frame.
The moveable arm equipped with a stopping mechanism with two pre-defined stop positions. For one position, the arm will make the QMAX device stop at the position where a fixed sample area on the QMAX device is right under the camera of smartphone. For the other position, the arm will make the QMAX device stop at the position where the sample area on QMAX device is out of the field of view of the smartphone and the QMAX device can be easily taken out of the track slot.
The moveable arm switches between the two stop positions by a pressing the QMAX
device and the moveable arm together to the end of the track slot and then releasing.
The moveable arm can indicate if the QMAX device is inserted in correct direction. The shape of one corner of the QMAX device is configured to be different from the other three right angle corners. And the shape of the moveable arm matches the shape of the corner with the special shape so that only in correct direction can QMAX device slide to correct position in the track slot.
FIG. 1-A, 1-B and 1-C is the schematic illustration of system 19 testing sample in fluorescent illumination mode. Particularly, FIG. 1-B and 1-C are the exploded views of system 19, shown from the front and rear sides respectively. System 19 comprises a smartphone 1; an optical adaptor device 18 fitting over the upper part of smartphone 1; a sample slide 5, inserted into receptacle slot 4 of device 18 so that the sample on sample slide 5 is positioned within the field of view and focal range of camera module 1C in smartphone 1. A lever 8 is fully pressed into device 18 so that system 19 operates in fluorescent illumination mode. A
rubber door 16 attached to device 18 covers receptacle slot 4 after sample slide 5 is in so as to prevent the ambient light getting into receptacle slot 4 to affect the test.
The software (not shown) installed in smartphone 1 analyzes the image collected by camera module 1C while light source 1L in smartphone 1 is emitting light, in order to get some property of the sample, and outputs the results to a display screen If in smartphone I.
FIG. 2-A, 2-B and 2-C is the schematic illustration of system 20 testing sample in bright-field illumination mode. Particularly, FIG. 2-B and 2-C are the exploded views of system 20, shown
The frame track has an opened window under the field of view of the camera of smartphone to allow the light back-illuminate the sample.
A moveable arm is pre-built in the sliding track slot of the track frame and moves together with the QMAX device to guide the movement of QMAX device in the track frame.
The moveable arm equipped with a stopping mechanism with two pre-defined stop positions. For one position, the arm will make the QMAX device stop at the position where a fixed sample area on the QMAX device is right under the camera of smartphone. For the other position, the arm will make the QMAX device stop at the position where the sample area on QMAX device is out of the field of view of the smartphone and the QMAX device can be easily taken out of the track slot.
The moveable arm switches between the two stop positions by a pressing the QMAX
device and the moveable arm together to the end of the track slot and then releasing.
The moveable arm can indicate if the QMAX device is inserted in correct direction. The shape of one corner of the QMAX device is configured to be different from the other three right angle corners. And the shape of the moveable arm matches the shape of the corner with the special shape so that only in correct direction can QMAX device slide to correct position in the track slot.
FIG. 1-A, 1-B and 1-C is the schematic illustration of system 19 testing sample in fluorescent illumination mode. Particularly, FIG. 1-B and 1-C are the exploded views of system 19, shown from the front and rear sides respectively. System 19 comprises a smartphone 1; an optical adaptor device 18 fitting over the upper part of smartphone 1; a sample slide 5, inserted into receptacle slot 4 of device 18 so that the sample on sample slide 5 is positioned within the field of view and focal range of camera module 1C in smartphone 1. A lever 8 is fully pressed into device 18 so that system 19 operates in fluorescent illumination mode. A
rubber door 16 attached to device 18 covers receptacle slot 4 after sample slide 5 is in so as to prevent the ambient light getting into receptacle slot 4 to affect the test.
The software (not shown) installed in smartphone 1 analyzes the image collected by camera module 1C while light source 1L in smartphone 1 is emitting light, in order to get some property of the sample, and outputs the results to a display screen If in smartphone I.
FIG. 2-A, 2-B and 2-C is the schematic illustration of system 20 testing sample in bright-field illumination mode. Particularly, FIG. 2-B and 2-C are the exploded views of system 20, shown
7 from the front and rear sides respectively. System 20 comprises a smartphone 1; an optical adaptor device 18 fitting over the upper part of smartphone 1; a sample slide 5, inserted into receptacle slot 4 of device 18 so that the sample on sample slide 5 is positioned within the field of view and focal range of camera module 1C in smartphone I. A lever 8 is pulled outward from device 18 and stopped by a stopper (not shown) at a pre-designed position in device 18 so that system 20 operates in bright-field illumination mode.
FIG. 3 is the schematic exploded view of optical adaptor device 18 in system 19 and system 20. Device 18 comprises a holder case 2 fitting over the upper part of smartphone 1; an optical box 3 attached to case 2 including a receptacle slot 4, an optics chamber 3C, track 6b and 6f allowing lever 8 to slide in, and a rubber door 16 inserted into trench 4s to cover receptacle slot 4. An optics insert 7 is fitted into the top of optics chamber 3C with an exit aperture 7L and an entrance aperture 7C in it aligning with light source 1L and camera 1C
(shown in FIG. 2-B) in smartphone 1. A lens 11 is mounted in entrance aperture 7C in optics insert 7 and configured so that the sample in sample slide 5 inserted into receptacle slot 4 is located within the working distance of the camera 1C (shown in FIG. 2-B and 1-B). Lens 11 serves to magnify the images of the sample captured by camera 1C (shown in FIG. 2-B and 1-B). A long-pass optical filter 12 is mounted on top of lens 11 in entrance aperture 7C. A pair of right angle mirrors 13 and 14 are mounted on the bottom of optics chamber 3C and configured so that mirror 13 and mirror 14 are aligned with light source 1L and camera 1C (shown in FIG. 2-B and 1-B) respectively. Mirror 13 and mirror 14 whose operation as bright-field illumination optics in device 18 is described below in FIG. 4. Lever 8 comprise two level bars: the upper-level bar comprises a band-pass optical filter 15 mounted in slot 8a, and the lower-level bar comprises a light absorber 9 mounted on the horizontal plane 8b and a reflective mirror 10 mounted on the tilted plane 8c.
The optical filter 15, light absorber 9 and mirror 10 whose operation as fluorescent illumination optics in device 18 is described below in FIG. 5. The upper-level bar of lever 8 slides along track 6f in box 3 and lower-level bar 8b and 8c slides along track 6b in box 3. Lever 8 stops at two different positions in box 3 to switch between bright-field illumination optics and fluorescent illumination optics. Lever 8 is fully inserted into box 3 to switch device 18 to work with fluorescent illumination optics. Ball plunger 17 is mounted on the sidewall of track 6t to stop lever 8 at a pre-defined position when lever 8 being pulled outward from box 3 to switch device 18 to work with bright-field illumination optics.
FIG. 4 is the schematic sectional view showing details of system 20 testing sample in bright-field illumination mode, and particularly of device 18. This figure illustrates the functionality of the elements that were described above with reference to FIG.3. Lever 8 (shown in FIG. 3) is
FIG. 3 is the schematic exploded view of optical adaptor device 18 in system 19 and system 20. Device 18 comprises a holder case 2 fitting over the upper part of smartphone 1; an optical box 3 attached to case 2 including a receptacle slot 4, an optics chamber 3C, track 6b and 6f allowing lever 8 to slide in, and a rubber door 16 inserted into trench 4s to cover receptacle slot 4. An optics insert 7 is fitted into the top of optics chamber 3C with an exit aperture 7L and an entrance aperture 7C in it aligning with light source 1L and camera 1C
(shown in FIG. 2-B) in smartphone 1. A lens 11 is mounted in entrance aperture 7C in optics insert 7 and configured so that the sample in sample slide 5 inserted into receptacle slot 4 is located within the working distance of the camera 1C (shown in FIG. 2-B and 1-B). Lens 11 serves to magnify the images of the sample captured by camera 1C (shown in FIG. 2-B and 1-B). A long-pass optical filter 12 is mounted on top of lens 11 in entrance aperture 7C. A pair of right angle mirrors 13 and 14 are mounted on the bottom of optics chamber 3C and configured so that mirror 13 and mirror 14 are aligned with light source 1L and camera 1C (shown in FIG. 2-B and 1-B) respectively. Mirror 13 and mirror 14 whose operation as bright-field illumination optics in device 18 is described below in FIG. 4. Lever 8 comprise two level bars: the upper-level bar comprises a band-pass optical filter 15 mounted in slot 8a, and the lower-level bar comprises a light absorber 9 mounted on the horizontal plane 8b and a reflective mirror 10 mounted on the tilted plane 8c.
The optical filter 15, light absorber 9 and mirror 10 whose operation as fluorescent illumination optics in device 18 is described below in FIG. 5. The upper-level bar of lever 8 slides along track 6f in box 3 and lower-level bar 8b and 8c slides along track 6b in box 3. Lever 8 stops at two different positions in box 3 to switch between bright-field illumination optics and fluorescent illumination optics. Lever 8 is fully inserted into box 3 to switch device 18 to work with fluorescent illumination optics. Ball plunger 17 is mounted on the sidewall of track 6t to stop lever 8 at a pre-defined position when lever 8 being pulled outward from box 3 to switch device 18 to work with bright-field illumination optics.
FIG. 4 is the schematic sectional view showing details of system 20 testing sample in bright-field illumination mode, and particularly of device 18. This figure illustrates the functionality of the elements that were described above with reference to FIG.3. Lever 8 (shown in FIG. 3) is
8 pulled outward from device 18 and stopped by stopper 17 (shown in FIG. 3) at a pre-defined position so that mirror 13 and mirror 14 is exposed to and aligned with camera 1C and light source IL. Light source IL emits light beam BB1 away from smartphone 1. Beam BB1 is deflected by mirror 14 by 90 degrees to beam BB2 which is further deflected by mirror 13 by 90 degrees to beam BB3. Beam BB3 back-illuminates the sample in sample slide 5 in normal incidence angle.
Lens 11 creates a magnified images of the sample on the image sensor plane of camera 1C.
Smartphone 1 captures and processes the image to get some property of the sample.
FIG. 5 is the schematic sectional view showing details of system 19 testing sample in fluorescent illumination mode, and particularly of device 18. This figure illustrates the functionality of the elements that were described above with reference to FIG. 3. Lever 8 (shown in FIG. 3) is fully inserted into device 18 so that light absorber 9 and tilted mirror 10 are under the view of camera 1C and light source IL, and block the light path between light source 1L and the pair of mirrors of 13 and 14. And band-pass optical filter 15 is right under the light source IL. Light source 1L emits light beam BFI away from smartphone 1. Optical filter 15 allows beam BFI with specific wavelength range which matches the excitation wavelength of the fluorescent sample in sample slide 5 to go through. Part of beam BFI illuminates on the edge of transparent sample slide 5 and couples to waveguide beam BF3 travelling in sample slide 5 and illuminates the sample area under the lens 11. Part of beam BFI illuminates on mirror 10. Tilted mirror 10 deflects beam BFI
to beam BF2 and back-illuminates the sample area in sample slide 5 right under lens 11 in large oblique angle. The remaining part of beam BFI with large divergence angle (i.e., beam BF4) illuminates on absorber 9 and get absorbed so that no reflected light of beam BF4 gets into the camera 1C in small incidence angle. The light coming from the sample area under the lens 11 goes through the lens 11 and is filtered by long-pass filter 12 so that only light in a specify wavelength range that is emitted by the fluorescent sample in sample slide 5 gets into camera 1C
to form an image. Smartphone 1 captures and processes the image to get some property of the sample. Rubber door 16 is inserted into device 18 to cover sample slide 5 to prevent ambient light getting into device 18 to affect the test.
FIG. 6-A and FIG. 6-B is the schematic sectional viewing showing the design to make lever 8 stop at the pre-defined position when being pulled outward from the device 18. Ball plunger 17 is mounted in the sidewall of track slot 6t, and a groove 8g is drilled on the sidewall of lever 8 with the shape matching the shape of the ball in ball plunger 17. When lever 8 is being pulled outward from device 18 and has not reach the pre-defined position as shown in FIG. 6-A, the ball in ball plunger 17 in pressed into its body by the sidewall of lever 8 so that lever 8 can slide along
Lens 11 creates a magnified images of the sample on the image sensor plane of camera 1C.
Smartphone 1 captures and processes the image to get some property of the sample.
FIG. 5 is the schematic sectional view showing details of system 19 testing sample in fluorescent illumination mode, and particularly of device 18. This figure illustrates the functionality of the elements that were described above with reference to FIG. 3. Lever 8 (shown in FIG. 3) is fully inserted into device 18 so that light absorber 9 and tilted mirror 10 are under the view of camera 1C and light source IL, and block the light path between light source 1L and the pair of mirrors of 13 and 14. And band-pass optical filter 15 is right under the light source IL. Light source 1L emits light beam BFI away from smartphone 1. Optical filter 15 allows beam BFI with specific wavelength range which matches the excitation wavelength of the fluorescent sample in sample slide 5 to go through. Part of beam BFI illuminates on the edge of transparent sample slide 5 and couples to waveguide beam BF3 travelling in sample slide 5 and illuminates the sample area under the lens 11. Part of beam BFI illuminates on mirror 10. Tilted mirror 10 deflects beam BFI
to beam BF2 and back-illuminates the sample area in sample slide 5 right under lens 11 in large oblique angle. The remaining part of beam BFI with large divergence angle (i.e., beam BF4) illuminates on absorber 9 and get absorbed so that no reflected light of beam BF4 gets into the camera 1C in small incidence angle. The light coming from the sample area under the lens 11 goes through the lens 11 and is filtered by long-pass filter 12 so that only light in a specify wavelength range that is emitted by the fluorescent sample in sample slide 5 gets into camera 1C
to form an image. Smartphone 1 captures and processes the image to get some property of the sample. Rubber door 16 is inserted into device 18 to cover sample slide 5 to prevent ambient light getting into device 18 to affect the test.
FIG. 6-A and FIG. 6-B is the schematic sectional viewing showing the design to make lever 8 stop at the pre-defined position when being pulled outward from the device 18. Ball plunger 17 is mounted in the sidewall of track slot 6t, and a groove 8g is drilled on the sidewall of lever 8 with the shape matching the shape of the ball in ball plunger 17. When lever 8 is being pulled outward from device 18 and has not reach the pre-defined position as shown in FIG. 6-A, the ball in ball plunger 17 in pressed into its body by the sidewall of lever 8 so that lever 8 can slide along
9 the track 6t. As shown in FIG. 6-B, when the groove 8g on lever 8 reach to the position of ball plunger 17, the ball in ball plunger 17 jump into groove 8g to stop lever 8.
FIG. 7 is the schematic illustration of the structure of the sample slider holding the QMAX
device. The sample slider comprises a track frame having a track slot to let QMAX device slide along it, a moveable arm pre-built in the track slot moving together with QMAX
device to guide its movement. The moveable arm equipped with a stopping mechanism to make QMAX
device stop at two pre-defined stop positions. The width and height of the track slot is carefully configured to make the QMAX device shift less than 0.5mm in horizontal direction perpendicular to the sliding direction and shift less than less than 0.2mm along the thickness direction of the QMAX device.
FIG. 8 is the schematic illustration of the moveable arm switching between two pre-defined stop positions. By pressing the QMAX device and the moveable arm together to the end of the track slot and then releasing, the QMAX card can stop at either position 1 where sample area is out of field of view of smartphone camera for easily taking out the QMAX
device from the slider or position 2 where sample area is right under the field of view of smartphone camera for capturing image.
FIG.9 is the schematic illustration of how the slider indicates if QMAX device is inserted in right direction. The shape of one corner of the QMAX device is configured to be different from the other three right angle corners. And the shape of the moveable arm matches the shape of the corner with the special shape so that only in correct direction can QMAX
device slide to correct position in the track slot. If the QMAX device is flipped or inserted from the wrong side, the part of the QMAX device outside the slider is longer that when the QMAX device is correctly inserted.
When both fluorescent image and bright-field images are available, one can employ the knowledge of the fluorescent image to process the bright-field image, or employ the knowledge of the bright-field image to process the fluorescent image, or collectively process two images. The field-of-view of the fluorescent image and bright-field image can be different; thus, the two images are not spatially aligned, pixel-to-pixel.
To solve the mis-alignment between the fluorescent image and bright-field image, one can apply image registration to these two images. An image registration finds a geometric transform that relates the spatial position from one image to another. Various image registration algorithms can be used for aligning a fluorescent image and bright-field image, including but not limited to, feature-point based, cross-correlation based, Fourier alignment based, etc.
The image registration outputs a geometric transform that maps the spatial position (coordinate) of one image to another.
After the fluorescent image and bright-field image are aligned, one can utilize the information from two images to refine the processing of one image, or process two images collectively.
Examples Al. An optical adaptor, comprising:
a holder frame, and an optical box removably attached to the holder frame, wherein the holder frame is configured to removably fit over a mobile device and align the optical box to a camera and an illumination source integrated in the mobile device;
wherein the optical box comprises sample receptacle slot and illumination optics.
Bl. An optical system, comprising:
the optical adaptor of embodiment Al; and ii. a QMAX card, which comprises a first plate and a second, wherein the first plate and the second compresses a liquid sample into a layer of uniform thickness of less than 200 um; and a slider that configured to accommodate the QMAX card and to be asserted into the optical box.
Cl. The adaptor or system of any prior embodiments, wherein the mobile device is a smart phone.
02. The adaptor or system of any prior embodiments, wherein the holder frame comprises a holder case that is configured to be replaceable with other holder cases having a different size for different mobile devices.
03. The adaptor or system of any prior embodiments, wherein the holder frame is sized to removably fit the optical adaptor to an upper part of the mobile device.
04. The adaptor or system of any prior embodiments, wherein the optical box of the optical adaptor comprises:
a receptacle slot that is configured to receive and position the QMAX card in a sample slide in the field of view and focal range of the camera;
a bright-field illumination optics that is configured to capture bright-field microscopy images of the sample;
a fluorescent illumination optics that is configured to capture fluorescent microscopy images of a sample; and iv. a lever that is configured to switch between bright-field illumination optics and fluorescent illumination optics by sliding inward and outward in the optical box.
05. The adaptor or system of any prior embodiments, wherein the receptor slot comprises a rubber door, which can fully cover the slot to prevent the ambient light getting into the optical box to be collected by the camera.
06. The adaptor or system of any prior embodiments, wherein the bright-field illumination optics in the adaptor is configured to receive and turn the beam emitted by the light source so as to back-illuminated the sample in normal incidence angle 07. The adaptor or system of any prior embodiments, wherein optical box further comprises a lens mounted in it and aligned with the camera of the mobile device, which magnifies the images captured by the camera.
08. The adaptor or system of any prior embodiments, wherein the images captured by the camera are further processed by processors of mobile device and outputs the analysis result on a screen of mobile device.
09. The adaptor or system of any prior embodiments, wherein the level is slidable and is configured to achieve both bright-field illumination and fluorescent illumination optics in the same optical adaptor.
010. The adaptor or system of any prior embodiments, wherein optical elements of the fluorescent illumination optics are mounted on the lever and when the lever fully slides into the optical box, 011. The adaptor or system of any prior embodiments, wherein the lever with the fluorescent illumination optics elements block the optical path of bright-field illumination optics and switch the illumination optics to fluorescent illumination optics 012. The adaptor or system of any prior embodiments, wherein when the lever slides out, the fluorescent illumination optics elements mounted on the lever move out of the optical path and switch the illumination optics to bright-field illumination optics 013. The adaptor or system of any prior embodiments, wherein the lever comprises two planes at different heights.
014. The adaptor or system of any prior embodiments, wherein the two planes are joined together with a vertical bar and move together in or out of the optical box.
015. The adaptor or system of any prior embodiments, wherein the two planes can be separated and each plane can move individually in or out of the optical box.
016. The adaptor or system of any prior embodiments, wherein the upper lever plane comprises at least one optical element which can be, but not limited to be an optical filter.
017. The adaptor or system of any prior embodiments, wherein the upper lever plane moves under the light source and the preferred distance between the upper lever plane and the light source is in the range of 0 to 5mm.
018. The adaptor or system of any prior embodiments, wherein part of the bottom lever plane is not parallel to the image plane.
019. The adaptor or system of any prior embodiments, wherein the surface of the non-parallel part of the bottom lever plane has mirror finish with high reflectivity larger than 95%.
020. The adaptor or system of any prior embodiments, wherein the non-parallel part of the bottom lever plane moves under the light source and deflects the light emitted from the light source to back-illuminate the sample area right under the camera.
021. The adaptor or system of any prior embodiments, wherein the preferred tilt angle of the non-parallel part of the bottom lever plane is in the range of 45 degree to 65 degree and the tilt angle is defined as the angle between the non-parallel bottom plane and the vertical plane.
022. The adaptor or system of any prior embodiments, wherein part of the bottom lever plane is parallel to the image plane and is located under and 1mm to 10mm away from the sample.
023. The adaptor or system of any prior embodiments, wherein the surface of the parallel part of the bottom lever plane is highly light absorptive with light absorption larger than 95%.
024. The adaptor or system of any prior embodiments, wherein the absorptive surface is to eliminate the reflective light back-illuminating on the sample in small incidence angle.
025. The adaptor or system of any prior embodiments, wherein the lever comprises a stopper configured to stop the lever.
026. The adaptor or system of any prior embodiments, wherein the stopper comprises a ball plunger and a groove on the lever is used in order to stop the lever at a pre-defined position when being pulled outward from the adaptor.
027. The adaptor or system of any prior embodiments, wherein the stopper is configured to allow the user to use arbitrary force the pull the lever but make the lever to stop at a fixed position where the optical adaptor's working mode is switched to bright-filed illumination.
028. The adaptor or system of any prior embodiments, wherein the sample slider is mounted inside the receptacle slot to receive the QMAX device and position the sample in the QMAX device in the field of view and focal range of the smartphone camera.
029. The adaptor or system of any prior embodiments, wherein the moveable arm switches between the two stop positions by a pressing the QMAX device and the moveable arm together to the end of the track slot and then releasing.
030. The adaptor or system of any prior embodiments, wherein he moveable arm can indicate if the QMAX device is inserted in correct direction.
031. The adaptor or system of any prior embodiments, wherein the shape of one corner of the QMAX device is configured to be different from the other three right angle corners.
031. The adaptor or system of any prior embodiments, wherein the shape of the moveable arm matches the shape of the corner with the special shape so that only in correct direction can QMAX
device slide to correct position in the track slot.
032. The adaptor or system of any prior embodiments, wherein the sample slider comprises a fixed track frame and a moveable arm:
033. The adaptor or system of any prior embodiments, wherein he frame track is fixedly mounted in the receptacle slot of the optical box; and the track frame has a sliding track slot that fits the width and thickness of the QMAX device so that the QMAX device can slide along the track. The width and height of the track slot is carefully configured to make the QMAX device shift less than 0.5mm in the direction perpendicular to the sliding direction in the sliding plane and shift less than less than 0.2mm along the thickness direction of the QMAX device.
034. The adaptor or system of any prior embodiments, wherein the frame track has an opened window under the field of view of the camera of smartphone to allow the light back-illuminate the sample.
035. The adaptor or system of any prior embodiments, wherein the moveable arm is pre-built in the sliding track slot of the track frame and moves together with the QMAX
device to guide the movement of QMAX device in the track frame.
036. The adaptor or system of any prior embodiments, wherein the moveable arm equipped with a stopping mechanism with two pre-defined stop positions.
B. Optical adaptor for colorimetric reader attachment to smartphone (tilted-fiber-end illumination) Colorimetric assay is a very powerful technique having wide applications in health monitoring, disease diagnostic, chemical analysis and so on. The key factor to get the accurate colorimetric assay result is to accurately quantify the color change.
Conventionally, the color change of a colorimetric test strip is analyzed by comparing the color change with a standard color card. But this comparison is accomplished by human's eye and can be easily influenced by the environment light condition, which limits the accuracy of quantifying the color change.
The present invention that is described herein address this problem by providing a system comprising an optical adaptor and a smartphone. The optical adaptor device fits over a smartphone converting it into a colorimetric reader which can provide a consistent and uniform illumination to illuminate the front surface of the colorimetric test card and capture the image of the sample to analyze the color change. This system can be operated conveniently and reliably by a common person at any location. The optical adaptor takes advantage of the existing resources of the smartphone, including camera, light source, processor and display screen, which provides a low-cost solution to accurately quantify the color change of a colorimetric assay.
In this invention, the optical adaptor device comprises a holder frame fitting over the upper part of the smartphone and an optical box attached to the holder having sample receptacle slot and illumination optics. In some prior arts of attachment adaptor for smartphone, their adaptor design is a whole piece including both the clip-on mechanics parts to fit over the smartphone and the functional elements. This design has the problem that they need to redesign the whole-piece adaptor for each specific model of smartphone. But in this present invention, the optical adaptor is separated into a holder frame only for fitting a smartphone and a universal optical box containing all the functional parts. For the smartphones with different dimensions, as long as the relative positions of the camera and the light source are the same, only the holder frame need to be redesigned, which will save a lot of cost of design and manufacture.
The optical box of the optical adaptor comprises: a receptacle slot which receives and position the colorimetric sample in the field of view and focal range of the smartphone camera; an illumination and imaging optics to create uniform and consistent illumination on the sample independently of any external conditions and capture the sample image.
To capture the sample image to accurately represent the color change, it is desirable that the sample area under the camera is uniformly illuminated. But for all common smartphones, there is always a distance between the light source and the camera. When the sample is placed very close to the camera of smartphone, without additional illumination optics, the area can be uniformly front-illuminated by the light source is right under the light source but not within the field of view of the camera. To solve this problem, in this present invention, a tilted large-core optical fiber is used to turn the light beam emitted from the light source to uniformly illuminate the sample area right under the camera.
And to create a more uniform illumination, it is desirable that the light beam from an area light source rather than from a LED point light source of the smartphone. A
separate diffuser placed in front of the end faces of the optical fiber could be provided for this purpose, but this approach increases the elements in the optical adaptor and increase the cost.
Instead, in this present invention, both end faces of the optical fiber are made to have matte finish to serve as the diffuser so that the end face towards the sample can become an area light source to generate more uniform illumination on the sample.
Typically, the optical box also comprises a lens mounted in it aligned with the camera of the smartphone, which makes the sample within the focal range of the camera.
The images captured by the camera will be further processed by the processor of smartphone to analyze the color change and outputs the analysis result on the screen of smartphone.
A sample slider is mounted inside the receptacle slot to receive the QMAX
device and position the sample in the QMAX device in the field of view and focal range of the smartphone camera.
The sample slider comprises a fixed track frame and a moveable arm:
The frame track is fixedly mounted in the receptacle slot of the optical box.
And the track frame has a sliding track slot that fits the width and thickness of the QMAX
device so that the QMAX device can slide along the track. The width and height of the track slot is carefully configured to make the QMAX device shift less than 0.5mm in the direction perpendicular to the sliding direction in the sliding plane and shift less than less than 0.2mm along the thickness direction of the QMAX device.
The frame track has an opened window under the field of view of the camera of smartphone to allow the light back-illuminate the sample.
A moveable arm is pre-built in the sliding track slot of the track frame and moves together with the QMAX device to guide the movement of QMAX device in the track frame.
The moveable arm equipped with a stopping mechanism with two pre-defined stop positions. For one position, the arm will make the QMAX device stop at the position where a fixed sample area on the QMAX device is right under the camera of smartphone. For the other position, the arm will make the QMAX device stop at the position where the sample area on QMAX device is out of the field of view of the smartphone and the QMAX device can be easily taken out of the track slot.
The moveable arm switches between the two stop positions by a pressing the QMAX
device and the moveable arm together to the end of the track slot and then releasing.
The moveable arm can indicate if the QMAX device is inserted in correct direction. The shape of one corner of the QMAX device is configured to be different from the other three right angle corners. And the shape of the moveable arm matches the shape of the corner with the special shape so that only in correct direction can QMAX device slide to correct position in the track slot.
FIG. 10-A, 10-B and 10-C are the schematic illustration of system 10 for smartphone colorimetric reader. Particularly, FIG. 10-B and 10-C are the exploded views of system 10, shown from the front and rear sides respectively. System 10 comprises a smartphone 1; an optical adaptor device 13 fitting over the upper part of smartphone 1; a colorimetric test card 137, inserted into receptacle slot 136 of device 13 so that the sample area on the sample card 137 is positioned within the field of view and focal range of camera module 1C in smartphone 1.
The software (not shown) installed in smartphone 1 analyzes the image collected by camera module 1C while light source 1L in smartphone 1 is emitting light, in order to analyze the color change of the colorimetric test, and outputs the results to a display screen If in smartphone 1.
FIG. 11 is the schematic exploded view of optical adaptor device 13 in system
FIG. 7 is the schematic illustration of the structure of the sample slider holding the QMAX
device. The sample slider comprises a track frame having a track slot to let QMAX device slide along it, a moveable arm pre-built in the track slot moving together with QMAX
device to guide its movement. The moveable arm equipped with a stopping mechanism to make QMAX
device stop at two pre-defined stop positions. The width and height of the track slot is carefully configured to make the QMAX device shift less than 0.5mm in horizontal direction perpendicular to the sliding direction and shift less than less than 0.2mm along the thickness direction of the QMAX device.
FIG. 8 is the schematic illustration of the moveable arm switching between two pre-defined stop positions. By pressing the QMAX device and the moveable arm together to the end of the track slot and then releasing, the QMAX card can stop at either position 1 where sample area is out of field of view of smartphone camera for easily taking out the QMAX
device from the slider or position 2 where sample area is right under the field of view of smartphone camera for capturing image.
FIG.9 is the schematic illustration of how the slider indicates if QMAX device is inserted in right direction. The shape of one corner of the QMAX device is configured to be different from the other three right angle corners. And the shape of the moveable arm matches the shape of the corner with the special shape so that only in correct direction can QMAX
device slide to correct position in the track slot. If the QMAX device is flipped or inserted from the wrong side, the part of the QMAX device outside the slider is longer that when the QMAX device is correctly inserted.
When both fluorescent image and bright-field images are available, one can employ the knowledge of the fluorescent image to process the bright-field image, or employ the knowledge of the bright-field image to process the fluorescent image, or collectively process two images. The field-of-view of the fluorescent image and bright-field image can be different; thus, the two images are not spatially aligned, pixel-to-pixel.
To solve the mis-alignment between the fluorescent image and bright-field image, one can apply image registration to these two images. An image registration finds a geometric transform that relates the spatial position from one image to another. Various image registration algorithms can be used for aligning a fluorescent image and bright-field image, including but not limited to, feature-point based, cross-correlation based, Fourier alignment based, etc.
The image registration outputs a geometric transform that maps the spatial position (coordinate) of one image to another.
After the fluorescent image and bright-field image are aligned, one can utilize the information from two images to refine the processing of one image, or process two images collectively.
Examples Al. An optical adaptor, comprising:
a holder frame, and an optical box removably attached to the holder frame, wherein the holder frame is configured to removably fit over a mobile device and align the optical box to a camera and an illumination source integrated in the mobile device;
wherein the optical box comprises sample receptacle slot and illumination optics.
Bl. An optical system, comprising:
the optical adaptor of embodiment Al; and ii. a QMAX card, which comprises a first plate and a second, wherein the first plate and the second compresses a liquid sample into a layer of uniform thickness of less than 200 um; and a slider that configured to accommodate the QMAX card and to be asserted into the optical box.
Cl. The adaptor or system of any prior embodiments, wherein the mobile device is a smart phone.
02. The adaptor or system of any prior embodiments, wherein the holder frame comprises a holder case that is configured to be replaceable with other holder cases having a different size for different mobile devices.
03. The adaptor or system of any prior embodiments, wherein the holder frame is sized to removably fit the optical adaptor to an upper part of the mobile device.
04. The adaptor or system of any prior embodiments, wherein the optical box of the optical adaptor comprises:
a receptacle slot that is configured to receive and position the QMAX card in a sample slide in the field of view and focal range of the camera;
a bright-field illumination optics that is configured to capture bright-field microscopy images of the sample;
a fluorescent illumination optics that is configured to capture fluorescent microscopy images of a sample; and iv. a lever that is configured to switch between bright-field illumination optics and fluorescent illumination optics by sliding inward and outward in the optical box.
05. The adaptor or system of any prior embodiments, wherein the receptor slot comprises a rubber door, which can fully cover the slot to prevent the ambient light getting into the optical box to be collected by the camera.
06. The adaptor or system of any prior embodiments, wherein the bright-field illumination optics in the adaptor is configured to receive and turn the beam emitted by the light source so as to back-illuminated the sample in normal incidence angle 07. The adaptor or system of any prior embodiments, wherein optical box further comprises a lens mounted in it and aligned with the camera of the mobile device, which magnifies the images captured by the camera.
08. The adaptor or system of any prior embodiments, wherein the images captured by the camera are further processed by processors of mobile device and outputs the analysis result on a screen of mobile device.
09. The adaptor or system of any prior embodiments, wherein the level is slidable and is configured to achieve both bright-field illumination and fluorescent illumination optics in the same optical adaptor.
010. The adaptor or system of any prior embodiments, wherein optical elements of the fluorescent illumination optics are mounted on the lever and when the lever fully slides into the optical box, 011. The adaptor or system of any prior embodiments, wherein the lever with the fluorescent illumination optics elements block the optical path of bright-field illumination optics and switch the illumination optics to fluorescent illumination optics 012. The adaptor or system of any prior embodiments, wherein when the lever slides out, the fluorescent illumination optics elements mounted on the lever move out of the optical path and switch the illumination optics to bright-field illumination optics 013. The adaptor or system of any prior embodiments, wherein the lever comprises two planes at different heights.
014. The adaptor or system of any prior embodiments, wherein the two planes are joined together with a vertical bar and move together in or out of the optical box.
015. The adaptor or system of any prior embodiments, wherein the two planes can be separated and each plane can move individually in or out of the optical box.
016. The adaptor or system of any prior embodiments, wherein the upper lever plane comprises at least one optical element which can be, but not limited to be an optical filter.
017. The adaptor or system of any prior embodiments, wherein the upper lever plane moves under the light source and the preferred distance between the upper lever plane and the light source is in the range of 0 to 5mm.
018. The adaptor or system of any prior embodiments, wherein part of the bottom lever plane is not parallel to the image plane.
019. The adaptor or system of any prior embodiments, wherein the surface of the non-parallel part of the bottom lever plane has mirror finish with high reflectivity larger than 95%.
020. The adaptor or system of any prior embodiments, wherein the non-parallel part of the bottom lever plane moves under the light source and deflects the light emitted from the light source to back-illuminate the sample area right under the camera.
021. The adaptor or system of any prior embodiments, wherein the preferred tilt angle of the non-parallel part of the bottom lever plane is in the range of 45 degree to 65 degree and the tilt angle is defined as the angle between the non-parallel bottom plane and the vertical plane.
022. The adaptor or system of any prior embodiments, wherein part of the bottom lever plane is parallel to the image plane and is located under and 1mm to 10mm away from the sample.
023. The adaptor or system of any prior embodiments, wherein the surface of the parallel part of the bottom lever plane is highly light absorptive with light absorption larger than 95%.
024. The adaptor or system of any prior embodiments, wherein the absorptive surface is to eliminate the reflective light back-illuminating on the sample in small incidence angle.
025. The adaptor or system of any prior embodiments, wherein the lever comprises a stopper configured to stop the lever.
026. The adaptor or system of any prior embodiments, wherein the stopper comprises a ball plunger and a groove on the lever is used in order to stop the lever at a pre-defined position when being pulled outward from the adaptor.
027. The adaptor or system of any prior embodiments, wherein the stopper is configured to allow the user to use arbitrary force the pull the lever but make the lever to stop at a fixed position where the optical adaptor's working mode is switched to bright-filed illumination.
028. The adaptor or system of any prior embodiments, wherein the sample slider is mounted inside the receptacle slot to receive the QMAX device and position the sample in the QMAX device in the field of view and focal range of the smartphone camera.
029. The adaptor or system of any prior embodiments, wherein the moveable arm switches between the two stop positions by a pressing the QMAX device and the moveable arm together to the end of the track slot and then releasing.
030. The adaptor or system of any prior embodiments, wherein he moveable arm can indicate if the QMAX device is inserted in correct direction.
031. The adaptor or system of any prior embodiments, wherein the shape of one corner of the QMAX device is configured to be different from the other three right angle corners.
031. The adaptor or system of any prior embodiments, wherein the shape of the moveable arm matches the shape of the corner with the special shape so that only in correct direction can QMAX
device slide to correct position in the track slot.
032. The adaptor or system of any prior embodiments, wherein the sample slider comprises a fixed track frame and a moveable arm:
033. The adaptor or system of any prior embodiments, wherein he frame track is fixedly mounted in the receptacle slot of the optical box; and the track frame has a sliding track slot that fits the width and thickness of the QMAX device so that the QMAX device can slide along the track. The width and height of the track slot is carefully configured to make the QMAX device shift less than 0.5mm in the direction perpendicular to the sliding direction in the sliding plane and shift less than less than 0.2mm along the thickness direction of the QMAX device.
034. The adaptor or system of any prior embodiments, wherein the frame track has an opened window under the field of view of the camera of smartphone to allow the light back-illuminate the sample.
035. The adaptor or system of any prior embodiments, wherein the moveable arm is pre-built in the sliding track slot of the track frame and moves together with the QMAX
device to guide the movement of QMAX device in the track frame.
036. The adaptor or system of any prior embodiments, wherein the moveable arm equipped with a stopping mechanism with two pre-defined stop positions.
B. Optical adaptor for colorimetric reader attachment to smartphone (tilted-fiber-end illumination) Colorimetric assay is a very powerful technique having wide applications in health monitoring, disease diagnostic, chemical analysis and so on. The key factor to get the accurate colorimetric assay result is to accurately quantify the color change.
Conventionally, the color change of a colorimetric test strip is analyzed by comparing the color change with a standard color card. But this comparison is accomplished by human's eye and can be easily influenced by the environment light condition, which limits the accuracy of quantifying the color change.
The present invention that is described herein address this problem by providing a system comprising an optical adaptor and a smartphone. The optical adaptor device fits over a smartphone converting it into a colorimetric reader which can provide a consistent and uniform illumination to illuminate the front surface of the colorimetric test card and capture the image of the sample to analyze the color change. This system can be operated conveniently and reliably by a common person at any location. The optical adaptor takes advantage of the existing resources of the smartphone, including camera, light source, processor and display screen, which provides a low-cost solution to accurately quantify the color change of a colorimetric assay.
In this invention, the optical adaptor device comprises a holder frame fitting over the upper part of the smartphone and an optical box attached to the holder having sample receptacle slot and illumination optics. In some prior arts of attachment adaptor for smartphone, their adaptor design is a whole piece including both the clip-on mechanics parts to fit over the smartphone and the functional elements. This design has the problem that they need to redesign the whole-piece adaptor for each specific model of smartphone. But in this present invention, the optical adaptor is separated into a holder frame only for fitting a smartphone and a universal optical box containing all the functional parts. For the smartphones with different dimensions, as long as the relative positions of the camera and the light source are the same, only the holder frame need to be redesigned, which will save a lot of cost of design and manufacture.
The optical box of the optical adaptor comprises: a receptacle slot which receives and position the colorimetric sample in the field of view and focal range of the smartphone camera; an illumination and imaging optics to create uniform and consistent illumination on the sample independently of any external conditions and capture the sample image.
To capture the sample image to accurately represent the color change, it is desirable that the sample area under the camera is uniformly illuminated. But for all common smartphones, there is always a distance between the light source and the camera. When the sample is placed very close to the camera of smartphone, without additional illumination optics, the area can be uniformly front-illuminated by the light source is right under the light source but not within the field of view of the camera. To solve this problem, in this present invention, a tilted large-core optical fiber is used to turn the light beam emitted from the light source to uniformly illuminate the sample area right under the camera.
And to create a more uniform illumination, it is desirable that the light beam from an area light source rather than from a LED point light source of the smartphone. A
separate diffuser placed in front of the end faces of the optical fiber could be provided for this purpose, but this approach increases the elements in the optical adaptor and increase the cost.
Instead, in this present invention, both end faces of the optical fiber are made to have matte finish to serve as the diffuser so that the end face towards the sample can become an area light source to generate more uniform illumination on the sample.
Typically, the optical box also comprises a lens mounted in it aligned with the camera of the smartphone, which makes the sample within the focal range of the camera.
The images captured by the camera will be further processed by the processor of smartphone to analyze the color change and outputs the analysis result on the screen of smartphone.
A sample slider is mounted inside the receptacle slot to receive the QMAX
device and position the sample in the QMAX device in the field of view and focal range of the smartphone camera.
The sample slider comprises a fixed track frame and a moveable arm:
The frame track is fixedly mounted in the receptacle slot of the optical box.
And the track frame has a sliding track slot that fits the width and thickness of the QMAX
device so that the QMAX device can slide along the track. The width and height of the track slot is carefully configured to make the QMAX device shift less than 0.5mm in the direction perpendicular to the sliding direction in the sliding plane and shift less than less than 0.2mm along the thickness direction of the QMAX device.
The frame track has an opened window under the field of view of the camera of smartphone to allow the light back-illuminate the sample.
A moveable arm is pre-built in the sliding track slot of the track frame and moves together with the QMAX device to guide the movement of QMAX device in the track frame.
The moveable arm equipped with a stopping mechanism with two pre-defined stop positions. For one position, the arm will make the QMAX device stop at the position where a fixed sample area on the QMAX device is right under the camera of smartphone. For the other position, the arm will make the QMAX device stop at the position where the sample area on QMAX device is out of the field of view of the smartphone and the QMAX device can be easily taken out of the track slot.
The moveable arm switches between the two stop positions by a pressing the QMAX
device and the moveable arm together to the end of the track slot and then releasing.
The moveable arm can indicate if the QMAX device is inserted in correct direction. The shape of one corner of the QMAX device is configured to be different from the other three right angle corners. And the shape of the moveable arm matches the shape of the corner with the special shape so that only in correct direction can QMAX device slide to correct position in the track slot.
FIG. 10-A, 10-B and 10-C are the schematic illustration of system 10 for smartphone colorimetric reader. Particularly, FIG. 10-B and 10-C are the exploded views of system 10, shown from the front and rear sides respectively. System 10 comprises a smartphone 1; an optical adaptor device 13 fitting over the upper part of smartphone 1; a colorimetric test card 137, inserted into receptacle slot 136 of device 13 so that the sample area on the sample card 137 is positioned within the field of view and focal range of camera module 1C in smartphone 1.
The software (not shown) installed in smartphone 1 analyzes the image collected by camera module 1C while light source 1L in smartphone 1 is emitting light, in order to analyze the color change of the colorimetric test, and outputs the results to a display screen If in smartphone 1.
FIG. 11 is the schematic exploded view of optical adaptor device 13 in system
10. Device 13 comprises a holder case 131 fitting over the upper part of smartphone 1; an optical box 132 attached to case 131 including a receptacle slot 136, an optics chamber 132C.
An optics insert 134 is fitted into the top of optics chamber 132C with an exit aperture 134L
and an entrance aperture 134C in it aligning with light source 1L and camera 1C (shown in FIG.
10-B) in smartphone 1. A lens 133 is mounted in entrance aperture 134C in optics insert 134 and configured so that the sample area on colorimetric sample card 137 inserted into receptacle slot 136 is located within the working distance of the camera 1C (shown in FIG. 10-B). A large-core optical fiber 135 is mounted in the exit aperture 134L with tilted angle. Both end faces of fiber 135 are made to have matte finish. Fiber 135 whose operation as the illumination optics in device 13 .. is described below in FIG. B3.
FIG. 12 is the schematic sectional view showing details of system 10 reading a colorimetric card, and particularly of device 13. This figure illustrates the functionality of the elements that were described above with reference to FIG. 11. Light source 1L emits light beam B1 away from smartphone 1. Beam B1 is coupled into the fiber 135 through the first end face and travels along the direction of fiber 135 and is emitted out from the second end face to become beam B2. Beam B2 illuminates the sample area of colorimetric sample card 137 right under the camera 1C from front side to create uniform illumination. Because the end faces of fiber 135 are made to be matte and diffusive finish, beam B2 can be regarded as emitting from an area light source, which helps to create a more uniform illumination. The tilt angle in which the fiber 135 is mounted is set to .. make the central tray of beam B2 illuminates on the area on the sample card 137 right under the camera. Lens 11 creates an image of the sample area on the image sensor plane of camera 1C.
Smartphone 1 captures and processes the image to analyze the color information in the image to quantify the color change of the colorimetric assay.
C. Optical adaptor for colorimetric reader attachment to smartphone (fiber-ring illumination) Colorimetric assay is a very powerful technique having wide applications in health monitoring, disease diagnostic, chemical analysis and so on. The key factor to get the accurate colorimetric assay result is to accurately quantify the color change.
Conventionally, the color change of a colorimetric test strip is analyzed by comparing the color change with a standard color card. But this comparison is accomplished by human's eye and can be easily influenced by the environment light condition, which limits the accuracy of quantifying the color change.
The present invention that is described herein address this problem by providing a system comprising an optical adaptor and a smartphone. The optical adaptor device fits over a smartphone converting it into a colorimetric reader which can provide a consistent and uniform illumination to illuminate the front surface of the colorimetric test card and capture the image of the sample to analyze the color change. This system can be operated conveniently and reliably by a common person at any location. The optical adaptor takes advantage of the existing resources of the smartphone, including camera, light source, processor and display screen, which provides a low-cost solution to accurately quantify the color change of a colorimetric assay.
In this invention, the optical adaptor device comprises a holder frame fitting over the upper part of the smartphone and an optical box attached to the holder having sample receptacle slot and illumination optics. In some prior arts of attachment adaptor for smartphone, their adaptor design is a whole piece including both the clip-on mechanics parts to fit over the smartphone and the functional elements. This design has the problem that they need to redesign the whole-piece adaptor for each specific model of smartphone. But in this present invention, the optical adaptor is separated into a holder frame only for fitting a smartphone and a universal optical box containing all the functional parts. For the smartphones with different dimensions, as long as the relative positions of the camera and the light source are the same, only the holder frame need to be redesigned, which will save a lot of cost of design and manufacture.
The optical box of the optical adaptor comprises: a receptacle slot which receives and position the colorimetric sample in the field of view and focal range of the smartphone camera; an illumination and imaging optics to create uniform and consistent illumination on the sample independently of any external conditions and capture the sample image.
To capture the sample image to accurately represent the color change, it is desirable that the sample area under the camera is uniformly illuminated. But for all common smartphones, the light source is always a point source and mounted next to the camera with some distance, which means the light source is not central symmetric relative to the camera. This causes the problem that, when the sample is placed very close to the camera of smartphone, without the help of additional illumination optics, the illumination pattern on the front surface of a sample in the field of view of the camera will have a gradient intensity change in a linear direction. Hence, it is desirable to create a light source with large emitting area and central symmetric to the camera.
To achieve this purpose, in this present invention, a plastic side-emitting fiber ring is put around the smartphone camera to make the fiber ring central symmetric relative to the camera. And the two end faces of the fiber ring are mounted towards the light source of the smartphone. This will convert the original single point light source to infinite number of small light sources having nearly equal luminous intensity distributed on a circle with equal distance from the smartphone camera.
The light emitted from the side wall of the ring fiber further goes through a diffusive film to increase the emitting area and make the illumination more even. The sample area right under the camera is uniformly front-illuminated by the designed illumination optics based on side-emitting fiber ring.
Because how the color of a colorimetric sample is represented greatly depends on the illumination condition, it is important to control the illumination in the optical box consistent independently to any external light conditions. To solve this problem, the receptacle slot has a rubber door attached to it, which can fully cover the slot to prevent the environmental light getting into the optical box to result in change of the illumination condition.
Typically, the optical box also comprises a lens mounted in it aligned with the camera of the smartphone, which makes the sample within the focal range of the camera.
The images captured by the camera will be further processed by the processor of smartphone to analyze the color change and outputs the analysis result on the screen of smartphone.
A sample slider is mounted inside the receptacle slot to receive the QMAX
device and position the sample in the QMAX device in the field of view and focal range of the smartphone camera.
The sample slider comprises a fixed track frame and a moveable arm:
The frame track is fixedly mounted in the receptacle slot of the optical box.
And the track frame has a sliding track slot that fits the width and thickness of the QMAX
device so that the QMAX device can slide along the track. The width and height of the track slot is carefully configured to make the QMAX device shift less than 0.5mm in the direction perpendicular to the sliding direction in the sliding plane and shift less than less than 0.2mm along the thickness direction of the QMAX device.
The frame track has an opened window under the field of view of the camera of smartphone to allow the light back-illuminate the sample.
A moveable arm is pre-built in the sliding track slot of the track frame and moves together with the QMAX device to guide the movement of QMAX device in the track frame.
The moveable arm (also called "lever") equipped with a stopping mechanism with two pre-defined stop positions. For one position, the arm will make the QMAX device stop at the position where a fixed sample area on the QMAX device is right under the camera of smartphone. For the other position, the arm will make the QMAX device stop at the position where the sample area on QMAX device is out of the field of view of the smartphone and the QMAX device can be easily taken out of the track slot.
The moveable arm switches between the two stop positions by a pressing the QMAX
device and the moveable arm together to the end of the track slot and then releasing.
The moveable arm can indicate if the QMAX device is inserted in correct direction. The shape of one corner of the QMAX device is configured to be different from the other three right angle corners. And the shape of the moveable arm matches the shape of the corner with the special shape so that only in correct direction can QMAX device slide to correct position in the track slot.
Some embodiments 1. Fiber Ring-illuminator In some embodiments of optical assembly, wherein a. the radius of the side illunmring fiber is 10mm;
b. the diameter of ring fiber can be at least 5 mm, 10 mm, 15 mm, 20 mm, 25 mm, mm, 40 mm, 50 mm, 60 mm, 80 mm, or 100 mm, or in a range between any of the two values;
c. the diameter of the cross-section of the ring fiber can be at least 0.5 mm, 1.0 25 mm, 1.5 mm, 2.0 mm, 2.5 mm, 3 mm, 4 mm, 5 mm, 6 mm, 8 mm, or 10 mm, or in a range between any of the two values.
In some embodiments of optical assembly, wherein d. the external imager lens has a diameter of 6mm;
30 e. the diameter of the imager lens can be at least 2 mm, 3mm, 4 mm, 5 mm, 10 mm, 15 mm, 20 mm, 25 mm, 30 mm, 40 mm, or 50 mm, or in a range between any of the two values.
In some embodiments of optical assembly, wherein the ring fiber can be used in combination with micro-lens array or be replace by a micro-lens array;
In some embodiments of optical assembly, wherein the optical assembly comprises a light diffuser plate between the sample and the ring fiber, wherein the light diffusive plate has an aperture configured to aligned with the camera.
In some embodiments of optical assembly, wherein the length of one side of the diffusive plate can be at least 5 mm, 10 mm, 15 mm, 20 mm, 25 mm, 30 mm, 40 mm, 50 mm, 100 mm, mm, or 200 mm, or in a range between any of the two values, wherein the thickness of the diffusive plate can be at least 2 mm, 3mm, 4 mm, 5 mm, 10 mm, 15 mm, or 20 mm, or in a range between any of the two values.
In some embodiments of optical assembly, wherein the distance between the diffusive plate and ring fiber can be at least 1mm, 10 mm, 15 mm, 20 mm, 25 mm, 30 mm, 40 mm, 50 mm, 100 mm, or in a range between any of the two values.
The optical assembly of claim 2, wherein the distance between the sample and ring fiber can be at least 2mm, 10 mm, 15 mm, 20 mm, 25 mm, 30 mm, 40 mm, 50 mm, 100 mm, 150 mm, 200 mm, or in a range between any of the two values.
Lever:
1. The optical assembly of claim 3, wherein the distance between first planar plane on the moveable arm and the light source can be at least 0.5mm, 2 mm, 4 mm, 8 mm, 10 mm, 20 mm, 50 mm, 100 mm or in a range between any of the two values.
2. The optical assembly of claim 3, wherein the distance between first planar plane and the second planar plane of the moveable arm can be at least 5mm, 10 mm, 15 mm, 20 mm, 40 mm, 100 mm, 200mm, or in a range between any of the two values.
3. The optical assembly of claim 5, wherein the distance that the moveable arm needs to move to switch between different positions can be at least 1mm, 5 mm, 15 mm, 20 mm, 40 mm, 100 mm, or in a range between any of the two values.
4. The optical assembly of claim 3, wherein the second planar plane is connected to a tilted plane, wherein a mirror is mounted on the tilted plane 5. The optical assembly of claim 4, wherein the preferred tilt angle of the tilted plane can be at least 10 degree, 30 degree, 60 degree, 80 degree, or in a range between any of the two values, and the tilt angle is defined as the angle between the second planar plane and tilted plane.
FIG. 13-A, 13-B and 13-C are the schematic illustrations of system 10 for smartphone colorimetric reader. Particularly, FIG. 13-B and FIG. 13-C are the exploded views of system 10, shown from the front and rear sides respectively. System 10 comprises a smartphone 1; an optical adaptor device 13 fitting over the upper part of smartphone 1; a colorimetric sample card 138, inserted into receptacle slot 137 of device 13 so that the sample area on the sample card 138 is positioned within the field of view and focal range of camera module 1C in smartphone 1. A rubber door 139 attached to device 18 covers receptacle slot 137 after sample card 138 is in so as to prevent the ambient light getting into optical adaptor 13 to affect the test.
The software (not shown) installed in smartphone 1 analyzes the image collected by camera module 1C
while light source IL in smartphone 1 is emitting light, in order to analyze the color change of the colorimetric test, and outputs the results to a display screen If in smartphone 1.
FIG. 14 is the schematic exploded view of optical adaptor device 13 in system 10. Device 13 comprises a holder case 131 fitting over the upper part of smartphone 1; an optical box 132 attached to case 131 including a receptacle slot 137, an optics chamber 132C
and a rubber door 139 inserted into trench 137s to cover receptacle slot 137. An optics insert 134 is fitted into the top of optics chamber 132C with an exit aperture 134L and an entrance aperture 134C in it aligning with light source 1L and camera 1C (shown in FIG. 13-B) in smartphone 1. A lens 133 is mounted in entrance aperture 134C in optics insert 134 and configured so that the sample area on colorimetric sample card 138 inserted into receptacle slot 137 is located within the working distance of the camera 1C (shown in FIG. 13-B). A side-emitting optical fiber ring 135 is mounted in optics insert 134 configured to make the camera 1C in the center of the fiber ring 135. Both end faces of optical fiber ring 135 are mounted in exit aperture 134L facing the light source IL. A light diffuser film 136 is put under the optical fiber ring 135 and has a hole opened for the aperture of lens. Optical fiber ring 135 whose operation as the illumination optics in device 13 is described below in FIG. 15-A-c.
FIG. 15-A, 15-B and 15-C are the schematic views showing details of system 10 reading a colorimetric card, and particularly of device 13. FIG. 15-A is the sectional view showing details of device 13. And FIG. 15-B and FIG. 15-C are the schematic views only showing the configuration of the optics elements in device 13. These figures illustrate the functionality of the elements that were described above with reference to FIG. 14. The light emitted from light source 1L is coupled into side-emitting optical fiber ring 135 from the two end faces of fiber ring 135 and travels inside along the ring. Beam B1 is emitted out from the side wall of fiber ring and go through the diffuser film 136. Beam B1 illuminates the sample area of colorimetric sample card 138 right under the camera 1C from front side to create uniform illumination. The illuminated sample area absorbs part of beam B1 and reflects the beam B1 to beam B2. Beam B2 is collected by lens 133 and gets into camera 1C Lens 133 creates an image of the sample area on the image sensor plane of camera 1C. Smartphone 1 captures and processes the image to analyze the color information in the image to quantify the color change of the colorimetric assay.
D. Device and Systems for Tomography 0-1. Tomography Device with QMAX Structure A tomography device that reconstructs a sliceable virtual three-dimensional copy of a biological specimen with the highest resolution of nanoscale is disclosed. The device consists of an imaging sensor, a lens, and a QMAX device, as in Fig. 16-A.
The QMAX device has a periodic pillar array. A biological specimen is contained in the QMAX device. An index-matching liquid can be used to reduce the scattering of light, and reduce heterogeneities of refractive index throughout the specimen. The QMAX
structure enhances the detection sensitivity of six (or more) orders of magnitude.
0-2. Calibration based on QMAX Structure The pillar array has a metallic disk on top of each pillar. The metallic disk provides a calibration signal for both spatial and height calibration for images captured by the imaging sensor. The shape of the metallic disk can be designed to facilitate a fast calibration. For example, the shape of the metallic disk can be like the letter E; such a pillar array is illustrated in Fig. 16-B.
When the imaging sensor capture an image on the QMAX structure, with or without a biological specimen, the captured image can be calibrated spatially and the focus distance of the camera can also be quantitively calibrated.
For spatial calibration, the captured image goes through an object detection.
The object detection scheme can be a template matching, an optical character recognition, a shape detection, or other schemes that are used in the field. The object detection retrieves the orientation of the detected pattern, which in the example of Fig. 16-B is the letter E.
With the orientation parameter, spatial calibration is achieved through a two-dimensional geometric transform.
We disclose a quantitative calibration of the focus distance with the pillar array. The effect of focal distance on the captured image can be explained by the thin lens model, as shown in Fig.
16-C. If the sensing device is at a distance 8 from the focus plane, point Q
will be projected onto a circle of diameter ko-, and its radiance will spread over this circle, with Q being defocused. The location v of the focal plane depends on the focal length of the lens, f, and the distance from the object, u. The relationship between these three variables is given by the well-known Gauss lens law or thin lens equation: 71 =
+
We measure the degree of focus on the captured image, and deduct the focus plane location. The focus degree measures the focus level either the whole image or every image pixel.
A wide variety of algorithms and operators have been pro- posed in the literature to measure the focus degree, such as gradient-based, Laplacian-based, wavelet-based, statistics-based, Cosine transform/Fourier transform based, etc.
The focus degree of the pillar array captured at different focus planes can be pre-measured and stored in a look up table. When the imaging sensor captures a new image of the pillar array, for example, Fig. 16-D shows a captured image of the example pillar array in Fig. 16-B, we compute the focus degree of the newly captured image, refer the focus degree to the look up table, and find its corresponding focal plane location.
0-3. Tomography System The goal of tomography is to reconstruct a three-dimensional volume of a biological specimen through several projections of it. An end-to-end tomography system includes light source, imaging, and three-dimensional reconstruction.
Light Source The light captured by the imaging sensor can be refracted from the specimen, emitted from the specimen, etc.
Imaging The imaging part captures projection on the imaging sensor. The projections can be captured at different focus distance, different angles, from different illumination, etc.
Several images can be captured at different focus distances. The lens moves towards or backward the QMAX structure at a stepsize or a multiple of stepsize. The value of the stepsize and the movement of the lens can be controlled by hardware or software through an application program interface. The image sensor records the captured image.
Several images can be captured at different angles. The specimen is rotated and optical images are captured that approximate straight-line projections through it. The specimen is rotated to a series of angular positions, and an image is captured at each orientation. The apparatus is carefully aligned to ensure that the axis of rotation is perpendicular to the optical axis, so that projection data pertaining to each plane is collected by the imaging sensor.
The focal plane can be positioned halfway between the axis of rotation and the QMAX card closest to the lens. This means that every image contains both focused data from the front half of the specimen (the half closest to the lens), and out-of-focus data from the back half of the specimen. The focused data will be utilized for three-dimensional volume reconstruction, while the out-of-focus data will not be used. A band-pass filter can be equipped to select the focused data.
Optical projection tomography is performed using standard tomographic algorithms. Due to the position of the focal plane relative to the axis of rotation, two images taken 180 degrees apart from each other will be focused on different parts of the specimen.
Limiting the back-projection to the region corresponding to the focused part of the specimen improves the quality of the results. As data is accumulated for the various orientations through the specimen, a semi-disc mask, which acts as a band-pass filter, can be rotated to ensure that only focused data is back-projected.
Several images can be captured at different illumination. Quantitative phase images from time-dependent interference patterns induced by the frequency shifting of a reference beam relative to the sample beam can be obtained. A galvanometer-mounted tilting mirror can be used to vary the angle of illumination. A laser beam passes through two acousto-optic modulators which shift the frequency of the laser beam. A second beam splitter recombines the specimen and reference laser beams, forming an interference pattern which is captured at the imaging sensor.
Phase images are then calculated by applying phase-shifting interferometry.
For near-plane wave illumination of a thin specimen with small index contrast, the phase of the transmitted field is to a good approximation equal to the line integral of the refractive index along the path of beam propagation. Therefore, the phase image can simply be interpreted as the projection of refractive index.
Besides a band-pass filter, various imaging filters can be used during image captures, for the purpose of (including but not limited to):
(1) signal selection, thereby portion of the captured image is selected;
(2) signal enhancement, thereby portion or whole of the captured image is enhanced;
(3) signal transformation, thereby portion or whole of the captured image is transformed into another representation, such as frequency representation, multi-scale representation, etc.;
(4) signal replication, thereby portion of the captured image is replaced by another portion of the captured image, or by the representation of another portion of the captured image;
(5) or any combination of (1) ¨ (4).
Captured images can be enhanced through filtering, such as contrast enhancement, color enhancement, noise reduction, etc. It can increase the dynamic range of pixel intensities, adjust color temperature, boost the signal to noise ratio, etc.
Captured images can be transformed into another representation, which can be more suitable for the three-dimension reconstruction. It can be transformed into a different format (8 bit to 16 bit, integer to floating point, etc.), different color space (RGB to HSV, etc.), different domain (spatial domain to frequency domain, etc.), etc.
Portion of captured images can be replaced by another portion (or transformation of another portion) of captured images. It can be a spatial region, which is replaced by the transformation of another region, such as a reflective extension around the boundary, etc. It can be a frequency subband, which is replaced by the transformation of another frequency subband, such as the high frequency subband is replaced by an estimation from the low frequency subband, etc.
Three-Dimensional Reconstruction Reconstructing a three-dimensional volume of the biological specimen from its projection is an inverse problem. The three-dimensional volume reconstruction can employ a phase image retrieval scheme, a back-projection scheme, non-linear approximation scheme, optimization scheme, etc.
When several images are captured at different focus distances, we compute the focus degrees of these images, and list these focus degrees as a vector. Then we refer the vector with the look up table, and find their corresponding focal plane distances. The corresponding can be distance based, correlation based, or other criteria to select the best match.
A diagram of phase image retrieval based scheme is shown in Fig. 16-E. It consists of four components:
= Focus distance calculation = Phase image retrieval = Height estimation = Three-dimensional volume reconstruction The second component, phase retrieval is through a quantitative phase imaging technique, based on the transport of intensity (TIE) equation. The TIE
equation states oI(x, y) k 15 ___________________________ = ¨V = [/(x, y)V(p(x, y)]
az al where ¨az indicates the intensity gradient which can be computed from the multi-focal images, k is the wave number and cp is the sample phase distribution.
The TIE equation could be solver using fast Fourier transform, discrete cosine transform;
see for example, "Boundary-artifact-free phase retrieval with the transport of intensity equation:
fast solution with use of discrete cosine transform", C. Zuo, Q. Chen, and A.
Asundi, Optics Express, Vol. 22, No. 8, April 2014. The phase image cp is retrieved from the TIE equation.
Given the phase image, we estimate the height (thickness) of the biological specimen.
Recall that for a sample with a thickness of t and a refractive index of n, the corresponding optical path length Lp is L =txn The height of the biological specimen can be computed, with a known refractive index.
Going further, the three-dimensional volume of the biological specimen can be reconstructed.
The back-projection algorithm is commonly used in three-dimensional reconstruction in tomography. It includes Fourier transform base algorithm, filtered back projection algorithm, back projection and filtering algorithm, and iterative algorithm.
When the position of the focal plane relative to the axis of rotation differs, two images taken 180 degrees apart from each other will be focused on different parts of the specimen. To compensate, a half-plane adjusted back projection algorithm can be employed.
Thus, limiting the back-projection to the region corresponding to the focused part of the specimen will improve the quality of the results. As data is accumulated for the various orientations through the specimen, a semi-disc mask can be rotated to ensure that only focused data is back-projected.
As another embodiment of the back-projection algorithm, a procedure based on the filtered back-projection method can be applied. A discrete inverse Radon transform is applied to every x-O slice in the beam rotation direction, with x, the coordinate in the tilt direction and 0, the relative angle of laser beam direction to the optic axis of the objective lens. To compensate for the angle between imaging and illumination directions, the x values is divided by cos 0.
To reduce the effects of the missing projections, an iterative constraint method can be applied.
For the inverse problem to reconstruct a three-dimensional volume from its projection, the resulting three-dimensional volume can be blurred. A ramp filter can be used to remove or reduce the blurriness.
Beside the deblurring filter, various imaging filters can be used for three-dimensional volume reconstruction, for (including but not limited to):
(1) signal selection, where portion of the image or image volume is selected;
(2) signal enhancement, where portion or whole of the image or image volume is enhanced;
(3) signal transformation, where portion or whole of the image or image volume is transformed into another representation, such as frequency representation, multi-scale representation, etc.;
(4) signal replication, where portion of the image or image volume is replaced by another portion of the captured image, or by the representation of another portion of the captured image;
(5) or any combination of (1) ¨ (4) 0-4. Examples of Present Invention DA1. A device for sample imaging, comprising a QMAX device and an imager, wherein:
(1) the QMAX device comprises:
a first plate, a second plate, and spacers, wherein:
i. the plates are movable relative to each other into different configurations;
ii. one or both plates are flexible;
iii. each of the plates has, on its respective inner surface, a sample contact area for contacting a deformable sample;
iv. one or both of the plates comprise the spacers that are fixed with a respective plate;
v. the spacers have a predetermined substantially uniform height and a predetermined inter-spacer-distance; and vi. at least one of the spacers is inside the sample contact area;
wherein one of the configurations is an open configuration, in which: the two plates are separated apart, the spacing between the plates is not regulated by the spacers, and the sample is deposited on one or both of the plates; and wherein another of the configurations is a closed configuration which is configured after the sample deposition in the open configuration; and in the closed configuration: at least part of the sample is compressed by the two plates into a layer of uniform thickness, wherein the uniform thickness of the layer is confined by the inner surfaces of the two plates and is regulated by the plates and the spacers; and (2) the imager is configured to capture an image of signals emanating from at least part of the layer of uniform thickness.
DB1. A system for tomography, comprising a QMAX device, an imager, a holder, and a control device, wherein:
(1) the QMAX device comprises: a first plate, a second plate, and spacers, wherein:
i. the plates are movable relative to each other into different configurations;
ii. one or both plates are flexible;
iii. each of the plates has, on its respective inner surface, a sample contact area for contacting a deformable sample;
iv. one or both of the plates comprise the spacers that are fixed with a respective plate;
v. the spacers have a predetermined substantially uniform height and a predetermined inter-spacer-distance; and vi. at least one of the spacers is inside the sample contact area;
wherein one of the configurations is an open configuration, in which: the two plates are separated apart, the spacing between the plates is not regulated by the spacers, and the sample is deposited on one or both of the plates; and wherein another of the configurations is a closed configuration which is configured after the sample deposition in the open configuration; and in the closed configuration: at least part of the sample is compressed by the two plates into a layer of uniform thickness, wherein the uniform thickness of the layer is confined by the inner surfaces of the two plates and is regulated by the plates and the spacers;
(2) the imager comprises an image sensor and a lens, wherein:
i. the lens is configured to focus signals emanating from at least part of the layer of uniform thickness and project the focused signals to the image sensor, and ii. the image sensor is configured to capture images of said focused signals;
(3) the holder is configured to adjust relative position between the QMAX
device and the imager; and (4) the control device comprises hardware and software for controlling and/or deducing the position adjustment made by the holder, and receiving and reconstructing said images into a three-dimensional volume.
DBB1. A system for tomography, comprising a QMAX device, an imager, a holder, and a control device, wherein:
(1) the QMAX device comprises: a first plate, a second plate, and spacers, wherein:
i. the plates are movable relative to each other into different configurations;
ii. one or both plates are flexible;
iii. each of the plates has, on its respective inner surface, a sample contact area for contacting a deformable sample;
iv. one or both of the plates comprise the spacers that are fixed with a respective plate;
v. the spacers have a predetermined substantially uniform height and a predetermined inter-spacer-distance; and vi. at least one of the spacers is inside the sample contact area;
wherein one of the configurations is an open configuration, in which: the two plates are separated apart, the spacing between the plates is not regulated by the spacers, and the sample is deposited on one or both of the plates; and wherein another of the configurations is a closed configuration which is configured after the sample deposition in the open configuration; and in the closed configuration: at least part of the sample is compressed by the two plates into a layer of uniform thickness, wherein the uniform thickness of the layer is confined by the inner surfaces of the two plates and is regulated by the plates and the spacers;
(2) the imager is capable of changing the focal plane and comprises an image sensor and a lens, wherein:
i. the lens is configured to focus signals emanating from at least part of the layer of uniform thickness and project the focused signals to the image sensor, and ii. the image sensor is configured to capture images of said focused signals;
iii. the lens is a single lens or a compound lens consisting several lenses;
iv. at least one element lens in the lens is moveable to change the distance from the image sensor to change the focal plane of the imager; and v. the moveable lens can be driven by stepper motor and/or electromagnetic force, which is computerized or manually controlled.
and (4) the control device comprises hardware and software for controlling and/or deducing the position adjustment made by the holder, and receiving and reconstructing said images into a three-dimensional volume.
DC1. A method of tomography, comprising the steps of:
(a) depositing a sample onto the QMAX device of any prior device or system embodiment;
(b) after (a), using the two plates of the QMAX device to compress at least part of the sample into a layer of substantially uniform thickness that is confined by the sample contact surfaces of the plates, wherein the uniform thickness of the layer is regulated by the spacers and the plates, wherein the compressing comprises:
bringing the two plates together; and conformable pressing, either in parallel or sequentially, an area of at least one of the plates to press the plates together to a closed configuration, wherein the conformable pressing generates a substantially uniform pressure on the plates over the at least part of the sample, and the pressing spreads the at least part of the sample laterally between the sample contact surfaces of the plates, and wherein the closed configuration is a configuration in which the spacing between the plates in the layer of uniform thickness region is regulated by the spacers;
(c) capturing an image, using the imager of any prior device or system embodiment, of signals emanating from at least part of the layer of uniform thickness;
(d) adjusting relative position between the QMAX device and imager, repeating step (c); and (e) after a series of steps (c), reconstructing the captured images into a three-dimensional volume of said at least part of the layer, wherein a conformable pressing is a method that makes the pressure applied over an area is substantially constant regardless the shape variation of the outer surfaces of the plates;
and wherein the parallel pressing applies the pressures on the intended area at the same time, and a sequential pressing applies the pressure on a part of the intended area and gradually move to other area.
DCC1. A method to take images at different focal planes, comprising steps of:
(a) computerized or manually controlling the moveable lens in the imager to the initial position;
(b) corresponding the moveable lens position to the position of the focal plane;
(c) capturing the image using the image sensor in the imager and record the position of focal plane;
(d) computerized or manually adding a step displacement to move the moveable lens to the next positon (e) repeat step (b) to (d) (f) after a series of step (e), several images at different focal planes are captured.
DA21. The device of any prior embodiment, wherein QMAX device further comprises a dry reagent coated on one or both plates that stains the sample.
DA22. The device of any prior embodiment, wherein:
i. one or both plate sample contact areas comprise one or a plurality of binding sites that each binds and immobilizes a respective analyte; or ii. one or both plate sample contact areas comprise, one or a plurality of storage sites that each stores a reagent or reagents; wherein the reagent(s) dissolve and diffuse in the sample during or after step (c), and wherein the sample contains one or plurality of analytes; or iii. one or a plurality of amplification sites that are each capable of amplifying a signal from the analyte or a label of the analyte when the analyte or label is 500 nm from the amplification site; or iv. any combination of i to iii.
DA23. The device of any prior embodiment, wherein the imager further comprises a light source that provides light for illumination or excitation of the layer of uniform thickness for the imaging.
DA24. The device of embodiment DA23, wherein the light source is selected from the group consisting of: LED, laser, incandescent light, and any combination thereof.
DB2. The system of embodiment DB1, wherein the signals comprise optical signals selected from the group consisting of: light reflection, light refraction, light transmission, luminescence signals, and any combination thereof.
DB3. The system of any prior embodiment, wherein the imager further comprises a light source providing light illuminating said layer of uniform thickness for the imaging, wherein the light source is selected from the group consisting of: incandescent light, LED, CFL, laser, and any combination thereof.
DB4. The system of any prior embodiment, wherein the imager further comprises a light source providing excitation light that excites fluorescence emission from said layer of uniform thickness for the imaging, wherein the light source is a LED and/or a laser.
DB5. The system of any prior embodiment, wherein the holder is capable of adjusting the relative position of the lens to the QMAX device along its optical axis to change focal plane .. position of the lens.
DB6. The system of any prior embodiment, wherein the holder is capable of adjusting the relative position between the lens and the QMAX device to change imaging angle, wherein the imaging angle is an angle between focal plane of the lens and the layer of uniform thickness.
DB7. The system of any prior embodiment, wherein the imager further comprises a light source providing illumination light for the imaging, and wherein the holder is capable of adjusting the relative position between the light source and the QMAX device to change angle of incidence of the illumination light, wherein the angle of incidence is the angle between the illumination light and a line perpendicular to the layer of uniform thickness.
DB8. The system of any prior embodiment, wherein the control device comprises hardware and software for sending a command that defines the position adjustment to the holder, and wherein the holder is configured to receive said command and make the adjustment with no more than 10% deviation.
DB9. The system of any prior embodiment, wherein the control device comprises hardware and software for sending a command that defines the position adjustment to the holder, and wherein the holder is configured to receive said command and make the adjustment with no more than 1% deviation.
DB10. The system of any of embodiments DB8 ¨ DB9, wherein the control device comprises hardware and software for receiving an input that defines the position adjustment and converting the input into the command for the holder to make the adjustment.
DB11. The system of any prior embodiment, wherein the system further comprises a plurality of calibration pillars, and wherein:
(1) said plurality of calibration pillars are placed between the sample contact areas of the two plates at the closed configuration, and have different heights from one another, which are all smaller than the uniform height of the spacers;
(2) said images are captured at different focal planes along a common optical axis; and (3) the control device comprises hardware and software for: (a) calculating a focus score for each of said images; and (b) deducing a focus plane position at which each of said images is captured by comparing said focus score with a look-up table, wherein the focus score is a matrix of focus degrees calculated for each pixel of a captured image, wherein the look-up table is predetermined and comprises a row of pre-determined focus plane positions along said common optical axis and a corresponding row of calibration focus scores, each of the calibration focus scores is calculated based on an image of the calibration pillars captured at the corresponding pre-determined focus plane.
DB12. The system of any prior embodiment, wherein said images are captured at different focal planes along a common optical axis, and wherein the control device comprises hardware and software for: (a) generating a phase image for a biological entity in said at least part of the layer, wherein the phase image is a phase distribution calculated based on wavelength of an illuminating light used for imaging, at least part of said images that contain signals from the biological entity, and the focus plane positions at which said images are respectively captured;
and (b) estimating a thickness of the biological entity based on the phase image and a refractive index of the sample, wherein the biological entity is a part or entirety of said at least part of the layer.
DB13. The system of embodiment DB8, wherein the control device comprises hardware and software for reconstructing said at least part of the images into a three-dimensional volume of the biological entity based on the estimated thickness.
DB14. The system of any prior embodiment, wherein said images are captured at different imaging angles, wherein the control device comprises hardware and software for: (1) knowing or deducing the imaging angle for each of said images; and (2) reconstructing said images into a three-dimensional volume based on the known/deduced imaging angels using a back-projection algorithm, and wherein the imaging angle is an angle between focal plane of the lens and the layer of uniform thickness.
DB15. The system of any prior embodiment, wherein said images are captured at different angels of incidence of illumination light, wherein the control device comprises hardware and software for: (1) knowing or deducing the angle of incidence for each of said images; and (2) reconstructing said images into a three-dimensional volume based on the known/deduced angle of incidence using a back-projection algorithm, and wherein the angle of incidence of the illumination light is the angle between the illumination light and a line perpendicular to the layer of uniform thickness.
DB16. The system of any or embodiments DB14 ¨ DB15, wherein the back-projection algorithm is selected from the group consisting of: Fourier transform base algorithm, filtered back-projection algorithm, back-projection and filtering algorithm, iterative algorithm, and any combination thereof.
DB17. The system of any prior embodiment, wherein said imager is equipped with imaging filters, and wherein the captured images are filtered by the imaging filters and/or software of the control device for: (1) signal selection, thereby portion of the captured image is selected; (2) signal enhancement, thereby portion or whole of the captured image is enhanced; (3) signal transformation, thereby portion or whole of the captured image is transformed into another representation, such as frequency representation, multi-scale representation, etc.; (4) signal replication, thereby portion of the captured image is replaced by another portion of the captured image, or by the representation of another portion of the captured image; or any combination of (1) ¨ (4).
DB18. The system of any prior embodiment, wherein the control device further comprises hardware and software for reconstructing said at least part of the images into a three-dimensional volume, wherein during three-dimensional volume reconstruction, the images and the three-dimensional volume are filtered by software for: (1) signal selection, where portion of the image or image volume is selected; (2) signal enhancement, where portion or whole of the image or image volume is enhanced; (3) signal transformation, where portion or whole of the image or image volume is transformed into another representation, such as frequency representation, multi-scale representation, etc.; (4) signal replication, where portion of the image or image volume is replaced by another portion of the captured image, or by the representation of another portion of the captured image; or any combination of (1) ¨ (4) DC2. The method of embodiment DC1, further comprising: before step (c), staining the sample with a dye.
DC3. The method of any prior method embodiment, wherein during the step (b), the conformable pressing is by human hand.
.. DC4. The method of any prior method embodiment, wherein the conformable pressing of step (d) is provided by a pressured liquid, a pressed gas, or a conformal material.
DC5. The method of any prior method embodiment, wherein the adjusting step (d) comprises adjusting the relative position of the lens to the QMAX device along its optical axis to change focal plane position of the lens.
DC6. The method of any prior method embodiment, wherein the adjusting step (d) comprises adjusting the relative position between the lens and the QMAX device to change imaging angle, wherein the imaging angle is an angle between focal plane and the layer of uniform thickness.
DC7. The method of any prior method embodiment, wherein the imager further comprises a light source providing illumination light for the imaging, and wherein the adjusting step (d) comprises adjusting the relative position of the light source to the QMAX
device to change angle of incidence of the illumination light, wherein the angle of incidence is the angle between the illumination light and a line perpendicular to the layer of uniform thickness.
DC8. The method of any prior method embodiment, wherein the adjusting step (d) is performed manually.
DC9. The method of any prior method embodiment, wherein the adjusting step (d) is performed through a control device operably coupled to a holder, wherein the control device comprises hardware and software for receiving an input that defines the position adjustment and sending a command to the holder, and wherein the holder is configured to receive said command and make the adjustment with a deviation no more than 10%.
DC10. The method of any prior method embodiment, wherein the adjusting step (d) is performed through a control device operably coupled to a holder, wherein the control device comprises hardware and software for receiving an input that defines the position adjustment and sending a command to the holder, and wherein the holder is configured to receive said command and make the adjustment with a deviation no more than 1%.
DC11. The method of any prior method embodiment, wherein said images are captured at different focal planes along a common optical axis, and wherein the reconstructing step (e) comprises: (i) calculating a focus score for each of said images; and (ii) deducing a focal plane position at which each of said images is captured by comparing said focus score with a look-up table, wherein the focus score is a matrix of focus degrees calculated for each pixel of a captured image, wherein the look-up table is predetermined and comprises a row of pre-determined focal plane positions along said common optical axis and a corresponding row of calibration focus scores, each of the calibration focus scores is calculated based on an image of the calibration pillars captured at the corresponding pre-determined focal plane.
DC12. The method of any prior method embodiment, wherein said images are captured at different focal planes along a common optical axis, and wherein the reconstructing step (e) comprises: (i) generating a phase image for a biological entity in said at least part of the layer, wherein the phase image is a phase distribution calculated based on the wavelength of an illuminating light used for imaging, at least part of said images that contain signals from the biological entity, and the focal plane positions at which said images are captured; and (ii) estimating a thickness of the biological entity based on the phase image and a refractive index of the sample, wherein the biological entity is a part or entirety of said at least part of the layer.
DC13. The method of embodiment DC12, wherein the reconstructing step (e) further comprises reconstructing said at least part of the images into a three-dimensional volume of the biological entity based on the estimated thickness.
DC14. The method of any prior method embodiment, wherein said images are captured at different imaging angles, wherein the reconstructing step (e) comprises: (i) knowing or deducing the imaging angle for each of said images; and (ii) reconstructing said images into a three-dimensional volume based on the known/deduced imaging angels using a back-projection algorithm, and wherein the imaging angle is an angle between focal plane of the lens and the layer of uniform thickness.
DC15. The method of any prior method embodiment, wherein said images are captured at different angels of incidence of illumination light, wherein the reconstructing step (e) comprises:
(i) knowing or deducing the angle of incidence for each of said images; and (ii) reconstructing said images into a three-dimensional volume based on the known/deduced angle of incidence using a back-projection algorithm, and wherein the angle of incidence of the illumination light is the angle between the illumination light and a line perpendicular to the layer of uniform thickness.
DC16. The method of any of embodiments DC14 ¨ DC15, wherein the back-projection algorithm is selected from the group consisting of: Fourier transform base algorithm, filtered back-projection algorithm, back-projection and filtering algorithm, iterative algorithm, and any combination thereof.
DC17. The method of any prior method embodiment, wherein the sample is a biological sample selected from the group consisting of: cells, tissues, bodily fluids, stool, and any combination thereof.
DC18. The method of any prior method embodiment, wherein the sample is an environmental sample from an environmental source selected from the group consisting of a river, lake, pond, ocean, glaciers, icebergs, rain, snow, sewage, reservoirs, tap water, drinking water, etc.; solid samples from soil, compost, sand, rocks, concrete, wood, brick, sewage, the air, underwater heat vents, industrial exhaust, vehicular exhaust and any combination thereof.
DC19. The method of any prior method embodiment, wherein the sample is a foodstuff sample selected from the group consisting of: raw ingredients, cooked food, plant and animal sources of food, preprocessed food, partially or fully processed food, and any combination thereof.
DC20. The method of any prior method embodiment, wherein the sample is blood, and the biological entity is red blood cells, white blood cells, and/or platelets.
DC21. The method of embodiment DC20, further comprising:
(f). calculating volume of red blood cells, white blood cells, and/or platelets, based on their respective reconstructed three-dimensional volumes.
D022. The method of embodiment DC21, further comprising:
(g) based on the calculated volume, determining a blood test readout selected from the group consisting of: mean corpuscular volume (MCV), hematocrit, Red cell distribution width (RDVV), mean platelet volume (MPV), platelet distribution width (PDVV), immature platelet fraction (I PF), and any combination thereof.
E. Assay and Imaging Assisted by Machine Learning E-1. QMAX Device for Assay and Imaging A device for biological analyte detection and localization, comprising a QMAX
device, an imager, and a computing unit, is disclosed. A biological sample is suspected on the QMAX device.
The count and location of an analyte contained in the sample are obtain by the disclosure.
The imager captures an image of the biological sample. The image is submitted to a computing unit. The computing unit can be physically directly connected to the imager, connected through network, or in-directly through image transfer.
E-2. Workflow The disclosed analyte detection and localization employ machine learning deep learning.
A machine learning algorithm is an algorithm that is able to learn from data.
A more rigorous definition of machine learning is "A computer program is said to learn from experience E with respect to some class of tasks T and performance measure P, if its performance at tasks in T, as measured by P, improves with experience E." It explores the study and construction of algorithms that can learn from and make predictions on data ¨ such algorithms overcome following strictly static program instructions by making data driven predictions or decisions, through building a model from sample inputs.
Deep learning is a specific kind of machine learning based on a set of algorithms that attempt to model high level abstractions in data. In a simple case, there might be two sets of neurons: ones that receive an input signal and ones that send an output signal. When the input layer receives an input, it passes on a modified version of the input to the next layer. In a deep network, there are many layers between the input and output (and the layers are not made of neurons but it can help to think of it that way), allowing the algorithm to use multiple processing layers, composed of multiple linear and non-linear transformations.
The disclosed analyte detection and localization workflow consists of two stages, training and prediction, as in Fig. 17-A. We describe training and prediction stages in the following paragraphs.
Training In the training stage, training data with annotation is fed into a convolutional neural network. Convolutional neural network a specialized kind of neural network for processing data that has a known, grid-like topology. Examples include time-series data, which can be thought of .. as a 1D grid taking samples at regular time intervals, and image data, which can be thought of as a 2D grid of pixels. Convolutional networks have been tremendously successful in practical applications. The name "convolutional neural network" indicates that the network employs a mathematical operation called convolution. Convolution is a specialized kind of linear operation.
Convolutional networks are simply neural networks that use convolution in place of general matrix multiplication in at least one of their layers.
Training data are annotated for the analyte to be detect. Annotation indicates whether or not an analyte presents in a training data. Annotation can be done in the form of bounding boxes which fully contains the analyte, or center locations of analytes. In the latter case, center locations are further converted into circles covering analytes.
When the size of training data is large, it presents two challenges:
annotation (which is usually done by person) is time consuming, and the training is computing expensive. To overcome these challenges, one can partition the training data into patches of small size, then annotate and train on these patches, or a portion of these patches.
Annotated training data is fed into a convolutional neural network for model training. The output is a model that can be used to make pixel-level prediction on an image.
We use the Caffe library with fully convolutional network (FCN). Other convolutional neural network architecture can also be used, such as TensorFlow.
The training stage generates a model that will be used in the prediction stage. The model can be repeatedly used in the prediction stage for input images. Thus, the computing unit only needs access to the generated model. It does not need access to the training data, nor the training stage has to be run on the computing unit.
Prediction In the predication stage, a detection component is applied to the input image, which is followed by a localization component. The output of the prediction stage is the count of analytes contained in the sample, along with the location of each analyte.
In the detection component, an input image, along with the model generated from the training stage, is fed into a convolutional neural network. The output of the detection stage is a pixel-level prediction, in the form of a heatmap. The heatmap can have the same size as the input image, or it can be a scaled down version of the input image. Each pixel in the heatmap has a value from 0 to 1, which can be considered as the probability (belief) whether a pixel belongs to an analyte. The higher the value, the bigger the chance it belongs to an analyte.
The heatmap is the input of the localization component. We disclose an algorithm to localize the analyte center. The main idea is to iteratively detect local peaks from the heatmap.
After we find the peak, we calculate the local area surrounding the peak but with smaller value.
We remove this region from the heatmap and find the next peak from the remaining pixels. The process is repeated only all pixels are removed from the heatmap.
One embodiment of the localization algorithm is to sort the heatmap values into a one-dimensional ordered list, from the highest value to the lowest value. Then pick the pixel with the highest value, remove the pixel from the list, along with its neighbors.
Iterate the process to pick the pixel with the highest value in the list, until all pixels are removed from the list.
Algorithm GlobalSearch (heatmap) Input:
heatmap Output:
loci loci 4¨{}
sort(heatmap) while (heatmap is not empty) {
s pop(heatmap) D <¨ {disk center as s with radius R}
heatmap = heatmap \ D I/ remove D from the heatmap add s to loci After sorting, heatmap is a one-dimensional ordered list, where the heatmap value is ordered from the highest to the lowest. Each heatmap value is associated with its corresponding pixel coordinates. The first item in the heatmap is the one with the highest value, which is the output of the pop(heatmap) function. One disk is created, where the center is the pixel coordinate of the one with highest heatmap value. Then all heatmap values whose pixel coordinates resides inside the disk is removed from the heatmap. The algorithm repeatedly pops up the highest value in the current heatmap, removes the disk around it, till the items are removed from the heatmap.
In the ordered list heatmap, each item has the knowledge of the proceeding item, and the following item. When removing an item from the ordered list, we make the following changes, as illustrated in Fig. 17-B:
= Assume the removing item is x1, its proceeding item is xp, and its following item is xf.
= For the proceeding item xp, re-define its following item to the following item of the removing item. Thus, the following item of xp is now xf.
= For the removing item x1, un-define its proceeding item and following item, which removes it from the ordered list.
= For the following item xf, re-define its proceeding item to the proceeding item of the removed item. Thus, the proceeding item of xf is now xp.
After all items are removed from the ordered list, the localization algorithm is complete.
The number of elements in the set loci will be the count of analytes, and location information is the pixel coordinate for each s in the set loci.
Another embodiment searches local peak, which is not necessary the one with the highest heatmap value. To detect each local peak, we start from a random starting point, and search for the local maximal value. After we find the peak, we calculate the local area surrounding the peak but with smaller value. We remove this region from the heatmap and find the next peak from the remaining pixels. The process is repeated only all pixels are removed from the heatmap.
Algorithm LocalSearch (s, heatmap) Input:
s: starting location (x, y) heatmap Output:
s: location of local peak.
We only consider pixels of value > 0.
Algorithm Cover (s, heatmap) Input:
s: location of local peak.
heatmap:
Output:
cover: a set of pixels covered by peak:
This is a breadth-first-search algorithm starting from s, with one altered condition of visiting points: a neighbor p of the current location q is only added to cover if heatmap[p]> 0 and heatmap[p] <= heatmap[q]. Therefore, each pixel in cover has a non-descending path leading to the local peak s.
Algorithm Localization (heatmap) Input:
heatmap Output:
loci loci 4¨{}
pixels 4¨{all pixels from heatmap}
while pixels is not empty {
s 4¨any pixel from pixels s 4¨LocalSearch(s, heatmap) II s is now local peak probe local region of radius R surrounding s for better local peak r 4¨Cover(s, heatmap) pixels <¨ pixels \ r II remove all pixels in cover add s to loci E-3. Example of present invention EA1. A method of deep learning for data analysis, comprising:
(a) receiving an image of a test sample, wherein the sample is loaded into a QMAX
device and the image is taken by an imager connected to the QMAX device, wherein the image includes detectable signals from an analyte in the test sample;
(b) analyzing the image with a detection model and generating a 2-D data array of the image, wherein the 2-D data array includes probability data of the analyte for each location in the image, and the detection model is established through a training process that comprises:
i. feeding an annotated data set to a convolutional neural network, wherein the annotated data set is from samples that are the same type as the test sample and for the same analyte; and training and establishing the detection model by convolution; and (c) analyzing the 2-D data array to detect local signal peaks with:
i. signal list process, or local searching process; and (d) calculating the amount of the analyte based on local signal peak information.
EB1. A system for data analysis, comprising:
a QMAX device, an imager, and computing unit, wherein:
(a) the QMAX device is configured to compress at least part of a test sample into a layer of highly uniform thickness;
(b) the imager is configured to produce an image of the sample at the layer of uniform thickness, wherein the image includes detectable signals from an analyte in the test sample;
(c) the computing unit is configured to:
receive the image from the imager;
analyze the image with a detection model and generate a 2-D data array of the image, wherein the 2-D data array includes probability data of the analyte for each location in the image, and the detection model is established through a training process that comprises:
feeding an annotated data set to a convolutional neural network, wherein the annotated data set is from samples that are the same type as the test sample and for the same analyte; and training and establishing the detection model by convolution; and (c) analyzing the 2-D data array to detect local signal peaks with signal list process, or local searching process; and iv. calculate the amount of the analyte based on local signal peak information.
EA2. The method of embodiment EA1, wherein the signal list process comprises:
establishing a signal list by iteratively detecting local peaks from the 2-D
data array, calculating a local area surrounding the detected local peak, and removing the detected peak and the local area data into the signal list in order; and ii. sequentially and repetitively removing highest signals from the signal list and signals from around the highest signal, thus detecting local signal peaks.
EA3. The method of any embodiments EA embodiments, wherein the local search process comprises:
i. searching for a local maximal value in the 2-D data array by starting from a random point;
calculating the local area surrounding the peak but with smaller value;
removing the local maximal value and the surrounding smaller values from the 2-D data array; and iv. repeating steps i-iii to detect local signal peaks.
EA4. The method of any prior EA embodiments, wherein the annotated data set is partitioned before annotation.
EB2. The system of embodiment EB1, wherein the imager comprises a camera.
EB3. The system of embodiment EB2, wherein the camera is part of a mobile communication device.
EB4. The system of any prior EB embodiments, wherein the computing unit is part of a mobile communication device.
F. Devices and Methods for Tissue Staining and Cell Imaging F-1. Example of QMAX Device for Tissue Staining and Cell Imaging Fig. 18-A shows an embodiment of a generic QMAX device, that have or not have a hinge, and wherein Q: quantification; M: magnifying; A: adding reagents; X:
acceleration; also known as compressed regulated open flow (CROF)) device. The generic QMAX device comprises a first plate 10 and a second plate 20. In particular, panel (A) shows the perspective view of a first plate and a second plate 20 wherein the first plate has spacers. It should be noted, however, that the spacers also are fixed on the second plate 20 (not shown) or on both first plate 10 and second plate 20 (not shown). Panel (B) shows the perspective view and a sectional view of depositing a sample 90 on the first plate 10 at an open configuration. It should be noted, however, that the 10 sample 90 also is deposited on the second plate 20 (not shown), or on both the first plate 10 and the second plate 20 (not shown). Panel (C) illustrates (i) using the first plate 10 and second plate to spread the sample 90 (the sample flow between the inner surfaces of the plates) and reduce the sample thickness, and (ii) using the spacers and the plate to regulate the sample thickness at the closed configuration of the QMAX device. The inner surfaces of each plate have one or a 15 plurality of binding sites and or storage sites (not shown).
In some embodiments, the spacers 40 have a predetermined uniform height and a predetermined uniform inter-spacer distance. In the closed configuration, as shown in panel (C) of Fig. 18-A, the spacing between the plates and the thus the thickness of the sample 90 is regulated by the spacers 40. In some embodiments, the uniform thickness of the sample 90 is 20 substantially similar to the uniform height of the spacers 40. It should be noted that although Fig.
18-A shows the spacers 40 to be fixed on one of the plates, in some embodiments the spacers are not fixed. For example, in certain embodiments the spacers is mixed with the sample so that when the sample is compressed into a thin layer, the spacers, which is rigid beads or particles that have a uniform size, regulate the thickness of the sample layer.
Fig. 18-A shows an embodiment of a QMAX device used for cell imaging. As shown in the figure, the device comprises a first plate 10, a second plate 20, and spacers 40. The plates are movable relative to each other into different configurations, one or both plates are flexible. Each of the plates has, on its respective inner surface, a sample contact area (not indicated) for contacting a staining liquid 910 and/or a tissue sample 90 suspected of containing a target analyte.
The second plate 20 comprises the spacers 40 that are fixed to its inner surface 21. The spacers have a predetermined substantially uniform height and a predetermined inter-spacer distance, and at least one of the spacers is inside the sample contact area.
Fig. 18-A panels (A) and (B) illustrate one of the configurations, an open configuration. As shown in the figure, in the open configuration, the two plates are partially or entirely separated apart, the spacing 102 between the plates is not regulated by the spacers 40, and the staining liquid 910 and the sample 90 are deposited on the first plate 10. It should be noted, the staining liquid 910 and the sample 90 can also be deposited on the second plate 20 or both plates.
Fig. 18-A panel (C) depicts another of the configurations of the two plates, a closed configuration. The closed configuration is configured after the deposition of the staining liquid 910 and the sample 90 in the open configuration, as shown in panel (B). And in the closed configuration, at least part of the sample 90 is between the two plates and a layer of at least part of staining liquid 910 is between the at least part of the sample 90 and the second plate 20, wherein the thickness of the at least part of staining liquid layer is regulated by the plates, the sample 90, and the spacers 40, and has an average distance between the sample surface and the second plate surface is equal or less than 250 pm with a small variation.
In some embodiments, the sample can dried thereon at the open configuration, and wherein the sample comprises bodily fluid selected from the group consisting of: amniotic fluid, aqueous humour, vitreous humour, blood (e.g., whole blood, fractionated blood, plasma or serum), breast milk, cerebrospinal fluid (CSF), cerumen (earwax), chyle, chime, endolymph, perilymph, feces, breath, gastric acid, gastric juice, lymph, mucus (including nasal drainage and phlegm), pericardial fluid, peritoneal fluid, pleural fluid, pus, rheum, saliva, exhaled breath condensates, sebum, semen, sputum, sweat, synovial fluid, tears, vomit, urine, and any combination thereof.
In some embodiments, the sample contact area of one or both of the plates is configured such that the sample can dried thereon at the open configuration, and the sample comprises blood smear and is dried on one or both plates.
In some embodiments, the sample is a solid tissue section having a thickness in the range of 1 ¨ 200 um, and the sample contact area of one or both of the plates is adhesive to the sample. In some embodiments, the sample is paraffin-embedded. In some embodiments, the sample is fixed.
In some embodiments, the staining liquid is a pure buffer solution that does not comprise particularly component capable of altering the properties of the sample. In some embodiments, the staining liquid comprises fixative capable of fixing the sample. In some embodiments, the staining liquid comprises blocking agents, wherein the blocking agents are configured to disable non-specific endogenous species in the sample to react with detection agents that are used to specifically label the target analyte. In some embodiments, the staining liquid comprises deparaffinizing agents capable of removing paraffin in the sample. In some embodiments, the staining liquid comprises permeabilizing agents capable of permeabilizing cells in the tissue sample that contain the target analyte. In some embodiments, the staining liquid comprises antigen retrieval agents capable of facilitating retrieval of antigen. In some embodiments, the staining liquid comprises detection agents that specifically label the target analyte in the sample.
In some embodiments, the sample contact area of one or both plates comprise a storage site that contains blocking agents, wherein the blocking agents are configured to disable non-specific endogenous species in the sample to react with detection agents that are used to specifically label the target analyte. In some embodiments, the sample contact area of one or both plates comprise a storage site that contains deparaffinizing agents capable of removing paraffin in the sample. In some embodiments. the sample contact area of one or both plates comprise a storage site that contains permeabilizing agents capable of permeabilizing cells in the tissue sample that contain the target analyte. In some embodiments. the sample contact area of one or both plates comprise a storage site that contains antigen retrieval agents capable of facilitating retrieval of antigen. In some embodiments, the sample contact area of one or both plates comprise a storage site that contains detection agents that specifically label the target analyte in the sample. In some embodiments, the sample contact area of one or both of the plates comprise a binding site that contains capture agents, wherein the capture agents are configured to bind to the target analyte on the surface of cells in the sample and immobilize the cells.
In some embodiments, the detection agent comprises dyes for a stain selected from the group consisting of: Acid fuchsin, Alcian blue 8 GX, Alizarin red S, Aniline blue WS, Auramine 0, Azocarmine B, Azocarmine G, Azure A, Azure B, Azure C, Basic fuchsine, Bismarck brown Y, Brilliant cresyl blue, Brilliant green, Carmine, Chlorazol black E, Congo red, C.I. Cresyl violet, Crystal violet, Darrow red, Eosin B, Eosin Y, Erythrosin, Ethyl eosin, Ethyl green, Fast green F
C F, Fluorescein lsothiocyanate, Giemsa Stain, Hematoxylin, Hematoxylin &
Eosin, Indigo carmine, Janus green B, Jenner stain 1899, Light green SF, Malachite green, Martius yellow, Methyl orange, Methyl violet 2B, Methylene blue, Methylene blue, Methylene violet, (Bernthsen), Neutral red, Nigrosin, Nile blue A, Nuclear fast red, Oil Red , Orange G, Orange II, Orcein, Pararosaniline, Phloxin B, Protargol S, Pyronine B, Pyronine , Resazurin, Rose Bengal, Safranine 0, Sudan black B, Sudan III, Sudan IV, Tetrachrome stain (MacNeal), Thionine, Toluidine blue, Weigert, Wright stain, and any combination thereof.
In some embodiments, the detection agent comprises antibodies configured to specifically bind to protein analyte in the sample.
In some embodiments, the detection agent comprises oligonucleotide probes configured to specifically bind to DNA and/or RNA in the sample.
In some embodiments, the detection agent is labeled with a reporter molecule, wherein the reporter molecule is configured to provide a detectable signal to be read and analyzed.
In some embodiments, the signal is selected from the group consisting of:
i. luminescence selected from photoluminescence, electroluminescence, and electrochemiluminescence;
ii. light absorption, reflection, transmission, diffraction, scattering, or diffusion;
iii. surface Raman scattering;
iv. electrical impedance selected from resistance, capacitance, and inductance;
v. magnetic relaxivity; and vi. any combination of i-v.
F-2. Immunohistochemistry In some embodiments, the devices and methods of the present invention are useful for conducting immunohistochemistry on the sample.
In immunohistochemical (IHC) staining methods, a tissue sample is fixed (e.g., in paraformaldehyde), optionally embedding in wax, sliced into thin sections that are less then 100 um thick (e.g., 2 um to 6 um thick), and then mounted onto a support such as a glass slide.
Once mounted, the tissue sections may be dehydrated using alcohol washes of increasing concentrations and cleared using a detergent such as xylene.
In most IHC methods, a primary and a secondary antibody may be used. In such methods, the primary antibody binds to antigen of interest (e.g., a biomarker) and is unlabeled.
The secondary antibody binds to the primary antibody and directly conjugated either to a reporter molecule or to a linker molecule (e.g., biotin) that can recruit reporter molecule that is in solution. Alternatively, the primary antibody itself may be directly conjugated either to a reporter molecule or to a linker molecule (e.g., biotin) that can recruit reporter molecule that is in solution. Reporter molecules include fluorophores (e.g., FITC, TRITC, AMCA, fluorescein and rhodamine) and enzymes such as alkaline phosphatase (AP) and horseradish peroxidase (HRP), for which there are a variety of fluorogenic, chromogenic and chemiluminescent substrates such as DAB or BCIP/NBT.
In direct methods, the tissue section is incubated with a labeled primary antibody (e.g.
an FITC-conjugated antibody) in binding buffer. The primary antibody binds directly with the antigen in the tissue section and, after the tissue section has been washed to remove any unbound primary antibody, the section is to be analyzed by microscopy.
In indirect methods, the tissue section is incubated with an unlabeled primary antibody that binds to the target antigen in the tissue. After the tissue section is washed to remove unbound primary antibody, the tissue section is incubated with a labeled secondary antibody that binds to the primary antibody.
After immunohistochemical staining of the antigen, the tissue sample may be stained with another dye, e.g., hematoxylin, Hoechst stain and DAPI, to provide contrast and/or identify other features.
The present device may be used for immunohistochemical (I HC) staining a tissue sample. In these embodiments, the device may comprise a first plate and a second plate, wherein: the plates are movable relative to each other into different configurations; one or both plates are flexible; each of the plates has, on its respective surface, a sample contact area for contacting a tissue sample or a I HC staining liquid; the sample contact area in the first plate is smooth and planner; the sample contact area in the second plate comprise spacers that are fixed on the surface and have a predetermined substantially uniform height and a predetermined constant inter-spacer distance that is in the range of 7 pm to 200 pm;
wherein one of the configurations is an open configuration, in which: the two plates are completely or partially separated apart, the spacing between the plates is not regulated by the spacers; and wherein another of the configurations is a closed configuration which is configured after a deposition of the sample and the I HC staining liquid in the open configuration; and in the closed configuration: at least part of the sample is between the two plates and a layer of at least part of staining liquid is between the at least part of the sample and the second plate, wherein the thickness of the at least part of staining liquid layer is regulated by the plates, the sample, and the spacers, and has an average distance between the sample surface and the second plate surface is equal or less than 250 pm with a small variation.
In some embodiments, the device may comprise a dry I HC staining agent coated on the sample contact area of one or both plates. In some embodiments, the device may comprise a dry I HC staining agent coated on the sample contact area of the second plate, and the I HC
staining liquid comprise a liquid that dissolve the dry I HC staining agent.
The device of claim 1, wherein the thickness of the sample is 2 um to 6 um.
F-3. H& E and Special stains In some embodiments, the devices and methods of the present invention are useful for conducting H&E stain and special stains.
Hematoxylin and eosin stain or haematoxylin and eosin stain (H&E stain or HE
stain) is one of the principal stains in histology. It is the most widely used stain in medical diagnosis and is often the gold standard; for example when a pathologist looks at a biopsy of a suspected cancer, the histological section is likely to be stained with H&E and termed "H&E section", "H+E
section", or "HE section". A combination of hematoxylin and eosin, it produces blues, violets, and reds.
In diagnostic pathology, the "special stain" terminology is most commonly used in the clinical environment, and simply means any technique other than the H & E
method that is used to impart colors to a specimen. This also includes immunohistochemical and in situ hybridization stains. On the other hand, the H & E stain is the most popular staining method in histology and medical diagnosis laboratories.
In any embodiments, the dry binding site may comprise a capture agent such as an antibody or nucleic acid. In some embodiments, the releasable dry reagent may be a labeled reagent such as a fluorescently-labeled reagent, e.g., a fluorescently-labeled antibody or a cell stain such Romanowsky's stain, Leishman stain, May-Grunwald stain, Giemsa stain, Jenner's stain, Wright's stain, or any combination of the same (e.g., Wright-Giemsa stain). Such a stain may comprise eosin Y or eosin B with methylene blue. In certain embodiments, the stain may be an alkaline stain such as haematoxylin.
In some embodiments, the special stains include, but not limited to, Acid fuchsin, Alcian blue 8 GX, Alizarin red S, Aniline blue WS, Auramine 0, Azocarmine B, Azocarmine G, Azure A, Azure B, Azure C, Basic fuchsine, Bismarck brown Y, Brilliant cresyl blue, Brilliant green, Carmine, Chlorazol black E, Congo red, C.I. Cresyl violet, Crystal violet, Darrow red, Eosin B, Eosin Y, Erythrosin, Ethyl eosin, Ethyl green, Fast green F C F, Fluorescein lsothiocyanate, Giemsa Stain, Hematoxylin, Hematoxylin & Eosin, Indigo carmine, Janus green B, Jenner stain 1899, Light green SF, Malachite green, Martius yellow, Methyl orange, Methyl violet 2B, Methylene blue, Methylene blue, Methylene violet, (Bernthsen), Neutral red, Nigrosin, Nile blue A, Nuclear fast red, Oil Red, Orange G, Orange II, Orcein, Pararosaniline, Phloxin B, Protargol S, Pyronine B, Pyronine , Resazurin, Rose Bengal, Safranine 0, Sudan black B, Sudan III, Sudan IV, Tetrachrome stain (MacNeal), Thionine, Toluidine blue, Weigert, Wright stain, and any combination thereof.
F-4. In Situ Hybridization In some embodiments, the devices and methods of the present invention are useful for conducting in situ hybridization (ISH) on histological samples.
In situ hybridization (ISH) is a type of hybridization that uses a labeled complementary DNA, RNA or modified nucleic acids strand (i.e., probe) to localize a specific DNA or RNA
sequence in a portion or section of tissue (in situ), or, if the tissue is small enough (e.g., plant seeds, Drosophila embryos), in the entire tissue (whole mount ISH), in cells, and in circulating tumor cells (CTCs).
In situ hybridization is used to reveal the location of specific nucleic acid sequences on chromosomes or in tissues, a crucial step for understanding the organization, regulation, and function of genes. The key techniques currently in use include: in situ hybridization to mRNA
with oligonucleotide and RNA probes (both radio-labelled and hapten-labelled);
analysis with light and electron microscopes; whole mount in situ hybridization; double detection of RNAs and RNA plus protein; and fluorescent in situ hybridization to detect chromosomal sequences. DNA
ISH can be used to determine the structure of chromosomes. Fluorescent DNA ISH
(FISH) can, for example, be used in medical diagnostics to assess chromosomal integrity.
RNA ISH (RNA in situ hybridization) is used to measure and localize RNAs (mRNAs, IncRNAs, and miRNAs) within tissue sections, cells, whole mounts, and circulating tumor cells (CTCs).
In some embodiments, the detection agent comprises nucleic acid probes for in situ hybridization staining. The nucleic acid probes include, but not limited to, oligonucleotide probes configured to specifically bind to DNA and/or RNA in the sample.
F-5. System and Method for Tissue Staining and Cell Imaging Also provided is a system for rapidly staining and analyzing a tissue sample using a mobile phone comprising:
(a) sample, staining liquid, and device as described above, (b) a mobile communication device comprising:
i. one or a plurality of cameras for the detecting and/or imaging the sample;
ii. electronics, signal processors, hardware and software for receiving and/or processing the detected signal and/or the image of the sample and for remote communication; and (c) a light source from either the mobile communication device or an external source.
Also provided is a method for rapidly staining and analyzing a tissue sample using a mobile phone, comprising:
(a) depositing a tissue sample and a staining liquid on the device of the system described above, and placing the two plate into a closed configuration;
(b) obtaining a mobile phone that has hardware and software of imaging, data processing, and communication;
(c) assaying by the tissue sample deposited on the CROF device by the mobile phone to generate a result; and (d) communicating the result from the mobile phone to a location remote from the mobile phone.
Also provided is a method for staining a tissue sample, comprising:
(a) obtaining a tissue sample;
(b) obtaining a stain liquid;
(c) obtaining a first plate and a second plate, wherein:
the plates are movable relative to each other into different configurations;
one or both plates are flexible;
each of the plates has, on its respective surface, a sample contact area for contacting a tissue sample or a I HC staining liquid;
the sample contact area in the first plate is smooth 5 and planner;
the sample contact area in the second plate comprise spacers that are fixed on the surface and have a predetermined substantially uniform height and a predetermined constant inter-spacer distance that is in the range of 7 pm to 200 pm;
(c) depositing the tissue sample and the stain liquid on the plates when the plates are configured in an open configuration, wherein the open configuration is a configuration in which the two plates are either partially or completely separated apart and the spacing between the plates is not regulated by the spacers; and (d), after (c), using the two plates to compress at least part of the tissue sample and at least part of the staining liquid into a closed configuration;
wherein in the closed configuration: at least part of the sample is between the two plates and a layer of at least part of staining liquid is between the at least part of the sample and the second plate, wherein the thickness of the at least part of staining liquid layer is regulated by the plates, the sample, and the spacers, and has an average distance between the sample surface and the second plate surface is equal or less than 250 pm with a small variation.
All of the benefits and advantages (e.g., an accelerated reaction, faster results, etc.) of other embodiments may be applied to this device, system and method.
Further, all parameters described above in the context of other embodiments (e.g., the size, spacing and shape of the spacers, the flexibility of the spacers and plates, and how the device and system can be used, etc.) can be incorporated into I HC embodiments described in this section.
For example, in some embodiments, the spacers regulating the layer of uniform thickness (i.e., the spacers that are spacing the plates away from each other in the layer) have a "filling factor" of at least 1 %, e.g., at least 2% or at least 5%, wherein the filling factor is the ratio of the spacer area that is in contact with the layer of uniform thickness to the total plate area that is in contact with the layer of uniform thickness. In some embodiments, for spacers regulating the layer of uniform thickness, the Young's modulus of the spacers times the filling factor of the spacers is equal or larger than 10 MPa, e.g., at least 15 MPa or at least 20 MPa, where the filling factor is the ratio of the spacer area that is in contact with the layer of uniform thickness to the total plate area that is in contact with the layer of uniform thickness.
In some embodiments, the thickness of the flexible plate times the Young's modulus of the flexible plate is in the range of 60 to 550 GPa-um, e.g., 100 to 300 GPa-um. In some embodiments, for a flexible plate, the fourth power of the inter-spacer-distance (ISD) divided by the thickness of the flexible plate (h) and the Young's modulus (E) of the flexible plate, ISD4/(hE), is equal to 5 or less than 106 um3/GPa, e.g., less than 105 um3/GPa, less than 104 um3/GPa or less than 103 um3/GPa.
In some embodiments, one or both plates comprise a location marker either on a surface .. of or inside the plate, that provide information of a location of the plate, e.g., a location that is going to be analyzed or a location onto which the section should be deposited.
In some cases, one or both plates may comprise a scale marker, either on a surface of or inside the plate, that provides information of a lateral dimension of a structure of the section and/or the plate. In some embodiments, one or both plates comprise an imaging marker, either on surface of or inside the plate, that assists an imaging of the sample. For example, the imaging marker could help focus the imaging device or direct the imaging device to a location on the device.
In some embodiments, the spacers can function as a location marker, a scale marker, an imaging marker, or any combination of thereof.
In some embodiments, the inter-spacer distance may substantially periodic. In some .. cases, the spacers may be in a regular pattern and the spacing between adjacent spacers may be approximately the same. In some embodiments, the spacers are pillars with a cross-sectional shape selected from round, polygonal, circular, square, rectangular, oval, elliptical, or any combination of the same and, in some embodiments, the spacers may have a substantially flat top surface, wherein, for each spacer, the ratio of the lateral dimension of the spacer to its height is at least 1. In some cases, the minimum lateral dimension of spacer is less than or substantially equal to the minimum dimension of an analyte in the sample. The minimum lateral dimension of spacer is in the range of 0.5 um to 100 um, e.g., in the range of 2 um to 50 um or 0.5 um to 10 um.
In some embodiments, the spacers have a pillar shape and the sidewall corners of the spacers have a round shape with a radius of curverture at least 1 um, e.g., at least 1.2 um, at least 1.5 um or at least 2.0 um. The spacers may have any convenient density, e.g., a density of at least 1000/mm2, e.g., a density of at least 1000/mm2, a density of at least 2000/mm2, a density of at least 5,000/mm2 or a density of at least 10,000/mm2.
In this device, at least one of the plates may be transparent, thereby allowing the assay to be read optically. Likewise, in this device, at least one of the plates may be made of a flexible polymer, thereby allowing the sample to be efficiently spread by compressing the plates together. In some embodiments, the pressure that compresses the plates, the spacers are not compressible and/or, independently, only one of the plates is flexible. The flexible plate may .. have a thickness in the range of 20 um to 200 um, e.g., 50 um to 150 um. As noted above, in the closed position, the thickness of the layer of uniform thickness may have a small variation.
In some embodiments, the variation may be less than 10%, less than 5% or less than 2%, meaning that the thickness of the area does not exceed +/- 10%, +/- 5% 5 or +/- 2% of the average thickness.
In some embodiments, the first and second plates are connected and the device can be changed from the open configuration to the closed configuration by folding the plates. In some embodiments, the first and second plates can be connected by a hinge and the device can be changed from the open configuration to the closed configuration by folding the plates such that the device bends along the hinge. The hinge may be a separate material that is attached to the plates or, in some cases, the plates may be integral with the plates.
In some embodiments, the device may be capable of analyzing the section very rapidly.
In some cases, the analysis may be done in 60 seconds or less, in 30 seconds, in 20 seconds or 15 less or in 10 seconds or less.
In some embodiments, the system may additionally comprise (d) a housing configured to hold the sample and to be mounted to the mobile communication device. The housing may comprise optics for facilitating the imaging and/or signal processing of the sample by the mobile communication device, and a mount configured to hold the optics on the mobile communication device. In some cases, an element of the optics of the device (e.g., a lens, filter, mirror, prism or a beamsplitter, may be movable) such that the sample may be imaged in at least two channels.
In some embodiments, the mobile communication device may be configured to communicate test results to a medical professional (e.g., an MD), a medical facility (e.g., a hospital or testing lab) or an insurance company. In addition, the mobile communication device may be configured to communicate information on the subject (e.g., the subject's age, gender, weight, address, name, prior test results, prior medical history, etc.) with the medical professional, medical facility or insurance company. In certain embodiments, the mobile communication device may be configured to receive a prescription, diagnosis or a recommendation from a medical professional. For example, in some embodiments the mobile communication device may send assay results to a remote location where a medical professional gives a diagnosis. The diagnosis may be communicated to the subject via the mobile communication device.
In some embodiments, the mobile communication device may contain hardware and software that allows it to (a) capture an image of the sample; (b) analyze a test location and a control location in in image; and (c) compare a value obtained from analysis of the test location to a threshold value that characterizes the rapid diagnostic test. In some cases, the mobile communication device communicates with the remote location via a wireless or cellular network.
In any embodiment, the mobile communication device may be a mobile phone.
The system may be used in a method that comprises (a) sample on the device of the system; (b) assaying the sample deposited on the device to generate a result;
and (c) communicating the result from the mobile communication device to a location remote from the mobile communication device. The method may comprise analyzing the results at the remote location to provide an analyzed result; and communicating the analyzed result from the remote location to the mobile communication device. As noted above, the analysis may be done by a medical professional at a remote location. And, in some embodiments, the mobile communication device may receive a prescription, diagnosis or a recommendation from a medical professional at a remote location.
Also provided is a method for analyzing a tissue section. In some embodiments, this method may comprise obtaining a device as described above, depositing the section onto one or both pates of the device; placing the plates in a closed configuration and applying an external force over at least part of the plates; and analyzing the sample in the layer of uniform thickness while the plates are the closed configuration.
In some embodiments, this method may comprise:
(a) obtaining a tissue section;
(b) obtaining a first and second plates that are movable relative to each other into different configurations, wherein each plate has a sample contact surface that is substantially planar, one or both plates are flexible, and one or both of the plates comprise spacers that are fixed with a respective sample contacting surface, and wherein the spacers have:
i. a predetermined substantially uniform height, ii. a shape of pillar with substantially uniform cross-section and a flat top surface;
iii. a ratio of the width to the height equal or larger than one;
iv. a predetermined constant inter-spacer distance that is in the range of 10 pm to 200 pm;
v. a filling factor of equal to 1% or larger; and (c) depositing the section on one or both of the plates when the plates are configured in an open configuration, wherein the open configuration is a configuration in which 5 the two plates are either partially or completely separated apart and the spacing between the plates is not regulated by the spacers;
(d), after (c), using the two plates to compress at least part of the section into a layer of substantially uniform thickness that is confined by the sample contact surfaces of the plates, wherein the uniform thickness of the layer is regulated by the spacers and the plates, and has an average value in the range of 1.8 pm to 3 pm with a variation of less than 10%, wherein the compressing comprises:
bringing the two plates together; and conformable pressing, either in parallel or sequentially, an area of at least one of the plates to press the plates together to a closed configuration, wherein the conformable pressing generates a substantially uniform pressure on the plates over the at least part of the sample, and the pressing spreads the at least part of the sample laterally between the sample contact surfaces of the plates, and wherein the closed configuration is a configuration in which the spacing between the plates in the layer of uniform thickness region is regulated by the spacers;
and (e) analyzing the section in the layer of uniform thickness while the plates are the closed configuration;
wherein the filling factor is the ratio of the spacer contact area to the total plate area;
wherein a conformable pressing is a method that makes the pressure applied over an area is substantially constant regardless the shape variation of the outer surfaces of the plates;
and wherein the parallel pressing applies the pressures on the intended area at the same time, and a sequential pressing applies the pressure on a part of the intended area and gradually move to other area.
In some embodiments, this method may comprise: removing the external force after the plates are in the closed configuration; imaging the section in the layer of uniform thickness while the plates are the closed configuration. As noted above, in these embodiments, the inter-spacer distance may in the range of 20 um to 200 um or 5 um to 20 um. In these embodiments, the product of the filling factor and the Young's modulus of the spacer is 2 M Pa or larger. In some embodiments, the surface variation is less than 30 nm.
In any of these embodiments, the imaging and counting may be done by: i.
illuminating the section in the layer of uniform thickness; ii. taking one or more images of the section using a CCD or CMOS sensor.
In some embodiments, the external force may be provided by human 5 hand, e.g., by pressing down using a digit such as a thumb, or pinching between a thumb and another digit such as a forefinger on the same hand.
In some embodiments, one or more of the plates may comprises a dry reagent coated on one or both plates (e.g., a binding agent, a staining agent, a detection agent or an assay reactant).
In some embodiments, the layer of uniform thickness sample may a thickness uniformity of up to +/-5%, e.g., up to +/-2% or up to +/-1%.
In some embodiments, the spacers are pillars with a cross-sectional shape selected from round, polygonal, circular, square, rectangular, oval, elliptical, or any combination of the same.
F-6. Examples of Present Invention FA1. A device for analyzing a tissue sample, comprising:
a first plate, a second plate, and spacers, wherein:
the plates are movable relative to each other into different configurations;
one or both plates are flexible;
iii. each of the plates has, on its respective inner surface, a sample contact area for contacting a staining liquid and/or a tissue sample suspected of containing a target analyte;
iv. one or both of the plates comprise the spacers that are fixed with a respective plate;
v. the spacers have a predetermined substantially uniform height and a predetermined inter-spacer distance; and vi. at least one of the spacers is inside the sample contact area;
wherein one of the configurations is an open configuration, in which: the two plates are partially or entirely separated apart, the spacing between the plates is not regulated by the spacers, and the staining liquid and the sample are deposited on one or both of the plates;
wherein another of the configurations is a closed configuration, which is configured after the deposition of the staining liquid and the sample in the open configuration, and in the closed configuration: at least part of the sample is between the two plates and a layer of at least part of staining liquid is between the at least part of the sample and the second plate, wherein the thickness of the at least part of staining liquid layer is regulated by the plates, the sample, and the spacers, and has an average distance between the sample surface and the second plate surface is equal or less than 250 pm with a small variation.
FAA1. A device for analyzing a tissue sample, comprising:
a first plate, a second plate, and spacers, wherein:
the plates are movable relative to each other into different configurations;
one or both plates are flexible;
each of the plates has, on its respective inner surface, a sample contact area for contacting a transfer solution and/or a tissue sample suspected of containing a target analyte;
iv. one or both of the plates comprise stain agent that is dried on the respective sample contact area and configured to, upon contacting the transfer solution, dissolve in the transfer solution and stain the tissue sample;
v. one or both of the plates comprise the spacers that are fixed with a respective plate;
vi. the spacers have a predetermined substantially uniform height and a predetermined inter-spacer distance; and vii. at least one of the spacers is inside the sample contact area;
wherein one of the configurations is an open configuration, in which: the two plates are partially or entirely separated apart, the spacing between the plates is not regulated by the spacers, and the staining liquid and the sample are deposited on one or both of the plates;
wherein another of the configurations is a closed configuration, which is configured after the deposition of the staining liquid and the sample in the open configuration, and in the closed configuration: at least part of the sample is between the two plates and a layer of at least part of transfer solution is between the at least part of the sample and the second plate, wherein the thickness of the at least part of transfer solution layer is regulated by the plates, the sample, and the spacers, and has an average distance between the sample surface and the second plate surface is equal or less than 250 pm with a small variation.
FB1. A method for analyzing a tissue sample, comprising the steps of:
(a) obtaining a tissue sample suspected of containing a target analyte and a staining liquid;
(b) obtaining a first plate, a second plate, and spacers, wherein:
the plates are movable relative to each other into different configurations;
one or both plates are flexible;
each of the plates has, on its respective inner surface, a sample contact area for contacting the staining liquid and/or the tissue sample;
iv. one or both of the plates comprise the spacers that are fixed with a respective plate;
v. the spacers have a predetermined substantially uniform height and a predetermined inter-spacer distance; and vi. at least one of the spacers is inside the sample contact area;
(c) depositing the staining liquid and the tissue sample on one or both of the plates when the plates are in an open configuration, wherein the open configuration is a configuration in which the two plates are partially or entirely separated apart, the spacing between the two plates is not regulated by the spacers, and the sample and the staining liquid are deposited on one or both of the plates;
(d) after (c), bringing the two plates together and pressing the plates into a closed configuration, wherein the pressing comprises conformable pressing, either in parallel or sequentially, an area of at least one of the plates to press the plates together to the closed configuration, wherein the conformable pressing generates a substantially uniform pressure on the plates over the at least part of the sample, and the pressing spreads the at least part of the sample laterally between the inner surfaces of the plates;
and wherein another of the configurations is the closed configuration, which is configured after the deposition of the staining liquid and the sample in the open configuration, and in the closed configuration: at least part of the sample is between the two plates and a layer of at least part of staining liquid is between the at least part of the sample and the second plate, wherein the thickness of the at least part of staining liquid layer is regulated by the plates, the sample, and the spacers, and has an average distance between the sample surface and the second plate surface is equal or less than 250 pm with a small variation;
and (e) analyzing the target analyte when the plates are in the closed configuration.
FBB1. A method for analyzing a tissue sample, comprising the steps of:
(a) obtaining a tissue sample suspected of containing a target analyte and a transfer solution;
(b) obtaining a first plate, a second plate, and spacers, wherein:
the plates are movable relative to each other into different configurations;
ii. one or both plates are flexible;
each of the plates has, on its respective inner surface, a sample contact area for contacting a staining liquid and/or a tissue sample suspected of containing a target analyte;
iv. one or both of the plates comprise stain agents that are coated on the respective sample contact area and configured to, upon contacting a transfer solution, dissolve in the transfer solution and stain the tissue sample;
v. one or both of the plates comprise the spacers that are fixed with a respective plate;
vi. the spacers have a predetermined substantially uniform height and a predetermined inter-spacer distance; and vii. at least one of the spacers is inside the sample contact area;
(c) depositing the staining liquid and the tissue sample on one or both of the plates when the plates are in an open configuration, wherein the open configuration is a configuration in which the two plates are partially or entirely separated apart, the spacing between the two plates is not regulated by the spacers, and the sample and the staining liquid are deposited on one or both of the plates;
(d) after (c), bringing the two plates together and pressing the plates into a closed configuration, wherein the pressing comprises conformable pressing, either in parallel or sequentially, an area of at least one of the plates to press the plates together to the closed configuration, wherein the conformable pressing generates a substantially uniform pressure on the plates over the at least part of the sample, and the pressing spreads the at least part of the sample laterally between the inner surfaces of the plates;
and wherein another of the configurations is the closed configuration, which is configured after the deposition of the staining liquid and the sample in the open configuration, and in the closed configuration: at least part of the sample is between the two plates and a layer of at least part of staining liquid is between the at least part of the sample and the second plate, wherein the thickness of the at least part of staining liquid layer is regulated by the plates, the sample, and the spacers, and has an average distance between the sample surface and the second plate surface is equal or less than 250 pm with a small variation;
and (e) analyzing the target analyte when the plates are in the closed configuration.
FA2. The device of embodiment FA1, wherein one or both of the plates is configured such that the sample can dried thereon at the open configuration, and wherein the sample comprises bodily fluid selected from the group consisting of: amniotic fluid, aqueous humour, vitreous humour, blood (e.g., whole blood, fractionated blood, plasma or serum), breast milk, cerebrospinal fluid (CSF), cerumen (earwax), chyle, chime, endolymph, perilymph, feces, breath, gastric acid, gastric juice, lymph, mucus (including nasal drainage and phlegm), pericardial fluid, peritoneal fluid, pleural fluid, pus, rheum, saliva, exhaled breath condensates, sebum, semen, sputum, sweat, synovial fluid, tears, vomit, urine, and any combination thereof.
FAA2. The device of any prior embodiment, wherein the staining liquid has a viscosity in the range of 0.1 to 3.5 mPa S.
FA3. The device of any prior embodiment, wherein the sample contact area of one or both of the plates is configured such that the sample can dried thereon at the open configuration, and wherein the sample comprises blood smear and is dried on one or both plates.
FA4. The device of any prior embodiment, wherein the sample contact area of one or both of the plates is adhesive to the sample, and wherein the sample is a tissue section having a thickness in the range of 1 ¨ 200 um.
FA5. The device of embodiment FA4, wherein the sample is paraffin-embedded.
FA6. The device of any of embodiment, wherein the sample is fixed.
FA7. The device of any prior embodiment, wherein the staining liquid comprises fixative capable of fixing the sample.
FA8. The device of any prior embodiment, wherein the staining liquid comprises blocking agents, wherein the blocking agents are configured to disable non-specific endogenous species in the sample to react with detection agents that are used to specifically label the target analyte.
FA9. The device of any prior embodiment, wherein the staining liquid comprises deparaffinizing agents capable of removing paraffin in the sample.
FA10. The device of any prior embodiment, wherein the staining liquid comprises permeabilizing agents capable of permeabilizing cells in the tissue sample that contain the .. target analyte.
FA11. The device of any prior embodiment, wherein the staining liquid comprises antigen retrieval agents capable of facilitating retrieval of antigen.
FA12. The device of any prior embodiment, wherein the staining liquid comprises detection agents that specifically label the target analyte in the sample.
FA13. The device of any prior embodiment, wherein the sample contact area of one or both plates comprise a storage site that contains blocking agents, wherein the blocking agents are configured to disable non-specific endogenous species in the sample to react with detection agents that are used to specifically label the target analyte.
FA14. The device of any prior embodiment, wherein the sample contact area of one or both plates comprise a storage site that contains deparaffinizing agents capable of removing paraffin in the sample.
FA15. The device of any prior embodiment, wherein the sample contact area of one or both plates comprise a storage site that contains permeabilizing agents capable of permeabilizing cells in the tissue sample that contain the target analyte.
FA16. The device of any prior embodiment, wherein the sample contact area of one or both plates comprise a storage site that contains antigen retrieval agents capable of facilitating retrieval of antigen.
FA17. The device of any prior embodiment, wherein the sample contact area of one or both plates comprise a storage site that contains detection agents that specifically label the target analyte in the sample.
FA18. The device of any prior embodiment, wherein the detection agent comprises dyes for a stain selected from the group consisting of: Acid fuchsin, Alcian blue 8 GX, Alizarin red S, Aniline blue WS, Auramine 0, Azocarmine B, Azocarmine G, Azure A, Azure B, Azure C, Basic fuchsine, Bismarck brown Y, Brilliant cresyl blue, Brilliant green, Carmine, Chlorazol black E, Congo red, C.I. Cresyl violet, Crystal violet, Darrow red, Eosin B, Eosin Y, Erythrosin, Ethyl eosin, Ethyl green, Fast green F C F, Fluorescein lsothiocyanate, Giemsa Stain, Hematoxylin, Hematoxylin & Eosin, Indigo carmine, Janus green B, Jenner stain 1899, Light green SF, Malachite green, Martius yellow, Methyl orange, Methyl violet 2B, Methylene blue, Methylene blue, Methylene violet, (Bernthsen), Neutral red, Nigrosin, Nile blue A, Nuclear fast red, Oil Red , Orange G, Orange II, Orcein, Pararosaniline, Phloxin B, Protargol S, Pyronine B, Pyronine , Resazurin, Rose Bengal, Safranine 0, Sudan black B, Sudan III, Sudan IV, Tetrachrome stain (MacNeal), Thionine, Toluidine blue, Weigert, Wright stain, and any combination thereof.
FA19. The device of any prior embodiment, wherein the detection agent comprises antibodies configured to specifically bind to protein analyte in the sample.
FA20. The device of any prior embodiment, wherein the detection agent comprises oligonucleotide probes configured to specifically bind to DNA and/or RNA in the sample.
FA21. The device of any prior embodiment, wherein the detection agent is labeled with a reporter molecule, wherein the reporter molecule is configured to provide a detectable signal to be read and analyzed.
FA22. The device of embodiment FA21, wherein the signal is selected from the group consisting of:
i. luminescence selected from photoluminescence, electroluminescence, and electrochemiluminescence;
ii. light absorption, reflection, transmission, diffraction, scattering, or diffusion;
iii. surface Raman scattering;
iv. electrical impedance selected from resistance, capacitance, and inductance;
v. magnetic relaxivity; and vi. any combination of i-v.
FA23. The device of any prior embodiment, wherein the sample contact area of one or both of the plates comprise a binding site that contains capture agents, wherein the capture agents are configured to bind to the target analyte on the surface of cells in the sample and immobilize the cells.
FB2. The method of embodiment F131, wherein the depositing step (c) comprises depositing and drying the sample on one or both of the plates before depositing the remaining of the staining liquid on top of the dried sample, and wherein the sample comprises bodily fluid selected from the group consisting of: amniotic fluid, aqueous humour, vitreous humour, blood (e.g., whole blood, fractionated blood, plasma or serum), breast milk, cerebrospinal fluid (CSF), cerumen (earwax), chyle, chime, endolymph, perilymph, feces, breath, gastric acid, gastric juice, lymph, mucus (including nasal drainage and phlegm), pericardial fluid, peritoneal fluid, pleural fluid, pus, rheum, saliva, exhaled breath condensates, sebum, semen, sputum, sweat, synovial fluid, tears, vomit, urine, and any combination thereof.
FBB2. The method of any prior embodiment, wherein the staining liquid has a viscosity in the range of 0.1 to 3.5 mPa S.
FB3. The method of any prior embodiment, wherein the depositing step (c) comprises depositing and drying the sample on one or both of the plates before depositing the remaining of the staining liquid on top of the dried sample, and wherein the sample comprises blood smear and is dried on one or both plates.
FB4. The method of any prior embodiment, wherein the depositing step (c) comprises depositing and attaching the sample to one or both of the plates before depositing the staining liquid on top of the sample, wherein the sample contact area of one or both of the plates is adhesive to the sample, and wherein the sample is a tissue section having a thickness in the range of 1 ¨200 Em.
FB5. The device of embodiment FA4, wherein the sample is paraffin-embedded.
FB6. The method of any of embodiment, wherein the sample is fixed.
FB7. The method of any prior embodiment, wherein the staining liquid comprises fixative capable of fixing the sample.
FB8. The method of any prior embodiment, wherein the staining liquid comprises blocking agents, wherein the blocking agents are configured to disable non-specific endogenous species in the sample to react with detection agents that are used to specifically label the target analyte.
FB9. The method of any prior embodiment, wherein the staining liquid comprises deparaffinizing agents capable of removing paraffin in the sample.
B10. The method of any prior embodiment, wherein the staining liquid comprises permeabilizing agents capable of permeabilizing cells in the tissue sample that contain the target analyte.
FB11. The method of any prior embodiment, wherein the staining liquid comprises antigen retrieval agents capable of facilitating retrieval of antigen.
FB12. The method of any prior embodiment, wherein the staining liquid comprises detection agents that specifically label the target analyte in the sample.
FB13. The method of any prior embodiment, wherein the sample contact area of one or both plates comprise a storage site that contains blocking agents, wherein the blocking agents are configured to disable non-specific endogenous species in the sample to react with detection agents that are used to specifically label the target analyte.
FB14. The method of any prior embodiment, wherein the sample contact area of one or both plates comprise a storage site that contains deparaffinizing agents capable of removing paraffin in the sample.
FB15. The method of any prior embodiment, wherein the sample contact area of one or both plates comprise a storage site that contains permeabilizing agents capable of permeabilizing cells in the tissue sample that contain the target analyte.
FB16. The method of any prior embodiment, wherein the sample contact area of one or both plates comprise a storage site that contains antigen retrieval agents capable of facilitating retrieval of antigen.
FB17. The method of any prior embodiment, wherein the sample contact area of one or both plates comprise a storage site that contains detection agents that specifically label the target analyte in the sample.
FB18. The method of any prior embodiment, wherein the detection agent comprises dyes for a stain selected from the group consisting of: Acid fuchsin, Alcian blue 8 GX, Alizarin red S, Aniline blue WS, Auramine 0, Azocarmine B, Azocarmine G, Azure A, Azure B, Azure C, Basic fuchsine, Bismarck brown Y, Brilliant cresyl blue, Brilliant green, Carmine, Chlorazol black E, Congo red, C.I. Cresyl violet, Crystal violet, Darrow red, Eosin B, Eosin Y, Erythrosin, Ethyl eosin, Ethyl green, Fast green F C F, Fluorescein lsothiocyanate, Giemsa Stain, Hematoxylin, Hematoxylin & Eosin, Indigo carmine, Janus green B, Jenner stain 1899, Light green SF, Malachite green, Martius yellow, Methyl orange, Methyl violet 2B, Methylene blue, Methylene blue, Methylene violet, (Bernthsen), Neutral red, Nigrosin, Nile blue A, Nuclear fast red, Oil Red , Orange G, Orange II, Orcein, Pararosaniline, Phloxin B, Protargol S, Pyronine B, Pyronine , Resazurin, Rose Bengal, Safranine 0, Sudan black B, Sudan III, Sudan IV, Tetrachrome stain (MacNeal), Thionine, Toluidine blue, Weigert, Wright stain, and any combination thereof.
FB19. The method of any prior embodiment, wherein the detection agent comprises antibodies configured to specifically bind to protein analyte in the sample.
FB20. The method of any prior embodiment, wherein the detection agent comprises oligonucleotide probes configured to specifically bind to DNA and/or RNA in the sample.
FB21. The method of any prior embodiment, wherein the detection agent is labeled with a reporter molecule, wherein the reporter molecule is configured to provide a detectable signal to be read and analyzed.
FB22. The device of embodiment FB21, wherein the signal is selected from the group consisting of:
i. luminescence selected from photoluminescence, electroluminescence, and electrochemiluminescence;
ii. light absorption, reflection, transmission, diffraction, scattering, or diffusion;
iii. surface Raman scattering;
iv. electrical impedance selected from resistance, capacitance, and inductance;
v. magnetic relaxivity; and vi. any combination of i-v.
FB23. The method of any prior embodiment, wherein the sample contact area of one or both of the plates comprise a binding site that contains capture agents, wherein the capture agents are configured to bind to the target analyte on the surface of cells in the sample and immobilize the cells.
FB24. The method of any prior embodiment, before step (e), further comprising:
incubating the sample at the closed configuration for a period of time that is longer than the time it takes for the detection agent to diffuse across the layer of uniform thickness and the sample.
FB25. The method of any prior embodiment, before step (e), further comprising:
incubating the sample at the closed configuration at a predetermined temperature in the range of 30 ¨ 75 C.
FB26. The method of any prior embodiment, wherein the staining liquid comprises the transfer solution.
G. Dual Lens imaging system But nowadays dual cameras are more and more common on state-of-art smartphones, which offers more possibilities of smartphone based imaging. By using two cameras, two different areas of the sample can be imaged at the same time, which is equivalent to a much larger field of view. And what's more, each camera can be used to do microscopy imaging at a different resolution. For example, one camera can do microscopy with lower resolution but larger field of view to image large objects in sample and the other camera can do microscopy with higher resolution but smaller field of view to image small objects. This is useful when the sample for imaging has mixed small objects and large objects. Hence, it is highly desirable to provide the users the smartphone imaging system based on dual cameras.
Dual camera imaging system FIG. 19-A is the schematic illustration of the dual camera imaging system. The dual camera imaging system comprises a mobile computing device (e.g. smartphone) having two built-in camera modules, two external lenses, a QMAX device and light source. Each camera module has an internal lens and an image sensor. The QMAX device is located under the two camera modules. Each external lens is placed between QMAX device and its corresponding internal lens at the appropriate height where the sample in QMAX device can be clearly focused on the image sensor. Each external lens is aligned with its corresponding internal lens.
The light captured by the imaging sensor can be refracted from the specimen, emitted from the specimen, etc. The light captured by the imaging sensor covers visible wavelength and can illuminate on the sample in QMAX device from back or top side in a normal or oblique incidence angle.
Dual camera imaging system for large FOV imaging One embodiment is that the dual camera imaging system is used for large FOV
imaging.
In this embodiment, the images taken by both camera have the same scale or optical magnification. To achieve this, the focal length of external lens 1 fEi, the focal length of internal lens 1 fNi, the focal length of external lens 2 fE2 and the focal length of internal lens 2 fN2 satisfy the relationship: ¨ffNEli = ffNE22.
The distance between two cameras is chosen to an appropriate value so that the FOVs of both cameras have overlap. As shown in FIG. 19-B, the letter "A" represents the sample, due to the overlap between the FOVs of two cameras, some part of the letter "A" exist in both the FOV
of camera 1 and FOV of camera 2.
A further image processing step is used to merge the two images into one large image by matching the same feature shared by the two images taken by camera 1 and camera 2.
Dual camera imaging system for dual resolution imaging The lens-based imaging system has the intrinsic drawback that it has the trade-off between the size of FOV and resolution. To achieve large FOV, the resolution of the imaging system need to be sacrificed. This problem is more concerned when the sample has mixed small and large objects with significant different size scale. In order to image enough number of large objects the FOV need to be large enough, but that will lose the resolution to get the details of the small objects. To solve this problem, in this embodiment, the dual camera imaging system is used for achieve dual resolution imaging on a same sample, in which camera 1 (or 2) is used for low resolution and large FOV imaging and camera 2 ( or 1) is used for high resolution and small FOV
imaging.
The resolution of the imaging system depends on the optical magnification and the optical magnification is equal to the ratio of the focal length of the external lens to the focal length of the internal length. For example, in this embodiment, camera 1 is used for low resolution imaging and camera 2 is used for high resolution imaging, then the focal length of external lens 1 fEi, the focal length of internal lens 1 fNi, the focal length of external lens 2 fE2 and the focal length of internal lens 2 fN2 satisfy the relationship: ¨
ffNE1 < ffNE22.
The FOVs of both cameras can have overlap or no overlap.
As shown in FIG. 19-C, the sample image taken by camera 1 covers larger FOV
and contains more objects in a single FOV but cannot resolve the detail of the small objects. And the image taken by camera 2 covers a relatively small FOV and contains fewer objects in a single FOV but has higher resolution that can resolve the details in the small objects.
Examples of Present Invention Al. A dual lens imaging device, comprising:
a first external lens, a second external lens, a housing unit, and a card unit, wherein:
the housing unit is configured to accommodate the first and second external lenses and the card unit, and to connect the dual length imaging device with a mobile device;
the first and the second external lenses are configured to respectively align with two internal lenses in the mobile device; and the card unit is configured to accommodate a specimen card, which contains a sample, wherein the card unit is positioned between the external lenses and the internal lenses;
wherein the external lenses are configured to focus illuminating light that is refracted or emitted from the specimen card onto image sensors in the mobile device, allowing the image sensors to capture images of the sample.
Bl. A dual lens imaging system, comprising:
(a) the dual lens imaging device of embodiment Al, (b) the mobile device, which comprises hardware and software to capture and process images of the sample through the dual lens imaging device.
Cl. The device or system of any prior embodiments, wherein the specimen card is a QMAX
card.
02. The device or system of any prior embodiments, wherein the mobile device is a mobile communication device.
03. The device or system of any prior embodiments, wherein mobile device is a smart phone.
04. The device or system of any prior embodiments, wherein the mobile device comprises a light source, which provides light to the specimen card.
05. The device or system of any prior embodiments, wherein the two external lenses are configured to capture overlapping images that are at least partly overlapping.
06. The device or system or embodiment 05, wherein the overlapping images have the same resolution.
07. The device or system of embodiment 06, wherein the software is configured to process the overlapping images to generate a combined image of the sample.
08. The device or system of embodiment C5, wherein the overlapping images have the different resolutions.
09. The device or system of embodiment 08, wherein the software is configured to process the overlapping images illustrate specific portions of the image having lower resolution.
010. The device or system of any prior embodiment, wherein the two external lenses are configured to image two different locations of a sample area of the Q-Card.
C1 1. The device or system of any prior embodiment, wherein the two external lenses are configured to have different size of FoV (field of view from each other).
012. The device or system of any prior embodiment, wherein the two external lenses are configured to have different size of FoV (field of view from each other), and wherein the ratio of the two different of FoV is 1.1, 1.2, 1.5,2, 5, 10, 15, 20, 30, 50, 100, 200, 1000, or in a range of any value of the two. A preferred ratio is 1.2, 1.5, 2, 5, 10, 20, or in a range of any value of the two.
013. The device or system of any prior embodiment, wherein overlap of FoV of the two external lenses are configured to be around 1%, 5%, 10%, 20%, 50%, 60%, 70%, 80%, 90%, or a range between any two of these values.
014. The device or system of any prior embodiment, wherein the two external lenses are optically coupled with different optical filters and/or polarizers.
Other Embodiments An optical adaptor for imaging an sample using a hand-held imaging device that has a light source, a single camera, and a computer processor, comprising:
an enclosure;
a cavity within the enclosure; and a lever within the cavity, wherein the lever comprises at least one optical element and is configured to be moveable between a first position and a second position, wherein (i) in the first position, said imaging device is capable of imaging a sample in a bright field mode, and (ii) in the second position, said imaging device is capable of imaging the sample in a fluorescence excitation mode.
An optical adaptor for imaging an sample using a hand-held imaging device that has a light source, a single camera, and a computer processor, comprising:
an enclosure;
a lens arranged to provide a field of view for the camera;
a cavity within the enclosure for receiving the sample and positioning the sample within the field of view of the camera, wherein the lens is positioned to receive light refracted by or emitted by the sample when in the field of view of the camera; and a lever within the cavity, wherein the lever comprises at least one optical element and is configured to be moveable between a first position and a second position, wherein (i) in the first position, said imaging device is capable of imaging a sample in a bright field mode, and (ii) in the second position, said imaging device is capable of imaging the sample in a fluorescence excitation mode.
An optical adaptor for imaging an sample using a hand-held imaging device that has a light source, a single camera, and a computer processor, comprising:
an enclosure;
a cavity within the enclosure for receiving the sample and positioning the sample within a field of view of the camera; and a lever within the cavity, wherein the lever comprises at least one optical element and is configured to be moveable between a first position and a second position, wherein (i) in the first position, said imaging device is capable of imaging a sample in a bright field mode, and (ii) in the second position, said imaging device is capable of imaging the sample in a fluorescence excitation mode, and wherein the lever comprises a first planar region extending along a first plane and a second planar region laterally displaced along a first direction from the first planar region and extending along a second plane, the first plane being disposed at a different height along a second direction from the second plane, the second direction being orthogonal to the first direction.
An optical adaptor for imaging an sample using a hand-held imaging device that has a light source, a single camera, and a computer processor, comprising:
an enclosure;
a cavity within the enclosure for receiving the sample and positioning the sample within a field of view of the camera; and a lever within the cavity, wherein the lever comprises at least one optical element and is configured to be moveable between a first position and a second position, wherein (i) in the first position, said imaging device is capable of imaging a sample in a bright field mode, and (ii) in the second position, said imaging device is capable of imaging the sample in a fluorescence excitation mode, and wherein the lever comprises a first planar region extending along a first plane and a second planar region laterally displaced along a first direction from the first planar region and extending along a second plane, the first plane being disposed at a different height along a second direction from the second plane, the second direction being orthogonal to the first direction, and wherein the first planar region comprises at least one optical element, and the second planar region comprises at least one optical element.
An optical adaptor for imaging an sample using a hand-held imaging device that has a light source, a single camera, and a computer processor, comprising:
an enclosure;
a cavity within the enclosure; and a lever within the cavity, wherein the lever comprises at least one optical element and is configured to be moveable between at least three different positions, wherein (i) in a first position, said imaging device is capable of imaging a sample in a bright field mode, (ii) in a second position, said imaging device is capable of imaging the sample in a fluorescence excitation mode, and (iii) in a third position, said imaging device is capable of measuring optical absorption of the sample.
An optical adaptor for imaging an sample using a hand-held imaging device that has a light source, a single camera, and a computer processor, comprising:
an enclosure;
a lens configured to provide a field of view for the camera;
a cavity within the enclosure for receiving the sample and positioning the sample within the field of view of the camera;
an aperture within the enclosure, wherein the aperture is arranged to receive source light from the light source for illuminating the sample; and a lever within the cavity, wherein the lever comprises at least one optical element and is configured to be moveable between a first position and a second position, wherein (i) in a first position, said imaging device is capable of imaging a sample in a bright field mode, (ii) in a second position, said imaging device is capable of imaging the sample in a fluorescence excitation mode, wherein in the fluorescence excitation mode, the lens is arranged to receive light emitted by the sample when the sample is illuminated by the source light.
An optical adaptor for imaging an sample using a smart phone that has a light source, a single camera, and a computer processor, comprising:
an enclosure;
a lens configured to provide a field of view for the camera;
a cavity within the enclosure for receiving the sample and positioning the sample within the field of view of the camera; and a lever within the cavity, wherein the lever comprises at least one optical element and is configured to be moveable between a first position and a second position, wherein (i) in a first position, said imaging device is capable of imaging a sample in a bright field mode, and (ii) in a second position, said imaging device is capable of imaging the sample in a fluorescence excitation mode.
An optical assembly attachable to a hand-held electronic device having a light source, a camera, and a computer processor, wherein the optical assembly is configured to enable microscopic imaging of a sample by the camera with illumination of the sample by light from the light source, the optical assembly comprising:
an enclosure;
a cavity within the enclosure;
a lens configured to provide a microscopic field of view for the camera; and moveable arm within the cavity, wherein the moveable arm is configurable to switch between a first position and a second position, wherein when the moveable arm is in the first position, the optical assembly is in a bright field mode, and when the moveable arm is in the second position, the optical assembly is in a fluorescence excitation mode.
The optical assembly of any embodiments, wherein the enclosure comprises:
a sample receptacle region within the cavity; and a slot on a side of the enclosure, wherein the slot is arranged to receive a sample substrate within the sample receptacle region and position the sample within the field of view of the camera.
The optical assembly of embodiments, further comprising a first set of one or more optical elements arranged to receive light entering from a first aperture in the enclosure corresponding to the light source and to redirect the light entering from the first aperture along a first pathway toward a second aperture in the enclosure corresponding to the camera to provide bright field illumination of the sample when the moveable arm is in the first position.
The optical assembly of embodiments, wherein the first set of one or more optical elements comprises a first right angle mirror and a second right angle mirror, wherein the first right angle mirror and the second right angle mirror are in the first pathway and are arranged to reflect the light from the light source to be normally incident into the camera, The optical assembly of embodiments, wherein the light source is a point source to achieve interference imaging of transparent samples via illuminating the sample by a same wavefront.
The optical assembly of embodiments, further comprising a second set of one or more optical elements mechanically coupled to the movable arm and arranged to receive light entering from the first aperture and redirect the light entering from the first aperture along a second pathway to obliquely illuminate the sample to provide fluorescence illumination of the sample when the moveable arm is in the second position, The optical assembly of embodiments, wherein the oblique angle is larger than a collecting angle of the lens configured to provide the field of view of the camera.
The optical assembly of embodiments, wherein the second set of one or more optical elements includes a mirror and an optical absorber, wherein the mirror reflects light to obliquely illuminate the sample and the optical absorber absorbs extraneous light from the first aperture that would otherwise pass through the second aperture of the enclosure and overwhelm the camera in the fluorescence excitation mode.
The optical assembly of embodiments, wherein the absorber absorbs light that is not incident on the mirror after going through the first aperture, wherein the light absorber is a thin-film light absorber.
The optical assembly of embodiments, further comprising a third set of one or more optical elements arranged to receive light entering from the first aperture and redirect the light entering into the second aperture in the movable arm and going along the first pathway toward a light diffuser on the movable arm to illuminate the sample in normal direction to measure the optical absorption of the sample.
The optical assembly of embodiments, wherein the third set of one or more optical elements includes a light diffuser, a first right angle mirror and a second right angle mirror, wherein the first right angle mirror and the second right angle mirror are in the first pathway and are arranged to reflect the light from the light source toward the light diffuser and then to be normally incident into the camera;
The optical assembly of embodiments, wherein the light diffuser is a semi-opaque diffuser with opacity in the range of 10% to 90%.
The optical assembly of embodiments, further comprising a rubber door to cover the sample receptacle to prevent ambient light from entering into the cavity.
The optical assembly of any of the preceding any embodiments, wherein the light source and the camera are positioned on the same side of the hand-held electronic device at a fixed distance to one another.
A system comprising: the optical assembly of any of the preceding any embodiments, and a mobile phone attachment comprising a first side configured to couple to the optical assembly and a second opposite side configured to couple to the hand-held electronic device, wherein the hand-held electronic device is a mobile phone.
The system of any embodiments, wherein the mobile phone attachment is exchangeable to provide attachment to different sized mobile phones.
The system of any embodiments, wherein a size of the mobile phone attachment is adjustable.
An optical assembly for a hand-held mobile electronic device, the optical assembly comprising:
an enclosure;
a cavity within the enclosure;
a plurality of optical elements within the cavity, wherein the plurality of optical elements are arranged to receive light entering from a first aperture in the enclosure and to redirect the light entering from the first aperture along a first pathway toward a second aperture in the enclosure;
a moveable arm configurable in at least two different positions within the enclosure, a moveable arm configurable in at least three different positions within the enclosure, wherein the moveable arm comprises a light reflector portion to reflect light, wherein the moveable arm comprise a light diffuser to homogenize the light and break the coherence of the light, wherein the moveable arm comprise an aperture aligned with the entrance aperture in the enclosure, wherein, when the moveable arm is in a first position within the enclosure, the light reflector portion is positioned between an entrance aperture in the enclosure and the plurality of optical elements such that the light reflector portion blocks the light entering from the first opening from being incident on the plurality of optical elements, and wherein, when the moveable arm is in a second position within the enclosure, the light entering from the first opening is incident on the plurality of optical elements, and wherein when the moveable arm is in a third position within the enclosure, the light entering from the first opening goes through an aperture on the moveable arm and then is incident on the light diffuser;
The optical assembly of any embodiments, comprising a slot on a side of the enclosure, wherein the slot is arranged to receive a sample substrate such that:
when the sample substrate is fully inserted within the slot and the moveable arm is in the second position within the enclosure, the first pathway intersects the sample substrate; and when the sample substrate is fully inserted within the slot and moveable arm is in the first position within the enclosure, light reflected by the light reflector portion is redirected to the sample substrate; and when the sample substrate is fully inserted within the slot and moveable arm is the third position within the enclosure, light goes along the first pathway toward a light diffuser and then illuminate on the sample substrate.
The optical assembly of any embodiments, wherein the moveable arm comprises a light absorber portion to absorb light that is not incident on the mirror after going through the first aperture.
The optical assembly of any embodiments, wherein the moveable arm comprises:
a first receptacle positioned above the light reflector portion; and an optical filter seated in the receptacle; and a second receptacle positioned above the aperture portion; and a optical filter seated in the receptacle.
The optical assembly of any embodiments, wherein, when the moveable arm is in the first position, the optical filter seated in the receptacle is positioned to receive light entering from the first aperture in the enclosure; and when the moveable arm is in the third position, the optical filter seated in the receptacle is positioned to receive light entering from the first aperture in the enclosure.
The optical assembly of any embodiments, wherein, when the moveable arm is in the first position, the optical filter seated in the receptacle overlaps a region in which a portion of the sample substrate is located when the sample substrate is fully inserted within the slot.
A system comprising:
the optical assembly of any embodiments; and a mobile phone attachment comprising a first side configured to couple to the optical assembly and comprising a second opposite side configured to couple to a mobile phone, wherein a size of the mobile phone attachment is adjustable.
An optical assembly attachable to a hand-held electronic device having a light source, a camera, and a computer processor, wherein the optical assembly is configured to enable microscopic imaging of a sample by the camera with illumination of the sample by light from the light source, the optical assembly comprising:
a lens configured to provide a microscopic field of view for the camera;
a receptacle for receiving the sample and positioning the sample within the microscopic field of view; and an optical fiber configured to receive the light from the light source and to illuminate the receptacle.
The optical assembly of any embodiments wherein, when the optical assembly is attached to the hand-held electronic device, the lens and the camera define an optical axis, and wherein the optical fiber circumscribes the optical axis.
The optical assembly of any embodiments wherein the optical fiber is ring-shaped.
The optical assembly of any embodiments wherein the optical fiber is a side-emitting fiber.
The optical assembly of any embodiments wherein the optical assembly comprises an enclosure defining the receptacle, wherein the ring-shaped fiber sits in a groove of the enclosure, wherein the enclosure comprises an aperture configured to align with the light source and both end faces of the ring-shape fiber to receive light from the light source.
The optical assembly of any embodiments, wherein the light emits from the side of the ring-shape fiber to illuminate the sample area right under the camera in the optical axis.
The optical assembly of any embodiments, wherein the optical assembly comprises an enclosure defining the receptacle, wherein the enclosure comprises a first aperture configured to align with the light source, and a first end face of the optical fiber is positioned in the first aperture to receive light from the light source.
The optical assembly of any embodiments wherein the enclosure comprises a second aperture configured to align with the camera, and wherein the optical fiber comprises a first end positioned in the first aperture and comprises a second end positioned in the second aperture.
The optical assembly of any embodiments wherein at least one of the first end face of the optical fiber and a second end face of the optical fiber is matted.
The optical assembly of any embodiments wherein when the optical assembly is attached to the hand-held electronic device, the optical fiber is tilted with respect to the light source, and wherein a second end face of the optical fiber is arranged to illuminate a region of the sample located directly beneath the lens.
The optical assembly of any embodiments wherein the optical assembly comprises an enclosure defining the receptacle, the enclosure comprises a groove, and the optical fiber is arranged in the groove.
An optical assembly attachable to a hand-held electronic device having a light source, a camera, and a computer processor, wherein the optical assembly is configured to enable microscopic fluorescence imaging of a sample by the camera with illumination of the sample by light from the light source, the optical assembly comprising:
a lens configured to provide a microscopic field of view for the camera;
a receptacle for receiving the sample and positioning the sample within the microscopic field of view;
a mirror off-set from an optical axis of the lens and positioned to reflect light from the light source and illuminate the sample over a range of oblique angles with respect to the optical axis;
and a wavelength filter positioned between the sample and the camera to pass fluorescence emitted by the sample in response to the oblique illumination.
The optical assembly of any embodiments wherein the lens is positioned on a front-side of the sample and the mirror is positioned to obliquely illuminate the sample from a back-side of the sample, wherein the oblique angle is larger than a collecting angle of the lens.
The optical assembly of any embodiments further comprising an optical absorber positioned on the optical axis adjacent the mirror to absorb light from the light source not reflected by the mirror.
The optical assembly of any embodiments wherein the mirror and the optical absorber are mounted on a common structure and tilted with respect to one another.
The optical assembly of any embodiments, further comprising a second wavelength filter positioned in a path of the illumination light between the light source and the mirror to select certain wavelengths for illuminating the sample.
The optical assembly of any of the preceding any embodiments, wherein the sample is supported by a sample holder comprising a planar structure, and wherein the receptacle is configured to position the planar structure to extend partially into a path of illumination light from the light source to couple illumination light into the planar structure.
The optical assembly of any embodiments 6, wherein the receptacle is configured to position the planar structure such that the path of illumination light is incident on an edge of the planar structure, wherein the edge extends along a plane that is normal to a plane comprising the field of view.
The optical assembly of any embodiments wherein the mirror is arranged to reflect the light to partially obliquely illuminate the sample from a back side of the planar structure and to partially illuminate an edge of the planar structure to couple illumination light into the planar structure.
The optical assembly of any embodiments further comprising a rubber door to cover the sample receptacle to prevent ambient light from entering the optical assembly and entering the camera.
The optical assembly of any embodiments, wherein the planar structure is configured to waveguide the coupled illumination light to the sample to illuminate the sample and cause the sample to emit fluorescence.
The optical assembly of any embodiments further comprising the sample holder, The optical assembly of any embodiments 6, wherein the sample is a liquid sample and the sample holder comprises first and second plates sandwiching the liquid sample.
The optical assembly of any of the preceding any embodiments, wherein the lens, the receptacle, the mirror, and the wavelength filter are supported in a common optical box and further comprising an exchangeable holder frame for attaching the optical box to the hand-held electronic device.
.. The optical assembly of any embodiments, wherein the light source and the camera are positioned on the same side of the hand-held electronic device and at fixed distance to one another.
The optical assembly of any embodiments, wherein the hand-held electronic device is a smart phone.
An apparatus comprising the optical assembly of any of the preceding any embodiments and the hand-held electronic device.
An optical assembly attachable to a hand-held electronic device having a light source, a camera, and a computer processor, the optical assembly configured to enable microscopic fluorescence imaging of a sample by the camera with illumination of the sample by light from the light source, the optical assembly comprising:
a lens configured to provide a microscopic field of view for the camera;
a receptacle for receiving the sample and positioning the sample within the microscopic field of view, wherein the sample is supported by a sample holder comprising a planar structure, and wherein the receptacle is configured to position the planar structure to extend partially into a path of illumination light from the light source to couple illumination light into the planar structure and cause the sample to emit fluorescence; and a wavelength filter positioned between the sample and the camera to pass fluorescence emitted by the sample in response to the illumination.
The optical assembly of any embodiments further comprising a rubber door to cover the sample receptacle to prevent ambient light entering the optical assembly through the receptacle.
The optical assembly of any embodiments wherein the planar structure is configured to waveguide the coupled illumination light to the sample to illuminate the sample and cause the sample to emit the fluorescence.
The optical assembly of any embodiments further comprising the sample holder, The optical assembly of any embodiments wherein the sample is a liquid sample and the sample holder comprises first and second plates sandwiching the liquid sample.
The optical assembly of any embodiments, further comprising a second wavelength filter positioned in the path of the illumination light between the light source and the portion of the sample holder partially extending into the path of the light.
The optical assembly of any of the preceding any embodiments, wherein the lens, the receptacle, and the wavelength filter are supported in a common optical box and further comprising an exchangeable holder frame for attaching the optical box to the hand-held electronic device.
The optical assembly of any embodiments wherein the light source and the camera are positioned on the same side of the hand-held electronic device at a fixed distance to one another.
The optical assembly of any embodiments, wherein the hand-held electronic device is a smart phone.
An apparatus comprising the optical assembly of any of the preceding any embodiments and the hand-held electronic device.
An optical assembly attachable to a hand-held electronic device having a light source, a first camera module, a second camera module, and a computer processor, wherein the optical assembly is configured to enable microscopic imaging of a sample by the first camera and by the second camera with illumination of the sample by light from the light source, the optical assembly comprising:
a first assembly lens configured to provide a first microscopic field of view for the first camera module;
a second assembly lens configured to provide a second microscopic field of view for the second camera module; and a receptacle for receiving the sample and positioning the sample within the first microscopic field of view and within the second microscopic field of view.
The optical assembly of any embodiments, wherein the first camera module comprises a first internal lens and the second camera module comprises a second internal lens, wherein a first optical magnification provided by the first assembly lens and the first internal lens is the same as a second optical magnification provided by the second assembly lens and the second internal lens.
The optical assembly of any embodiments, wherein a first ratio of a focal length of the first assembly lens to a focal length of the first internal lens is equal to a second ratio of a focal length of the second assembly lens to a focal length of the second internal lens.
The optical assembly of any embodiments, wherein a first image resolution provided by the first camera module and the first assembly lens is the same as a second image resolution provided by the second camera module and the second assembly lens.
The optical assembly of any embodiments, wherein the first camera module comprises a first internal lens and the second camera module comprises a second internal lens, wherein a first optical magnification provided by the first assembly lens and the first internal lens is different from a second optical magnification provided by the second assembly lens and the second internal lens.
The optical assembly of any embodiments, wherein a first ratio of a focal length of the first assembly lens to a focal length of the first internal lens is less than a second ratio of a focal length of the second assembly lens to a focal length of the second internal lens.
The optical assembly of any embodiments, wherein a first image resolution provided by the first camera module and the first assembly lens is less than a second image resolution provided by the second camera module and the second assembly lens.
The optical assembly of any of the preceding any embodiments, wherein the first microscopic field of view overlaps with the second microscopic field of view.
The optical assembly of any embodiments, wherein an amount of overlap of the first microscopic field of view with the second microscopic field of view is between 1% and 90%.
The optical assembly of any of any embodiments , wherein the first microscopic field of view does not overlap with the second microscopic field of view.
The optical assembly of any of the preceding any embodiments, wherein each of the first assembly lens and the second assembly lens is arranged to receive light scattered by or emitted by the sample.
The optical assembly of any of the preceding any embodiments, wherein the first microscopic field of view is less than the second microscopic field of view.
The optical assembly of any of the preceding any embodiments, wherein an angular field of view of the first assembly lens is less than an angular field of view of the second assembly lens.
The optical assembly of any embodiments, wherein a ratio of the angular field of view of the first assembly lens to the angular field of the second assembly lens is between 1.1 and 1000.
The optical assembly of any of the preceding any embodiments, comprising:
a first optical filter arranged in a first illumination path to or from the first assembly lens;
and a second optical filter arranged in a second illumination path to or from the second assembly lens.
The optical assembly of any embodiments, wherein the first optical filter is configured to filter a first range of wavelengths, the second optical filter is configured to filter a second range of wavelengths, and the first range of wavelengths is different from the second range of wavelengths.
The optical assembly of any of the preceding any embodiments, comprising:
a first polarizer arranged in a first illumination path to or from the first assembly lens; and a second polarizer arranged in a second illumination path to or from the second assembly lens.
The optical assembly of any embodiments, wherein the first polarizer and the second polarizer have different polarization dependent light transmission and blocking properties.
An apparatus comprising the optical assembly of any of the preceding any embodiments and the hand-held electronic device.
The apparatus of any embodiments, wherein the hand-held electronic device is a smart phone.
The apparatus of any embodiments, wherein the hand-held electronic device is configured to computationally merge a first image obtained from the first camera module with a second image obtained from the second camera module.
An imaging method comprising:
compressing a sample between two plates, wherein the two plates are separated from one another by an array of spacers, at least one of which has a reference mark;
acquiring multiple images of the sample using an imaging system comprising a camera and at least one lens, wherein each image corresponds to a different object plane within a thickness of the sample;
computationally analyzing each image to determine information about the corresponding object plane based on one or more of the reference marks; and computationally constructing a three-dimensional image of the sample based on the multiple images and the information about the corresponding object planes.
The imaging method of any embodiments, wherein the determined information about the corresponding object plane comprises a depth of the object plane relative to imaging system.
The imaging method of any embodiments of any embodiments 2, wherein at least some of the spacers each have a reference mark.
The imaging method of any embodiments, wherein the determined information about the corresponding object plane comprises a depth and an orientation of the object plane relative to imaging system.
The imaging method of any of the preceding any embodiments, where the computational analyzing of each image comprises determining a degree of defocus of one or more of the reference marks.
The imaging method of any embodiments, where the computational analyzing of each image comprises determining a depth for each of multiple ones of the reference marks based on a degree of defocus for each such reference mark and determining a depth and an orientation of the corresponding object plane relative to the imaging system based on the determined depths of the reference marks.
The imaging method of any of the preceding any embodiments, wherein the references marks are not rotationally symmetric with respect to an axis perpendicular to at least one of the plates.
The imaging method of any embodiments, wherein the computational analyzing of each image comprises determining a rotational orientation of one or more of the reference marks about the axis relative to the imaging system.
The imaging method of any of the preceding any embodiments, wherein the computational analyzing of each image comprising comparing image information about the reference marks to a priori knowledge about the reference marks.
The imaging method of any embodiments, wherein the a priori knowledge about the reference marks is based on one or more of a shape of each reference mark and a location of each reference mark relative to the plates.
The imaging method of any of the preceding any embodiments, wherein the spacers are pillars.
The imaging method of any of the preceding any embodiments, wherein the acquiring of the multiple images comprises moving one or more components of the imaging system relative to the plates sandwiching the sample.
The imaging method of any of the preceding any embodiments, wherein the computational constructing of the three-dimensional image comprises processing each acquired image to remove out-of-focus features.
The imaging method of any embodiments, wherein the processing of each acquired image to remove out-of-focus features comprises using a band-pass filter.
The imaging method of any of the preceding any embodiments, where the acquired images correspond to interference images formed by combining light from the sample with reference light not directed to the sample on the camera.
An imaging apparatus comprising:
an imaging system comprising a camera and at least one lens;
a sample holder for supporting a sample cartridge relative to the imaging system, the sample cartridge comprising two plates are separated from one another by an array of spacers, at least one of which has a reference mark, wherein a sample to be imaged is configured to be compressed between the two plates; and a processing and control system coupled to the sample holder and the camera and configured to acquire multiple images of the sample using the imaging system, wherein each image corresponds to a different object plane within a thickness of the sample, and wherein the processing and control system is further configured to:
computationally analyze each image to determine information about the corresponding object plane based on one or more of the reference marks; and computationally construct a three-dimensional image of the sample based on the multiple images and the information about the corresponding object planes.
The imaging apparatus of any embodiments, wherein the determined information about the corresponding object plane comprises a depth of the object plane relative to imaging system.
The imaging apparatus of any embodiments or, wherein at least some of the spacers each have a reference mark.
The imaging apparatus of any embodiments, wherein the determined information about the corresponding object plane comprises a depth and an orientation of the object plane relative to imaging system.
The apparatus of any of the preceding any embodiments, where the computational analyzing of each image comprises determining a degree of defocus of one or more of the reference marks.
The apparatus of any embodiments 20, wherein the computational analyzing of each image comprises determining a depth for each of multiple ones of the reference marks based on a degree of defocus for each such reference mark and determining a depth and an orientation of the corresponding object plane relative to the imaging system based on the determined depths of the reference marks.
.. The apparatus of any of the preceding any embodiments, wherein the references marks are not rotationally symmetric with respect to an axis perpendicular to at least one of the plates.
The apparatus of any embodiments, wherein the computational analyzing of each image comprises determining a rotational orientation of one or more of the reference marks about the axis relative to the imaging system.
The apparatus of any of the preceding any embodiments, wherein the computational analyzing of each image comprising comparing image information about the reference marks to a priori knowledge about the reference marks.
The apparatus of any embodiments, wherein the a priori knowledge about the reference marks is based on one or more of a shape of each reference mark and a location of each reference mark relative to the plates.
The apparatus of any of the preceding any embodiments, wherein the spacers are pillars.
The apparatus of any of the preceding any embodiments, wherein the control system is configured to move one or more components of the imaging system relative to the plates sandwiching the sample to acquire the multiple images.
The apparatus of any of the preceding any embodiments, wherein the computational constructing of the three-dimensional image comprises processing each acquired image to remove out-of-focus features.
The apparatus of any embodiments wherein the processing of each acquired image to remove out-of-focus features comprises using a band-pass filter.
The apparatus of any of the preceding any embodiments, wherein where the acquired images correspond to interference images formed by combining light from the sample with reference light not directed to the sample on the camera.
More Other Embodiments The present invention includes a variety of embodiments, which can be combined in multiple ways as long as the various components do not contradict one another.
The embodiments should be regarded as a single invention file: each filing has other filing as the references and is also referenced in its entirety and for all purpose, rather than as a discrete independent. These embodiments include not only the disclosures in the current file, but also the documents that are herein referenced, incorporated, or to which priority is claimed.
(1) Definitions The terms used in describing the devices, systems, and methods herein disclosed are defined in the current application, or in PCT Application (designating U.S.) Nos.
PCT/U52016/045437 and PCT/U50216/051775, which were respectively filed on August 10, 2016 and September 14, 2016, US Provisional Application No. 62/456065, which was filed on February 7, 2017, US Provisional Application No. 62/426065, which was filed on February 8, 2017, US Provisional Application No. 62/456504, which was filed on February 8, 2017, all of which applications are incorporated herein in their entireties for all purposes.
The terms "CROF Card (or card)", "COF Card", "QMAX-Card", "Q-Card", "CROF
device", "COF device", "QMAX-device", "CROF plates", "COF plates", and "QMAX-plates"
are interchangeable, except that in some embodiments, the COF card does not comprise spacers;
and the terms refer to a device that comprises a first plate and a second plate that are movable relative to each other into different configurations (including an open configuration and a closed configuration), and that comprises spacers (except some embodiments of the COF
card) that regulate the spacing between the plates. The term "X-plate" refers to one of the two plates in a CROF card, wherein the spacers are fixed to this plate. More descriptions of the COF Card, CROF
Card, and X-plate are given in the provisional application serial nos.
62/456065, filed on February 7, 2017, which is incorporated herein in its entirety for all purposes.
(2) Q-Card, Spacer and Uniform Sample thickness The devices, systems, and methods herein disclosed can include or use Q-cards, spacers, and uniform sample thickness embodiments for sample detection, analysis, and quantification. In some embodiments, the Q-card comprises spacers, which help to render at least part of the sample into a layer of high uniformity. The structure, material, function, variation and dimension of the spacers, as well as the uniformity of the spacers and the sample layer, are herein disclosed, or listed, described, and summarized in PCT Application (designating U.S.) Nos.
PCT/U52016/045437 and PCT/U50216/051775, which were respectively filed on August 10, 2016 and September 14, 2016, US Provisional Application No. 62/456065, which was filed on February 7, 2017, US Provisional Application No. 62/426065, which was filed on February 8, 2017, US Provisional Application No. 62/456504, which was filed on February 8, 2017, all of which applications are incorporated herein in their entireties for all purposes.
(3) Hinges, Opening Notches, Recessed Edge and Sliders The devices, systems, and methods herein disclosed can include or use Q-cards for sample detection, analysis, and quantification. In some embodiments, the Q-card comprises hinges, notches, recesses, and sliders, which help to facilitate the manipulation of the Q card and the measurement of the samples. The structure, material, function, variation and dimension of the hinges, notches, recesses, and sliders are herein disclosed, or listed, described, and summarized in PCT Application (designating U.S.) Nos. PCT/U52016/045437 and PCT/U50216/051775, which were respectively filed on August 10, 2016 and September 14, 2016, US Provisional Application No. 62/456065, which was filed on February 7, 2017, US Provisional Application No. 62/426065, which was filed on February 8, 2017, US Provisional Application No.
62/456504, which was filed on February 8, 2017, all of which applications are incorporated herein in their entireties for all purposes.
(4) Q-Card, sliders, and smartphone detection system The devices, systems, and methods herein disclosed can include or use Q-cards for sample detection, analysis, and quantification. In some embodiments, the Q-cards are used together with sliders that allow the card to be read by a smartphone detection system. The structure, material, function, variation, dimension and connection of the Q-card, the sliders, and the smartphone detection system are herein disclosed, or listed, described, and summarized in PCT Application (designating U.S.) Nos. PCT/U52016/045437 and PCT/U50216/051775, which were respectively filed on August 10, 2016 and September 14, 2016, US
Provisional Application No. 62/456065, which was filed on February 7, 2017, US Provisional Application No. 62/426065, which was filed on February 8, 2017, US Provisional Application No. 62/456504, which was filed on February 8, 2017, all of which applications are incorporated herein in their entireties for all purposes.
In some embodiments of QMAX, the sample contact area of one or both of the plates comprises a compressed open flow monitoring surface structures (MSS) that are configured to monitoring how much flow has occurred after COF. For examples, the MSS
comprises, in some embodiments, shallow square array, which will cause friction to the components (e.g. blood cells in a blood) in a sample. By checking the distributions of some components of a sample, one can obtain information related to a flow, under a COF, of the sample and its components.
The depth of the MSS can be 1/1000, 1/100, 1/100, 1/5, 1/2 of the spacer height or in a range of any two values, and in either protrusion or well form.
(5) Detection methods The devices, systems, and methods herein disclosed can include or be used in various types of detection methods. The detection methods are herein disclosed, or listed, described, and summarized in PCT Application (designating U.S.) Nos. PCT/U52016/045437 and PCT/U50216/051775, which were respectively filed on August 10, 2016 and September 14, 2016, US Provisional Application No. 62/456065, which was filed on February 7, 2017, US Provisional Application No. 62/426065, which was filed on February 8, 2017, US Provisional Application No.
62/456504, which was filed on February 8, 2017, all of which applications are incorporated herein in their entireties for all purposes.
(6) Labels The devices, systems, and methods herein disclosed can employ various types of labels that are used for analytes detection. The labels are herein disclosed, or listed, described, and summarized in PCT Application (designating U.S.) Nos. PCT/U52016/045437 and PCT/U50216/051775, which were respectively filed on August 10, 2016 and September 14, 2016, US Provisional Application No. 62/456065, which was filed on February 7, 2017, US Provisional Application No. 62/426065, which was filed on February 8, 2017, US Provisional Application No.
62/456504, which was filed on February 8, 2017, all of which applications are incorporated herein in their entireties for all purposes.
(7) Analytes The devices, systems, and methods herein disclosed can be applied to manipulation and detection of various types of analytes (including biomarkers). The analytes and are herein disclosed, or listed, described, and summarized in PCT Application (designating U.S.) Nos.
PCT/U52016/045437 and PCT/U50216/051775, which were respectively filed on August 10, 2016 and September 14, 2016, US Provisional Application No. 62/456065, which was filed on February 7, 2017, US Provisional Application No. 62/426065, which was filed on February 8, 2017, US Provisional Application No. 62/456504, which was filed on February 8, 2017, all of which applications are incorporated herein in their entireties for all purposes.
(8) Applications (field and samples) The devices, systems, and methods herein disclosed can be used for various applications (fields and samples). The applications are herein disclosed, or listed, described, and summarized in PCT Application (designating U.S.) Nos. PCT/U52016/045437 and PCT/U50216/051775, which were respectively filed on August 10, 2016 and September 14, 2016, US
Provisional Application No. 62/456065, which was filed on February 7, 2017, US Provisional Application No.
62/426065, which was filed on February 8, 2017, US Provisional Application No.
62/456504, which was filed on February 8, 2017, all of which applications are incorporated herein in their entireties for all purposes.
(9) Cloud The devices, systems, and methods herein disclosed can employ cloud technology for data transfer, storage, and/or analysis. The related cloud technologies are herein disclosed, or listed, described, and summarized in PCT Application (designating U.S.) Nos.
PCT/U52016/045437 and PCT/U50216/051775, which were respectively filed on August 10, 2016 and September 14, 2016, US Provisional Application No. 62/456065, which was filed on February 7, 2017, US Provisional Application No. 62/426065, which was filed on February 8, 2017, US Provisional Application No. 62/456504, which was filed on February 8, 2017, all of which applications are incorporated herein in their entireties for all purposes.
Additional Notes Further examples of inventive subject matter according to the present disclosure are described in the following enumerated paragraphs.
It must be noted that as used herein and in the appended claims, the singular forms "a", "an", and "the" include plural referents unless the context clearly dictates otherwise, e.g., when the word "single" is used. For example, reference to "an analyte" includes a single analyte and multiple analytes, reference to "a capture agent" includes a single capture agent and multiple capture agents, reference to "a detection agent" includes a single detection agent and multiple detection agents, and reference to "an agent" includes a single agent and multiple agents.
As used herein, the terms "adapted" and "configured" mean that the element, component, or other subject matter is designed and/or intended to perform a given function. Thus, the use of the terms "adapted" and "configured" should not be construed to mean that a given element, component, or other subject matter is simply "capable of" performing a given function. Similarly, subject matter that is recited as being configured to perform a particular function may additionally or alternatively be described as being operative to perform that function.
As used herein, the phrase, "for example," the phrase, "as an example," and/or simply the terms "example" and "exemplary" when used with reference to one or more components, features, details, structures, embodiments, and/or methods according to the present disclosure, are intended to convey that the described component, feature, detail, structure, embodiment, and/or method is an illustrative, non-exclusive example of components, features, details, structures, embodiments, and/or methods according to the present disclosure. Thus, the described component, feature, detail, structure, embodiment, and/or method is not intended to be limiting, required, or exclusive/exhaustive; and other components, features, details, structures, embodiments, and/or methods, including structurally and/or functionally similar and/or equivalent components, features, details, structures, embodiments, and/or methods, are also within the scope of the present disclosure.
As used herein, the phrases "at least one of" and "one or more of," in reference to a list of more than one entity, means any one or more of the entity in the list of entity, and is not limited to at least one of each and every entity specifically listed within the list of entity. For example, "at least one of A and B" (or, equivalently, "at least one of A or B," or, equivalently, "at least one of A
and/or B") may refer to A alone, B alone, or the combination of A and B.
As used herein, the term "and/or" placed between a first entity and a second entity means one of (1) the first entity, (2) the second entity, and (3) the first entity and the second entity.
Multiple entity listed with "and/or" should be construed in the same manner, i.e., "one or more" of the entity so conjoined. Other entity may optionally be present other than the entity specifically identified by the "and/or" clause, whether related or unrelated to those entities specifically identified.
Where numerical ranges are mentioned herein, the invention includes embodiments in which the endpoints are included, embodiments in which both endpoints are excluded, and embodiments in which one endpoint is included and the other is excluded. It should be assumed that both endpoints are included unless indicated otherwise. Furthermore, unless otherwise indicated or otherwise evident from the context and understanding of one of ordinary skill in the art.
In the event that any patents, patent applications, or other references are incorporated by reference herein and (1) define a term in a manner that is inconsistent with and/or (2) are otherwise inconsistent with, either the non-incorporated portion of the present disclosure or any of the other incorporated references, the non-incorporated portion of the present disclosure shall control, and the term or incorporated disclosure therein shall only control with respect to the reference in which the term is defined and/or the incorporated disclosure was present originally.
OTHER EMBODIMENTS
It is to be understood that while the invention has been described in conjunction with the detailed description thereof, the foregoing description is intended to illustrate and not limit the .. scope of the invention, which is defined by the scope of the appended claims.
An optics insert 134 is fitted into the top of optics chamber 132C with an exit aperture 134L
and an entrance aperture 134C in it aligning with light source 1L and camera 1C (shown in FIG.
10-B) in smartphone 1. A lens 133 is mounted in entrance aperture 134C in optics insert 134 and configured so that the sample area on colorimetric sample card 137 inserted into receptacle slot 136 is located within the working distance of the camera 1C (shown in FIG. 10-B). A large-core optical fiber 135 is mounted in the exit aperture 134L with tilted angle. Both end faces of fiber 135 are made to have matte finish. Fiber 135 whose operation as the illumination optics in device 13 .. is described below in FIG. B3.
FIG. 12 is the schematic sectional view showing details of system 10 reading a colorimetric card, and particularly of device 13. This figure illustrates the functionality of the elements that were described above with reference to FIG. 11. Light source 1L emits light beam B1 away from smartphone 1. Beam B1 is coupled into the fiber 135 through the first end face and travels along the direction of fiber 135 and is emitted out from the second end face to become beam B2. Beam B2 illuminates the sample area of colorimetric sample card 137 right under the camera 1C from front side to create uniform illumination. Because the end faces of fiber 135 are made to be matte and diffusive finish, beam B2 can be regarded as emitting from an area light source, which helps to create a more uniform illumination. The tilt angle in which the fiber 135 is mounted is set to .. make the central tray of beam B2 illuminates on the area on the sample card 137 right under the camera. Lens 11 creates an image of the sample area on the image sensor plane of camera 1C.
Smartphone 1 captures and processes the image to analyze the color information in the image to quantify the color change of the colorimetric assay.
C. Optical adaptor for colorimetric reader attachment to smartphone (fiber-ring illumination) Colorimetric assay is a very powerful technique having wide applications in health monitoring, disease diagnostic, chemical analysis and so on. The key factor to get the accurate colorimetric assay result is to accurately quantify the color change.
Conventionally, the color change of a colorimetric test strip is analyzed by comparing the color change with a standard color card. But this comparison is accomplished by human's eye and can be easily influenced by the environment light condition, which limits the accuracy of quantifying the color change.
The present invention that is described herein address this problem by providing a system comprising an optical adaptor and a smartphone. The optical adaptor device fits over a smartphone converting it into a colorimetric reader which can provide a consistent and uniform illumination to illuminate the front surface of the colorimetric test card and capture the image of the sample to analyze the color change. This system can be operated conveniently and reliably by a common person at any location. The optical adaptor takes advantage of the existing resources of the smartphone, including camera, light source, processor and display screen, which provides a low-cost solution to accurately quantify the color change of a colorimetric assay.
In this invention, the optical adaptor device comprises a holder frame fitting over the upper part of the smartphone and an optical box attached to the holder having sample receptacle slot and illumination optics. In some prior arts of attachment adaptor for smartphone, their adaptor design is a whole piece including both the clip-on mechanics parts to fit over the smartphone and the functional elements. This design has the problem that they need to redesign the whole-piece adaptor for each specific model of smartphone. But in this present invention, the optical adaptor is separated into a holder frame only for fitting a smartphone and a universal optical box containing all the functional parts. For the smartphones with different dimensions, as long as the relative positions of the camera and the light source are the same, only the holder frame need to be redesigned, which will save a lot of cost of design and manufacture.
The optical box of the optical adaptor comprises: a receptacle slot which receives and position the colorimetric sample in the field of view and focal range of the smartphone camera; an illumination and imaging optics to create uniform and consistent illumination on the sample independently of any external conditions and capture the sample image.
To capture the sample image to accurately represent the color change, it is desirable that the sample area under the camera is uniformly illuminated. But for all common smartphones, the light source is always a point source and mounted next to the camera with some distance, which means the light source is not central symmetric relative to the camera. This causes the problem that, when the sample is placed very close to the camera of smartphone, without the help of additional illumination optics, the illumination pattern on the front surface of a sample in the field of view of the camera will have a gradient intensity change in a linear direction. Hence, it is desirable to create a light source with large emitting area and central symmetric to the camera.
To achieve this purpose, in this present invention, a plastic side-emitting fiber ring is put around the smartphone camera to make the fiber ring central symmetric relative to the camera. And the two end faces of the fiber ring are mounted towards the light source of the smartphone. This will convert the original single point light source to infinite number of small light sources having nearly equal luminous intensity distributed on a circle with equal distance from the smartphone camera.
The light emitted from the side wall of the ring fiber further goes through a diffusive film to increase the emitting area and make the illumination more even. The sample area right under the camera is uniformly front-illuminated by the designed illumination optics based on side-emitting fiber ring.
Because how the color of a colorimetric sample is represented greatly depends on the illumination condition, it is important to control the illumination in the optical box consistent independently to any external light conditions. To solve this problem, the receptacle slot has a rubber door attached to it, which can fully cover the slot to prevent the environmental light getting into the optical box to result in change of the illumination condition.
Typically, the optical box also comprises a lens mounted in it aligned with the camera of the smartphone, which makes the sample within the focal range of the camera.
The images captured by the camera will be further processed by the processor of smartphone to analyze the color change and outputs the analysis result on the screen of smartphone.
A sample slider is mounted inside the receptacle slot to receive the QMAX
device and position the sample in the QMAX device in the field of view and focal range of the smartphone camera.
The sample slider comprises a fixed track frame and a moveable arm:
The frame track is fixedly mounted in the receptacle slot of the optical box.
And the track frame has a sliding track slot that fits the width and thickness of the QMAX
device so that the QMAX device can slide along the track. The width and height of the track slot is carefully configured to make the QMAX device shift less than 0.5mm in the direction perpendicular to the sliding direction in the sliding plane and shift less than less than 0.2mm along the thickness direction of the QMAX device.
The frame track has an opened window under the field of view of the camera of smartphone to allow the light back-illuminate the sample.
A moveable arm is pre-built in the sliding track slot of the track frame and moves together with the QMAX device to guide the movement of QMAX device in the track frame.
The moveable arm (also called "lever") equipped with a stopping mechanism with two pre-defined stop positions. For one position, the arm will make the QMAX device stop at the position where a fixed sample area on the QMAX device is right under the camera of smartphone. For the other position, the arm will make the QMAX device stop at the position where the sample area on QMAX device is out of the field of view of the smartphone and the QMAX device can be easily taken out of the track slot.
The moveable arm switches between the two stop positions by a pressing the QMAX
device and the moveable arm together to the end of the track slot and then releasing.
The moveable arm can indicate if the QMAX device is inserted in correct direction. The shape of one corner of the QMAX device is configured to be different from the other three right angle corners. And the shape of the moveable arm matches the shape of the corner with the special shape so that only in correct direction can QMAX device slide to correct position in the track slot.
Some embodiments 1. Fiber Ring-illuminator In some embodiments of optical assembly, wherein a. the radius of the side illunmring fiber is 10mm;
b. the diameter of ring fiber can be at least 5 mm, 10 mm, 15 mm, 20 mm, 25 mm, mm, 40 mm, 50 mm, 60 mm, 80 mm, or 100 mm, or in a range between any of the two values;
c. the diameter of the cross-section of the ring fiber can be at least 0.5 mm, 1.0 25 mm, 1.5 mm, 2.0 mm, 2.5 mm, 3 mm, 4 mm, 5 mm, 6 mm, 8 mm, or 10 mm, or in a range between any of the two values.
In some embodiments of optical assembly, wherein d. the external imager lens has a diameter of 6mm;
30 e. the diameter of the imager lens can be at least 2 mm, 3mm, 4 mm, 5 mm, 10 mm, 15 mm, 20 mm, 25 mm, 30 mm, 40 mm, or 50 mm, or in a range between any of the two values.
In some embodiments of optical assembly, wherein the ring fiber can be used in combination with micro-lens array or be replace by a micro-lens array;
In some embodiments of optical assembly, wherein the optical assembly comprises a light diffuser plate between the sample and the ring fiber, wherein the light diffusive plate has an aperture configured to aligned with the camera.
In some embodiments of optical assembly, wherein the length of one side of the diffusive plate can be at least 5 mm, 10 mm, 15 mm, 20 mm, 25 mm, 30 mm, 40 mm, 50 mm, 100 mm, mm, or 200 mm, or in a range between any of the two values, wherein the thickness of the diffusive plate can be at least 2 mm, 3mm, 4 mm, 5 mm, 10 mm, 15 mm, or 20 mm, or in a range between any of the two values.
In some embodiments of optical assembly, wherein the distance between the diffusive plate and ring fiber can be at least 1mm, 10 mm, 15 mm, 20 mm, 25 mm, 30 mm, 40 mm, 50 mm, 100 mm, or in a range between any of the two values.
The optical assembly of claim 2, wherein the distance between the sample and ring fiber can be at least 2mm, 10 mm, 15 mm, 20 mm, 25 mm, 30 mm, 40 mm, 50 mm, 100 mm, 150 mm, 200 mm, or in a range between any of the two values.
Lever:
1. The optical assembly of claim 3, wherein the distance between first planar plane on the moveable arm and the light source can be at least 0.5mm, 2 mm, 4 mm, 8 mm, 10 mm, 20 mm, 50 mm, 100 mm or in a range between any of the two values.
2. The optical assembly of claim 3, wherein the distance between first planar plane and the second planar plane of the moveable arm can be at least 5mm, 10 mm, 15 mm, 20 mm, 40 mm, 100 mm, 200mm, or in a range between any of the two values.
3. The optical assembly of claim 5, wherein the distance that the moveable arm needs to move to switch between different positions can be at least 1mm, 5 mm, 15 mm, 20 mm, 40 mm, 100 mm, or in a range between any of the two values.
4. The optical assembly of claim 3, wherein the second planar plane is connected to a tilted plane, wherein a mirror is mounted on the tilted plane 5. The optical assembly of claim 4, wherein the preferred tilt angle of the tilted plane can be at least 10 degree, 30 degree, 60 degree, 80 degree, or in a range between any of the two values, and the tilt angle is defined as the angle between the second planar plane and tilted plane.
FIG. 13-A, 13-B and 13-C are the schematic illustrations of system 10 for smartphone colorimetric reader. Particularly, FIG. 13-B and FIG. 13-C are the exploded views of system 10, shown from the front and rear sides respectively. System 10 comprises a smartphone 1; an optical adaptor device 13 fitting over the upper part of smartphone 1; a colorimetric sample card 138, inserted into receptacle slot 137 of device 13 so that the sample area on the sample card 138 is positioned within the field of view and focal range of camera module 1C in smartphone 1. A rubber door 139 attached to device 18 covers receptacle slot 137 after sample card 138 is in so as to prevent the ambient light getting into optical adaptor 13 to affect the test.
The software (not shown) installed in smartphone 1 analyzes the image collected by camera module 1C
while light source IL in smartphone 1 is emitting light, in order to analyze the color change of the colorimetric test, and outputs the results to a display screen If in smartphone 1.
FIG. 14 is the schematic exploded view of optical adaptor device 13 in system 10. Device 13 comprises a holder case 131 fitting over the upper part of smartphone 1; an optical box 132 attached to case 131 including a receptacle slot 137, an optics chamber 132C
and a rubber door 139 inserted into trench 137s to cover receptacle slot 137. An optics insert 134 is fitted into the top of optics chamber 132C with an exit aperture 134L and an entrance aperture 134C in it aligning with light source 1L and camera 1C (shown in FIG. 13-B) in smartphone 1. A lens 133 is mounted in entrance aperture 134C in optics insert 134 and configured so that the sample area on colorimetric sample card 138 inserted into receptacle slot 137 is located within the working distance of the camera 1C (shown in FIG. 13-B). A side-emitting optical fiber ring 135 is mounted in optics insert 134 configured to make the camera 1C in the center of the fiber ring 135. Both end faces of optical fiber ring 135 are mounted in exit aperture 134L facing the light source IL. A light diffuser film 136 is put under the optical fiber ring 135 and has a hole opened for the aperture of lens. Optical fiber ring 135 whose operation as the illumination optics in device 13 is described below in FIG. 15-A-c.
FIG. 15-A, 15-B and 15-C are the schematic views showing details of system 10 reading a colorimetric card, and particularly of device 13. FIG. 15-A is the sectional view showing details of device 13. And FIG. 15-B and FIG. 15-C are the schematic views only showing the configuration of the optics elements in device 13. These figures illustrate the functionality of the elements that were described above with reference to FIG. 14. The light emitted from light source 1L is coupled into side-emitting optical fiber ring 135 from the two end faces of fiber ring 135 and travels inside along the ring. Beam B1 is emitted out from the side wall of fiber ring and go through the diffuser film 136. Beam B1 illuminates the sample area of colorimetric sample card 138 right under the camera 1C from front side to create uniform illumination. The illuminated sample area absorbs part of beam B1 and reflects the beam B1 to beam B2. Beam B2 is collected by lens 133 and gets into camera 1C Lens 133 creates an image of the sample area on the image sensor plane of camera 1C. Smartphone 1 captures and processes the image to analyze the color information in the image to quantify the color change of the colorimetric assay.
D. Device and Systems for Tomography 0-1. Tomography Device with QMAX Structure A tomography device that reconstructs a sliceable virtual three-dimensional copy of a biological specimen with the highest resolution of nanoscale is disclosed. The device consists of an imaging sensor, a lens, and a QMAX device, as in Fig. 16-A.
The QMAX device has a periodic pillar array. A biological specimen is contained in the QMAX device. An index-matching liquid can be used to reduce the scattering of light, and reduce heterogeneities of refractive index throughout the specimen. The QMAX
structure enhances the detection sensitivity of six (or more) orders of magnitude.
0-2. Calibration based on QMAX Structure The pillar array has a metallic disk on top of each pillar. The metallic disk provides a calibration signal for both spatial and height calibration for images captured by the imaging sensor. The shape of the metallic disk can be designed to facilitate a fast calibration. For example, the shape of the metallic disk can be like the letter E; such a pillar array is illustrated in Fig. 16-B.
When the imaging sensor capture an image on the QMAX structure, with or without a biological specimen, the captured image can be calibrated spatially and the focus distance of the camera can also be quantitively calibrated.
For spatial calibration, the captured image goes through an object detection.
The object detection scheme can be a template matching, an optical character recognition, a shape detection, or other schemes that are used in the field. The object detection retrieves the orientation of the detected pattern, which in the example of Fig. 16-B is the letter E.
With the orientation parameter, spatial calibration is achieved through a two-dimensional geometric transform.
We disclose a quantitative calibration of the focus distance with the pillar array. The effect of focal distance on the captured image can be explained by the thin lens model, as shown in Fig.
16-C. If the sensing device is at a distance 8 from the focus plane, point Q
will be projected onto a circle of diameter ko-, and its radiance will spread over this circle, with Q being defocused. The location v of the focal plane depends on the focal length of the lens, f, and the distance from the object, u. The relationship between these three variables is given by the well-known Gauss lens law or thin lens equation: 71 =
+
We measure the degree of focus on the captured image, and deduct the focus plane location. The focus degree measures the focus level either the whole image or every image pixel.
A wide variety of algorithms and operators have been pro- posed in the literature to measure the focus degree, such as gradient-based, Laplacian-based, wavelet-based, statistics-based, Cosine transform/Fourier transform based, etc.
The focus degree of the pillar array captured at different focus planes can be pre-measured and stored in a look up table. When the imaging sensor captures a new image of the pillar array, for example, Fig. 16-D shows a captured image of the example pillar array in Fig. 16-B, we compute the focus degree of the newly captured image, refer the focus degree to the look up table, and find its corresponding focal plane location.
0-3. Tomography System The goal of tomography is to reconstruct a three-dimensional volume of a biological specimen through several projections of it. An end-to-end tomography system includes light source, imaging, and three-dimensional reconstruction.
Light Source The light captured by the imaging sensor can be refracted from the specimen, emitted from the specimen, etc.
Imaging The imaging part captures projection on the imaging sensor. The projections can be captured at different focus distance, different angles, from different illumination, etc.
Several images can be captured at different focus distances. The lens moves towards or backward the QMAX structure at a stepsize or a multiple of stepsize. The value of the stepsize and the movement of the lens can be controlled by hardware or software through an application program interface. The image sensor records the captured image.
Several images can be captured at different angles. The specimen is rotated and optical images are captured that approximate straight-line projections through it. The specimen is rotated to a series of angular positions, and an image is captured at each orientation. The apparatus is carefully aligned to ensure that the axis of rotation is perpendicular to the optical axis, so that projection data pertaining to each plane is collected by the imaging sensor.
The focal plane can be positioned halfway between the axis of rotation and the QMAX card closest to the lens. This means that every image contains both focused data from the front half of the specimen (the half closest to the lens), and out-of-focus data from the back half of the specimen. The focused data will be utilized for three-dimensional volume reconstruction, while the out-of-focus data will not be used. A band-pass filter can be equipped to select the focused data.
Optical projection tomography is performed using standard tomographic algorithms. Due to the position of the focal plane relative to the axis of rotation, two images taken 180 degrees apart from each other will be focused on different parts of the specimen.
Limiting the back-projection to the region corresponding to the focused part of the specimen improves the quality of the results. As data is accumulated for the various orientations through the specimen, a semi-disc mask, which acts as a band-pass filter, can be rotated to ensure that only focused data is back-projected.
Several images can be captured at different illumination. Quantitative phase images from time-dependent interference patterns induced by the frequency shifting of a reference beam relative to the sample beam can be obtained. A galvanometer-mounted tilting mirror can be used to vary the angle of illumination. A laser beam passes through two acousto-optic modulators which shift the frequency of the laser beam. A second beam splitter recombines the specimen and reference laser beams, forming an interference pattern which is captured at the imaging sensor.
Phase images are then calculated by applying phase-shifting interferometry.
For near-plane wave illumination of a thin specimen with small index contrast, the phase of the transmitted field is to a good approximation equal to the line integral of the refractive index along the path of beam propagation. Therefore, the phase image can simply be interpreted as the projection of refractive index.
Besides a band-pass filter, various imaging filters can be used during image captures, for the purpose of (including but not limited to):
(1) signal selection, thereby portion of the captured image is selected;
(2) signal enhancement, thereby portion or whole of the captured image is enhanced;
(3) signal transformation, thereby portion or whole of the captured image is transformed into another representation, such as frequency representation, multi-scale representation, etc.;
(4) signal replication, thereby portion of the captured image is replaced by another portion of the captured image, or by the representation of another portion of the captured image;
(5) or any combination of (1) ¨ (4).
Captured images can be enhanced through filtering, such as contrast enhancement, color enhancement, noise reduction, etc. It can increase the dynamic range of pixel intensities, adjust color temperature, boost the signal to noise ratio, etc.
Captured images can be transformed into another representation, which can be more suitable for the three-dimension reconstruction. It can be transformed into a different format (8 bit to 16 bit, integer to floating point, etc.), different color space (RGB to HSV, etc.), different domain (spatial domain to frequency domain, etc.), etc.
Portion of captured images can be replaced by another portion (or transformation of another portion) of captured images. It can be a spatial region, which is replaced by the transformation of another region, such as a reflective extension around the boundary, etc. It can be a frequency subband, which is replaced by the transformation of another frequency subband, such as the high frequency subband is replaced by an estimation from the low frequency subband, etc.
Three-Dimensional Reconstruction Reconstructing a three-dimensional volume of the biological specimen from its projection is an inverse problem. The three-dimensional volume reconstruction can employ a phase image retrieval scheme, a back-projection scheme, non-linear approximation scheme, optimization scheme, etc.
When several images are captured at different focus distances, we compute the focus degrees of these images, and list these focus degrees as a vector. Then we refer the vector with the look up table, and find their corresponding focal plane distances. The corresponding can be distance based, correlation based, or other criteria to select the best match.
A diagram of phase image retrieval based scheme is shown in Fig. 16-E. It consists of four components:
= Focus distance calculation = Phase image retrieval = Height estimation = Three-dimensional volume reconstruction The second component, phase retrieval is through a quantitative phase imaging technique, based on the transport of intensity (TIE) equation. The TIE
equation states oI(x, y) k 15 ___________________________ = ¨V = [/(x, y)V(p(x, y)]
az al where ¨az indicates the intensity gradient which can be computed from the multi-focal images, k is the wave number and cp is the sample phase distribution.
The TIE equation could be solver using fast Fourier transform, discrete cosine transform;
see for example, "Boundary-artifact-free phase retrieval with the transport of intensity equation:
fast solution with use of discrete cosine transform", C. Zuo, Q. Chen, and A.
Asundi, Optics Express, Vol. 22, No. 8, April 2014. The phase image cp is retrieved from the TIE equation.
Given the phase image, we estimate the height (thickness) of the biological specimen.
Recall that for a sample with a thickness of t and a refractive index of n, the corresponding optical path length Lp is L =txn The height of the biological specimen can be computed, with a known refractive index.
Going further, the three-dimensional volume of the biological specimen can be reconstructed.
The back-projection algorithm is commonly used in three-dimensional reconstruction in tomography. It includes Fourier transform base algorithm, filtered back projection algorithm, back projection and filtering algorithm, and iterative algorithm.
When the position of the focal plane relative to the axis of rotation differs, two images taken 180 degrees apart from each other will be focused on different parts of the specimen. To compensate, a half-plane adjusted back projection algorithm can be employed.
Thus, limiting the back-projection to the region corresponding to the focused part of the specimen will improve the quality of the results. As data is accumulated for the various orientations through the specimen, a semi-disc mask can be rotated to ensure that only focused data is back-projected.
As another embodiment of the back-projection algorithm, a procedure based on the filtered back-projection method can be applied. A discrete inverse Radon transform is applied to every x-O slice in the beam rotation direction, with x, the coordinate in the tilt direction and 0, the relative angle of laser beam direction to the optic axis of the objective lens. To compensate for the angle between imaging and illumination directions, the x values is divided by cos 0.
To reduce the effects of the missing projections, an iterative constraint method can be applied.
For the inverse problem to reconstruct a three-dimensional volume from its projection, the resulting three-dimensional volume can be blurred. A ramp filter can be used to remove or reduce the blurriness.
Beside the deblurring filter, various imaging filters can be used for three-dimensional volume reconstruction, for (including but not limited to):
(1) signal selection, where portion of the image or image volume is selected;
(2) signal enhancement, where portion or whole of the image or image volume is enhanced;
(3) signal transformation, where portion or whole of the image or image volume is transformed into another representation, such as frequency representation, multi-scale representation, etc.;
(4) signal replication, where portion of the image or image volume is replaced by another portion of the captured image, or by the representation of another portion of the captured image;
(5) or any combination of (1) ¨ (4) 0-4. Examples of Present Invention DA1. A device for sample imaging, comprising a QMAX device and an imager, wherein:
(1) the QMAX device comprises:
a first plate, a second plate, and spacers, wherein:
i. the plates are movable relative to each other into different configurations;
ii. one or both plates are flexible;
iii. each of the plates has, on its respective inner surface, a sample contact area for contacting a deformable sample;
iv. one or both of the plates comprise the spacers that are fixed with a respective plate;
v. the spacers have a predetermined substantially uniform height and a predetermined inter-spacer-distance; and vi. at least one of the spacers is inside the sample contact area;
wherein one of the configurations is an open configuration, in which: the two plates are separated apart, the spacing between the plates is not regulated by the spacers, and the sample is deposited on one or both of the plates; and wherein another of the configurations is a closed configuration which is configured after the sample deposition in the open configuration; and in the closed configuration: at least part of the sample is compressed by the two plates into a layer of uniform thickness, wherein the uniform thickness of the layer is confined by the inner surfaces of the two plates and is regulated by the plates and the spacers; and (2) the imager is configured to capture an image of signals emanating from at least part of the layer of uniform thickness.
DB1. A system for tomography, comprising a QMAX device, an imager, a holder, and a control device, wherein:
(1) the QMAX device comprises: a first plate, a second plate, and spacers, wherein:
i. the plates are movable relative to each other into different configurations;
ii. one or both plates are flexible;
iii. each of the plates has, on its respective inner surface, a sample contact area for contacting a deformable sample;
iv. one or both of the plates comprise the spacers that are fixed with a respective plate;
v. the spacers have a predetermined substantially uniform height and a predetermined inter-spacer-distance; and vi. at least one of the spacers is inside the sample contact area;
wherein one of the configurations is an open configuration, in which: the two plates are separated apart, the spacing between the plates is not regulated by the spacers, and the sample is deposited on one or both of the plates; and wherein another of the configurations is a closed configuration which is configured after the sample deposition in the open configuration; and in the closed configuration: at least part of the sample is compressed by the two plates into a layer of uniform thickness, wherein the uniform thickness of the layer is confined by the inner surfaces of the two plates and is regulated by the plates and the spacers;
(2) the imager comprises an image sensor and a lens, wherein:
i. the lens is configured to focus signals emanating from at least part of the layer of uniform thickness and project the focused signals to the image sensor, and ii. the image sensor is configured to capture images of said focused signals;
(3) the holder is configured to adjust relative position between the QMAX
device and the imager; and (4) the control device comprises hardware and software for controlling and/or deducing the position adjustment made by the holder, and receiving and reconstructing said images into a three-dimensional volume.
DBB1. A system for tomography, comprising a QMAX device, an imager, a holder, and a control device, wherein:
(1) the QMAX device comprises: a first plate, a second plate, and spacers, wherein:
i. the plates are movable relative to each other into different configurations;
ii. one or both plates are flexible;
iii. each of the plates has, on its respective inner surface, a sample contact area for contacting a deformable sample;
iv. one or both of the plates comprise the spacers that are fixed with a respective plate;
v. the spacers have a predetermined substantially uniform height and a predetermined inter-spacer-distance; and vi. at least one of the spacers is inside the sample contact area;
wherein one of the configurations is an open configuration, in which: the two plates are separated apart, the spacing between the plates is not regulated by the spacers, and the sample is deposited on one or both of the plates; and wherein another of the configurations is a closed configuration which is configured after the sample deposition in the open configuration; and in the closed configuration: at least part of the sample is compressed by the two plates into a layer of uniform thickness, wherein the uniform thickness of the layer is confined by the inner surfaces of the two plates and is regulated by the plates and the spacers;
(2) the imager is capable of changing the focal plane and comprises an image sensor and a lens, wherein:
i. the lens is configured to focus signals emanating from at least part of the layer of uniform thickness and project the focused signals to the image sensor, and ii. the image sensor is configured to capture images of said focused signals;
iii. the lens is a single lens or a compound lens consisting several lenses;
iv. at least one element lens in the lens is moveable to change the distance from the image sensor to change the focal plane of the imager; and v. the moveable lens can be driven by stepper motor and/or electromagnetic force, which is computerized or manually controlled.
and (4) the control device comprises hardware and software for controlling and/or deducing the position adjustment made by the holder, and receiving and reconstructing said images into a three-dimensional volume.
DC1. A method of tomography, comprising the steps of:
(a) depositing a sample onto the QMAX device of any prior device or system embodiment;
(b) after (a), using the two plates of the QMAX device to compress at least part of the sample into a layer of substantially uniform thickness that is confined by the sample contact surfaces of the plates, wherein the uniform thickness of the layer is regulated by the spacers and the plates, wherein the compressing comprises:
bringing the two plates together; and conformable pressing, either in parallel or sequentially, an area of at least one of the plates to press the plates together to a closed configuration, wherein the conformable pressing generates a substantially uniform pressure on the plates over the at least part of the sample, and the pressing spreads the at least part of the sample laterally between the sample contact surfaces of the plates, and wherein the closed configuration is a configuration in which the spacing between the plates in the layer of uniform thickness region is regulated by the spacers;
(c) capturing an image, using the imager of any prior device or system embodiment, of signals emanating from at least part of the layer of uniform thickness;
(d) adjusting relative position between the QMAX device and imager, repeating step (c); and (e) after a series of steps (c), reconstructing the captured images into a three-dimensional volume of said at least part of the layer, wherein a conformable pressing is a method that makes the pressure applied over an area is substantially constant regardless the shape variation of the outer surfaces of the plates;
and wherein the parallel pressing applies the pressures on the intended area at the same time, and a sequential pressing applies the pressure on a part of the intended area and gradually move to other area.
DCC1. A method to take images at different focal planes, comprising steps of:
(a) computerized or manually controlling the moveable lens in the imager to the initial position;
(b) corresponding the moveable lens position to the position of the focal plane;
(c) capturing the image using the image sensor in the imager and record the position of focal plane;
(d) computerized or manually adding a step displacement to move the moveable lens to the next positon (e) repeat step (b) to (d) (f) after a series of step (e), several images at different focal planes are captured.
DA21. The device of any prior embodiment, wherein QMAX device further comprises a dry reagent coated on one or both plates that stains the sample.
DA22. The device of any prior embodiment, wherein:
i. one or both plate sample contact areas comprise one or a plurality of binding sites that each binds and immobilizes a respective analyte; or ii. one or both plate sample contact areas comprise, one or a plurality of storage sites that each stores a reagent or reagents; wherein the reagent(s) dissolve and diffuse in the sample during or after step (c), and wherein the sample contains one or plurality of analytes; or iii. one or a plurality of amplification sites that are each capable of amplifying a signal from the analyte or a label of the analyte when the analyte or label is 500 nm from the amplification site; or iv. any combination of i to iii.
DA23. The device of any prior embodiment, wherein the imager further comprises a light source that provides light for illumination or excitation of the layer of uniform thickness for the imaging.
DA24. The device of embodiment DA23, wherein the light source is selected from the group consisting of: LED, laser, incandescent light, and any combination thereof.
DB2. The system of embodiment DB1, wherein the signals comprise optical signals selected from the group consisting of: light reflection, light refraction, light transmission, luminescence signals, and any combination thereof.
DB3. The system of any prior embodiment, wherein the imager further comprises a light source providing light illuminating said layer of uniform thickness for the imaging, wherein the light source is selected from the group consisting of: incandescent light, LED, CFL, laser, and any combination thereof.
DB4. The system of any prior embodiment, wherein the imager further comprises a light source providing excitation light that excites fluorescence emission from said layer of uniform thickness for the imaging, wherein the light source is a LED and/or a laser.
DB5. The system of any prior embodiment, wherein the holder is capable of adjusting the relative position of the lens to the QMAX device along its optical axis to change focal plane .. position of the lens.
DB6. The system of any prior embodiment, wherein the holder is capable of adjusting the relative position between the lens and the QMAX device to change imaging angle, wherein the imaging angle is an angle between focal plane of the lens and the layer of uniform thickness.
DB7. The system of any prior embodiment, wherein the imager further comprises a light source providing illumination light for the imaging, and wherein the holder is capable of adjusting the relative position between the light source and the QMAX device to change angle of incidence of the illumination light, wherein the angle of incidence is the angle between the illumination light and a line perpendicular to the layer of uniform thickness.
DB8. The system of any prior embodiment, wherein the control device comprises hardware and software for sending a command that defines the position adjustment to the holder, and wherein the holder is configured to receive said command and make the adjustment with no more than 10% deviation.
DB9. The system of any prior embodiment, wherein the control device comprises hardware and software for sending a command that defines the position adjustment to the holder, and wherein the holder is configured to receive said command and make the adjustment with no more than 1% deviation.
DB10. The system of any of embodiments DB8 ¨ DB9, wherein the control device comprises hardware and software for receiving an input that defines the position adjustment and converting the input into the command for the holder to make the adjustment.
DB11. The system of any prior embodiment, wherein the system further comprises a plurality of calibration pillars, and wherein:
(1) said plurality of calibration pillars are placed between the sample contact areas of the two plates at the closed configuration, and have different heights from one another, which are all smaller than the uniform height of the spacers;
(2) said images are captured at different focal planes along a common optical axis; and (3) the control device comprises hardware and software for: (a) calculating a focus score for each of said images; and (b) deducing a focus plane position at which each of said images is captured by comparing said focus score with a look-up table, wherein the focus score is a matrix of focus degrees calculated for each pixel of a captured image, wherein the look-up table is predetermined and comprises a row of pre-determined focus plane positions along said common optical axis and a corresponding row of calibration focus scores, each of the calibration focus scores is calculated based on an image of the calibration pillars captured at the corresponding pre-determined focus plane.
DB12. The system of any prior embodiment, wherein said images are captured at different focal planes along a common optical axis, and wherein the control device comprises hardware and software for: (a) generating a phase image for a biological entity in said at least part of the layer, wherein the phase image is a phase distribution calculated based on wavelength of an illuminating light used for imaging, at least part of said images that contain signals from the biological entity, and the focus plane positions at which said images are respectively captured;
and (b) estimating a thickness of the biological entity based on the phase image and a refractive index of the sample, wherein the biological entity is a part or entirety of said at least part of the layer.
DB13. The system of embodiment DB8, wherein the control device comprises hardware and software for reconstructing said at least part of the images into a three-dimensional volume of the biological entity based on the estimated thickness.
DB14. The system of any prior embodiment, wherein said images are captured at different imaging angles, wherein the control device comprises hardware and software for: (1) knowing or deducing the imaging angle for each of said images; and (2) reconstructing said images into a three-dimensional volume based on the known/deduced imaging angels using a back-projection algorithm, and wherein the imaging angle is an angle between focal plane of the lens and the layer of uniform thickness.
DB15. The system of any prior embodiment, wherein said images are captured at different angels of incidence of illumination light, wherein the control device comprises hardware and software for: (1) knowing or deducing the angle of incidence for each of said images; and (2) reconstructing said images into a three-dimensional volume based on the known/deduced angle of incidence using a back-projection algorithm, and wherein the angle of incidence of the illumination light is the angle between the illumination light and a line perpendicular to the layer of uniform thickness.
DB16. The system of any or embodiments DB14 ¨ DB15, wherein the back-projection algorithm is selected from the group consisting of: Fourier transform base algorithm, filtered back-projection algorithm, back-projection and filtering algorithm, iterative algorithm, and any combination thereof.
DB17. The system of any prior embodiment, wherein said imager is equipped with imaging filters, and wherein the captured images are filtered by the imaging filters and/or software of the control device for: (1) signal selection, thereby portion of the captured image is selected; (2) signal enhancement, thereby portion or whole of the captured image is enhanced; (3) signal transformation, thereby portion or whole of the captured image is transformed into another representation, such as frequency representation, multi-scale representation, etc.; (4) signal replication, thereby portion of the captured image is replaced by another portion of the captured image, or by the representation of another portion of the captured image; or any combination of (1) ¨ (4).
DB18. The system of any prior embodiment, wherein the control device further comprises hardware and software for reconstructing said at least part of the images into a three-dimensional volume, wherein during three-dimensional volume reconstruction, the images and the three-dimensional volume are filtered by software for: (1) signal selection, where portion of the image or image volume is selected; (2) signal enhancement, where portion or whole of the image or image volume is enhanced; (3) signal transformation, where portion or whole of the image or image volume is transformed into another representation, such as frequency representation, multi-scale representation, etc.; (4) signal replication, where portion of the image or image volume is replaced by another portion of the captured image, or by the representation of another portion of the captured image; or any combination of (1) ¨ (4) DC2. The method of embodiment DC1, further comprising: before step (c), staining the sample with a dye.
DC3. The method of any prior method embodiment, wherein during the step (b), the conformable pressing is by human hand.
.. DC4. The method of any prior method embodiment, wherein the conformable pressing of step (d) is provided by a pressured liquid, a pressed gas, or a conformal material.
DC5. The method of any prior method embodiment, wherein the adjusting step (d) comprises adjusting the relative position of the lens to the QMAX device along its optical axis to change focal plane position of the lens.
DC6. The method of any prior method embodiment, wherein the adjusting step (d) comprises adjusting the relative position between the lens and the QMAX device to change imaging angle, wherein the imaging angle is an angle between focal plane and the layer of uniform thickness.
DC7. The method of any prior method embodiment, wherein the imager further comprises a light source providing illumination light for the imaging, and wherein the adjusting step (d) comprises adjusting the relative position of the light source to the QMAX
device to change angle of incidence of the illumination light, wherein the angle of incidence is the angle between the illumination light and a line perpendicular to the layer of uniform thickness.
DC8. The method of any prior method embodiment, wherein the adjusting step (d) is performed manually.
DC9. The method of any prior method embodiment, wherein the adjusting step (d) is performed through a control device operably coupled to a holder, wherein the control device comprises hardware and software for receiving an input that defines the position adjustment and sending a command to the holder, and wherein the holder is configured to receive said command and make the adjustment with a deviation no more than 10%.
DC10. The method of any prior method embodiment, wherein the adjusting step (d) is performed through a control device operably coupled to a holder, wherein the control device comprises hardware and software for receiving an input that defines the position adjustment and sending a command to the holder, and wherein the holder is configured to receive said command and make the adjustment with a deviation no more than 1%.
DC11. The method of any prior method embodiment, wherein said images are captured at different focal planes along a common optical axis, and wherein the reconstructing step (e) comprises: (i) calculating a focus score for each of said images; and (ii) deducing a focal plane position at which each of said images is captured by comparing said focus score with a look-up table, wherein the focus score is a matrix of focus degrees calculated for each pixel of a captured image, wherein the look-up table is predetermined and comprises a row of pre-determined focal plane positions along said common optical axis and a corresponding row of calibration focus scores, each of the calibration focus scores is calculated based on an image of the calibration pillars captured at the corresponding pre-determined focal plane.
DC12. The method of any prior method embodiment, wherein said images are captured at different focal planes along a common optical axis, and wherein the reconstructing step (e) comprises: (i) generating a phase image for a biological entity in said at least part of the layer, wherein the phase image is a phase distribution calculated based on the wavelength of an illuminating light used for imaging, at least part of said images that contain signals from the biological entity, and the focal plane positions at which said images are captured; and (ii) estimating a thickness of the biological entity based on the phase image and a refractive index of the sample, wherein the biological entity is a part or entirety of said at least part of the layer.
DC13. The method of embodiment DC12, wherein the reconstructing step (e) further comprises reconstructing said at least part of the images into a three-dimensional volume of the biological entity based on the estimated thickness.
DC14. The method of any prior method embodiment, wherein said images are captured at different imaging angles, wherein the reconstructing step (e) comprises: (i) knowing or deducing the imaging angle for each of said images; and (ii) reconstructing said images into a three-dimensional volume based on the known/deduced imaging angels using a back-projection algorithm, and wherein the imaging angle is an angle between focal plane of the lens and the layer of uniform thickness.
DC15. The method of any prior method embodiment, wherein said images are captured at different angels of incidence of illumination light, wherein the reconstructing step (e) comprises:
(i) knowing or deducing the angle of incidence for each of said images; and (ii) reconstructing said images into a three-dimensional volume based on the known/deduced angle of incidence using a back-projection algorithm, and wherein the angle of incidence of the illumination light is the angle between the illumination light and a line perpendicular to the layer of uniform thickness.
DC16. The method of any of embodiments DC14 ¨ DC15, wherein the back-projection algorithm is selected from the group consisting of: Fourier transform base algorithm, filtered back-projection algorithm, back-projection and filtering algorithm, iterative algorithm, and any combination thereof.
DC17. The method of any prior method embodiment, wherein the sample is a biological sample selected from the group consisting of: cells, tissues, bodily fluids, stool, and any combination thereof.
DC18. The method of any prior method embodiment, wherein the sample is an environmental sample from an environmental source selected from the group consisting of a river, lake, pond, ocean, glaciers, icebergs, rain, snow, sewage, reservoirs, tap water, drinking water, etc.; solid samples from soil, compost, sand, rocks, concrete, wood, brick, sewage, the air, underwater heat vents, industrial exhaust, vehicular exhaust and any combination thereof.
DC19. The method of any prior method embodiment, wherein the sample is a foodstuff sample selected from the group consisting of: raw ingredients, cooked food, plant and animal sources of food, preprocessed food, partially or fully processed food, and any combination thereof.
DC20. The method of any prior method embodiment, wherein the sample is blood, and the biological entity is red blood cells, white blood cells, and/or platelets.
DC21. The method of embodiment DC20, further comprising:
(f). calculating volume of red blood cells, white blood cells, and/or platelets, based on their respective reconstructed three-dimensional volumes.
D022. The method of embodiment DC21, further comprising:
(g) based on the calculated volume, determining a blood test readout selected from the group consisting of: mean corpuscular volume (MCV), hematocrit, Red cell distribution width (RDVV), mean platelet volume (MPV), platelet distribution width (PDVV), immature platelet fraction (I PF), and any combination thereof.
E. Assay and Imaging Assisted by Machine Learning E-1. QMAX Device for Assay and Imaging A device for biological analyte detection and localization, comprising a QMAX
device, an imager, and a computing unit, is disclosed. A biological sample is suspected on the QMAX device.
The count and location of an analyte contained in the sample are obtain by the disclosure.
The imager captures an image of the biological sample. The image is submitted to a computing unit. The computing unit can be physically directly connected to the imager, connected through network, or in-directly through image transfer.
E-2. Workflow The disclosed analyte detection and localization employ machine learning deep learning.
A machine learning algorithm is an algorithm that is able to learn from data.
A more rigorous definition of machine learning is "A computer program is said to learn from experience E with respect to some class of tasks T and performance measure P, if its performance at tasks in T, as measured by P, improves with experience E." It explores the study and construction of algorithms that can learn from and make predictions on data ¨ such algorithms overcome following strictly static program instructions by making data driven predictions or decisions, through building a model from sample inputs.
Deep learning is a specific kind of machine learning based on a set of algorithms that attempt to model high level abstractions in data. In a simple case, there might be two sets of neurons: ones that receive an input signal and ones that send an output signal. When the input layer receives an input, it passes on a modified version of the input to the next layer. In a deep network, there are many layers between the input and output (and the layers are not made of neurons but it can help to think of it that way), allowing the algorithm to use multiple processing layers, composed of multiple linear and non-linear transformations.
The disclosed analyte detection and localization workflow consists of two stages, training and prediction, as in Fig. 17-A. We describe training and prediction stages in the following paragraphs.
Training In the training stage, training data with annotation is fed into a convolutional neural network. Convolutional neural network a specialized kind of neural network for processing data that has a known, grid-like topology. Examples include time-series data, which can be thought of .. as a 1D grid taking samples at regular time intervals, and image data, which can be thought of as a 2D grid of pixels. Convolutional networks have been tremendously successful in practical applications. The name "convolutional neural network" indicates that the network employs a mathematical operation called convolution. Convolution is a specialized kind of linear operation.
Convolutional networks are simply neural networks that use convolution in place of general matrix multiplication in at least one of their layers.
Training data are annotated for the analyte to be detect. Annotation indicates whether or not an analyte presents in a training data. Annotation can be done in the form of bounding boxes which fully contains the analyte, or center locations of analytes. In the latter case, center locations are further converted into circles covering analytes.
When the size of training data is large, it presents two challenges:
annotation (which is usually done by person) is time consuming, and the training is computing expensive. To overcome these challenges, one can partition the training data into patches of small size, then annotate and train on these patches, or a portion of these patches.
Annotated training data is fed into a convolutional neural network for model training. The output is a model that can be used to make pixel-level prediction on an image.
We use the Caffe library with fully convolutional network (FCN). Other convolutional neural network architecture can also be used, such as TensorFlow.
The training stage generates a model that will be used in the prediction stage. The model can be repeatedly used in the prediction stage for input images. Thus, the computing unit only needs access to the generated model. It does not need access to the training data, nor the training stage has to be run on the computing unit.
Prediction In the predication stage, a detection component is applied to the input image, which is followed by a localization component. The output of the prediction stage is the count of analytes contained in the sample, along with the location of each analyte.
In the detection component, an input image, along with the model generated from the training stage, is fed into a convolutional neural network. The output of the detection stage is a pixel-level prediction, in the form of a heatmap. The heatmap can have the same size as the input image, or it can be a scaled down version of the input image. Each pixel in the heatmap has a value from 0 to 1, which can be considered as the probability (belief) whether a pixel belongs to an analyte. The higher the value, the bigger the chance it belongs to an analyte.
The heatmap is the input of the localization component. We disclose an algorithm to localize the analyte center. The main idea is to iteratively detect local peaks from the heatmap.
After we find the peak, we calculate the local area surrounding the peak but with smaller value.
We remove this region from the heatmap and find the next peak from the remaining pixels. The process is repeated only all pixels are removed from the heatmap.
One embodiment of the localization algorithm is to sort the heatmap values into a one-dimensional ordered list, from the highest value to the lowest value. Then pick the pixel with the highest value, remove the pixel from the list, along with its neighbors.
Iterate the process to pick the pixel with the highest value in the list, until all pixels are removed from the list.
Algorithm GlobalSearch (heatmap) Input:
heatmap Output:
loci loci 4¨{}
sort(heatmap) while (heatmap is not empty) {
s pop(heatmap) D <¨ {disk center as s with radius R}
heatmap = heatmap \ D I/ remove D from the heatmap add s to loci After sorting, heatmap is a one-dimensional ordered list, where the heatmap value is ordered from the highest to the lowest. Each heatmap value is associated with its corresponding pixel coordinates. The first item in the heatmap is the one with the highest value, which is the output of the pop(heatmap) function. One disk is created, where the center is the pixel coordinate of the one with highest heatmap value. Then all heatmap values whose pixel coordinates resides inside the disk is removed from the heatmap. The algorithm repeatedly pops up the highest value in the current heatmap, removes the disk around it, till the items are removed from the heatmap.
In the ordered list heatmap, each item has the knowledge of the proceeding item, and the following item. When removing an item from the ordered list, we make the following changes, as illustrated in Fig. 17-B:
= Assume the removing item is x1, its proceeding item is xp, and its following item is xf.
= For the proceeding item xp, re-define its following item to the following item of the removing item. Thus, the following item of xp is now xf.
= For the removing item x1, un-define its proceeding item and following item, which removes it from the ordered list.
= For the following item xf, re-define its proceeding item to the proceeding item of the removed item. Thus, the proceeding item of xf is now xp.
After all items are removed from the ordered list, the localization algorithm is complete.
The number of elements in the set loci will be the count of analytes, and location information is the pixel coordinate for each s in the set loci.
Another embodiment searches local peak, which is not necessary the one with the highest heatmap value. To detect each local peak, we start from a random starting point, and search for the local maximal value. After we find the peak, we calculate the local area surrounding the peak but with smaller value. We remove this region from the heatmap and find the next peak from the remaining pixels. The process is repeated only all pixels are removed from the heatmap.
Algorithm LocalSearch (s, heatmap) Input:
s: starting location (x, y) heatmap Output:
s: location of local peak.
We only consider pixels of value > 0.
Algorithm Cover (s, heatmap) Input:
s: location of local peak.
heatmap:
Output:
cover: a set of pixels covered by peak:
This is a breadth-first-search algorithm starting from s, with one altered condition of visiting points: a neighbor p of the current location q is only added to cover if heatmap[p]> 0 and heatmap[p] <= heatmap[q]. Therefore, each pixel in cover has a non-descending path leading to the local peak s.
Algorithm Localization (heatmap) Input:
heatmap Output:
loci loci 4¨{}
pixels 4¨{all pixels from heatmap}
while pixels is not empty {
s 4¨any pixel from pixels s 4¨LocalSearch(s, heatmap) II s is now local peak probe local region of radius R surrounding s for better local peak r 4¨Cover(s, heatmap) pixels <¨ pixels \ r II remove all pixels in cover add s to loci E-3. Example of present invention EA1. A method of deep learning for data analysis, comprising:
(a) receiving an image of a test sample, wherein the sample is loaded into a QMAX
device and the image is taken by an imager connected to the QMAX device, wherein the image includes detectable signals from an analyte in the test sample;
(b) analyzing the image with a detection model and generating a 2-D data array of the image, wherein the 2-D data array includes probability data of the analyte for each location in the image, and the detection model is established through a training process that comprises:
i. feeding an annotated data set to a convolutional neural network, wherein the annotated data set is from samples that are the same type as the test sample and for the same analyte; and training and establishing the detection model by convolution; and (c) analyzing the 2-D data array to detect local signal peaks with:
i. signal list process, or local searching process; and (d) calculating the amount of the analyte based on local signal peak information.
EB1. A system for data analysis, comprising:
a QMAX device, an imager, and computing unit, wherein:
(a) the QMAX device is configured to compress at least part of a test sample into a layer of highly uniform thickness;
(b) the imager is configured to produce an image of the sample at the layer of uniform thickness, wherein the image includes detectable signals from an analyte in the test sample;
(c) the computing unit is configured to:
receive the image from the imager;
analyze the image with a detection model and generate a 2-D data array of the image, wherein the 2-D data array includes probability data of the analyte for each location in the image, and the detection model is established through a training process that comprises:
feeding an annotated data set to a convolutional neural network, wherein the annotated data set is from samples that are the same type as the test sample and for the same analyte; and training and establishing the detection model by convolution; and (c) analyzing the 2-D data array to detect local signal peaks with signal list process, or local searching process; and iv. calculate the amount of the analyte based on local signal peak information.
EA2. The method of embodiment EA1, wherein the signal list process comprises:
establishing a signal list by iteratively detecting local peaks from the 2-D
data array, calculating a local area surrounding the detected local peak, and removing the detected peak and the local area data into the signal list in order; and ii. sequentially and repetitively removing highest signals from the signal list and signals from around the highest signal, thus detecting local signal peaks.
EA3. The method of any embodiments EA embodiments, wherein the local search process comprises:
i. searching for a local maximal value in the 2-D data array by starting from a random point;
calculating the local area surrounding the peak but with smaller value;
removing the local maximal value and the surrounding smaller values from the 2-D data array; and iv. repeating steps i-iii to detect local signal peaks.
EA4. The method of any prior EA embodiments, wherein the annotated data set is partitioned before annotation.
EB2. The system of embodiment EB1, wherein the imager comprises a camera.
EB3. The system of embodiment EB2, wherein the camera is part of a mobile communication device.
EB4. The system of any prior EB embodiments, wherein the computing unit is part of a mobile communication device.
F. Devices and Methods for Tissue Staining and Cell Imaging F-1. Example of QMAX Device for Tissue Staining and Cell Imaging Fig. 18-A shows an embodiment of a generic QMAX device, that have or not have a hinge, and wherein Q: quantification; M: magnifying; A: adding reagents; X:
acceleration; also known as compressed regulated open flow (CROF)) device. The generic QMAX device comprises a first plate 10 and a second plate 20. In particular, panel (A) shows the perspective view of a first plate and a second plate 20 wherein the first plate has spacers. It should be noted, however, that the spacers also are fixed on the second plate 20 (not shown) or on both first plate 10 and second plate 20 (not shown). Panel (B) shows the perspective view and a sectional view of depositing a sample 90 on the first plate 10 at an open configuration. It should be noted, however, that the 10 sample 90 also is deposited on the second plate 20 (not shown), or on both the first plate 10 and the second plate 20 (not shown). Panel (C) illustrates (i) using the first plate 10 and second plate to spread the sample 90 (the sample flow between the inner surfaces of the plates) and reduce the sample thickness, and (ii) using the spacers and the plate to regulate the sample thickness at the closed configuration of the QMAX device. The inner surfaces of each plate have one or a 15 plurality of binding sites and or storage sites (not shown).
In some embodiments, the spacers 40 have a predetermined uniform height and a predetermined uniform inter-spacer distance. In the closed configuration, as shown in panel (C) of Fig. 18-A, the spacing between the plates and the thus the thickness of the sample 90 is regulated by the spacers 40. In some embodiments, the uniform thickness of the sample 90 is 20 substantially similar to the uniform height of the spacers 40. It should be noted that although Fig.
18-A shows the spacers 40 to be fixed on one of the plates, in some embodiments the spacers are not fixed. For example, in certain embodiments the spacers is mixed with the sample so that when the sample is compressed into a thin layer, the spacers, which is rigid beads or particles that have a uniform size, regulate the thickness of the sample layer.
Fig. 18-A shows an embodiment of a QMAX device used for cell imaging. As shown in the figure, the device comprises a first plate 10, a second plate 20, and spacers 40. The plates are movable relative to each other into different configurations, one or both plates are flexible. Each of the plates has, on its respective inner surface, a sample contact area (not indicated) for contacting a staining liquid 910 and/or a tissue sample 90 suspected of containing a target analyte.
The second plate 20 comprises the spacers 40 that are fixed to its inner surface 21. The spacers have a predetermined substantially uniform height and a predetermined inter-spacer distance, and at least one of the spacers is inside the sample contact area.
Fig. 18-A panels (A) and (B) illustrate one of the configurations, an open configuration. As shown in the figure, in the open configuration, the two plates are partially or entirely separated apart, the spacing 102 between the plates is not regulated by the spacers 40, and the staining liquid 910 and the sample 90 are deposited on the first plate 10. It should be noted, the staining liquid 910 and the sample 90 can also be deposited on the second plate 20 or both plates.
Fig. 18-A panel (C) depicts another of the configurations of the two plates, a closed configuration. The closed configuration is configured after the deposition of the staining liquid 910 and the sample 90 in the open configuration, as shown in panel (B). And in the closed configuration, at least part of the sample 90 is between the two plates and a layer of at least part of staining liquid 910 is between the at least part of the sample 90 and the second plate 20, wherein the thickness of the at least part of staining liquid layer is regulated by the plates, the sample 90, and the spacers 40, and has an average distance between the sample surface and the second plate surface is equal or less than 250 pm with a small variation.
In some embodiments, the sample can dried thereon at the open configuration, and wherein the sample comprises bodily fluid selected from the group consisting of: amniotic fluid, aqueous humour, vitreous humour, blood (e.g., whole blood, fractionated blood, plasma or serum), breast milk, cerebrospinal fluid (CSF), cerumen (earwax), chyle, chime, endolymph, perilymph, feces, breath, gastric acid, gastric juice, lymph, mucus (including nasal drainage and phlegm), pericardial fluid, peritoneal fluid, pleural fluid, pus, rheum, saliva, exhaled breath condensates, sebum, semen, sputum, sweat, synovial fluid, tears, vomit, urine, and any combination thereof.
In some embodiments, the sample contact area of one or both of the plates is configured such that the sample can dried thereon at the open configuration, and the sample comprises blood smear and is dried on one or both plates.
In some embodiments, the sample is a solid tissue section having a thickness in the range of 1 ¨ 200 um, and the sample contact area of one or both of the plates is adhesive to the sample. In some embodiments, the sample is paraffin-embedded. In some embodiments, the sample is fixed.
In some embodiments, the staining liquid is a pure buffer solution that does not comprise particularly component capable of altering the properties of the sample. In some embodiments, the staining liquid comprises fixative capable of fixing the sample. In some embodiments, the staining liquid comprises blocking agents, wherein the blocking agents are configured to disable non-specific endogenous species in the sample to react with detection agents that are used to specifically label the target analyte. In some embodiments, the staining liquid comprises deparaffinizing agents capable of removing paraffin in the sample. In some embodiments, the staining liquid comprises permeabilizing agents capable of permeabilizing cells in the tissue sample that contain the target analyte. In some embodiments, the staining liquid comprises antigen retrieval agents capable of facilitating retrieval of antigen. In some embodiments, the staining liquid comprises detection agents that specifically label the target analyte in the sample.
In some embodiments, the sample contact area of one or both plates comprise a storage site that contains blocking agents, wherein the blocking agents are configured to disable non-specific endogenous species in the sample to react with detection agents that are used to specifically label the target analyte. In some embodiments, the sample contact area of one or both plates comprise a storage site that contains deparaffinizing agents capable of removing paraffin in the sample. In some embodiments. the sample contact area of one or both plates comprise a storage site that contains permeabilizing agents capable of permeabilizing cells in the tissue sample that contain the target analyte. In some embodiments. the sample contact area of one or both plates comprise a storage site that contains antigen retrieval agents capable of facilitating retrieval of antigen. In some embodiments, the sample contact area of one or both plates comprise a storage site that contains detection agents that specifically label the target analyte in the sample. In some embodiments, the sample contact area of one or both of the plates comprise a binding site that contains capture agents, wherein the capture agents are configured to bind to the target analyte on the surface of cells in the sample and immobilize the cells.
In some embodiments, the detection agent comprises dyes for a stain selected from the group consisting of: Acid fuchsin, Alcian blue 8 GX, Alizarin red S, Aniline blue WS, Auramine 0, Azocarmine B, Azocarmine G, Azure A, Azure B, Azure C, Basic fuchsine, Bismarck brown Y, Brilliant cresyl blue, Brilliant green, Carmine, Chlorazol black E, Congo red, C.I. Cresyl violet, Crystal violet, Darrow red, Eosin B, Eosin Y, Erythrosin, Ethyl eosin, Ethyl green, Fast green F
C F, Fluorescein lsothiocyanate, Giemsa Stain, Hematoxylin, Hematoxylin &
Eosin, Indigo carmine, Janus green B, Jenner stain 1899, Light green SF, Malachite green, Martius yellow, Methyl orange, Methyl violet 2B, Methylene blue, Methylene blue, Methylene violet, (Bernthsen), Neutral red, Nigrosin, Nile blue A, Nuclear fast red, Oil Red , Orange G, Orange II, Orcein, Pararosaniline, Phloxin B, Protargol S, Pyronine B, Pyronine , Resazurin, Rose Bengal, Safranine 0, Sudan black B, Sudan III, Sudan IV, Tetrachrome stain (MacNeal), Thionine, Toluidine blue, Weigert, Wright stain, and any combination thereof.
In some embodiments, the detection agent comprises antibodies configured to specifically bind to protein analyte in the sample.
In some embodiments, the detection agent comprises oligonucleotide probes configured to specifically bind to DNA and/or RNA in the sample.
In some embodiments, the detection agent is labeled with a reporter molecule, wherein the reporter molecule is configured to provide a detectable signal to be read and analyzed.
In some embodiments, the signal is selected from the group consisting of:
i. luminescence selected from photoluminescence, electroluminescence, and electrochemiluminescence;
ii. light absorption, reflection, transmission, diffraction, scattering, or diffusion;
iii. surface Raman scattering;
iv. electrical impedance selected from resistance, capacitance, and inductance;
v. magnetic relaxivity; and vi. any combination of i-v.
F-2. Immunohistochemistry In some embodiments, the devices and methods of the present invention are useful for conducting immunohistochemistry on the sample.
In immunohistochemical (IHC) staining methods, a tissue sample is fixed (e.g., in paraformaldehyde), optionally embedding in wax, sliced into thin sections that are less then 100 um thick (e.g., 2 um to 6 um thick), and then mounted onto a support such as a glass slide.
Once mounted, the tissue sections may be dehydrated using alcohol washes of increasing concentrations and cleared using a detergent such as xylene.
In most IHC methods, a primary and a secondary antibody may be used. In such methods, the primary antibody binds to antigen of interest (e.g., a biomarker) and is unlabeled.
The secondary antibody binds to the primary antibody and directly conjugated either to a reporter molecule or to a linker molecule (e.g., biotin) that can recruit reporter molecule that is in solution. Alternatively, the primary antibody itself may be directly conjugated either to a reporter molecule or to a linker molecule (e.g., biotin) that can recruit reporter molecule that is in solution. Reporter molecules include fluorophores (e.g., FITC, TRITC, AMCA, fluorescein and rhodamine) and enzymes such as alkaline phosphatase (AP) and horseradish peroxidase (HRP), for which there are a variety of fluorogenic, chromogenic and chemiluminescent substrates such as DAB or BCIP/NBT.
In direct methods, the tissue section is incubated with a labeled primary antibody (e.g.
an FITC-conjugated antibody) in binding buffer. The primary antibody binds directly with the antigen in the tissue section and, after the tissue section has been washed to remove any unbound primary antibody, the section is to be analyzed by microscopy.
In indirect methods, the tissue section is incubated with an unlabeled primary antibody that binds to the target antigen in the tissue. After the tissue section is washed to remove unbound primary antibody, the tissue section is incubated with a labeled secondary antibody that binds to the primary antibody.
After immunohistochemical staining of the antigen, the tissue sample may be stained with another dye, e.g., hematoxylin, Hoechst stain and DAPI, to provide contrast and/or identify other features.
The present device may be used for immunohistochemical (I HC) staining a tissue sample. In these embodiments, the device may comprise a first plate and a second plate, wherein: the plates are movable relative to each other into different configurations; one or both plates are flexible; each of the plates has, on its respective surface, a sample contact area for contacting a tissue sample or a I HC staining liquid; the sample contact area in the first plate is smooth and planner; the sample contact area in the second plate comprise spacers that are fixed on the surface and have a predetermined substantially uniform height and a predetermined constant inter-spacer distance that is in the range of 7 pm to 200 pm;
wherein one of the configurations is an open configuration, in which: the two plates are completely or partially separated apart, the spacing between the plates is not regulated by the spacers; and wherein another of the configurations is a closed configuration which is configured after a deposition of the sample and the I HC staining liquid in the open configuration; and in the closed configuration: at least part of the sample is between the two plates and a layer of at least part of staining liquid is between the at least part of the sample and the second plate, wherein the thickness of the at least part of staining liquid layer is regulated by the plates, the sample, and the spacers, and has an average distance between the sample surface and the second plate surface is equal or less than 250 pm with a small variation.
In some embodiments, the device may comprise a dry I HC staining agent coated on the sample contact area of one or both plates. In some embodiments, the device may comprise a dry I HC staining agent coated on the sample contact area of the second plate, and the I HC
staining liquid comprise a liquid that dissolve the dry I HC staining agent.
The device of claim 1, wherein the thickness of the sample is 2 um to 6 um.
F-3. H& E and Special stains In some embodiments, the devices and methods of the present invention are useful for conducting H&E stain and special stains.
Hematoxylin and eosin stain or haematoxylin and eosin stain (H&E stain or HE
stain) is one of the principal stains in histology. It is the most widely used stain in medical diagnosis and is often the gold standard; for example when a pathologist looks at a biopsy of a suspected cancer, the histological section is likely to be stained with H&E and termed "H&E section", "H+E
section", or "HE section". A combination of hematoxylin and eosin, it produces blues, violets, and reds.
In diagnostic pathology, the "special stain" terminology is most commonly used in the clinical environment, and simply means any technique other than the H & E
method that is used to impart colors to a specimen. This also includes immunohistochemical and in situ hybridization stains. On the other hand, the H & E stain is the most popular staining method in histology and medical diagnosis laboratories.
In any embodiments, the dry binding site may comprise a capture agent such as an antibody or nucleic acid. In some embodiments, the releasable dry reagent may be a labeled reagent such as a fluorescently-labeled reagent, e.g., a fluorescently-labeled antibody or a cell stain such Romanowsky's stain, Leishman stain, May-Grunwald stain, Giemsa stain, Jenner's stain, Wright's stain, or any combination of the same (e.g., Wright-Giemsa stain). Such a stain may comprise eosin Y or eosin B with methylene blue. In certain embodiments, the stain may be an alkaline stain such as haematoxylin.
In some embodiments, the special stains include, but not limited to, Acid fuchsin, Alcian blue 8 GX, Alizarin red S, Aniline blue WS, Auramine 0, Azocarmine B, Azocarmine G, Azure A, Azure B, Azure C, Basic fuchsine, Bismarck brown Y, Brilliant cresyl blue, Brilliant green, Carmine, Chlorazol black E, Congo red, C.I. Cresyl violet, Crystal violet, Darrow red, Eosin B, Eosin Y, Erythrosin, Ethyl eosin, Ethyl green, Fast green F C F, Fluorescein lsothiocyanate, Giemsa Stain, Hematoxylin, Hematoxylin & Eosin, Indigo carmine, Janus green B, Jenner stain 1899, Light green SF, Malachite green, Martius yellow, Methyl orange, Methyl violet 2B, Methylene blue, Methylene blue, Methylene violet, (Bernthsen), Neutral red, Nigrosin, Nile blue A, Nuclear fast red, Oil Red, Orange G, Orange II, Orcein, Pararosaniline, Phloxin B, Protargol S, Pyronine B, Pyronine , Resazurin, Rose Bengal, Safranine 0, Sudan black B, Sudan III, Sudan IV, Tetrachrome stain (MacNeal), Thionine, Toluidine blue, Weigert, Wright stain, and any combination thereof.
F-4. In Situ Hybridization In some embodiments, the devices and methods of the present invention are useful for conducting in situ hybridization (ISH) on histological samples.
In situ hybridization (ISH) is a type of hybridization that uses a labeled complementary DNA, RNA or modified nucleic acids strand (i.e., probe) to localize a specific DNA or RNA
sequence in a portion or section of tissue (in situ), or, if the tissue is small enough (e.g., plant seeds, Drosophila embryos), in the entire tissue (whole mount ISH), in cells, and in circulating tumor cells (CTCs).
In situ hybridization is used to reveal the location of specific nucleic acid sequences on chromosomes or in tissues, a crucial step for understanding the organization, regulation, and function of genes. The key techniques currently in use include: in situ hybridization to mRNA
with oligonucleotide and RNA probes (both radio-labelled and hapten-labelled);
analysis with light and electron microscopes; whole mount in situ hybridization; double detection of RNAs and RNA plus protein; and fluorescent in situ hybridization to detect chromosomal sequences. DNA
ISH can be used to determine the structure of chromosomes. Fluorescent DNA ISH
(FISH) can, for example, be used in medical diagnostics to assess chromosomal integrity.
RNA ISH (RNA in situ hybridization) is used to measure and localize RNAs (mRNAs, IncRNAs, and miRNAs) within tissue sections, cells, whole mounts, and circulating tumor cells (CTCs).
In some embodiments, the detection agent comprises nucleic acid probes for in situ hybridization staining. The nucleic acid probes include, but not limited to, oligonucleotide probes configured to specifically bind to DNA and/or RNA in the sample.
F-5. System and Method for Tissue Staining and Cell Imaging Also provided is a system for rapidly staining and analyzing a tissue sample using a mobile phone comprising:
(a) sample, staining liquid, and device as described above, (b) a mobile communication device comprising:
i. one or a plurality of cameras for the detecting and/or imaging the sample;
ii. electronics, signal processors, hardware and software for receiving and/or processing the detected signal and/or the image of the sample and for remote communication; and (c) a light source from either the mobile communication device or an external source.
Also provided is a method for rapidly staining and analyzing a tissue sample using a mobile phone, comprising:
(a) depositing a tissue sample and a staining liquid on the device of the system described above, and placing the two plate into a closed configuration;
(b) obtaining a mobile phone that has hardware and software of imaging, data processing, and communication;
(c) assaying by the tissue sample deposited on the CROF device by the mobile phone to generate a result; and (d) communicating the result from the mobile phone to a location remote from the mobile phone.
Also provided is a method for staining a tissue sample, comprising:
(a) obtaining a tissue sample;
(b) obtaining a stain liquid;
(c) obtaining a first plate and a second plate, wherein:
the plates are movable relative to each other into different configurations;
one or both plates are flexible;
each of the plates has, on its respective surface, a sample contact area for contacting a tissue sample or a I HC staining liquid;
the sample contact area in the first plate is smooth 5 and planner;
the sample contact area in the second plate comprise spacers that are fixed on the surface and have a predetermined substantially uniform height and a predetermined constant inter-spacer distance that is in the range of 7 pm to 200 pm;
(c) depositing the tissue sample and the stain liquid on the plates when the plates are configured in an open configuration, wherein the open configuration is a configuration in which the two plates are either partially or completely separated apart and the spacing between the plates is not regulated by the spacers; and (d), after (c), using the two plates to compress at least part of the tissue sample and at least part of the staining liquid into a closed configuration;
wherein in the closed configuration: at least part of the sample is between the two plates and a layer of at least part of staining liquid is between the at least part of the sample and the second plate, wherein the thickness of the at least part of staining liquid layer is regulated by the plates, the sample, and the spacers, and has an average distance between the sample surface and the second plate surface is equal or less than 250 pm with a small variation.
All of the benefits and advantages (e.g., an accelerated reaction, faster results, etc.) of other embodiments may be applied to this device, system and method.
Further, all parameters described above in the context of other embodiments (e.g., the size, spacing and shape of the spacers, the flexibility of the spacers and plates, and how the device and system can be used, etc.) can be incorporated into I HC embodiments described in this section.
For example, in some embodiments, the spacers regulating the layer of uniform thickness (i.e., the spacers that are spacing the plates away from each other in the layer) have a "filling factor" of at least 1 %, e.g., at least 2% or at least 5%, wherein the filling factor is the ratio of the spacer area that is in contact with the layer of uniform thickness to the total plate area that is in contact with the layer of uniform thickness. In some embodiments, for spacers regulating the layer of uniform thickness, the Young's modulus of the spacers times the filling factor of the spacers is equal or larger than 10 MPa, e.g., at least 15 MPa or at least 20 MPa, where the filling factor is the ratio of the spacer area that is in contact with the layer of uniform thickness to the total plate area that is in contact with the layer of uniform thickness.
In some embodiments, the thickness of the flexible plate times the Young's modulus of the flexible plate is in the range of 60 to 550 GPa-um, e.g., 100 to 300 GPa-um. In some embodiments, for a flexible plate, the fourth power of the inter-spacer-distance (ISD) divided by the thickness of the flexible plate (h) and the Young's modulus (E) of the flexible plate, ISD4/(hE), is equal to 5 or less than 106 um3/GPa, e.g., less than 105 um3/GPa, less than 104 um3/GPa or less than 103 um3/GPa.
In some embodiments, one or both plates comprise a location marker either on a surface .. of or inside the plate, that provide information of a location of the plate, e.g., a location that is going to be analyzed or a location onto which the section should be deposited.
In some cases, one or both plates may comprise a scale marker, either on a surface of or inside the plate, that provides information of a lateral dimension of a structure of the section and/or the plate. In some embodiments, one or both plates comprise an imaging marker, either on surface of or inside the plate, that assists an imaging of the sample. For example, the imaging marker could help focus the imaging device or direct the imaging device to a location on the device.
In some embodiments, the spacers can function as a location marker, a scale marker, an imaging marker, or any combination of thereof.
In some embodiments, the inter-spacer distance may substantially periodic. In some .. cases, the spacers may be in a regular pattern and the spacing between adjacent spacers may be approximately the same. In some embodiments, the spacers are pillars with a cross-sectional shape selected from round, polygonal, circular, square, rectangular, oval, elliptical, or any combination of the same and, in some embodiments, the spacers may have a substantially flat top surface, wherein, for each spacer, the ratio of the lateral dimension of the spacer to its height is at least 1. In some cases, the minimum lateral dimension of spacer is less than or substantially equal to the minimum dimension of an analyte in the sample. The minimum lateral dimension of spacer is in the range of 0.5 um to 100 um, e.g., in the range of 2 um to 50 um or 0.5 um to 10 um.
In some embodiments, the spacers have a pillar shape and the sidewall corners of the spacers have a round shape with a radius of curverture at least 1 um, e.g., at least 1.2 um, at least 1.5 um or at least 2.0 um. The spacers may have any convenient density, e.g., a density of at least 1000/mm2, e.g., a density of at least 1000/mm2, a density of at least 2000/mm2, a density of at least 5,000/mm2 or a density of at least 10,000/mm2.
In this device, at least one of the plates may be transparent, thereby allowing the assay to be read optically. Likewise, in this device, at least one of the plates may be made of a flexible polymer, thereby allowing the sample to be efficiently spread by compressing the plates together. In some embodiments, the pressure that compresses the plates, the spacers are not compressible and/or, independently, only one of the plates is flexible. The flexible plate may .. have a thickness in the range of 20 um to 200 um, e.g., 50 um to 150 um. As noted above, in the closed position, the thickness of the layer of uniform thickness may have a small variation.
In some embodiments, the variation may be less than 10%, less than 5% or less than 2%, meaning that the thickness of the area does not exceed +/- 10%, +/- 5% 5 or +/- 2% of the average thickness.
In some embodiments, the first and second plates are connected and the device can be changed from the open configuration to the closed configuration by folding the plates. In some embodiments, the first and second plates can be connected by a hinge and the device can be changed from the open configuration to the closed configuration by folding the plates such that the device bends along the hinge. The hinge may be a separate material that is attached to the plates or, in some cases, the plates may be integral with the plates.
In some embodiments, the device may be capable of analyzing the section very rapidly.
In some cases, the analysis may be done in 60 seconds or less, in 30 seconds, in 20 seconds or 15 less or in 10 seconds or less.
In some embodiments, the system may additionally comprise (d) a housing configured to hold the sample and to be mounted to the mobile communication device. The housing may comprise optics for facilitating the imaging and/or signal processing of the sample by the mobile communication device, and a mount configured to hold the optics on the mobile communication device. In some cases, an element of the optics of the device (e.g., a lens, filter, mirror, prism or a beamsplitter, may be movable) such that the sample may be imaged in at least two channels.
In some embodiments, the mobile communication device may be configured to communicate test results to a medical professional (e.g., an MD), a medical facility (e.g., a hospital or testing lab) or an insurance company. In addition, the mobile communication device may be configured to communicate information on the subject (e.g., the subject's age, gender, weight, address, name, prior test results, prior medical history, etc.) with the medical professional, medical facility or insurance company. In certain embodiments, the mobile communication device may be configured to receive a prescription, diagnosis or a recommendation from a medical professional. For example, in some embodiments the mobile communication device may send assay results to a remote location where a medical professional gives a diagnosis. The diagnosis may be communicated to the subject via the mobile communication device.
In some embodiments, the mobile communication device may contain hardware and software that allows it to (a) capture an image of the sample; (b) analyze a test location and a control location in in image; and (c) compare a value obtained from analysis of the test location to a threshold value that characterizes the rapid diagnostic test. In some cases, the mobile communication device communicates with the remote location via a wireless or cellular network.
In any embodiment, the mobile communication device may be a mobile phone.
The system may be used in a method that comprises (a) sample on the device of the system; (b) assaying the sample deposited on the device to generate a result;
and (c) communicating the result from the mobile communication device to a location remote from the mobile communication device. The method may comprise analyzing the results at the remote location to provide an analyzed result; and communicating the analyzed result from the remote location to the mobile communication device. As noted above, the analysis may be done by a medical professional at a remote location. And, in some embodiments, the mobile communication device may receive a prescription, diagnosis or a recommendation from a medical professional at a remote location.
Also provided is a method for analyzing a tissue section. In some embodiments, this method may comprise obtaining a device as described above, depositing the section onto one or both pates of the device; placing the plates in a closed configuration and applying an external force over at least part of the plates; and analyzing the sample in the layer of uniform thickness while the plates are the closed configuration.
In some embodiments, this method may comprise:
(a) obtaining a tissue section;
(b) obtaining a first and second plates that are movable relative to each other into different configurations, wherein each plate has a sample contact surface that is substantially planar, one or both plates are flexible, and one or both of the plates comprise spacers that are fixed with a respective sample contacting surface, and wherein the spacers have:
i. a predetermined substantially uniform height, ii. a shape of pillar with substantially uniform cross-section and a flat top surface;
iii. a ratio of the width to the height equal or larger than one;
iv. a predetermined constant inter-spacer distance that is in the range of 10 pm to 200 pm;
v. a filling factor of equal to 1% or larger; and (c) depositing the section on one or both of the plates when the plates are configured in an open configuration, wherein the open configuration is a configuration in which 5 the two plates are either partially or completely separated apart and the spacing between the plates is not regulated by the spacers;
(d), after (c), using the two plates to compress at least part of the section into a layer of substantially uniform thickness that is confined by the sample contact surfaces of the plates, wherein the uniform thickness of the layer is regulated by the spacers and the plates, and has an average value in the range of 1.8 pm to 3 pm with a variation of less than 10%, wherein the compressing comprises:
bringing the two plates together; and conformable pressing, either in parallel or sequentially, an area of at least one of the plates to press the plates together to a closed configuration, wherein the conformable pressing generates a substantially uniform pressure on the plates over the at least part of the sample, and the pressing spreads the at least part of the sample laterally between the sample contact surfaces of the plates, and wherein the closed configuration is a configuration in which the spacing between the plates in the layer of uniform thickness region is regulated by the spacers;
and (e) analyzing the section in the layer of uniform thickness while the plates are the closed configuration;
wherein the filling factor is the ratio of the spacer contact area to the total plate area;
wherein a conformable pressing is a method that makes the pressure applied over an area is substantially constant regardless the shape variation of the outer surfaces of the plates;
and wherein the parallel pressing applies the pressures on the intended area at the same time, and a sequential pressing applies the pressure on a part of the intended area and gradually move to other area.
In some embodiments, this method may comprise: removing the external force after the plates are in the closed configuration; imaging the section in the layer of uniform thickness while the plates are the closed configuration. As noted above, in these embodiments, the inter-spacer distance may in the range of 20 um to 200 um or 5 um to 20 um. In these embodiments, the product of the filling factor and the Young's modulus of the spacer is 2 M Pa or larger. In some embodiments, the surface variation is less than 30 nm.
In any of these embodiments, the imaging and counting may be done by: i.
illuminating the section in the layer of uniform thickness; ii. taking one or more images of the section using a CCD or CMOS sensor.
In some embodiments, the external force may be provided by human 5 hand, e.g., by pressing down using a digit such as a thumb, or pinching between a thumb and another digit such as a forefinger on the same hand.
In some embodiments, one or more of the plates may comprises a dry reagent coated on one or both plates (e.g., a binding agent, a staining agent, a detection agent or an assay reactant).
In some embodiments, the layer of uniform thickness sample may a thickness uniformity of up to +/-5%, e.g., up to +/-2% or up to +/-1%.
In some embodiments, the spacers are pillars with a cross-sectional shape selected from round, polygonal, circular, square, rectangular, oval, elliptical, or any combination of the same.
F-6. Examples of Present Invention FA1. A device for analyzing a tissue sample, comprising:
a first plate, a second plate, and spacers, wherein:
the plates are movable relative to each other into different configurations;
one or both plates are flexible;
iii. each of the plates has, on its respective inner surface, a sample contact area for contacting a staining liquid and/or a tissue sample suspected of containing a target analyte;
iv. one or both of the plates comprise the spacers that are fixed with a respective plate;
v. the spacers have a predetermined substantially uniform height and a predetermined inter-spacer distance; and vi. at least one of the spacers is inside the sample contact area;
wherein one of the configurations is an open configuration, in which: the two plates are partially or entirely separated apart, the spacing between the plates is not regulated by the spacers, and the staining liquid and the sample are deposited on one or both of the plates;
wherein another of the configurations is a closed configuration, which is configured after the deposition of the staining liquid and the sample in the open configuration, and in the closed configuration: at least part of the sample is between the two plates and a layer of at least part of staining liquid is between the at least part of the sample and the second plate, wherein the thickness of the at least part of staining liquid layer is regulated by the plates, the sample, and the spacers, and has an average distance between the sample surface and the second plate surface is equal or less than 250 pm with a small variation.
FAA1. A device for analyzing a tissue sample, comprising:
a first plate, a second plate, and spacers, wherein:
the plates are movable relative to each other into different configurations;
one or both plates are flexible;
each of the plates has, on its respective inner surface, a sample contact area for contacting a transfer solution and/or a tissue sample suspected of containing a target analyte;
iv. one or both of the plates comprise stain agent that is dried on the respective sample contact area and configured to, upon contacting the transfer solution, dissolve in the transfer solution and stain the tissue sample;
v. one or both of the plates comprise the spacers that are fixed with a respective plate;
vi. the spacers have a predetermined substantially uniform height and a predetermined inter-spacer distance; and vii. at least one of the spacers is inside the sample contact area;
wherein one of the configurations is an open configuration, in which: the two plates are partially or entirely separated apart, the spacing between the plates is not regulated by the spacers, and the staining liquid and the sample are deposited on one or both of the plates;
wherein another of the configurations is a closed configuration, which is configured after the deposition of the staining liquid and the sample in the open configuration, and in the closed configuration: at least part of the sample is between the two plates and a layer of at least part of transfer solution is between the at least part of the sample and the second plate, wherein the thickness of the at least part of transfer solution layer is regulated by the plates, the sample, and the spacers, and has an average distance between the sample surface and the second plate surface is equal or less than 250 pm with a small variation.
FB1. A method for analyzing a tissue sample, comprising the steps of:
(a) obtaining a tissue sample suspected of containing a target analyte and a staining liquid;
(b) obtaining a first plate, a second plate, and spacers, wherein:
the plates are movable relative to each other into different configurations;
one or both plates are flexible;
each of the plates has, on its respective inner surface, a sample contact area for contacting the staining liquid and/or the tissue sample;
iv. one or both of the plates comprise the spacers that are fixed with a respective plate;
v. the spacers have a predetermined substantially uniform height and a predetermined inter-spacer distance; and vi. at least one of the spacers is inside the sample contact area;
(c) depositing the staining liquid and the tissue sample on one or both of the plates when the plates are in an open configuration, wherein the open configuration is a configuration in which the two plates are partially or entirely separated apart, the spacing between the two plates is not regulated by the spacers, and the sample and the staining liquid are deposited on one or both of the plates;
(d) after (c), bringing the two plates together and pressing the plates into a closed configuration, wherein the pressing comprises conformable pressing, either in parallel or sequentially, an area of at least one of the plates to press the plates together to the closed configuration, wherein the conformable pressing generates a substantially uniform pressure on the plates over the at least part of the sample, and the pressing spreads the at least part of the sample laterally between the inner surfaces of the plates;
and wherein another of the configurations is the closed configuration, which is configured after the deposition of the staining liquid and the sample in the open configuration, and in the closed configuration: at least part of the sample is between the two plates and a layer of at least part of staining liquid is between the at least part of the sample and the second plate, wherein the thickness of the at least part of staining liquid layer is regulated by the plates, the sample, and the spacers, and has an average distance between the sample surface and the second plate surface is equal or less than 250 pm with a small variation;
and (e) analyzing the target analyte when the plates are in the closed configuration.
FBB1. A method for analyzing a tissue sample, comprising the steps of:
(a) obtaining a tissue sample suspected of containing a target analyte and a transfer solution;
(b) obtaining a first plate, a second plate, and spacers, wherein:
the plates are movable relative to each other into different configurations;
ii. one or both plates are flexible;
each of the plates has, on its respective inner surface, a sample contact area for contacting a staining liquid and/or a tissue sample suspected of containing a target analyte;
iv. one or both of the plates comprise stain agents that are coated on the respective sample contact area and configured to, upon contacting a transfer solution, dissolve in the transfer solution and stain the tissue sample;
v. one or both of the plates comprise the spacers that are fixed with a respective plate;
vi. the spacers have a predetermined substantially uniform height and a predetermined inter-spacer distance; and vii. at least one of the spacers is inside the sample contact area;
(c) depositing the staining liquid and the tissue sample on one or both of the plates when the plates are in an open configuration, wherein the open configuration is a configuration in which the two plates are partially or entirely separated apart, the spacing between the two plates is not regulated by the spacers, and the sample and the staining liquid are deposited on one or both of the plates;
(d) after (c), bringing the two plates together and pressing the plates into a closed configuration, wherein the pressing comprises conformable pressing, either in parallel or sequentially, an area of at least one of the plates to press the plates together to the closed configuration, wherein the conformable pressing generates a substantially uniform pressure on the plates over the at least part of the sample, and the pressing spreads the at least part of the sample laterally between the inner surfaces of the plates;
and wherein another of the configurations is the closed configuration, which is configured after the deposition of the staining liquid and the sample in the open configuration, and in the closed configuration: at least part of the sample is between the two plates and a layer of at least part of staining liquid is between the at least part of the sample and the second plate, wherein the thickness of the at least part of staining liquid layer is regulated by the plates, the sample, and the spacers, and has an average distance between the sample surface and the second plate surface is equal or less than 250 pm with a small variation;
and (e) analyzing the target analyte when the plates are in the closed configuration.
FA2. The device of embodiment FA1, wherein one or both of the plates is configured such that the sample can dried thereon at the open configuration, and wherein the sample comprises bodily fluid selected from the group consisting of: amniotic fluid, aqueous humour, vitreous humour, blood (e.g., whole blood, fractionated blood, plasma or serum), breast milk, cerebrospinal fluid (CSF), cerumen (earwax), chyle, chime, endolymph, perilymph, feces, breath, gastric acid, gastric juice, lymph, mucus (including nasal drainage and phlegm), pericardial fluid, peritoneal fluid, pleural fluid, pus, rheum, saliva, exhaled breath condensates, sebum, semen, sputum, sweat, synovial fluid, tears, vomit, urine, and any combination thereof.
FAA2. The device of any prior embodiment, wherein the staining liquid has a viscosity in the range of 0.1 to 3.5 mPa S.
FA3. The device of any prior embodiment, wherein the sample contact area of one or both of the plates is configured such that the sample can dried thereon at the open configuration, and wherein the sample comprises blood smear and is dried on one or both plates.
FA4. The device of any prior embodiment, wherein the sample contact area of one or both of the plates is adhesive to the sample, and wherein the sample is a tissue section having a thickness in the range of 1 ¨ 200 um.
FA5. The device of embodiment FA4, wherein the sample is paraffin-embedded.
FA6. The device of any of embodiment, wherein the sample is fixed.
FA7. The device of any prior embodiment, wherein the staining liquid comprises fixative capable of fixing the sample.
FA8. The device of any prior embodiment, wherein the staining liquid comprises blocking agents, wherein the blocking agents are configured to disable non-specific endogenous species in the sample to react with detection agents that are used to specifically label the target analyte.
FA9. The device of any prior embodiment, wherein the staining liquid comprises deparaffinizing agents capable of removing paraffin in the sample.
FA10. The device of any prior embodiment, wherein the staining liquid comprises permeabilizing agents capable of permeabilizing cells in the tissue sample that contain the .. target analyte.
FA11. The device of any prior embodiment, wherein the staining liquid comprises antigen retrieval agents capable of facilitating retrieval of antigen.
FA12. The device of any prior embodiment, wherein the staining liquid comprises detection agents that specifically label the target analyte in the sample.
FA13. The device of any prior embodiment, wherein the sample contact area of one or both plates comprise a storage site that contains blocking agents, wherein the blocking agents are configured to disable non-specific endogenous species in the sample to react with detection agents that are used to specifically label the target analyte.
FA14. The device of any prior embodiment, wherein the sample contact area of one or both plates comprise a storage site that contains deparaffinizing agents capable of removing paraffin in the sample.
FA15. The device of any prior embodiment, wherein the sample contact area of one or both plates comprise a storage site that contains permeabilizing agents capable of permeabilizing cells in the tissue sample that contain the target analyte.
FA16. The device of any prior embodiment, wherein the sample contact area of one or both plates comprise a storage site that contains antigen retrieval agents capable of facilitating retrieval of antigen.
FA17. The device of any prior embodiment, wherein the sample contact area of one or both plates comprise a storage site that contains detection agents that specifically label the target analyte in the sample.
FA18. The device of any prior embodiment, wherein the detection agent comprises dyes for a stain selected from the group consisting of: Acid fuchsin, Alcian blue 8 GX, Alizarin red S, Aniline blue WS, Auramine 0, Azocarmine B, Azocarmine G, Azure A, Azure B, Azure C, Basic fuchsine, Bismarck brown Y, Brilliant cresyl blue, Brilliant green, Carmine, Chlorazol black E, Congo red, C.I. Cresyl violet, Crystal violet, Darrow red, Eosin B, Eosin Y, Erythrosin, Ethyl eosin, Ethyl green, Fast green F C F, Fluorescein lsothiocyanate, Giemsa Stain, Hematoxylin, Hematoxylin & Eosin, Indigo carmine, Janus green B, Jenner stain 1899, Light green SF, Malachite green, Martius yellow, Methyl orange, Methyl violet 2B, Methylene blue, Methylene blue, Methylene violet, (Bernthsen), Neutral red, Nigrosin, Nile blue A, Nuclear fast red, Oil Red , Orange G, Orange II, Orcein, Pararosaniline, Phloxin B, Protargol S, Pyronine B, Pyronine , Resazurin, Rose Bengal, Safranine 0, Sudan black B, Sudan III, Sudan IV, Tetrachrome stain (MacNeal), Thionine, Toluidine blue, Weigert, Wright stain, and any combination thereof.
FA19. The device of any prior embodiment, wherein the detection agent comprises antibodies configured to specifically bind to protein analyte in the sample.
FA20. The device of any prior embodiment, wherein the detection agent comprises oligonucleotide probes configured to specifically bind to DNA and/or RNA in the sample.
FA21. The device of any prior embodiment, wherein the detection agent is labeled with a reporter molecule, wherein the reporter molecule is configured to provide a detectable signal to be read and analyzed.
FA22. The device of embodiment FA21, wherein the signal is selected from the group consisting of:
i. luminescence selected from photoluminescence, electroluminescence, and electrochemiluminescence;
ii. light absorption, reflection, transmission, diffraction, scattering, or diffusion;
iii. surface Raman scattering;
iv. electrical impedance selected from resistance, capacitance, and inductance;
v. magnetic relaxivity; and vi. any combination of i-v.
FA23. The device of any prior embodiment, wherein the sample contact area of one or both of the plates comprise a binding site that contains capture agents, wherein the capture agents are configured to bind to the target analyte on the surface of cells in the sample and immobilize the cells.
FB2. The method of embodiment F131, wherein the depositing step (c) comprises depositing and drying the sample on one or both of the plates before depositing the remaining of the staining liquid on top of the dried sample, and wherein the sample comprises bodily fluid selected from the group consisting of: amniotic fluid, aqueous humour, vitreous humour, blood (e.g., whole blood, fractionated blood, plasma or serum), breast milk, cerebrospinal fluid (CSF), cerumen (earwax), chyle, chime, endolymph, perilymph, feces, breath, gastric acid, gastric juice, lymph, mucus (including nasal drainage and phlegm), pericardial fluid, peritoneal fluid, pleural fluid, pus, rheum, saliva, exhaled breath condensates, sebum, semen, sputum, sweat, synovial fluid, tears, vomit, urine, and any combination thereof.
FBB2. The method of any prior embodiment, wherein the staining liquid has a viscosity in the range of 0.1 to 3.5 mPa S.
FB3. The method of any prior embodiment, wherein the depositing step (c) comprises depositing and drying the sample on one or both of the plates before depositing the remaining of the staining liquid on top of the dried sample, and wherein the sample comprises blood smear and is dried on one or both plates.
FB4. The method of any prior embodiment, wherein the depositing step (c) comprises depositing and attaching the sample to one or both of the plates before depositing the staining liquid on top of the sample, wherein the sample contact area of one or both of the plates is adhesive to the sample, and wherein the sample is a tissue section having a thickness in the range of 1 ¨200 Em.
FB5. The device of embodiment FA4, wherein the sample is paraffin-embedded.
FB6. The method of any of embodiment, wherein the sample is fixed.
FB7. The method of any prior embodiment, wherein the staining liquid comprises fixative capable of fixing the sample.
FB8. The method of any prior embodiment, wherein the staining liquid comprises blocking agents, wherein the blocking agents are configured to disable non-specific endogenous species in the sample to react with detection agents that are used to specifically label the target analyte.
FB9. The method of any prior embodiment, wherein the staining liquid comprises deparaffinizing agents capable of removing paraffin in the sample.
B10. The method of any prior embodiment, wherein the staining liquid comprises permeabilizing agents capable of permeabilizing cells in the tissue sample that contain the target analyte.
FB11. The method of any prior embodiment, wherein the staining liquid comprises antigen retrieval agents capable of facilitating retrieval of antigen.
FB12. The method of any prior embodiment, wherein the staining liquid comprises detection agents that specifically label the target analyte in the sample.
FB13. The method of any prior embodiment, wherein the sample contact area of one or both plates comprise a storage site that contains blocking agents, wherein the blocking agents are configured to disable non-specific endogenous species in the sample to react with detection agents that are used to specifically label the target analyte.
FB14. The method of any prior embodiment, wherein the sample contact area of one or both plates comprise a storage site that contains deparaffinizing agents capable of removing paraffin in the sample.
FB15. The method of any prior embodiment, wherein the sample contact area of one or both plates comprise a storage site that contains permeabilizing agents capable of permeabilizing cells in the tissue sample that contain the target analyte.
FB16. The method of any prior embodiment, wherein the sample contact area of one or both plates comprise a storage site that contains antigen retrieval agents capable of facilitating retrieval of antigen.
FB17. The method of any prior embodiment, wherein the sample contact area of one or both plates comprise a storage site that contains detection agents that specifically label the target analyte in the sample.
FB18. The method of any prior embodiment, wherein the detection agent comprises dyes for a stain selected from the group consisting of: Acid fuchsin, Alcian blue 8 GX, Alizarin red S, Aniline blue WS, Auramine 0, Azocarmine B, Azocarmine G, Azure A, Azure B, Azure C, Basic fuchsine, Bismarck brown Y, Brilliant cresyl blue, Brilliant green, Carmine, Chlorazol black E, Congo red, C.I. Cresyl violet, Crystal violet, Darrow red, Eosin B, Eosin Y, Erythrosin, Ethyl eosin, Ethyl green, Fast green F C F, Fluorescein lsothiocyanate, Giemsa Stain, Hematoxylin, Hematoxylin & Eosin, Indigo carmine, Janus green B, Jenner stain 1899, Light green SF, Malachite green, Martius yellow, Methyl orange, Methyl violet 2B, Methylene blue, Methylene blue, Methylene violet, (Bernthsen), Neutral red, Nigrosin, Nile blue A, Nuclear fast red, Oil Red , Orange G, Orange II, Orcein, Pararosaniline, Phloxin B, Protargol S, Pyronine B, Pyronine , Resazurin, Rose Bengal, Safranine 0, Sudan black B, Sudan III, Sudan IV, Tetrachrome stain (MacNeal), Thionine, Toluidine blue, Weigert, Wright stain, and any combination thereof.
FB19. The method of any prior embodiment, wherein the detection agent comprises antibodies configured to specifically bind to protein analyte in the sample.
FB20. The method of any prior embodiment, wherein the detection agent comprises oligonucleotide probes configured to specifically bind to DNA and/or RNA in the sample.
FB21. The method of any prior embodiment, wherein the detection agent is labeled with a reporter molecule, wherein the reporter molecule is configured to provide a detectable signal to be read and analyzed.
FB22. The device of embodiment FB21, wherein the signal is selected from the group consisting of:
i. luminescence selected from photoluminescence, electroluminescence, and electrochemiluminescence;
ii. light absorption, reflection, transmission, diffraction, scattering, or diffusion;
iii. surface Raman scattering;
iv. electrical impedance selected from resistance, capacitance, and inductance;
v. magnetic relaxivity; and vi. any combination of i-v.
FB23. The method of any prior embodiment, wherein the sample contact area of one or both of the plates comprise a binding site that contains capture agents, wherein the capture agents are configured to bind to the target analyte on the surface of cells in the sample and immobilize the cells.
FB24. The method of any prior embodiment, before step (e), further comprising:
incubating the sample at the closed configuration for a period of time that is longer than the time it takes for the detection agent to diffuse across the layer of uniform thickness and the sample.
FB25. The method of any prior embodiment, before step (e), further comprising:
incubating the sample at the closed configuration at a predetermined temperature in the range of 30 ¨ 75 C.
FB26. The method of any prior embodiment, wherein the staining liquid comprises the transfer solution.
G. Dual Lens imaging system But nowadays dual cameras are more and more common on state-of-art smartphones, which offers more possibilities of smartphone based imaging. By using two cameras, two different areas of the sample can be imaged at the same time, which is equivalent to a much larger field of view. And what's more, each camera can be used to do microscopy imaging at a different resolution. For example, one camera can do microscopy with lower resolution but larger field of view to image large objects in sample and the other camera can do microscopy with higher resolution but smaller field of view to image small objects. This is useful when the sample for imaging has mixed small objects and large objects. Hence, it is highly desirable to provide the users the smartphone imaging system based on dual cameras.
Dual camera imaging system FIG. 19-A is the schematic illustration of the dual camera imaging system. The dual camera imaging system comprises a mobile computing device (e.g. smartphone) having two built-in camera modules, two external lenses, a QMAX device and light source. Each camera module has an internal lens and an image sensor. The QMAX device is located under the two camera modules. Each external lens is placed between QMAX device and its corresponding internal lens at the appropriate height where the sample in QMAX device can be clearly focused on the image sensor. Each external lens is aligned with its corresponding internal lens.
The light captured by the imaging sensor can be refracted from the specimen, emitted from the specimen, etc. The light captured by the imaging sensor covers visible wavelength and can illuminate on the sample in QMAX device from back or top side in a normal or oblique incidence angle.
Dual camera imaging system for large FOV imaging One embodiment is that the dual camera imaging system is used for large FOV
imaging.
In this embodiment, the images taken by both camera have the same scale or optical magnification. To achieve this, the focal length of external lens 1 fEi, the focal length of internal lens 1 fNi, the focal length of external lens 2 fE2 and the focal length of internal lens 2 fN2 satisfy the relationship: ¨ffNEli = ffNE22.
The distance between two cameras is chosen to an appropriate value so that the FOVs of both cameras have overlap. As shown in FIG. 19-B, the letter "A" represents the sample, due to the overlap between the FOVs of two cameras, some part of the letter "A" exist in both the FOV
of camera 1 and FOV of camera 2.
A further image processing step is used to merge the two images into one large image by matching the same feature shared by the two images taken by camera 1 and camera 2.
Dual camera imaging system for dual resolution imaging The lens-based imaging system has the intrinsic drawback that it has the trade-off between the size of FOV and resolution. To achieve large FOV, the resolution of the imaging system need to be sacrificed. This problem is more concerned when the sample has mixed small and large objects with significant different size scale. In order to image enough number of large objects the FOV need to be large enough, but that will lose the resolution to get the details of the small objects. To solve this problem, in this embodiment, the dual camera imaging system is used for achieve dual resolution imaging on a same sample, in which camera 1 (or 2) is used for low resolution and large FOV imaging and camera 2 ( or 1) is used for high resolution and small FOV
imaging.
The resolution of the imaging system depends on the optical magnification and the optical magnification is equal to the ratio of the focal length of the external lens to the focal length of the internal length. For example, in this embodiment, camera 1 is used for low resolution imaging and camera 2 is used for high resolution imaging, then the focal length of external lens 1 fEi, the focal length of internal lens 1 fNi, the focal length of external lens 2 fE2 and the focal length of internal lens 2 fN2 satisfy the relationship: ¨
ffNE1 < ffNE22.
The FOVs of both cameras can have overlap or no overlap.
As shown in FIG. 19-C, the sample image taken by camera 1 covers larger FOV
and contains more objects in a single FOV but cannot resolve the detail of the small objects. And the image taken by camera 2 covers a relatively small FOV and contains fewer objects in a single FOV but has higher resolution that can resolve the details in the small objects.
Examples of Present Invention Al. A dual lens imaging device, comprising:
a first external lens, a second external lens, a housing unit, and a card unit, wherein:
the housing unit is configured to accommodate the first and second external lenses and the card unit, and to connect the dual length imaging device with a mobile device;
the first and the second external lenses are configured to respectively align with two internal lenses in the mobile device; and the card unit is configured to accommodate a specimen card, which contains a sample, wherein the card unit is positioned between the external lenses and the internal lenses;
wherein the external lenses are configured to focus illuminating light that is refracted or emitted from the specimen card onto image sensors in the mobile device, allowing the image sensors to capture images of the sample.
Bl. A dual lens imaging system, comprising:
(a) the dual lens imaging device of embodiment Al, (b) the mobile device, which comprises hardware and software to capture and process images of the sample through the dual lens imaging device.
Cl. The device or system of any prior embodiments, wherein the specimen card is a QMAX
card.
02. The device or system of any prior embodiments, wherein the mobile device is a mobile communication device.
03. The device or system of any prior embodiments, wherein mobile device is a smart phone.
04. The device or system of any prior embodiments, wherein the mobile device comprises a light source, which provides light to the specimen card.
05. The device or system of any prior embodiments, wherein the two external lenses are configured to capture overlapping images that are at least partly overlapping.
06. The device or system or embodiment 05, wherein the overlapping images have the same resolution.
07. The device or system of embodiment 06, wherein the software is configured to process the overlapping images to generate a combined image of the sample.
08. The device or system of embodiment C5, wherein the overlapping images have the different resolutions.
09. The device or system of embodiment 08, wherein the software is configured to process the overlapping images illustrate specific portions of the image having lower resolution.
010. The device or system of any prior embodiment, wherein the two external lenses are configured to image two different locations of a sample area of the Q-Card.
C1 1. The device or system of any prior embodiment, wherein the two external lenses are configured to have different size of FoV (field of view from each other).
012. The device or system of any prior embodiment, wherein the two external lenses are configured to have different size of FoV (field of view from each other), and wherein the ratio of the two different of FoV is 1.1, 1.2, 1.5,2, 5, 10, 15, 20, 30, 50, 100, 200, 1000, or in a range of any value of the two. A preferred ratio is 1.2, 1.5, 2, 5, 10, 20, or in a range of any value of the two.
013. The device or system of any prior embodiment, wherein overlap of FoV of the two external lenses are configured to be around 1%, 5%, 10%, 20%, 50%, 60%, 70%, 80%, 90%, or a range between any two of these values.
014. The device or system of any prior embodiment, wherein the two external lenses are optically coupled with different optical filters and/or polarizers.
Other Embodiments An optical adaptor for imaging an sample using a hand-held imaging device that has a light source, a single camera, and a computer processor, comprising:
an enclosure;
a cavity within the enclosure; and a lever within the cavity, wherein the lever comprises at least one optical element and is configured to be moveable between a first position and a second position, wherein (i) in the first position, said imaging device is capable of imaging a sample in a bright field mode, and (ii) in the second position, said imaging device is capable of imaging the sample in a fluorescence excitation mode.
An optical adaptor for imaging an sample using a hand-held imaging device that has a light source, a single camera, and a computer processor, comprising:
an enclosure;
a lens arranged to provide a field of view for the camera;
a cavity within the enclosure for receiving the sample and positioning the sample within the field of view of the camera, wherein the lens is positioned to receive light refracted by or emitted by the sample when in the field of view of the camera; and a lever within the cavity, wherein the lever comprises at least one optical element and is configured to be moveable between a first position and a second position, wherein (i) in the first position, said imaging device is capable of imaging a sample in a bright field mode, and (ii) in the second position, said imaging device is capable of imaging the sample in a fluorescence excitation mode.
An optical adaptor for imaging an sample using a hand-held imaging device that has a light source, a single camera, and a computer processor, comprising:
an enclosure;
a cavity within the enclosure for receiving the sample and positioning the sample within a field of view of the camera; and a lever within the cavity, wherein the lever comprises at least one optical element and is configured to be moveable between a first position and a second position, wherein (i) in the first position, said imaging device is capable of imaging a sample in a bright field mode, and (ii) in the second position, said imaging device is capable of imaging the sample in a fluorescence excitation mode, and wherein the lever comprises a first planar region extending along a first plane and a second planar region laterally displaced along a first direction from the first planar region and extending along a second plane, the first plane being disposed at a different height along a second direction from the second plane, the second direction being orthogonal to the first direction.
An optical adaptor for imaging an sample using a hand-held imaging device that has a light source, a single camera, and a computer processor, comprising:
an enclosure;
a cavity within the enclosure for receiving the sample and positioning the sample within a field of view of the camera; and a lever within the cavity, wherein the lever comprises at least one optical element and is configured to be moveable between a first position and a second position, wherein (i) in the first position, said imaging device is capable of imaging a sample in a bright field mode, and (ii) in the second position, said imaging device is capable of imaging the sample in a fluorescence excitation mode, and wherein the lever comprises a first planar region extending along a first plane and a second planar region laterally displaced along a first direction from the first planar region and extending along a second plane, the first plane being disposed at a different height along a second direction from the second plane, the second direction being orthogonal to the first direction, and wherein the first planar region comprises at least one optical element, and the second planar region comprises at least one optical element.
An optical adaptor for imaging an sample using a hand-held imaging device that has a light source, a single camera, and a computer processor, comprising:
an enclosure;
a cavity within the enclosure; and a lever within the cavity, wherein the lever comprises at least one optical element and is configured to be moveable between at least three different positions, wherein (i) in a first position, said imaging device is capable of imaging a sample in a bright field mode, (ii) in a second position, said imaging device is capable of imaging the sample in a fluorescence excitation mode, and (iii) in a third position, said imaging device is capable of measuring optical absorption of the sample.
An optical adaptor for imaging an sample using a hand-held imaging device that has a light source, a single camera, and a computer processor, comprising:
an enclosure;
a lens configured to provide a field of view for the camera;
a cavity within the enclosure for receiving the sample and positioning the sample within the field of view of the camera;
an aperture within the enclosure, wherein the aperture is arranged to receive source light from the light source for illuminating the sample; and a lever within the cavity, wherein the lever comprises at least one optical element and is configured to be moveable between a first position and a second position, wherein (i) in a first position, said imaging device is capable of imaging a sample in a bright field mode, (ii) in a second position, said imaging device is capable of imaging the sample in a fluorescence excitation mode, wherein in the fluorescence excitation mode, the lens is arranged to receive light emitted by the sample when the sample is illuminated by the source light.
An optical adaptor for imaging an sample using a smart phone that has a light source, a single camera, and a computer processor, comprising:
an enclosure;
a lens configured to provide a field of view for the camera;
a cavity within the enclosure for receiving the sample and positioning the sample within the field of view of the camera; and a lever within the cavity, wherein the lever comprises at least one optical element and is configured to be moveable between a first position and a second position, wherein (i) in a first position, said imaging device is capable of imaging a sample in a bright field mode, and (ii) in a second position, said imaging device is capable of imaging the sample in a fluorescence excitation mode.
An optical assembly attachable to a hand-held electronic device having a light source, a camera, and a computer processor, wherein the optical assembly is configured to enable microscopic imaging of a sample by the camera with illumination of the sample by light from the light source, the optical assembly comprising:
an enclosure;
a cavity within the enclosure;
a lens configured to provide a microscopic field of view for the camera; and moveable arm within the cavity, wherein the moveable arm is configurable to switch between a first position and a second position, wherein when the moveable arm is in the first position, the optical assembly is in a bright field mode, and when the moveable arm is in the second position, the optical assembly is in a fluorescence excitation mode.
The optical assembly of any embodiments, wherein the enclosure comprises:
a sample receptacle region within the cavity; and a slot on a side of the enclosure, wherein the slot is arranged to receive a sample substrate within the sample receptacle region and position the sample within the field of view of the camera.
The optical assembly of embodiments, further comprising a first set of one or more optical elements arranged to receive light entering from a first aperture in the enclosure corresponding to the light source and to redirect the light entering from the first aperture along a first pathway toward a second aperture in the enclosure corresponding to the camera to provide bright field illumination of the sample when the moveable arm is in the first position.
The optical assembly of embodiments, wherein the first set of one or more optical elements comprises a first right angle mirror and a second right angle mirror, wherein the first right angle mirror and the second right angle mirror are in the first pathway and are arranged to reflect the light from the light source to be normally incident into the camera, The optical assembly of embodiments, wherein the light source is a point source to achieve interference imaging of transparent samples via illuminating the sample by a same wavefront.
The optical assembly of embodiments, further comprising a second set of one or more optical elements mechanically coupled to the movable arm and arranged to receive light entering from the first aperture and redirect the light entering from the first aperture along a second pathway to obliquely illuminate the sample to provide fluorescence illumination of the sample when the moveable arm is in the second position, The optical assembly of embodiments, wherein the oblique angle is larger than a collecting angle of the lens configured to provide the field of view of the camera.
The optical assembly of embodiments, wherein the second set of one or more optical elements includes a mirror and an optical absorber, wherein the mirror reflects light to obliquely illuminate the sample and the optical absorber absorbs extraneous light from the first aperture that would otherwise pass through the second aperture of the enclosure and overwhelm the camera in the fluorescence excitation mode.
The optical assembly of embodiments, wherein the absorber absorbs light that is not incident on the mirror after going through the first aperture, wherein the light absorber is a thin-film light absorber.
The optical assembly of embodiments, further comprising a third set of one or more optical elements arranged to receive light entering from the first aperture and redirect the light entering into the second aperture in the movable arm and going along the first pathway toward a light diffuser on the movable arm to illuminate the sample in normal direction to measure the optical absorption of the sample.
The optical assembly of embodiments, wherein the third set of one or more optical elements includes a light diffuser, a first right angle mirror and a second right angle mirror, wherein the first right angle mirror and the second right angle mirror are in the first pathway and are arranged to reflect the light from the light source toward the light diffuser and then to be normally incident into the camera;
The optical assembly of embodiments, wherein the light diffuser is a semi-opaque diffuser with opacity in the range of 10% to 90%.
The optical assembly of embodiments, further comprising a rubber door to cover the sample receptacle to prevent ambient light from entering into the cavity.
The optical assembly of any of the preceding any embodiments, wherein the light source and the camera are positioned on the same side of the hand-held electronic device at a fixed distance to one another.
A system comprising: the optical assembly of any of the preceding any embodiments, and a mobile phone attachment comprising a first side configured to couple to the optical assembly and a second opposite side configured to couple to the hand-held electronic device, wherein the hand-held electronic device is a mobile phone.
The system of any embodiments, wherein the mobile phone attachment is exchangeable to provide attachment to different sized mobile phones.
The system of any embodiments, wherein a size of the mobile phone attachment is adjustable.
An optical assembly for a hand-held mobile electronic device, the optical assembly comprising:
an enclosure;
a cavity within the enclosure;
a plurality of optical elements within the cavity, wherein the plurality of optical elements are arranged to receive light entering from a first aperture in the enclosure and to redirect the light entering from the first aperture along a first pathway toward a second aperture in the enclosure;
a moveable arm configurable in at least two different positions within the enclosure, a moveable arm configurable in at least three different positions within the enclosure, wherein the moveable arm comprises a light reflector portion to reflect light, wherein the moveable arm comprise a light diffuser to homogenize the light and break the coherence of the light, wherein the moveable arm comprise an aperture aligned with the entrance aperture in the enclosure, wherein, when the moveable arm is in a first position within the enclosure, the light reflector portion is positioned between an entrance aperture in the enclosure and the plurality of optical elements such that the light reflector portion blocks the light entering from the first opening from being incident on the plurality of optical elements, and wherein, when the moveable arm is in a second position within the enclosure, the light entering from the first opening is incident on the plurality of optical elements, and wherein when the moveable arm is in a third position within the enclosure, the light entering from the first opening goes through an aperture on the moveable arm and then is incident on the light diffuser;
The optical assembly of any embodiments, comprising a slot on a side of the enclosure, wherein the slot is arranged to receive a sample substrate such that:
when the sample substrate is fully inserted within the slot and the moveable arm is in the second position within the enclosure, the first pathway intersects the sample substrate; and when the sample substrate is fully inserted within the slot and moveable arm is in the first position within the enclosure, light reflected by the light reflector portion is redirected to the sample substrate; and when the sample substrate is fully inserted within the slot and moveable arm is the third position within the enclosure, light goes along the first pathway toward a light diffuser and then illuminate on the sample substrate.
The optical assembly of any embodiments, wherein the moveable arm comprises a light absorber portion to absorb light that is not incident on the mirror after going through the first aperture.
The optical assembly of any embodiments, wherein the moveable arm comprises:
a first receptacle positioned above the light reflector portion; and an optical filter seated in the receptacle; and a second receptacle positioned above the aperture portion; and a optical filter seated in the receptacle.
The optical assembly of any embodiments, wherein, when the moveable arm is in the first position, the optical filter seated in the receptacle is positioned to receive light entering from the first aperture in the enclosure; and when the moveable arm is in the third position, the optical filter seated in the receptacle is positioned to receive light entering from the first aperture in the enclosure.
The optical assembly of any embodiments, wherein, when the moveable arm is in the first position, the optical filter seated in the receptacle overlaps a region in which a portion of the sample substrate is located when the sample substrate is fully inserted within the slot.
A system comprising:
the optical assembly of any embodiments; and a mobile phone attachment comprising a first side configured to couple to the optical assembly and comprising a second opposite side configured to couple to a mobile phone, wherein a size of the mobile phone attachment is adjustable.
An optical assembly attachable to a hand-held electronic device having a light source, a camera, and a computer processor, wherein the optical assembly is configured to enable microscopic imaging of a sample by the camera with illumination of the sample by light from the light source, the optical assembly comprising:
a lens configured to provide a microscopic field of view for the camera;
a receptacle for receiving the sample and positioning the sample within the microscopic field of view; and an optical fiber configured to receive the light from the light source and to illuminate the receptacle.
The optical assembly of any embodiments wherein, when the optical assembly is attached to the hand-held electronic device, the lens and the camera define an optical axis, and wherein the optical fiber circumscribes the optical axis.
The optical assembly of any embodiments wherein the optical fiber is ring-shaped.
The optical assembly of any embodiments wherein the optical fiber is a side-emitting fiber.
The optical assembly of any embodiments wherein the optical assembly comprises an enclosure defining the receptacle, wherein the ring-shaped fiber sits in a groove of the enclosure, wherein the enclosure comprises an aperture configured to align with the light source and both end faces of the ring-shape fiber to receive light from the light source.
The optical assembly of any embodiments, wherein the light emits from the side of the ring-shape fiber to illuminate the sample area right under the camera in the optical axis.
The optical assembly of any embodiments, wherein the optical assembly comprises an enclosure defining the receptacle, wherein the enclosure comprises a first aperture configured to align with the light source, and a first end face of the optical fiber is positioned in the first aperture to receive light from the light source.
The optical assembly of any embodiments wherein the enclosure comprises a second aperture configured to align with the camera, and wherein the optical fiber comprises a first end positioned in the first aperture and comprises a second end positioned in the second aperture.
The optical assembly of any embodiments wherein at least one of the first end face of the optical fiber and a second end face of the optical fiber is matted.
The optical assembly of any embodiments wherein when the optical assembly is attached to the hand-held electronic device, the optical fiber is tilted with respect to the light source, and wherein a second end face of the optical fiber is arranged to illuminate a region of the sample located directly beneath the lens.
The optical assembly of any embodiments wherein the optical assembly comprises an enclosure defining the receptacle, the enclosure comprises a groove, and the optical fiber is arranged in the groove.
An optical assembly attachable to a hand-held electronic device having a light source, a camera, and a computer processor, wherein the optical assembly is configured to enable microscopic fluorescence imaging of a sample by the camera with illumination of the sample by light from the light source, the optical assembly comprising:
a lens configured to provide a microscopic field of view for the camera;
a receptacle for receiving the sample and positioning the sample within the microscopic field of view;
a mirror off-set from an optical axis of the lens and positioned to reflect light from the light source and illuminate the sample over a range of oblique angles with respect to the optical axis;
and a wavelength filter positioned between the sample and the camera to pass fluorescence emitted by the sample in response to the oblique illumination.
The optical assembly of any embodiments wherein the lens is positioned on a front-side of the sample and the mirror is positioned to obliquely illuminate the sample from a back-side of the sample, wherein the oblique angle is larger than a collecting angle of the lens.
The optical assembly of any embodiments further comprising an optical absorber positioned on the optical axis adjacent the mirror to absorb light from the light source not reflected by the mirror.
The optical assembly of any embodiments wherein the mirror and the optical absorber are mounted on a common structure and tilted with respect to one another.
The optical assembly of any embodiments, further comprising a second wavelength filter positioned in a path of the illumination light between the light source and the mirror to select certain wavelengths for illuminating the sample.
The optical assembly of any of the preceding any embodiments, wherein the sample is supported by a sample holder comprising a planar structure, and wherein the receptacle is configured to position the planar structure to extend partially into a path of illumination light from the light source to couple illumination light into the planar structure.
The optical assembly of any embodiments 6, wherein the receptacle is configured to position the planar structure such that the path of illumination light is incident on an edge of the planar structure, wherein the edge extends along a plane that is normal to a plane comprising the field of view.
The optical assembly of any embodiments wherein the mirror is arranged to reflect the light to partially obliquely illuminate the sample from a back side of the planar structure and to partially illuminate an edge of the planar structure to couple illumination light into the planar structure.
The optical assembly of any embodiments further comprising a rubber door to cover the sample receptacle to prevent ambient light from entering the optical assembly and entering the camera.
The optical assembly of any embodiments, wherein the planar structure is configured to waveguide the coupled illumination light to the sample to illuminate the sample and cause the sample to emit fluorescence.
The optical assembly of any embodiments further comprising the sample holder, The optical assembly of any embodiments 6, wherein the sample is a liquid sample and the sample holder comprises first and second plates sandwiching the liquid sample.
The optical assembly of any of the preceding any embodiments, wherein the lens, the receptacle, the mirror, and the wavelength filter are supported in a common optical box and further comprising an exchangeable holder frame for attaching the optical box to the hand-held electronic device.
.. The optical assembly of any embodiments, wherein the light source and the camera are positioned on the same side of the hand-held electronic device and at fixed distance to one another.
The optical assembly of any embodiments, wherein the hand-held electronic device is a smart phone.
An apparatus comprising the optical assembly of any of the preceding any embodiments and the hand-held electronic device.
An optical assembly attachable to a hand-held electronic device having a light source, a camera, and a computer processor, the optical assembly configured to enable microscopic fluorescence imaging of a sample by the camera with illumination of the sample by light from the light source, the optical assembly comprising:
a lens configured to provide a microscopic field of view for the camera;
a receptacle for receiving the sample and positioning the sample within the microscopic field of view, wherein the sample is supported by a sample holder comprising a planar structure, and wherein the receptacle is configured to position the planar structure to extend partially into a path of illumination light from the light source to couple illumination light into the planar structure and cause the sample to emit fluorescence; and a wavelength filter positioned between the sample and the camera to pass fluorescence emitted by the sample in response to the illumination.
The optical assembly of any embodiments further comprising a rubber door to cover the sample receptacle to prevent ambient light entering the optical assembly through the receptacle.
The optical assembly of any embodiments wherein the planar structure is configured to waveguide the coupled illumination light to the sample to illuminate the sample and cause the sample to emit the fluorescence.
The optical assembly of any embodiments further comprising the sample holder, The optical assembly of any embodiments wherein the sample is a liquid sample and the sample holder comprises first and second plates sandwiching the liquid sample.
The optical assembly of any embodiments, further comprising a second wavelength filter positioned in the path of the illumination light between the light source and the portion of the sample holder partially extending into the path of the light.
The optical assembly of any of the preceding any embodiments, wherein the lens, the receptacle, and the wavelength filter are supported in a common optical box and further comprising an exchangeable holder frame for attaching the optical box to the hand-held electronic device.
The optical assembly of any embodiments wherein the light source and the camera are positioned on the same side of the hand-held electronic device at a fixed distance to one another.
The optical assembly of any embodiments, wherein the hand-held electronic device is a smart phone.
An apparatus comprising the optical assembly of any of the preceding any embodiments and the hand-held electronic device.
An optical assembly attachable to a hand-held electronic device having a light source, a first camera module, a second camera module, and a computer processor, wherein the optical assembly is configured to enable microscopic imaging of a sample by the first camera and by the second camera with illumination of the sample by light from the light source, the optical assembly comprising:
a first assembly lens configured to provide a first microscopic field of view for the first camera module;
a second assembly lens configured to provide a second microscopic field of view for the second camera module; and a receptacle for receiving the sample and positioning the sample within the first microscopic field of view and within the second microscopic field of view.
The optical assembly of any embodiments, wherein the first camera module comprises a first internal lens and the second camera module comprises a second internal lens, wherein a first optical magnification provided by the first assembly lens and the first internal lens is the same as a second optical magnification provided by the second assembly lens and the second internal lens.
The optical assembly of any embodiments, wherein a first ratio of a focal length of the first assembly lens to a focal length of the first internal lens is equal to a second ratio of a focal length of the second assembly lens to a focal length of the second internal lens.
The optical assembly of any embodiments, wherein a first image resolution provided by the first camera module and the first assembly lens is the same as a second image resolution provided by the second camera module and the second assembly lens.
The optical assembly of any embodiments, wherein the first camera module comprises a first internal lens and the second camera module comprises a second internal lens, wherein a first optical magnification provided by the first assembly lens and the first internal lens is different from a second optical magnification provided by the second assembly lens and the second internal lens.
The optical assembly of any embodiments, wherein a first ratio of a focal length of the first assembly lens to a focal length of the first internal lens is less than a second ratio of a focal length of the second assembly lens to a focal length of the second internal lens.
The optical assembly of any embodiments, wherein a first image resolution provided by the first camera module and the first assembly lens is less than a second image resolution provided by the second camera module and the second assembly lens.
The optical assembly of any of the preceding any embodiments, wherein the first microscopic field of view overlaps with the second microscopic field of view.
The optical assembly of any embodiments, wherein an amount of overlap of the first microscopic field of view with the second microscopic field of view is between 1% and 90%.
The optical assembly of any of any embodiments , wherein the first microscopic field of view does not overlap with the second microscopic field of view.
The optical assembly of any of the preceding any embodiments, wherein each of the first assembly lens and the second assembly lens is arranged to receive light scattered by or emitted by the sample.
The optical assembly of any of the preceding any embodiments, wherein the first microscopic field of view is less than the second microscopic field of view.
The optical assembly of any of the preceding any embodiments, wherein an angular field of view of the first assembly lens is less than an angular field of view of the second assembly lens.
The optical assembly of any embodiments, wherein a ratio of the angular field of view of the first assembly lens to the angular field of the second assembly lens is between 1.1 and 1000.
The optical assembly of any of the preceding any embodiments, comprising:
a first optical filter arranged in a first illumination path to or from the first assembly lens;
and a second optical filter arranged in a second illumination path to or from the second assembly lens.
The optical assembly of any embodiments, wherein the first optical filter is configured to filter a first range of wavelengths, the second optical filter is configured to filter a second range of wavelengths, and the first range of wavelengths is different from the second range of wavelengths.
The optical assembly of any of the preceding any embodiments, comprising:
a first polarizer arranged in a first illumination path to or from the first assembly lens; and a second polarizer arranged in a second illumination path to or from the second assembly lens.
The optical assembly of any embodiments, wherein the first polarizer and the second polarizer have different polarization dependent light transmission and blocking properties.
An apparatus comprising the optical assembly of any of the preceding any embodiments and the hand-held electronic device.
The apparatus of any embodiments, wherein the hand-held electronic device is a smart phone.
The apparatus of any embodiments, wherein the hand-held electronic device is configured to computationally merge a first image obtained from the first camera module with a second image obtained from the second camera module.
An imaging method comprising:
compressing a sample between two plates, wherein the two plates are separated from one another by an array of spacers, at least one of which has a reference mark;
acquiring multiple images of the sample using an imaging system comprising a camera and at least one lens, wherein each image corresponds to a different object plane within a thickness of the sample;
computationally analyzing each image to determine information about the corresponding object plane based on one or more of the reference marks; and computationally constructing a three-dimensional image of the sample based on the multiple images and the information about the corresponding object planes.
The imaging method of any embodiments, wherein the determined information about the corresponding object plane comprises a depth of the object plane relative to imaging system.
The imaging method of any embodiments of any embodiments 2, wherein at least some of the spacers each have a reference mark.
The imaging method of any embodiments, wherein the determined information about the corresponding object plane comprises a depth and an orientation of the object plane relative to imaging system.
The imaging method of any of the preceding any embodiments, where the computational analyzing of each image comprises determining a degree of defocus of one or more of the reference marks.
The imaging method of any embodiments, where the computational analyzing of each image comprises determining a depth for each of multiple ones of the reference marks based on a degree of defocus for each such reference mark and determining a depth and an orientation of the corresponding object plane relative to the imaging system based on the determined depths of the reference marks.
The imaging method of any of the preceding any embodiments, wherein the references marks are not rotationally symmetric with respect to an axis perpendicular to at least one of the plates.
The imaging method of any embodiments, wherein the computational analyzing of each image comprises determining a rotational orientation of one or more of the reference marks about the axis relative to the imaging system.
The imaging method of any of the preceding any embodiments, wherein the computational analyzing of each image comprising comparing image information about the reference marks to a priori knowledge about the reference marks.
The imaging method of any embodiments, wherein the a priori knowledge about the reference marks is based on one or more of a shape of each reference mark and a location of each reference mark relative to the plates.
The imaging method of any of the preceding any embodiments, wherein the spacers are pillars.
The imaging method of any of the preceding any embodiments, wherein the acquiring of the multiple images comprises moving one or more components of the imaging system relative to the plates sandwiching the sample.
The imaging method of any of the preceding any embodiments, wherein the computational constructing of the three-dimensional image comprises processing each acquired image to remove out-of-focus features.
The imaging method of any embodiments, wherein the processing of each acquired image to remove out-of-focus features comprises using a band-pass filter.
The imaging method of any of the preceding any embodiments, where the acquired images correspond to interference images formed by combining light from the sample with reference light not directed to the sample on the camera.
An imaging apparatus comprising:
an imaging system comprising a camera and at least one lens;
a sample holder for supporting a sample cartridge relative to the imaging system, the sample cartridge comprising two plates are separated from one another by an array of spacers, at least one of which has a reference mark, wherein a sample to be imaged is configured to be compressed between the two plates; and a processing and control system coupled to the sample holder and the camera and configured to acquire multiple images of the sample using the imaging system, wherein each image corresponds to a different object plane within a thickness of the sample, and wherein the processing and control system is further configured to:
computationally analyze each image to determine information about the corresponding object plane based on one or more of the reference marks; and computationally construct a three-dimensional image of the sample based on the multiple images and the information about the corresponding object planes.
The imaging apparatus of any embodiments, wherein the determined information about the corresponding object plane comprises a depth of the object plane relative to imaging system.
The imaging apparatus of any embodiments or, wherein at least some of the spacers each have a reference mark.
The imaging apparatus of any embodiments, wherein the determined information about the corresponding object plane comprises a depth and an orientation of the object plane relative to imaging system.
The apparatus of any of the preceding any embodiments, where the computational analyzing of each image comprises determining a degree of defocus of one or more of the reference marks.
The apparatus of any embodiments 20, wherein the computational analyzing of each image comprises determining a depth for each of multiple ones of the reference marks based on a degree of defocus for each such reference mark and determining a depth and an orientation of the corresponding object plane relative to the imaging system based on the determined depths of the reference marks.
.. The apparatus of any of the preceding any embodiments, wherein the references marks are not rotationally symmetric with respect to an axis perpendicular to at least one of the plates.
The apparatus of any embodiments, wherein the computational analyzing of each image comprises determining a rotational orientation of one or more of the reference marks about the axis relative to the imaging system.
The apparatus of any of the preceding any embodiments, wherein the computational analyzing of each image comprising comparing image information about the reference marks to a priori knowledge about the reference marks.
The apparatus of any embodiments, wherein the a priori knowledge about the reference marks is based on one or more of a shape of each reference mark and a location of each reference mark relative to the plates.
The apparatus of any of the preceding any embodiments, wherein the spacers are pillars.
The apparatus of any of the preceding any embodiments, wherein the control system is configured to move one or more components of the imaging system relative to the plates sandwiching the sample to acquire the multiple images.
The apparatus of any of the preceding any embodiments, wherein the computational constructing of the three-dimensional image comprises processing each acquired image to remove out-of-focus features.
The apparatus of any embodiments wherein the processing of each acquired image to remove out-of-focus features comprises using a band-pass filter.
The apparatus of any of the preceding any embodiments, wherein where the acquired images correspond to interference images formed by combining light from the sample with reference light not directed to the sample on the camera.
More Other Embodiments The present invention includes a variety of embodiments, which can be combined in multiple ways as long as the various components do not contradict one another.
The embodiments should be regarded as a single invention file: each filing has other filing as the references and is also referenced in its entirety and for all purpose, rather than as a discrete independent. These embodiments include not only the disclosures in the current file, but also the documents that are herein referenced, incorporated, or to which priority is claimed.
(1) Definitions The terms used in describing the devices, systems, and methods herein disclosed are defined in the current application, or in PCT Application (designating U.S.) Nos.
PCT/U52016/045437 and PCT/U50216/051775, which were respectively filed on August 10, 2016 and September 14, 2016, US Provisional Application No. 62/456065, which was filed on February 7, 2017, US Provisional Application No. 62/426065, which was filed on February 8, 2017, US Provisional Application No. 62/456504, which was filed on February 8, 2017, all of which applications are incorporated herein in their entireties for all purposes.
The terms "CROF Card (or card)", "COF Card", "QMAX-Card", "Q-Card", "CROF
device", "COF device", "QMAX-device", "CROF plates", "COF plates", and "QMAX-plates"
are interchangeable, except that in some embodiments, the COF card does not comprise spacers;
and the terms refer to a device that comprises a first plate and a second plate that are movable relative to each other into different configurations (including an open configuration and a closed configuration), and that comprises spacers (except some embodiments of the COF
card) that regulate the spacing between the plates. The term "X-plate" refers to one of the two plates in a CROF card, wherein the spacers are fixed to this plate. More descriptions of the COF Card, CROF
Card, and X-plate are given in the provisional application serial nos.
62/456065, filed on February 7, 2017, which is incorporated herein in its entirety for all purposes.
(2) Q-Card, Spacer and Uniform Sample thickness The devices, systems, and methods herein disclosed can include or use Q-cards, spacers, and uniform sample thickness embodiments for sample detection, analysis, and quantification. In some embodiments, the Q-card comprises spacers, which help to render at least part of the sample into a layer of high uniformity. The structure, material, function, variation and dimension of the spacers, as well as the uniformity of the spacers and the sample layer, are herein disclosed, or listed, described, and summarized in PCT Application (designating U.S.) Nos.
PCT/U52016/045437 and PCT/U50216/051775, which were respectively filed on August 10, 2016 and September 14, 2016, US Provisional Application No. 62/456065, which was filed on February 7, 2017, US Provisional Application No. 62/426065, which was filed on February 8, 2017, US Provisional Application No. 62/456504, which was filed on February 8, 2017, all of which applications are incorporated herein in their entireties for all purposes.
(3) Hinges, Opening Notches, Recessed Edge and Sliders The devices, systems, and methods herein disclosed can include or use Q-cards for sample detection, analysis, and quantification. In some embodiments, the Q-card comprises hinges, notches, recesses, and sliders, which help to facilitate the manipulation of the Q card and the measurement of the samples. The structure, material, function, variation and dimension of the hinges, notches, recesses, and sliders are herein disclosed, or listed, described, and summarized in PCT Application (designating U.S.) Nos. PCT/U52016/045437 and PCT/U50216/051775, which were respectively filed on August 10, 2016 and September 14, 2016, US Provisional Application No. 62/456065, which was filed on February 7, 2017, US Provisional Application No. 62/426065, which was filed on February 8, 2017, US Provisional Application No.
62/456504, which was filed on February 8, 2017, all of which applications are incorporated herein in their entireties for all purposes.
(4) Q-Card, sliders, and smartphone detection system The devices, systems, and methods herein disclosed can include or use Q-cards for sample detection, analysis, and quantification. In some embodiments, the Q-cards are used together with sliders that allow the card to be read by a smartphone detection system. The structure, material, function, variation, dimension and connection of the Q-card, the sliders, and the smartphone detection system are herein disclosed, or listed, described, and summarized in PCT Application (designating U.S.) Nos. PCT/U52016/045437 and PCT/U50216/051775, which were respectively filed on August 10, 2016 and September 14, 2016, US
Provisional Application No. 62/456065, which was filed on February 7, 2017, US Provisional Application No. 62/426065, which was filed on February 8, 2017, US Provisional Application No. 62/456504, which was filed on February 8, 2017, all of which applications are incorporated herein in their entireties for all purposes.
In some embodiments of QMAX, the sample contact area of one or both of the plates comprises a compressed open flow monitoring surface structures (MSS) that are configured to monitoring how much flow has occurred after COF. For examples, the MSS
comprises, in some embodiments, shallow square array, which will cause friction to the components (e.g. blood cells in a blood) in a sample. By checking the distributions of some components of a sample, one can obtain information related to a flow, under a COF, of the sample and its components.
The depth of the MSS can be 1/1000, 1/100, 1/100, 1/5, 1/2 of the spacer height or in a range of any two values, and in either protrusion or well form.
(5) Detection methods The devices, systems, and methods herein disclosed can include or be used in various types of detection methods. The detection methods are herein disclosed, or listed, described, and summarized in PCT Application (designating U.S.) Nos. PCT/U52016/045437 and PCT/U50216/051775, which were respectively filed on August 10, 2016 and September 14, 2016, US Provisional Application No. 62/456065, which was filed on February 7, 2017, US Provisional Application No. 62/426065, which was filed on February 8, 2017, US Provisional Application No.
62/456504, which was filed on February 8, 2017, all of which applications are incorporated herein in their entireties for all purposes.
(6) Labels The devices, systems, and methods herein disclosed can employ various types of labels that are used for analytes detection. The labels are herein disclosed, or listed, described, and summarized in PCT Application (designating U.S.) Nos. PCT/U52016/045437 and PCT/U50216/051775, which were respectively filed on August 10, 2016 and September 14, 2016, US Provisional Application No. 62/456065, which was filed on February 7, 2017, US Provisional Application No. 62/426065, which was filed on February 8, 2017, US Provisional Application No.
62/456504, which was filed on February 8, 2017, all of which applications are incorporated herein in their entireties for all purposes.
(7) Analytes The devices, systems, and methods herein disclosed can be applied to manipulation and detection of various types of analytes (including biomarkers). The analytes and are herein disclosed, or listed, described, and summarized in PCT Application (designating U.S.) Nos.
PCT/U52016/045437 and PCT/U50216/051775, which were respectively filed on August 10, 2016 and September 14, 2016, US Provisional Application No. 62/456065, which was filed on February 7, 2017, US Provisional Application No. 62/426065, which was filed on February 8, 2017, US Provisional Application No. 62/456504, which was filed on February 8, 2017, all of which applications are incorporated herein in their entireties for all purposes.
(8) Applications (field and samples) The devices, systems, and methods herein disclosed can be used for various applications (fields and samples). The applications are herein disclosed, or listed, described, and summarized in PCT Application (designating U.S.) Nos. PCT/U52016/045437 and PCT/U50216/051775, which were respectively filed on August 10, 2016 and September 14, 2016, US
Provisional Application No. 62/456065, which was filed on February 7, 2017, US Provisional Application No.
62/426065, which was filed on February 8, 2017, US Provisional Application No.
62/456504, which was filed on February 8, 2017, all of which applications are incorporated herein in their entireties for all purposes.
(9) Cloud The devices, systems, and methods herein disclosed can employ cloud technology for data transfer, storage, and/or analysis. The related cloud technologies are herein disclosed, or listed, described, and summarized in PCT Application (designating U.S.) Nos.
PCT/U52016/045437 and PCT/U50216/051775, which were respectively filed on August 10, 2016 and September 14, 2016, US Provisional Application No. 62/456065, which was filed on February 7, 2017, US Provisional Application No. 62/426065, which was filed on February 8, 2017, US Provisional Application No. 62/456504, which was filed on February 8, 2017, all of which applications are incorporated herein in their entireties for all purposes.
Additional Notes Further examples of inventive subject matter according to the present disclosure are described in the following enumerated paragraphs.
It must be noted that as used herein and in the appended claims, the singular forms "a", "an", and "the" include plural referents unless the context clearly dictates otherwise, e.g., when the word "single" is used. For example, reference to "an analyte" includes a single analyte and multiple analytes, reference to "a capture agent" includes a single capture agent and multiple capture agents, reference to "a detection agent" includes a single detection agent and multiple detection agents, and reference to "an agent" includes a single agent and multiple agents.
As used herein, the terms "adapted" and "configured" mean that the element, component, or other subject matter is designed and/or intended to perform a given function. Thus, the use of the terms "adapted" and "configured" should not be construed to mean that a given element, component, or other subject matter is simply "capable of" performing a given function. Similarly, subject matter that is recited as being configured to perform a particular function may additionally or alternatively be described as being operative to perform that function.
As used herein, the phrase, "for example," the phrase, "as an example," and/or simply the terms "example" and "exemplary" when used with reference to one or more components, features, details, structures, embodiments, and/or methods according to the present disclosure, are intended to convey that the described component, feature, detail, structure, embodiment, and/or method is an illustrative, non-exclusive example of components, features, details, structures, embodiments, and/or methods according to the present disclosure. Thus, the described component, feature, detail, structure, embodiment, and/or method is not intended to be limiting, required, or exclusive/exhaustive; and other components, features, details, structures, embodiments, and/or methods, including structurally and/or functionally similar and/or equivalent components, features, details, structures, embodiments, and/or methods, are also within the scope of the present disclosure.
As used herein, the phrases "at least one of" and "one or more of," in reference to a list of more than one entity, means any one or more of the entity in the list of entity, and is not limited to at least one of each and every entity specifically listed within the list of entity. For example, "at least one of A and B" (or, equivalently, "at least one of A or B," or, equivalently, "at least one of A
and/or B") may refer to A alone, B alone, or the combination of A and B.
As used herein, the term "and/or" placed between a first entity and a second entity means one of (1) the first entity, (2) the second entity, and (3) the first entity and the second entity.
Multiple entity listed with "and/or" should be construed in the same manner, i.e., "one or more" of the entity so conjoined. Other entity may optionally be present other than the entity specifically identified by the "and/or" clause, whether related or unrelated to those entities specifically identified.
Where numerical ranges are mentioned herein, the invention includes embodiments in which the endpoints are included, embodiments in which both endpoints are excluded, and embodiments in which one endpoint is included and the other is excluded. It should be assumed that both endpoints are included unless indicated otherwise. Furthermore, unless otherwise indicated or otherwise evident from the context and understanding of one of ordinary skill in the art.
In the event that any patents, patent applications, or other references are incorporated by reference herein and (1) define a term in a manner that is inconsistent with and/or (2) are otherwise inconsistent with, either the non-incorporated portion of the present disclosure or any of the other incorporated references, the non-incorporated portion of the present disclosure shall control, and the term or incorporated disclosure therein shall only control with respect to the reference in which the term is defined and/or the incorporated disclosure was present originally.
OTHER EMBODIMENTS
It is to be understood that while the invention has been described in conjunction with the detailed description thereof, the foregoing description is intended to illustrate and not limit the .. scope of the invention, which is defined by the scope of the appended claims.
Claims (119)
1. An optical adaptor for imaging an sample using a hand-held imaging device that has a light source, a single camera, and a computer processor, comprising:
an enclosure;
a cavity within the enclosure; and a lever within the cavity, wherein the lever comprises at least one optical element and is configured to be moveable between a first position and a second position, wherein (i) in the first position, said imaging device is capable of imaging a sample in a bright field mode, and (ii) in the second position, said imaging device is capable of imaging the sample in a fluorescence excitation mode.
an enclosure;
a cavity within the enclosure; and a lever within the cavity, wherein the lever comprises at least one optical element and is configured to be moveable between a first position and a second position, wherein (i) in the first position, said imaging device is capable of imaging a sample in a bright field mode, and (ii) in the second position, said imaging device is capable of imaging the sample in a fluorescence excitation mode.
2. An optical adaptor for imaging an sample using a hand-held imaging device that has a light source, a single camera, and a computer processor, comprising:
an enclosure;
a lens arranged to provide a field of view for the camera;
a cavity within the enclosure for receiving the sample and positioning the sample within the field of view of the camera, wherein the lens is positioned to receive light refracted by or emitted by the sample when in the field of view of the camera;
and a lever within the cavity, wherein the lever comprises at least one optical element and is configured to be moveable between a first position and a second position, wherein (i) in the first position, said imaging device is capable of imaging a sample in a bright field mode, and (ii) in the second position, said imaging device is capable of imaging the sample in a fluorescence excitation mode.
an enclosure;
a lens arranged to provide a field of view for the camera;
a cavity within the enclosure for receiving the sample and positioning the sample within the field of view of the camera, wherein the lens is positioned to receive light refracted by or emitted by the sample when in the field of view of the camera;
and a lever within the cavity, wherein the lever comprises at least one optical element and is configured to be moveable between a first position and a second position, wherein (i) in the first position, said imaging device is capable of imaging a sample in a bright field mode, and (ii) in the second position, said imaging device is capable of imaging the sample in a fluorescence excitation mode.
3. An optical adaptor for imaging an sample using a hand-held imaging device that has a light source, a single camera, and a computer processor, comprising:
an enclosure;
a cavity within the enclosure for receiving the sample and positioning the sample within a field of view of the camera, and a lever within the cavity, wherein the lever comprises at least one optical element and is configured to be moveable between a first position and a second position, wherein (i) in the first position, said imaging device is capable of imaging a sample in a bright field mode, and (ii) in the second position, said imaging device is capable of imaging the sample in a fluorescence excitation mode, and wherein the lever comprises a first planar region extending along a first plane and a second planar region laterally displaced along a first direction from the first planar region and extending along a second plane, the first plane being disposed at a different height along a second direction from the second plane, the second direction being orthogonal to the first direction.
an enclosure;
a cavity within the enclosure for receiving the sample and positioning the sample within a field of view of the camera, and a lever within the cavity, wherein the lever comprises at least one optical element and is configured to be moveable between a first position and a second position, wherein (i) in the first position, said imaging device is capable of imaging a sample in a bright field mode, and (ii) in the second position, said imaging device is capable of imaging the sample in a fluorescence excitation mode, and wherein the lever comprises a first planar region extending along a first plane and a second planar region laterally displaced along a first direction from the first planar region and extending along a second plane, the first plane being disposed at a different height along a second direction from the second plane, the second direction being orthogonal to the first direction.
4. An optical adaptor for imaging an sample using a hand-held imaging device that has a light source, a single camera, and a computer processor, comprising:
an enclosure;
a cavity within the enclosure for receiving the sample and positioning the sample within a field of view of the camera; and a lever within the cavity, wherein the lever comprises at least one optical element and is configured to be moveable between a first position and a second position, wherein (i) in the first position, said imaging device is capable of imaging a sample in a bright field mode, and (ii) in the second position, said imaging device is capable of imaging the sample in a fluorescence excitation mode, and wherein the lever comprises a first planar region extending along a first plane and a second planar region laterally displaced along a first direction from the first planar region and extending along a second plane, the first plane being disposed at a different height along a second direction from the second plane, the second direction being orthogonal to the first direction, and wherein the first planar region comprises at least one optical element, and the second planar region comprises at least one optical element.
an enclosure;
a cavity within the enclosure for receiving the sample and positioning the sample within a field of view of the camera; and a lever within the cavity, wherein the lever comprises at least one optical element and is configured to be moveable between a first position and a second position, wherein (i) in the first position, said imaging device is capable of imaging a sample in a bright field mode, and (ii) in the second position, said imaging device is capable of imaging the sample in a fluorescence excitation mode, and wherein the lever comprises a first planar region extending along a first plane and a second planar region laterally displaced along a first direction from the first planar region and extending along a second plane, the first plane being disposed at a different height along a second direction from the second plane, the second direction being orthogonal to the first direction, and wherein the first planar region comprises at least one optical element, and the second planar region comprises at least one optical element.
5. An optical adaptor for imaging an sample using a hand-held imaging device that has a light source, a single camera, and a computer processor, comprising:
an enclosure;
a cavity within the enclosure; and a lever within the cavity, wherein the lever comprises at least one optical element and is configured to be moveable between at least three different positions, wherein (i) in a first position, said imaging device is capable of imaging a sample in a bright field mode, (ii) in a second position, said imaging device is capable of imaging the sample in a fluorescence excitation mode, and (iii) in a third position, said imaging device is capable of measuring optical absorption of the sample.
an enclosure;
a cavity within the enclosure; and a lever within the cavity, wherein the lever comprises at least one optical element and is configured to be moveable between at least three different positions, wherein (i) in a first position, said imaging device is capable of imaging a sample in a bright field mode, (ii) in a second position, said imaging device is capable of imaging the sample in a fluorescence excitation mode, and (iii) in a third position, said imaging device is capable of measuring optical absorption of the sample.
6. An optical adaptor for imaging an sample using a hand-held imaging device that has a light source, a single camera, and a computer processor, comprising:
an enclosure;
a lens configured to provide a field of view for the camera;
a cavity within the enclosure for receiving the sample and positioning the sample within the field of view of the camera;
an aperture within the enclosure, wherein the aperture is arranged to receive source light from the light source for illuminating the sample; and a lever within the cavity, wherein the lever comprises at least one optical element and is configured to be moveable between a first position and a second position, wherein (i) in a first position, said imaging device is capable of imaging a sample in a bright field mode, (ii) in a second position, said imaging device is capable of imaging the sample in a fluorescence excitation mode, wherein in the fluorescence excitation mode, the lens is arranged to receive light emitted by the sample when the sample is illuminated by the source light.
an enclosure;
a lens configured to provide a field of view for the camera;
a cavity within the enclosure for receiving the sample and positioning the sample within the field of view of the camera;
an aperture within the enclosure, wherein the aperture is arranged to receive source light from the light source for illuminating the sample; and a lever within the cavity, wherein the lever comprises at least one optical element and is configured to be moveable between a first position and a second position, wherein (i) in a first position, said imaging device is capable of imaging a sample in a bright field mode, (ii) in a second position, said imaging device is capable of imaging the sample in a fluorescence excitation mode, wherein in the fluorescence excitation mode, the lens is arranged to receive light emitted by the sample when the sample is illuminated by the source light.
7. An optical adaptor for imaging an sample using a smart phone that has a light source, a single camera, and a computer processor, comprising:
an enclosure;
a lens configured to provide a field of view for the camera;
a cavity within the enclosure for receiving the sample and positioning the sample within the field of view of the camera; and a lever within the cavity, wherein the lever comprises at least one optical element and is configured to be moveable between a first position and a second position, wherein (i) in a first position, said imaging device is capable of imaging a sample in a bright field mode, and (ii) in a second position, said imaging device is capable of imaging the sample in a fluorescence excitation mode.
an enclosure;
a lens configured to provide a field of view for the camera;
a cavity within the enclosure for receiving the sample and positioning the sample within the field of view of the camera; and a lever within the cavity, wherein the lever comprises at least one optical element and is configured to be moveable between a first position and a second position, wherein (i) in a first position, said imaging device is capable of imaging a sample in a bright field mode, and (ii) in a second position, said imaging device is capable of imaging the sample in a fluorescence excitation mode.
8. An optical assembly attachable to a hand-held electronic device having a light source, a camera, and a computer processor, wherein the optical assembly is configured to enable microscopic imaging of a sample by the camera with illumination of the sample by light from the light source, the optical assembly comprising:
an enclosure;
a cavity within the enclosure;
a lens configured to provide a microscopic field of view for the camera; and moveable arm within the cavity, wherein the moveable arm is configurable to switch between a first position and a second position, wherein when the moveable arm is in the first position, the optical assembly is in a bright field mode, and when the moveable arm is in the second position, the optical assembly is in a fluorescence excitation mode.
an enclosure;
a cavity within the enclosure;
a lens configured to provide a microscopic field of view for the camera; and moveable arm within the cavity, wherein the moveable arm is configurable to switch between a first position and a second position, wherein when the moveable arm is in the first position, the optical assembly is in a bright field mode, and when the moveable arm is in the second position, the optical assembly is in a fluorescence excitation mode.
9. The optical assembly of any embodiments, wherein the enclosure comprises:
a sample receptacle region within the cavity; and a slot on a side of the enclosure, wherein the slot is arranged to receive a sample substrate within the sample receptacle region and position the sample within the field of view of the camera.
a sample receptacle region within the cavity; and a slot on a side of the enclosure, wherein the slot is arranged to receive a sample substrate within the sample receptacle region and position the sample within the field of view of the camera.
10. The optical assembly of embodiments, further comprising a first set of one or more optical elements arranged to receive light entering from a first aperture in the enclosure corresponding to the light source and to redirect the light entering from the first aperture along a first pathway toward a second aperture in the enclosure corresponding to the camera to provide bright field illumination of the sample when the moveable arm is in the first position.
11. The optical assembly of embodiments, wherein the first set of one or more optical elements comprises a first right angle mirror and a second right angle mirror, wherein the first right angle mirror and the second right angle mirror are in the first pathway and are arranged to reflect the light from the light source to be normally incident into the camera,
12. The optical assembly of embodiments, wherein the light source is a point source to achieve interference imaging of transparent samples via illuminating the sample by a same wavefront.
13. The optical assembly of embodiments, further comprising a second set of one or more optical elements mechanically coupled to the movable arm and arranged to receive light entering from the first aperture and redirect the light entering from the first aperture along a second pathway to obliquely illuminate the sample to provide fluorescence illumination of the sample when the moveable arm is in the second position,
14. The optical assembly of embodiments, wherein the oblique angle is larger than a collecting angle of the lens configured to provide the field of view of the camera.
15. The optical assembly of embodiments, wherein the second set of one or more optical elements includes a mirror and an optical absorber, wherein the mirror reflects light to obliquely illuminate the sample and the optical absorber absorbs extraneous light from the first aperture that would otherwise pass through the second aperture of the enclosure and overwhelm the camera in the fluorescence excitation mode.
16. The optical assembly of embodiments, wherein the absorber absorbs light that is not incident on the mirror after going through the first aperture, wherein the light absorber is a thin-film light absorber.
17. The optical assembly of embodiments, further comprising a third set of one or more optical elements arranged to receive light entering from the first aperture and redirect the light entering into the second aperture in the movable arm and going along the first pathway toward a light diffuser on the movable arm to illuminate the sample in normal direction to measure the optical absorption of the sample.
18. The optical assembly of embodiments, wherein the third set of one or more optical elements includes a light diffuser, a first right angle mirror and a second right angle mirror, wherein the first right angle mirror and the second right angle mirror are in the first pathway and are arranged to reflect the light from the light source toward the light diffuser and then to be normally incident into the camera;
19. The optical assembly of embodiments, wherein the light diffuser is a semi-opaque diffuser with opacity in the range of 10% to 90%.
20. The optical assembly of embodiments, further comprising a rubber door to cover the sample receptacle to prevent ambient light from entering into the cavity.
21. The optical assembly of any of the preceding any embodiments, wherein the light source and the camera are positioned on the same side of the hand-held electronic device at a fixed distance to one another.
22. A system comprising: the optical assembly of any of the preceding any embodiments, and a mobile phone attachment comprising a first side configured to couple to the optical assembly and a second opposite side configured to couple to the hand-held electronic device, wherein the hand-held electronic device is a mobile phone.
23. The system of any embodiments, wherein the mobile phone attachment is exchangeable to provide attachment to different sized mobile phones.
24. The system of any embodiments, wherein a size of the mobile phone attachment is adjustable.
25. An optical assembly for a hand-held mobile electronic device, the optical assembly comprising:
an enclosure;
a cavity within the enclosure;
a plurality of optical elements within the cavity, wherein the plurality of optical elements are arranged to receive light entering from a first aperture in the enclosure and to redirect the light entering from the first aperture along a first pathway toward a second aperture in the enclosure;
a moveable arm configurable in at least two different positions within the enclosure, a moveable arm configurable in at least three different positions within the enclosure, wherein the moveable arm comprises a light reflector portion to reflect light, wherein the moveable arm comprise a light diffuser to homogenize the light and break the coherence of the light, wherein the moveable arm comprise an aperture aligned with the entrance aperture in the enclosure, wherein, when the moveable arm is in a first position within the enclosure, the light reflector portion is positioned between an entrance aperture in the enclosure and the plurality of optical elements such that the light reflector portion blocks the light entering from the first opening from being incident on the plurality of optical elements, and wherein, when the moveable arm is in a second position within the enclosure, the light entering from the first opening is incident on the plurality of optical elements, and wherein when the moveable arm is in a third position within the enclosure, the light entering from the first opening goes through an aperture on the moveable arm and then is incident on the light diffuser;
an enclosure;
a cavity within the enclosure;
a plurality of optical elements within the cavity, wherein the plurality of optical elements are arranged to receive light entering from a first aperture in the enclosure and to redirect the light entering from the first aperture along a first pathway toward a second aperture in the enclosure;
a moveable arm configurable in at least two different positions within the enclosure, a moveable arm configurable in at least three different positions within the enclosure, wherein the moveable arm comprises a light reflector portion to reflect light, wherein the moveable arm comprise a light diffuser to homogenize the light and break the coherence of the light, wherein the moveable arm comprise an aperture aligned with the entrance aperture in the enclosure, wherein, when the moveable arm is in a first position within the enclosure, the light reflector portion is positioned between an entrance aperture in the enclosure and the plurality of optical elements such that the light reflector portion blocks the light entering from the first opening from being incident on the plurality of optical elements, and wherein, when the moveable arm is in a second position within the enclosure, the light entering from the first opening is incident on the plurality of optical elements, and wherein when the moveable arm is in a third position within the enclosure, the light entering from the first opening goes through an aperture on the moveable arm and then is incident on the light diffuser;
26. The optical assembly of any embodiments, comprising a slot on a side of the enclosure, wherein the slot is arranged to receive a sample substrate such that:
when the sample substrate is fully inserted within the slot and the moveable arm is in the second position within the enclosure, the first pathway intersects the sample substrate; and when the sample substrate is fully inserted within the slot and moveable arm is in the first position within the enclosure, light reflected by the light reflector portion is redirected to the sample substrate; and when the sample substrate is fully inserted within the slot and moveable arm is the third position within the enclosure, light goes along the first pathway toward a light diffuser and then illuminate on the sample substrate.
when the sample substrate is fully inserted within the slot and the moveable arm is in the second position within the enclosure, the first pathway intersects the sample substrate; and when the sample substrate is fully inserted within the slot and moveable arm is in the first position within the enclosure, light reflected by the light reflector portion is redirected to the sample substrate; and when the sample substrate is fully inserted within the slot and moveable arm is the third position within the enclosure, light goes along the first pathway toward a light diffuser and then illuminate on the sample substrate.
27. The optical assembly of any embodiments, wherein the moveable arm comprises a light absorber portion to absorb light that is not incident on the mirror after going through the first aperture.
28. The optical assembly of any embodiments, wherein the moveable arm comprises:
a first receptacle positioned above the light reflector portion; and an optical filter seated in the receptacle; and a second receptacle positioned above the aperture portion; and a optical filter seated in the receptacle.
a first receptacle positioned above the light reflector portion; and an optical filter seated in the receptacle; and a second receptacle positioned above the aperture portion; and a optical filter seated in the receptacle.
29. The optical assembly of any embodiments, wherein, when the moveable arm is in the first position, the optical filter seated in the receptacle is positioned to receive light entering from the first aperture in the enclosure; and when the moveable arm is in the third position, the optical filter seated in the receptacle is positioned to receive light entering from the first aperture in the enclosure.
30. The optical assembly of any embodiments, wherein, when the moveable arm is in the first position, the optical filter seated in the receptacle overlaps a region in which a portion of the sample substrate is located when the sample substrate is fully inserted within the slot.
31. A system comprising:
the optical assembly of any embodiments; and a mobile phone attachment comprising a first side configured to couple to the optical assembly and comprising a second opposite side configured to couple to a mobile phone, wherein a size of the mobile phone attachment is adjustable.
the optical assembly of any embodiments; and a mobile phone attachment comprising a first side configured to couple to the optical assembly and comprising a second opposite side configured to couple to a mobile phone, wherein a size of the mobile phone attachment is adjustable.
32. An optical assembly attachable to a hand-held electronic device having a light source, a camera, and a computer processor, wherein the optical assembly is configured to enable microscopic imaging of a sample by the camera with illumination of the sample by light from the light source, the optical assembly comprising:
a lens configured to provide a microscopic field of view for the camera;
a receptacle for receiving the sample and positioning the sample within the microscopic field of view; and an optical fiber configured to receive the light from the light source and to illuminate the receptacle.
a lens configured to provide a microscopic field of view for the camera;
a receptacle for receiving the sample and positioning the sample within the microscopic field of view; and an optical fiber configured to receive the light from the light source and to illuminate the receptacle.
33. The optical assembly of any embodiments wherein, when the optical assembly is attached to the hand-held electronic device, the lens and the camera define an optical axis, and wherein the optical fiber circumscribes the optical axis.
34. The optical assembly of any embodiments wherein the optical fiber is ring-shaped.
35. The optical assembly of any embodiments wherein the optical fiber is a side-emitting fiber.
36. The optical assembly of any embodiments wherein the optical assembly comprises an enclosure defining the receptacle, wherein the ring-shaped fiber sits in a groove of the enclosure, wherein the enclosure comprises an aperture configured to align with the light source and both end faces of the ring-shape fiber to receive light from the light source.
37. The optical assembly of any embodiments, wherein the light emits from the side of the ring-shape fiber to illuminate the sample area right under the camera in the optical axis.
38. The optical assembly of any embodiments, wherein the optical assembly comprises an enclosure defining the receptacle, wherein the enclosure comprises a first aperture configured to align with the light source, and a first end face of the optical fiber is positioned in the first aperture to receive light from the light source.
39. The optical assembly of any embodiments wherein the enclosure comprises a second aperture configured to align with the camera, and wherein the optical fiber comprises a first end positioned in the first aperture and comprises a second end positioned in the second aperture.
40. The optical assembly of any embodiments wherein at least one of the first end face of the optical fiber and a second end face of the optical fiber is matted.
41. The optical assembly of any embodiments wherein when the optical assembly is attached to the hand-held electronic device, the optical fiber is tilted with respect to the light source, and wherein a second end face of the optical fiber is arranged to illuminate a region of the sample located directly beneath the lens.
42. The optical assembly of any embodiments wherein the optical assembly comprises an enclosure defining the receptacle, the enclosure comprises a groove, and the optical fiber is arranged in the groove.
43. An optical assembly attachable to a hand-held electronic device having a light source, a camera, and a computer processor, wherein the optical assembly is configured to enable microscopic fluorescence imaging of a sample by the camera with illumination of the sample by light from the light source, the optical assembly comprising:
a lens configured to provide a microscopic field of view for the camera;
a receptacle for receiving the sample and positioning the sample within the microscopic field of view;
a mirror off-set from an optical axis of the lens and positioned to reflect light from the light source and illuminate the sample over a range of oblique angles with respect to the optical axis; and a wavelength filter positioned between the sample and the camera to pass fluorescence emitted by the sample in response to the oblique illumination.
a lens configured to provide a microscopic field of view for the camera;
a receptacle for receiving the sample and positioning the sample within the microscopic field of view;
a mirror off-set from an optical axis of the lens and positioned to reflect light from the light source and illuminate the sample over a range of oblique angles with respect to the optical axis; and a wavelength filter positioned between the sample and the camera to pass fluorescence emitted by the sample in response to the oblique illumination.
44. The optical assembly of any embodiments wherein the lens is positioned on a front-side of the sample and the mirror is positioned to obliquely illuminate the sample from a back-side of the sample, wherein the oblique angle is larger than a collecting angle of the lens
45. The optical assembly of any embodiments further comprising an optical absorber positioned on the optical axis adjacent the mirror to absorb light from the light source not reflected by the mirror.
46. The optical assembly of any embodiments wherein the mirror and the optical absorber are mounted on a common structure and tilted with respect to one another.
47. The optical assembly of any embodiments, further comprising a second wavelength filter positioned in a path of the illumination light between the light source and the mirror to select certain wavelengths for illuminating the sample.
48. The optical assembly of any of the preceding any embodiments, wherein the sample is supported by a sample holder comprising a planar structure, and wherein the receptacle is configured to position the planar structure to extend partially into a path of illumination light from the light source to couple illumination light into the planar structure.
49. The optical assembly of any embodiments 6, wherein the receptacle is configured to position the planar structure such that the path of illumination light is incident on an edge of the planar structure, wherein the edge extends along a plane that is normal to a plane comprising the field of view.
50. The optical assembly of any embodiments wherein the mirror is arranged to reflect the light to partially obliquely illuminate the sample from a back side of the planar structure and to partially illuminate an edge of the planar structure to couple illumination light into the planar structure.
51. The optical assembly of any embodiments further comprising a rubber door to cover the sample receptacle to prevent ambient light from entering the optical assembly and entering the camera.
52. The optical assembly of any embodiments, wherein the planar structure is configured to waveguide the coupled illumination light to the sample to illuminate the sample and cause the sample to emit fluorescence.
53. The optical assembly of any embodiments further comprising the sample holder,
54. The optical assembly of any embodiments 6, wherein the sample is a liquid sample and the sample holder comprises first and second plates sandwiching the liquid sample.
55. The optical assembly of any of the preceding any embodiments, wherein the lens, the receptacle, the mirror, and the wavelength filter are supported in a common optical box and further comprising an exchangeable holder frame for attaching the optical box to the hand-held electronic device.
56. The optical assembly of any embodiments, wherein the light source and the camera are positioned on the same side of the hand-held electronic device and at fixed distance to one another.
57. The optical assembly of any embodiments, wherein the hand-held electronic device is a smart phone.
58. An apparatus comprising the optical assembly of any of the preceding any embodiments and the hand-held electronic device.
59. An optical assembly attachable to a hand-held electronic device having a light source, a camera, and a computer processor, the optical assembly configured to enable microscopic fluorescence imaging of a sample by the camera with illumination of the sample by light from the light source, the optical assembly comprising:
a lens configured to provide a microscopic field of view for the camera;
a receptacle for receiving the sample and positioning the sample within the microscopic field of view, wherein the sample is supported by a sample holder comprising a planar structure, and wherein the receptacle is configured to position the planar structure to extend partially into a path of illumination light from the light source to couple illumination light into the planar structure and cause the sample to emit fluorescence; and a wavelength filter positioned between the sample and the camera to pass fluorescence emitted by the sample in response to the illumination.
a lens configured to provide a microscopic field of view for the camera;
a receptacle for receiving the sample and positioning the sample within the microscopic field of view, wherein the sample is supported by a sample holder comprising a planar structure, and wherein the receptacle is configured to position the planar structure to extend partially into a path of illumination light from the light source to couple illumination light into the planar structure and cause the sample to emit fluorescence; and a wavelength filter positioned between the sample and the camera to pass fluorescence emitted by the sample in response to the illumination.
60. The optical assembly of any embodiments further comprising a rubber door to cover the sample receptacle to prevent ambient light entering the optical assembly through the receptacle.
61. The optical assembly of any embodiments wherein the planar structure is configured to waveguide the coupled illumination light to the sample to illuminate the sample and cause the sample to emit the fluorescence.
62. The optical assembly of any embodiments further comprising the sample holder,
63. The optical assembly of any embodiments wherein the sample is a liquid sample and the sample holder comprises first and second plates sandwiching the liquid sample.
64. The optical assembly of any embodiments, further comprising a second wavelength filter positioned in the path of the illumination light between the light source and the portion of the sample holder partially extending into the path of the light.
65. The optical assembly of any of the preceding any embodiments, wherein the lens, the receptacle, and the wavelength filter are supported in a common optical box and further comprising an exchangeable holder frame for attaching the optical box to the hand-held electronic device.
66. The optical assembly of any embodiments wherein the light source and the camera are positioned on the same side of the hand-held electronic device at a fixed distance to one another.
67. The optical assembly of any embodiments, wherein the hand-held electronic device is a smart phone.
68. An apparatus comprising the optical assembly of any of the preceding any embodiments and the hand-held electronic device.
69. An optical assembly attachable to a hand-held electronic device having a light source, a first camera module, a second camera module, and a computer processor, wherein the optical assembly is configured to enable microscopic imaging of a sample by the first camera and by the second camera with illumination of the sample by light from the light source, the optical assembly comprising:
a first assembly lens configured to provide a first microscopic field of view for the first camera module;
a second assembly lens configured to provide a second microscopic field of view for the second camera module; and a receptacle for receiving the sample and positioning the sample within the first microscopic field of view and within the second microscopic field of view.
a first assembly lens configured to provide a first microscopic field of view for the first camera module;
a second assembly lens configured to provide a second microscopic field of view for the second camera module; and a receptacle for receiving the sample and positioning the sample within the first microscopic field of view and within the second microscopic field of view.
70. The optical assembly of any embodiments, wherein the first camera module comprises a first internal lens and the second camera module comprises a second internal lens, wherein a first optical magnification provided by the first assembly lens and the first internal lens is the same as a second optical magnification provided by the second assembly lens and the second internal lens.
71. The optical assembly of any embodiments, wherein a first ratio of a focal length of the first assembly lens to a focal length of the first internal lens is equal to a second ratio of a focal length of the second assembly lens to a focal length of the second internal lens.
72. The optical assembly of any embodiments, wherein a first image resolution provided by the first camera module and the first assembly lens is the same as a second image resolution provided by the second camera module and the second assembly lens.
73. The optical assembly of any embodiments, wherein the first camera module comprises a first internal lens and the second camera module comprises a second internal lens, wherein a first optical magnification provided by the first assembly lens and the first internal lens is different from a second optical magnification provided by the second assembly lens and the second internal lens.
74. The optical assembly of any embodiments, wherein a first ratio of a focal length of the first assembly lens to a focal length of the first internal lens is less than a second ratio of a focal length of the second assembly lens to a focal length of the second internal lens.
75. The optical assembly of any embodiments, wherein a first image resolution provided by the first camera module and the first assembly lens is less than a second image resolution provided by the second camera module and the second assembly lens.
76. The optical assembly of any of the preceding any embodiments, wherein the first microscopic field of view overlaps with the second microscopic field of view.
77. The optical assembly of any embodiments, wherein an amount of overlap of the first microscopic field of view with the second microscopic field of view is between 1%
and 90%.
and 90%.
78. The optical assembly of any of any embodiments , wherein the first microscopic field of view does not overlap with the second microscopic field of view.
79. The optical assembly of any of the preceding any embodiments, wherein each of the first assembly lens and the second assembly lens is arranged to receive light scattered by or emitted by the sample.
80. The optical assembly of any of the preceding any embodiments, wherein the first microscopic field of view is less than the second microscopic field of view.
81. The optical assembly of any of the preceding any embodiments, wherein an angular field of view of the first assembly lens is less than an angular field of view of the second assembly lens.
82. The optical assembly of any embodiments, wherein a ratio of the angular field of view of the first assembly lens to the angular field of the second assembly lens is between 1.1 and 1000.
83. The optical assembly of any of the preceding any embodiments, comprising:
a first optical filter arranged in a first illumination path to or from the first assembly lens; and a second optical filter arranged in a second illumination path to or from the second assembly lens.
a first optical filter arranged in a first illumination path to or from the first assembly lens; and a second optical filter arranged in a second illumination path to or from the second assembly lens.
84. The optical assembly of any embodiments, wherein the first optical filter is configured to filter a first range of wavelengths, the second optical filter is configured to filter a second range of wavelengths, and the first range of wavelengths is different from the second range of wavelengths.
85. The optical assembly of any of the preceding any embodiments, comprising:
a first polarizer arranged in a first illumination path to or from the first assembly lens; and a second polarizer arranged in a second illumination path to or from the second assembly lens.
a first polarizer arranged in a first illumination path to or from the first assembly lens; and a second polarizer arranged in a second illumination path to or from the second assembly lens.
86. The optical assembly of any embodiments, wherein the first polarizer and the second polarizer have different polarization dependent light transmission and blocking properties.
87. An apparatus comprising the optical assembly of any of the preceding any embodiments and the hand-held electronic device.
88. The apparatus of any embodiments, wherein the hand-held electronic device is a smart phone.
89. The apparatus of any embodiments, wherein the hand-held electronic device is configured to computationally merge a first image obtained from the first camera module with a second image obtained from the second camera module.
90. An imaging method comprising:
compressing a sample between two plates, wherein the two plates are separated from one another by an array of spacers, at least one of which has a reference mark;
acquiring multiple images of the sample using an imaging system comprising a camera and at least one lens, wherein each image corresponds to a different object plane within a thickness of the sample;
computationally analyzing each image to determine information about the corresponding object plane based on one or more of the reference marks; and computationally constructing a three-dimensional image of the sample based on the multiple images and the information about the corresponding object planes.
compressing a sample between two plates, wherein the two plates are separated from one another by an array of spacers, at least one of which has a reference mark;
acquiring multiple images of the sample using an imaging system comprising a camera and at least one lens, wherein each image corresponds to a different object plane within a thickness of the sample;
computationally analyzing each image to determine information about the corresponding object plane based on one or more of the reference marks; and computationally constructing a three-dimensional image of the sample based on the multiple images and the information about the corresponding object planes.
91. The imaging method of any embodiments, wherein the determined information about the corresponding object plane comprises a depth of the object plane relative to imaging system.
92. The imaging method of any embodiments of any embodiments 2, wherein at least some of the spacers each have a reference mark.
93. The imaging method of any embodiments, wherein the determined information about the corresponding object plane comprises a depth and an orientation of the object plane relative to imaging system.
94. The imaging method of any of the preceding any embodiments, where the computational analyzing of each image comprises determining a degree of defocus of one or more of the reference marks.
95. The imaging method of any embodiments, where the computational analyzing of each image comprises determining a depth for each of multiple ones of the reference marks based on a degree of defocus for each such reference mark and determining a depth and an orientation of the corresponding object plane relative to the imaging system based on the determined depths of the reference marks.
96. The imaging method of any of the preceding any embodiments, wherein the references marks are not rotationally symmetric with respect to an axis perpendicular to at least one of the plates.
97. The imaging method of any embodiments, wherein the computational analyzing of each image comprises determining a rotational orientation of one or more of the reference marks about the axis relative to the imaging system.
98. The imaging method of any of the preceding any embodiments, wherein the computational analyzing of each image comprising comparing image information about the reference marks to a priori knowledge about the reference marks.
99. The imaging method of any embodiments, wherein the a priori knowledge about the reference marks is based on one or more of a shape of each reference mark and a location of each reference mark relative to the plates.
100. The imaging method of any of the preceding any embodiments, wherein the spacers are pillars.
101. The imaging method of any of the preceding any embodiments, wherein the acquiring of the multiple images comprises moving one or more components of the imaging system relative to the plates sandwiching the sample.
102. The imaging method of any of the preceding any embodiments, wherein the computational constructing of the three-dimensional image comprises processing each acquired image to remove out-of-focus features.
103. The imaging method of any embodiments, wherein the processing of each acquired image to remove out-of-focus features comprises using a band-pass filter.
104. The imaging method of any of the preceding any embodiments, where the acquired images correspond to interference images formed by combining light from the sample with reference light not directed to the sample on the camera.
105. An imaging apparatus comprising:
an imaging system comprising a camera and at least one lens;
a sample holder for supporting a sample cartridge relative to the imaging system, the sample cartridge comprising two plates are separated from one another by an array of spacers, at least one of which has a reference mark, wherein a sample to be imaged is configured to be compressed between the two plates; and a processing and control system coupled to the sample holder and the camera and configured to acquire multiple images of the sample using the imaging system, wherein each image corresponds to a different object plane within a thickness of the sample, and wherein the processing and control system is further configured to:
computationally analyze each image to determine information about the corresponding object plane based on one or more of the reference marks;
and computationally construct a three-dimensional image of the sample based on the multiple images and the information about the corresponding object planes.
an imaging system comprising a camera and at least one lens;
a sample holder for supporting a sample cartridge relative to the imaging system, the sample cartridge comprising two plates are separated from one another by an array of spacers, at least one of which has a reference mark, wherein a sample to be imaged is configured to be compressed between the two plates; and a processing and control system coupled to the sample holder and the camera and configured to acquire multiple images of the sample using the imaging system, wherein each image corresponds to a different object plane within a thickness of the sample, and wherein the processing and control system is further configured to:
computationally analyze each image to determine information about the corresponding object plane based on one or more of the reference marks;
and computationally construct a three-dimensional image of the sample based on the multiple images and the information about the corresponding object planes.
106. The imaging apparatus of any embodiments, wherein the determined information about the corresponding object plane comprises a depth of the object plane relative to imaging system.
107. The imaging apparatus of any embodiments or, wherein at least some of the spacers each have a reference mark.
108. The imaging apparatus of any embodiments, wherein the determined information about the corresponding object plane comprises a depth and an orientation of the object plane relative to imaging system.
109. The apparatus of any of the preceding any embodiments, where the computational analyzing of each image comprises determining a degree of defocus of one or more of the reference marks.
110. The apparatus of any embodiments 20, wherein the computational analyzing of each image comprises determining a depth for each of multiple ones of the reference marks based on a degree of defocus for each such reference mark and determining a depth and an orientation of the corresponding object plane relative to the imaging system based on the determined depths of the reference marks.
111. The apparatus of any of the preceding any embodiments, wherein the references marks are not rotationally symmetric with respect to an axis perpendicular to at least one of the plates.
112. The apparatus of any embodiments, wherein the computational analyzing of each image comprises determining a rotational orientation of one or more of the reference marks about the axis relative to the imaging system.
113. The apparatus of any of the preceding any embodiments, wherein the computational analyzing of each image comprising comparing image information about the reference marks to a priori knowledge about the reference marks.
114. The apparatus of any embodiments, wherein the a priori knowledge about the reference marks is based on one or more of a shape of each reference mark and a location of each reference mark relative to the plates.
115. The apparatus of any of the preceding any embodiments, wherein the spacers are pillars.
116. The apparatus of any of the preceding any embodiments, wherein the control system is configured to move one or more components of the imaging system relative to the plates sandwiching the sample to acquire the multiple images.
117. The apparatus of any of the preceding any embodiments, wherein the computational constructing of the three-dimensional image comprises processing each acquired image to remove out-of-focus features.
118. The apparatus of any embodiments wherein the processing of each acquired image to remove out-of-focus features comprises using a band-pass filter.
119. The apparatus of any of the preceding any embodiments, wherein where the acquired images correspond to interference images formed by combining light from the sample with reference light not directed to the sample on the camera.
Applications Claiming Priority (17)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US201762456598P | 2017-02-08 | 2017-02-08 | |
US201762456590P | 2017-02-08 | 2017-02-08 | |
US201762456504P | 2017-02-08 | 2017-02-08 | |
US62/456,598 | 2017-02-08 | ||
US62/456,504 | 2017-02-08 | ||
US62/456,590 | 2017-02-08 | ||
US201762457133P | 2017-02-09 | 2017-02-09 | |
US201762456904P | 2017-02-09 | 2017-02-09 | |
US62/456,904 | 2017-02-09 | ||
US62/457,133 | 2017-02-09 | ||
US201762459554P | 2017-02-15 | 2017-02-15 | |
US62/459,554 | 2017-02-15 | ||
US201762460062P | 2017-02-16 | 2017-02-16 | |
US201762460075P | 2017-02-16 | 2017-02-16 | |
US62/460,062 | 2017-02-16 | ||
US62/460,075 | 2017-02-16 | ||
PCT/US2018/017504 WO2018148471A2 (en) | 2017-02-08 | 2018-02-08 | Optics, device, and system for assaying |
Publications (1)
Publication Number | Publication Date |
---|---|
CA3053009A1 true CA3053009A1 (en) | 2018-08-16 |
Family
ID=63107057
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CA3053009A Pending CA3053009A1 (en) | 2017-02-08 | 2018-02-08 | Optics, device, and system for assaying |
Country Status (5)
Country | Link |
---|---|
EP (1) | EP3580597A4 (en) |
JP (1) | JP7177073B2 (en) |
CN (2) | CN116794819A (en) |
CA (1) | CA3053009A1 (en) |
WO (1) | WO2018148471A2 (en) |
Families Citing this family (37)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
FI3901281T3 (en) | 2015-04-10 | 2023-01-31 | Spatially distinguished, multiplex nucleic acid analysis of biological specimens | |
WO2020047177A1 (en) * | 2018-08-28 | 2020-03-05 | Essenlix Corporation | Assay accuracy improvement |
USD898221S1 (en) | 2018-11-15 | 2020-10-06 | Essenlix Corporation | Assay plate |
USD897555S1 (en) | 2018-11-15 | 2020-09-29 | Essenlix Corporation | Assay card |
USD898224S1 (en) | 2018-11-15 | 2020-10-06 | Essenlix Corporation | Assay plate with sample landing mark |
USD898939S1 (en) | 2018-11-20 | 2020-10-13 | Essenlix Corporation | Assay plate with sample landing mark |
USD910202S1 (en) | 2018-11-21 | 2021-02-09 | Essenlix Corporation | Assay plate with sample landing mark |
USD893469S1 (en) | 2018-11-21 | 2020-08-18 | Essenlix Corporation | Phone holder |
USD910203S1 (en) | 2018-11-27 | 2021-02-09 | Essenlix Corporation | Assay plate with sample landing mark |
USD893470S1 (en) | 2018-11-28 | 2020-08-18 | Essenlix Corporation | Phone holder |
USD912842S1 (en) | 2018-11-29 | 2021-03-09 | Essenlix Corporation | Assay plate |
EP3894587A1 (en) | 2018-12-10 | 2021-10-20 | 10X Genomics, Inc. | Resolving spatial arrays by proximity-based deconvolution |
USD898222S1 (en) | 2019-01-18 | 2020-10-06 | Essenlix Corporation | Assay card |
CN110297322A (en) * | 2019-01-21 | 2019-10-01 | 福鼎市一雄光学仪器有限公司 | The mobile phone high definition close-shot enlarging lens device of built-in fiber illumination |
CN111289443A (en) * | 2019-07-03 | 2020-06-16 | 无锡市人民医院 | Drainage liquid colorimetric card convenient for recycling and colorimetric method thereof |
WO2021003518A1 (en) * | 2019-07-11 | 2021-01-14 | Sensibility Pty Ltd | Machine learning based phone imaging system and analysis method |
US20220276235A1 (en) * | 2019-07-18 | 2022-09-01 | Essenlix Corporation | Imaging based homogeneous assay |
EP3798614A1 (en) * | 2019-09-30 | 2021-03-31 | IAssay, Inc. | Modular multiplex analysis devices and platforms |
GB201918948D0 (en) | 2019-12-20 | 2020-02-05 | Oxford Immune Algorithmics Ltd | Portable device for imaging biological sample |
CN113155555B (en) * | 2020-01-23 | 2023-04-11 | 天津市政工程设计研究总院有限公司 | Manufacturing method of magnesium alloy model for simulating concrete pipe gallery |
US11768175B1 (en) | 2020-03-04 | 2023-09-26 | 10X Genomics, Inc. | Electrophoretic methods for spatial analysis |
EP4414459A3 (en) | 2020-05-22 | 2024-09-18 | 10X Genomics, Inc. | Simultaneous spatio-temporal measurement of gene expression and cellular activity |
US12031177B1 (en) | 2020-06-04 | 2024-07-09 | 10X Genomics, Inc. | Methods of enhancing spatial resolution of transcripts |
WO2021252499A1 (en) | 2020-06-08 | 2021-12-16 | 10X Genomics, Inc. | Methods of determining a surgical margin and methods of use thereof |
AU2021288090A1 (en) * | 2020-06-10 | 2023-01-19 | 10X Genomics, Inc. | Fluid delivery methods |
US20220020481A1 (en) | 2020-07-20 | 2022-01-20 | Abbott Laboratories | Digital pass verification systems and methods |
WO2022043998A1 (en) * | 2020-08-23 | 2022-03-03 | My-Or Diagnostics Ltd. | Apparatus and method for determining hemoglobin levels |
EP4213993A2 (en) * | 2020-09-18 | 2023-07-26 | 10X Genomics, Inc. | Sample handling apparatus and fluid delivery methods |
CN112276370B (en) * | 2020-11-27 | 2021-10-08 | 华中科技大学 | Three-dimensional code laser marking method and system based on spatial light modulator |
WO2022119459A1 (en) * | 2020-12-03 | 2022-06-09 | Pictor Limited | Device and method of analyte detection |
AU2021409136A1 (en) | 2020-12-21 | 2023-06-29 | 10X Genomics, Inc. | Methods, compositions, and systems for capturing probes and/or barcodes |
EP4275087A1 (en) * | 2021-01-06 | 2023-11-15 | Scopgenx Private Limited | A compact portable multimodal microscopy |
US20240151737A1 (en) * | 2021-02-18 | 2024-05-09 | Peek Technologies, Inc. | Configurable diagnostic platform systems and methods for performing chemical test assays |
WO2022178267A2 (en) | 2021-02-19 | 2022-08-25 | 10X Genomics, Inc. | Modular assay support devices |
EP4347879A1 (en) | 2021-06-03 | 2024-04-10 | 10X Genomics, Inc. | Methods, compositions, kits, and systems for enhancing analyte capture for spatial analysis |
CN113984759B (en) * | 2021-09-24 | 2023-12-12 | 暨南大学 | Optical instant detection system and body fluid slide crystallization and detection method |
WO2024092682A1 (en) * | 2022-11-04 | 2024-05-10 | 深圳华大智造科技股份有限公司 | Optical system and detection method |
Family Cites Families (15)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US7372985B2 (en) * | 2003-08-15 | 2008-05-13 | Massachusetts Institute Of Technology | Systems and methods for volumetric tissue scanning microscopy |
JP2005099786A (en) | 2003-08-29 | 2005-04-14 | Olympus Corp | Optical element switching device of microscope |
DE102004034975A1 (en) * | 2004-07-16 | 2006-02-16 | Carl Zeiss Jena Gmbh | Method for acquiring images of a sample with a microscope |
JP5080186B2 (en) * | 2007-09-26 | 2012-11-21 | 富士フイルム株式会社 | Molecular analysis photodetection method, molecular analysis photodetection device used therefor, and sample plate |
CN101952762B (en) * | 2008-01-02 | 2012-11-28 | 加利福尼亚大学董事会 | High numerical aperture telemicroscopy apparatus |
EP2633678A4 (en) * | 2010-10-29 | 2015-05-20 | Univ California | Cellscope apparatus and methods for imaging |
US20120157160A1 (en) * | 2010-12-21 | 2012-06-21 | The Regents Of The University Of California | Compact wide-field fluorescent imaging on a mobile device |
JP6382309B2 (en) | 2013-07-12 | 2018-08-29 | カルロバッツ,ネベン | General purpose rapid diagnostic test reader with transvisual sensitivity |
ES2830823T3 (en) * | 2013-12-12 | 2021-06-04 | Mes Medical Electronic Systems Ltd | Device to test at home |
TWI551269B (en) * | 2014-03-21 | 2016-10-01 | 財團法人工業技術研究院 | Portable analytical device and system |
TWI533025B (en) * | 2014-07-07 | 2016-05-11 | 億觀生物科技股份有限公司 | Portable microscope |
CN106714670A (en) | 2014-07-24 | 2017-05-24 | 大学健康网络 | Collection and analysis of data for diagnostic purposes |
JP2016161550A (en) | 2015-03-05 | 2016-09-05 | アークレイ株式会社 | Colorimetric measuring adapter |
CN204439554U (en) * | 2015-03-27 | 2015-07-01 | 华南师范大学 | Smart mobile phone wide field fluoroscope imager |
US10068145B2 (en) * | 2015-07-30 | 2018-09-04 | Fuji Xerox Co., Ltd. | Photographing system configured to hold a pill |
-
2018
- 2018-02-08 CN CN202310507084.7A patent/CN116794819A/en active Pending
- 2018-02-08 WO PCT/US2018/017504 patent/WO2018148471A2/en unknown
- 2018-02-08 CN CN201880020973.8A patent/CN111465882B/en active Active
- 2018-02-08 CA CA3053009A patent/CA3053009A1/en active Pending
- 2018-02-08 EP EP18751754.5A patent/EP3580597A4/en active Pending
- 2018-02-08 JP JP2019543054A patent/JP7177073B2/en active Active
Also Published As
Publication number | Publication date |
---|---|
WO2018148471A3 (en) | 2018-10-04 |
WO2018148471A2 (en) | 2018-08-16 |
JP2020509403A (en) | 2020-03-26 |
CN111465882A (en) | 2020-07-28 |
CN111465882B (en) | 2023-05-26 |
JP7177073B2 (en) | 2022-11-22 |
EP3580597A4 (en) | 2021-05-05 |
CN116794819A (en) | 2023-09-22 |
EP3580597A2 (en) | 2019-12-18 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US11463608B2 (en) | Image-based assay using mark-assisted machine learning | |
CN111465882B (en) | Optical device, apparatus and system for assay | |
US12120407B2 (en) | Image-based assay using mark-assisted machine learning | |
JP7084959B2 (en) | Devices and systems for analyzing samples, especially blood, and how to use them. | |
US11842483B2 (en) | Systems for cell shape estimation | |
US20200302603A1 (en) | Method of computing tumor spatial and inter-marker heterogeneity | |
US10083340B2 (en) | Automated cell segmentation quality control | |
CN112689757A (en) | Image-based metering system and method using CROF and machine learning | |
US11885952B2 (en) | Optics, device, and system for assaying and imaging | |
US20070135999A1 (en) | Method, apparatus and system for characterizing pathological specimen | |
JP2018502279A (en) | Classification of nuclei in histological images | |
JP2021501321A (en) | Devices and methods for tissue and cell staining | |
US11906432B2 (en) | Enhanced, rapid, homogeneous, cell staining and assay | |
WO2009063185A1 (en) | Test results reading method and apparatus | |
Dolled-Filhart et al. | Automated analysis of tissue microarrays | |
US20220065795A1 (en) | System and methods for remote assessment of a sample assay for disease diagnostics | |
US20090041633A1 (en) | Apparatus and method for performing ligand binding assays on microarrays in multiwell plates | |
US7867783B2 (en) | Apparatus and method for performing ligand binding assays on microarrays in multiwell plates |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
EEER | Examination request |
Effective date: 20220920 |
|
EEER | Examination request |
Effective date: 20220920 |
|
EEER | Examination request |
Effective date: 20220920 |
|
EEER | Examination request |
Effective date: 20220920 |
|
EEER | Examination request |
Effective date: 20220920 |
|
EEER | Examination request |
Effective date: 20220920 |