US20210311060A1 - Methods, kits, and systems for scoring the immune response to cancer - Google Patents
Methods, kits, and systems for scoring the immune response to cancer Download PDFInfo
- Publication number
- US20210311060A1 US20210311060A1 US17/304,317 US202117304317A US2021311060A1 US 20210311060 A1 US20210311060 A1 US 20210311060A1 US 202117304317 A US202117304317 A US 202117304317A US 2021311060 A1 US2021311060 A1 US 2021311060A1
- Authority
- US
- United States
- Prior art keywords
- specific binding
- foxp3
- sample
- binding moiety
- scoring
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 206010028980 Neoplasm Diseases 0.000 title claims abstract description 71
- 238000000034 method Methods 0.000 title claims abstract description 53
- 201000011510 cancer Diseases 0.000 title claims abstract description 18
- 230000028993 immune response Effects 0.000 title claims abstract description 17
- 238000001514 detection method Methods 0.000 claims abstract description 58
- 102100022005 B-lymphocyte antigen CD20 Human genes 0.000 claims abstract description 30
- 101000897405 Homo sapiens B-lymphocyte antigen CD20 Proteins 0.000 claims abstract description 30
- 210000004698 lymphocyte Anatomy 0.000 claims abstract description 27
- 238000010186 staining Methods 0.000 claims abstract description 23
- 239000003153 chemical reaction reagent Substances 0.000 claims description 39
- 201000001441 melanoma Diseases 0.000 claims description 13
- 102000004190 Enzymes Human genes 0.000 claims description 11
- 108090000790 Enzymes Proteins 0.000 claims description 11
- 239000000439 tumor marker Substances 0.000 claims description 9
- 102000011782 Keratins Human genes 0.000 claims description 8
- 108010076876 Keratins Proteins 0.000 claims description 8
- 238000009826 distribution Methods 0.000 claims description 7
- 238000003384 imaging method Methods 0.000 claims description 4
- 239000011521 glass Substances 0.000 claims description 3
- 201000009030 Carcinoma Diseases 0.000 claims description 2
- 230000009870 specific binding Effects 0.000 claims 22
- 241000283973 Oryctolagus cuniculus Species 0.000 claims 6
- 229940126619 mouse monoclonal antibody Drugs 0.000 claims 6
- 150000001875 compounds Chemical class 0.000 claims 4
- 238000004422 calculation algorithm Methods 0.000 abstract description 45
- 238000010191 image analysis Methods 0.000 abstract description 18
- 210000004027 cell Anatomy 0.000 description 60
- 210000001519 tissue Anatomy 0.000 description 46
- 102000017420 CD3 protein, epsilon/gamma/delta subunit Human genes 0.000 description 36
- 108050005493 CD3 protein, epsilon/gamma/delta subunit Proteins 0.000 description 36
- 210000001744 T-lymphocyte Anatomy 0.000 description 26
- 238000003556 assay Methods 0.000 description 17
- 238000003364 immunohistochemistry Methods 0.000 description 17
- 239000003550 marker Substances 0.000 description 17
- 238000002835 absorbance Methods 0.000 description 16
- 241000501754 Astronotus ocellatus Species 0.000 description 14
- 210000002865 immune cell Anatomy 0.000 description 13
- 238000007837 multiplex assay Methods 0.000 description 13
- 239000000090 biomarker Substances 0.000 description 12
- 206010006187 Breast cancer Diseases 0.000 description 11
- 230000006870 function Effects 0.000 description 11
- 210000004881 tumor cell Anatomy 0.000 description 11
- 208000026310 Breast neoplasm Diseases 0.000 description 10
- 238000007901 in situ hybridization Methods 0.000 description 10
- 230000008569 process Effects 0.000 description 10
- 239000000523 sample Substances 0.000 description 10
- 238000011282 treatment Methods 0.000 description 10
- 210000003719 b-lymphocyte Anatomy 0.000 description 9
- 230000005055 memory storage Effects 0.000 description 9
- 238000012545 processing Methods 0.000 description 9
- 238000004458 analytical method Methods 0.000 description 8
- 230000027455 binding Effects 0.000 description 8
- 239000012472 biological sample Substances 0.000 description 8
- 238000011534 incubation Methods 0.000 description 8
- 108090000623 proteins and genes Proteins 0.000 description 8
- 102000004169 proteins and genes Human genes 0.000 description 8
- 210000003289 regulatory T cell Anatomy 0.000 description 8
- 102000003992 Peroxidases Human genes 0.000 description 7
- 238000005516 engineering process Methods 0.000 description 7
- 108040007629 peroxidase activity proteins Proteins 0.000 description 7
- 230000011664 signaling Effects 0.000 description 7
- 238000012549 training Methods 0.000 description 7
- 206010009944 Colon cancer Diseases 0.000 description 6
- 208000001333 Colorectal Neoplasms Diseases 0.000 description 6
- 102100034922 T-cell surface glycoprotein CD8 alpha chain Human genes 0.000 description 6
- 238000007635 classification algorithm Methods 0.000 description 6
- 210000001151 cytotoxic T lymphocyte Anatomy 0.000 description 6
- 230000003595 spectral effect Effects 0.000 description 6
- WZUVPPKBWHMQCE-UHFFFAOYSA-N Haematoxylin Chemical compound C12=CC(O)=C(O)C=C2CC2(O)C1C1=CC=C(O)C(O)=C1OC2 WZUVPPKBWHMQCE-UHFFFAOYSA-N 0.000 description 5
- MHAJPDPJQMAIIY-UHFFFAOYSA-N Hydrogen peroxide Chemical compound OO MHAJPDPJQMAIIY-UHFFFAOYSA-N 0.000 description 5
- 102000004160 Phosphoric Monoester Hydrolases Human genes 0.000 description 5
- 108090000608 Phosphoric Monoester Hydrolases Proteins 0.000 description 5
- 239000004365 Protease Substances 0.000 description 5
- 230000000875 corresponding effect Effects 0.000 description 5
- 201000010099 disease Diseases 0.000 description 5
- 208000037265 diseases, disorders, signs and symptoms Diseases 0.000 description 5
- 238000003703 image analysis method Methods 0.000 description 5
- 239000012528 membrane Substances 0.000 description 5
- 238000012986 modification Methods 0.000 description 5
- 230000004048 modification Effects 0.000 description 5
- 239000011535 reaction buffer Substances 0.000 description 5
- 210000001266 CD8-positive T-lymphocyte Anatomy 0.000 description 4
- 108091005804 Peptidases Proteins 0.000 description 4
- 102100037486 Reverse transcriptase/ribonuclease H Human genes 0.000 description 4
- WLDHEUZGFKACJH-UHFFFAOYSA-K amaranth Chemical compound [Na+].[Na+].[Na+].C12=CC=C(S([O-])(=O)=O)C=C2C=C(S([O-])(=O)=O)C(O)=C1N=NC1=CC=C(S([O-])(=O)=O)C2=CC=CC=C12 WLDHEUZGFKACJH-UHFFFAOYSA-K 0.000 description 4
- 239000000427 antigen Substances 0.000 description 4
- 102000036639 antigens Human genes 0.000 description 4
- 108091007433 antigens Proteins 0.000 description 4
- 230000008901 benefit Effects 0.000 description 4
- 239000003086 colorant Substances 0.000 description 4
- 239000000975 dye Substances 0.000 description 4
- 238000011156 evaluation Methods 0.000 description 4
- 238000002474 experimental method Methods 0.000 description 4
- 230000014509 gene expression Effects 0.000 description 4
- 230000004807 localization Effects 0.000 description 4
- 210000002540 macrophage Anatomy 0.000 description 4
- 230000007170 pathology Effects 0.000 description 4
- 238000011160 research Methods 0.000 description 4
- 239000000126 substance Substances 0.000 description 4
- 230000004083 survival effect Effects 0.000 description 4
- LHYQAEFVHIZFLR-UHFFFAOYSA-L 4-(4-diazonio-3-methoxyphenyl)-2-methoxybenzenediazonium;dichloride Chemical compound [Cl-].[Cl-].C1=C([N+]#N)C(OC)=CC(C=2C=C(OC)C([N+]#N)=CC=2)=C1 LHYQAEFVHIZFLR-UHFFFAOYSA-L 0.000 description 3
- 206010061218 Inflammation Diseases 0.000 description 3
- 206010027476 Metastases Diseases 0.000 description 3
- 230000033289 adaptive immune response Effects 0.000 description 3
- 210000000481 breast Anatomy 0.000 description 3
- 239000000872 buffer Substances 0.000 description 3
- 238000004891 communication Methods 0.000 description 3
- 238000004590 computer program Methods 0.000 description 3
- 230000008021 deposition Effects 0.000 description 3
- 238000011161 development Methods 0.000 description 3
- 238000000605 extraction Methods 0.000 description 3
- 239000000834 fixative Substances 0.000 description 3
- 238000007490 hematoxylin and eosin (H&E) staining Methods 0.000 description 3
- 230000008595 infiltration Effects 0.000 description 3
- 238000001764 infiltration Methods 0.000 description 3
- 230000004054 inflammatory process Effects 0.000 description 3
- 238000002372 labelling Methods 0.000 description 3
- 230000036210 malignancy Effects 0.000 description 3
- 230000009401 metastasis Effects 0.000 description 3
- 238000000386 microscopy Methods 0.000 description 3
- 238000003860 storage Methods 0.000 description 3
- 238000012360 testing method Methods 0.000 description 3
- 210000003171 tumor-infiltrating lymphocyte Anatomy 0.000 description 3
- AXDJCCTWPBKUKL-UHFFFAOYSA-N 4-[(4-aminophenyl)-(4-imino-3-methylcyclohexa-2,5-dien-1-ylidene)methyl]aniline;hydron;chloride Chemical compound Cl.C1=CC(=N)C(C)=CC1=C(C=1C=CC(N)=CC=1)C1=CC=C(N)C=C1 AXDJCCTWPBKUKL-UHFFFAOYSA-N 0.000 description 2
- AOJJSUZBOXZQNB-TZSSRYMLSA-N Doxorubicin Chemical compound O([C@H]1C[C@@](O)(CC=2C(O)=C3C(=O)C=4C=CC=C(C=4C(=O)C3=C(O)C=21)OC)C(=O)CO)[C@H]1C[C@H](N)[C@H](O)[C@H](C)O1 AOJJSUZBOXZQNB-TZSSRYMLSA-N 0.000 description 2
- 102100027581 Forkhead box protein P3 Human genes 0.000 description 2
- 101000861452 Homo sapiens Forkhead box protein P3 Proteins 0.000 description 2
- 101000934372 Homo sapiens Macrosialin Proteins 0.000 description 2
- 101000946843 Homo sapiens T-cell surface glycoprotein CD8 alpha chain Proteins 0.000 description 2
- 235000000177 Indigofera tinctoria Nutrition 0.000 description 2
- 102000014150 Interferons Human genes 0.000 description 2
- 108010050904 Interferons Proteins 0.000 description 2
- 102100025136 Macrosialin Human genes 0.000 description 2
- 206010061309 Neoplasm progression Diseases 0.000 description 2
- 230000004913 activation Effects 0.000 description 2
- 238000009098 adjuvant therapy Methods 0.000 description 2
- 238000013459 approach Methods 0.000 description 2
- 230000006399 behavior Effects 0.000 description 2
- 238000012512 characterization method Methods 0.000 description 2
- 208000037976 chronic inflammation Diseases 0.000 description 2
- 230000006020 chronic inflammation Effects 0.000 description 2
- 230000003750 conditioning effect Effects 0.000 description 2
- 239000000470 constituent Substances 0.000 description 2
- 230000001086 cytosolic effect Effects 0.000 description 2
- 238000003745 diagnosis Methods 0.000 description 2
- 239000012636 effector Substances 0.000 description 2
- 210000001280 germinal center Anatomy 0.000 description 2
- PCHJSUWPFVWCPO-UHFFFAOYSA-N gold Chemical compound [Au] PCHJSUWPFVWCPO-UHFFFAOYSA-N 0.000 description 2
- 229910052737 gold Inorganic materials 0.000 description 2
- 239000010931 gold Substances 0.000 description 2
- 230000012010 growth Effects 0.000 description 2
- -1 histochemistry (HC)) Chemical class 0.000 description 2
- 230000001900 immune effect Effects 0.000 description 2
- 238000011493 immune profiling Methods 0.000 description 2
- 238000010249 in-situ analysis Methods 0.000 description 2
- 238000011065 in-situ storage Methods 0.000 description 2
- 229940097275 indigo Drugs 0.000 description 2
- COHYTHOBJLSHDF-UHFFFAOYSA-N indigo powder Natural products N1C2=CC=CC=C2C(=O)C1=C1C(=O)C2=CC=CC=C2N1 COHYTHOBJLSHDF-UHFFFAOYSA-N 0.000 description 2
- 230000005764 inhibitory process Effects 0.000 description 2
- 230000003993 interaction Effects 0.000 description 2
- 229940079322 interferon Drugs 0.000 description 2
- 230000002601 intratumoral effect Effects 0.000 description 2
- 201000010893 malignant breast melanoma Diseases 0.000 description 2
- 102000039446 nucleic acids Human genes 0.000 description 2
- 108020004707 nucleic acids Proteins 0.000 description 2
- 150000007523 nucleic acids Chemical class 0.000 description 2
- 230000035515 penetration Effects 0.000 description 2
- 239000002244 precipitate Substances 0.000 description 2
- 230000004044 response Effects 0.000 description 2
- 238000002560 therapeutic procedure Methods 0.000 description 2
- 230000005751 tumor progression Effects 0.000 description 2
- 230000000007 visual effect Effects 0.000 description 2
- 238000012800 visualization Methods 0.000 description 2
- 238000005406 washing Methods 0.000 description 2
- WZUVPPKBWHMQCE-XJKSGUPXSA-N (+)-haematoxylin Chemical compound C12=CC(O)=C(O)C=C2C[C@]2(O)[C@H]1C1=CC=C(O)C(O)=C1OC2 WZUVPPKBWHMQCE-XJKSGUPXSA-N 0.000 description 1
- HSTOKWSFWGCZMH-UHFFFAOYSA-N 3,3'-diaminobenzidine Chemical compound C1=C(N)C(N)=CC=C1C1=CC=C(N)C(N)=C1 HSTOKWSFWGCZMH-UHFFFAOYSA-N 0.000 description 1
- LVSPDZAGCBEQAV-UHFFFAOYSA-N 4-chloronaphthalen-1-ol Chemical compound C1=CC=C2C(O)=CC=C(Cl)C2=C1 LVSPDZAGCBEQAV-UHFFFAOYSA-N 0.000 description 1
- QRXMUCSWCMTJGU-UHFFFAOYSA-N 5-bromo-4-chloro-3-indolyl phosphate Chemical compound C1=C(Br)C(Cl)=C2C(OP(O)(=O)O)=CNC2=C1 QRXMUCSWCMTJGU-UHFFFAOYSA-N 0.000 description 1
- RXGJTUSBYWCRBK-UHFFFAOYSA-M 5-methylphenazinium methyl sulfate Chemical compound COS([O-])(=O)=O.C1=CC=C2[N+](C)=C(C=CC=C3)C3=NC2=C1 RXGJTUSBYWCRBK-UHFFFAOYSA-M 0.000 description 1
- JIEINYQEXWLMCU-UHFFFAOYSA-N 7-bromo-3-hydroxy-n-(2-methoxyphenyl)naphthalene-2-carboxamide Chemical compound COC1=CC=CC=C1NC(=O)C1=CC2=CC(Br)=CC=C2C=C1O JIEINYQEXWLMCU-UHFFFAOYSA-N 0.000 description 1
- OXEUETBFKVCRNP-UHFFFAOYSA-N 9-ethyl-3-carbazolamine Chemical compound NC1=CC=C2N(CC)C3=CC=CC=C3C2=C1 OXEUETBFKVCRNP-UHFFFAOYSA-N 0.000 description 1
- 208000010507 Adenocarcinoma of Lung Diseases 0.000 description 1
- 208000036832 Adenocarcinoma of ovary Diseases 0.000 description 1
- VYZAMTAEIAYCRO-UHFFFAOYSA-N Chromium Chemical compound [Cr] VYZAMTAEIAYCRO-UHFFFAOYSA-N 0.000 description 1
- 208000035473 Communicable disease Diseases 0.000 description 1
- 108020003215 DNA Probes Proteins 0.000 description 1
- 230000004544 DNA amplification Effects 0.000 description 1
- 239000003298 DNA probe Substances 0.000 description 1
- 101710088194 Dehydrogenase Proteins 0.000 description 1
- QXNVGIXVLWOKEQ-UHFFFAOYSA-N Disodium Chemical class [Na][Na] QXNVGIXVLWOKEQ-UHFFFAOYSA-N 0.000 description 1
- LFQSCWFLJHTTHZ-UHFFFAOYSA-N Ethanol Chemical compound CCO LFQSCWFLJHTTHZ-UHFFFAOYSA-N 0.000 description 1
- 206010015866 Extravasation Diseases 0.000 description 1
- 102000001398 Granzyme Human genes 0.000 description 1
- 108060005986 Granzyme Proteins 0.000 description 1
- 101001012157 Homo sapiens Receptor tyrosine-protein kinase erbB-2 Proteins 0.000 description 1
- ZDZOTLJHXYCWBA-VCVYQWHSSA-N N-debenzoyl-N-(tert-butoxycarbonyl)-10-deacetyltaxol Chemical compound O([C@H]1[C@H]2[C@@](C([C@H](O)C3=C(C)[C@@H](OC(=O)[C@H](O)[C@@H](NC(=O)OC(C)(C)C)C=4C=CC=CC=4)C[C@]1(O)C3(C)C)=O)(C)[C@@H](O)C[C@H]1OC[C@]12OC(=O)C)C(=O)C1=CC=CC=C1 ZDZOTLJHXYCWBA-VCVYQWHSSA-N 0.000 description 1
- 108020004711 Nucleic Acid Probes Proteins 0.000 description 1
- 108091005461 Nucleic proteins Proteins 0.000 description 1
- CTQNGGLPUBDAKN-UHFFFAOYSA-N O-Xylene Chemical compound CC1=CC=CC=C1C CTQNGGLPUBDAKN-UHFFFAOYSA-N 0.000 description 1
- 206010061328 Ovarian epithelial cancer Diseases 0.000 description 1
- 229910019142 PO4 Inorganic materials 0.000 description 1
- 241001510071 Pyrrhocoridae Species 0.000 description 1
- 102100030086 Receptor tyrosine-protein kinase erbB-2 Human genes 0.000 description 1
- 208000033878 Tertiary Lymphoid Structures Diseases 0.000 description 1
- 108091023040 Transcription factor Proteins 0.000 description 1
- 102000040945 Transcription factor Human genes 0.000 description 1
- 102100023495 Zinc finger protein ZIC 3 Human genes 0.000 description 1
- IOMLBTHPCVDRHM-UHFFFAOYSA-N [3-[(2,4-dimethylphenyl)carbamoyl]naphthalen-2-yl] dihydrogen phosphate Chemical compound CC1=CC(C)=CC=C1NC(=O)C1=CC2=CC=CC=C2C=C1OP(O)(O)=O IOMLBTHPCVDRHM-UHFFFAOYSA-N 0.000 description 1
- 230000005856 abnormality Effects 0.000 description 1
- 230000001154 acute effect Effects 0.000 description 1
- 230000003044 adaptive effect Effects 0.000 description 1
- 239000002671 adjuvant Substances 0.000 description 1
- 230000003321 amplification Effects 0.000 description 1
- 230000000259 anti-tumor effect Effects 0.000 description 1
- 230000000890 antigenic effect Effects 0.000 description 1
- CIZVQWNPBGYCGK-UHFFFAOYSA-N benzenediazonium Chemical compound N#[N+]C1=CC=CC=C1 CIZVQWNPBGYCGK-UHFFFAOYSA-N 0.000 description 1
- 230000015572 biosynthetic process Effects 0.000 description 1
- 238000000339 bright-field microscopy Methods 0.000 description 1
- 150000001720 carbohydrates Chemical class 0.000 description 1
- 235000014633 carbohydrates Nutrition 0.000 description 1
- 230000022534 cell killing Effects 0.000 description 1
- 230000001413 cellular effect Effects 0.000 description 1
- 238000000701 chemical imaging Methods 0.000 description 1
- 238000006243 chemical reaction Methods 0.000 description 1
- 238000002512 chemotherapy Methods 0.000 description 1
- 239000003593 chromogenic compound Substances 0.000 description 1
- 239000012916 chromogenic reagent Substances 0.000 description 1
- 238000005352 clarification Methods 0.000 description 1
- 239000013068 control sample Substances 0.000 description 1
- 230000001276 controlling effect Effects 0.000 description 1
- 238000012937 correction Methods 0.000 description 1
- 230000002596 correlated effect Effects 0.000 description 1
- 210000000805 cytoplasm Anatomy 0.000 description 1
- 231100000433 cytotoxic Toxicity 0.000 description 1
- 230000001472 cytotoxic effect Effects 0.000 description 1
- 238000013523 data management Methods 0.000 description 1
- 230000007812 deficiency Effects 0.000 description 1
- 238000012217 deletion Methods 0.000 description 1
- 230000037430 deletion Effects 0.000 description 1
- 210000004443 dendritic cell Anatomy 0.000 description 1
- 102000038379 digestive enzymes Human genes 0.000 description 1
- 108091007734 digestive enzymes Proteins 0.000 description 1
- NBIIXXVUZAFLBC-UHFFFAOYSA-M dihydrogenphosphate Chemical compound OP(O)([O-])=O NBIIXXVUZAFLBC-UHFFFAOYSA-M 0.000 description 1
- 238000010790 dilution Methods 0.000 description 1
- 239000012895 dilution Substances 0.000 description 1
- 229960003668 docetaxel Drugs 0.000 description 1
- 229960004679 doxorubicin Drugs 0.000 description 1
- 210000002889 endothelial cell Anatomy 0.000 description 1
- 230000003511 endothelial effect Effects 0.000 description 1
- 230000007613 environmental effect Effects 0.000 description 1
- YQGOJNYOYNNSMM-UHFFFAOYSA-N eosin Chemical compound [Na+].OC(=O)C1=CC=CC=C1C1=C2C=C(Br)C(=O)C(Br)=C2OC2=C(Br)C(O)=C(Br)C=C21 YQGOJNYOYNNSMM-UHFFFAOYSA-N 0.000 description 1
- 210000002919 epithelial cell Anatomy 0.000 description 1
- 210000000981 epithelium Anatomy 0.000 description 1
- 238000001704 evaporation Methods 0.000 description 1
- 230000008020 evaporation Effects 0.000 description 1
- 230000036251 extravasation Effects 0.000 description 1
- 238000000684 flow cytometry Methods 0.000 description 1
- 238000002073 fluorescence micrograph Methods 0.000 description 1
- 230000002496 gastric effect Effects 0.000 description 1
- 238000011223 gene expression profiling Methods 0.000 description 1
- 230000002068 genetic effect Effects 0.000 description 1
- 230000002008 hemorrhagic effect Effects 0.000 description 1
- 210000003630 histaminocyte Anatomy 0.000 description 1
- 238000012735 histological processing Methods 0.000 description 1
- 230000003118 histopathologic effect Effects 0.000 description 1
- 238000005286 illumination Methods 0.000 description 1
- 230000006450 immune cell response Effects 0.000 description 1
- 210000000987 immune system Anatomy 0.000 description 1
- 230000036039 immunity Effects 0.000 description 1
- 230000002055 immunohistochemical effect Effects 0.000 description 1
- 238000011532 immunohistochemical staining Methods 0.000 description 1
- 210000004969 inflammatory cell Anatomy 0.000 description 1
- 230000002757 inflammatory effect Effects 0.000 description 1
- 230000002401 inhibitory effect Effects 0.000 description 1
- 238000009830 intercalation Methods 0.000 description 1
- 230000002687 intercalation Effects 0.000 description 1
- 230000009545 invasion Effects 0.000 description 1
- 238000011068 loading method Methods 0.000 description 1
- 201000005249 lung adenocarcinoma Diseases 0.000 description 1
- 210000001165 lymph node Anatomy 0.000 description 1
- 230000000527 lymphocytic effect Effects 0.000 description 1
- 238000007726 management method Methods 0.000 description 1
- 230000008018 melting Effects 0.000 description 1
- 238000002844 melting Methods 0.000 description 1
- 210000003071 memory t lymphocyte Anatomy 0.000 description 1
- 230000000813 microbial effect Effects 0.000 description 1
- 238000010172 mouse model Methods 0.000 description 1
- CNXZLZNEIYFZGU-UHFFFAOYSA-N n-(4-amino-2,5-diethoxyphenyl)benzamide Chemical compound C1=C(N)C(OCC)=CC(NC(=O)C=2C=CC=CC=2)=C1OCC CNXZLZNEIYFZGU-UHFFFAOYSA-N 0.000 description 1
- 230000001338 necrotic effect Effects 0.000 description 1
- JPXMTWWFLBLUCD-UHFFFAOYSA-N nitro blue tetrazolium(2+) Chemical compound COC1=CC(C=2C=C(OC)C(=CC=2)[N+]=2N(N=C(N=2)C=2C=CC=CC=2)C=2C=CC(=CC=2)[N+]([O-])=O)=CC=C1[N+]1=NC(C=2C=CC=CC=2)=NN1C1=CC=C([N+]([O-])=O)C=C1 JPXMTWWFLBLUCD-UHFFFAOYSA-N 0.000 description 1
- 230000009871 nonspecific binding Effects 0.000 description 1
- 238000003199 nucleic acid amplification method Methods 0.000 description 1
- 239000002853 nucleic acid probe Substances 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 208000013371 ovarian adenocarcinoma Diseases 0.000 description 1
- 201000006588 ovary adenocarcinoma Diseases 0.000 description 1
- 230000002018 overexpression Effects 0.000 description 1
- 210000002741 palatine tonsil Anatomy 0.000 description 1
- 239000012188 paraffin wax Substances 0.000 description 1
- NBIIXXVUZAFLBC-UHFFFAOYSA-K phosphate Chemical compound [O-]P([O-])([O-])=O NBIIXXVUZAFLBC-UHFFFAOYSA-K 0.000 description 1
- 239000010452 phosphate Substances 0.000 description 1
- 230000001376 precipitating effect Effects 0.000 description 1
- 238000002360 preparation method Methods 0.000 description 1
- 238000004321 preservation Methods 0.000 description 1
- 238000004393 prognosis Methods 0.000 description 1
- 230000035755 proliferation Effects 0.000 description 1
- 238000011002 quantification Methods 0.000 description 1
- 238000007637 random forest analysis Methods 0.000 description 1
- 230000001105 regulatory effect Effects 0.000 description 1
- 238000012552 review Methods 0.000 description 1
- 150000003839 salts Chemical class 0.000 description 1
- 230000035945 sensitivity Effects 0.000 description 1
- 238000000926 separation method Methods 0.000 description 1
- 238000012163 sequencing technique Methods 0.000 description 1
- 229910052709 silver Inorganic materials 0.000 description 1
- 239000004332 silver Substances 0.000 description 1
- 239000000243 solution Substances 0.000 description 1
- 210000002536 stromal cell Anatomy 0.000 description 1
- 239000000758 substrate Substances 0.000 description 1
- 208000014794 superficial urinary bladder carcinoma Diseases 0.000 description 1
- 238000003786 synthesis reaction Methods 0.000 description 1
- 230000008685 targeting Effects 0.000 description 1
- 125000003831 tetrazolyl group Chemical group 0.000 description 1
- 208000025358 tongue carcinoma Diseases 0.000 description 1
- 230000005945 translocation Effects 0.000 description 1
- 230000004614 tumor growth Effects 0.000 description 1
- 230000009452 underexpressoin Effects 0.000 description 1
- 230000003612 virological effect Effects 0.000 description 1
- 238000001429 visible spectrum Methods 0.000 description 1
- 239000001993 wax Substances 0.000 description 1
- 239000008096 xylene Substances 0.000 description 1
- JIAARYAFYJHUJI-UHFFFAOYSA-L zinc dichloride Chemical class [Cl-].[Cl-].[Zn+2] JIAARYAFYJHUJI-UHFFFAOYSA-L 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N33/00—Investigating or analysing materials by specific methods not covered by groups G01N1/00 - G01N31/00
- G01N33/48—Biological material, e.g. blood, urine; Haemocytometers
- G01N33/50—Chemical analysis of biological material, e.g. blood, urine; Testing involving biospecific ligand binding methods; Immunological testing
- G01N33/53—Immunoassay; Biospecific binding assay; Materials therefor
- G01N33/574—Immunoassay; Biospecific binding assay; Materials therefor for cancer
- G01N33/57407—Specifically defined cancers
- G01N33/5743—Specifically defined cancers of skin, e.g. melanoma
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N15/00—Investigating characteristics of particles; Investigating permeability, pore-volume or surface-area of porous materials
- G01N15/10—Investigating individual particles
- G01N15/14—Optical investigation techniques, e.g. flow cytometry
- G01N15/1429—Signal processing
- G01N15/1433—Signal processing using image recognition
-
- G01N15/1463—
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N33/00—Investigating or analysing materials by specific methods not covered by groups G01N1/00 - G01N31/00
- G01N33/48—Biological material, e.g. blood, urine; Haemocytometers
- G01N33/50—Chemical analysis of biological material, e.g. blood, urine; Testing involving biospecific ligand binding methods; Immunological testing
- G01N33/53—Immunoassay; Biospecific binding assay; Materials therefor
- G01N33/566—Immunoassay; Biospecific binding assay; Materials therefor using specific carrier or receptor proteins as ligand binding reagents where possible specific carrier or receptor proteins are classified with their target compounds
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N33/00—Investigating or analysing materials by specific methods not covered by groups G01N1/00 - G01N31/00
- G01N33/48—Biological material, e.g. blood, urine; Haemocytometers
- G01N33/50—Chemical analysis of biological material, e.g. blood, urine; Testing involving biospecific ligand binding methods; Immunological testing
- G01N33/53—Immunoassay; Biospecific binding assay; Materials therefor
- G01N33/574—Immunoassay; Biospecific binding assay; Materials therefor for cancer
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N33/00—Investigating or analysing materials by specific methods not covered by groups G01N1/00 - G01N31/00
- G01N33/48—Biological material, e.g. blood, urine; Haemocytometers
- G01N33/50—Chemical analysis of biological material, e.g. blood, urine; Testing involving biospecific ligand binding methods; Immunological testing
- G01N33/53—Immunoassay; Biospecific binding assay; Materials therefor
- G01N33/574—Immunoassay; Biospecific binding assay; Materials therefor for cancer
- G01N33/57407—Specifically defined cancers
- G01N33/57415—Specifically defined cancers of breast
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N33/00—Investigating or analysing materials by specific methods not covered by groups G01N1/00 - G01N31/00
- G01N33/48—Biological material, e.g. blood, urine; Haemocytometers
- G01N33/50—Chemical analysis of biological material, e.g. blood, urine; Testing involving biospecific ligand binding methods; Immunological testing
- G01N33/68—Chemical analysis of biological material, e.g. blood, urine; Testing involving biospecific ligand binding methods; Immunological testing involving proteins, peptides or amino acids
- G01N33/6875—Nucleoproteins
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N35/00—Automatic analysis not limited to methods or materials provided for in any single one of groups G01N1/00 - G01N33/00; Handling materials therefor
- G01N35/00029—Automatic analysis not limited to methods or materials provided for in any single one of groups G01N1/00 - G01N33/00; Handling materials therefor provided with flat sample substrates, e.g. slides
-
- G—PHYSICS
- G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
- G16B—BIOINFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR GENETIC OR PROTEIN-RELATED DATA PROCESSING IN COMPUTATIONAL MOLECULAR BIOLOGY
- G16B25/00—ICT specially adapted for hybridisation; ICT specially adapted for gene or protein expression
-
- G—PHYSICS
- G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
- G16B—BIOINFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR GENETIC OR PROTEIN-RELATED DATA PROCESSING IN COMPUTATIONAL MOLECULAR BIOLOGY
- G16B25/00—ICT specially adapted for hybridisation; ICT specially adapted for gene or protein expression
- G16B25/10—Gene or protein expression profiling; Expression-ratio estimation or normalisation
-
- G01N2015/008—
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N15/00—Investigating characteristics of particles; Investigating permeability, pore-volume or surface-area of porous materials
- G01N15/01—Investigating characteristics of particles; Investigating permeability, pore-volume or surface-area of porous materials specially adapted for biological cells, e.g. blood cells
- G01N2015/016—White blood cells
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N15/00—Investigating characteristics of particles; Investigating permeability, pore-volume or surface-area of porous materials
- G01N15/10—Investigating individual particles
- G01N2015/1006—Investigating individual particles for cytology
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N15/00—Investigating characteristics of particles; Investigating permeability, pore-volume or surface-area of porous materials
- G01N15/10—Investigating individual particles
- G01N15/14—Optical investigation techniques, e.g. flow cytometry
- G01N2015/1486—Counting the particles
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N35/00—Automatic analysis not limited to methods or materials provided for in any single one of groups G01N1/00 - G01N33/00; Handling materials therefor
- G01N35/00029—Automatic analysis not limited to methods or materials provided for in any single one of groups G01N1/00 - G01N33/00; Handling materials therefor provided with flat sample substrates, e.g. slides
- G01N2035/00099—Characterised by type of test elements
- G01N2035/00138—Slides
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N2333/00—Assays involving biological materials from specific organisms or of a specific nature
- G01N2333/435—Assays involving biological materials from specific organisms or of a specific nature from animals; from humans
- G01N2333/46—Assays involving biological materials from specific organisms or of a specific nature from animals; from humans from vertebrates
- G01N2333/47—Assays involving proteins of known structure or function as defined in the subgroups
- G01N2333/4701—Details
- G01N2333/4703—Regulators; Modulating activity
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N2333/00—Assays involving biological materials from specific organisms or of a specific nature
- G01N2333/435—Assays involving biological materials from specific organisms or of a specific nature from animals; from humans
- G01N2333/46—Assays involving biological materials from specific organisms or of a specific nature from animals; from humans from vertebrates
- G01N2333/47—Assays involving proteins of known structure or function as defined in the subgroups
- G01N2333/4701—Details
- G01N2333/4739—Cyclin; Prad 1
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N2333/00—Assays involving biological materials from specific organisms or of a specific nature
- G01N2333/435—Assays involving biological materials from specific organisms or of a specific nature from animals; from humans
- G01N2333/46—Assays involving biological materials from specific organisms or of a specific nature from animals; from humans from vertebrates
- G01N2333/47—Assays involving proteins of known structure or function as defined in the subgroups
- G01N2333/4701—Details
- G01N2333/4742—Keratin; Cytokeratin
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N2333/00—Assays involving biological materials from specific organisms or of a specific nature
- G01N2333/435—Assays involving biological materials from specific organisms or of a specific nature from animals; from humans
- G01N2333/705—Assays involving receptors, cell surface antigens or cell surface determinants
- G01N2333/70503—Immunoglobulin superfamily, e.g. VCAMs, PECAM, LFA-3
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N2333/00—Assays involving biological materials from specific organisms or of a specific nature
- G01N2333/435—Assays involving biological materials from specific organisms or of a specific nature from animals; from humans
- G01N2333/705—Assays involving receptors, cell surface antigens or cell surface determinants
- G01N2333/70503—Immunoglobulin superfamily, e.g. VCAMs, PECAM, LFA-3
- G01N2333/7051—T-cell receptor (TcR)-CD3 complex
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N2333/00—Assays involving biological materials from specific organisms or of a specific nature
- G01N2333/435—Assays involving biological materials from specific organisms or of a specific nature from animals; from humans
- G01N2333/705—Assays involving receptors, cell surface antigens or cell surface determinants
- G01N2333/70503—Immunoglobulin superfamily, e.g. VCAMs, PECAM, LFA-3
- G01N2333/70517—CD8
Definitions
- This disclosure relates to methods, kits, and systems for scoring the immune response to cancer through examination of tissue infiltrating lymphocytes (TILs).
- TILs tissue infiltrating lymphocytes
- Bio samples such as histology specimens, may be examined histopathologically by light microscopy using bright field illumination; whereas molecular pathology is the examination, at a molecular level, of biomolecules associated with disease. From a histopathological examination, important information about patient diagnosis, prognosis, and treatment options can be elucidated.
- Pathologists study the histopathologic architecture, tissue morphology, and/or signals associated with the detection of particular biomolecules (e.g. nucleic acid or proteins).
- a number of assays presently available detect and/or quantify proteins (i.e. immunohistochemistry (IHC)), nucleic acids (i.e. in situ hybridization (ISH)), carbohydrates (i.e. histochemistry (HC)), and enzymes (i.e. enzyme histochemistry (EHC)).
- an image analysis system for the automatic computation of an immune score from a set images of multiplex IHC slides or images of fluorescent stained slides is desirable.
- TILs tissue infiltrating lymphocytes
- TILs Immune cells infiltrating the tumor microenvironment
- Increasing evidence demonstrate that the number, type and location of TILs in primary tumors may have a prognostic role. These observations have led to the development of potential new scoring systems derived from the immune context in tissue and based on the identification and evaluation of specific lymphocyte populations. The potential prognostic value of CD3, CD8, CD20, and FOXP3 was explored as an ‘Immunoscore’ for melanoma patients which would utilize widely accessible, standardized technology.
- the natural history of a tumor includes phases of ‘in situ’ growth, invasion, extravasation and metastasis. During these phases, tumor cells interact with their microenvironment and are influenced by signals coming from stromal, endothelial, inflammatory and immune cells. Indeed, tumors are often infiltrated by various numbers of lymphocytes, macrophages or mast cells. It is generally believed that the latter produce factors that maintain chronic inflammation and promote tumor growth, whereas lymphocytes may control cancer outcome, as evidenced in mouse models. In this study, we analyze data from large cohorts of human tumors, clearly establishing that infiltration of the primary tumor by memory T cells, particularly of the Th1 and cytotoxic types, is the strongest prognostic factor in terms of freedom from disease and overall survival at all stages of clinical disease.
- T and B cells organized as germinal centers may be the site of an antitumor reaction.
- the unmet medical need is the ability to determine which melanoma patients with node infiltration progress to metastisis and which would not based on a measure of the patient's immune response.
- Current standard of practice is either to watch and monitor these patients or treat them with harsh interferon treatment.
- multiplex IHC slide has the potential advantages of simultaneously identifying multiple biomarkers in a tissue section as opposed to single biomarker labeling in multiple slides.
- digital pathology can serve to visually separate and quantitatively score the biomarkers for the immune cells, such as the different type of T-cells and B-cells.
- the following references disclose methods for assessing and/or scoring tissue, but are not adequate for multiplex slides: Manual tumor microenvironment assessment with CD3, CD8, CD45R0 and FoxP3: Paolo Ascierto, “The Medical Need for an Immune Scoring/Profiling for Melanoma and Other Cancer Patients,” Invited talk, Arlington Symposium, Mar.
- the tumor marker, B-cell, total T cell, cytotoxic T cell, and regulatory T cell populations should all be viewed together, and the scoring and interpretation must be automated and scalable to realistically function as a clinical concept.
- Our assay includes a tumor marker, as well as 4 immune markers.
- the immunological data (the type, density, and location of immune cells within the tumor samples) were found to be a better predictor of patient survival than the histopathological methods currently used to stage cancer.
- the results were validated in two patient populations. This data supports the hypothesis that the adaptive immune response influences the behavior of human tumors. In situ analysis of tumor-infiltrating immune cells may therefore be a valuable prognostic tool in the treatment of colorectal cancer and other malignancies.
- the image analysis algorithm involves a computer-implemented method for counting a number of types of cells in a single tissue specimen that has been stained with a multiplex assay, comprising: imaging the single tissue specimen that has been stained with the multiplex assay that includes lymphocyte markers CD3, CD8, CD20, FoxP3, and tumor detection markers; unmixing the image of single tissue specimen that has been stained with a multiplex assay into separate image channels for each marker of the multiplex assay; identifying regions of interest in each image channel based on intensity information in each channel, wherein regions of low intensity in each channel are removed, and regions of high intensity represent cell signals; generating a single surrogated image, wherein the surrogated image is a combination of the image channel information of all the lymphocyte markers; applying a cell detection algorithm, wherein the cell detection algorithm is a membrane finding algorithm or a nucleus finding algorithm; identifying features of the lymphocyte
- FIG. 1(A) -(B) are photomicrographs of a primary melanoma tissue (A) and (B) taken with (A) a 20 ⁇ objective and (B) a 40 ⁇ objective which shows a 5-plex stain with FoxP3 being detected in dark brown (exemplarily indicated by an arrow indicated with “DB” in FIG. 1(B) ), CD8 detected in dark gray/black (exemplarily indicated by an arrow indicated with “DGB” in FIG. 1(B) ), CD3 detected in blue (exemplarily indicated by an arrow indicated with “B” in FIG. 1(B) ), CD20 detected in red/magenta (exemplarily indicated by an arrow indicated with “RM” in FIG. 1(B) ) and S100 detected in green (exemplarily indicated by an arrow indicated with “G” in FIG. 1(A) ), wherein (B) focuses on lymphocytic cells that can be seen to the left of the primary tumor.
- DB dark gray/black
- DGB dark gray/black
- FIG. 2(A) -(B) are photomicrographs of a colon carcinoma tissue (A) and (B) taken with (A) a 20 ⁇ objective and (B) a 40 ⁇ objective which shows a 5-plex stain with FoxP3 being detected in dark brown (exemplarily indicated by an arrow indicated with “DB” in FIG. 2(B) ), CD8 detected in dark gray/black (exemplarily indicated by an arrow indicated with “DGB” in FIG. 2(B) ), CD3 detected in blue (exemplarily indicated by an arrow indicated with “B” in FIG. 2(B) ), CD20 detected in red/magenta (exemplarily indicated by an arrow indicated with “RM” in FIG. 2(B) ) and cytokeratin (OSCAR) detected in green (exemplarily indicated by an arrow indicated with “G” in FIG. 2(B) ).
- DB dark gray/black
- DGB dark gray/black
- CD3 detected in blue exemplarily indicated by an arrow indicated with “B” in FIG. 2(B
- FIG. 3 is a photomicrograph of a tongue carcinoma tissue which shows a 5-plex stain with FoxP3 being detected in dark brown (exemplarily indicated by an arrow indicated with “DB”), CD8 detected in dark gray/black (exemplarily indicated by an arrow indicated with “DGB”), CD3 detected in blue (exemplarily indicated by an arrow indicated with “B”), CD20 detected in red/magenta (exemplarily indicated by an arrow indicated with “RM”) and cytokeratin (OSCAR) detected in green (exemplarily indicated by an arrow indicated with “G”).
- DB dark brown
- DGB dark gray/black
- B CD3 detected in blue
- OSCAR cytokeratin
- FIG. 4 is a photomicrograph of a lung adenocarcinoma tissue taken at a 20 ⁇ objective which shows a 5-plex stain with FoxP3 being detected in dark brown (exemplarily indicated by an arrow indicated with “DB”), CD8 detected in dark gray/black (exemplarily indicated by an arrow indicated with “DGB”), CD3 detected in blue (exemplarily indicated by an arrow indicated with “B”), CD20 detected in red/magenta (exemplarily indicated by an arrow indicated with “RM”) and cytokeratin (OSCAR) detected in green (exemplarily indicated by an arrow indicated with “G”).
- DB dark brown
- DGB dark gray/black
- B CD3 detected in blue
- CD20 detected in red/magenta exemplarily indicated by an arrow indicated with “RM”
- OSCAR cytokeratin
- FIG. 5 is a photomicrograph (20 ⁇ objective) of an ovarian adenocarcinoma tissue stained (5-plex) with antibodies for a cytokeratin tumor marker (yellow) (exemplarily indicated by an arrow indicated with “Y”) and for infiltrating CD8+ cytotoxic T cells (green) (exemplarily indicated by an arrow indicated with “G”), further showing how the CD8 cells have infiltrated throughout the tumor.
- a cytokeratin tumor marker exemplarily indicated by an arrow indicated with “Y”
- cytotoxic T cells green
- FIG. 6 is a photomicrograph of normal tonsil tissue stained with antibodies for proliferation marker Ki-67 (green) (exemplarily indicated by an arrow indicated with “G”), CD8+ T cells (purple) (exemplarily indicated by an arrow indicated with “P”), and CD3+ T cells (yellow) (exemplarily indicated by an arrow indicated with “Y”).
- Ki-67 green
- CD8+ T cells purple
- CD3+ T cells yellow
- Y CD3+ T cells
- FIG. 7 is a photomicrograph (20 ⁇ objective) of breast cancer tissue showing tumor in purple (exemplarily indicated by an arrow indicated with “P”), infiltrating CD8+ cells in green (exemplarily indicated by an arrow indicated with “G”), and CD68+ macrophages in blue (exemplarily indicated by an arrow indicated with “B”), and CD20 detected in red (exemplarily indicated by an arrow indicated with “R”).
- P purple
- G infiltrating CD8+ cells in green
- B CD68+ macrophages in blue
- R CD20 detected in red
- FIG. 8(A) -(D) is (A) a photomicrograph similar to FIG. 7 , unmixed into its component colors (B) and (D); and reassembled and pseudocolored in (C).
- FIG. 9 is a schematic illustrating a Scoring Algorithm Workflow in accordance with the present disclosure.
- FIG. 10 is a schematic illustrating an example implementation of the Scoring Algorithm in accordance with the present invention.
- FIG. 11(A) -(B) is a schematic illustrating a filter bank (A) and ring detector (B) in accordance with the present invention.
- the multiplex assay along with the image analysis algorithms, potentially provide a toolkit for the breast cancer and/or melanoma immune score computation.
- the final report generated by the computer may be used to support the clinical analysis of the patient's personal immune response and help guide further treatment, but further studies are needed to substantiate this hypothesis.
- TILs tumor microenvironment
- Increasing evidence demonstrates that the number, type and location of TILs in primary tumors may have a prognostic role.
- These observations have led to the development of potential new scoring systems derived from the immune context in tissue and based on the identification and evaluation of specific lymphocyte populations.
- a multiplex IHC slide has the potential advantage of simultaneously identifying multiple biomarkers in a single tissue section as opposed to single biomarker labeling in multiple slides, thereby demonstrating much more information within one small piece of tissue.
- a multiplex assay has been developed to provide an immune score for patients with breast cancer and melanoma, along with other tumor types.
- digital pathology can serve to visually separate and quantitatively score the biomarkers for the immune cells, such as the different types of TILs.
- CD3 is the “universal marker” for T cells in general. Further analysis (staining) must be done to identify the type of T cell, e.g. regulatory or cytotoxic T cell. An analysis of CD3+ T cell numbers is a good indication of immune response.
- CD8 is a specific marker for cytotoxic T lymphocytes. These are the effector cells that actually “kill” tumor cells. They act by direct contact to introduce the digestive enzyme granzyme B into the tumor cell cytoplasm, thereby killing it. Therefore, it is important not only to know their overall numbers but also their localization relative to the tumor itself. Only those cells in direct contact with tumor cells will be effective in cell killing.
- CD20 is a marker for antibody-producting B cells. As such, it is an indication of a more fully developed (mature) immune response. The total numbers and localization of these antibody-producing effector cells may be of importance.
- Tregs are nuclear transcription factor that is the most specific marker for regulatory T cells (so-called Tregs). Tregs function to moderate the immune response. Presumably, the presence of Tregs would indicate an inhibitory immune response to a tumor.
- cytokeratin staining identifies tumor cells as well as the normal epithelium. This information, together with the fact that tumor cells abnormally overexpress the cytokeratins compared to normal epithelial cells, allows one to identify tumor vs. normal tissue.
- the S100 biomarker serves a similar purpose.
- the method includes applying a chromogenic reagent so that the sample is specifically stained.
- specifically staining includes the application of a primary stain that selectively stains portions of the sample through adhesion associated with hydrophobicity, intercalation, or other non-recognition associations.
- hematoxylin and eosin staining H&E staining
- H&E staining is well known in the art. Reference is made to U.S. Published Patent Application 2008/0227143, which is hereby incorporated by reference for disclosure related to hematoxylin and primary staining. H&E staining is used for the evaluation of cellular morphology and is the primary tool for pathologically diagnosing cancer.
- the method includes applying an immunohistochemical (IHC) binding reagent or an in situ hybridization (ISH) binding reagent so that the IHC binding reagent or the ISH binding reagent contact the sample.
- ISH can be used to diagnose the presence of a genetic abnormality or condition, or over- or under-expression from the norm.
- ISH may be used to detect gene amplification, deletion, or translocation of genes related to a particular disease.
- ISH is also useful in the diagnosis of infectious diseases as it allows detection of microbial and viral sequences within infected cells.
- IHC includes antibodies specifically binding epitopes of interest.
- the epitopes also referred to as antigens or antigenic sequences, are portions of proteins that have been established as a marker of clinical interest.
- the epitope may be a mutated form of a protein, a protein-protein binding site, or a normal protein that is expressed at a concentration either higher or lower than normal, such as in a control sample. Detection and/or quantification of epitopes in various biological samples have been used for a vast number of clinical purposes.
- Both IHC and ISH involve a specific recognition event between a nucleic acid probe (ISH) or an antibody (IHC) and a target within the sample. This specific interaction labels the target.
- the label can be directly visualized (direct labeling) or indirectly observed using additional detection chemistries.
- Chromogenic detection which involves the deposition of a chromogenic substance in the vicinity of the label, involves further detection steps to amplify the intensity of the signal to facilitate visualization. Visualization of the amplified signal (e.g. the use of reporter molecules) allows an observer to localize targets in the sample.
- Chromogenic detection offers a simple and cost-effective method of detection. Chromogenic substrates have traditionally functioned by precipitating when acted on by the appropriate enzyme. That is, the traditional chromogenic substance is converted from a soluble reagent into an insoluble, colored precipitate upon contacting the enzyme. The resulting colored precipitate requires no special equipment for processing or visualizing.
- Table 1 is a non-exhaustive list of chromogen systems useful within the scope of the present disclosure:
- a key advancement to the present invention is the use of tyramide-chromogen conjugates that allow deposition and covalent binding of here-to-fore novel chromogens of novel color schemes.
- This covalent binding also has the added advantage of being able to dehydrate the specimen slides in a series of increasing concentrations of alcohol solutions followed by xylene and mounting in a hardened plastic for permanent preservation. This results in improved morphology and resolution of staining compared to other chromogen dye staining techniques that employ dyes that are extracted by this conventional histological processing.
- the chromogen conjugates may be configured to absorb light more selectively than traditionally available chromogens. Detection is realized by absorbance of the light by the signaling conjugate; for example, absorbance of at least about 5% of incident light would facilitate detection of the target. In other darker stains, at least about 20% of incident light would be absorbed. Non-uniform absorbance of light within the visible spectra results in the chromophore moiety appearing colored.
- the signaling conjugates disclosed herein may appear colored due to their absorbance; the signaling conjugates may appear to provide any color when used in the assay, with certain particular colors including red, orange, yellow, green, indigo, or violet depending on the spectral absorbance associated with the chomophore moiety.
- the chromophore moieties may have narrower spectral absorbances than those absorbances of traditionally used chromogens (e.g. DAB, Fast Red, Fast Blue).
- the spectral absorbance associated with the first chromophore moiety of the first signaling conjugate has a full-width half-max (FWHM) of between 30 nm and 250 nm, between 30 nm and 150 nm, between 30 nm and 100 nm, or between 20 nm and 60 nm.
- FWHM full-width half-max
- Narrow spectral absorbances enable the signaling conjugate chromophore moiety to be analyzed differently than traditional chromogens. While having enhanced features compared to traditional chromogens, detecting the signaling conjugates remains simple. In illustrative embodiments, detecting comprises using a brightfield microscope or an equivalent digital scanner. The narrow spectral absorbances enable chromogenic multiplexing at a level beyond the capability of traditional chromogens. For example, traditional chromogens are somewhat routinely duplexed (e.g. Fast Red and Fast Blue, Fast Red and Black (silver), Fast Red and DAB).
- traditional chromogens are somewhat routinely duplexed (e.g. Fast Red and Fast Blue, Fast Red and Black (silver), Fast Red and DAB).
- the method includes detecting from at least two, and up to six or more, different targets using different signaling conjugates or combinations thereof.
- illuminating the biological sample with light comprises illuminating the biological sample with a spectrally narrow light source, the spectrally narrow light source having a spectral emission with a second full-width half-max (FWHM) of between 30 nm and 250 nm, between 30 nm and 150 nm, between 30 nm and 100 nm, or between 20 nm and 60 nm.
- illuminating the biological sample with light includes illuminating the biological sample with an LED light source.
- illuminating the biological sample with light includes illuminating the biological sample with a filtered light source.
- the subject disclosure is a non-transitory computer-readable medium for storing computer-executable instructions that are executed by a processor to perform operations including training an algorithm, computing a score, and unmixing.
- the subject disclosure is a system for digital pathology including a processor and a memory coupled to the processor, the memory to store computer-executable instructions that, when executed by the processor, cause the processor to perform operations, including training an algorithm, computing a score, and unmixing.
- the present invention includes an image analysis system that automatically computes a score, for example, an immune score, for a multiplex assay (e.g., a set of multiplex IHC slides) or fluorescent stained slide or slides.
- the image analysis system includes software modules and algorithms, that include computer executable instructions that are executed by, for example, a processor, for the purpose of analyzing images of tissue stained with a multiplex assay, and for generating a score based off of the analysis.
- the image analysis system is able to identify multiple biomarkers in the same biological specimen, for example a single tissue specimen, and is applicable to a multiplex assay for any tissue type.
- the image analysis algorithm of the present invention is described in connection with cancerous tissue slides that are stained by a multiplex assay.
- breast tissue slides are analyzed.
- stained tissue slides are imaged and/or scanned, and the corresponding color images are generated, and input into the image analysis system.
- the images are obtained from a source.
- the present invention is applicable to brightfield and fluorescence images, and a microscopy system (e.g., a brightfield microscopy system) or a scanner is utilized for imaging or scanning the slides and obtaining the brightfield images.
- a microscopy system e.g., a brightfield microscopy system
- a scanner is utilized for imaging or scanning the slides and obtaining the brightfield images.
- a multi-spectral imaging system such as a fluorescent microscope or scanner (e.g., a whole slide scanner) is used to obtain the multi-spectral fluorescent images.
- the image analysis algorithm and/or system of the present invention includes a color unmixing algorithm, which may be included in an unmixing module, that identifies the individual constituent dyes for the biomarkers and the proportions in which they appear in the color images.
- the unmixing operations may be performed in accordance with the unmixing method disclosed in U.S. Provisional Application No. 61/830,620, filed Jun. 3, 2013, and entitled IMAGE ADAPTIVE PHYSIOLOGICALLY PLAUSIBLE COLOR SEPARATION, the disclosure of which is incorporated herein by reference in its entirety.
- detection algorithms are developed to automatically identify different combination of T and B lymphocytes with respect to each of the differentiating IHC markers.
- a tumor marker for example a cytokeratin marker (e.g., Oscar) may also be included in the assay to identify the tumor, intratumoral and/or peritumoral regions to get the tissue context (for example, to identify the nuclei and the tumor regions).
- image analysis is performed, after unmixing, to identify, quantify and/or generate a score for a biomarker, for example, Oscar, CD3, CD8 and FoxP3 markers.
- the score for each marker may be reported, along with the tissue context information, as output.
- FIG. 9 illustrates the workflow of an image analysis method and system of the present invention.
- FIG. 9 shows an example implementation of an image analysis method, in accordance with the present invention, that depicts details associated the image analysis method being applied to breast cancer immune score computation.
- the image analysis method of the present invention involves a training stage, which may be incorporated into a training stage module.
- identification for different type of lymphocytes as well as the examples of false positive cells may be performed first, for each marker.
- the seeds within the cells e.g., true positive T-cells
- seeds outside the cells e.g., false positive T-cells
- one or more feature extraction algorithms in accordance with the present invention, which may be incorporated in a feature extraction module, is applied to an image patch around the seed to obtain a feature set for each type of cells (e.g., CD3 cells, CD8 cells and CD20 cells).
- the features are extracted from different image channels, for example, the RGB channels of the image, the absorbance space, the unmixed channels and the grayscale image.
- different feature extraction algorithms can be used.
- dictionary learning can be applied to build a codebook for the different cell appearances.
- a classification algorithm which may be included in a classification module, may be trained to classify different types of cells present in an image, for example, an image of tissue stained with a multiplex assay.
- different classification algorithms for example, SVM, Random Forest and Boosting etc. algorithms may be applied.
- an SVM algorithm is utilized in the classification algorithm, as shown in FIG. 9 to associate a feature with a label for the feature.
- the whole slide image, or portion thereof is input into the image analysis method/system of the present invention.
- the following steps of unmixing, removing tumor-related noise, generating a surrogated image, ring or blob detecting (e.g., to find lymphocytes with membrane markers), feature extracting, classifying, and counting of types of cells or lymphocytes are applied.
- a surrogated image of lymphocytes i.e., an image that contains all the T-cells
- a log transform is utilized to convert the RGB image into absorbance space, and then the Oscar channel may be utilized to remove the noise (tumor cells) as shown in FIG. 9 , since we are not detecting the tumor cells.
- the Oscar channel information including the tumor cell information is saved in a memory in order to count the tumor cells.
- a surrogated image is utilized to do detection, instead of each unmixed channel, because unmixing multiplex assays, for example assays having five or more markers, may not be reliable due to the huge color variation across the image.
- a combined image of some other sort may be utilized, for example, a transformed image (e.g., an absorbance image or grey scale image) or an image that combines various channels.
- the input image e.g., the RGB image
- the input image may be unmixed into different channels of biomarkers, for example, the Oscar, FoxP3, CD3, CD8, HTX and CD20 channels.
- the cell detection algorithm may be included in a cell detection module, and is applied to the surrogated image to detect the lymphocytes.
- the ring shape of the cell detection algorithm provides for capturing ring shape membrane markers (e.g. all the possible T-cell candidates and may include false positive detections).
- ring shape membrane markers e.g. all the possible T-cell candidates and may include false positive detections.
- a cell detection algorithm that is very sensitive, is desirable, e.g., an algorithm that captures all possible cells and may include the false positive detections.
- a ring detector may be applied to the surrogate image to detect the membrane markers, which are utilized to identify cells.
- FIG. 10 illustrates a simple example of the ring detector. It should be understood by one skilled in the art that other and different types of cell detection algorithms may be applied to an image (surrogate or otherwise) to detect cells.
- a classifier for example, the classifier learned or generated from the training stage, may be then used to classify all the cell candidate seeds between categories, such as false positive cell, CD3 only T-cell, CD3/CD8 T-cell, FP3 T-cell and B-cell.
- the information from CD3, CD8, FP3 and CD20 channels may also be used as a feature for classification.
- FIG. 9 illustrates an example of implementation of the dictionary learning algorithm.
- (1) a learned appearance feature, for example, the shape of the cell, which was obtained from the local patch around the seed, is utilized to distinguish between true positive and false positive lymphocytes and (2) the stain amount feature is utilized to classify, for example, the CD3-only and CD3/CD8 T-cells.
- the CD3 and CD8 pixels around the neighborhood of the T-cell, from CD3 and CD8 unmixed channels may be obtained, and the ratio of the two stains is computed to classify between (1) CDs positive and CD8 positive cells and (2) CD3 positive only cells.
- the cell identified in the surrogate image is labeled as CD3 only cell, otherwise it is labeled as CD3/CD8 cell.
- the nuclear marker channel for example, the FoxP3 channel image
- FoxP3 is the nuclear marker.
- the blob detection algorithm which may be included in a blob detection module, in the FoxP3 channel to find the FoxP3 nuclei.
- a radial symmetry algorithm which may be included in a radial symmetry module, may be utilized to detect nuclei.
- other blob detection methods may be accomplished utilizing, for example, a circular transform.
- the Oscar channel is utilized.
- region detection algorithms may be used to identify the tumor regions.
- an Otsu thresholding method is applied to Oscar channel to find the tumor region.
- the Otsu thresholding method identifies the tumor region by a process that finds the best threshold for the foreground and background.
- the Oscar channel is also utilized to remove the noise associated with the tumor region.
- the Oscar channel is also utilized to remove the ring shape tumor cytoplasmic markers. As cytoplasmic markers sometimes create ring shape appearance, we need to remove those regions first before applying ring detection.
- the order of the steps of the image analysis algorithms, methods, and/or systems of the present invention may vary.
- FIG. 11(B) illustrates an exemplary ring detector, in accordance with the present invention, that may be utilized for lymphocyte detection in our implementation.
- a filter bank i.e., a set of masks containing 12 directions, as shown in FIG. 11(A) .
- the black region denote pixels of ⁇ 1 which cover the center of the ring and the gray region corresponds to pixels of 1 covering the boundary of the ring, so that when this mask is convolved with the image we obtain the intensity difference between the ring boundary and the center.
- the width of the filter is 3 pixels
- the length of black region is 5 pixels
- the length of the gray region is 10 pixels.
- the parameters including, for example, the number of directions, width and length of the filter are adjustable, for example, to correspond to the different cell sizes for which detection is desired.
- the vote corresponds to the intensity value difference of total pixel intensities within the black region of the filter and the gray region of the filter. This vote is accumulated at (x,y) along 12 directions at the center of the ring. Note that 12 is just an example number of directions and different number can be used.
- multi-scale detection i.e., different sizes of the ring
- One embodiment relates to a user interface and functionalities associated with an image analysis system and/or method in accordance with the present invention.
- the user interface provides the following functionalities:
- a load image feature that allows for loading the FOVs or whole slide images via the “Load Data Dir” button.
- a detect tissue region feature that allows for detection of the lymphocytes and tumor regions and/or display of the detection results by clicking, for example, the file name in the “File List” panel.
- a cell modification feature that allows the user to modify the cell detection results, add and/or delete annotations.
- a user may first select the type of cell to modify from the popup list, then click the “Modify Cell” button to start editing, and a left click of the mouse corresponds to, for example, being able to delete a seed and a right click of the mouse corresponds, for example, to being able to add a seed.
- activation of the “Enter” key on keyboard indicates that editing is complete.
- a tumor modification feature allows the user to modify the tumor detection results.
- a user may to start draw a polygon and a double left click of the mouse, for example, allows a user to indicate that the drawing of the polygon is complete.
- a save modification feature allows a user, via activation of a “Save Modification” button to save the modification.
- a create final report feature allows a user to create a final report that includes, for example, the immune score, which is based on a number of one or more cell types. For example, a user may click the “Get Report” button or region of the user interface to generate the final report. It should be understood by one of ordinary skill in the art that buttons, icons, and regions of the screen may be utilized to activate features, and can all be utilized as alternatives to the other.
- An exemplary embodiment of a computer system for use in accordance with the present disclosure may include any number of computer platforms or multiple types of computer platforms, such as workstations, personal computers, servers, hand-held devices, multi-processor systems, microprocessor-based or programmable consumer electronics, network PCs, minicomputers, mainframe computers or any other present or future computer.
- An exemplary embodiment may also be practiced in distributed computing environments where tasks are performed by local and/or remote processing devices that are connected (by, for example, hardwired connections, wireless connections, or a combination thereof), in a communications network.
- program modules may be located in both local and remote computer storage media including memory storage devices. It will, however, be appreciated by one of ordinary skill in the art that the aforementioned computer platforms as described herein are specifically configured to perform the specialized operations of the described invention and are not considered general purpose computers.
- Computers typically include known components, such as a processor, an operating system, system memory, memory storage devices, input-output controllers, input-output devices, and display devices. It will also be understood by those of ordinary skill in the relevant art that there are many possible configurations and components of a computer and may also include cache memory, a data backup unit, and many other devices. Examples of input devices include a keyboard, a cursor control devices (e.g., a mouse), a microphone, a scanner, and so forth. Examples of output devices include a display device (e.g., a monitor or projector), speakers, a printer, a network card, and so forth. Display devices may include display devices that provide visual information, this information typically may be logically and/or physically organized as an array of pixels.
- An interface controller may also be included that may comprise any of a variety of known or future software programs for providing input and output interfaces.
- interfaces may include what are generally referred to as “Graphical User Interfaces” (often referred to as GUI's) that provide one or more graphical representations to a user. Interfaces are typically enabled to accept user inputs using means of selection or input known to those of ordinary skill in the related art.
- the interface may also be a touch screen device.
- applications on a computer may employ an interface that includes what are referred to as “command line interfaces” (often referred to as CLI's). CLI's typically provide a text based interaction between an application and a user.
- command line interfaces present output and receive input as lines of text through display devices.
- some implementations may include what are referred to as a “shell” such as Unix Shells known to those of ordinary skill in the related art, or Microsoft Windows Powershell that employs object-oriented type programming architectures such as the Microsoft .NET framework.
- interfaces may include one or more GUI's, CLI's or a combination thereof.
- a processor may include a commercially available processor such as a Celeron, Core, or Pentium processor made by Intel Corporation, a SPARC processor made by Sun Microsystems, an Athlon, Sempron, Phenom, or Opteron processor made by AMD Corporation, or it may be one of other processors that are or will become available.
- Some embodiments of a processor may include what is referred to as multi-core processor and/or be enabled to employ parallel processing technology in a single or multi-core configuration.
- a multi-core architecture typically comprises two or more processor “execution cores”. In the present example, each execution core may perform as an independent processor that enables parallel execution of multiple threads.
- a processor may be configured in what is generally referred to as 32 or 64 bit architectures, or other architectural configurations now known or that may be developed in the future.
- a processor typically executes an operating system, which may be, for example, a Windows type operating system from the Microsoft Corporation; the Mac OS X operating system from Apple Computer Corp.; a Unix or Linux-type operating system available from many vendors or what is referred to as an open source; another or a future operating system; or some combination thereof.
- An operating system interfaces with firmware and hardware in a well-known manner, and facilitates the processor in coordinating and executing the functions of various computer programs that may be written in a variety of programming languages.
- An operating system typically in cooperation with a processor, coordinates and executes functions of the other components of a computer.
- An operating system also provides scheduling, input-output control, file and data management, memory management, and communication control and related services, all in accordance with known techniques.
- System memory may include any of a variety of known or future memory storage devices that can be used to store the desired information and that can be accessed by a computer.
- Computer readable storage media may include volatile and non-volatile, removable and non-removable media implemented in any method or technology for storage of information such as computer readable instructions, data structures, program modules, or other data. Examples include any commonly available random access memory (RAM), read-only memory (ROM), electronically erasable programmable read-only memory (EEPROM), digital versatile disks (DVD), magnetic medium, such as a resident hard disk or tape, an optical medium such as a read and write compact disc, or other memory storage device.
- RAM random access memory
- ROM read-only memory
- EEPROM electronically erasable programmable read-only memory
- DVD digital versatile disks
- magnetic medium such as a resident hard disk or tape
- an optical medium such as a read and write compact disc, or other memory storage device.
- Memory storage devices may include any of a variety of known or future devices, including a compact disk drive, a tape drive, a removable hard disk drive, USB or flash drive, or a diskette drive. Such types of memory storage devices typically read from, and/or write to, a program storage medium such as, respectively, a compact disk, magnetic tape, removable hard disk, USB or flash drive, or floppy diskette. Any of these program storage media, or others now in use or that may later be developed, may be considered a computer program product.
- program storage media typically store a computer software program and/or data.
- Computer software programs also called computer control logic
- typically are stored in system memory and/or the program storage device used in conjunction with memory storage device.
- a computer program product is described comprising a computer usable medium having control logic (computer software program, including program code) stored therein.
- the control logic when executed by a processor, causes the processor to perform functions described herein.
- some functions are implemented primarily in hardware using, for example, a hardware state machine. Implementation of the hardware state machine so as to perform the functions described herein will be apparent to those skilled in the relevant arts.
- Input-output controllers could include any of a variety of known devices for accepting and processing information from a user, whether a human or a machine, whether local or remote. Such devices include, for example, modem cards, wireless cards, network interface cards, sound cards, or other types of controllers for any of a variety of known input devices.
- Output controllers could include controllers for any of a variety of known display devices for presenting information to a user, whether a human or a machine, whether local or remote.
- the functional elements of a computer communicate with each other via a system bus.
- Some embodiments of a computer may communicate with some functional elements using network or other types of remote communications.
- an instrument control and/or a data processing application if implemented in software, may be loaded into and executed from system memory and/or a memory storage device.
- instrument control and/or data processing applications may also reside in a read-only memory or similar device of the memory storage device, such devices not requiring that the instrument control and/or data processing applications first be loaded through input-output controllers. It will be understood by those skilled in the relevant art that the instrument control and/or data processing applications, or portions of it, may be loaded by a processor, in a known manner into system memory, or cache memory, or both, as advantageous for execution.
- a computer may include one or more library files, experiment data files, and an internet client stored in system memory.
- experiment data could include data related to one or more experiments or assays, such as detected signal values, or other values associated with one or more sequencing by synthesis (SBS) experiments or processes.
- SBS sequencing by synthesis
- an internet client may include an application enabled to access a remote service on another computer using a network and may for instance comprise what are generally referred to as “Web Browsers”.
- some commonly employed web browsers include Microsoft Internet Explorer available from Microsoft Corporation, Mozilla Firefox from the Mozilla Corporation, Safari from Apple Computer Corp., Google Chrome from the Google Corporation, or other type of web browser currently known in the art or to be developed in the future.
- an internet client may include, or could be an element of, specialized software applications enabled to access remote information via a network such as a data processing application for biological applications.
- a network may include one or more of the many various types of networks well known to those of ordinary skill in the art.
- a network may include a local or wide area network that may employ what is commonly referred to as a TCP/IP protocol suite to communicate.
- a network may include a network comprising a worldwide system of interconnected computer networks that is commonly referred to as the internet, or could also include various intranet architectures.
- Firewalls also sometimes referred to as Packet, Filters, or Border Protection Devices
- firewalls may comprise hardware or software elements or some combination thereof and are typically designed to enforce security policies put in place by users, such as for instance network administrators, etc.
- Exemplary automated systems available through Ventana Medical Systems, Inc., Arlington, Ariz. include SYMPHONY® Staining System, catalog #: 900-SYM3, VENTANA® BenchMark Automated Slide Preparation Systems, catalog #s: N750-BMKXT-FS, N750-BMKU-FS, VENTANA, and VENTANA® BenchMark Special Stains automated slide stainer.
- These systems employ a microprocessor controlled system including a revolving carousel supporting radially positioned slides.
- a stepper motor rotates the carousel placing each slide under one of a series of reagent dispensers positioned above the slides. Bar codes on the slides and reagent dispensers permits the computer controlled positioning of the dispensers and slides so that different reagent treatments can be performed for each of the various tissue samples by appropriate programming of the computer.
- Illustrative instrumentation systems are designed to sequentially apply reagents to tissue sections mounted on one by three inch glass microscope slides under controlled environmental conditions.
- the instrument must perform several basic functions such as reagent application, washing (to remove a previously applied reagent), jet draining (a technique to reduce the residual buffer volume on a slide subsequent to washing), application of a light oil used to contain reagents and prevent evaporation, and other instrument functions.
- Exemplary staining instruments process slides on a rotating carousel. The slides maintain a stationary position and a dispenser carousel rotates the reagents above the fixed slides.
- the processes described herein can be performed using various physical configurations.
- the process of clarifying and staining tissue on a slide consists of the sequential repetition of basic instrument functions described above.
- a reagent is applied to the tissue then incubated for a specified time at a specific temperature.
- the reagent is washed off the slide and the next reagent is applied, incubated, and washed off, etc., until all of the reagents have been applied and the staining process is complete.
- a plurality of slides are mounted in a circular array on a carousel which rotates, as directed by the computer, to a dispensing location placing each slide under one of a series of reagent dispensers on a second rotating carousel positioned above the slides.
- Each slide receives the selected reagents (e.g. DNA probe) and is washed, mixed, and/or heated in an optimum sequence and for the required period of time.
- Baking may be performed to adhere tissue to slides, especially for fresh cut slides; temperatures: 60° C.-75° C.; incubation time: 4-32 min; for online baking, set the temperature 2-4 degrees above the melting point of paraffin brand used, [No baking];
- CC1 VMSI Catalog #: 950-124
- CC2 VMSI Catalog #: 950-123
- Reaction Buffer VMSI Catalog #: 950-300
- CC1 with a slightly alkaline pH used for heat+buffer retrieval CC2 pH of 6.0 used for heat+buffer retrieval, Reaction Buffer used for heat retrieval only; 1 to 5 cycles selectable; incubation times: 4-16 min; temperatures: 60° C.-100° C., [CC1 for 32 minutes-8 minutes at 95° C. followed by 24 minutes at 100° C.];
- Protease Treatment cell conditioning using heat retrieval loosens crosslinks from fixation; protease “punches holes” in protein; combination may enable better sample penetration; enzyme choice and incubation time may be determined by reagent manufacturer, recommendation, experimentation, enzyme option; user-fillable dispensers to be used with ENZYME 1-10, pre-diluted Protease 1-3 (VMSI Catalog #s: 760-2018, 760-2019, 760-2020); pre-diluted ISH-Protease 1-3 (VMSI Catalog #s: 780-4147, 780-4148, 780-4149); incubation time from 4-32 min, [No protease used];
- VMSI Catalog #: 253-4578 Pre Primary Peroxidase Inhibit & Post Primary Peroxidase Inhibit
- VMSI Catalog #: 253-4578 allows for inhibition of endogenous peroxidase after the primary has bound to the antigen; some antigens may be sensitive to hydrogen peroxide; this option can improve staining for those antibodies, [No Peroxidase Inhibition used];
- Cancerous breast tissue slides were stained with a cocktail of haptenated primary antibodies followed by sequential staining using anti-hapten secondary antibodies linked to HRP. The deposition of specific chromogens of different colors represented the localization of the primary antibodies.
- the stained slides were scanned and the corresponding RGB color images were obtained.
- To analyze the images we developed a color unmixing algorithm to identify the individual constituent dyes for the biomarkers and the proportions in which they appear in the color images. Based on the separated image channels for each marker, detection algorithms were developed to automatically identify different types of T-cells. The image analysis was done for Oscar, CD3, CD8 and FP3 markers. As the final output, the score for each marker was reported.
- the multiplex assay along with the image analysis algorithms, potentially provide a toolkit for the breast cancer immune score computation.
- the final report generated by the computer may be used to support the clinical analysis of the patient's personal immune response and help guide further breast cancer treatment, but further studies are needed to validate this approach.
- a color unmixing algorithm which may be refer referred to as a color unmixing algorithm, was developed that separates image data into individual contributions from three or more different chromogens.
- Tissue slides stained with the newly developed multiplex chromogen brightfield assay system were scanned on a standard brightfield whole-slide scanner and the color unmixing algorithm was applied in order to provide individual stain-specific image channels for subsequent analysis.
- immune profiling assays for breast cancer tissue that consisted of antibodies targeting CD3+ T cells, CD8+ cytotoxic T cells, FoxP3+ Treg cells, CD20+ B cells, CD68+ macrophages, and cytokeratin+ tumor cells.
- immune cells were located in different regions of the tissue, such as: stroma only, at the invasive margin of the tumor, and in the tumor center.
- stroma only, at the invasive margin of the tumor, and in the tumor center.
- Various combinations of immune cell distribution were observed, and when correlated with clinical outcome these data may be predictive of patient responses.
- TILs tumor-infiltrating lymphocytes
- macrophages Detection and characterization of tumor-infiltrating lymphocytes (TILs) and macrophages in individual cancer patients serves to demonstrate to what extent the patient's own immune system is activated in response to the tumor. This information may then be used as a prognostic or predictive test, or as a guide to further therapy.
- TILs tumor-infiltrating lymphocytes
- the multiplex chromogen detection system is a flexible and sensitive technology that can be used to detect multiple targets in brightfield light microscopy. For example, flexibility is demonstrated by the interchangeability of the chromogens and multiplexed assays can be designed using haptenated antibodies to improve sensitivity and avoid non-specific binding or “cross talk”. By using hapten amplification, the signal generated is more robust and allows detection of weakly-expressed antigens.
- the Immune Profiling concept illustrated in this filing serves as an ideal application for multiplex chromogen brightfield IHC, providing medical value by enabling multi-component tumor microenvironment analyses and facilitating testing efficiency by means of single slide staining.
Landscapes
- Health & Medical Sciences (AREA)
- Life Sciences & Earth Sciences (AREA)
- Engineering & Computer Science (AREA)
- Immunology (AREA)
- Molecular Biology (AREA)
- Chemical & Material Sciences (AREA)
- Physics & Mathematics (AREA)
- Urology & Nephrology (AREA)
- Hematology (AREA)
- Biomedical Technology (AREA)
- General Health & Medical Sciences (AREA)
- Biotechnology (AREA)
- Pathology (AREA)
- General Physics & Mathematics (AREA)
- Biochemistry (AREA)
- Analytical Chemistry (AREA)
- Medicinal Chemistry (AREA)
- Cell Biology (AREA)
- Microbiology (AREA)
- Food Science & Technology (AREA)
- Oncology (AREA)
- Genetics & Genomics (AREA)
- Hospice & Palliative Care (AREA)
- Bioinformatics & Cheminformatics (AREA)
- Biophysics (AREA)
- Medical Informatics (AREA)
- Bioinformatics & Computational Biology (AREA)
- Evolutionary Biology (AREA)
- Theoretical Computer Science (AREA)
- Spectroscopy & Molecular Physics (AREA)
- Proteomics, Peptides & Aminoacids (AREA)
- Signal Processing (AREA)
- Dispersion Chemistry (AREA)
- Investigating Or Analysing Biological Materials (AREA)
- Measuring Or Testing Involving Enzymes Or Micro-Organisms (AREA)
- Computer Vision & Pattern Recognition (AREA)
Abstract
This disclosure describes methods, kits, and systems for scoring the immune response to cancer through examination of tissue infiltrating lymphocytes (TILs). Methods of scoring the immune response in cancer using tissue infiltrating lymphocytes include detecting CD3, CD8, CD20, and FoxP3 within the sample and scoring the detection manually or scoring the digital images of the staining with the aid of image analysis and algorithms.
Description
- This is a divisional application of U.S. patent application Ser. No. 15/246,409, filed Aug. 24, 2016, which is a continuation of International Patent Application No. PCT/EP2015/053643, filed Feb. 20, 2015, which claims priority to and the benefit of U.S. Provisional Patent Application Ser. No. 61/943,939, filed Feb. 24, 2014, each of which is incorporated herein by reference as if set forth in its entirety.
- This disclosure relates to methods, kits, and systems for scoring the immune response to cancer through examination of tissue infiltrating lymphocytes (TILs).
- Biological samples, such as histology specimens, may be examined histopathologically by light microscopy using bright field illumination; whereas molecular pathology is the examination, at a molecular level, of biomolecules associated with disease. From a histopathological examination, important information about patient diagnosis, prognosis, and treatment options can be elucidated. Pathologists study the histopathologic architecture, tissue morphology, and/or signals associated with the detection of particular biomolecules (e.g. nucleic acid or proteins). A number of assays presently available detect and/or quantify proteins (i.e. immunohistochemistry (IHC)), nucleic acids (i.e. in situ hybridization (ISH)), carbohydrates (i.e. histochemistry (HC)), and enzymes (i.e. enzyme histochemistry (EHC)).
- Although the presence of immune infiltrates of variable content in human solid tumors from different origins and different patients has long been established, the prognostic value of these components is still not fully understood. There has been a shift from the turn of the 21st century to now wherein immunity and inflammation are considered hallmarks of cancers. That is, considering published data, it is known that local inflammation strongly influences cancer development. In one example, the creation of an acute local inflammation has been used in the adjuvant treatment of superficial bladder cancer by BCG. This approach is now the state of the art for this malignancy. In contrast, chronic inflammation is understood to influence the outcome and progression of many tumors (head and neck, gastric, colorectal, etc.). Similarly, immune deficiencies have been seen as negative prognostic indicators.
- However, in light of the prior art, an image analysis system for the automatic computation of an immune score from a set images of multiplex IHC slides or images of fluorescent stained slides is desirable.
- Methods, kits, and systems for scoring cancer through examination of tissue infiltrating lymphocytes (TILs) are disclosed in which a panel of CD3, CD8, CD20, and FoxP3 was found to be useful as a prognostic marker across a number of cancers, including high risk melanoma, colorectal cancer, and breast cancer.
- Immune cells infiltrating the tumor microenvironment (TILs) may either limit or promote tumor progression. Increasing evidence demonstrate that the number, type and location of TILs in primary tumors may have a prognostic role. These observations have led to the development of potential new scoring systems derived from the immune context in tissue and based on the identification and evaluation of specific lymphocyte populations. The potential prognostic value of CD3, CD8, CD20, and FOXP3 was explored as an ‘Immunoscore’ for melanoma patients which would utilize widely accessible, standardized technology.
- The role of the adaptive immune response in controlling the growth and recurrence of human tumors has been studied extensively. The characterization of tumor-infiltrating immune cells in cancers by gene expression profiling and in situ immunohistochemical staining has been presented. However, collectively, the immunological data (the type, density, and location of immune cells within the tumor samples) were found to be a better predictor of patient survival than the histopathological methods currently used to stage, for example, colorectal cancer. The results were validated in two additional patient populations. These data support the hypothesis that the adaptive immune response influences the behavior of human tumors. In situ analysis of tumor-infiltrating immune cells may therefore be a valuable prognostic tool in the treatment of colorectal cancer and possibly other malignancies.
- The natural history of a tumor includes phases of ‘in situ’ growth, invasion, extravasation and metastasis. During these phases, tumor cells interact with their microenvironment and are influenced by signals coming from stromal, endothelial, inflammatory and immune cells. Indeed, tumors are often infiltrated by various numbers of lymphocytes, macrophages or mast cells. It is generally believed that the latter produce factors that maintain chronic inflammation and promote tumor growth, whereas lymphocytes may control cancer outcome, as evidenced in mouse models. In this study, we analyze data from large cohorts of human tumors, clearly establishing that infiltration of the primary tumor by memory T cells, particularly of the Th1 and cytotoxic types, is the strongest prognostic factor in terms of freedom from disease and overall survival at all stages of clinical disease. We review data suggesting that tertiary lymphoid structures adjacent to tumors and composed of mature dendritic cells (T and B cells organized as germinal centers) may be the site of an antitumor reaction. We propose an immune scoring based on the type, density and location of lymphocyte infiltrates as a novel prognostic factor, in addition to tumor node metastasis staging, to predict disease-free survival and to aid in decisions regarding adjuvant therapies in early stage human cancers.
- The unmet medical need is the ability to determine which melanoma patients with node infiltration progress to metastisis and which would not based on a measure of the patient's immune response. Current standard of practice is either to watch and monitor these patients or treat them with harsh interferon treatment.
- As a multiplex IHC slide has the potential advantages of simultaneously identifying multiple biomarkers in a tissue section as opposed to single biomarker labeling in multiple slides. To support the pathologist with the slide interpretation process of multiplex IHC slides, digital pathology can serve to visually separate and quantitatively score the biomarkers for the immune cells, such as the different type of T-cells and B-cells. The following references disclose methods for assessing and/or scoring tissue, but are not adequate for multiplex slides: Manual tumor microenvironment assessment with CD3, CD8, CD45R0 and FoxP3: Paolo Ascierto, “The Medical Need for an Immune Scoring/Profiling for Melanoma and Other Cancer Patients,” Invited talk, Tucson Symposium, Mar. 12-13, Tucson, Ariz., 2013; Manual/semi-automatic CD3/CD8 counting: Galon J Costes A Sanchez-Cabo F Kirilovsky A Mlecnik B Lagorce-Pages C Tosolini M Camus M Berger A Wind P Zinzindohoue F Bruneval P Cugnenc PH Trajanoski Z Fridman W H Pages F “Type, density, and location of immune cells within human colorectal tumors predict clinical outcome,” Science 29; 313(5795):1960-4, 2006; Flow cytometry counting of CD8 and FoxP3: F. Stephen Hodi, “Recent Advances in Combinatorial Therapies,” Invited talk, Tucson Symposium, Mar. 12-13, Tucson, Ariz., 2013; Immune scoring from H&E: Sherene Loi, Nicolas Sirtaine, Fanny Piette, Roberto Salgado, Giuseppe Viale, Franc, oise Van Eenoo, Ghizlane Rouas, Prudence Francis, John P. A. Crown, Erika Hitre, Evandro de Azambuja, Emmanuel Quinaux, Angelo Di Leo, Stefan Michiels, Martine J. Piccart, and Christos Sotiriou, “Prognostic and Predictive Value of Tumor-Infiltrating Lymphocytes in a Phase III Randomized Adjuvant Breast Cancer Trial in Node-Positive Breast Cancer Comparing=the Addition of Docetaxel to Doxorubicin With Doxorubicin-Based Chemotherapy: BIG 02-98,” Journal of Clinical Oncology 31(7), pp 860-867, 2013. The technical hurdle has been to quantify the immune cell response on one slide and to incorporate the necessary immune markers. In order to fully understand the context of the patient's current immune response to cancer, the tumor marker, B-cell, total T cell, cytotoxic T cell, and regulatory T cell populations should all be viewed together, and the scoring and interpretation must be automated and scalable to realistically function as a clinical concept.
- Although there are methods to multiplex several markers, to our knowledge, there is no assay presented in either the research or commercial space which has incorporated these 5 markers in an assay, addresses this specific medical need, and includes a digital algorithm.
- We developed a research prototype multiplexed assay and corresponding digital scoring algorithm based on clinical, biological, and statistical input. Our assay includes a tumor marker, as well as 4 immune markers.
- Collectively, the immunological data (the type, density, and location of immune cells within the tumor samples) were found to be a better predictor of patient survival than the histopathological methods currently used to stage cancer. In colorectal cancer, the results were validated in two patient populations. This data supports the hypothesis that the adaptive immune response influences the behavior of human tumors. In situ analysis of tumor-infiltrating immune cells may therefore be a valuable prognostic tool in the treatment of colorectal cancer and other malignancies.
- An image analysis algorithm and/or system has been developed that automatically computes an immune score from a set images of multiplex IHC slides and/or fluorescent stained slides. The image analysis algorithm involves a computer-implemented method for counting a number of types of cells in a single tissue specimen that has been stained with a multiplex assay, comprising: imaging the single tissue specimen that has been stained with the multiplex assay that includes lymphocyte markers CD3, CD8, CD20, FoxP3, and tumor detection markers; unmixing the image of single tissue specimen that has been stained with a multiplex assay into separate image channels for each marker of the multiplex assay; identifying regions of interest in each image channel based on intensity information in each channel, wherein regions of low intensity in each channel are removed, and regions of high intensity represent cell signals; generating a single surrogated image, wherein the surrogated image is a combination of the image channel information of all the lymphocyte markers; applying a cell detection algorithm, wherein the cell detection algorithm is a membrane finding algorithm or a nucleus finding algorithm; identifying features of the lymphocytes and combinations of lymphocytes in each image channel or image of combined channels, or a transformed image such as grayscale or absorbance image, or a surrogated image; training a classification algorithm based on features of known lymphocytes and lymphocyte combinations; applying the trained algorithm to features of the lymphocytes and combinations of lymphocytes in each image channel or in each image of combined channels, or in a transformed image such as grayscale or absorbance image, or in a surrogated image, that were identified to classify the detected cells as at least one of false positive cells, CD3 only T-cells, CD3 and CD8 T-cells, FP3 T-cells; and CD20 B-cells; counting a number of each different type of cell classified; generating a score of the tissue specimen, wherein the score is based on the number of each type of cell counted.
- The patent or application file contains at least one drawing executed in color. Copies of this patent or patent application publication with color drawing(s) will be provided by the Office upon request and payment of the necessary fee.
-
FIG. 1(A) -(B) are photomicrographs of a primary melanoma tissue (A) and (B) taken with (A) a 20× objective and (B) a 40× objective which shows a 5-plex stain with FoxP3 being detected in dark brown (exemplarily indicated by an arrow indicated with “DB” inFIG. 1(B) ), CD8 detected in dark gray/black (exemplarily indicated by an arrow indicated with “DGB” inFIG. 1(B) ), CD3 detected in blue (exemplarily indicated by an arrow indicated with “B” inFIG. 1(B) ), CD20 detected in red/magenta (exemplarily indicated by an arrow indicated with “RM” inFIG. 1(B) ) and S100 detected in green (exemplarily indicated by an arrow indicated with “G” inFIG. 1(A) ), wherein (B) focuses on lymphocytic cells that can be seen to the left of the primary tumor. -
FIG. 2(A) -(B) are photomicrographs of a colon carcinoma tissue (A) and (B) taken with (A) a 20× objective and (B) a 40× objective which shows a 5-plex stain with FoxP3 being detected in dark brown (exemplarily indicated by an arrow indicated with “DB” inFIG. 2(B) ), CD8 detected in dark gray/black (exemplarily indicated by an arrow indicated with “DGB” inFIG. 2(B) ), CD3 detected in blue (exemplarily indicated by an arrow indicated with “B” inFIG. 2(B) ), CD20 detected in red/magenta (exemplarily indicated by an arrow indicated with “RM” inFIG. 2(B) ) and cytokeratin (OSCAR) detected in green (exemplarily indicated by an arrow indicated with “G” inFIG. 2(B) ). -
FIG. 3 is a photomicrograph of a tongue carcinoma tissue which shows a 5-plex stain with FoxP3 being detected in dark brown (exemplarily indicated by an arrow indicated with “DB”), CD8 detected in dark gray/black (exemplarily indicated by an arrow indicated with “DGB”), CD3 detected in blue (exemplarily indicated by an arrow indicated with “B”), CD20 detected in red/magenta (exemplarily indicated by an arrow indicated with “RM”) and cytokeratin (OSCAR) detected in green (exemplarily indicated by an arrow indicated with “G”). -
FIG. 4 is a photomicrograph of a lung adenocarcinoma tissue taken at a 20× objective which shows a 5-plex stain with FoxP3 being detected in dark brown (exemplarily indicated by an arrow indicated with “DB”), CD8 detected in dark gray/black (exemplarily indicated by an arrow indicated with “DGB”), CD3 detected in blue (exemplarily indicated by an arrow indicated with “B”), CD20 detected in red/magenta (exemplarily indicated by an arrow indicated with “RM”) and cytokeratin (OSCAR) detected in green (exemplarily indicated by an arrow indicated with “G”). -
FIG. 5 is a photomicrograph (20× objective) of an ovarian adenocarcinoma tissue stained (5-plex) with antibodies for a cytokeratin tumor marker (yellow) (exemplarily indicated by an arrow indicated with “Y”) and for infiltrating CD8+ cytotoxic T cells (green) (exemplarily indicated by an arrow indicated with “G”), further showing how the CD8 cells have infiltrated throughout the tumor. -
FIG. 6 is a photomicrograph of normal tonsil tissue stained with antibodies for proliferation marker Ki-67 (green) (exemplarily indicated by an arrow indicated with “G”), CD8+ T cells (purple) (exemplarily indicated by an arrow indicated with “P”), and CD3+ T cells (yellow) (exemplarily indicated by an arrow indicated with “Y”). This image confirms the localization of Ki-67+ cells in germinal centers with CD8 and CD3 cells, FoxP3 being detected in dark brown, and CD8 detected in the surrounding mantle zone. Magnification ×200. -
FIG. 7 is a photomicrograph (20× objective) of breast cancer tissue showing tumor in purple (exemplarily indicated by an arrow indicated with “P”), infiltrating CD8+ cells in green (exemplarily indicated by an arrow indicated with “G”), and CD68+ macrophages in blue (exemplarily indicated by an arrow indicated with “B”), and CD20 detected in red (exemplarily indicated by an arrow indicated with “R”). -
FIG. 8(A) -(D) is (A) a photomicrograph similar toFIG. 7 , unmixed into its component colors (B) and (D); and reassembled and pseudocolored in (C). -
FIG. 9 is a schematic illustrating a Scoring Algorithm Workflow in accordance with the present disclosure. -
FIG. 10 is a schematic illustrating an example implementation of the Scoring Algorithm in accordance with the present invention. -
FIG. 11(A) -(B) is a schematic illustrating a filter bank (A) and ring detector (B) in accordance with the present invention. - There is an unmet medical need to develop the ability to determine which melanoma patients with node infiltration progress to metastasis and which would not based on a measure of the patient's immune response. Current standard of practice is either to watch and monitor these patients or treat them with harsh interferon treatment.
- The technical hurdle has been quantifying an immune response that could be seen on one slide and that incorporates the necessary immune markers. In order to fully understand the context of the patient's current immune response to cancer, a tumor marker, B-cell, total T cell, cytotoxic T cell, and regulatory T cell populations should be viewed together, and the scoring and interpretation must be automated and scalable to realistically function as a clinical concept.
- Although, there are methods to multiplex several markers, to our knowledge there is no assay presented in either the research or commercial space which incorporates these 5 markers in one assay, addresses this specific medical need, and includes a digital algorithm. Our assay includes a tumor marker, as well as 4 immune markers.
- The multiplex assay, along with the image analysis algorithms, potentially provide a toolkit for the breast cancer and/or melanoma immune score computation. The final report generated by the computer may be used to support the clinical analysis of the patient's personal immune response and help guide further treatment, but further studies are needed to substantiate this hypothesis.
- Immune cells infiltrating the tumor microenvironment (TILs) may either limit or promote tumor progression. Increasing evidence demonstrates that the number, type and location of TILs in primary tumors may have a prognostic role. These observations have led to the development of potential new scoring systems derived from the immune context in tissue and based on the identification and evaluation of specific lymphocyte populations. We explored the potential prognostic value of cells positive for a combination of CD3, CD8, CD20, and FOXP3 as an ‘Immunoscore’ for melanoma patients which would utilize widely accessible, standardized technology.
- We developed a research prototype multiplexed assay and corresponding digital scoring algorithm based on clinical, biological, and statistical input.
- A multiplex IHC slide has the potential advantage of simultaneously identifying multiple biomarkers in a single tissue section as opposed to single biomarker labeling in multiple slides, thereby demonstrating much more information within one small piece of tissue. With this purpose in mind, a multiplex assay has been developed to provide an immune score for patients with breast cancer and melanoma, along with other tumor types. To support pathologists with the slide interpretation process, digital pathology can serve to visually separate and quantitatively score the biomarkers for the immune cells, such as the different types of TILs.
- CD3 is the “universal marker” for T cells in general. Further analysis (staining) must be done to identify the type of T cell, e.g. regulatory or cytotoxic T cell. An analysis of CD3+ T cell numbers is a good indication of immune response.
- CD8 is a specific marker for cytotoxic T lymphocytes. These are the effector cells that actually “kill” tumor cells. They act by direct contact to introduce the digestive enzyme granzyme B into the tumor cell cytoplasm, thereby killing it. Therefore, it is important not only to know their overall numbers but also their localization relative to the tumor itself. Only those cells in direct contact with tumor cells will be effective in cell killing.
- CD20 is a marker for antibody-producting B cells. As such, it is an indication of a more fully developed (mature) immune response. The total numbers and localization of these antibody-producing effector cells may be of importance.
- FoxP3 is a nuclear transcription factor that is the most specific marker for regulatory T cells (so-called Tregs). Tregs function to moderate the immune response. Presumably, the presence of Tregs would indicate an inhibitory immune response to a tumor.
- In epithelial tumors (carcinomas), cytokeratin staining identifies tumor cells as well as the normal epithelium. This information, together with the fact that tumor cells abnormally overexpress the cytokeratins compared to normal epithelial cells, allows one to identify tumor vs. normal tissue. For melanoma tissue of neuroectodermal origin, the S100 biomarker serves a similar purpose.
- In illustrative embodiments, the method includes applying a chromogenic reagent so that the sample is specifically stained. In one embodiment, specifically staining includes the application of a primary stain that selectively stains portions of the sample through adhesion associated with hydrophobicity, intercalation, or other non-recognition associations. For example, hematoxylin and eosin staining (H&E staining) is well known in the art. Reference is made to U.S. Published Patent Application 2008/0227143, which is hereby incorporated by reference for disclosure related to hematoxylin and primary staining. H&E staining is used for the evaluation of cellular morphology and is the primary tool for pathologically diagnosing cancer.
- The method includes applying an immunohistochemical (IHC) binding reagent or an in situ hybridization (ISH) binding reagent so that the IHC binding reagent or the ISH binding reagent contact the sample. ISH can be used to diagnose the presence of a genetic abnormality or condition, or over- or under-expression from the norm. For example, ISH may be used to detect gene amplification, deletion, or translocation of genes related to a particular disease. ISH is also useful in the diagnosis of infectious diseases as it allows detection of microbial and viral sequences within infected cells. IHC includes antibodies specifically binding epitopes of interest. The epitopes, also referred to as antigens or antigenic sequences, are portions of proteins that have been established as a marker of clinical interest. For example, the epitope may be a mutated form of a protein, a protein-protein binding site, or a normal protein that is expressed at a concentration either higher or lower than normal, such as in a control sample. Detection and/or quantification of epitopes in various biological samples have been used for a vast number of clinical purposes.
- Both IHC and ISH involve a specific recognition event between a nucleic acid probe (ISH) or an antibody (IHC) and a target within the sample. This specific interaction labels the target. The label can be directly visualized (direct labeling) or indirectly observed using additional detection chemistries. Chromogenic detection, which involves the deposition of a chromogenic substance in the vicinity of the label, involves further detection steps to amplify the intensity of the signal to facilitate visualization. Visualization of the amplified signal (e.g. the use of reporter molecules) allows an observer to localize targets in the sample.
- Chromogenic detection offers a simple and cost-effective method of detection. Chromogenic substrates have traditionally functioned by precipitating when acted on by the appropriate enzyme. That is, the traditional chromogenic substance is converted from a soluble reagent into an insoluble, colored precipitate upon contacting the enzyme. The resulting colored precipitate requires no special equipment for processing or visualizing. Table 1 is a non-exhaustive list of chromogen systems useful within the scope of the present disclosure:
-
TABLE 1 Chromogenic detection reagents. Abbr. Name Color Enzyme DAB 3,3′-diamino-benzidine + H2O2 brown - peroxidase black AEC 3-amino-9-ethyl-carbazole + red peroxidase H2O2 CN 4-chloro-1-naphthol + H2O2 blue peroxidase BCIP/NBT 5-bromo-4-chloro-3-indolyl- indigo - alkaline phosphate + nitroblue black phosphatase tetrazolium FAST 4-chloro-2-methyl- red alkaline RED benzenediazonium + 3-hydroxy- phosphatase 2-naphthoic acid 2,4- dimethylanilide phosphate FAST Naphthol AS-MX phosphate blue alkaline BLUE disodium salt + fast blue phosphatase BB salt hemi(zinc chloride) salt FUCHSIN Naphthol AS-BI + New red alkaline Fuchsin phosphatase NBT nitroblue tetrazolium + blue - dehydrogenase phenazine methosulfate purple ALK 3-methyl-1-phenyl-1H-pyrazol- yellow - alkaline GOLD† 5-yl dihydrogen phosphate + gold phosphatase fast blue BB - Table 1, while not exhaustive, provides insight into the varieties of presently available chromogenic substances (†WO2012/024185, Kelly et al. “Substrates for Chromogenic detection and methods of use in detection assays and kits”).
- A key advancement to the present invention is the use of tyramide-chromogen conjugates that allow deposition and covalent binding of here-to-fore novel chromogens of novel color schemes. This covalent binding also has the added advantage of being able to dehydrate the specimen slides in a series of increasing concentrations of alcohol solutions followed by xylene and mounting in a hardened plastic for permanent preservation. This results in improved morphology and resolution of staining compared to other chromogen dye staining techniques that employ dyes that are extracted by this conventional histological processing.
- One aspect of the present disclosure is that the chromogen conjugates may be configured to absorb light more selectively than traditionally available chromogens. Detection is realized by absorbance of the light by the signaling conjugate; for example, absorbance of at least about 5% of incident light would facilitate detection of the target. In other darker stains, at least about 20% of incident light would be absorbed. Non-uniform absorbance of light within the visible spectra results in the chromophore moiety appearing colored. The signaling conjugates disclosed herein may appear colored due to their absorbance; the signaling conjugates may appear to provide any color when used in the assay, with certain particular colors including red, orange, yellow, green, indigo, or violet depending on the spectral absorbance associated with the chomophore moiety. According to another aspect, the chromophore moieties may have narrower spectral absorbances than those absorbances of traditionally used chromogens (e.g. DAB, Fast Red, Fast Blue). In illustrative embodiments, the spectral absorbance associated with the first chromophore moiety of the first signaling conjugate has a full-width half-max (FWHM) of between 30 nm and 250 nm, between 30 nm and 150 nm, between 30 nm and 100 nm, or between 20 nm and 60 nm.
- Narrow spectral absorbances enable the signaling conjugate chromophore moiety to be analyzed differently than traditional chromogens. While having enhanced features compared to traditional chromogens, detecting the signaling conjugates remains simple. In illustrative embodiments, detecting comprises using a brightfield microscope or an equivalent digital scanner. The narrow spectral absorbances enable chromogenic multiplexing at a level beyond the capability of traditional chromogens. For example, traditional chromogens are somewhat routinely duplexed (e.g. Fast Red and Fast Blue, Fast Red and Black (silver), Fast Red and DAB). However, triplexed or three-color applications, or greater, are atypical, as it becomes difficult to discern one chromophore from another, especially when they overlap or co-localize. In illustrative embodiments of the presently disclosed technology, the method includes detecting from at least two, and up to six or more, different targets using different signaling conjugates or combinations thereof. In one embodiment, illuminating the biological sample with light comprises illuminating the biological sample with a spectrally narrow light source, the spectrally narrow light source having a spectral emission with a second full-width half-max (FWHM) of between 30 nm and 250 nm, between 30 nm and 150 nm, between 30 nm and 100 nm, or between 20 nm and 60 nm. In another embodiment, illuminating the biological sample with light includes illuminating the biological sample with an LED light source. In another embodiment, illuminating the biological sample with light includes illuminating the biological sample with a filtered light source.
- Reference is made to US20130260379 which is incorporated by reference herein, in its entirety. Reference is also made to U.S. Appl. Ser. No. 61/831,552 which is incorporated by reference herein, in its entirety.
- In one exemplary embodiment, the subject disclosure is a non-transitory computer-readable medium for storing computer-executable instructions that are executed by a processor to perform operations including training an algorithm, computing a score, and unmixing. In another exemplary embodiment, the subject disclosure is a system for digital pathology including a processor and a memory coupled to the processor, the memory to store computer-executable instructions that, when executed by the processor, cause the processor to perform operations, including training an algorithm, computing a score, and unmixing.
- The present invention includes an image analysis system that automatically computes a score, for example, an immune score, for a multiplex assay (e.g., a set of multiplex IHC slides) or fluorescent stained slide or slides. The image analysis system includes software modules and algorithms, that include computer executable instructions that are executed by, for example, a processor, for the purpose of analyzing images of tissue stained with a multiplex assay, and for generating a score based off of the analysis. The image analysis system is able to identify multiple biomarkers in the same biological specimen, for example a single tissue specimen, and is applicable to a multiplex assay for any tissue type.
- For exemplary purposes, the image analysis algorithm of the present invention is described in connection with cancerous tissue slides that are stained by a multiplex assay. As an example of implementation of the image analysis algorithm of the present invention, breast tissue slides are analyzed. In an exemplary embodiment of the present invention, stained tissue slides are imaged and/or scanned, and the corresponding color images are generated, and input into the image analysis system. Alternatively, the images are obtained from a source.
- The present invention is applicable to brightfield and fluorescence images, and a microscopy system (e.g., a brightfield microscopy system) or a scanner is utilized for imaging or scanning the slides and obtaining the brightfield images. To generate multi-spectral images, a multi-spectral imaging system (such as a fluorescent microscope or scanner (e.g., a whole slide scanner) is used to obtain the multi-spectral fluorescent images.
- To analyze the generated or obtained images, the image analysis algorithm and/or system of the present invention includes a color unmixing algorithm, which may be included in an unmixing module, that identifies the individual constituent dyes for the biomarkers and the proportions in which they appear in the color images. The unmixing operations may be performed in accordance with the unmixing method disclosed in U.S. Provisional Application No. 61/830,620, filed Jun. 3, 2013, and entitled IMAGE ADAPTIVE PHYSIOLOGICALLY PLAUSIBLE COLOR SEPARATION, the disclosure of which is incorporated herein by reference in its entirety. Based on the separated image channels for each marker, detection algorithms are developed to automatically identify different combination of T and B lymphocytes with respect to each of the differentiating IHC markers. For example, different T-cell markers might co-localize and create different combination of the stain amounts. Additionally, a tumor marker, for example a cytokeratin marker (e.g., Oscar), may also be included in the assay to identify the tumor, intratumoral and/or peritumoral regions to get the tissue context (for example, to identify the nuclei and the tumor regions). In an exemplary embodiment, image analysis is performed, after unmixing, to identify, quantify and/or generate a score for a biomarker, for example, Oscar, CD3, CD8 and FoxP3 markers. In an exemplary embodiment of the present invention, the score for each marker may be reported, along with the tissue context information, as output.
-
FIG. 9 illustrates the workflow of an image analysis method and system of the present invention.FIG. 9 shows an example implementation of an image analysis method, in accordance with the present invention, that depicts details associated the image analysis method being applied to breast cancer immune score computation. - The image analysis method of the present invention involves a training stage, which may be incorporated into a training stage module. In the training stage identification for different type of lymphocytes as well as the examples of false positive cells may be performed first, for each marker. For example, in
FIG. 9 , the seeds within the cells (e.g., true positive T-cells) and seeds outside the cells (e.g., false positive T-cells) are manually annotated, after the automatic detection. - Next, one or more feature extraction algorithms, in accordance with the present invention, which may be incorporated in a feature extraction module, is applied to an image patch around the seed to obtain a feature set for each type of cells (e.g., CD3 cells, CD8 cells and CD20 cells). The features are extracted from different image channels, for example, the RGB channels of the image, the absorbance space, the unmixed channels and the grayscale image. Here different feature extraction algorithms can be used. For example, as shown in
FIG. 9 , dictionary learning can be applied to build a codebook for the different cell appearances. - In an exemplary embodiment of the present invention, a classification algorithm, which may be included in a classification module, may be trained to classify different types of cells present in an image, for example, an image of tissue stained with a multiplex assay. In exemplary embodiments of the present invention different classification algorithms, for example, SVM, Random Forest and Boosting etc. algorithms may be applied. In an exemplary embodiment of the present invention, an SVM algorithm is utilized in the classification algorithm, as shown in
FIG. 9 to associate a feature with a label for the feature. - In the testing stage and/or implementation stage, where the classification algorithm, in accordance with the present invention, is applied, the whole slide image, or portion thereof, is input into the image analysis method/system of the present invention. For each region of interest in the whole slide image, or portion thereof, the following steps of unmixing, removing tumor-related noise, generating a surrogated image, ring or blob detecting (e.g., to find lymphocytes with membrane markers), feature extracting, classifying, and counting of types of cells or lymphocytes are applied. A surrogated image of lymphocytes (i.e., an image that contains all the T-cells) may be obtained first. By doing so, we can first detect all the T-cells and then use the classification algorithm to identify the cell types. To generate the surrogated image, a log transform is utilized to convert the RGB image into absorbance space, and then the Oscar channel may be utilized to remove the noise (tumor cells) as shown in
FIG. 9 , since we are not detecting the tumor cells. In an exemplary embodiment of the present invention, the Oscar channel information, including the tumor cell information is saved in a memory in order to count the tumor cells. A surrogated image is utilized to do detection, instead of each unmixed channel, because unmixing multiplex assays, for example assays having five or more markers, may not be reliable due to the huge color variation across the image. In exemplary embodiments of the present invention, a combined image of some other sort may be utilized, for example, a transformed image (e.g., an absorbance image or grey scale image) or an image that combines various channels. Then the input image (e.g., the RGB image) may be unmixed into different channels of biomarkers, for example, the Oscar, FoxP3, CD3, CD8, HTX and CD20 channels. - The cell detection algorithm (e.g., corresponding to the ring detector in
FIG. 10 ), may be included in a cell detection module, and is applied to the surrogated image to detect the lymphocytes. In an exemplary embodiment of the present invention, the ring shape of the cell detection algorithm provides for capturing ring shape membrane markers (e.g. all the possible T-cell candidates and may include false positive detections). We use the absorbance image with Oscar correction as the surrogated image in the implementation (FIG. 9 ) to detect the ring shape membrane markers. In the implementation stage, a cell detection algorithm that is very sensitive, is desirable, e.g., an algorithm that captures all possible cells and may include the false positive detections. In an exemplary embodiment of the present invention, a ring detector may be applied to the surrogate image to detect the membrane markers, which are utilized to identify cells.FIG. 10 illustrates a simple example of the ring detector. It should be understood by one skilled in the art that other and different types of cell detection algorithms may be applied to an image (surrogate or otherwise) to detect cells. - A classifier, for example, the classifier learned or generated from the training stage, may be then used to classify all the cell candidate seeds between categories, such as false positive cell, CD3 only T-cell, CD3/CD8 T-cell, FP3 T-cell and B-cell.
- In exemplary embodiments, the information from CD3, CD8, FP3 and CD20 channels, for example information regarding the colors and shapes of cells in the respective channels, may also be used as a feature for classification.
FIG. 9 illustrates an example of implementation of the dictionary learning algorithm. In this example, (1) a learned appearance feature, for example, the shape of the cell, which was obtained from the local patch around the seed, is utilized to distinguish between true positive and false positive lymphocytes and (2) the stain amount feature is utilized to classify, for example, the CD3-only and CD3/CD8 T-cells. - In particular, for each detected true positive T-cell in a surrogate image, the CD3 and CD8 pixels around the neighborhood of the T-cell, from CD3 and CD8 unmixed channels may be obtained, and the ratio of the two stains is computed to classify between (1) CDs positive and CD8 positive cells and (2) CD3 positive only cells. In an exemplary embodiment of the present invention, if (number of CD8 pixels)/(number of CD3 pixels)<threshold, the cell identified in the surrogate image is labeled as CD3 only cell, otherwise it is labeled as CD3/CD8 cell.
- To identify nuclei we evaluate the nuclear marker channel, for example, the FoxP3 channel image, as FoxP3 is the nuclear marker. We apply the blob detection algorithm, which may be included in a blob detection module, in the FoxP3 channel to find the FoxP3 nuclei. In an alternative embodiment of the present invention, a radial symmetry algorithm, which may be included in a radial symmetry module, may be utilized to detect nuclei. However, it should be understood by one of ordinary skill in the art that other blob detection methods may be accomplished utilizing, for example, a circular transform.
- To identify the tumor region, the Oscar channel is utilized. In exemplary embodiments of the present invention, region detection algorithms may be used to identify the tumor regions. In the implementation shown in (
FIG. 11 ), an Otsu thresholding method is applied to Oscar channel to find the tumor region. The Otsu thresholding method identifies the tumor region by a process that finds the best threshold for the foreground and background. The Oscar channel is also utilized to remove the noise associated with the tumor region. The Oscar channel is also utilized to remove the ring shape tumor cytoplasmic markers. As cytoplasmic markers sometimes create ring shape appearance, we need to remove those regions first before applying ring detection. We note that the order of the steps of the image analysis algorithms, methods, and/or systems of the present invention may vary. -
FIG. 11(B) illustrates an exemplary ring detector, in accordance with the present invention, that may be utilized for lymphocyte detection in our implementation. To implement a ring detector, a filter bank, i.e., a set of masks containing 12 directions, as shown inFIG. 11(A) , may be built. The black region denote pixels of −1 which cover the center of the ring and the gray region corresponds to pixels of 1 covering the boundary of the ring, so that when this mask is convolved with the image we obtain the intensity difference between the ring boundary and the center. In this example, the width of the filter is 3 pixels, the length of black region is 5 pixels and the length of the gray region is 10 pixels. The parameters, including, for example, the number of directions, width and length of the filter are adjustable, for example, to correspond to the different cell sizes for which detection is desired. As shown inFIG. 11(B) , for each location (x,y) in the image, the vote V(x,y)=V(x,y)+[sum(I(A))−sum(I(B))] is computed. The vote corresponds to the intensity value difference of total pixel intensities within the black region of the filter and the gray region of the filter. This vote is accumulated at (x,y) along 12 directions at the center of the ring. Note that 12 is just an example number of directions and different number can be used. In exemplary embodiments of the present invention, multi-scale detection (i.e., different sizes of the ring) may be utilized to capture cells at different sizes by tuning the parameters of the filter. - One embodiment relates to a user interface and functionalities associated with an image analysis system and/or method in accordance with the present invention. The user interface provides the following functionalities:
- A load image feature that allows for loading the FOVs or whole slide images via the “Load Data Dir” button. A detect tissue region feature that allows for detection of the lymphocytes and tumor regions and/or display of the detection results by clicking, for example, the file name in the “File List” panel.
- A cell modification feature that allows the user to modify the cell detection results, add and/or delete annotations. In an exemplary embodiment of the present invention, a user may first select the type of cell to modify from the popup list, then click the “Modify Cell” button to start editing, and a left click of the mouse corresponds to, for example, being able to delete a seed and a right click of the mouse corresponds, for example, to being able to add a seed. After edits have been made, activation of the “Enter” key on keyboard indicates that editing is complete.
- A tumor modification feature allows the user to modify the tumor detection results. In an exemplary embodiment of the present invention by clicking the “Add Region” and “Remove Region” icons or regions of a user interface, a user may to start draw a polygon and a double left click of the mouse, for example, allows a user to indicate that the drawing of the polygon is complete.
- A save modification feature allows a user, via activation of a “Save Modification” button to save the modification.
- A create final report feature allows a user to create a final report that includes, for example, the immune score, which is based on a number of one or more cell types. For example, a user may click the “Get Report” button or region of the user interface to generate the final report. It should be understood by one of ordinary skill in the art that buttons, icons, and regions of the screen may be utilized to activate features, and can all be utilized as alternatives to the other.
- An exemplary embodiment of a computer system for use in accordance with the present disclosure may include any number of computer platforms or multiple types of computer platforms, such as workstations, personal computers, servers, hand-held devices, multi-processor systems, microprocessor-based or programmable consumer electronics, network PCs, minicomputers, mainframe computers or any other present or future computer. An exemplary embodiment may also be practiced in distributed computing environments where tasks are performed by local and/or remote processing devices that are connected (by, for example, hardwired connections, wireless connections, or a combination thereof), in a communications network. In a distributed computing environment, program modules may be located in both local and remote computer storage media including memory storage devices. It will, however, be appreciated by one of ordinary skill in the art that the aforementioned computer platforms as described herein are specifically configured to perform the specialized operations of the described invention and are not considered general purpose computers.
- Computers typically include known components, such as a processor, an operating system, system memory, memory storage devices, input-output controllers, input-output devices, and display devices. It will also be understood by those of ordinary skill in the relevant art that there are many possible configurations and components of a computer and may also include cache memory, a data backup unit, and many other devices. Examples of input devices include a keyboard, a cursor control devices (e.g., a mouse), a microphone, a scanner, and so forth. Examples of output devices include a display device (e.g., a monitor or projector), speakers, a printer, a network card, and so forth. Display devices may include display devices that provide visual information, this information typically may be logically and/or physically organized as an array of pixels. An interface controller may also be included that may comprise any of a variety of known or future software programs for providing input and output interfaces. For example, interfaces may include what are generally referred to as “Graphical User Interfaces” (often referred to as GUI's) that provide one or more graphical representations to a user. Interfaces are typically enabled to accept user inputs using means of selection or input known to those of ordinary skill in the related art. The interface may also be a touch screen device. In the same or alternative embodiments, applications on a computer may employ an interface that includes what are referred to as “command line interfaces” (often referred to as CLI's). CLI's typically provide a text based interaction between an application and a user. Typically, command line interfaces present output and receive input as lines of text through display devices. For example, some implementations may include what are referred to as a “shell” such as Unix Shells known to those of ordinary skill in the related art, or Microsoft Windows Powershell that employs object-oriented type programming architectures such as the Microsoft .NET framework.
- Those of ordinary skill in the related art will appreciate that interfaces may include one or more GUI's, CLI's or a combination thereof.
- A processor may include a commercially available processor such as a Celeron, Core, or Pentium processor made by Intel Corporation, a SPARC processor made by Sun Microsystems, an Athlon, Sempron, Phenom, or Opteron processor made by AMD Corporation, or it may be one of other processors that are or will become available. Some embodiments of a processor may include what is referred to as multi-core processor and/or be enabled to employ parallel processing technology in a single or multi-core configuration. For example, a multi-core architecture typically comprises two or more processor “execution cores”. In the present example, each execution core may perform as an independent processor that enables parallel execution of multiple threads. In addition, those of ordinary skill in the related will appreciate that a processor may be configured in what is generally referred to as 32 or 64 bit architectures, or other architectural configurations now known or that may be developed in the future.
- A processor typically executes an operating system, which may be, for example, a Windows type operating system from the Microsoft Corporation; the Mac OS X operating system from Apple Computer Corp.; a Unix or Linux-type operating system available from many vendors or what is referred to as an open source; another or a future operating system; or some combination thereof. An operating system interfaces with firmware and hardware in a well-known manner, and facilitates the processor in coordinating and executing the functions of various computer programs that may be written in a variety of programming languages. An operating system, typically in cooperation with a processor, coordinates and executes functions of the other components of a computer. An operating system also provides scheduling, input-output control, file and data management, memory management, and communication control and related services, all in accordance with known techniques.
- System memory may include any of a variety of known or future memory storage devices that can be used to store the desired information and that can be accessed by a computer. Computer readable storage media may include volatile and non-volatile, removable and non-removable media implemented in any method or technology for storage of information such as computer readable instructions, data structures, program modules, or other data. Examples include any commonly available random access memory (RAM), read-only memory (ROM), electronically erasable programmable read-only memory (EEPROM), digital versatile disks (DVD), magnetic medium, such as a resident hard disk or tape, an optical medium such as a read and write compact disc, or other memory storage device. Memory storage devices may include any of a variety of known or future devices, including a compact disk drive, a tape drive, a removable hard disk drive, USB or flash drive, or a diskette drive. Such types of memory storage devices typically read from, and/or write to, a program storage medium such as, respectively, a compact disk, magnetic tape, removable hard disk, USB or flash drive, or floppy diskette. Any of these program storage media, or others now in use or that may later be developed, may be considered a computer program product.
- As will be appreciated, these program storage media typically store a computer software program and/or data. Computer software programs, also called computer control logic, typically are stored in system memory and/or the program storage device used in conjunction with memory storage device. In some embodiments, a computer program product is described comprising a computer usable medium having control logic (computer software program, including program code) stored therein. The control logic, when executed by a processor, causes the processor to perform functions described herein. In other embodiments, some functions are implemented primarily in hardware using, for example, a hardware state machine. Implementation of the hardware state machine so as to perform the functions described herein will be apparent to those skilled in the relevant arts. Input-output controllers could include any of a variety of known devices for accepting and processing information from a user, whether a human or a machine, whether local or remote. Such devices include, for example, modem cards, wireless cards, network interface cards, sound cards, or other types of controllers for any of a variety of known input devices.
- Output controllers could include controllers for any of a variety of known display devices for presenting information to a user, whether a human or a machine, whether local or remote. In the presently described embodiment, the functional elements of a computer communicate with each other via a system bus. Some embodiments of a computer may communicate with some functional elements using network or other types of remote communications. As will be evident to those skilled in the relevant art, an instrument control and/or a data processing application, if implemented in software, may be loaded into and executed from system memory and/or a memory storage device.
- All or portions of the instrument control and/or data processing applications may also reside in a read-only memory or similar device of the memory storage device, such devices not requiring that the instrument control and/or data processing applications first be loaded through input-output controllers. It will be understood by those skilled in the relevant art that the instrument control and/or data processing applications, or portions of it, may be loaded by a processor, in a known manner into system memory, or cache memory, or both, as advantageous for execution. Also, a computer may include one or more library files, experiment data files, and an internet client stored in system memory. For example, experiment data could include data related to one or more experiments or assays, such as detected signal values, or other values associated with one or more sequencing by synthesis (SBS) experiments or processes.
- Additionally, an internet client may include an application enabled to access a remote service on another computer using a network and may for instance comprise what are generally referred to as “Web Browsers”. In the present example, some commonly employed web browsers include Microsoft Internet Explorer available from Microsoft Corporation, Mozilla Firefox from the Mozilla Corporation, Safari from Apple Computer Corp., Google Chrome from the Google Corporation, or other type of web browser currently known in the art or to be developed in the future. Also, in the same or other embodiments an internet client may include, or could be an element of, specialized software applications enabled to access remote information via a network such as a data processing application for biological applications.
- A network may include one or more of the many various types of networks well known to those of ordinary skill in the art. For example, a network may include a local or wide area network that may employ what is commonly referred to as a TCP/IP protocol suite to communicate. A network may include a network comprising a worldwide system of interconnected computer networks that is commonly referred to as the internet, or could also include various intranet architectures. Those of ordinary skill in the related arts will also appreciate that some users in networked environments may prefer to employ what are generally referred to as “firewalls” (also sometimes referred to as Packet, Filters, or Border Protection Devices) to control information traffic to and from hardware and/or software systems. For example, firewalls may comprise hardware or software elements or some combination thereof and are typically designed to enforce security policies put in place by users, such as for instance network administrators, etc.
- Exemplary automated systems available through Ventana Medical Systems, Inc., Tucson, Ariz. include SYMPHONY® Staining System, catalog #: 900-SYM3, VENTANA® BenchMark Automated Slide Preparation Systems, catalog #s: N750-BMKXT-FS, N750-BMKU-FS, VENTANA, and VENTANA® BenchMark Special Stains automated slide stainer. These systems employ a microprocessor controlled system including a revolving carousel supporting radially positioned slides. A stepper motor rotates the carousel placing each slide under one of a series of reagent dispensers positioned above the slides. Bar codes on the slides and reagent dispensers permits the computer controlled positioning of the dispensers and slides so that different reagent treatments can be performed for each of the various tissue samples by appropriate programming of the computer.
- Illustrative instrumentation systems are designed to sequentially apply reagents to tissue sections mounted on one by three inch glass microscope slides under controlled environmental conditions. The instrument must perform several basic functions such as reagent application, washing (to remove a previously applied reagent), jet draining (a technique to reduce the residual buffer volume on a slide subsequent to washing), application of a light oil used to contain reagents and prevent evaporation, and other instrument functions. Exemplary staining instruments process slides on a rotating carousel. The slides maintain a stationary position and a dispenser carousel rotates the reagents above the fixed slides. The processes described herein can be performed using various physical configurations. The process of clarifying and staining tissue on a slide consists of the sequential repetition of basic instrument functions described above. Essentially a reagent is applied to the tissue then incubated for a specified time at a specific temperature. When the incubation time is completed the reagent is washed off the slide and the next reagent is applied, incubated, and washed off, etc., until all of the reagents have been applied and the staining process is complete.
- For related disclosure, reference is made to Richards et al. U.S. Pat. No. 6,296,809, assigned to Ventana Medical Systems, which describes an apparatus and methods for automatically staining or treating multiple tissue samples mounted on microscope slides so that each sample can receive an individualized staining or treatment protocol even when such protocols require different temperature parameters. More specifically, what is described is an apparatus comprising a computer controlled, bar code driven, staining instrument that automatically applies chemical and biological reagents to tissue or cells mounted or affixed to standard glass microscope slides. A plurality of slides are mounted in a circular array on a carousel which rotates, as directed by the computer, to a dispensing location placing each slide under one of a series of reagent dispensers on a second rotating carousel positioned above the slides. Each slide receives the selected reagents (e.g. DNA probe) and is washed, mixed, and/or heated in an optimum sequence and for the required period of time.
- The following examples are provided to illustrate certain specific features of working embodiments and general protocols. The scope of the present invention is not limited to those features exemplified by the following examples.
- The following protocols were implemented on a VENTANA® BenchMark XT (VMSI Catalog #: N750-BMKXT-FS) with NexES V10.6, the ranges providing illustrative process variations with the bracketed values representing an exemplary value:
- (1) Baking may be performed to adhere tissue to slides, especially for fresh cut slides; temperatures: 60° C.-75° C.; incubation time: 4-32 min; for online baking, set the temperature 2-4 degrees above the melting point of paraffin brand used, [No baking];
- (2) Deparaffinization was performed to remove the wax for reagent penetration; the unique deparaffinization options include standard, extended and extended II; these procedures enable improved flexibility to allow greater success at optimizing difficult tissues; standard is the default and will reproduce the classic deparaffinization protocol using EZ Prep (VMSI Catalog #: 950-102); extended, when selected, will reproduce the deparaffinization from HER2 DDISH (VMSI Catalog #: 780-4422) (adding 5 extra EZ Prep rinsing steps to the standard protocol; extended II, when selected, will use LCS (VMSI Catalog #: 650-010), [Standard Deparaffinization, 75° C., 4 minutes; 3 EZ Prep rinses; 76° C., 4 minutes; Rinse];
- (3) Pretreatment; on-slide post-fixation, option pretreatment, removal of excess protein (heat and enzyme); user-fillable fixative reagent; temperature from 37° C.-60° C.; user-fillable “FIXATIVE 1” through “
FIXATIVE 10” incubation time from 4-32 min in Reaction Buffer; [No pretreatment]; - (4) Cell Conditioning; used CC1 (VMSI Catalog #: 950-124), CC2 (VMSI Catalog #: 950-123) or Reaction Buffer (VMSI Catalog #: 950-300); CC1 with a slightly alkaline pH used for heat+buffer retrieval; CC2 pH of 6.0 used for heat+buffer retrieval, Reaction Buffer used for heat retrieval only; 1 to 5 cycles selectable; incubation times: 4-16 min; temperatures: 60° C.-100° C., [CC1 for 32 minutes-8 minutes at 95° C. followed by 24 minutes at 100° C.];
- (5) Protease Treatment: cell conditioning using heat retrieval loosens crosslinks from fixation; protease “punches holes” in protein; combination may enable better sample penetration; enzyme choice and incubation time may be determined by reagent manufacturer, recommendation, experimentation, enzyme option; user-fillable dispensers to be used with ENZYME 1-10, pre-diluted Protease 1-3 (VMSI Catalog #s: 760-2018, 760-2019, 760-2020); pre-diluted ISH-Protease 1-3 (VMSI Catalog #s: 780-4147, 780-4148, 780-4149); incubation time from 4-32 min, [No protease used];
- (6) Pre Primary Peroxidase Inhibit & Post Primary Peroxidase Inhibit (VMSI Catalog #: 253-4578); allows for inhibition of endogenous peroxidase after the primary has bound to the antigen; some antigens may be sensitive to hydrogen peroxide; this option can improve staining for those antibodies, [No Peroxidase Inhibition used];
- (7) Apply rinsing reagent; Reaction Buffer; Apply LCS, [4 minutes, no heat];
- (8) Clarification Process [described herein];
- (9) Primary Antibody Application; primary antibody temperature and primary antibody dilution option; enables the user to modify the incubation temperature for the primary; adds an additional 900 μL of Reaction Buffer to the slide before primary antibody application; [anti-V600E (Clone VE1), Incubate 37° C. for 16 minutes];
- (10) Detection links a “visual” molecule to the probe; UltraView or OptiView (VMSI Catalog #s: 760-500, 760-700) [OptiView]; and
- (11) Counterstain & Post-counterstain; adds a “backdrop” color to the tissue; user can select from a list of counterstain reagents, including pre-dilute VENTANA reagents as well as user-fillable counterstain dispensers; incubation time is selectable from 4 min to 32 min; [counterstain 4 minutes with Hematoxylin II (VMSI Catalog #: 790-2208), Post-counterstain 4 minutes with Bluing Reagent (VMSI Catalog #: 760-2037)].
- Cancerous breast tissue slides were stained with a cocktail of haptenated primary antibodies followed by sequential staining using anti-hapten secondary antibodies linked to HRP. The deposition of specific chromogens of different colors represented the localization of the primary antibodies. The stained slides were scanned and the corresponding RGB color images were obtained. To analyze the images, we developed a color unmixing algorithm to identify the individual constituent dyes for the biomarkers and the proportions in which they appear in the color images. Based on the separated image channels for each marker, detection algorithms were developed to automatically identify different types of T-cells. The image analysis was done for Oscar, CD3, CD8 and FP3 markers. As the final output, the score for each marker was reported.
- We observed different combinations of the T-cell distributions in the slides and validated our analysis algorithm by identifying the number and location of each type of T-cell.
- The multiplex assay, along with the image analysis algorithms, potentially provide a toolkit for the breast cancer immune score computation. The final report generated by the computer may be used to support the clinical analysis of the patient's personal immune response and help guide further breast cancer treatment, but further studies are needed to validate this approach.
- For each case, manual cell counts and regional annotation were taken. The data for each patient were summarized as a median expression across sampled nodes, and these values were then compared between relapse and no relapse groups. There were statistically significant differences in the peri/intra ratio for both CD3 and CD8, with the ratio being higher in no relapse patients compared to relapse patients for both breast cohort.
- We have collected FFPE lymphadenectomies from 34 melanoma patients, analyzing a total of 150 lymph-nodes. We have characterized the Immunoscore by immunohistochemistry expression of CD3, CD8, CD20 and Foxp3 (all Ventana Medical Systems). 3-4 □m serial tissue sections have been cut for haematoxylin/eosin (H&E) and stained with a multiplex of all markers including tumor marker for melanoma (S100). Tissue sections were stained using novel multiplex staining protocols on a VENTANA Benchmark instrument as well as serial section (slide) staining. Initial evaluation was conducted with a high power microscope field (Olympus BX51), excluding hemorrhagic or necrotic areas. The number of positive cells has been evaluated by counting them in 5 peritumoral and 5 intratumoral non-overlapping fields using ×400 magnification. The expression of each marker as well as combinations of markers have been matched with the most important clinical information that correlates with clinical outcome.
- These trending differences also seemed apparent for both FoxP3 and CD20, although our limited sample size restricted some conclusions. We then hypothesized a high/low risk score which we now plan to validate on a larger melanoma. For each case, manual cell counts and regional annotation were taken. The data for each patient were summarized as a median expression across sampled nodes, and these values were then compared between relapse and no relapse groups. There were statistically significant differences in the peri/intra ratio for both CD3 and CD8, with the ratio being higher in no relapse patients compared to relapse patients for both proteins. These trending differences also seemed apparent for both FoxP3 and CD20, although our limited sample size limited some conclusions. We then hypothesized a high/low risk score which we now plan to validate on a larger cohort.
- A color unmixing algorithm, which may be refer referred to as a color unmixing algorithm, was developed that separates image data into individual contributions from three or more different chromogens. Tissue slides stained with the newly developed multiplex chromogen brightfield assay system were scanned on a standard brightfield whole-slide scanner and the color unmixing algorithm was applied in order to provide individual stain-specific image channels for subsequent analysis. As a model to apply this technology, we designed immune profiling assays for breast cancer tissue that consisted of antibodies targeting CD3+ T cells, CD8+ cytotoxic T cells, FoxP3+ Treg cells, CD20+ B cells, CD68+ macrophages, and cytokeratin+ tumor cells.
- We observed a range of immune responses, both in terms of different cell types and in terms of number of cells. In addition, immune cells were located in different regions of the tissue, such as: stroma only, at the invasive margin of the tumor, and in the tumor center. Various combinations of immune cell distribution were observed, and when correlated with clinical outcome these data may be predictive of patient responses.
- Detection and characterization of tumor-infiltrating lymphocytes (TILs) and macrophages in individual cancer patients serves to demonstrate to what extent the patient's own immune system is activated in response to the tumor. This information may then be used as a prognostic or predictive test, or as a guide to further therapy.
- The multiplex chromogen detection system is a flexible and sensitive technology that can be used to detect multiple targets in brightfield light microscopy. For example, flexibility is demonstrated by the interchangeability of the chromogens and multiplexed assays can be designed using haptenated antibodies to improve sensitivity and avoid non-specific binding or “cross talk”. By using hapten amplification, the signal generated is more robust and allows detection of weakly-expressed antigens.
- The Immune Profiling concept illustrated in this filing serves as an ideal application for multiplex chromogen brightfield IHC, providing medical value by enabling multi-component tumor microenvironment analyses and facilitating testing efficiency by means of single slide staining.
Claims (17)
1. A method of scoring the immune response in cancer using tissue infiltrating lymphocytes comprising:
contacting a sample with CD3, CD8, CD20, and FoxP3 specific binding moieties,
removing excess specific binding moieties from the sample,
detecting the specific binding moieties,
assessing a presence and a distribution for the specific binding moieties within the sample,
scoring cancer using tissue infiltrating lymphocytes by analyzing the presence and the distribution of the specific binding moieties.
2. The method of claim 1 , further comprising contacting the sample with a specific binding moiety for a tumor marker.
3. The method of claim 2 , wherein the specific binding moiety for the tumor marker is selected from antibodies to cytokeratin for epithelial tumors (carcinomas) and antibodies to S100 for melanomas.
4. The method of claim 1 , wherein the specific binding moiety for CD3 is anti-CD3 rabbit or mouse monoclonal antibodies.
5. The method of claim 1 , wherein the specific binding moiety for CD8 is anti-CD8 rabbit or mouse monoclonal antibodies.
6. The method of claim 1 , wherein the specific binding moiety for CD20 is anti-CD20 rabbit or mouse monoclonal antibodies.
7. The method of claim 1 , wherein the specific binding moiety for FoxP3 is anti-FoxP3 rabbit or mouse monoclonal antibodies.
8. The method of claim 1 , wherein contacting comprises contacting the sample with CD3, CD8, CD20, and FoxP3 specific binding moieties which are selected from rabbit or mouse monoclonal antibodies.
9. The method of claim 8 , wherein detecting comprises contacting the sample with an anti-species antibody specific to the rabbit or mouse monoclonal antibodies.
10. The method of claim 9 , wherein the anti-species antibody is haptenated, and wherein detecting the haptenated antibody further comprises contacting the sample with an anti-hapten antibody conjugated to an enzyme.
11. The method of claim 10 , wherein detecting further comprises contacting the sample with a detection compound.
12. The method of claim 11 , wherein the detection compound is selected from a chromogen or a fluorophore.
13. The method of claim 1 , wherein the specific binding moieties are haptenated, and wherein detecting the specific binding moieties further comprises contacting the sample with an anti-hapten antibody conjugated to an enzyme.
14. The method of claim 13 , wherein detecting further comprises contacting the sample with a detection compound.
15. The method of claim 14 , wherein the detection compound is selected from a chromogen or a fluorophore.
16. A kit for scoring cancer comprising:
a CD3 specific binding moiety and a CD3 detection reagent,
a CD8 specific binding moiety and a CD8 detection reagent,
a CD20 specific binding moiety and a CD20 detection reagent,
a FoxP3 specific binding moiety and a FoxP3 detection reagent,
contained in a plurality of vessels, and
instructions for scoring which describe detecting CD3, CD8, CD20, and
FoxP3 within a tissue sample and scoring based on a presence and a distribution of the detection reagents on the tissue.
17. A system for scoring cancer by interrogating a tissue sample disposed upon a glass slide, the system comprising:
reagents comprising a CD3 specific binding moiety, a CD3 detection reagent, a CD8 specific binding moiety, a CD8 detection reagent, a CD20 specific binding moiety, a CD20 detection reagent, a FoxP3 specific binding moiety, and a FoxP3 detection reagent,
an automated staining apparatus, and
an imaging apparatus;
wherein the automated staining apparatus is configured to deliver the reagents onto the slide in a manner such that a presence and distribution of CD3, CD8, CD20, and FoxP3, is specifically determined and the imaging apparatus is configured so that the presence and distribution of the CD3, CD8, CD20, and FoxP3 can be used to generate a score.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US17/304,317 US20210311060A1 (en) | 2014-02-24 | 2021-06-17 | Methods, kits, and systems for scoring the immune response to cancer |
Applications Claiming Priority (4)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US201461943939P | 2014-02-24 | 2014-02-24 | |
PCT/EP2015/053643 WO2015124737A1 (en) | 2014-02-24 | 2015-02-20 | Methods, kits, and systems for scoring the immune response to cancer by simultaneous detection of cd3, cd8, cd20 and foxp3 |
US15/246,409 US11079382B2 (en) | 2014-02-24 | 2016-08-24 | Methods, kits, and systems for scoring the immune response to cancer |
US17/304,317 US20210311060A1 (en) | 2014-02-24 | 2021-06-17 | Methods, kits, and systems for scoring the immune response to cancer |
Related Parent Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US15/246,409 Division US11079382B2 (en) | 2014-02-24 | 2016-08-24 | Methods, kits, and systems for scoring the immune response to cancer |
Publications (1)
Publication Number | Publication Date |
---|---|
US20210311060A1 true US20210311060A1 (en) | 2021-10-07 |
Family
ID=52589380
Family Applications (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US15/246,409 Active 2035-08-21 US11079382B2 (en) | 2014-02-24 | 2016-08-24 | Methods, kits, and systems for scoring the immune response to cancer |
US17/304,317 Pending US20210311060A1 (en) | 2014-02-24 | 2021-06-17 | Methods, kits, and systems for scoring the immune response to cancer |
Family Applications Before (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US15/246,409 Active 2035-08-21 US11079382B2 (en) | 2014-02-24 | 2016-08-24 | Methods, kits, and systems for scoring the immune response to cancer |
Country Status (8)
Country | Link |
---|---|
US (2) | US11079382B2 (en) |
EP (1) | EP3111221B2 (en) |
JP (1) | JP6605506B2 (en) |
AU (1) | AU2015220783B2 (en) |
CA (1) | CA2940115C (en) |
DK (1) | DK3111221T4 (en) |
ES (1) | ES2701092T5 (en) |
WO (1) | WO2015124737A1 (en) |
Families Citing this family (20)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
AU2015299073A1 (en) | 2014-08-04 | 2016-12-15 | Ventana Medical Systems, Inc. | Image analysis system using context features |
WO2017171720A1 (en) * | 2016-03-29 | 2017-10-05 | Flagship Biosciences, Inc. | Digital image analysis of inflammatory cells and mediators of inflammation |
US10346975B2 (en) * | 2016-06-06 | 2019-07-09 | Case Western Reserve University | Computerized analysis of computed tomography (CT) imagery to quantify tumor infiltrating lymphocytes (TILs) in non-small cell lung cancer (NSCLC) |
EP3392799A1 (en) * | 2017-04-21 | 2018-10-24 | Koninklijke Philips N.V. | Medical image detection |
US11010610B2 (en) | 2017-06-13 | 2021-05-18 | Google Llc | Augmented reality microscope for pathology |
WO2019020556A1 (en) * | 2017-07-24 | 2019-01-31 | Ventana Medical Systems, Inc. | Methods and systems for evaluation of immune cell infiltrate in tumor samples |
US10956795B2 (en) * | 2017-09-15 | 2021-03-23 | Case Western Reserve University | Predicting recurrence in early stage non-small cell lung cancer (NSCLC) using spatial arrangement of clusters of tumor infiltrating lymphocytes and cancer nuclei |
CN111656179B (en) | 2017-11-13 | 2023-11-03 | 豪夫迈·罗氏有限公司 | Device for sample analysis using epitope electrophoresis |
JP7000139B2 (en) * | 2017-12-01 | 2022-01-19 | キヤノン株式会社 | Image information processing device and display method |
JP2021515240A (en) * | 2018-04-12 | 2021-06-17 | グーグル エルエルシーGoogle LLC | Augmented reality microscope for pathology with overlay of quantitative biomarker data |
JP2021521137A (en) * | 2018-04-12 | 2021-08-26 | カイト ファーマ インコーポレイテッドKite Pharma, Inc | Chimeric receptor T cell therapy using the characteristics of the tumor microenvironment |
EP3776337B1 (en) | 2018-04-13 | 2024-09-11 | Ventana Medical Systems, Inc. | Systems for cell shape estimation |
JP2022501361A (en) | 2018-09-19 | 2022-01-06 | アルパイン イミューン サイエンシズ インコーポレイテッド | Methods and uses of variant CD80 fusion proteins and related constructs |
WO2020074742A1 (en) | 2018-10-12 | 2020-04-16 | F. Hoffmann-La Roche Ag | Detection methods for epitachophoresis workflow automation |
US20210405057A1 (en) * | 2018-11-09 | 2021-12-30 | Pierian Biosciences, LLC | Methods and compositions for determining the composition of a tumor microenvironment |
WO2020121711A1 (en) * | 2018-12-11 | 2020-06-18 | 株式会社日立ハイテク | Automatic analysis device |
US20220138937A1 (en) * | 2019-02-15 | 2022-05-05 | Konica Minolta, Inc. | Information provision method, information provision device, and storage medium |
WO2020229437A1 (en) | 2019-05-14 | 2020-11-19 | F. Hoffmann-La Roche Ag | Devices and methods for sample analysis |
CN114113616B (en) * | 2021-12-07 | 2022-08-23 | 深圳裕策生物科技有限公司 | Kit and dyeing method thereof |
WO2024090265A1 (en) * | 2022-10-28 | 2024-05-02 | 株式会社biomy | Information processing device, information processing method, and program |
Family Cites Families (12)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US7219016B2 (en) | 2001-04-20 | 2007-05-15 | Yale University | Systems and methods for automated analysis of cells and tissues |
EP1777523A1 (en) | 2005-10-19 | 2007-04-25 | INSERM (Institut National de la Santé et de la Recherche Médicale) | An in vitro method for the prognosis of progression of a cancer and of the outcome in a patient and means for performing said method |
US20090203015A1 (en) * | 2008-02-13 | 2009-08-13 | Celera Corporation | Multiplex assays for hormonal and growth factor receptors, and uses thereof |
SI2619576T1 (en) * | 2010-09-24 | 2021-03-31 | Niels Grabe | Means and methods for the prediction of treatment response of a cancer patient |
EP2649205A4 (en) * | 2010-12-07 | 2014-05-14 | Univ California | Phenotyping tumor-infiltrating leukocytes |
JP2012150253A (en) * | 2011-01-19 | 2012-08-09 | Nikon Corp | Fluorescence microscope and optical filter |
EP2805165B1 (en) | 2012-01-20 | 2018-03-14 | INSERM - Institut National de la Santé et de la Recherche Médicale | Methods for predicting the survival time of a patient suffering from a solid cancer based on density of b cells |
AU2013240090B2 (en) † | 2012-03-27 | 2017-01-05 | Ventana Medical Systems, Inc. | Signaling conjugates and methods of use |
RU2014137129A (en) * | 2012-03-30 | 2016-05-27 | Клариент Дайагностик Сервисез, Инк. | IMMUNO-FLUORESCENT ANALYSIS AND FLUORESCENT ANALYSIS OF NUCLEIC ACIDS IN ONE AND SAME SAMPLE |
CN104541167B (en) | 2012-06-14 | 2018-05-01 | 国家医疗保健研究所 | Method and its application for the immunocyte in quantitative tumor tissues |
EP2682750A1 (en) † | 2012-07-02 | 2014-01-08 | Sotio a.s. | In vitro method for the diagnosis and surveillance of cancer |
WO2014160451A1 (en) | 2013-03-13 | 2014-10-02 | Virtusense Technologies | Range of motion system, and method |
-
2015
- 2015-02-20 DK DK15706450.2T patent/DK3111221T4/en active
- 2015-02-20 WO PCT/EP2015/053643 patent/WO2015124737A1/en active Application Filing
- 2015-02-20 AU AU2015220783A patent/AU2015220783B2/en active Active
- 2015-02-20 EP EP15706450.2A patent/EP3111221B2/en active Active
- 2015-02-20 ES ES15706450T patent/ES2701092T5/en active Active
- 2015-02-20 JP JP2016570181A patent/JP6605506B2/en active Active
- 2015-02-20 CA CA2940115A patent/CA2940115C/en active Active
-
2016
- 2016-08-24 US US15/246,409 patent/US11079382B2/en active Active
-
2021
- 2021-06-17 US US17/304,317 patent/US20210311060A1/en active Pending
Also Published As
Publication number | Publication date |
---|---|
WO2015124737A1 (en) | 2015-08-27 |
US11079382B2 (en) | 2021-08-03 |
JP2017511488A (en) | 2017-04-20 |
DK3111221T3 (en) | 2019-01-07 |
EP3111221A1 (en) | 2017-01-04 |
AU2015220783B2 (en) | 2021-02-04 |
CA2940115A1 (en) | 2015-08-27 |
JP6605506B2 (en) | 2019-11-13 |
EP3111221B2 (en) | 2022-01-19 |
ES2701092T5 (en) | 2022-05-12 |
US20160363593A1 (en) | 2016-12-15 |
ES2701092T3 (en) | 2019-02-20 |
AU2015220783A1 (en) | 2016-07-07 |
CA2940115C (en) | 2023-03-14 |
DK3111221T4 (en) | 2022-04-19 |
EP3111221B1 (en) | 2018-10-10 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US20210311060A1 (en) | Methods, kits, and systems for scoring the immune response to cancer | |
US10846848B2 (en) | System for bright field image simulation | |
US11972859B2 (en) | Computational pathology approach for retrospective analysis of tissue-based companion diagnostic driven clinical trial studies | |
EP3195191B1 (en) | Systems and methods for calculating immune scores | |
JP7092503B2 (en) | Systems and methods for co-expression analysis | |
EP3251087B1 (en) | Dot detection, color classification of dots and counting of color classified dots | |
JP2021506013A (en) | How to Calculate Tumor Spatial Heterogeneity and Intermarker Heterogeneity | |
JP2021506022A (en) | Deep learning systems and methods for solidarity cell and region classification in bioimaging | |
JP2017509871A (en) | Medical image analysis to identify biomarker positive tumor cells | |
JP2021506003A (en) | How to store and retrieve digital pathology analysis results | |
US20240029409A1 (en) | Tissue staining and sequential imaging of biological samples for deep learning image analysis and virtual staining | |
JP7011067B2 (en) | Systems and methods for classifying cells in tissue images based on membrane characteristics | |
US20230368504A1 (en) | Synthetic generation of immunohistochemical special stains | |
Dangott | Whole Slide Imaging and Research Applications | |
Ferrer-Font et al. | Panel Design and Optimization for Full Spectrum Flow Cytometry | |
Kresak | The Technological History of Immunohistochemical Methods and Applications in Clinical Cancer Diagnosis and Research. |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
STPP | Information on status: patent application and granting procedure in general |
Free format text: DOCKETED NEW CASE - READY FOR EXAMINATION |