EP2845139A2 - Systeme und verfahren zur durchführung einer korrelationsanalyse klinischer ergebnisse und der eigenschaften von biologischem gewebe - Google Patents

Systeme und verfahren zur durchführung einer korrelationsanalyse klinischer ergebnisse und der eigenschaften von biologischem gewebe

Info

Publication number
EP2845139A2
EP2845139A2 EP13721622.2A EP13721622A EP2845139A2 EP 2845139 A2 EP2845139 A2 EP 2845139A2 EP 13721622 A EP13721622 A EP 13721622A EP 2845139 A2 EP2845139 A2 EP 2845139A2
Authority
EP
European Patent Office
Prior art keywords
biological
user interface
view
image
biological tissue
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Withdrawn
Application number
EP13721622.2A
Other languages
English (en)
French (fr)
Inventor
Vidya Pundalik KAMATH
Colin Craig MCCULLOCH
Megan ROTHNEY
Alberto Santamaria-Pang
Brion Daryl SARACHAN
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Leica Microsystems CMS GmbH
Original Assignee
General Electric Co
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from US13/460,081 external-priority patent/US9036888B2/en
Priority claimed from US13/460,018 external-priority patent/US20130286043A1/en
Priority claimed from US13/459,999 external-priority patent/US8737709B2/en
Priority claimed from US13/459,958 external-priority patent/US20130286038A1/en
Priority claimed from US13/460,100 external-priority patent/US20150032671A9/en
Application filed by General Electric Co filed Critical General Electric Co
Publication of EP2845139A2 publication Critical patent/EP2845139A2/de
Withdrawn legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G16INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16BBIOINFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR GENETIC OR PROTEIN-RELATED DATA PROCESSING IN COMPUTATIONAL MOLECULAR BIOLOGY
    • G16B20/00ICT specially adapted for functional genomics or proteomics, e.g. genotype-phenotype associations
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00Arrangements for image or video recognition or understanding
    • G06V10/98Detection or correction of errors, e.g. by rescanning the pattern or by human intervention; Evaluation of the quality of the acquired patterns
    • G06V10/993Evaluation of the quality of the acquired pattern
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00Scenes; Scene-specific elements
    • G06V20/60Type of objects
    • G06V20/69Microscopic objects, e.g. biological cells or cellular parts
    • GPHYSICS
    • G16INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16BBIOINFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR GENETIC OR PROTEIN-RELATED DATA PROCESSING IN COMPUTATIONAL MOLECULAR BIOLOGY
    • G16B45/00ICT specially adapted for bioinformatics-related data visualisation, e.g. displaying of maps or networks
    • GPHYSICS
    • G16INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16HHEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H30/00ICT specially adapted for the handling or processing of medical images
    • G16H30/40ICT specially adapted for the handling or processing of medical images for processing medical images, e.g. editing
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B21/00Microscopes
    • G02B21/36Microscopes arranged for photographic purposes or projection purposes or digital imaging or video purposes including associated control and data processing arrangements
    • G02B21/365Control or image processing arrangements for digital or video microscopes
    • G02B21/367Control or image processing arrangements for digital or video microscopes providing an output produced by processing a plurality of individual source images, e.g. image tiling, montage, composite images, depth sectioning, image comparison

Definitions

  • exemplary embodiments may access data corresponding to multiple biological tissue samples corresponding to a patient cohort including the first patient and one or more other patients with breast cancer. Exemplary embodiments may retrieve data for the cohort corresponding to one or more features
  • the computer processor is also programmed to, in response to user input selecting a first biomarker and a first field of view corresponding to a biological tissue at the field of view selection component, render, on the graphical user interface, a first image of the selected first field of view corresponding to the biological tissue, the first image representing expression levels of the selected first biomarker and including representations of one or more biological units in the biological tissue.
  • a file structure browser 306 may be displayed to allow the user to view a file structure in which data files are organized.
  • the file structure browser 306 may allow the user to select one or more topmost level directories that include all of the image and/or text data corresponding to a study.
  • a default data source may be automatically selected if the user fails to make a selection.
  • the user interface may render in an overlaid manner the first image of the selected field-of-view of biological tissue in which expression levels of the first biomarker are automatically represented as one or more intensities of the first color, and a second image of the selected field-of-view corresponding to the biological tissue in which the expression levels of the second biomarker are automatically represented as one or more intensities of the second color.
  • Exemplary embodiments may display expression of one or more DNA sequences and one or more protein biomarkers in an overlaid manner in the same display panel.
  • the expression and non-expression of DNA sequences on a cell-by-cell basis may be determined based on fluorescence in situ hybridization (FISH).
  • FISH is a technique used to detect and localize the presence or absence of specific DNA sequences on chromosomes.
  • FISH is used in a similar manner as used for multiplexing to detect the hybridization of DNA probes at the cellular level.
  • the probes may look like tiny bright dots on a dark background, with each dot representing a probe on one copy of the gene. The brighter a spot, the more likely it is that the dot represents overlapping copies of the gene.
  • the morphological representation 1910 may facilitate identifying one or more biomarkers that are effective for isolating a target morphologically-related population of particles.
  • the user interface may receive, at the field-of-view selection component, user input selecting a field-of-view of biological tissue.
  • the user interface may also receive user input selection one or more biomarkers whose expression levels are to be displayed in the selected field-of-view of the biological tissue.
  • the user interface may receive, at the clinical outcome selection component, user input selecting a clinical outcome, for example, positive diagnosis of a disease or tissue condition, negative diagnosis of a disease or tissue condition, a disease prognosis, a prediction of drug response, stratification into a clinically-relevant group, and the like.
  • a clinical outcome for example, positive diagnosis of a disease or tissue condition, negative diagnosis of a disease or tissue condition, a disease prognosis, a prediction of drug response, stratification into a clinically-relevant group, and the like.
  • the selection of the aspects of the field-of- view may be automatically expanded using a supervised learning method or algorithm encoded on one or more non-transitory computer-readable media and implemented as computer- executable instructions.
  • the supervised leaming method may expand the selection of the aspects of the field-of-view by including one or more additional aspects in the same data cohort having one or more similar features. For example, if the user selects one or more biological units, exemplary embodiments may expand the selection with one or more additional biological units in the cohort having one or more similar features as in the user-selected biological units.
  • the quality review selection component 2504 may include a "Next Marker" tool 2514 to allow a user to replace the first image displayed in the display panel 502 with a different image of the same field-of-view of biological tissue obtained by treating the biological tissue with a different biomarker than the biomarker used to obtain the first image.
  • the user interface may render a second, different image of the selected field-of-view of biological tissue, while continuing to render the representation of the result of the selected morphological analysis such that the second image is overlaid by the representation of the result of the morphological analysis.
  • the second image may replace the first image on the user interface.
  • the second image result may be overlaid on the first image on the user interface.
  • Figure 30 is a flowchart illustrating an exemplary computer-implemented method performed in exemplary embodiments to allow a user to perform quality review of results of an image analysis method.
  • the class may manage one or more file streams used to read files and/or images in the database, memory allocated to store temporary data and/or variables during the data access operations, and the like.
  • Exemplary inputs to the class may include, but are not limited to, a class derived from the PathData interface class, information on specific images to be read, and the like.
  • the "PathlmageData" class may query the data structures generated by the "PathData” class to selectively retrieve the data specified in the input.
  • the attributes may include, but are not limited to, a unique identifier for the cell, a sample identifier identifying a sample, test, slide, and/or spot in which the cell was identified, a tissue identifier identifying a tissue that the cell is part of, and the like.
  • the attributes may also include, but are not limited to, one or more types corresponding to the cell (e.g., a structural type like red blood cell, a morphological type like oversized, a diagnostic type like diseased, and the like), a size of the cell, the boundaries of the cell (e.g., the boundaries of the cell on an image of biological tissue), a location of the cell (e.g., a location of the cell on an image of biological tissue), and the like.
  • the attributes may also include, but are not limited to, one or more expression levels associated with the cell (e.g., expression levels of one or more biomarkers, expression of one or more DNA sequences), and the like.

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Health & Medical Sciences (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Theoretical Computer Science (AREA)
  • General Health & Medical Sciences (AREA)
  • Bioinformatics & Cheminformatics (AREA)
  • Multimedia (AREA)
  • General Physics & Mathematics (AREA)
  • Quality & Reliability (AREA)
  • Medical Informatics (AREA)
  • Molecular Biology (AREA)
  • Bioinformatics & Computational Biology (AREA)
  • Evolutionary Biology (AREA)
  • Biophysics (AREA)
  • Biotechnology (AREA)
  • Spectroscopy & Molecular Physics (AREA)
  • Proteomics, Peptides & Aminoacids (AREA)
  • Genetics & Genomics (AREA)
  • Analytical Chemistry (AREA)
  • Chemical & Material Sciences (AREA)
  • Biomedical Technology (AREA)
  • Public Health (AREA)
  • Radiology & Medical Imaging (AREA)
  • Epidemiology (AREA)
  • Primary Health Care (AREA)
  • Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
  • Data Mining & Analysis (AREA)
  • Investigating Or Analysing Biological Materials (AREA)
  • Medical Treatment And Welfare Office Work (AREA)
  • Apparatus Associated With Microorganisms And Enzymes (AREA)
  • User Interface Of Digital Computer (AREA)
  • Processing Or Creating Images (AREA)
  • Image Processing (AREA)
EP13721622.2A 2012-04-30 2013-04-26 Systeme und verfahren zur durchführung einer korrelationsanalyse klinischer ergebnisse und der eigenschaften von biologischem gewebe Withdrawn EP2845139A2 (de)

Applications Claiming Priority (6)

Application Number Priority Date Filing Date Title
US13/460,081 US9036888B2 (en) 2012-04-30 2012-04-30 Systems and methods for performing quality review scoring of biomarkers and image analysis methods for biological tissue
US13/460,018 US20130286043A1 (en) 2012-04-30 2012-04-30 Systems and methods for analyzing biomarker co-localization in a biological tissue
US13/459,999 US8737709B2 (en) 2012-04-30 2012-04-30 Systems and methods for performing correlation analysis on clinical outcome and characteristics of biological tissue
US13/459,958 US20130286038A1 (en) 2012-04-30 2012-04-30 Systems and methods for selection and display of multiplexed images of biological tissue
US13/460,100 US20150032671A9 (en) 2010-07-23 2012-04-30 Systems and methods for selecting and analyzing particles in a biological tissue
PCT/EP2013/058790 WO2013164281A2 (en) 2012-04-30 2013-04-26 Systems and methods for performing correlation analysis on clinical outcome and characteristics of biological tissue

Publications (1)

Publication Number Publication Date
EP2845139A2 true EP2845139A2 (de) 2015-03-11

Family

ID=48190980

Family Applications (3)

Application Number Title Priority Date Filing Date
EP13721622.2A Withdrawn EP2845139A2 (de) 2012-04-30 2013-04-26 Systeme und verfahren zur durchführung einer korrelationsanalyse klinischer ergebnisse und der eigenschaften von biologischem gewebe
EP13719105.2A Withdrawn EP2845138A1 (de) 2012-04-30 2013-04-26 Systeme und verfahren zur analyse der biomarker co-lokalisierung in einem biologischen gewebe
EP13719104.5A Active EP2845137B1 (de) 2012-04-30 2013-04-26 Systeme und verfahren zur qualitätsprüfungswertung von biomarkern und bildanalyseverfahren für biologisches gewebe

Family Applications After (2)

Application Number Title Priority Date Filing Date
EP13719105.2A Withdrawn EP2845138A1 (de) 2012-04-30 2013-04-26 Systeme und verfahren zur analyse der biomarker co-lokalisierung in einem biologischen gewebe
EP13719104.5A Active EP2845137B1 (de) 2012-04-30 2013-04-26 Systeme und verfahren zur qualitätsprüfungswertung von biomarkern und bildanalyseverfahren für biologisches gewebe

Country Status (4)

Country Link
EP (3) EP2845139A2 (de)
JP (2) JP6187989B2 (de)
AU (1) AU2013255961B2 (de)
WO (5) WO2013164280A1 (de)

Families Citing this family (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP5953195B2 (ja) * 2012-09-21 2016-07-20 株式会社キーエンス 撮影解析装置、その制御方法及び撮影解析装置用のプログラム
EP2929453B1 (de) * 2012-12-06 2020-04-08 Global Life Sciences Solutions USA LLC Auswahl und anzeige von biomarkerexpressionen
US20170183648A1 (en) * 2015-08-12 2017-06-29 Quick Biology, Inc. Method, kit and array for functional validation of results derived from high throughput studies
JP7026625B2 (ja) * 2015-11-04 2022-02-28 メタボロン,インコーポレイテッド サンプルの質の自動評価
EP3697925A4 (de) * 2017-10-18 2021-06-23 Venn Biosciences Corporation Identifizierung und verwendung biologischer parameter für diagnose und therapieüberwachung
AU2021213741A1 (en) * 2020-01-28 2022-09-08 Paige. Ai, Inc. Systems and methods for delivery of digital biomarkers and genomic panels
US11475251B2 (en) 2020-01-31 2022-10-18 The Toronto-Dominion Bank System and method for validating data
JP2021124861A (ja) * 2020-02-04 2021-08-30 ソニーグループ株式会社 解析装置、解析方法、解析プログラム及び診断支援システム
JP2022123488A (ja) 2021-02-12 2022-08-24 株式会社Screenホールディングス 閾値決定方法
US11783083B2 (en) 2021-03-19 2023-10-10 International Business Machines Corporation Computing trade-offs between privacy and accuracy of data analysis
WO2024090265A1 (ja) * 2022-10-28 2024-05-02 株式会社biomy 情報処理装置、情報処理方法及びプログラム

Family Cites Families (22)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5235522A (en) * 1990-10-10 1993-08-10 Cell Analysis Systems, Inc. Method and apparatus for automated analysis of biological specimens
JPH1198372A (ja) * 1997-09-18 1999-04-09 Olympus Optical Co Ltd 色調整方法
US6642716B1 (en) * 2002-05-15 2003-11-04 Koninklijke Philips Electronics, N.V. Diffusion tensor magnetic resonance imaging including fiber rendering using hyperstreamlines
EP1616286A1 (de) * 2003-04-02 2006-01-18 Amersham Biosciences UK Limited Verfahren und computersoftware zur klassifikation von zellen zu subpopulationen
US20060031187A1 (en) * 2004-08-04 2006-02-09 Advizor Solutions, Inc. Systems and methods for enterprise-wide visualization of multi-dimensional data
KR20070068401A (ko) * 2004-09-22 2007-06-29 트리패스 이미징, 인코포레이티드 암의 예후에 대한 마커 후보의 분석 및 최적화를 위한 방법및 컴퓨터 프로그램 제품
WO2006132313A1 (ja) * 2005-06-09 2006-12-14 Hitachi Medical Corporation 疾患判定支援システム
US20070168154A1 (en) * 2005-12-23 2007-07-19 Ericson Richard E User interface for statistical data analysis
US8131476B2 (en) * 2006-08-07 2012-03-06 General Electric Company System and method for co-registering multi-channel images of a tissue micro array
US20090327906A1 (en) * 2008-06-30 2009-12-31 Microsoft Corporation Supporting brand assets in a social networking service
US8861810B2 (en) * 2009-01-06 2014-10-14 Vala Sciences, Inc. Automated image analysis with GUI management and control of a pipeline workflow
US20100177942A1 (en) * 2009-01-14 2010-07-15 Applied Spectral Imaging Ltd. Method and apparatus for analyzing imagery data
US8269827B2 (en) 2009-09-29 2012-09-18 General Electric Company System and methods for mapping fluorescent images into a bright field color space
US8706184B2 (en) * 2009-10-07 2014-04-22 Intuitive Surgical Operations, Inc. Methods and apparatus for displaying enhanced imaging data on a clinical image
US8320655B2 (en) * 2009-10-16 2012-11-27 General Electric Company Process and system for analyzing the expression of biomarkers in cells
US20110091081A1 (en) * 2009-10-16 2011-04-21 General Electric Company Method and system for analyzing the expression of biomarkers in cells in situ in their tissue of origin
US20110202624A1 (en) * 2010-02-11 2011-08-18 Virtual Gestures, LLC. Techniques for sharing content
US8693743B1 (en) * 2010-02-19 2014-04-08 Olive Tree Media, LLC Analysis and display of multiple biomarker co-expression in cells and tissues
JP5864559B2 (ja) * 2010-06-04 2016-02-17 ライカ バイオシステムズ イメージング インコーポレイテッドAperio Technologies, Inc. デジタル化された顕微鏡スライドのスライド品質を判断するシステム及び方法
WO2012016242A2 (en) * 2010-07-30 2012-02-02 Aureon Biosciences, Inc. Systems and methods for segmentation and processing of tissue images and feature extraction from same for treating, diagnosing, or predicting medical conditions
US8766803B2 (en) * 2011-05-13 2014-07-01 Roche Diagnostics Operations, Inc. Dynamic data collection
US9740912B2 (en) * 2011-12-20 2017-08-22 Definiens Ag Evaluation of co-registered images of differently stained tissue slices

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
None *
See also references of WO2013164281A2 *

Also Published As

Publication number Publication date
WO2013164277A3 (en) 2013-12-27
WO2013164281A2 (en) 2013-11-07
WO2013164281A3 (en) 2013-12-27
AU2013255961B2 (en) 2017-12-07
EP2845138A1 (de) 2015-03-11
JP2015527622A (ja) 2015-09-17
WO2013164278A1 (en) 2013-11-07
EP2845137B1 (de) 2021-01-20
AU2013255961A1 (en) 2014-10-23
JP6187989B2 (ja) 2017-08-30
JP6317732B2 (ja) 2018-04-25
WO2013164279A1 (en) 2013-11-07
WO2013164280A1 (en) 2013-11-07
JP2015526771A (ja) 2015-09-10
EP2845137A1 (de) 2015-03-11
WO2013164277A2 (en) 2013-11-07

Similar Documents

Publication Publication Date Title
US9036888B2 (en) Systems and methods for performing quality review scoring of biomarkers and image analysis methods for biological tissue
US20150032671A9 (en) Systems and methods for selecting and analyzing particles in a biological tissue
US8737709B2 (en) Systems and methods for performing correlation analysis on clinical outcome and characteristics of biological tissue
EP2845137B1 (de) Systeme und verfahren zur qualitätsprüfungswertung von biomarkern und bildanalyseverfahren für biologisches gewebe
US20130286038A1 (en) Systems and methods for selection and display of multiplexed images of biological tissue
CN109791693B (zh) 用于提供可视化全切片图像分析的数字病理学系统及相关工作流程
US9891804B2 (en) Selection and display of biomarker expressions
US9836865B2 (en) Systems and methods for split screen display of biological specimen and for capturing records thereof
US20220237796A1 (en) Quality Control of Automated Whole-slide Analyses
US20230360414A1 (en) Systems and methods for processing images to determine image-based computational biomarkers from liquid specimens
US20130286043A1 (en) Systems and methods for analyzing biomarker co-localization in a biological tissue
US20240086460A1 (en) Whole slide image search

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

17P Request for examination filed

Effective date: 20141006

AK Designated contracting states

Kind code of ref document: A2

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

AX Request for extension of the european patent

Extension state: BA ME

DAX Request for extension of the european patent (deleted)
STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: EXAMINATION IS IN PROGRESS

17Q First examination report despatched

Effective date: 20180919

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: EXAMINATION IS IN PROGRESS

RAP1 Party data changed (applicant data changed or rights of an application transferred)

Owner name: GLOBAL LIFE SCIENCES SOLUTIONS USA LLC

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE APPLICATION HAS BEEN WITHDRAWN

RAP1 Party data changed (applicant data changed or rights of an application transferred)

Owner name: LEICA MICROSYSTEMS CMS GMBH

18W Application withdrawn

Effective date: 20210719