EP3828761A1 - Procédé, dispositif et système d'analyse de cellules - Google Patents

Procédé, dispositif et système d'analyse de cellules Download PDF

Info

Publication number
EP3828761A1
EP3828761A1 EP20210018.6A EP20210018A EP3828761A1 EP 3828761 A1 EP3828761 A1 EP 3828761A1 EP 20210018 A EP20210018 A EP 20210018A EP 3828761 A1 EP3828761 A1 EP 3828761A1
Authority
EP
European Patent Office
Prior art keywords
analysis
cell
data
artificial intelligence
training
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
EP20210018.6A
Other languages
German (de)
English (en)
Inventor
Momoko Imakubo
Jianyin Lu
Kentaro Shirai
Eri Katsumata
Yuji Okamoto
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Sysmex Corp
Original Assignee
Sysmex Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Sysmex Corp filed Critical Sysmex Corp
Publication of EP3828761A1 publication Critical patent/EP3828761A1/fr
Pending legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H30/00—ICT specially adapted for the handling or processing of medical images
    • G16H30/20—ICT specially adapted for the handling or processing of medical images for handling medical images, e.g. DICOM, HL7 or PACS
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/60—Type of objects
    • G06V20/69—Microscopic objects, e.g. biological cells or cellular parts
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N15/00—Investigating characteristics of particles; Investigating permeability, pore-volume or surface-area of porous materials
    • G01N15/10—Investigating individual particles
    • G01N15/14—Optical investigation techniques, e.g. flow cytometry
    • G01N15/1429—Signal processing
    • G01N15/1431—Signal processing the electronics being integrated with the analyser, e.g. hand-held devices for on-site investigation
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N15/00—Investigating characteristics of particles; Investigating permeability, pore-volume or surface-area of porous materials
    • G01N15/10—Investigating individual particles
    • G01N15/14—Optical investigation techniques, e.g. flow cytometry
    • G01N15/1429—Signal processing
    • G01N15/1433—Signal processing using image recognition
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N15/00—Investigating characteristics of particles; Investigating permeability, pore-volume or surface-area of porous materials
    • G01N15/10—Investigating individual particles
    • G01N15/14—Optical investigation techniques, e.g. flow cytometry
    • G01N15/1434—Optical arrangements
    • G01N15/1436—Optical arrangements the optical arrangement forming an integrated apparatus with the sample container, e.g. a flow cell
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N21/00—Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
    • G01N21/62—Systems in which the material investigated is excited whereby it emits light or causes a change in wavelength of the incident light
    • G01N21/63—Systems in which the material investigated is excited whereby it emits light or causes a change in wavelength of the incident light optically excited
    • G01N21/64—Fluorescence; Phosphorescence
    • G01N21/6428—Measuring fluorescence of fluorescent products of reactions or of fluorochrome labelled reactive substances, e.g. measuring quenching effects, using measuring "optrodes"
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N21/00—Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
    • G01N21/62—Systems in which the material investigated is excited whereby it emits light or causes a change in wavelength of the incident light
    • G01N21/63—Systems in which the material investigated is excited whereby it emits light or causes a change in wavelength of the incident light optically excited
    • G01N21/64—Fluorescence; Phosphorescence
    • G01N21/6486—Measuring fluorescence of biological material, e.g. DNA, RNA, cells
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00—Pattern recognition
    • G06F18/20—Analysing
    • G06F18/285—Selection of pattern recognition techniques, e.g. of classifiers in a multi-classifier system
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/04—Architecture, e.g. interconnection topology
    • G06N3/045—Combinations of networks
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/08—Learning methods
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/0002—Inspection of images, e.g. flaw detection
    • G06T7/0012—Biomedical image inspection
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/70—Arrangements for image or video recognition or understanding using pattern recognition or machine learning
    • G06V10/87—Arrangements for image or video recognition or understanding using pattern recognition or machine learning using selection of the recognition techniques, e.g. of a classifier in a multiple classifier system
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N15/00—Investigating characteristics of particles; Investigating permeability, pore-volume or surface-area of porous materials
    • G01N2015/0019—Means for transferring or separating particles prior to analysis, e.g. hoppers or particle conveyors
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N15/00—Investigating characteristics of particles; Investigating permeability, pore-volume or surface-area of porous materials
    • G01N15/10—Investigating individual particles
    • G01N2015/1028—Sorting particles
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N15/00—Investigating characteristics of particles; Investigating permeability, pore-volume or surface-area of porous materials
    • G01N15/10—Investigating individual particles
    • G01N15/14—Optical investigation techniques, e.g. flow cytometry
    • G01N2015/1493—Particle size
    • G01N2015/1495—Deformation of particles
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N21/00—Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
    • G01N21/62—Systems in which the material investigated is excited whereby it emits light or causes a change in wavelength of the incident light
    • G01N21/63—Systems in which the material investigated is excited whereby it emits light or causes a change in wavelength of the incident light optically excited
    • G01N21/64—Fluorescence; Phosphorescence
    • G01N21/6428—Measuring fluorescence of fluorescent products of reactions or of fluorochrome labelled reactive substances, e.g. measuring quenching effects, using measuring "optrodes"
    • G01N2021/6439—Measuring fluorescence of fluorescent products of reactions or of fluorochrome labelled reactive substances, e.g. measuring quenching effects, using measuring "optrodes" with indicators, stains, dyes, tags, labels, marks
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10056—Microscopic image
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10064—Fluorescence image
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20081—Training; Learning
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20084—Artificial neural networks [ANN]
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30004—Biomedical image processing
    • G06T2207/30024—Cell structures in vitro; Tissue sections in vitro

Definitions

  • the present invention relates to a cell analysis method, cell analysis device, cell analysis system, and cell analysis program.
  • WIPO Patent Publication No. 2015/065697 discloses a method of applying a filtered microscope image to a trained machine learning model to determine centers and boundaries of cells of a specific type, count the determined cells, and output an image of the cells.
  • the cell analysis method generates data for analysis of cells (82, 87, 585) contained in a sample, selects an artificial intelligence algorithm (60, 63, 563) from a plurality of artificial intelligence algorithms (60, 63, 563), inputs the generated data for analysis (82, 87, 585) to the selected artificial intelligence algorithm (60, 63, 563), and generates, by the selected artificial intelligence algorithm(60, 63, 563), data indicating properties of the cells (84, 88, 582) based on the generated data for analysis (82, 87, 585).
  • One embodiment of the present invention relates to a cell analysis device (400A, 200T) for analyzing cells.
  • the cell analysis device (400A, 200T) is provided with a control unit (40A, 20T) configured to select an artificial intelligence algorithm(60, 63, 560) from a plurality of artificial intelligence algorithms(60, 63, 560); input data for analysis of cells contained in a sample (82, 87, 585) to the selected artificial intelligence algorithm(60, 63, 560); and generate, by the selected artificial intelligence algorithm(60, 63, 560), data indicating properties of the cells (84, 88, 582) based on the data for analysis(82, 87, 585).
  • Cell analysis system (1000) includes a flow cell (110) having a flow path (111) through which a sample containing cells flows, a light source (120, 121, 122, 123) for irradiating light on the sample flowing through the flow path (111), an imaging unit (160) for imaging cells in the sample irradiated with the light; and a control unit (40A), wherein the control unit (40A) is configured to generate data for analysis of cells contained in the sample (82, 87) flowing through the flow path (111) and imaged by the imaging unit (160), select an artificial intelligence algorithm (60, 63) from a plurality of artificial intelligence algorithms (60, 63), input the generated data for analysis (82, 87) to the selected artificial intelligence algorithm (60, 63), and generate, by the selected artificial intelligence algorithm (60, 63), data indicating properties of the cells (80, 85) based on the data for analysis.
  • a flow cell (110) having a flow path (111) through which a sample containing cells flows, a light
  • a cell analysis system includes a flow cell (4113) having a flow path(4113a) through which a sample containing cells flows, a signal acquiring unit (610) that acquires signals from cells in a sample flowing through the flow path, and a control unit(20T), wherein the control unit(20T) is configured to acquire signal strengths for individual cells passing through the flow path (4113a), generate analysis data (585) from the acquired signal strengths, select an artificial intelligence algorithm (560, 563) from a plurality of artificial intelligence algorithms (560, 563), and generate, by the selected artificial intelligence algorithm(560, 563), data indicating properties of the cells (582) based on the data for analysis.
  • the cell analysis system (1000) includes a microscope (700) with a stage for placing a slide smeared with a sample containing cells, an imaging unit (710d) that images the cells in the sample magnified by the microscope, and a control unit(40A), wherein the control unit (40A) is configured to generate data for analysis (82, 87) of cells contained in the sample smeared on the slide and imaged by the imaging unit, select an artificial intelligence algorithm (60, 63) from a plurality of artificial intelligence algorithms (60, 63), input the generated data for analysis to the selected artificial intelligence algorithm, and generate, by the selected artificial intelligence algorithm, data indicating properties of the cells (80, 85) based on the data for analysis.
  • an artificial intelligence algorithm 60, 63
  • the selected artificial intelligence algorithm data indicating properties of the cells (80, 85) based on the data for analysis.
  • analysis of a plurality of analysis items is facilitated in cell analysis.
  • FIG. 1 An summary of an embodiment of the present invention will be described with reference to FIG. 1 .
  • An embodiment of the present invention relates to a cell analysis method for analyzing cells.
  • the cell analysis method characteristically generates analysis data 82, 87, or 585 of the cells contained in the sample, and selects an artificial intelligence algorithm as an input destination of the generated analysis data from among a plurality of artificial intelligence algorithms 405 (a), 405 (b), T205 (a) and T205 (b) depending on the exam item.
  • the selected artificial intelligence algorithm generates data indicating the properties of the cells to be analyzed from the input analysis data.
  • a flow cytometer or a microscope can be used to obtain an image of the cells and waveform data based on the signal intensity from the cells.
  • the kind of data collected from cells is predetermined according to exam items or analysis items such as chromosomal aberration test, peripheral circulating tumor cell test, peripheral blood test, urinalysis. Therefore, in the present invention, an artificial intelligence algorithm suitable for each analysis is selected according to the exam item or the analysis item.
  • the first embodiment relates to a method of analyzing a cell from an image of the cell using an artificial intelligence algorithm.
  • the present embodiment relates to a cell analysis method for analyzing cells using an artificial intelligence algorithm.
  • an analysis target image obtained by capturing an image of an analysis target cell is acquired by causing a sample containing cells to flow in a flowpath and imaging the cells passing through the flowpath.
  • the analysis data to be input to the artificial intelligence algorithm are generated from the acquired analysis target image.
  • the artificial intelligence algorithm When the analysis data are input to the artificial intelligence algorithm, the artificial intelligence algorithm generates data indicating the properties of the cells included in the analysis target image.
  • the analysis target image is preferably an image of individual cells passing through the flowpath.
  • the sample may be a sample prepared from a specimen collected from a subject.
  • the sample may include, for example, blood samples such as peripheral blood, venous blood, arterial blood, urine samples, and body fluid samples other than blood and urine.
  • Body fluids other than blood and urine may include bone marrow, ascites, pleural effusion, spinal fluid and the like.
  • Body fluids other than blood and urine may be simply referred to as "body fluid".
  • the blood is preferably peripheral blood.
  • the blood may be peripheral blood collected by using an anticoagulant such as ethylenediaminetetraacetate sodium salt or potassium salt) and heparin sodium.
  • the sample can be prepared from the specimen according to a known method.
  • an examiner collects nucleated cells by subjecting a blood sample collected from a subject to centrifugation or the like using a cell separation medium such as Ficoll.
  • the nucleated cells may be left by hemolyzing red blood cells and the like using a hemolytic agent instead of recovering the nucleated cells by centrifugation.
  • the target site of the recovered nucleated cells is labeled with at least one selected from the Fluorescence In Situ Hybridization (FISH) method, immunostaining method, intracellular organelle staining method and the like described below, and preferably by performing fluorescent labeling; then the suspension liquid of the labeled cells is used as a sample supplied to, for example, in an imaging flow cytometer to image the analysis target cells.
  • FISH Fluorescence In Situ Hybridization
  • cells that can be analyzed are also referred to as analysis target cells.
  • the analysis target cell may be a cell contained in a sample collected from a subject.
  • the cells may be nucleated cells.
  • the cells can include normal cells and abnormal cells.
  • Normal cell means a cell that should be originally contained in the sample depending on the body portion where the sample is collected.
  • Abnormal cell mean cells other than normal cells.
  • Abnormal cells can include cells with chromosomal abnormalities and/or tumor cells.
  • the tumor cells are preferably peripheral circulating tumor cells. More preferably, the peripheral circulating tumor cells are not intended to be hematopoietic tumor cells in which tumor cells are present in the blood in a normal pathological state, rather tumor cells originating from a cell lineage other than a hematopoietic cell line are intended to be in circulation.
  • tumor cells circulating peripherally are also referred to as circulating tumor cells (CTC).
  • the target site is the nucleus of the cell to be analyzed.
  • chromosomal abnormalities include chromosomal translocations, deletions, inversions, duplications, and the like.
  • cells having such chromosomal abnormalities include myelodysplastic syndrome, acute myeloblastic leukemia, acute myeloblastic leukemia, acute promyelocytic leukemia, acute myelomonocytic leukemia, and acute monocytic leukemia, erythroleukemia, acute megakaryoblastic leukemia, acute myelogenous leukemia, acute lymphocytic leukemia, lymphoblastic leukemia, chronic myelogenous leukemia, chronic leukemia such as leukemia, Hodgkin lymphoma, non-Hodgkin lymphoma, malignant lymphoma and multiple myeloma.
  • Chromosomal abnormalities can be detected by known methods such as the FISH method.
  • test items for detecting chromosomal abnormalities are set according to the type of abnormal cells to be detected.
  • the gene or locus to be analyzed is set as an analysis item depending on what kind of test item is to be performed on the sample.
  • abnormal chromosome position or abnormal number can be detected by hybridizing a probe that specifically binds to the locus or gene present in the nucleus of the cell to be analyzed.
  • the probe is labeled with a labeling substance.
  • the labeling substance is preferably a fluorescent dye. Depending on the probe, when the labeling substance is a fluorescent dye, the labeling substance combines with fluorescent dyes having different fluorescence wavelength regions, and it is possible to detect multiple genes or loci in one cell.
  • the abnormal cell is a cell that appears when suffering from a predetermined disease, and may include, for example, a tumor cell such as a cancer cell or a leukemia cell.
  • the predetermined diseases can be selected from a group consisting of myeloid dysplasia syndrome, acute myeloid leukemia, acute myeloid leukemia, acute premyelocytic leukemia, acute myeloid monocytic leukemia, acute monocytic leukemia, leukemia such as red leukemia, acute meganuclear blast leukemia, acute myeloid leukemia, acute lymphocytic leukemia, lymphoblastic leukemia, chronic myeloid leukemia, or chronic lymphocytic leukemia, Hodgkin lymphoma, non-Hodgkin lymphoma, malignant lymphoma and multiple myeloid leukemia.
  • the predetermined diseases may be gastrointestinal malignant tumors originating from the rectum or anal region, upper pharynx, esophagus, stomach, duodenum, jejunum, ileum, cecum, worm, ascending colon, transverse colon, descending colon, S-shaped colon; liver cancer; cholangiocarcinoma; cholangiocarcinoma; pancreatic cancer; pancreatic cancer; urinary malignancies originating from the bladder, ureter or kidney; female reproductive system malignancies originating from the ovaries, Fallopian tubes, uterus; breast cancer; pre-stage cancer; skin cancer; endocrine malignancies such as the hypothalamus, pituitary gland, thyroid gland, parathyroid gland, adrenal gland, and pancreas; central nervous system malignancies; and solid tumors such as a malignant tumor that develops from bone and soft tissue.
  • gastrointestinal malignant tumors originating from the rectum or anal region, upper pharynx, eso
  • Abnormal cells can be detected using at least one selected from bright-field images, immunostaining images for various antigens, and organelle-stained images that specifically stain organelles.
  • Immunostained images can be obtained by imaging immunostained cells by labeling with a labeling substance using an antibody capable of binding to an antigen present at at least one intracellular or cell target site selected from the nucleus, cytoplasm, and cell surface.
  • a labeling substance it is preferable to use a fluorescent dye as in the FISH method.
  • the labeling substance Depending on the antigen, when the labeling substance is a fluorescent dye, the labeling substance combines with fluorescent dyes having different fluorescence wavelength regions, and it is possible to detect multiple antigens in one cell.
  • Organelle-stained images can be obtained by imaging stained cells using dyes that can selectively bind to proteins, sugar chains, lipids, nucleic acids and the like present in at least one cell or cell membrane target site selected from the nucleus, cytoplasm, and cell membrane.
  • nuclear-specific stains include Hoechst (TM) 33342, Hoechst (TM) 33258, 4', 6-diamidino-2-phenylindole (DAPI), Propidium Iodide (PI), DNA-binding dyes such as ReadyProbes (TM) nuclear staining reagents, and Histone protein binding reagents such as Cell Light (TM) reagent.
  • nucleolus and RNA-specific staining reagent examples include SYTO (TM) RNA Select (TM), which specifically binds to RNA.
  • TM SYTO
  • TM RNA Select
  • cytoskeleton-specific staining reagent examples include fluorescently labeled phalloidin.
  • the CytoPainter series from Abcam plc can be used as dye to stain other organelles, such as lysosomes, endoplasmic reticulum, Golgi apparatus, mitochondria and the like.
  • staining dyes or staining reagents are fluorescent dyes or reagents containing fluorescent dyes, and different fluorescence wavelength regions can be selected depending on the wavelength range of the fluorescence of the organelles and the fluorescent dyes used as another stain applied jointly to one cell.
  • inspection items are set according to what kind of abnormal cells are detected.
  • the inspection items may include analysis items necessary for detecting abnormal cells.
  • the analysis items may be set corresponding to the above-mentioned bright-field image, each antigen, and each organelle. Fluorescent dyes having different wavelength regions of fluorescence correspond to each analysis item except for the bright field, and different analysis items can be detected in one cell.
  • the analysis data to be input to the artificial intelligence algorithm is acquired by a method described later.
  • the data indicating the properties of the cells included in the analysis target image generated by the artificial intelligence algorithm are, for example, data indicating whether the analysis target cells are normal or abnormal. More specifically, the data indicating the properties of the cells included in the analysis target image are data indicating whether the analysis target cell is a cell having a chromosomal abnormality or a peripheral circulating tumor cell.
  • analysis target image may be referred to as “analysis image”
  • data to be analyzed may be referred to as “analysis data”
  • image for training may be referred to as “training image”
  • training data data for training
  • the “fluorescent image” is intended to be a training image obtained by imaging a fluorescent label or an analysis image obtained by imaging a fluorescent label.
  • the training method of the first artificial intelligence algorithm 50 and the second artificial intelligence algorithm 53, and the cell analysis method using the trained first artificial intelligence algorithm 60 and the trained second artificial intelligence algorithm 63 will be described using FIG. 2 to FIG. 12 .
  • the first and second artificial intelligence algorithms 60 and 63 can be deep learning algorithms having a neural network structure.
  • the neural network structure can be selected from a fully connected deep neural network (FC-DNN), a convolutional neural network (CNN), an autoregressive neural network (RNN), and a combination thereof.
  • a convolutional neural network is preferred.
  • the artificial intelligence algorithm for example, the artificial intelligence algorithm provided by Python can be used.
  • This embodiment is related to a training method using a first artificial intelligence algorithm 50 for detecting a chromosomal abnormality, and a cell analysis method using the trained first artificial intelligence algorithm 60 for detecting a chromosomal abnormality.
  • the term “train” or “training” may be used in place of the term “generate” or “generating”.
  • FIG. 2 an example using an image of FISH staining of the PML-RARA chimeric gene formed by translocation of a transcriptional regulator lodged on the long arm of chromosome 15 (15q24.1), and the retinoic acid receptor ⁇ (RARA) gene located on the long arm of chromosome 17 (17q21.2).
  • RARA retinoic acid receptor ⁇
  • labeled positive integrated training data 73P and labeled negative integrated training data 73N are generated from a positive training image 70P obtained by imaging a cell positive for a chromosomal abnormality (hereinafter referred to as "first positive control cell”) and a negative training image 70N obtained by imaging a cell negative for chromosomal abnormality (hereinafter referred to as "first negative control cell”), respectively.
  • the positive training image 70P and the negative training image 70N may be collectively referred to as a training images 70.
  • the labeled positive integrated training data 73P and the labeled negative integrated training data 73N may be collectively referred to as training data 73.
  • the example shows a probe for detecting the PML locus is bound to a first fluorescent dye that fluoresces in the green wavelength region, and a probe for detecting the RARA locus is bound to a second fluorescent dye that fluoresces in the red wavelength region different from that of the first fluorescent dye.
  • the nucleus of the first positive control cell and the nucleus of the first negative control cell can be labeled with the first fluorescent dye and the second fluorescent dye, respectively, by the FISH method using the probe bound with the first fluorescent dye and the probe bound with the second fluorescent dye.
  • the label with the first fluorescent dye at the target site may be referred to as the first fluorescent label
  • the label with the second fluorescent dye at the target site may be referred to as the second fluorescent label.
  • a sample containing cells having the first fluorescent label and the second fluorescent label can be subjected to analysis in a cell imaging device such as an imaging flow cytometer to capture an image of the cells.
  • An image taken of a cell may include multiple images for the same field of view of the same cell. Since the first fluorescent label and the second fluorescent label have different fluorescence wavelength regions of the respective fluorescent dyes, a first filter for transmitting light emitted from the first fluorescent dye and a second filter for transmitting the light emitted from the second fluorescent dye differ. Therefore, the light transmitted through the first filter and the light transmitted through the second filter are taken into the imaging unit 160 described later via a corresponding first channel and a second channel, respectively, to capture as separate images of the same cell in the same field of view. That is, in the imaging unit 160, a plurality of images corresponding to the number of labeling substances labeling the cell are acquired for the same field of view of the same cell.
  • the positive training image 70P includes a first positive training image 70PA in which a green first fluorescent label is imaged via a first channel and a second positive training image 70PB in which a red second fluorescent label is imaged via a second channel for the first positive control cell.
  • the first positive training image 70PA and the second positive training image 70PB are associated with each other as images of the same field of view of the same cell.
  • the first positive training image 70PA and the second positive training image 70PB are then converted to the first positive numerical training data 71PA and the second positive numerical training data 71PB, which numerically indicate the brightness of the captured light at each pixel in the image.
  • a method of generating the first positive numerical training data 71PA will be described using the first positive training image 70PA.
  • Each image captured by the imaging unit 160 is trimmed to, for example, 100 pixels in length ⁇ 100 pixels in width to generate a training image 70. At this time, trimming is performed so that the images acquired from each channel for one cell have the same field of view.
  • the first positive training image 70PA is represented, for example, as a 16-bit grayscale image. Therefore, in each pixel, the brightness of the pixel can be indicated by a numerical value of the brightness of 65,536 gradations from 1 to 65,536. As shown in FIG. 2A , the value indicating the gradation of brightness in each pixel of the first positive training image 70PA is the first positive numerical training data 71PA, which expresses a matrix of numbers corresponding to each pixel.
  • the second positive numerical training data 71PB indicating the brightness of the imaged light at each pixel in the image can be generated from the second positive training image 70PB.
  • the first positive numerical training data 71PA and the second positive numerical training data 71PB are integrated for each pixel to generate positive integrated training data 72P.
  • the positive integrated training data 72P are matrix data in which the numerical value in each pixel of the first positive numerical training data 71PA is shown side by side with the value in each pixel of the second positive numerical training data 71PB.
  • the positive integrated training data 72P are labeled with a label value 74P indicating that the positive integrated training data 72P are derived from the first positive control cell, and the labeled positive integrated training data 73P are generated.
  • the numeral "2" is attached in FIG. 2A as a label indicating that it is the first positive control cell.
  • the labeled negative integrated training data 73N are generated in the same manner as in the case of generating the labeled positive integrated training data 73P.
  • the negative training image 70N includes a first negative training image 70NA obtained by imaging a green first fluorescent label through a first channel and a second negative training image 70NB obtained by imaging a blue second fluorescent label through a second channel with regard to a first negative control cell. Imaging and trimming, and quantification of the brightness of light in each pixel are the same as in the case of acquiring the first positive numerical training data 71PA from the first positive training image 70PA. It is possible to generate the first negative numerical training data 71NA which numerically indicates the brightness of the captured light in each pixel in the image from the first negative training image 70N by the same method as the first positive numerical training data 71PA.
  • the second negative training image 70NB it is possible to generate the second negative numerical training data 71NB that numerically indicates the brightness of the captured light at each pixel in the image.
  • the first negative numerical training data 71NA and the second negative numerical training data 71NB are integrated for each pixel according to the method of generating the positive integrated training data 72P, and the negative integrated training data 72N are generated.
  • the negative integrated training data 72N become matrix data in which the numerical value in each pixel of the first negative numerical training data 71NA is shown side by side with the value in each pixel of the second negative numerical training data 71NB.
  • the negative integrated training data 72N is labeled with a label value 74N indicating that the negative integrated training data 72N is derived from the first negative control cell, and labeled negative integrated training data 73N are generated.
  • a "1" is attached in FIG. 2B as a label indicating that it is the first negative control cell.
  • FIG. 3 shows a method of inputting the labeled positive integrated training data 73P and the labeled negative integrated training data 73N generated in the first artificial intelligence algorithm 50.
  • Data corresponding to the positive integrated training data 72P of the labeled positive integrated training data 73P are input to the input layer 50a of the neural network.
  • a label value 74P corresponding to the data input to the input layer 50a is input to the output layer 50b of the neural network.
  • data corresponding to the negative integrated training data 72N of the labeled negative integrated training data 73N are input to the input layer 50a of the neural network.
  • a label value 74N corresponding to the data input to the input layer 50a is input to the output layer 50b of the neural network.
  • the method of generating the integrated analysis data 72 and the cell analysis method using the trained first artificial intelligence algorithm 63 will be described from the analysis image 80 with reference to FIG. 4 .
  • the analysis image 80 can be imaged in the same manner as the method in which the training image 70 is imaged.
  • the analysis image 80 includes a first analysis image 80A in which a green first fluorescent label is imaged via a first channel and a second analysis image 80B in which a red second fluorescent label is imaged via a second channel for the cells to be analyzed.
  • Imaging and trimming, and quantification of the brightness of light in each pixel are the same as in the case of acquiring the first positive numerical training data 71PA from the first positive training image 70PA.
  • the first numerical analysis data 81A which numerically indicate the brightness of the captured light at each pixel in the image can be generated from the first analysis image 80A.
  • the second analysis image 80B it is possible to generate the second numerical analysis data 81B which numerically indicates the brightness of the captured light in each pixel in the image.
  • the first numerical analysis data 81A and the second numerical analysis data 81B are integrated for each pixel to generate the integrated analysis data 82 according to the method of generating the positive integrated training data 72P.
  • the integrated analysis data 82 become matrix data in which the numerical value in each pixel of the first numerical analysis data 81A is shown side by side with the value in each corresponding pixel of the second numerical analysis data 81B.
  • the generated integrated analysis data 82 are input to the input layer 60a of the neural network in the trained first artificial intelligence algorithm 60.
  • the value included in the input integrated analysis data 82 outputs a label value 84 indicating whether the analysis target cell has a chromosomal abnormality from the output layer 60b of the neural network via the intermediate layer 60c of the neural network.
  • a label value 84 indicating whether the analysis target cell has a chromosomal abnormality from the output layer 60b of the neural network via the intermediate layer 60c of the neural network.
  • FIGS. 6 and 7 show examples of fluorescent labeling of a typical positive pattern (major pattern) of the BCR/ABL fusion gene.
  • negative cases have two first fluorescent labels and two second fluorescent labels, and the number of fusion fluorescent labeled images is zero.
  • the number of the first fluorescent labels is 1, the number of the second fluorescent labels is 2, and the number of fusion fluorescent labels is 1.
  • the negative pattern has two first fluorescent labels and two second fluorescent labels, and the number of fusion fluorescent labels is zero.
  • the number of the first fluorescent labels is 1, the number of the second fluorescent labels is 1, and the number of fusion fluorescent labels is 2.
  • FIG. 7 is an example of a fluorescent labeling of an atypical positive pattern of the BCR/ABL fusion gene.
  • the atypical positive pattern is the minor BCR/ABL pattern, in which the cut point of the BCR gene is relatively upstream of the BCR gene, so that the ES probe also detects three first fluorescent labels.
  • Another example of the atypical positive pattern is the deletion of a portion of the binding region of the probe targeting the ABL gene on chromosome 9, and dependent on this, only one fusion fluorescent label is detected whereas two should be detected when the DF probe is used.
  • a portion of the binding region of the probe targeting the ABL gene on chromosome 9 and a portion of the binding region of the probe targeting the BCR gene on chromosome 22 are both deleted. Dependent on this, only one fusion fluorescent label is detected whereas two should be detected when the DF probe is used.
  • FIG. 8 shows an example of a negative pattern and a reference pattern of a positive pattern when detecting a chromosomal abnormality related to the ALK locus is detected.
  • the ALK gene is not cleaved, so there are two fusion fluorescent labels.
  • the positive pattern since the ALK gene is cleaved, only one fusion fluorescent label is present (when only one of the alleles is cleaved), or the fusion fluorescent label is not recognized (both alleles). If is disconnected).
  • the negative pattern and the positive pattern are the same for the ROS1 gene and the RET gene as well as the ALK gene.
  • FIG. 8 shows an example of a reference pattern of a chromosomal abnormality in which the long arm (5q) of chromosome 5 is deleted.
  • the first fluorescently labeled probe is designed to bind to the long arm of chromosome 5
  • the second fluorescently labeled probe is designed to bind to the centromere of chromosome 5.
  • the negative pattern the number of centromeres on chromosome 5 and the number of long arms on chromosome 5 are the same, so the first fluorescent label and the second fluorescent label reflect the number of homologous chromosomes, that is, two each.
  • deletion of the long arm occurs on one or both of chromosome 5, and the number of the first fluorescent labels is only 1 or 0.
  • This negative and positive pattern is the same for deletions of the short or long arms of other chromosomes.
  • long-arm deletions of other chromosomes include long-arm deletions of chromosomes 7 and 20.
  • Further examples showing similar positive and negative patterns include 7q31 (deletion), p16 (9p21 deletion analysis), IRF-1 (5q31) deletion, D20S108 (20q12) deletion, D13S319 (13q14) deletion, 4q12 deletion, ATM (11q22.3) deletion, p53 (17p13.1) deletion and the like.
  • FIG. 8 also shows an example of chromosome 8 trisomy.
  • the first fluorescently labeled probe binds, for example, to the centromere on chromosome 8.
  • the positive pattern has three first fluorescent labels.
  • the negative pattern has two first fluorescent labels.
  • Such a fluorescent labeling pattern is the same in trisomy 12 of chromosome.
  • the positive pattern is one first fluorescent label.
  • the negative pattern has two first fluorescent labels.
  • the present embodiment relates to a method for training a second artificial intelligence algorithm 53 for detecting peripheral circulating tumor cells and a method for analyzing cells using the second artificial intelligence algorithm 63 for detecting peripheral circulating tumor cells.
  • train or “training” may be used in place of the term “generate” or “generating”.
  • the training method of the second artificial intelligence algorithm 53 for detecting peripheral circulating tumor cells will be described with reference to FIGS. 9 to 11 .
  • FIG. 9 shows a preprocessing method for an image captured by the imaging unit 160.
  • FIG. 9A shows a captured image before pretreatment.
  • the preprocessing is a trimming process for making the training image 75 and the analysis image 85 the same size, and can be performed on all the images used as the training image 75 or the analysis image 85.
  • (a) and (b) are images of the same cell, but the channels at the time of imaging are different.
  • (c) and (a) are images of different cells. Although (c) and (d) are images of the same cell, the channels when imaging are different.
  • the size of the image when the cells are imaged may be different.
  • FIG. 9B (a) is an image extracted from FIGS. 9A (a)
  • FIG. 9B (b) is an image extracted from FIG. 9A (b)
  • FIG. 9B (c) is an image extracted from FIG. 9A (c)
  • FIG. 9B (d) is an image extracted from FIG.
  • Each image in FIG. 9B has a length of 32 pixels and a width of 32 pixels.
  • the center of gravity of the nucleus can be determined, for example, by using the analysis software (IDEAS) attached to an imaging flow cytometer (ImageStream MarkII, Luminex).
  • IDEAS analysis software
  • Imaging flow cytometer ImageStream MarkII, Luminex
  • FIGS. 10 and 11 show a training method for the second artificial intelligence algorithm 53.
  • positive integrated training data 78P and the negative integrated training data 78N are generated from a positive training image 75P obtained by imaging peripheral circulating tumor cells (hereinafter, referred to as "second positive control cell”) and negative training image 75N obtained from cells other than peripheral circulating tumor (hereinafter, "second negative control cell”).
  • the positive training image 75P and the negative training image 75N may be collectively referred to as a training image 75.
  • the positive integrated training data 78P and the negative integrated training data 78N also may be collectively referred to as training data 78.
  • the image captured by the imaging unit 160 may include a bright field image and a fluorescence image.
  • the brightfield image can be an image of the phase difference of the cells. This image can be captured, for example, on a first channel.
  • the fluorescent image is an image of a fluorescent label labeled at a target site in the cell by immunostaining or intracellular organelle staining. Fluorescent labeling is performed with fluorescent dyes that have different fluorescence wavelength regions for each antigen and / or each organelle.
  • the first antigen when the first fluorescent dye that emits fluorescence in the first green wavelength region is bound to the first antigen, the first antigen can be labeled with the first fluorescent dye by binding the first fluorescent dye to an antibody that directly or indirectly binds to the first antigen.
  • the second antigen can be labeled with the second fluorescent dye by binding the second fluorescent dye to an antibody that directly or indirectly binds to the second antigen.
  • the third antigen can be labeled with a third fluorescent dye by binding the third fluorescent dye to an antibody that directly or indirectly binds to the third antigen.
  • fluorescent dyes with different fluorescence wavelength regions can be labeled from the first fluorescence label to the Xth fluorescence label.
  • a sample containing cells having the first fluorescent label to the Xth fluorescent label can be subjected to imaging with a cell imaging device such as an imaging flow cytometer, and an image of the cells can be obtained.
  • An image taken of a cell may include multiple images for the same field of view of the same cell. Since the first fluorescent label to the Xth fluorescent label have different fluorescence wavelength regions of each fluorescent dye, the filter for transmitting the light emitted from each fluorescent dye is different for each fluorescent dye.
  • the bright field image requires the use of a filter different from the filter that transmits light from the fluorescent dye. Therefore, the light transmitted through each filter is taken into the imaging unit 160 (described later) via each corresponding channel, and is captured as another image of the same cell in the same field of view. That is, in the imaging unit 160, for the same visual field of the same cell, a plurality of images corresponding to the number obtained by adding the number of bright-field images to the number of labeling substances labeling the cells are acquired.
  • the first channel (Ch1) indicates a bright-field image in FIGS. 10A and 10B .
  • the second channel (Ch2), the third channel (Ch3), ... the Xth channel (ChX) refer to each channel in which a plurality of different labeling substances are imaged.
  • the positive training image 75P includes the first positive training image 75P1 imaged through the first channel of the second positive control cell, a second positive training image 75P2 in which the first fluorescent label is imaged via the second channel, a third positive training image 75P3 in which the second fluorescent label is imaged via the third channel, and the like on up to an Xth positive training image 75Px in which each fluorescent label is imaged on up to the Xth channel. Images from the first positive training image 75P1 to the Xth positive training image 75Px are associated as images of the same visual field of the same cell.
  • Images from the first positive training image 75P1 to the Xth positive training image 75P are converted to the first positive numerical training data 76P1 to the Xth positive training data 76Px which numerically indicate the brightness of the imaged light in each pixel in the image.
  • a method of generating the first positive numerical training data 76P1 will be described with reference to the first positive training image 75P1.
  • Each image captured by the imaging unit 160 is trimmed, for example, to 32 pixels in length ⁇ 32 pixels in width by the above-mentioned preprocessing to obtain a training image 75.
  • the first positive training image 75P1 is represented, for example, as a 16-bit grayscale image. Therefore, in each pixel, the brightness of the pixel can be indicated by a numerical value of the brightness of 65,536 gradations from 1 to 65,536.
  • the values indicating the gradation of brightness in each pixel of the first positive training image 75P1 are the first positive numerical training data 76P1, which is a matrix of numbers corresponding to each pixel.
  • the Xth positive numerical training data 76Px can be generated from the second positive numerical training data 76P2 which numerically indicate the brightness of the imaged light for each pixel in the image from the second positive training image 75P2 to the Xth positive training image 75Px.
  • the first positive numerical training data 76P1 to the Xth positive numerical training data 76Px are integrated for each pixel to generate positive integrated training data 77P.
  • the positive integrated training data 77P become matrix data in which the numerical values in each pixel of the first positive numerical training data 76PA are shown side by side with the values of each pixel corresponding to the second positive numerical training data 76P2 to the X positive numerical training data 76Px.
  • the positive integrated training data 77P is labeled with a label value 79P indicating that the positive integrated training data 77P is derived from the second positive control cell, then labeled positive integrated training data 78P are generated.
  • the numeral "2" is attached in FIG. 10A as a label indicating that it is the first positive control cell.
  • the labeled negative integrated training data 78N are generated in the same manner as in the case of generating the labeled positive integrated training data 78P.
  • the negative training image 75N includes from the first negative training image 75N1 to the Xth negative training image 75Nx obtained from the first channel via the Xth image for the second negative control cell, similarly to the positive training image 75P.
  • the quantification of the brightness of light in each pixel is identical to the case when the first positive numerical training data 76P1 to Xth positive numerical training data 76Px are acquired from the the first positive training image 75PA to the Xth positive training image 75P.
  • First negative numerical training data 76N1 indicating the brightness of the imaged light numerically can be generated for each pixel in the image from the first negative training image 75N1 by the same method as the first positive numerical training data 76P1.
  • the first negative numerical training data 76N1 to the Xth negative numerical training data 76Nx are integrated for each pixel according to the method of generating the positive integrated training data 77P to generate the negative integrated training data 77N.
  • in the negative integrated training data 77N become matrix data in which the numerical values in each pixel the first negative numerical training data 76N1 are shown side by side with the values of each pixel corresponding to the second negative numerical training data 76N2 to the Xth negative numerical training data 76Nx.
  • the negative integrated training data 77N is labeled with a label value 79N indicating that the negative integrated training data 77N is derived from the second negative control cell, and labeled negative integrated training data 78N are generated.
  • a "1" is attached in FIG. 10B as a label indicating that it is the second negative control cell.
  • FIG. 11 shows a method of inputting the labeled positive integrated training data 78P generated in the second artificial intelligence algorithm 53 and the labeled negative integrated training data 78N.
  • Data equivalent to the positive integrated training data 77P of the labeled positive integrated training data 78P are input to the input layer 53a of the neural network.
  • a label value 79P corresponding to the data input to the input layer 53a is input to the output layer 53b of the neural network.
  • Data corresponding to the negative integrated training data 77N of the labeled negative integrated training data 78N are input to the input layer 53a of the neural network.
  • a label value 79N corresponding to the data input to the input layer 53a is input to the output layer 53b of the neural network.
  • the method of generating the integrated analysis data 72 and the cell analysis method using the trained first artificial intelligence algorithm 63 will be described from the analysis image 85 with reference to FIG. 12 .
  • the analysis image 85 can be captured and reprocessed in the same manner as the training image 75 was captured.
  • the analysis image 85 includes a first analysis image 85T1, that is, a bright-field image of the cells to be analyzed taken through the first channel, and the Xth analysis image 85Tx obtained from the second analysis image 85T2 of the imaged Xth fluorescence label taken through the Xth channel from the second channel.
  • Imaging and preprocessing, and quantification of the brightness of light in each pixel are the same as in the case of acquiring the first positive numerical training data 76P1 from the first positive training image 75P1.
  • the first numerical analysis data 86T1 which numerically indicates the brightness of the captured light at each pixel in the image is generated from the first analysis image 85T1.
  • the Xth numerical analysis data 86Tx can be generated from the second numerical analysis data 86T2 numerically indicating the brightness of the captured light in each pixel in the image.
  • the first numerical analysis data 86T1 to the Xth numerical analysis data 86Tx are integrated for each pixel to generate the integrated analysis data 87 according to the method of generating the positive integrated training data 77P.
  • the integrated analysis data 87 become matrix data in which the numerical value in each pixel of the first numerical analysis data 86T1 are shown side by side with the value in each pixel corresponding to the second numerical analysis data 86T2 to the Xth numerical analysis data 86Tx.
  • the generated integrated analysis data 87 are input to the input layer 63a of the neural network in the trained second artificial intelligence algorithm 63.
  • the value included in the input integrated analysis data 87 outputs a label value 89 indicating whether the analysis target cell is a peripheral circulating tumor cell from the output layer 63b of the neural network via the intermediate layer 63c of the neural network.
  • " 1 " is output as a label value when it is determined that the cell to be analyzed is not a peripheral circulating tumor cell
  • "2" is output as a label value when it is determined to be a peripheral circulating tumor cell.
  • labels such as "none”, “yes”, “normal”, and "abnormal” also may be output.
  • FIG. 13 shows the hardware structure of the cell analysis system 1000 according to the first embodiment.
  • the cell analysis system 1000 may include a training device 200A for training the artificial intelligence algorithm, a cell imaging device 100A, and a cell analysis device 400A.
  • the cell imaging device 100A and the cell analysis device 400A are communicably connected.
  • the training device 200A and the cell analysis device 400A also can be connected by a wired or wireless network.
  • the hardware structure of the training device 200A will be described with reference to FIG. 14 .
  • the training device 200A includes a control unit 20A, an input unit 26, and an output unit 27.
  • the training device 200A can be connected to the network 99.
  • the control unit 20A includes a CPU (Central Processing Unit) 21 that performs data processing described later, a memory 22 used as a work area for data processing, a storage unit 23 that records a program and processing data described later, a bus 24 for transmitting data among each of the units, an interface (I/F) unit 25 for inputting/outputting data to/from an external device, and a GPU (Graphics Processing Unit) 29.
  • the input unit 26 and the output unit 27 are connected to the control unit 20A via the I/F unit 25.
  • the input unit 26 is an input device such as a keyboard or a mouse
  • the output unit 27 is a display device such as a liquid crystal display.
  • the GPU 29 functions as an accelerator for assisting arithmetic processing (for example, parallel arithmetic processing) performed by the CPU 21.
  • the processing performed by the CPU 21 means that the processing performed by the CPU 21 using the GPU 29 as an accelerator is also included.
  • a chip which is preferable for the calculation of the neural network may be provided. Examples of such a chip include FPGA (Field-Programmable Gate Array), ASIC (Application Specific Integrated Circuit), Myriad X (Intel), and the like.
  • the control unit 20A sends a training program for training the artificial intelligence algorithm and an artificial intelligence algorithm in advance and in an executable format to the storage unit 23, for example, in order to perform the processing of each step described with reference to FIG. 16 .
  • the execution form is, for example, a form generated by being converted from a programming language by a compiler.
  • the control unit 20A makes the operating system and the training program recorded in the storage unit 23 cooperate with each other to perform training processing of the artificial intelligence algorithm prior to the training.
  • the processing performed by the control unit 20A means the processing performed by the CPU 21 or the CPU 21 and the GPU 29 based on the program and the artificial intelligence algorithm stored in the storage unit 23 or the memory 22.
  • the CPU 21 temporarily stores necessary data (intermediate data during processing and the like) using the memory 22 as a work area, and appropriately records data to be stored for a long period of time, such as a calculation result, in the storage unit 23.
  • the training images 70PA, 70PB, 70NA, 70NB, 75P1 to 75Px, 75N1 to 75Nx are acquired in advance from the cell imaging device 100A by the cell analysis device 400A, and are stored in advance in the storage unit 23 or the memory 22 of the control unit 20A of the training device 200A.
  • the training device 200A also may acquire the training images 70PA, 70PB, 70NA, 70NB, 75P1 to 75Px and 75N1, to 75Nx from the cell analysis device 400A via the network, or may be acquired via the media drive D98.
  • the training data database (DB) 204 stores the generated training data 73 and 78.
  • the artificial intelligence algorithm prior to training is stored in advance in the algorithm databases 205 (a) and 205 (b).
  • the control unit 20A of the training device 200A performs the training process shown in FIG. 16 .
  • the CPU 21 of the control unit 20A acquires the training images 70PA, 70PB, 70NA, 70NB and the training images 75P1 to 75Px and 75N1 to 75Nx stored in the storage unit 23 or the memory 22.
  • the training images 70PA, 70PB, 70NA, 70NB can be used to train the first artificial intelligence algorithm 50, and the training images 75P1 to 75Px, and 75N1 to 75Nx can be used to train the second artificial intelligence algorithm 53, respectively.
  • step S11 of FIG. 16 the control unit 20A generates positive integrated training data 72P from the positive training images 70PA and 70PB, and generates negative integrated training data 72N from the negative training images 70NA and 70NB.
  • the control unit 20A assigns a label value 74P or a label value 74N corresponding to each of the positive integrated training data 72P and the negative integrated training data 72N, and generates a labeled positive integrated training data 73P or a labeled negative integrated training data 73N.
  • the labeled positive integrated training data 73P or the labeled negative integrated training data 73N are recorded in the storage unit 23 as training data 73.
  • the method for generating the labeled positive integrated training data 73P and the labeled negative integrated training data 73N is described in section 2-1 above.
  • control unit 20A inputs the generated labeled positive integrated training data 73P and the labeled negative integrated training data 73N into the first artificial intelligence algorithm 50 in step S12 of FIG. 16 , and trains the first artificial intelligence algorithm 50.
  • the training result of the first artificial intelligence algorithm 50 is aggregated each time the training is performed using the plurality of labeled positive integrated training data 73P and the labeled negative integrated training data 73N.
  • step S13 of FIG. 16 the control unit 20A determines whether the training results for a predetermined number of trials have been accumulated.
  • the control unit 20A proceeds to the process of step S14, and when the training results are not accumulated for a predetermined number of trials ("NO"), the control unit 20A proceeds to the process of step S15.
  • step S14 the control unit 20A updates the weighting (w) (coupling weight) of the first artificial intelligence algorithm 50 using the training results accumulated in step S12.
  • step S15 the control unit 20A determines whether the first artificial intelligence algorithm 50 has been trained with a predetermined number of labeled positive integrated training data 73P and labeled negative integrated training data 73N.
  • the training process is terminated.
  • the control unit 20A stores the trained first artificial intelligence algorithm 60 in the storage unit 23.
  • control unit 20A advances from step S15 to step S16 and the processes from step S11 to step S15 are performed on the next positive training images 70PA and 70PB and the negative training images 70NA and 70NB.
  • step S11 of FIG. 16 the control unit 20A generates positive integrated training data 77P from positive training images 75P1 to 75Px, and generates negative integrated training data 77N from negative training images 75N1 to 75Nx.
  • the control unit 20A assigns a label value 79P or a label value 79N corresponding to each of the positive integrated training data 77P and the negative integrated training data 77N, and generates labeled positive integrated training data 78P or labeled negative integrated training data 78N.
  • the labeled positive integrated training data 78P or the labeled negative integrated training data 78N are recorded in the storage unit 23 as training data 78.
  • the method for generating the labeled positive integrated training data 78P and the labeled negative integrated training data 78N is as described in 2-2 above.
  • control unit 20A inputs the generated labeled positive integrated training data 73P and the labeled negative integrated training data 73N into the second artificial intelligence algorithm 53 in step S12 of FIG. 16 , and trains the second artificial intelligence algorithm 53.
  • the training result of the second artificial intelligence algorithm 53 is accumulated every time the training is performed using the plurality of labeled positive integrated training data 78P and the labeled negative integrated training data 78N.
  • step S13 of FIG. 16 the control unit 20A determines whether the training results for a predetermined number of trials have been accumulated.
  • the control unit 20A proceeds to the process of step S14, and when the training results are not accumulated for a predetermined number of trials ("NO"), the control unit 20A proceeds to the process of step S15.
  • step S14 the control unit 20A uses the training results accumulated in step S12 to update the weight w (coupling weight) of the second artificial intelligence algorithm 53.
  • step S15 the control unit 20A determines whether the second artificial intelligence algorithm 53 has been trained with a predetermined number of labeled positive integrated training data 78P and labeled negative integrated training data 78N.
  • the training process is completed.
  • the control unit 20A stores the trained second artificial intelligence algorithm 63 in the storage unit 23.
  • control unit 20A advances from step S15 to step S16, and the processes from step S11 to step S15 are performed on the next positive training images 75P1 to 75Px and the negative training images 75N1 to 75Nx.
  • the present embodiment includes a computer program for training an artificial intelligence algorithm that causes a computer to execute the processes of steps S11 to S16.
  • An implementation of the present embodiment relates to a program product such as a storage medium that stores the computer program. That is, the computer program can be stored on a hard disk, a semiconductor memory element such as a flash memory, or a storage medium such as an optical disk.
  • the recording format of the program on the storage medium is not limited insofar as the training device 200A can read the program. Recording on the storage medium is preferably nonvolatile.
  • program is a concept including not only a program that can be directly executed by the CPU, but also a source format program, a compressed program, an encrypted program, and the like.
  • FIG. 17 shows the structure of the cell imaging device 100A that captures the training images 70, 75 and/or the analysis images 80 and 85.
  • the cell imaging device 100A shown in FIG. 17 is exemplified by an imaging flow cytometer.
  • the operation of the cell imaging device 100A as an imaging device is controlled by the cell analysis device 400A.
  • chromosomal abnormalities or peripheral circulating tumor cells use one or more fluorescent dyes to detect the target site.
  • the FISH method uses two or more fluorescent dyes to detect a target site on the first chromosome and a target site on the second chromosome (the "first" and "second” that modify the "chromosome” is a comprehensive concept of numbers that do not mean chromosome numbers).
  • a probe that hybridizes with the PML locus is labeled by a first fluorescent dye in which a nucleic acid having a sequence complementary to the base sequence of the PML locus is irradiated with light of wavelength ⁇ 11 to generate first fluorescence of wavelength ⁇ 21.
  • the PML locus is labeled with the first fluorescent dye.
  • a nucleic acid having a sequence complementary to the base sequence of the RARA locus is labeled with a second fluorescent dye that produces a second fluorescence of a wavelength ⁇ 22 when irradiated with light of a wavelength ⁇ 12.
  • the RARA locus is labeled with a second fluorescent dye.
  • the nucleus is stained with a dye for nuclear staining that produces a third fluorescence of wavelength ⁇ 23 when irradiated with light of wavelength ⁇ 13.
  • the wavelength ⁇ 11, the wavelength ⁇ 12, and the wavelength ⁇ 13 are so-called excitation lights.
  • the wavelength ⁇ 114 is light emitted from a halogen lamp or the like for bright field observation.
  • the cell imaging device 100A includes a flow cell 110, a light source 120 to 123, a condenser lens 130 to 133, a dichroic mirror 140 to 141, a condenser lens 150, an optical unit 151, a condenser lens 152, and an imaging unit 160.
  • the sample 10 is flowed through the flow path 111 of the flow cell 110.
  • the light sources 120 to 123 irradiate light on the sample 10 flowing from the bottom to the top of the flow cell 110.
  • the light sources 120 to 123 are configured of, for example, a semiconductor laser light source. Lights having wavelengths ⁇ 11 to ⁇ 14 are emitted from the light sources 120 to 123, respectively.
  • the condenser lenses 130 to 133 collect light having wavelengths ⁇ 11 to ⁇ 14 emitted from light sources 120 to 123, respectively.
  • the dichroic mirror 140 transmits light having a wavelength of ⁇ 11 and refracts light having a wavelength of ⁇ 12.
  • the dichroic mirror 141 transmits light having wavelengths ⁇ 11 and ⁇ 12 and refracts light having wavelength ⁇ 13. In this way, light having wavelengths ⁇ 11 to ⁇ 14 is applied to the sample 10 flowing through the flow path 111 of the flow cell 110.
  • the number of semiconductor laser light sources included in the cell imaging device 100A is not limited insofar as it is 1 or more.
  • the number of semiconductor laser light sources can be selected from, for example, 1, 2, 3, 4, 5 or 6.
  • fluorescence is generated from the fluorescent dye labeled on the cells flowing through the flow path 111.
  • a first fluorescence of the wavelength ⁇ 21 is generated from the first fluorescent dye.
  • the second fluorescent dye produces a second fluorescence of wavelength ⁇ 22.
  • the dye for nuclear dyeing When light of wavelength ⁇ 13 is irradiated on the dye for nuclear dyeing that stains the nucleus, the dye for nuclear dyeing produces a third fluorescence of wavelength ⁇ 23.
  • the sample 10 flowing through the flow cell 110 is irradiated with light having a wavelength of ⁇ 14, this light passes through the cells.
  • the transmitted light of wavelength ⁇ 14 transmitted through the cells is used to generate a brightfield image.
  • the first fluorescence is the wavelength region of green light
  • the second fluorescence is the wavelength region of red light
  • the third fluorescence is the wavelength region of blue light.
  • the condenser lens 150 collects the first fluorescence to the third fluorescence generated from the sample 10 flowing through the flow path 111 of the flow cell 110 and the transmitted light transmitted through the sample 10 flowing through the flow path 111 of the flow cell 110.
  • the optical unit 151 has a configuration in which four dichroic mirrors are combined. The four dichroic mirrors of the optical unit 151 reflect the first fluorescence to the third fluorescence and the transmitted light at slightly different angles, and separate them on the light receiving surface of the imaging unit 160.
  • the condenser lens 152 collects the first fluorescence to the third fluorescence and the transmitted light.
  • the cell imaging device 100A also may be provided with a pretreatment device 300 as necessary.
  • the pretreatment device 300 samples a portion of the sample and performs FISH, immunostaining, intracellular organelle staining, or the like on the cells contained in the sample to prepare the sample 10.
  • the structure of the control unit 40A is the same as the structure of the control unit 20A of the training device 200A.
  • the CPU 21, the memory 22, the storage unit 23, the bus 24, the I/F unit 25, and the GPU 29 in the control unit 20A of the training device 200A are replaced with the CPU 41, the memory 42, the storage unit 43, the bus 44, and the I/F unit 45, and GPU49, respectively.
  • the storage unit 43 stores the trained artificial intelligence algorithms 60 and 63 generated by the training device 200A and acquired by the CPU 41 from the I/F unit 45 via the network 99 or the media drive 98.
  • the analysis images 80 and 85 can be acquired by the cell imaging device 100A and stored in the storage unit 43 or the memory 42 of the control unit 40A of the cell analysis device 400A.
  • the trained first artificial intelligence algorithm 60 is recorded in the algorithm database 405 (a) in association with the exam items and analysis items for inspecting chromosomal abnormalities.
  • the trained second artificial intelligence algorithm 63 is recorded in the algorithm database 405 (b) in association with the exam items and analysis items for testing peripheral circulating tumor cells.
  • the control unit 40A of the cell analysis device 400A performs the cell analysis process shown in FIG. 19 .
  • This embodiment facilitates high-precision and high-speed analysis.
  • the CPU 41 of the control unit 40A starts the cell analysis process according to a request from the user to start the process or when the cell imaging device 100A starts the analysis.
  • the control unit 40A receives an exam item by the input unit 46 in step S20 shown in FIG. 19 .
  • the exam item is accepted by reading the information about the exam item from the barcode attached to each sample by the barcode reader which is an example of the input unit 46.
  • the method of generating the integrated analysis data 82 is as described in section 2-1 above.
  • the method of generating the integrated analysis data 87 is as described in section 2-2 above.
  • the control unit 40A stores the generated integrated analysis data 82 or integrated analysis data 87 in the storage unit 43 or the memory 42.
  • step S22 the control unit 40A selects the first artificial intelligence algorithm 60 or the second artificial intelligence algorithm 63 according to the exam item received in step S20.
  • the received exam item and the artificial intelligence algorithm are linked by the exam item/algorithm table shown in FIG. 20 .
  • the exam item/algorithm table is stored in the storage unit 43.
  • the exam item/algorithm table shown in FIG. 20 exemplifies "chromosomal abnormalities" and "peripheral circulating tumor cells" as "exam items".
  • the exam item "chromosomal abnormality” corresponds to "BCR-ABL”, “PML-RARA”, “IGH-CCND1, IGH-FGFR3, IGH-MAF” as analysis items
  • the exam item “peripheral circulating tumor cells” corresponds to "CTC” as an analysis item.
  • each exam item has labels of "green”, “yellow”, “blue”, and “red” indicating the wavelength region of fluorescence labeled on the target site, and "bright” indicating brightfield imaging is labeled "Field of View”.
  • the trained first artificial intelligence algorithm 60 is associated with the analysis items "BCR-ABL”, “PML-RARA”, and "IGH-CCND1, IGH-FGFR3, IGH-MAF”.
  • a trained second artificial intelligence algorithm 63 is associated with the analysis item "CTC".
  • step S23 the control unit 40A uses the selected first artificial intelligence algorithm 60 or the second artificial intelligence algorithm 63 to determine the properties of the analysis target cells in the analysis images 80A and 80B, and stores the label value 84 of the determination result in the storage unit 43 or the memory 42.
  • the determination method is as described in sections 2-1 and 2-2 above.
  • the present embodiment includes a computer program for performing cell analysis that causes a computer to perform the processes of steps S20 to S26 and steps S221 to S222.
  • An implementation of the present embodiment relates to a program product such as a storage medium that stores the computer program. That is, the computer program can be stored on a hard disk, a semiconductor memory element such as a flash memory, or a storage medium such as an optical disk.
  • the recording format of the program on the storage medium is not limited insofar as the training device 200A can read the program. Recording on the storage medium is preferably nonvolatile.
  • program is a concept including not only a program that can be directly executed by the CPU, but also a source format program, a compressed program, an encrypted program, and the like.
  • control unit 40A is described in terms of an example of selecting an artificial intelligence algorithm based on the exam items received in S20. However, instead of the exam item, it may be based on the analysis mode shown in FIGS. 36 and 37 .
  • the method of generating the integrated analysis data 82 is as described in section 2-1 above.
  • the method of generating the integrated analysis data 87 is as described in section 2-2 above.
  • the control unit 40A stores the generated integrated analysis data 82 or integrated analysis data 87 in the storage unit 43 or the memory 42.
  • step S202 the control unit 40A selects the first artificial intelligence algorithm 60 when the received analysis mode is the "chromosomal aberration determination mode", and selects the second artificial intelligence algorithm 63 when the received analysis mode is the "CTC determination mode".
  • step S23 the control unit 40A uses the selected first artificial intelligence algorithm 60 or the second artificial intelligence algorithm 63 to determine the properties of the analysis target cells in the analysis images 80A and 80B, and stores the label value 84 of the determination result in the storage unit 43 or the memory 42.
  • the determination method is as described in sections 2-1 and 2-2 above.
  • steps S204 to S206 by the control unit 40A Since the processing of steps S204 to S206 by the control unit 40A is the same as that of steps S24 to S26 described with reference to FIG. 19 , the description thereof will be omitted.
  • the above sections 1 to 4 have described an example in which the imaging unit 160 is provided in the imaging flow cytometer.
  • the microscope 700 shown in FIGS. 21 and 22 also may be used instead of the imaging flow cytometer.
  • the microscope shown in FIG. 21 is disclosed in US Pat. No. 2018-0074308 and is incorporated herein by reference.
  • the microscope device 700 includes a housing unit 710 and a moving unit 720.
  • the microscope device 700 includes an imaging unit 710d and a slide installation unit 711.
  • the imaging unit 710d includes an objective lens 712, a light source 713, and an imaging element 714.
  • the slide installation unit 711 is provided on the upper surface (the surface on the Z1 direction side) of the housing unit 710.
  • the objective lens 712, the light source 713, and the image sensor 714 are provided inside the housing unit 710.
  • the microscope device 700 includes a display unit 721.
  • the display unit 721 is provided on the front surface (the surface on the Y1 direction side) of the moving unit 720.
  • the display surface 721a of the display unit 721 is arranged on the front side of the moving unit 720.
  • the microscope device 700 includes a drive unit 710a that moves the moving unit 720 relative to the housing unit 710.
  • the slide installation unit 711 includes a stage 711a.
  • the stage 711a can move in the horizontal direction (X direction and Y direction) and in the vertical direction (Z direction).
  • the stage 711a can move independently of each other in the X direction, the Y direction, and the Z direction. In this way the slide can be moved relative to the objective lens 712, so that the desired position of the slide can be magnified and viewed.
  • the objective lens 712 is arranged close to the stage 711a of the slide installation unit 711.
  • the objective lens 712 is arranged close to the lower side (Z2 direction) of the stage 711a of the slide installation unit 711.
  • the objective lens 712 is provided so as to face the slide installation unit 711 in the vertical direction (Z direction).
  • the objective lens 712 is arranged so that the optical axis is substantially perpendicular to the slide installation surface on which the slide of the slide installation unit 711 is installed.
  • the objective lens 712 is arranged so as to face upward.
  • the objective lens 712 can move relative to the slide installation unit 711 in the vertical direction (Z direction).
  • the objective lens 712 is arranged so as to have a longitudinal direction in the vertical direction. That is, the objective lens 712 is arranged so as to have an optical axis in the substantially vertical direction.
  • the objective lens 712 includes a plurality of lenses.
  • FIG. 22 shows a structural example of the optical system of the microscope device 700.
  • the microscope device 700 includes an objective lens 712, a light source 713, an image sensor 714, a first optical element 715, a filter 716a, a second optical elements 716b, 716c, 716f, and 716g, lenses 716d, 716e and 716h, reflective parts 717a, 717b and 717d, and a lens 717c.
  • the objective lens 712, the light source 713, the image sensor 714, and the first optical element 715, the filter 716a, the second optical elements 716b, 716c, 716f and 716g, the lenses 716d, 716e and 716h, the reflecting parts 717a, 717b and 717d, and the lens 717c are located within the housing unit 710.
  • the first optical element 715 is configured to reflect the light emitted from the light source 713 in the optical axis direction of the objective lens 712, and transmit the light from the slide.
  • the first optical element 715 includes, for example, a dichroic mirror. That is, the first optical element 715 is configured to reflect light having a wavelength emitted from the light source 713 and transmit the wavelength of light generated from the slide.
  • the filter 716a is configured to transmit light of a predetermined wavelength to block light of other wavelengths, or to block light of a predetermined wavelength and transmit light of other wavelengths. That is, light of a desired wavelength is transmitted by the filter 716a and reaches the image sensor 714.
  • the second optical elements 716b, 716c, 716f and 716g are configured to reflect the light from the slide toward the image sensor 714.
  • the second optical elements 716b, 716c, 716f and 716g include a reflecting part.
  • the second optical elements 716b, 716c, 716f and 716g include, for example, a mirror.
  • the reflecting parts 717a, 717b and 717d are configured to reflect the light from the light source 713 toward the objective lens 712.
  • Reflecting parts 717a, 717b and 717d include, for example, mirrors.
  • the light emitted from the light source 713 is reflected by the reflecting portion 717a and incident on the reflecting portion 17b.
  • the light incident on the reflecting portion 717b is reflected and incident on the reflecting portion 717d via the lens 717c.
  • the light incident on the reflecting portion 717d is reflected and incident on the first optical element 715.
  • the light incident on the first optical element 715 is reflected and reaches the slide installation portion 11 via the objective lens 712, and is irradiated to the slide.
  • the light emitted from the slide based on the light of the light source 713 is incident on the first optical element 715 via the objective lens 712.
  • the light incident on the first optical element 715 is transmitted and enters the second optical element 716b through the filter 716a.
  • the light incident on the second optical element 716b is reflected and incident on the second optical element 716c.
  • the light incident on the second optical element 716c is reflected and incident on the second optical element 716f via the lenses 716d and 716e.
  • the light incident on the second optical element 716f is reflected and incident on the second optical element 716g.
  • the light incident on the second optical element 716g is reflected and reaches the image pickup element 714 via the lens 16h.
  • the image sensor 714 captures an enlarged image of the slide based on the light that reaches it.
  • the captured image is transmitted from the microscope 700 to the computer 800 shown in FIG.
  • the computer 800 corresponds to a generator (200A) and / or a cell analyzer (400A).
  • a second embodiment relates to a method of analyzing a cell using an artificial intelligence algorithm from waveform data based on signal strength from the cell.
  • the present embodiment relates to a cell analysis method for analyzing cells contained in a biological sample.
  • numerical data corresponding to the signal strength for each cell is input to the third artificial intelligence algorithm 560 or the fourth artificial intelligence algorithm 563 having a neural network structure. Then, based on the result output from the third artificial intelligence algorithm 560 or the fourth artificial intelligence algorithm 563, the type of cell for which the signal strength has been acquired is determined for each cell.
  • the type of cell to be determined in a certain form of the present embodiment is based on the type of cell based on the morphological classification, and differs depending on the type of the biological sample.
  • the types of cells to be determined in this embodiment include erythrocytes, nucleated cells such as leukocytes, and platelets. included. Nucleated cells include neutrophils, lymphocytes, monocytes, eosinophils and basophils. Neutrophils include lobulated neutrophils and rod-shaped neutrophils.
  • the nucleated cells may contain at least one selected from the group consisting of immature granulocytes and abnormal cells. Such cells are also included in the type of cells to be determined in this embodiment. Immature granulocytes can include cells such as metamyelocytes, myelocytes, promyelocytes, and myeloblasts.
  • training data 575 A method of generating training data 575 and a method of analyzing waveform data will be described with reference to the examples shown in FIGS. 23 to 25 .
  • train or “training” may be used in place of the term “generate” or “generating”.
  • analysis target image may be referred to as “analysis image”
  • data to be analyzed may be referred to as “analysis data”
  • image for training may be referred to as “training image”
  • training data for training may be referred to as “training data”.
  • the "fluorescent image” is intended to be a training image obtained by imaging a fluorescent label or an analysis image obtained by imaging a fluorescent label.
  • the example shown in FIG. 23 is an example of a method for generating training waveform data used for training a third artificial intelligence algorithm for determining the types of leukocytes, immature granulocytes, and abnormal cells.
  • the waveform data for forward scattered light 570a, the waveform data 570b for lateral scattered light, and the waveform data 570c for lateral fluorescence, which are the waveform data for training, are associated with the cells to be trained.
  • Waveform data of forward scattered light 570a, waveform data of side scattered light 570b, and waveform data 570c of lateral fluorescence also are referred to as training waveform data 570.
  • the training waveform data 570a, 570b, and 570c obtained from the training target cells may be waveform data obtained by flow cytometry of cells whose cell types are known based on morphological classification. Alternatively, waveform data of cells whose cell type has already been determined from a scattergram of a healthy person may be used. Further, as the waveform data in which the cell type of a healthy person is determined, a pool of waveform data of cells acquired from a plurality of people may be used.
  • the sample for acquiring the training waveform data 570a, 570b, and 570c is preferably processed from a sample containing cells of the same type as the cells to be trained by the same sample processing method as the sample containing the cells to be trained.
  • the training waveform data 570a, 570b, and 570c are acquired under the same conditions as those for the cells to be analyzed.
  • the training waveform data 570a, 570b, and 570c can be obtained in advance for each cell by, for example, a known flow cytometry or sheath flow electrical resistance method.
  • the training data may be waveform data acquired by the sheath flow electric resistance method, and the waveform data may be a type obtained from the electrical signal strength.
  • training waveform data 570a, 570b, and 570c acquired by flow cytometry using Sysmex XN-1000 are used.
  • the training waveform data 570a, 570b, and 570c for example, after the forward scattered light reaches a predetermined threshold, acquisition of the forward scattered light signal intensity, the side scattered light signal intensity, and the side fluorescence signal intensity is started, and in this example, waveform data are acquired at a plurality of time points at regular intervals for one training target cell until the acquisition is completed after a predetermined time.
  • Examples of acquiring waveform data at a plurality of time points at regular intervals include 1024 points at 10 nanosecond intervals, 128 points at 80 nanosecond intervals, 64 points at 160 nanosecond intervals, and the like.
  • the cells contained in the biological sample are flowed through the flow path for cell detection in the measurement unit, which is equipped with a flow cytometer, a sheath flow electric resistance type measuring device, or the like which can detect cells individually and are acquired for individual cells passing through the flow path.
  • the training waveform data 570a, 570b, and 570c in FIG. 23 are represented by raw data values, such as forward scattered light sequence data 572a, side scattered light sequence data 572b, and side fluorescence sequence data 572c.
  • Adjacent cells inside the respective sequence data 576a, 576b, and 576c store signal intensities at intervals of 10 nanoseconds.
  • the sequence data 576a, 576b, and 576c are combined with a label value of 577 indicating the type of training target cell, and the three signal strengths at the same point (forward scattered light signal strength, side scattered light signal strength, and side) become a set of training data 575 that is input to the third artificial intelligence algorithm 550.
  • the sequence data 576a, 576b, and 576c are given "1" as a label value 577 indicating that the cell is a neutrophil, and training data 575 are generated...
  • FIG. 24 shows an example of the label value 577. Since the training data 575 are generated for each cell type, the label value is given a different label value of 577 depending on the cell type.
  • the synchronization at the time when the signal intensity is acquired is, for example, combined at the same time in the sequence data 572a of the forward scattered light, the sequence data 572b of the side scattered light, and the sequence data 572c of the side fluorescence for the time from the start of measurement to match the measurement points.
  • the sequence data 572a of the forward scattered light, the sequence data 572b of the laterally scattered light, and the sequence data 572c of the lateral fluorescence each have the signal strength acquired at the same time in one cell passing through the flow cell.
  • the measurement start time may be a time when the signal intensity of the forward scattered light exceeds a predetermined threshold value such as a threshold value, another scattered light or fluorescence signal intensity threshold value may be used.
  • a threshold value also may be set for each sequence data.
  • the analysis waveform data 580a, 580b, and 580c are acquired by using Sysmex XN-1000 in the same manner as the training waveform data 570a, 570b, and 570c.
  • the analysis waveform data 580a, 580b, and 580c are represented by raw data values, for example, forward scattered light sequence data 582a, side scattered light sequence data 582b, and side fluorescence sequence data 582c.
  • the sequence data 582a, 582b, and 582c are synchronized at the time when the signal strength is acquired for each cell to be trained, and become the sequence data is 586a (forward scattered light), the sequence data is 586b (side scattered light), and the sequence data is 586c (side fluorescence).
  • the sequence data 586a, 586b, and 586c are combined so that the three signal intensities at the same point (the signal intensity of the forward scattered light, the signal intensity of the side scattered light, and the signal intensity of the side fluorescence) are combined so as to become a set, and the analysis data 585 are input to the third artificial intelligence algorithm 560 or the fourth artificial intelligence algorithm 563.
  • the probability that the analysis target cell for which the analysis data 585 have been acquired belongs to each of the cell types input as training data is output from the output layer 560b or the input layer 563a.
  • Reference numerals 560c and 563c in FIG. 25 indicate an intermediate layer. Further, it may be determined that the analysis target cell for which the analysis data 585 have been acquired belongs to the classification having the highest value in this probability, and the label value 582 or the like associated with the cell type may be output.
  • the output analysis result 583 regarding the cell may be data in which the label value itself is replaced with information (for example, terminology or the like) indicating the cell type.
  • FIG. 25 shows an example based on the analysis data 585, wherein the third artificial intelligence algorithm 560 or the fourth artificial intelligence algorithm 563 outputs the label value "1" having the highest probability that the analysis target cell for which the analysis data 585 have been acquired, and the character data "neutrophil" corresponding to this label value is output as the analysis result 583 for the cell.
  • the output of the label value may be performed by the third artificial intelligence algorithm 560 or the fourth artificial intelligence algorithm 563, but other computer programs may be used, another computer program may output the most preferable label value based on the probability calculated by the third artificial intelligence algorithm 560 or the fourth artificial intelligence algorithm 563.
  • the waveform data of this embodiment can be acquired by the cell analysis system 5000.
  • FIG. 26 shows the appearance of the cell analysis system 5000.
  • the cell analysis system 5000 includes a measurement unit (also referred to as a measurement unit) 600, processing units 100T and 200T in the measurement unit 600 for controlling setting and measurement of sample measurement conditions in the measurement unit 600 which can be connected by wire or wirelessly so that they can communicate with each other.
  • the configuration example of the measurement unit 600 will be shown below, but the mode of the present embodiment is not to be construed as being limited to the following examples.
  • the processing unit 100T or the processing unit 200T can be shared with the training device 100T or the cell analysis device 200T, which will be described later.
  • the training device 100T or the cell analysis device 200T is used as the processing unit 100T or the processing unit 200T will be described.
  • a structural example will be described with reference to FIGS. 26 to 28 when the measurement unit 600 is a flow cytometer for detecting nucleated cells in a blood sample.
  • the detection unit 610 functions as a signal acquisition unit, and has a nucleated cell detection unit 611 that detects at least nucleated cells such as white blood cells, an erythrocyte/platelet detection unit 612 that measures the number of erythrocytes and platelets, and if necessary, and a hemoglobin detection unit 613 for measuring the amount of blood pigment in the blood cells.
  • the nucleated cell detection unit 611 is composed of an optical detection unit, and more specifically, has a configuration for performing detection by a flow cytometry method.
  • the digital value calculation unit 683 is connected to the interface unit 689 via the interface unit 684 and the bus 685.
  • the interface unit 689 is connected to the display/operation unit 650 via the bus 685 and the interface unit 486, and is connected to the detection unit 610, the device mechanism unit 630, and the sample preparation unit 640 via the bus 685 and the interface unit 688.
  • the A/D conversion unit 682 converts the received light signal, which is an analog signal output from the analog processing unit 620, into a digital signal and outputs the converted signal to the digital value calculation unit 683.
  • the digital value calculation unit 683 performs a predetermined calculation process on the digital signal output from the A/D conversion unit 682.
  • the training device 100T or the cell analysis device 200T is connected to the digital value calculation unit 683 via the interface unit 684, the bus 685, and the interface unit 689, such that the training device 100T or the cell analysis device 200T can receive the calculation result output from the digital value calculation unit 683.
  • the training device 100T or the cell analysis device 200T controls the device mechanism unit 630 including a sampler (not shown) for automatically supplying the sample container, a fluid system for preparing and measuring the sample, and other controls.
  • the nucleated cell detection unit 611 flows a measurement sample containing cells through a flow path for cell detection, irradiates light on the cells flowing through the flow path for cell detection, and measures scattered light and fluorescence generated from the cells.
  • the erythrocyte/platelet detection unit 612 flows a measurement sample containing cells through a cell detection channel, measures the electrical resistance of the cells flowing through the cell detection channel, and detects the cell volume.
  • the measurement unit 600 preferably includes a flow cytometer and/or a sheath flow electric resistance type detection unit.
  • the nucleated cell detection unit 611 can be a flow cytometer.
  • the erythrocyte/platelet detection unit 612 may be a sheath flow electrical resistance type detection unit.
  • nucleated cells may be measured by the erythrocyte/platelet detection unit 612, and erythrocytes and platelets may be measured by the nucleated cell detection unit 611.
  • a light source 4111 irradiates the flow cell 4113 with light, and the scattered light and fluorescence emitted via this irradiation light from the cells in the flow cell 4113 are detected.
  • the scattered light is not particularly limited as long as it is scattered light that can be measured by a flow cytometer that is generally distributed.
  • scattered light includes forward scattered light (for example, a light receiving angle of around 0 to 20 degrees) and side scattered light (light receiving angle of around 90 degrees).
  • side scattered light reflects internal information of cells such as cell nuclei and granules
  • forward scattered light reflects information on cell size.
  • FIG. 28 shows a structural example of the optical system of the nucleated cell detection unit 611.
  • the light emitted from the laser diode which is the light source 4111, irradiates the cells passing through the flow cell 6113 via the irradiation lens system 4112.
  • the light source 4111 of the flow cytometer is not specifically limited, and a light source 4111 having a wavelength suitable for exciting the fluorescent dye is selected.
  • a light source 4111 for example, a semiconductor laser including a red semiconductor laser and/or a blue semiconductor laser, a gas laser such as an argon laser and a helium-neon laser, a mercury arc lamp, and the like may be used.
  • semiconductor lasers are suitable because they are much cheaper than gas lasers.
  • the forward scattered light emitted from the particles passing through the flow cell 4113 is received by the forward scattered light receiving element 4116 via the condenser lens 4114 and the pinhole portion 4115.
  • the forward scattered light receiving element 4116 may be a photodiode or the like.
  • the side scattered light is received by the side scattered light receiving element 4121 via the condenser lens 4117, the dichroic mirror 4118, the bandpass filter 4119, and the pinhole portion 4120.
  • the side scattered light receiving element 4121 can be a photodiode, a photomultiplier, or the like.
  • the side fluorescence is received by the side fluorescence light receiving element 4122 via the condenser lens 4117 and the dichroic mirror 4118.
  • the side fluorescence light receiving element 4122 may be an avalanche photodiode, a photomultiplier, or the like.
  • the received light signals output from the light receiving elements 4116, 4121 and 4122 are subjected to analog processing such as amplification and waveform processing by the analog processing unit 620 shown in FIG. 27 having amplifiers 4151, 4152 and 4153, respectively, and sent to the control unit 680 of the measurement unit.
  • analog processing such as amplification and waveform processing by the analog processing unit 620 shown in FIG. 27 having amplifiers 4151, 4152 and 4153, respectively, and sent to the control unit 680 of the measurement unit.
  • the measurement unit 600 may include a sample preparation unit 640 for preparing a measurement sample.
  • the sample preparation unit 640 is controlled by the information control unit 481 of the measurement unit via the interface unit 688 and the bus 685.
  • a sample preparation unit 640 provided in the measurement unit 600 prepares a measurement sample by mixing a blood sample, a staining reagent, and a hemolytic reagent, and the obtained measurement sample is measured by a nucleated cell detection unit.
  • the obtained measurement sample is sent to the flow cell 4113 in the nucleated cell detection unit 611 together with a sheath solution (for example, Cellpack (II), manufactured by Sysmex Corporation), and is measured by a flow cytometry method in the nucleated cell detection unit 611.
  • a sheath solution for example, Cellpack (II), manufactured by Sysmex Corporation
  • FIG. 30 illustrates an example of the hardware structure of the training device 100T.
  • the training device 200A includes a control unit 20A, an input unit 26, and an output unit 27.
  • the training device 100T can be connected to the network 99.
  • the Structure of the control unit 10T is the same as the structure of the control unit 20A of the training device 200A.
  • the CPU 21, the memory 22, the storage unit 23, the bus 24, the I/F unit 25, and the GPU 29 in the control unit 20A of the training device 200A shall be read as the CPU 11, the memory 12, the storage unit 13, the bus 14, and the I/F unit 15, and GPU19, respectively.
  • the storage unit 13 stores the third artificial intelligence algorithm 550 and the fourth artificial intelligence algorithm 560.
  • the training waveform data 570 can be acquired by the measurement unit 600 and stored in the storage unit 13 or the memory 12 of the control unit 10T of the training device 100T.
  • the cell analysis device 200T includes a control unit 20, an input unit 26, an output unit 27, and a media drive D98.
  • the cell analysis device 200T can be connected to the network 99.
  • the training waveform data 580 can be acquired by the measurement unit 600 and stored in the storage unit 23 or the memory 22 of the control unit 20T of the training device 200T.
  • the training waveform data 570a, 570b, and 570c are acquired in advance by the measurement unit 600 and stored in advance in the training data database T104 (a) of the control unit 10T.
  • the third artificial intelligence algorithm 550 is stored in advance in the algorithm database T105 (b).
  • FIG. 33 shows the function structure of the cell analyzer 200T.
  • the cell analysis device 200T includes an analysis data generation unit T201, an analysis data input unit T202, an analysis unit T203, an analysis data database (DB) T204, and an algorithm database (DB) T205 (a) and T205 (b).
  • Step S2001 shown in FIG. 35 corresponds to the analysis data generation unit T201.
  • Step S2002 shown in FIG. 35 corresponds to the analysis data input unit T202.
  • Step S2003 shown in FIG. 35 corresponds to the analysis unit T403.
  • the waveform data 580 for analysis are acquired by the measurement unit 600 and stored in the analysis data database T204.
  • the plurality of trained third artificial intelligence algorithms 560 are stored in the algorithm database T205 (a).
  • the fourth artificial intelligence algorithm 563 is stored in the algorithm database T205 (b).
  • step S1001 the control unit 10T associates information indicating the cell type associated with the training waveform data 570a, 570b, and 570c, a label value associated with the cell type stored in the memory 12 or the storage unit 13, and a label value 577 corresponding to sequence data 576a, 576b, 576c synchronized with the waveform data of the forward scattered light, side scattered light, and side fluorescent light during waveform data acquisition with the sequence data 572a, 572b, 572c.
  • the control unit 10T generates training data 575.
  • step S1003 the control unit 10T determines whether the accumulated training results have reached a predetermined number of training cycles.
  • the control unit 10T proceeds to the process of step S1004, and when the training results have not accumulated for a predetermined number of cycles ("NO"), the control unit 10T proceeds to the process of step S15.
  • step S1004 the control unit 10T uses the training results accumulated in step S1002 to update the weight w of the third artificial intelligence algorithm 550 or the fourth artificial intelligence algorithm 553. Since the cell type analysis method according to the present embodiment uses the stochastic gradient descent method, the weight w of the third artificial intelligence algorithm 550 or the fourth artificial intelligence algorithm 553 is updated at the stage at which the training results for a predetermined number of trials are accumulated.
  • step S1005 the control unit 10T determines whether the third artificial intelligence algorithm 550 or the fourth artificial intelligence algorithm 553 has been trained with the specified number of training data 575. When training is performed with the specified number of training data 575 (in the case of "YES"), the training process is terminated.
  • step S1005 When the control unit 10T determines in step S1005 that the third artificial intelligence algorithm 550 or the fourth artificial intelligence algorithm 553 has not been trained with the specified number of training data 575 (in the case of "NO"), the routine advances from step S1005 to step S1006, and the next training waveform data 570 is processed from step S1001 to step S1005.
  • step S2002 the control unit 20T selects the third artificial intelligence algorithm 560 or the fourth artificial intelligence algorithm 563 according to the exam item received in step S2000.
  • the control unit 20T selects the third artificial intelligence algorithm 560 when the exam item is "blood cell classification test", and selects the fourth artificial intelligence algorithm 563 when the exam item is "abnormal cell test”.
  • step S2003 the control unit 20T classifies the analysis target cells using the third artificial intelligence algorithm 560 or the fourth artificial intelligence algorithm 563 selected in step S2003, and stores the label value 577 of the determination result in the storage unit 43 or the memory 42.
  • the control unit 20T determines whether all the analysis target cells have been determined in step S2004, and if all have been determined (in the case of "YES"), proceeds to step S2005 and determines the determination result, and outputs the determination result to the output unit. If not all have been determined in step S2004 (in the case of "NO"), the control unit 20T updates the analysis target cells in step S2006 and repeats steps S2001 to S2004 until all the determinations are made.
  • a second embodiment includes a computer program for training an artificial intelligence algorithm that causes a computer to perform the processes of steps S1001 to S1006.
  • a second embodiment includes a computer program for analyzing cells that causes a computer to perform the processes of steps S2000-S2006 and S2201-S2002.
  • An implementation of the present embodiment relates to a program product such as a storage medium that stores the computer program. That is, the computer program can be stored on a hard disk, a semiconductor memory element such as a flash memory, or a storage medium such as an optical disk.
  • the recording format of the program on the storage medium is not limited insofar as the training device 200A can read the program. Recording on the storage medium is preferably nonvolatile.
  • program is a concept including not only a program that can be directly executed by the CPU, but also a source format program, a compressed program, an encrypted program, and the like.
  • the algorithm to be used is selected according to the received exam item, but the algorithm to be used also may be selected according to the received analysis item after receiving the analysis item.

Landscapes

  • Engineering & Computer Science (AREA)
  • Health & Medical Sciences (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • General Health & Medical Sciences (AREA)
  • Theoretical Computer Science (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Chemical & Material Sciences (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Immunology (AREA)
  • Analytical Chemistry (AREA)
  • Biochemistry (AREA)
  • Pathology (AREA)
  • Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
  • Medical Informatics (AREA)
  • Biomedical Technology (AREA)
  • Molecular Biology (AREA)
  • Evolutionary Computation (AREA)
  • Artificial Intelligence (AREA)
  • Computing Systems (AREA)
  • Multimedia (AREA)
  • Software Systems (AREA)
  • Data Mining & Analysis (AREA)
  • Dispersion Chemistry (AREA)
  • Radiology & Medical Imaging (AREA)
  • General Engineering & Computer Science (AREA)
  • Signal Processing (AREA)
  • Quality & Reliability (AREA)
  • Databases & Information Systems (AREA)
  • Biophysics (AREA)
  • Computational Linguistics (AREA)
  • Mathematical Physics (AREA)
  • Microelectronics & Electronic Packaging (AREA)
  • Bioinformatics & Cheminformatics (AREA)
  • Bioinformatics & Computational Biology (AREA)
  • Evolutionary Biology (AREA)
  • Chemical Kinetics & Catalysis (AREA)
  • Optics & Photonics (AREA)
  • Epidemiology (AREA)
  • Primary Health Care (AREA)
EP20210018.6A 2019-11-29 2020-11-26 Procédé, dispositif et système d'analyse de cellules Pending EP3828761A1 (fr)

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
JP2019217162A JP2021083431A (ja) 2019-11-29 2019-11-29 細胞解析方法、細胞解析装置、細胞解析システム、及び細胞解析プログラム

Publications (1)

Publication Number Publication Date
EP3828761A1 true EP3828761A1 (fr) 2021-06-02

Family

ID=73598739

Family Applications (1)

Application Number Title Priority Date Filing Date
EP20210018.6A Pending EP3828761A1 (fr) 2019-11-29 2020-11-26 Procédé, dispositif et système d'analyse de cellules

Country Status (4)

Country Link
US (1) US20210164883A1 (fr)
EP (1) EP3828761A1 (fr)
JP (1) JP2021083431A (fr)
CN (1) CN112967785A (fr)

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2020210734A1 (fr) 2019-04-11 2020-10-15 Agilent Technologies, Inc. Interface utilisateur configurée pour faciliter une annotation d'utilisateur pour une segmentation d'instance dans un échantillon biologique
EP3767587A1 (fr) * 2019-07-19 2021-01-20 Euroimmun Medizinische Labordiagnostika AG Détection de la présence des différents types de motifs fluorescents d'anticorps antinucléaires et dispositif associé
CN114067315B (zh) * 2021-10-23 2022-11-29 广州市艾贝泰生物科技有限公司 细胞计数方法、装置、计算机设备和存储介质
WO2023129820A1 (fr) * 2021-12-30 2023-07-06 Verily Life Sciences Llc Détection de cellules anormales à l'aide d'une microscopie à autofluorescence

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20090204557A1 (en) * 2008-02-08 2009-08-13 Health Discovery Corporation Method and System for Analysis of Flow Cytometry Data Using Support Vector Machines
US20150065697A1 (en) 2013-08-28 2015-03-05 Xerox Corporation Colorant Compounds
WO2017214023A1 (fr) * 2016-06-10 2017-12-14 Amnis Corporation Procédé pour combiner des canaux à fond clair et fluorescents pour la segmentation d'images de cellules et analyse morphologique au moyen d'images obtenues à partir d'un appareil d'imagerie par cytométrie en flux (cmf)
US20180074308A1 (en) 2016-09-12 2018-03-15 Sysmex Corporation Microscope device, microscope system, and imaging method
CN108362628A (zh) * 2018-01-11 2018-08-03 天津大学 基于偏振衍射成像流式细胞仪的无标记细胞流式分选方法

Family Cites Families (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6043039A (en) * 1998-02-17 2000-03-28 Applied Spectral Imaging Method of and composite for in situ fluorescent hybridization
JP4852890B2 (ja) * 2005-05-31 2012-01-11 株式会社ニコン 細胞の自動良否判定システム
US20100053211A1 (en) * 2008-06-27 2010-03-04 Vala Sciences, Inc. User interface method and system with image viewer for management and control of automated image processing in high content screening or high throughput screening
MX2014004004A (es) * 2011-10-05 2015-01-14 Cireca Theranostics Llc Metodo y sistema para analizar especimenes biologicos por medio de imagenes espectrales.
US20150064722A1 (en) * 2012-03-28 2015-03-05 Shizuoka Prefecture Method for detecting the degree of malignancy of each of the circulating tumor cells, and a kit for the same
CN107407691B (zh) * 2015-01-22 2021-07-27 贝克顿迪金森公司 用于单细胞中核酸靶标的分子条码化的装置和系统
JP6777086B2 (ja) * 2015-10-08 2020-10-28 ソニー株式会社 情報処理装置、情報処理方法及び情報処理システム
JP2017108738A (ja) * 2015-12-15 2017-06-22 東ソー株式会社 細胞検出装置および細胞回収装置
JP7030423B2 (ja) * 2017-04-27 2022-03-07 シスメックス株式会社 画像解析方法、装置、プログラムおよび深層学習アルゴリズムの製造方法
JP7198577B2 (ja) * 2017-11-17 2023-01-04 シスメックス株式会社 画像解析方法、装置、プログラムおよび学習済み深層学習アルゴリズムの製造方法
JP7076698B2 (ja) * 2017-11-17 2022-05-30 国立研究開発法人国立がん研究センター 画像解析方法、画像解析装置、プログラム、学習済み深層学習アルゴリズムの製造方法および学習済み深層学習アルゴリズム

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20090204557A1 (en) * 2008-02-08 2009-08-13 Health Discovery Corporation Method and System for Analysis of Flow Cytometry Data Using Support Vector Machines
US20150065697A1 (en) 2013-08-28 2015-03-05 Xerox Corporation Colorant Compounds
WO2017214023A1 (fr) * 2016-06-10 2017-12-14 Amnis Corporation Procédé pour combiner des canaux à fond clair et fluorescents pour la segmentation d'images de cellules et analyse morphologique au moyen d'images obtenues à partir d'un appareil d'imagerie par cytométrie en flux (cmf)
US20180074308A1 (en) 2016-09-12 2018-03-15 Sysmex Corporation Microscope device, microscope system, and imaging method
CN108362628A (zh) * 2018-01-11 2018-08-03 天津大学 基于偏振衍射成像流式细胞仪的无标记细胞流式分选方法

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
LUO S B ET AL: "A High Performance of Single Cell Imaging Detection with Deep Learning", 2019 IEEE 4TH INTERNATIONAL CONFERENCE ON IMAGE, VISION AND COMPUTING (ICIVC), IEEE, 5 July 2019 (2019-07-05), pages 356 - 360, XP033704708, DOI: 10.1109/ICIVC47709.2019.8981372 *

Also Published As

Publication number Publication date
US20210164883A1 (en) 2021-06-03
JP2021083431A (ja) 2021-06-03
CN112967785A (zh) 2021-06-15

Similar Documents

Publication Publication Date Title
EP3828761A1 (fr) Procédé, dispositif et système d'analyse de cellules
US7346200B1 (en) Method and apparatus for computer controlled cell based diagnosis
KR100691043B1 (ko) 컴퓨터 제어된 태아 세포 포함 희귀 세포 진단 방법 및 장치
US9133506B2 (en) Methods and systems for analyzing biological samples
JP3466568B2 (ja) 細胞ベースのスクリーニング用のシステム
US20130078636A1 (en) Method for detecting and quantitating multiple subcellular components
JP7475848B2 (ja) 細胞解析方法、細胞解析装置、細胞解析システム、及び細胞解析プログラム、並びに訓練された人工知能アルゴリズムの生成方法、生成装置、及び生成プログラム
JP2002355090A (ja) 細胞に基づくスクリーニングシステム
JP2008518587A (ja) 多細胞下成分の検出及び定量法
JP2009528043A (ja) 生物学的サンプルの画像化および修飾のための装置および方法
JP4630015B2 (ja) 細胞分離回収方法および細胞分離チップおよび細胞分離装置
EP4299712A1 (fr) Système de traitement de cellules, procédé de traitement de cellules, et procédé de création de données d'apprentissage
WO2023189281A1 (fr) Appareil de traitement d'informations, procédé de traitement d'informations, système de culture cellulaire et programme
US11908130B2 (en) Apparatuses and methods for digital pathology
Cecic et al. Technologies supporting analytical cytology: clinical, research and drug discovery applications
Valet et al. Cytomics: From cell States to predictive medicine
Kotov et al. Chrysalis: A new method for high-throughput histo-cytometry analysis of images and movies. Running title: Automation of quantitative image analysis using Chrysalis
Kim et al. Cellular imaging-based biological analysis for cancer diagnostics and drug target development

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE APPLICATION HAS BEEN PUBLISHED

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE

17P Request for examination filed

Effective date: 20211104

RBV Designated contracting states (corrected)

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: EXAMINATION IS IN PROGRESS

17Q First examination report despatched

Effective date: 20230313