WO2020075635A1 - 画像処理装置、画像処理方法、プログラム、及び評価方法 - Google Patents

画像処理装置、画像処理方法、プログラム、及び評価方法 Download PDF

Info

Publication number
WO2020075635A1
WO2020075635A1 PCT/JP2019/039250 JP2019039250W WO2020075635A1 WO 2020075635 A1 WO2020075635 A1 WO 2020075635A1 JP 2019039250 W JP2019039250 W JP 2019039250W WO 2020075635 A1 WO2020075635 A1 WO 2020075635A1
Authority
WO
WIPO (PCT)
Prior art keywords
region
extraction
colony
area
image
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/JP2019/039250
Other languages
English (en)
French (fr)
Japanese (ja)
Inventor
知朗 檀
宏昭 紀伊
魚住　孝之
泰次郎 清田
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Nikon Corp
Original Assignee
Nikon Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Nikon Corp filed Critical Nikon Corp
Priority to JP2020551099A priority Critical patent/JP7351311B2/ja
Priority to EP19871996.5A priority patent/EP3865565A4/en
Priority to CN201980067104.5A priority patent/CN112889086B/zh
Publication of WO2020075635A1 publication Critical patent/WO2020075635A1/ja
Priority to US17/227,967 priority patent/US11953498B2/en
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N33/00—Investigating or analysing materials by specific methods not covered by groups G01N1/00 - G01N31/00
    • G01N33/48—Biological material, e.g. blood, urine; Haemocytometers
    • G01N33/50—Chemical analysis of biological material, e.g. blood, urine; Testing involving biospecific ligand binding methods; Immunological testing
    • G01N33/5005—Chemical analysis of biological material, e.g. blood, urine; Testing involving biospecific ligand binding methods; Immunological testing involving human or animal cells
    • G01N33/5008—Chemical analysis of biological material, e.g. blood, urine; Testing involving biospecific ligand binding methods; Immunological testing involving human or animal cells for testing or evaluating the effect of chemical or biological compounds, e.g. drugs, cosmetics
    • G01N33/5044—Chemical analysis of biological material, e.g. blood, urine; Testing involving biospecific ligand binding methods; Immunological testing involving human or animal cells for testing or evaluating the effect of chemical or biological compounds, e.g. drugs, cosmetics involving specific cell types
    • G01N33/5073—Stem cells
    • C—CHEMISTRY; METALLURGY
    • C12—BIOCHEMISTRY; BEER; SPIRITS; WINE; VINEGAR; MICROBIOLOGY; ENZYMOLOGY; MUTATION OR GENETIC ENGINEERING
    • C12M—APPARATUS FOR ENZYMOLOGY OR MICROBIOLOGY; APPARATUS FOR CULTURING MICROORGANISMS FOR PRODUCING BIOMASS, FOR GROWING CELLS OR FOR OBTAINING FERMENTATION OR METABOLIC PRODUCTS, i.e. BIOREACTORS OR FERMENTERS
    • C12M41/00—Means for regulation, monitoring, measurement or control, e.g. flow regulation
    • C12M41/30—Means for regulation, monitoring, measurement or control, e.g. flow regulation of concentration
    • C12M41/36—Means for regulation, monitoring, measurement or control, e.g. flow regulation of concentration of biomass, e.g. colony counters or by turbidity measurements
    • C—CHEMISTRY; METALLURGY
    • C12—BIOCHEMISTRY; BEER; SPIRITS; WINE; VINEGAR; MICROBIOLOGY; ENZYMOLOGY; MUTATION OR GENETIC ENGINEERING
    • C12Q—MEASURING OR TESTING PROCESSES INVOLVING ENZYMES, NUCLEIC ACIDS OR MICROORGANISMS; COMPOSITIONS OR TEST PAPERS THEREFOR; PROCESSES OF PREPARING SUCH COMPOSITIONS; CONDITION-RESPONSIVE CONTROL IN MICROBIOLOGICAL OR ENZYMOLOGICAL PROCESSES
    • C12Q1/00—Measuring or testing processes involving enzymes, nucleic acids or microorganisms; Compositions therefor; Processes of preparing such compositions
    • C12Q1/02—Measuring or testing processes involving enzymes, nucleic acids or microorganisms; Compositions therefor; Processes of preparing such compositions involving viable microorganisms
    • C12Q1/04—Determining presence or kind of microorganism; Use of selective media for testing antibiotics or bacteriocides; Compositions containing a chemical indicator therefor
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/0002—Inspection of images, e.g. flaw detection
    • G06T7/0012—Biomedical image inspection
    • G06T7/0014—Biomedical image inspection using an image reference approach
    • G06T7/0016—Biomedical image inspection using an image reference approach involving temporal comparison
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/10—Segmentation; Edge detection
    • G06T7/11—Region-based segmentation
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/10—Segmentation; Edge detection
    • G06T7/155—Segmentation; Edge detection involving morphological operators
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10056—Microscopic image
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30004—Biomedical image processing
    • G06T2207/30024—Cell structures in vitro; Tissue sections in vitro
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30242—Counting objects in image

Definitions

  • one aspect of the present invention is a colony region extracting unit that extracts a colony region of the pluripotent stem cells from a microscope image by transmitted illumination, and a reference value among pixels that configure the microscope image.
  • a high-brightness region extraction unit that extracts a high-brightness region, which is a region based on a group of pixels having a large brightness value, the colony region extracted by the colony region extraction unit, and the high-brightness region extraction unit Based on the high-brightness region extracted by the extraction target region extraction unit that extracts an extraction target region from the microscope image, and outputs the extraction target region extracted by the extraction target region extraction unit as an extraction result
  • An image processing apparatus including an output unit.
  • transition state As an intermediate state between the immature state and the mature state of the colony.
  • the transitional state is a state in which pluripotent stem cells form colonies but are not sufficiently matured.
  • FIG. 5 is a diagram showing an example of the normal area mask NM according to the present embodiment.
  • the area other than the normal area NR in the phase difference image P1 is masked by the normal area mask NM.
  • Step S240 The dense / muscle mixed area extraction unit 12 adds an image (not shown) obtained by adding the dark spot image P22 generated in step S210 and the normalized image P24 generated in step S230, and a colony mask. Logical AND with CM. The dense / muscle mixed area extraction unit 12 generates a colony mask logical product image P25 as a result of the logical product.
  • FIG. 8 shows the rough mask PM generated as a result of the rough region extraction processing in step S150.
  • FIG. 8 is a diagram showing an example of the rough mask PM generated in the rough region extraction processing according to this embodiment.
  • step S150 the rough area extraction unit 13 replaces the normal area mask NM with the colony mask CM generated by the extraction unit 110 and the dense / muscle mixed area MSM generated by the dense / muscle mixed area extraction unit 12.
  • the rough region PR may be extracted based on
  • the rough area extraction unit 13 extracts the rough area PR based on the colony mask CM instead of the normal area mask NM, the rough area PR is extracted as compared to when the rough area PR is extracted based on the normal area mask NM. Accuracy may be reduced.
  • Step S300 The high brightness area extraction unit 140 performs background normalization processing on the phase difference image P1 acquired by the phase difference image acquisition unit 10.
  • the high-luminance region extraction unit 140 generates the background normalized image P31 as a result of the background normalization processing.
  • step S300 The background normalization process in step S300 may be omitted.
  • step S310 the high-luminance region extraction unit 140 is a region based on a group of pixels having a luminance value larger than the reference value out of the pixels forming the phase difference image P1 A region is extracted from the phase difference image P1.
  • the extraction target area is an area in which a striped pattern appears in the microscope image (transition illumination in this example, the phase difference image P0) by transmission illumination.
  • the image processing device 1 in addition to the rough region PR corresponding to the immature state of the colony and the dense region DR corresponding to the mature state of the colony, the immature state and the mature state
  • the muscle region SR corresponding to the transition state with the above state can be extracted from the microscope image by the transmitted illumination (the phase difference image P0 in this example). Improving the accuracy of the evaluation by evaluating the maturity of the pluripotent stem cell colony based on the muscle region SR, as compared with the case where the evaluation is based on only the rough region PR and the dense region DR. You can
  • the day 4 muscle area ratio SR14 and the day 7 muscle area ratio SR17 can be confirmed.
  • the muscle region ratios are still high on the 4th day and the 7th day, and it is determined that the “culture continues”.
  • the first graph G10 with respect to the normal region NR1 imaged in the phase difference image PT1, it is determined that “cultivation is continued” on the 4th day, but is determined to be “passage” on the 7th day.
  • the area ratio of the dense region DR is 60% or more
  • the colony is in a mature state and is determined as "passage”.
  • the determination result on the 7th day in FIG. 14 is “passage”, whereas the determination result on the 7th day in this embodiment is “continuation of culture”.
  • the accuracy of the evaluation result of the maturity degree of the colony is higher than that in the conventional case.
  • the normal region NR2 imaged in the phase difference image PT2 is determined to be “passage” on the 6th, 7th, and 8th days.
  • the determination results on the 6th and 7th days in FIG. 14 are “passage”, whereas the determination results on the 6th and 7th days in the present embodiment are “continuation of culture”.
  • the accuracy of the evaluation result of the degree of maturity of the colony is higher than in the conventional case.
  • the "computer-readable recording medium” refers to a portable medium such as a flexible disk, a magneto-optical disk, a ROM, a CD-ROM, or a storage device such as a hard disk built in a computer system.
  • “computer-readable recording medium” means a program that dynamically holds a program for a short time, such as a communication line when transmitting the program through a network such as the Internet or a communication line such as a telephone line.
  • a volatile memory inside the computer system that serves as a server or a client in which the program is held for a certain period of time may be included.
  • the above-mentioned program may be for realizing a part of the above-mentioned functions, and may be for realizing the above-mentioned functions in combination with a program already recorded in the computer system.
  • part or all of the image processing devices 1 and 1a in the above-described embodiments may be realized as an integrated circuit such as an LSI (Large Scale Integration).
  • LSI Large Scale Integration
  • Each functional block of the image processing devices 1 and 1a may be individually implemented as a processor, or part or all of the functional blocks may be integrated and implemented as a processor.
  • the method of circuit integration is not limited to LSI, and may be realized by a dedicated circuit or a general-purpose processor.
  • an integrated circuit according to the technology may be used.

Landscapes

  • Engineering & Computer Science (AREA)
  • Health & Medical Sciences (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Chemical & Material Sciences (AREA)
  • Physics & Mathematics (AREA)
  • Immunology (AREA)
  • Biomedical Technology (AREA)
  • General Physics & Mathematics (AREA)
  • General Health & Medical Sciences (AREA)
  • Organic Chemistry (AREA)
  • Bioinformatics & Cheminformatics (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Molecular Biology (AREA)
  • Theoretical Computer Science (AREA)
  • Zoology (AREA)
  • Wood Science & Technology (AREA)
  • Biotechnology (AREA)
  • Analytical Chemistry (AREA)
  • Biochemistry (AREA)
  • Microbiology (AREA)
  • Urology & Nephrology (AREA)
  • Cell Biology (AREA)
  • Hematology (AREA)
  • Toxicology (AREA)
  • General Engineering & Computer Science (AREA)
  • Proteomics, Peptides & Aminoacids (AREA)
  • Genetics & Genomics (AREA)
  • Quality & Reliability (AREA)
  • Medical Informatics (AREA)
  • Radiology & Medical Imaging (AREA)
  • Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
  • Developmental Biology & Embryology (AREA)
  • Tropical Medicine & Parasitology (AREA)
  • Pathology (AREA)
  • Medicinal Chemistry (AREA)
  • Food Science & Technology (AREA)
  • Sustainable Development (AREA)
  • Biophysics (AREA)
  • Apparatus Associated With Microorganisms And Enzymes (AREA)
  • Measuring Or Testing Involving Enzymes Or Micro-Organisms (AREA)
PCT/JP2019/039250 2018-10-12 2019-10-04 画像処理装置、画像処理方法、プログラム、及び評価方法 Ceased WO2020075635A1 (ja)

Priority Applications (4)

Application Number Priority Date Filing Date Title
JP2020551099A JP7351311B2 (ja) 2018-10-12 2019-10-04 画像処理装置、画像処理方法、プログラム、及び評価方法
EP19871996.5A EP3865565A4 (en) 2018-10-12 2019-10-04 IMAGE PROCESSING DEVICE, IMAGE PROCESSING METHOD, PROGRAM AND EVALUATION DEVICE
CN201980067104.5A CN112889086B (zh) 2018-10-12 2019-10-04 图像处理方法及图像处理装置
US17/227,967 US11953498B2 (en) 2018-10-12 2021-04-12 Image processing device, image processing method, program, and evaluation method

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2018193814 2018-10-12
JP2018-193814 2018-10-12

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US17/227,967 Continuation US11953498B2 (en) 2018-10-12 2021-04-12 Image processing device, image processing method, program, and evaluation method

Publications (1)

Publication Number Publication Date
WO2020075635A1 true WO2020075635A1 (ja) 2020-04-16

Family

ID=70164557

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2019/039250 Ceased WO2020075635A1 (ja) 2018-10-12 2019-10-04 画像処理装置、画像処理方法、プログラム、及び評価方法

Country Status (5)

Country Link
US (1) US11953498B2 (https=)
EP (1) EP3865565A4 (https=)
JP (1) JP7351311B2 (https=)
CN (1) CN112889086B (https=)
WO (1) WO2020075635A1 (https=)

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2011010449A1 (ja) * 2009-07-21 2011-01-27 国立大学法人京都大学 画像処理装置、培養観察装置、及び画像処理方法
WO2011043077A1 (ja) * 2009-10-09 2011-04-14 川崎重工業株式会社 未分化多能性幹細胞の識別方法及び装置並びに自動培養方法及び装置
WO2015193951A1 (ja) * 2014-06-16 2015-12-23 株式会社ニコン 観察装置、観察方法、観察システム、そのプログラム、および細胞の製造方法
WO2016013394A1 (ja) 2014-07-22 2016-01-28 株式会社日立ハイテクノロジーズ 細胞数濃度調整装置およびそれを用いた自動継代培養システム
JP2018193814A (ja) 2017-05-19 2018-12-06 株式会社技研製作所 鋼管矢板の施工方法および改良方法

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7907769B2 (en) * 2004-05-13 2011-03-15 The Charles Stark Draper Laboratory, Inc. Image-based methods for measuring global nuclear patterns as epigenetic markers of cell differentiation
WO2012115153A1 (ja) * 2011-02-25 2012-08-30 株式会社ニコン 細胞評価方法、細胞培養方法、細胞評価装置、インキュベータ、細胞評価プログラム、コロニー分類プログラム、幹細胞の培養方法、幹細胞評価装置および幹細胞評価プログラム
JP5333570B2 (ja) * 2011-12-21 2013-11-06 富士ゼロックス株式会社 画像処理装置、プログラム及び画像処理システム
JP6066492B2 (ja) * 2013-08-22 2017-01-25 富士フイルム株式会社 細胞画像評価装置および方法並びにプログラム
JP6312123B2 (ja) * 2013-11-19 2018-04-18 国立大学法人京都大学 細胞判定方法、細胞判定装置及び細胞判定プログラム

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2011010449A1 (ja) * 2009-07-21 2011-01-27 国立大学法人京都大学 画像処理装置、培養観察装置、及び画像処理方法
WO2011043077A1 (ja) * 2009-10-09 2011-04-14 川崎重工業株式会社 未分化多能性幹細胞の識別方法及び装置並びに自動培養方法及び装置
WO2015193951A1 (ja) * 2014-06-16 2015-12-23 株式会社ニコン 観察装置、観察方法、観察システム、そのプログラム、および細胞の製造方法
WO2016013394A1 (ja) 2014-07-22 2016-01-28 株式会社日立ハイテクノロジーズ 細胞数濃度調整装置およびそれを用いた自動継代培養システム
JP2018193814A (ja) 2017-05-19 2018-12-06 株式会社技研製作所 鋼管矢板の施工方法および改良方法

Also Published As

Publication number Publication date
JPWO2020075635A1 (ja) 2021-10-14
US20210301246A1 (en) 2021-09-30
CN112889086B (zh) 2024-06-25
US11953498B2 (en) 2024-04-09
EP3865565A4 (en) 2022-07-20
EP3865565A1 (en) 2021-08-18
CN112889086A (zh) 2021-06-01
JP7351311B2 (ja) 2023-09-27

Similar Documents

Publication Publication Date Title
TWI431549B (zh) Image processing apparatus and method and computer program product
CN109712142B (zh) 基于染色分离的乳腺癌Ki67/ER/PR核染色细胞计数方法
WO2006063268B1 (en) Computer-implemented methods for detecting and/or sorting defects in a design pattern of a reticle
EP3477586A1 (en) Image processing device, image processing method, and image processing program
US12378516B2 (en) Passage timing calculation device, passage timing calculation method, and recording medium for recording program
CN111583175B (zh) 一种红细胞图像检测方法及设备、介质
JP5800234B2 (ja) 微細藻類濃度決定方法
CN110060223B (zh) 一种基于特征提取及去噪的图像分割方法
CN120894286A (zh) 一种基于图像视觉识别的发泡硅橡胶表面检测方法
CN107945128A (zh) 一种基于Retinex的彩色图像增强方法
WO2020075635A1 (ja) 画像処理装置、画像処理方法、プログラム、及び評価方法
JP6819445B2 (ja) 情報処理装置、制御方法、及びプログラム
JP2013009700A (ja) 頭髪撮影画像のデータ処理方法およびデータ比較方法
CN109360189A (zh) 检测非制冷红外机芯图像像素缺陷点的方法
CN111083468B (zh) 一种基于图像梯度的短视频质量评价方法及系统
RU2420593C2 (ru) Способ анализа клеточных структур и их компонентов
WO2023008525A1 (ja) 細胞画像解析方法
US20240233089A1 (en) Image processing method and image processing apparatus
JP2021099250A (ja) 吸水状態評価装置及び吸水状態評価方法
CN112819795B (zh) 基于多色荧光图片的细胞数量和面积的统计方法
CN111126259A (zh) 细胞融合度计算方法、装置、计算机设备及存储介质
CN110633065B (zh) 一种图像调整方法及装置、计算机可读存储介质
Dong et al. Automatic segmentation for ovarian cancer immunohistochemical image based on yuv color space
JPWO2020075635A5 (https=)
Verma et al. Underwater Vision Enhancement: Adaptive White Balancing Combined with Nature-Inspired Algorithm Mechanisms

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 19871996

Country of ref document: EP

Kind code of ref document: A1

ENP Entry into the national phase

Ref document number: 2020551099

Country of ref document: JP

Kind code of ref document: A

NENP Non-entry into the national phase

Ref country code: DE

ENP Entry into the national phase

Ref document number: 2019871996

Country of ref document: EP

Effective date: 20210512