CN110706237A - Diaminobenzidine separation and evaluation method based on YCbCr color space - Google Patents

Diaminobenzidine separation and evaluation method based on YCbCr color space Download PDF

Info

Publication number
CN110706237A
CN110706237A CN201910843772.4A CN201910843772A CN110706237A CN 110706237 A CN110706237 A CN 110706237A CN 201910843772 A CN201910843772 A CN 201910843772A CN 110706237 A CN110706237 A CN 110706237A
Authority
CN
China
Prior art keywords
image
crb
cbr
color space
diaminobenzidine
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201910843772.4A
Other languages
Chinese (zh)
Other versions
CN110706237B (en
Inventor
刘净心
郭滟
王晶
左彦飞
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Hengdao Zhizao Technology (Changxing) Co.,Ltd.
Original Assignee
Shanghai Hengdao Medical Pathological Diagnosis Center Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shanghai Hengdao Medical Pathological Diagnosis Center Co Ltd filed Critical Shanghai Hengdao Medical Pathological Diagnosis Center Co Ltd
Priority to CN201910843772.4A priority Critical patent/CN110706237B/en
Publication of CN110706237A publication Critical patent/CN110706237A/en
Application granted granted Critical
Publication of CN110706237B publication Critical patent/CN110706237B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/10Segmentation; Edge detection
    • G06T7/11Region-based segmentation
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T3/00Geometric image transformations in the plane of the image
    • G06T3/04Context-preserving transformations, e.g. by using an importance map
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/10Image acquisition modality
    • G06T2207/10024Color image

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Sampling And Sample Adjustment (AREA)
  • Investigating Or Analysing Biological Materials (AREA)
  • Spectrometry And Color Measurement (AREA)

Abstract

A diaminobenzidine separation and evaluation method based on YCbCr color space comprises the following implementation steps: s1, acquiring a picture; s2, converting into a color space; s3, generating a Crb or Cbr chromaticity difference picture; s4, setting a bias value; s5, extracting symbol information; s6, performing morphological processing on the information in the step S5; s7, generating a final image; the adopted YCbCr color space is most consistent with the color composition essence of diaminobenzidine and hematoxylin dyeing, and a positive dyeing area can be separated more accurately; the final image generated by the method can be used for quantitatively describing the dyeing degree; with this method, higher separation accuracy can be obtained than with the conventional method.

Description

Diaminobenzidine separation and evaluation method based on YCbCr color space
Technical Field
The invention relates to the technical field of computer-assisted immunohistochemical staining, in particular to a diaminobenzidine separation and evaluation method based on a YCbCr color space.
Background
Immunohistochemistry is a very powerful target antigen detection method, and immunohistochemical digital images are three-dimensional data consisting of three color channels of red, green and blue (RGB). The computer aided diagnosis tool needs to segment the positive staining pixels from the three-dimensional image to the maximum extent through a mathematical algorithm and mark the staining degree, so that the target antigen tissue can be seen under an optical microscope through staining. The reliability and versatility of immunohistochemistry, which makes it widely used in clinical diagnosis and basic research, diaminobenzidine, one of the most commonly used dyes in immunohistochemistry, can stain target tissues with tan (positive staining) to distinguish it from blue (negative staining) caused by background and hematoxylin stain, and for immunohistochemical staining pathological images stained with hematoxylin-diaminobenzidine (H-DAB), quantitative analysis of the distribution and staining intensity of positive staining (DAB) can be used for biomarker localization or immunoreaction scoring, which is of great significance in clinical medicine, however, currently used methods are based on manual semi-quantitative evaluation of positive staining area and intensity, such as a color deconvolution method, a blue normalization method, a method of performing mathematical transformation on an original image matrix to perform positive staining separation, and the like, the methods have extremely poor segmentation effect on the severe positive staining, are troublesome to adjust on different databases, or can generate pictures which can not give quantitative description of staining concentration and are time-consuming and subject to subjective errors, so that the method is particularly important for accurately separating and evaluating the staining by adopting a computer algorithm.
The present invention is an improvement to solve the above problems.
Disclosure of Invention
The technical problem to be solved by the invention is to provide a method for separating and evaluating diaminobenzidine based on YCbCr color space, which aims at the characteristics that the dyeing degree span of diaminobenzidine is too large and the scattering frequency spectrum is too wide, adopts a multi-threshold technology based on brightness to improve the separation effect, and uses a brightness assignment method to enable the final picture to quantitatively describe the dyeing degree.
The technical scheme adopted by the invention for solving the technical problem is as follows:
a diaminobenzidine separation and evaluation method based on YCbCr color space comprises the following implementation steps:
s1, acquiring a picture, loading the original picture, and acquiring a red, green and blue (RGB) three-channel image matrix of the picture;
s2, converting the image matrix in the step S1 into a YCbCr three-channel image matrix;
s3, generating a Crb or Cbr chromaticity difference picture, obtaining the Crb or Cbr chromaticity difference picture through the chromaticity component of the three-dimensional matrix in the step S2, and then separating a positive dyeing area;
s4, setting a bias value, equally dividing Crb or Cbr according to the brightness component channel value n, and adding a bias value alpha to each interval;
s5, extracting symbol information, and extracting symbol information of a Crb or Cbr image matrix;
s6, performing morphological processing on the information in the step S5;
s7, generating a final image, and finally obtaining an image matrix according to the information obtained in the step S6;
further, the color space is YCbCr;
further, the conversion formula for converting the image matrix into the three-dimensional matrix in step S2 is as follows:
Y=(0.299×R+0.587×G+0.114×B)/255
Cb=(-0.168736×R+0.331264×G+0.5×B)/255
Cr=(0.5×R-0.418688×G-0.081312×B)/255。
where Y is the luminance component and Cb and Cr are the chrominance components;
y ranges from 0 to 1, Cb and Cr are respectively a blue excursion and a red excursion, and the ranges are-0.5 to 0.5;
in the step S3, a Crb or Cbr chrominance difference image is obtained through information of two color channels Cb and Cr;
specifically, the formula for separating the positive dyeing region in step S3 is as follows:
Crb(x,y)=Cr(x,y)-Cb(x,y)or Cbr(x,y)=Cb(x,y)-Cr(x,y)
Wherein (x, y) is a two-dimensional coordinate of an image pixel, and the value range of the Crb or Cbr image is-1 to 1;
wherein, the formula of the separated positive dyeing area after the bias value is set in the step S4 is as follows:
Crbi (x,y)=Cri (x,y)-Cbi (x,y)i1, 2, n or
Cbri (x,y)=Cbi (x,y)-Cri (x,y)ii=1,2…,n;
The symbol separation information extracted from the Crb image matrix in step S5 is a binary segmentation result obtained from the chrominance difference, and the formula is as follows:
Figure BDA0002194531300000031
or
Figure BDA0002194531300000032
In step S6, morphological processing is performed on the binary segmentation result, and the implementation steps include:
y1, opening operation, namely, firstly performing corrosion operation and then performing expansion operation to eliminate tiny non-tissue pixels which are not related to evaluation in the image;
y2, closing operation, namely, firstly performing expansion operation and then performing corrosion operation to fill up fine cavity noise generated by a positive image of a cell nucleus;
the sign separation information sign (crb) obtained in step S7 is multiplied by the inverted Y value to obtain a final sepia-blue (BB) image matrix, which has the formula:
Figure BDA0002194531300000041
converting an original red, green and blue picture matrix into a YCbCr color space, and obtaining a chromaticity difference image by subtracting a Cb channel from a Cr channel; different bias values are applied according to a mode of equally dividing Y channels, so that positive and negative stains are accurately separated. The method can effectively solve the problem that the dyeing degree span of the diaminobenzidine is too large, so that the scattering spectrum is too wide and the separation is difficult; the pictures that have been separated in terms of chroma are assigned information of the luminance channel, so that the degree of staining of the positive stain can be quantitatively evaluated.
The invention has the advantages that: the YCbCr color space adopted by the invention is most consistent with the color composition essence of diaminobenzidine and hematoxylin dyeing, and can more accurately separate a positive dyeing area; the final image generated by the method can be used for quantitatively describing the dyeing degree; with this method, higher separation accuracy can be obtained than with the conventional method.
Drawings
Fig. 1 shows the distribution of pixel points in Crb and luminance two-dimensional space in the YCbCr color space-based diaminobenzidine separation and evaluation method.
Detailed Description
In order to make the technical means, the original characteristics, the achieved purposes and the effects of the invention easy to understand, the invention is further described with reference to the figures and the specific embodiments.
Referring to fig. 1, the method for separating and evaluating diaminobenzidine based on YCbCr color space is implemented by the following steps:
s1, acquiring a picture, loading the original picture, acquiring a three-dimensional image matrix of the picture, and acquiring a three-dimensional image matrix described by a red, green and blue color channel;
s2, converting the image matrix in the step S1 into a three-dimensional matrix, and converting the acquired original image matrix into YCbC by using the ITU-R BT.601 standard or the ITU-R BT.2020 standardrA three-dimensional matrix of color channel descriptions;
s3, generating a Crb or Cbr chromaticity difference image, obtaining the Crb or Cbr chromaticity difference image through the chromaticity component of the three-dimensional matrix in the step S2, and then separating a positive dyeing area;
s4, setting a bias value, equally dividing Crb or Cbr according to the brightness component channel value n, and adding a bias value alpha to each interval;
s5, extracting symbol information, and extracting symbol information of a Crb or Cbr image matrix;
s6, performing morphological processing on the information in the step S5;
s7, generating a final image, and finally obtaining an image matrix according to the information obtained in the step S6;
further, the color space is YCbCr
Further, the conversion formula for converting the image matrix into the three-dimensional matrix in step S2 is as follows:
Y=(0.299×R+0.587×G+0.114×B)/255
Cb=(-0.168736×R+0.331264×G+0.5×B)/255
Cr=(0.5×R-0.418688×G-0.081312×B)/255。
where Y is the luminance component and Cb and Cr are the chrominance components;
y ranges from 0 to 1, Cb and Cr are respectively a blue excursion and a red excursion, and the ranges are-0.5 to 0.5;
in the step S3, a Crb or Cbr chrominance difference image is obtained through information of two color channels Cb and Cr;
specifically, the formula for separating the positive dyeing region in step S3 is as follows:
Crb(x,y)=Cr(x,y)-Cb(x,y)or Cbr(x,y)=Cb(x,y)-Cr(x,y)
Wherein (x, y) is a two-dimensional coordinate of an image pixel, and the value range of the Crb or Cbr image is-1 to 1;
wherein, the formula of the separated positive dyeing area after the bias value is set in the step S4 is as follows:
Crbi (x,y)=Cri (x,y)-Cbi (x,y)i1, 2, n or
Cbri (x,y)=Cbi (x,y)-Cri (x,y)ii=1,2…,n.
The values of the equipartition value n and the bias value a are set by the pathologist from different databases. The set Crb can correctly separate diaminobenzidine dyeing pixels through positive and negative values;
the symbol separation information extracted from the Crb image matrix in step S5 is a binary segmentation result obtained from the chrominance difference, and the formula is as follows:
Figure BDA0002194531300000061
or
Figure BDA0002194531300000062
The obtained binary image Sign (Crb)(x,y)) Can be used to calculate the positive staining ratio equating information of the whole image;
in step S6, morphological processing is performed on the binary segmentation result, and the implementation steps include:
y1, opening operation, namely, firstly performing corrosion operation and then performing expansion operation to eliminate tiny non-tissue pixels which are not related to evaluation in the image;
y2, closing operation, namely, firstly performing expansion operation and then performing corrosion operation to fill up fine cavity noise generated by a positive image of a cell nucleus;
the sign separation information sign (crb) obtained in step S7 is multiplied by the inverted Y value to obtain a final sepia-blue (BB) image matrix, which has the formula:
Figure BDA0002194531300000071
BB obtained(x,y)The image can be used for describing the positive staining intensity of the image, and a threshold value can be applied to the image to obtain the ratio of strong positive, medium positive and weak positive, the image matrix is assigned according to the staining degree of each pixel, and the numerical difference between positive staining and negative staining is enlarged according to the difference of brightness; high brightness background pixels will concentrate to values around 1. The BB image allows a quantitative description of the degree of positive staining.
Converting an original red, green and blue picture matrix into a YCbCr color space, and obtaining a chromaticity difference image by subtracting a Cb channel from a Cr channel; different bias values are applied according to a mode of equally dividing Y channels, so that positive and negative stains are accurately separated. The method can effectively solve the problem that the dyeing degree span of the diaminobenzidine is too large, so that the scattering spectrum is too wide and the separation is difficult; the pictures that have been separated in terms of chroma are assigned information of the luminance channel, so that the degree of staining of the positive stain can be quantitatively evaluated.
The YCbCr color space adopted by the invention is most consistent with the color composition essence of diaminobenzidine and hematoxylin dyeing, and can more accurately separate a positive dyeing area; the final image generated by the method can be used for quantitatively describing the dyeing degree; with this method, higher separation accuracy can be obtained than with the conventional method.
It is evident from fig. 1 that the Crb value effectively separates the brownish and blue colors.
The foregoing shows and describes the general principles, essential features, and advantages of the invention. It will be understood by those skilled in the art that the present invention is not limited to the embodiments described above, which are given by way of illustration of the principles of the present invention, and that various changes and modifications may be made without departing from the spirit and scope of the invention as defined by the appended claims. The scope of the invention is defined by the appended claims and equivalents thereof.

Claims (10)

1. A diaminobenzidine separation and evaluation method based on YCbCr color space is characterized in that: the method comprises the following implementation steps:
s1, acquiring a picture, loading the original picture, and acquiring a red, green and blue (RGB) three-channel image matrix of the picture;
s2, converting the image matrix in the step S1 into a YCbCr three-channel image matrix;
s3, generating a Crb or Cbr chromaticity difference picture, obtaining the Crb or Cbr chromaticity difference picture through the chromaticity component of the three-dimensional matrix in the step S2, and then separating a positive dyeing area;
s4, setting a bias value, equally dividing Crb or Cbr according to the brightness component channel value n, and adding a bias value alpha to each interval;
s5, extracting symbol information, namely extracting symbol information of a Crb or Cbr image matrix to obtain a dyeing separated binary result image;
s6, performing morphological processing on the information in the step S5;
and S7, generating a final image, and finally obtaining an image matrix according to the information obtained in the step S6.
2. The method as claimed in claim 1, wherein the color space is YCbCr.
3. The method for separating and evaluating diaminobenzidine based on YCbCr color space of claim 1, wherein the conversion formula of the image matrix into three-dimensional matrix in step S2 is:
Y=(0.299×R+0.587×G+0.114×B)/255
Cb=(-0.168736×R+0.331264×G+0.5×B)/255
Cr=(0.5×R-0.418688×G-0.081312×B)/255。
where Y is the luminance component and Cb and Cr are the chrominance components.
4. The method of claim 3 wherein Y ranges from 0 to 1, Cb and Cr are blue and red shifts, respectively, each ranging from-0.5 to 0.5.
5. The method as claimed in claim 3, wherein the Crb or Cbr chroma difference image is obtained from the information of the Cb and Cr color channels in step S3.
6. The method for separating and evaluating diaminobenzidine based on YCbCr color space of claim 5, wherein the formula for separating positive staining area in step S3 is:
Crb(x,y)=Cr(x,y)-Cb(x,y)or Cbr(x,y)=Cb(x,y)-Cr(x,y)
Wherein (x, y) is the two-dimensional coordinates of the image pixel, and the value range of the Crb or Cbr image is-1 to 1.
7. The method for separating and evaluating diaminobenzidine based on YCbCr color space of claim 6, wherein the formula of the separated positive staining area after setting bias value in step S4 is:
Crbi (x,y)=Cri (x,y)-Cbi (x,y)i1, 2, n or
Cbri (x,y)=Cbi (x,y)-Cri (x,y) +αii=1,2...,n。
8. The method as claimed in claim 1, wherein the sign separation information extracted from the Crb image matrix in step S5 is a binary segmentation result obtained from the chrominance difference, and is expressed as:
Figure FDA0002194531290000021
or
Figure FDA0002194531290000022
9. The method as claimed in claim 8, wherein the step S6 is performed by morphological processing on the binary segmentation result, and the method comprises the steps of:
y1, opening operation, namely, firstly performing corrosion operation and then performing expansion operation to eliminate tiny non-tissue pixels which are not related to evaluation in the image;
y2, close operation, namely expansion operation and corrosion operation, to fill in the tiny hole noise generated by the positive image of the cell nucleus.
10. The method as claimed in claim 8, wherein the sign separation information sign (crb) obtained from the processing in step S7 is multiplied by the inverted Y value to obtain a final sepia-blue (BB) image matrix, which is expressed by the following formula:
Figure FDA0002194531290000031
CN201910843772.4A 2019-09-06 2019-09-06 Diamino benzidine separation and evaluation method based on YCbCr color space Active CN110706237B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201910843772.4A CN110706237B (en) 2019-09-06 2019-09-06 Diamino benzidine separation and evaluation method based on YCbCr color space

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201910843772.4A CN110706237B (en) 2019-09-06 2019-09-06 Diamino benzidine separation and evaluation method based on YCbCr color space

Publications (2)

Publication Number Publication Date
CN110706237A true CN110706237A (en) 2020-01-17
CN110706237B CN110706237B (en) 2023-06-06

Family

ID=69194444

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201910843772.4A Active CN110706237B (en) 2019-09-06 2019-09-06 Diamino benzidine separation and evaluation method based on YCbCr color space

Country Status (1)

Country Link
CN (1) CN110706237B (en)

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2008172677A (en) * 2007-01-15 2008-07-24 Murata Mach Ltd Image processor and ground color detection method
US20110090381A1 (en) * 2009-10-20 2011-04-21 Apple Inc. System and method for processing image data using an image processing pipeline of an image signal processor
CN102096823A (en) * 2011-02-12 2011-06-15 厦门大学 Face detection method based on Gaussian model and minimum mean-square deviation
CN104200428A (en) * 2014-08-18 2014-12-10 南京信息工程大学 Microscopic image color convolution removal method and cutting method based on non-negative matrix factorization (NMF)
CN107622502A (en) * 2017-07-28 2018-01-23 南京航空航天大学 The path extraction of robot vision leading system and recognition methods under the conditions of complex illumination
CN107705336A (en) * 2017-04-15 2018-02-16 北京航空航天大学 A kind of pathological image staining components adjusting method
CN107944359A (en) * 2017-11-14 2018-04-20 中电数通科技有限公司 Flame detecting method based on video
CN109635711A (en) * 2018-12-07 2019-04-16 上海衡道医学病理诊断中心有限公司 A kind of pathological image dividing method based on deep learning network

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2008172677A (en) * 2007-01-15 2008-07-24 Murata Mach Ltd Image processor and ground color detection method
US20110090381A1 (en) * 2009-10-20 2011-04-21 Apple Inc. System and method for processing image data using an image processing pipeline of an image signal processor
CN102096823A (en) * 2011-02-12 2011-06-15 厦门大学 Face detection method based on Gaussian model and minimum mean-square deviation
CN104200428A (en) * 2014-08-18 2014-12-10 南京信息工程大学 Microscopic image color convolution removal method and cutting method based on non-negative matrix factorization (NMF)
CN107705336A (en) * 2017-04-15 2018-02-16 北京航空航天大学 A kind of pathological image staining components adjusting method
CN107622502A (en) * 2017-07-28 2018-01-23 南京航空航天大学 The path extraction of robot vision leading system and recognition methods under the conditions of complex illumination
CN107944359A (en) * 2017-11-14 2018-04-20 中电数通科技有限公司 Flame detecting method based on video
CN109635711A (en) * 2018-12-07 2019-04-16 上海衡道医学病理诊断中心有限公司 A kind of pathological image dividing method based on deep learning network

Non-Patent Citations (3)

* Cited by examiner, † Cited by third party
Title
ALWASEELA ABDALLA等: "Infield oilseed rape images segmentation via improved unsupervised learning models combined with supreme color features", 《COMPUTERS AND ELECTRONICS IN AGRICULTURE》 *
刘敦浩等: "动态环境下自适应阈值分割方法", 《计算机应用》 *
王寻等: "基于肤色及改进的Adaboost算法的人脸检测", 《电子科技》 *

Also Published As

Publication number Publication date
CN110706237B (en) 2023-06-06

Similar Documents

Publication Publication Date Title
Ganesan et al. Segmentation and edge detection of color images using CIELAB color space and edge detectors
JP4504203B2 (en) Scoring of estrogen and progesterone expressions based on image analysis
JP4376058B2 (en) Quantitative video microscopy and related systems and computer software program products
CN107123088B (en) A kind of method of automatic replacement photo background color
US8559714B2 (en) Post processing for improved generation of intrinsic images
CN108320289B (en) Bone marrow cell segmentation method based on sparse representation and morphological operation
Murakami et al. Color correction for automatic fibrosis quantification in liver biopsy specimens
CN111310768B (en) Saliency target detection method based on robustness background prior and global information
CN104504722A (en) Method for correcting image colors through gray points
CN104021566A (en) GrabCut algorithm-based automatic segmentation method of tongue diagnosis image
CN107545550A (en) Cell image color cast correction
CN105761292A (en) Image rendering method based on color shift and correction
Joze et al. White patch gamut mapping colour constancy
CN114511567B (en) Tongue body and tongue coating image identification and separation method
Ortiz-Jaramillo et al. Evaluating color difference measures in images
CN109064490B (en) Moving target tracking method based on MeanShift
CN112184696B (en) Cell nucleus and organelle counting and area calculating method and system thereof
Dong et al. Automatic segmentation for ovarian cancer immunohistochemical image based on YUV color space
Mukherjee et al. Grayscale conversion of histopathological slide images as a preprocessing step for image segmentation
US8428352B1 (en) Post processing for improved generation of intrinsic images
Jin et al. A quaternion gradient operator for color image edge detection
Pang et al. Self-similarity-based image colorization
CN110706237A (en) Diaminobenzidine separation and evaluation method based on YCbCr color space
CN106780379A (en) The microscopical colour-image reinforcing method of one kind metering
Mohammed et al. Segmentation of acute lymphoblastic leukemia using CY color space

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant
TR01 Transfer of patent right

Effective date of registration: 20240509

Address after: 313199 2A, Building 11, National University Science Park, No. 669 High speed Railway, the Taihu Lake Street, Changxing County, Huzhou City, Zhejiang Province

Patentee after: Hengdao Zhizao Technology (Changxing) Co.,Ltd.

Country or region after: China

Address before: 201900 8th floor, building 2, No. 300 Yuankang Road, Baoshan District, Shanghai

Patentee before: SHANGHAI HISTO MEDICAL PATHOLOGY CENTER Co.,Ltd.

Country or region before: China

TR01 Transfer of patent right