CN111007020B - Double-frame four-spectrum imaging method and application - Google Patents
Double-frame four-spectrum imaging method and application Download PDFInfo
- Publication number
- CN111007020B CN111007020B CN201911332938.2A CN201911332938A CN111007020B CN 111007020 B CN111007020 B CN 111007020B CN 201911332938 A CN201911332938 A CN 201911332938A CN 111007020 B CN111007020 B CN 111007020B
- Authority
- CN
- China
- Prior art keywords
- color
- frame
- channel
- color channel
- image
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N21/00—Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
- G01N21/17—Systems in which incident light is modified in accordance with the properties of the material investigated
- G01N21/25—Colour; Spectral properties, i.e. comparison of effect of material on the light at two or more different wavelengths or wavelength bands
- G01N21/255—Details, e.g. use of specially adapted sources, lighting or optical systems
Abstract
The invention relates to a double-frame four-spectrum imaging method and application, wherein the method specifically comprises the following steps: the method comprises the steps that after a color COMS camera is focused and is static, a light source is switched in sequence to capture two frames of images, wherein white light is used for superposing an RGB three-channel optical filter when a first frame of image is obtained, and RGB color channel images are correspondingly obtained; and correspondingly acquiring a Y-channel color image by using a white light superposition yellow filter when acquiring the second frame image. According to the double-frame four-spectrum imaging method, the light sources are switched, so that the color COMS camera can successively acquire RGB and Y color channel spectrum imaging during double-frame shooting, the dependence on the light sources is weaker compared with a time-sharing multispectral imaging system, only two light sources are needed, the cost is reduced, and compared with the existing area array gray scale CMOS camera, the RGBY four-spectrum imaging method is adopted, the image capturing time is shorter, and the image transmission requirement is low; the obtained four-channel spectrum is used for cell detection, and the problem that the reliability and effectiveness of the existing manual detection result are difficult to guarantee is solved.
Description
Technical Field
The invention relates to the technical field of image processing, in particular to a double-frame four-spectrum imaging method and application.
Background
Malignant lesions of epithelial cells are the most common lesions, and are pathologically usually stained specifically using exfoliated cytology, and then morphologically completed by means of microscopic images of manually examined sample smears or examined by computer image processing techniques.
The manual detection method has the advantages of simple equipment, easy operation and low cost, and is the main means for diagnosing the malignant lesion of the epithelial cells at present. However, the manual method is time-consuming and labor intensity of the inspection personnel is high, so that reliability and effectiveness of the manual inspection result are difficult to guarantee.
Because of low efficiency of artificial morphological analysis, the cell smear is automatically classified and identified based on expert knowledge from the morphological perspective by combining with the relevant knowledge of subjects such as digital image processing, pattern recognition and computer vision, so as to realize early diagnosis of malignant lesion of epithelial cells. However, the existing time-sharing multispectral imaging system is generally adopted, the dependence on a light source is strong, and the light source is easy to damage and has high cost. Or an area array gray CMOS camera is used for simultaneously capturing images of four color channels, the image capturing time is long, and the image transmission requirement is high.
Disclosure of Invention
In order to overcome the defects in the prior art, the invention provides a double-frame four-spectrum imaging method, which can solve the problems that the existing time-sharing multi-spectrum imaging system has stronger dependence on a light source and the light source is easy to damage and has higher cost, and can also solve the technical problems that an area-array gray-scale CMOS camera consumes long time and has high image transmission requirement when capturing four color channels.
The invention is realized by the following technical scheme:
the double-frame four-spectrum imaging method specifically comprises the following steps:
the method comprises the steps that after a color COMS camera is focused and is static, a light source is switched in sequence to capture two frames of images, wherein white light is used for superposing an RGB three-channel optical filter when a first frame of image is obtained, and RGB color channel images are correspondingly obtained; and correspondingly acquiring a Y-channel color image by using a white light superposition yellow filter when acquiring the second frame image.
Furthermore, the two frames of images captured by the color COMS camera are both RAW format images, and the pixel points of the two frames of images are consistent.
Further, the RGB triple channel filter used for obtaining the first frame image is BP467-525 and 625 triple channel filter.
Further, the first frame image captured by the color COMS camera is converted into a BMP image in a BGR24 bit format by a convertBGR function, and three images of R, G, B color channels in a complete format are calculated by linear interpolation.
Further, at the 575nm wave band, the brightness of the light source is adjusted to make the brightness value of the image of the yellow light acquired by the GR color channel of the camera consistent with the brightness acquired by the RGB light source, and the response of the yellow light provided by the B color channel is calculated through an interpolation algorithm.
Further, the specific interpolation process for calculating the response of yellow light provided by the B color channel is as follows: and expanding the response of the G color channel at 575nm to the value same as the main peak of the G color channel, interpolating an R color channel by using the G color channel, and interpolating a B color channel by combining the RG two channels.
Further, the method for interpolating the R color channel on the G color channel is as follows: in the second frame image, averaging the nearest colors around the G channel pixel points to calculate R, and then calculating the response of the corresponding B color channel by using the average value of the GR color channel.
The application of the double-frame four-spectrum imaging method comprises the steps of obtaining RGBY four-channel color images by the double-frame four-spectrum imaging method, wherein the Y-channel color images are used for quantitatively calculating the nuclear DNA index, and other RGB three-channel color images are used for calculating the cell morphology.
Compared with the prior art, the invention has the beneficial effects that:
according to the double-frame four-spectrum imaging method, the light sources are switched, so that the color COMS camera can successively acquire RGB and Y color channel spectrum imaging during double-frame shooting, the cost is reduced compared with the time-sharing multi-spectrum imaging system which is weaker in dependence on the light sources and only needs two light sources, and compared with the current situation that the existing area array gray scale CMOS camera needs to capture four color channels and consumes long time, the RGBY four-spectrum imaging method is adopted, the image capture time is shorter, and the image transmission requirement is low; the obtained four-channel spectrum is used for cell detection, and the technical problem that the reliability and effectiveness of the existing manual detection result are difficult to guarantee is solved.
Drawings
FIG. 1 is a diagram of a color COMS camera according to an embodiment of the present invention for obtaining spectral images of RGB three color channels;
FIG. 2 is a diagram showing the effect of scanning an eosin Foregren stained slide using a two-frame four-spectrum imaging method according to an embodiment of the present invention;
FIG. 3 is a diagram showing the effect of scanning E6 and E7 hematoxylin stained slides by the two-frame four-spectrum imaging method according to the embodiment of the invention;
FIG. 4 is a diagram illustrating the effect of scanning a Foregren stained slide using a two-frame four-spectrum imaging method according to an embodiment of the present invention;
FIG. 5 is a graph showing the effect of scanning HE stained slides using a dual-frame four-spectrum imaging method according to an embodiment of the present invention.
Detailed Description
The following examples are presented to illustrate certain embodiments of the invention in particular and should not be construed as limiting the scope of the invention. The present disclosure may be modified from materials, methods, and reaction conditions at the same time, and all such modifications are intended to be within the spirit and scope of the present invention.
The double-frame four-spectrum imaging method specifically comprises the following steps: capturing two frames of images in RAW format by sequentially switching light sources after the color COMS camera is focused and is static, wherein a white light superposition BP467-525-625 three-channel optical filter is used for correspondingly obtaining RGB color channel images when a first frame of image is obtained, as shown in figure 1; and when a second frame of image is obtained, a white light superposition yellow filter is used for correspondingly obtaining a Y channel color image, and the pixel points of the two frames of images are consistent.
In this embodiment, the first frame image captured by the color COMS camera is converted into a BMP image in BGR24 bit format by using a convertBGR function, and three images of R, G, B color channels in full format are calculated by linear interpolation.
In this embodiment, when the color COMS camera acquires the second frame image, at the wavelength of 575nm, the brightness of the light source is adjusted so that the brightness value of the yellow light acquired at the GR color channel of the camera is consistent with the brightness acquired at the RGB light source, the response of the G color channel at 575nm is expanded to the same value as the main peak of the G color channel, then the nearest colors around the G channel pixel are averaged to calculate R, and then the GR color channel is used to calculate the response of the corresponding B color channel by averaging.
In this embodiment, an RGBY four-channel color image is obtained by a two-frame four-spectrum imaging method, where the Y-channel color image is used to quantitatively calculate the nuclear DNA index, and the other RGB three-channel color images are used to calculate the cell morphology.
The cells were stained using the existing cell staining method and made into standard slides by a liquid based cell slide machine, and slides of different staining types were scanned by the above-mentioned imaging method of the present application, such as: the image effect of the slides of eosin feulgen staining, E6, E7+ hematoxylin staining, feulgen staining and HE staining is shown in FIGS. 2-5.
In summary, by adopting the spectral imaging method, different light source soft trigger cameras are sequentially turned on for exposure, two frames of images are obtained, and R, G, B, Y four color channel images are respectively obtained by color interpolation calculation.
The above description is only an embodiment of the present invention, and not intended to limit the scope of the present invention, and all modifications of equivalent structures and equivalent processes, which are made by the present specification, or directly or indirectly applied to other related technical fields, are included in the scope of the present invention.
Claims (5)
1. The double-frame four-spectrum imaging method is characterized by comprising the following steps:
sequentially switching a light source to capture two frames of images after the color COMS camera is focused and is static, wherein white light is superposed with a BP467-525-625 three-channel optical filter when a first frame of image is obtained, and correspondingly obtaining RGB color channel images; and when a second frame image is acquired, at a wavelength of 575nm, the brightness of the light source is adjusted to enable the brightness value of the yellow light acquired at the GR color channel of the camera to be consistent with the brightness acquired at the RGB light source, and a white light superposition yellow filter is used, and the response of the yellow light provided at the B color channel is calculated through an interpolation algorithm to acquire a Y channel color image.
2. The dual-frame four-spectrum imaging method according to claim 1, wherein the two frames of images captured by the color COMS camera are both RAW format images, and the pixel points of the two frames of images are consistent.
3. The method as claimed in claim 2, wherein the first frame image captured by the color COMS camera is converted into BMP image in BGR24 bit format by convertBGR function, and three images of R, G, B color channels in full format are calculated by linear interpolation.
4. The dual-frame four-spectrum imaging method of claim 1, wherein the specific interpolation process for calculating the response of yellow light provided in the B color channel is as follows: and expanding the response of the G color channel at 575nm to the value same as the main peak of the G color channel, interpolating an R color channel by using the G color channel, and interpolating a B color channel by combining the RG two channels.
5. The dual-frame four-spectrum imaging method according to claim 4, wherein the method of interpolating the R color channel on the G color channel is: in the second frame image, averaging the nearest colors around the G channel pixel points to calculate R, and then calculating the response of the corresponding B color channel by using the average value of the GR color channel.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911332938.2A CN111007020B (en) | 2019-12-23 | 2019-12-23 | Double-frame four-spectrum imaging method and application |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911332938.2A CN111007020B (en) | 2019-12-23 | 2019-12-23 | Double-frame four-spectrum imaging method and application |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN111007020A CN111007020A (en) | 2020-04-14 |
| CN111007020B true CN111007020B (en) | 2021-10-08 |
Family
ID=70117586
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201911332938.2A Active CN111007020B (en) | 2019-12-23 | 2019-12-23 | Double-frame four-spectrum imaging method and application |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111007020B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111879791B (en) * | 2020-07-30 | 2023-06-20 | 西湖大学 | Machine vision system and method for enhancing raised features on pattern surface |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2009168975A (en) * | 2008-01-15 | 2009-07-30 | Seiko Epson Corp | Image processing method, image processor, and image processing program |
| CN103698009A (en) * | 2013-12-25 | 2014-04-02 | 北京农业智能装备技术研究中心 | Multispectral image acquiring method and system on basis of line scanning hyperspectral imaging |
| CN108051376A (en) * | 2017-12-12 | 2018-05-18 | 中国地质大学（武汉） | A kind of spectrum reconstruction method based on RGB color camera image |
| CN108378825A (en) * | 2018-03-23 | 2018-08-10 | 张栋 | A kind of medical four colors multispectral imaging method and apparatus that black and white one camera is realized |
| CN108965654A (en) * | 2018-02-11 | 2018-12-07 | 浙江宇视科技有限公司 | Double spectrum camera systems and image processing method based on single-sensor |
| CN110503690A (en) * | 2018-05-16 | 2019-11-26 | 南京大学 | A kind of two-way camera alignment schemes of EO-1 hyperion video acquisition system |
-
2019
- 2019-12-23 CN CN201911332938.2A patent/CN111007020B/en active Active
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2009168975A (en) * | 2008-01-15 | 2009-07-30 | Seiko Epson Corp | Image processing method, image processor, and image processing program |
| CN103698009A (en) * | 2013-12-25 | 2014-04-02 | 北京农业智能装备技术研究中心 | Multispectral image acquiring method and system on basis of line scanning hyperspectral imaging |
| CN108051376A (en) * | 2017-12-12 | 2018-05-18 | 中国地质大学（武汉） | A kind of spectrum reconstruction method based on RGB color camera image |
| CN108965654A (en) * | 2018-02-11 | 2018-12-07 | 浙江宇视科技有限公司 | Double spectrum camera systems and image processing method based on single-sensor |
| CN108378825A (en) * | 2018-03-23 | 2018-08-10 | 张栋 | A kind of medical four colors multispectral imaging method and apparatus that black and white one camera is realized |
| CN110503690A (en) * | 2018-05-16 | 2019-11-26 | 南京大学 | A kind of two-way camera alignment schemes of EO-1 hyperion video acquisition system |
Also Published As
| Publication number | Publication date |
|---|---|
| CN111007020A (en) | 2020-04-14 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US9224193B2 (en) | Focus stacking image processing apparatus, imaging system, and image processing system | |
| EP2943761B1 (en) | Multispectral imaging system and methods | |
| CN110322522B (en) | Vehicle color recognition method based on target recognition area interception | |
| US10453195B2 (en) | Method of detecting tissue area of interest in digital pathology imaging by executing computer-executable instructions stored on a non-transitory computer-readable medium | |
| JP5675419B2 (en) | Image generating apparatus and image generating method | |
| US9404850B2 (en) | Microscope system, image processing apparatus, and computer readable recording medium | |
| CA2473848A1 (en) | Method for quantitative video-microscopy and associated system and computer software program product | |
| JP2008539763A (en) | Image analysis method based on chromogen separation | |
| JP2016527549A (en) | Autofocus method and system for multispectral imaging | |
| US9438768B2 (en) | Image processing apparatus, image reading apparatus, image processing method and information storage medium | |
| US11467387B2 (en) | Image processing apparatus and image processing method | |
| CN102279050A (en) | Method and system for reconstructing multi-spectral calculation | |
| Bautista et al. | Improving the visualization and detection of tissue folds in whole slide images through color enhancement | |
| CN106558044B (en) | Method for measuring resolution of image module | |
| CN102404581A (en) | Color image processing method and device based on interpolation and near infrared | |
| CN111007020B (en) | Double-frame four-spectrum imaging method and application | |
| Wang et al. | A novel low rank smooth flat-field correction algorithm for hyperspectral microscopy imaging | |
| CN116883323A (en) | Multiple immunofluorescence image analysis system based on computer vision | |
| CN106462964B (en) | Method and digital microscope for being split to color image | |
| CN110726536B (en) | Color correction method for color digital reflection microscope | |
| CN113936017A (en) | Image processing method and device | |
| KR101293728B1 (en) | Detecting method of wounded portion of skin and the recorded medium thereof | |
| CN116593452A (en) | Food safety detection method, system and medium | |
| CN115100035A (en) | Image processing method and device with pixel-level noise correction combined with demosaicing | |
| JP3265464B2 (en) | Sample evaluation method and apparatus using microscopic images |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |