WO2025006041A1 - Method for developing tissue-specific color chart - Google Patents

Method for developing tissue-specific color chart Download PDF

Info

Publication number
WO2025006041A1
WO2025006041A1 PCT/US2024/025608 US2024025608W WO2025006041A1 WO 2025006041 A1 WO2025006041 A1 WO 2025006041A1 US 2024025608 W US2024025608 W US 2024025608W WO 2025006041 A1 WO2025006041 A1 WO 2025006041A1
Authority
WO
WIPO (PCT)
Prior art keywords
tissue
color space
cie
gamut
predetermined color
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/US2024/025608
Other languages
French (fr)
Inventor
Young Kim
Sang Mok PARK
Yuhyun Ji
Semin KWEON
Jungwoo Leem
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Purdue Research Foundation
Original Assignee
Purdue Research Foundation
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Purdue Research Foundation filed Critical Purdue Research Foundation
Publication of WO2025006041A1 publication Critical patent/WO2025006041A1/en
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/90Determination of colour characteristics
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/0033Features or image-related aspects of imaging apparatus, e.g. for MRI, optical tomography or impedance tomography apparatus; Arrangements of imaging apparatus in a room
    • A61B5/004Features or image-related aspects of imaging apparatus, e.g. for MRI, optical tomography or impedance tomography apparatus; Arrangements of imaging apparatus in a room adapted for image acquisition of a particular organ or body part
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/0059Measuring for diagnostic purposes; Identification of persons using light, e.g. diagnosis by transillumination, diascopy, fluorescence
    • A61B5/0077Devices for viewing the surface of the body, e.g. camera, magnifying lens
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/145Measuring characteristics of blood in vivo, e.g. gas concentration or pH-value ; Measuring characteristics of body fluids or tissues, e.g. interstitial fluid or cerebral tissue
    • A61B5/1455Measuring characteristics of blood in vivo, e.g. gas concentration or pH-value ; Measuring characteristics of body fluids or tissues, e.g. interstitial fluid or cerebral tissue using optical sensors, e.g. spectral photometrical oximeters
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/0002Inspection of images, e.g. flaw detection
    • G06T7/0012Biomedical image inspection
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B2560/00Constructional details of operational features of apparatus; Accessories for medical measuring apparatus
    • A61B2560/02Operational features
    • A61B2560/0242Operational features adapted to measure environmental factors, e.g. temperature, pollution
    • A61B2560/0247Operational features adapted to measure environmental factors, e.g. temperature, pollution for compensation or correction of the measured physiological value
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/44Detecting, measuring or recording for evaluating the integumentary system, e.g. skin, hair or nails
    • A61B5/441Skin evaluation, e.g. for skin disorder diagnosis
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/10Image acquisition modality
    • G06T2207/10024Color image
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/20Special algorithmic details
    • G06T2207/20081Training; Learning
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/30Subject of image; Context of image processing
    • G06T2207/30004Biomedical image processing
    • G06T2207/30041Eye; Retina; Ophthalmic
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N1/00Scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission; Details thereof
    • H04N1/46Colour picture communication systems
    • H04N1/56Processing of colour picture signals
    • H04N1/60Colour correction or control
    • H04N1/603Colour correction or control controlled by characteristics of the picture signal generator or the picture reproducer
    • H04N1/6033Colour correction or control controlled by characteristics of the picture signal generator or the picture reproducer using test pattern analysis
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N9/00Details of colour television systems
    • H04N9/64Circuits for processing colour signals

Definitions

  • TECHNICAL FIELD [0003] The present disclosure generally relates to developing color standard or reference charts and specifically for developing color charts for diagnostic applications.
  • BACKGROUND [0004] This section introduces aspects that may help facilitate a better understanding of the disclosure. Accordingly, these statements are to be read in this light and are not to be understood as admissions about what is or is not prior art.
  • a photograph can provide diagnostic information beyond a mere visual representation. The primary challenge is to achieve color accuracy, which is referred to as the ability to define standardized colors of a sample and accurately detect them across diverse photo acquisition settings. Photographs acquired using a digital camera exhibit detrimental variations in colors, depending on device models, light conditions, and file formats.
  • Color correction and calibration computations with a limited number of reference colors are prone to random and systematic errors (e.g., Gaussian, impulse, photon, or speckle noise) in a variety of photo acquisitions. Incorporating more reference colors allows us to use advanced machine learning techniques that can outperform the conventional computations.
  • regression-based color correction computations also known as lookup table and interpolation
  • machine vision require manual fine-tuning, depending on photo acquisition settings.
  • FIG.1A wherein representative digital photos of biological tissue (e.g., palpebral conjunctiva) captured under five various white-light PRF-70251-02 illumination conditions are provided including LEDs with color temperature of 3000 K, 4300 K, and 5800 K as well as fluorescent tube light.
  • Color accuracy in diagnostic photography refers to the ability to detect the absolute colors across various photo acquisition settings.
  • a digital trichromatic camera three-color image sensor
  • RGB red-green-blue
  • spectral response functions also known as the spectral sensitivity
  • model-specific RGB spectral response functions lead to device-dependent color mapping of several popular low- and high-end smartphones with ANDROID and iOS operating systems including APPLE iPHONE 12 PRO, APPLE iPHONE SE, SAMSUNG GALAXY S21, and SAMSUNG GALAXY A52.
  • the RGB spectral responses of smartphone cameras exhibit significant model-specific variations as shown in FIGs. 1C and 1D, resulting in notoriously device-dependent RGB color values. From an illumination standpoint, different types of white light sources have distinct spectral profiles in otherwise grossly white-appearing light conditions as shown in FIGs.1E and 1F.
  • the method includes using a mathematical relationship associated with a tissue of interest expressing a relationship between intensity as a function of wavelength, the received mathematical relationship having a plurality of parameters each with an established range, synthesizing a plurality of synthesized spectra based on the mathematical relationship, converting each of the plurality of synthesized spectra to a predetermined color space under a predetermined illuminant , thereby generating a digital tissue- specific gamut, identifying a plurality of digital gamut points within the digital tissue-specific gamut based on a predetermined criterion, and printing a tissue-specific gamut based on the digital tissue-specific gamut thus establishing a ground truth color chart having a plurality of color patches, whereby each of the plurality of digital gamut points corresponds to an associated printed color patch using a predetermined printing calibration.
  • the predetermined illuminant is International Commission on Illumination (CIE) illuminant E.
  • CIE International Commission on Illumination
  • the plurality of types of tissue includes palpebral conjunctiva.
  • the tissue of interest includes skin.
  • the tissue of interest includes teeth.
  • the tissue of interest includes tongue.
  • the tissue of interest includes eye.
  • the tissue of interest includes bulbar conjunctiva.
  • tissue of interest includes whole blood.
  • tissue of interest includes eye tears.
  • tissue of interest includes nailbed.
  • tissue of interest includes external eye.
  • tissue of interest includes stool.
  • the step of synthesizing a plurality of synthesized spectra is based on a plurality of parameter data points associated with each of the parameters of the plurality of parameters. PRF-70251-02 [0023] In the above method, one or more of the plurality of parameters are associated with whole blood and one or more of the parameters are associated with peripheral tissue.
  • the plurality of parameters are ⁇ ⁇ , ⁇ ⁇ / , ⁇ ⁇ , ⁇ ⁇ 0 , ⁇ / , ⁇ ⁇ , ⁇ 0 , ⁇ 1 , and ⁇ 3 , wherein: ⁇ ⁇ , ⁇ ⁇ / , ⁇ ⁇ , and ⁇ ⁇ 0 represent tissue scattering contributions
  • ⁇ / represents optical pathlength
  • ⁇ ⁇ represents blood volume fraction
  • ⁇ 0 represents effective blood vessel diameter in peripheral tissue
  • ⁇ 1 represents blood hemoglobin (Hgb) content
  • ⁇ 3 represents blood oxygen saturation,
  • ⁇ 4 represents a constant for wavelength normalization
  • 5 6 7896: ( ⁇ ) represents total absorption coefficient including oxygenated and deoxygenated Hgb, wherein: 5 6 7896: ( ⁇
  • the predetermined color space is RGB.
  • the predetermined color space is CIE XYZ.
  • the predetermined color space is CIE RGB. [0031] In the above method, the predetermined color space is CIE YUV. [0032] In the above method, the predetermined color space is CIE UVW. [0033] In the above method, the predetermined color space is CIE LAB. [0034] In the above method, the predetermined color space is CIE LUV. [0035] In the above method, the predetermined color space is HSL. [0036] In the above method, the predetermined color space is HSV. [0037] In the above method, the predetermined color space is HCL. [0038] In the above method, the predetermined color space is LMS.
  • Another method of generating a ground truth color chart for colorimetric bioassays includes generating a digital bioassay-specific gamut using a predetermined color space under a predetermined illuminant for a bioassay-specific test strip having a plurality of reference color panels, identifying a plurality of digital gamut points within the digital bioassay-specific gamut based on a predetermined criterion, and printing a bioassay- specific gamut based on the digital bioassay-specific gamut thus establishing a ground truth color chart having a plurality of color patches, whereby each of the plurality of digital gamut points corresponds to an associated printed color patch using a predetermined printing calibration.
  • the predetermined illuminant is International Commission on Illumination (CIE) illuminant E. PRF-70251-02
  • CIE International Commission on Illumination
  • the bioassay-specific test strip is for urine.
  • the bioassay-specific test strip is for blood.
  • the bioassay-specific test strip is for eye tears.
  • the bioassay-specific test strip is for saliva.
  • the bioassay-specific test strip is for stool.
  • the bioassay-specific test strip is for body fluid.
  • the bioassay-specific test strip is for biological solutions.
  • the predetermined color space is RGB.
  • the predetermined color space is CIE XYZ.
  • the predetermined color space is CIE RGB.
  • the predetermined color space is CIE YUV.
  • the predetermined color space is CIE UVW.
  • the predetermined color space is CIE LAB.
  • the predetermined color space is CIE LUV.
  • the predetermined color space is HSL.
  • FIG.1A provides representative digital photos of biological tissue (e.g., palpebral conjunctiva) captured under five various white-light illumination conditions are provided including LEDs with color temperature of 3000 K, 4300 K, and 5800 K as well as fluorescent tube light.
  • biological tissue e.g., palpebral conjunctiva
  • FIG.1B provides model-specific RGB spectral response functions which lead to device- dependent color mapping of several popular low- and high-end smartphones with ANDROID and iOS operating systems including APPLE iPHONE 12 PRO, APPLE iPHONE SE, SAMSUNG GALAXY S21, and SAMSUNG GALAXY A52. PRF-70251-02 [0061]
  • FIGs.1C and 1D provide device-dependent RGB color values.
  • FIGs.1E and 1F provides different types of white light sources which have distinct spectral profiles in otherwise grossly white-appearing light conditions.
  • FIG.1G provides diverse spectral characteristics of light sources which fundamentally limit color management (e.g., white balancing), resulting in light condition-specific RGB color values.
  • FIGs.1H and 1I provide degree of color compression (FIG.1H: schematic of file compressions) significantly influenced by the image file format (FIG.1I: DNG, JPEG, and MP4).
  • FIG.2 is a flowchart that outlines the two approaches and their common convergence toward generating a tissue-specific ground truth color chart.
  • FIG.3A is a hyperspectral image capture device captures a line-scan from an area of interest (e.g., the inner eyelid).
  • FIG.3B is the resulting hyperspectral image in which this image is subdivided into three parts along a vertical (y-axis) while the horizontal axis (x-axis) is the associated wavelength in nm.
  • FIG.3C provides the subdivisions in FIG.3B in the form of spectra.
  • FIG.3D provides spectra shown in FIG.3C into an average spectrum.
  • FIGs.4A and 4B provide 12,240 spectral datapoints generated from peripheral tissue (FIG.4A) and 10,000 spectral datapoints generated of whole blood (FIG.4B) in the visible range by varying parameters discussed below.
  • FIG.4C provides converted synthesized spectra to a CIE XYZ tristimulus value resulting in generation of a digital tissue-specific gamut.
  • FIG.4D provides division between the 12,240 and the 10,000 spectral datapoints of FIGs.4A and 4B based on the plurality of parameters discussed below.
  • FIGs.5A and 5B provide number of points, e.g., 116, inside and outside of a digital Hgb gamut - these points represent 116 reference color patches including 100 CIE xy chromaticity values that are uniformly distributed inside the Hgb gamut as well as 12 primary colors and four PRF-70251-02 black and white colors to interpolate colorimetric outliers outside the Hgb gamut and to compute the spectral response functions of the image capture device, e.g., a smartphone camera.
  • FIGs.5C and 5D provide printed tissue-specific gamut determined based on the digital tissue-specific gamut shown in FIGs.5A and 5B, whereby each of the plurality of digital gamut points corresponds to an associated printed gamut point thereby establishing an error signal corresponding to a plurality of CMYK (cyan, magenta, yellow, and key (black)) values used for printing the associated printed gamut points.
  • FIG.5E is a color chart for each of the printed gamut points in FIGs.5C and 5D.
  • a conventional color chart e.g., Macbeth ColorChecker or X-Rite ColorChecker
  • PRF-70251-02 DETAILED DESCRIPTION [0077] For the purposes of promoting an understanding of the principles in the present disclosure, reference will now be made to the embodiments illustrated in the drawings, and specific language will be used to describe the same. It will nevertheless be understood that no limitation of the scope of this disclosure is thereby intended. [0078] In the present disclosure, the term “about” can allow for a degree of variability in a value or range, for example, within 10%, within 5%, or within 1% of a stated value or of a stated limit of a range.
  • the term “substantially” can allow for a degree of variability in a value or range, for example, within 90%, within 95%, or within 99% of a stated value or of a stated limit of a range.
  • a novel method is disclosed herein that can be used to generate a tissue-specific ground truth color chart that can be used with biological tissue-specific images. Towards this end two approaches are discussed herein. These two approaches converge to generate a ground truth color chart that is specific to a tissue. Referring to FIG.2, a flowchart is provided that outlines the two approaches and their common convergence toward generating a tissue-specific ground truth color chart. Two different types of color gamut determination are shown in FIG.2.
  • the first one is gamut determination based on spectral data, while the second is RGB (red-green-blue)-based.
  • Identification of a color gamut is required to achieve accurate and precise ground truth color charts in diagnostic colorimetric applications in bioimaging and bioassays. Commonly used conventional color gamuts (e.g., sRGB) are too broad to offer accurate and precise color corrections. Depending on the availability of commercially available reference color panels for a biological sample or bioassay strip of interest, two different approaches are disclosed herein to determine the specific gamut.
  • spectroscopic gamut determination e.g., blood hemoglobin and peripheral tissue (e.g., inner eyelid) is discussed.
  • spectral PRF-70251-02 we can use parametric biological tissue spectral modeling if reference color panels for a biological sample of interest are unavailable.
  • spectral PRF-70251-02 we determine a specific color gamut. For example, a color gamut specific to blood hemoglobin (Hgb) and peripheral tissue perfusion can be determined.
  • Hgb blood hemoglobin
  • Physiologically relevant ranges of model parameters are varied to generate possible spectra, from which CIE xy chromaticity values are calculated. This allows for the determination of a specific unique and narrow triangular color gamut in the CIE xy chromaticity diagram.
  • the second type of gamut determination is based on RGB data. This type is generally seen in strip test (e.g., colorimetric strip tests (e.g., urine test strips)).
  • strip test e.g., colorimetric strip tests (e.g., urine test strips)
  • reference color panels we can use commercially available reference color panels to determine a color gamut of a biological sample for colorimetric diagnostics of interest.
  • bioassay reference color panels such as dental shade guides, urine test strips, pH or peroxide strips
  • the color gamut can be determined by acquiring CIE xy chromaticity values of reference color panels using a white-light D65 LED light source.
  • CIE xy chromaticity values By converting RGB values to ground truth CIE XYZ and CIE xy chromaticity values, a unique and narrow triangular gamut can be defined based on the local cluster of reference color panels.
  • Each of these gamut processing approaches are now defined in more details.
  • parametric biological tissue spectral modeling can be used to augment homogeneous data for proper gamut determination.
  • FIGs.3A–3C An example of such a hyperspectral image is shown in FIGs.3A–3C.
  • a hyperspectral image capture device captures a line-scan from an area of interest (e.g., the inner eyelid). The resulting hyperspectral image is shown in FIG.3B.
  • This image is subdivided into three parts along a vertical (y-axis) while the horizontal axis (x-axis) is the associated PRF-70251-02 wavelength in nm.
  • Each of these subdivisions is shown as a spectrum in FIG.3C relating intensity to wavelength.
  • the spectra in FIG.3C are averaged into a spectrum which is shown in FIG.3D.
  • a spectrum is generated as shown in FIG.3D.
  • a mathematical relationship is established between intensity as a function of wavelength, wherein the mathematical relationship includes a plurality of parameters.
  • ⁇ ( ⁇ ) ⁇ + ( 1 ⁇ ⁇ ) ⁇ ⁇ ⁇ ⁇ + ⁇ ⁇ ⁇ ⁇ ⁇ ⁇ ⁇ , , wherein I represents ⁇ represents wavelength, the plurality of parameters are ⁇ ⁇ , ⁇ ⁇ / , ⁇ ⁇ , ⁇ ⁇ 0 , ⁇ / , ⁇ ⁇ , ⁇ 0 , ⁇ 1 , and ⁇ 3 , wherein: ⁇ ⁇ , ⁇ ⁇ / , ⁇ ⁇ , and ⁇ ⁇ 0 represent tissue scattering contributions, ⁇ / represents optical pathlength, ⁇ ⁇ represents blood volume fraction, ⁇ 0 represents effective blood vessel diameter in peripheral tissue, ⁇ 1 represents blood hemoglobin (Hgb) content, ⁇ 3 represents blood oxygen saturation, ⁇ 4 represents a constant for wavelength normalization, 5 6 7896:( ⁇ ) represents total absorption coefficient including oxygenated and deoxygenated Hgb, wherein: 5 6 7896: ( ⁇ ⁇
  • Table 1 summarizes the physiologically relevant ranges of the model parameters ⁇ ⁇ , ⁇ ⁇ / , ⁇ ⁇ , ⁇ ⁇ 0 , ⁇ / , ⁇ ⁇ , ⁇ 0 , ⁇ 1 , and ⁇ 3 , reflecting the optical properties of peripheral perfusion and blood Hgb.
  • CIE XYZ and CIE xy chromaticity values are calculated from a total of 22,240 synthesized blood-related spectra, as related to this non-limiting example, using Equations 3 and 4.
  • the division between the 12,240 and the 10,000 spectral data based on the plurality of parameters are shown in FIG.4D.
  • we determine the corresponding color gamut we employ the CIE XYZ color space to analyze the physiologically relevant colorimetric range.
  • Each synthesized spectrum C ( ⁇ ) can be mapped to the corresponding CIE XYZ tristimulus values using the CIE XYZ color matching functions.
  • D ⁇ ⁇ K H L ⁇ G C I ⁇
  • PRF-70251-02 M ⁇ E ⁇ K H L ⁇ G( ⁇ H )C( ⁇ H )NO( ⁇ H )
  • G ( ⁇ ) is the illuminant spectrum
  • T ⁇ K H L ⁇ G( ⁇ H )NO( ⁇ H ) .
  • each of the plurality of synthesized spectra is converted to a CIE XYZ tristimulus value thereby generating a digital tissue-specific gamut, as shown in FIG.4C in the triangular area identified as the Hgb gamut within the CIE xy chromaticity space.
  • This gamut is herein referred to as the digital Hgb gamut.
  • a number of points, e.g., 116, inside and outside of the digital Hgb gamut are chosen as shown in FIGs.5A and 5B (these points represent 116 reference color patches including 100 CIE xy chromaticity values that are uniformly distributed inside the Hgb gamut as well as 12 primary colors and four black and white colors to interpolate colorimetric outliers outside the Hgb gamut and to compute the spectral response functions of the image capture device, e.g., a smartphone PRF-70251-02 camera).
  • a printed tissue-specific gamut is determined based on the digital tissue-specific gamut, whereby each of the plurality of digital gamut points corresponds to an associated printed gamut point thereby establishing a printing calibration corresponding to a plurality of CMYK (cyan, magenta, yellow, and key (black)) values used for printing the associated printed gamut points and by minimizing the error signal based on a regression technique known to a person having ordinary skill in the art.
  • the resulting printed gamut is shown in FIGs.5C and 5D for the associated printed gamut points.
  • CMYK refers to the four fundamental ink pigments for color printing. These colors were generated based on the U.S. Web Coated (SWOP) v2, which served as the standard CMYK profile in the working space.
  • the 729 CMYK input values were printed using a professional photographic inkjet printer (imagePROGRAF PRO-1000, Canon). We also applied the International Color Consortium (ICC) profile and used the manufacturer-recommended genuine paper (Photo Paper Premium Fine Art Smooth, Canon).
  • reference color panels When reference color panels are available for a specific diagnostic colorimetric application, these panels can be utilized for the determination of a relevant color gamut for a biological sample of interest.
  • dental shade guides consist of a comprehensive set of reference colors that mimic the natural shades of teeth, allowing for assessing colorimetric matches for tooth whitening procedure.
  • urine test strips incorporate a range of distinct colors that arise from different reagent tests, which enables health monitoring of vital organs such as kidney and liver, as well as measuring glucose levels.
  • pH or peroxide strips exhibit unique colors corresponding to varying pH values and peroxide levels.
  • a conventional color chart e.g., Macbeth ColorChecker or X-Rite ColorChecker
  • RGB information is acquired for the color chart and the test strip.
  • an RGB matrix of 24 ⁇ 3 represents the color chart. This matrix is multiplied by a color-correction matrix of size 3 ⁇ 3, including 9 unknown parameters.
  • the multiplication results in a calibrated matrix of 24 ⁇ 3 matrix which expresses a calibrated PRF-70251-02 color information of the color chart in the CIE XYZ space.
  • the calibrated color values of the color chart are known apriori.
  • the 9 parameters of the 3 ⁇ 3 color-correction matrix are thus determined via known regression techniques, e.g., simple linear regression, by employing least square techniques, also known to a person having ordinary skill in the art. Once the 3 ⁇ 3 color- correction matrix is known, that matrix is multiplied by the matrix representing the test strip in order to determine a calibrated color information of the test strip in the CIE XYZ space.
  • Alternative approaches may be implemented for generating CIE XYZ tristimulus value based on converting an RGB-based matrix to a CIE XYZ matrix (m ⁇ 3) and then multiplying by a second version of the color-correction matrix (3 ⁇ 3) to obtain a CIE XYZ matrix (m ⁇ 3).
  • Still in another alternative approach of generating a CIE XYZ tristimulus value is based on multiplying a first RGB-based matrix (m ⁇ 3) by a third version of the color-correction matrix (3 ⁇ 3) to obtain a second RGB-based matrix (m ⁇ 3) and then converting the second RGB-based matrix (m ⁇ 3) to a CIE XYZ matrix (m ⁇ 3).
  • the exact color gamut of a specific biological sample is determined by acquiring CIE xy chromaticity values of reference color panels using the most commonly used Macbeth ColorChecker (or X-Rite ColorChecker) consisting of 24 color patches. Specifically, single-shot RGB photos are captured for the reference color panels juxtaposed with Macbeth ColorChecker, under a CIE standard illuminant LED light source with color temperature of 6500 K (also known as D65). Given that CIE XYZ coordinates of 24 color patches in Macbeth ColorChecker under D65 LED illumination are apriori accessible, these coordinates can be used to derive an RGB-to- CIE XYZ conversion matrix, as described above.
  • RGB values are transformed into corresponding CIE XYZ values for the reference color panels under D65 LED illumination.
  • CIE xy chromaticity values of the reference color panels are calculated from the CIE XYZ values. It should be noted that these chromaticity values form a local cluster in the CIE xy chromaticity diagram as discussed with reference to FIG.4C. Consequently, we define a unique and narrow triangular gamut that is circumscribed about the cluster, having three primary points of CIE xy chromaticity, as discussed above with respect to FIG.4C. The remainder of the steps are similar to spectroscopic gamut determination to generate the ground truth color chart as described with respect to FIGs.5A–5E.
  • a ground truth color chart containing a plurality of color patches along with ground truth color values of each of the color patches for various domains including RGB, CIE XYZ, CIE RGB, CIE LAB, CIE LUV, HSL, and HSV.
  • CIE standard illuminants also known as reference illuminants
  • CIE illuminant E stands out as a theoretical reference with a 100% uniform spectral power distribution across the entire wavelength range (equal energy radiator or spectrally uniform illumination).
  • CIE illuminant E is considered to exist solely in theory within the color science community, in the field of tissue optics and spectroscopy, spectral normalization involving a reflectance standard is frequently used to factor out the spectral response of the illumination and system, which is essentially equivalent to using CIE illuminant E. Given the availability of reflectance standards with a reflectivity of > 99% over the entire visible range, spectral normalization is equivalent to using illuminant E. [0097] We obtained the spectral intensity n ( ⁇ ) reflected from a sample of interest under CIE illuminant E without using a physical light source of illuminant E as follows.
  • ⁇ drs ( ⁇ ) G ( ⁇ ) ⁇ p ( ⁇ ) ⁇ q ( ⁇ ) .
  • CIE illuminant E via spectral normalization allowed for the definition of the PRF-70251-02 absolute colors of a sample because the spectral intensity reflected from the sample is not affected by the physical illumination source and acquisition conditions.

Landscapes

  • Health & Medical Sciences (AREA)
  • Engineering & Computer Science (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Physics & Mathematics (AREA)
  • General Health & Medical Sciences (AREA)
  • Medical Informatics (AREA)
  • Surgery (AREA)
  • Public Health (AREA)
  • Biomedical Technology (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Biophysics (AREA)
  • Molecular Biology (AREA)
  • Radiology & Medical Imaging (AREA)
  • Animal Behavior & Ethology (AREA)
  • Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
  • Pathology (AREA)
  • Veterinary Medicine (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Spectroscopy & Molecular Physics (AREA)
  • Optics & Photonics (AREA)
  • Quality & Reliability (AREA)
  • Image Processing (AREA)
  • Color Image Communication Systems (AREA)
  • Spectrometry And Color Measurement (AREA)

Abstract

A method of generating a ground truth color chart including color patches for biological imaging and colorimetric bioassays is disclosed which includes using a mathematical relationship associated with a tissue of interest expressing a relationship between intensity as a function of wavelength, the received mathematical relationship having a plurality of parameters, synthesizing a plurality of synthesized spectra based on the mathematical relationship, converting each of the plurality of synthesized spectra to a predetermined color space under a predetermined illuminant, thereby generating a digital tissue-specific gamut, identifying a plurality of digital gamut points within the digital tissue-specific gamut based on a predetermined criterion, and printing a tissue-specific gamut based on the digital tissue-specific gamut thus establishing a ground truth color chart having a plurality of color patches, whereby each of the plurality of digital gamut points corresponds to an associated printed color patch using a predetermined printing calibration.

Description

PRF-70251-02 METHOD FOR DEVELOPING TISSUE-SPECIFIC COLOR CHART CROSS-REFERENCE TO RELATED APPLICATIONS [0001] The present non-provisional patent application is related to and claims the priority benefit of U.S. Provisional Patent Application Serial 63524318, filed June 30, 2023, and of U.S. Provisional Patent Application Serial 63524352, filed June 30, 2023, the contents of each of which are hereby incorporated by reference in their entirety into the present disclosure. STATEMENT REGARDING GOVERNMENT FUNDING [0002] This invention was made with government support under R01EB033788 awarded by the National Institutes of Health. The government has certain rights in the invention. TECHNICAL FIELD [0003] The present disclosure generally relates to developing color standard or reference charts and specifically for developing color charts for diagnostic applications. BACKGROUND [0004] This section introduces aspects that may help facilitate a better understanding of the disclosure. Accordingly, these statements are to be read in this light and are not to be understood as admissions about what is or is not prior art. [0005] A photograph can provide diagnostic information beyond a mere visual representation. The primary challenge is to achieve color accuracy, which is referred to as the ability to define standardized colors of a sample and accurately detect them across diverse photo acquisition settings. Photographs acquired using a digital camera exhibit detrimental variations in colors, depending on device models, light conditions, and file formats. Color accuracy in medical PRF-70251-02 imaging, color consistency in machine vision, and color constancy in human perception are distinct yet interrelated aspects of color science and management. The importance of color consistency is well recognized in machine vision and general photography, which focuses on color correction and color reproduction. Color constancy in human perception primarily focuses on achieving identical perceptual response. However, there is a lack of studies to realize color accuracy in medical imaging. Recently, the onboard cameras of mobile devices have been extensively used for medical photography, including telemedicine and mobile health (mHealth) applications. Healthcare professionals now consider the acquisition of photos using mobile devices (i.e., smartphones and tablets) to be a mandatory part of healthcare practice because diagnostic photography plays a key role in a variety of digital health applications. As a result, there is an urgent need for implementing color accuracy in diagnostic photography. [0006] Reproducing original colors is challenging in photography, printing, and electronic displays because of intrinsic color distortions during image acquisition, processing, and output. The existing color calibration or correction methods using the conventional color charts are inadequate to achieve high fidelity of color accuracy for diagnostic purposes. First, generating a universal color gamut that can exactly reproduce all colors is challenging. Optimizing a unique color gamut is necessary, but identifying relevant yet subtle color derivatives is not straightforward without spectroscopic analyses, which enable to augment homogeneous data for ideal gamut determination. Second, color undersampling in the conventional color charts fundamentally reduces the degree of color accuracy. Color correction and calibration computations with a limited number of reference colors are prone to random and systematic errors (e.g., Gaussian, impulse, photon, or speckle noise) in a variety of photo acquisitions. Incorporating more reference colors allows us to use advanced machine learning techniques that can outperform the conventional computations. Third, regression-based color correction computations (also known as lookup table and interpolation) commonly used in machine vision require manual fine-tuning, depending on photo acquisition settings. [0007] In digital photography, color appearance is considerably affected by a variety of factors, settings, and conditions. Reference is made to FIG.1A wherein representative digital photos of biological tissue (e.g., palpebral conjunctiva) captured under five various white-light PRF-70251-02 illumination conditions are provided including LEDs with color temperature of 3000 K, 4300 K, and 5800 K as well as fluorescent tube light. Color accuracy in diagnostic photography refers to the ability to detect the absolute colors across various photo acquisition settings. From a device standpoint, a digital trichromatic camera (three-color image sensor) has unique red-green-blue (RGB) spectral response functions (also known as the spectral sensitivity) as a function of the wavelength of light ^. Referring to FIG.1B, model-specific RGB spectral response functions lead to device-dependent color mapping of several popular low- and high-end smartphones with ANDROID and iOS operating systems including APPLE iPHONE 12 PRO, APPLE iPHONE SE, SAMSUNG GALAXY S21, and SAMSUNG GALAXY A52. Notably, the RGB spectral responses of smartphone cameras exhibit significant model-specific variations as shown in FIGs. 1C and 1D, resulting in notoriously device-dependent RGB color values. From an illumination standpoint, different types of white light sources have distinct spectral profiles in otherwise grossly white-appearing light conditions as shown in FIGs.1E and 1F. Diverse spectral characteristics of light sources fundamentally limit color management (e.g., white balancing), resulting in light condition-specific RGB color values as shown in FIG.1G. From file format and bit depth (color depth) standpoints, the degree of color compression is significantly influenced by the image file format as shown in FIGs.1H and 1I. JPEG, the most commonly used file format (8-bit depth), uses lossy compression to reduce file size. RAW (also known as DNG) minimizes data compression and rendering. Recent high-end smartphones provide Pro Mode or ProRAW for 10-bit depth in each RGB channel. In telemedicine settings (FIG.1H), live, two-way video conferencing between a healthcare provider and patient introduces additional diversity in file formats (e.g., MP4). Overall, diverse photo acquisition scenarios pose a fundamental challenge for color accuracy in diagnostic photography. [0008] Therefore, there is an unmet need for a novel method that can be used to generate a tissue-specific ground truth color chart that can be used with biological tissue-specific photos. SUMMARY PRF-70251-02 [0009] A method of generating a ground truth color chart including color patches for biological imaging and colorimetric bioassays is disclosed. The method includes using a mathematical relationship associated with a tissue of interest expressing a relationship between intensity as a function of wavelength, the received mathematical relationship having a plurality of parameters each with an established range, synthesizing a plurality of synthesized spectra based on the mathematical relationship, converting each of the plurality of synthesized spectra to a predetermined color space under a predetermined illuminant , thereby generating a digital tissue- specific gamut, identifying a plurality of digital gamut points within the digital tissue-specific gamut based on a predetermined criterion, and printing a tissue-specific gamut based on the digital tissue-specific gamut thus establishing a ground truth color chart having a plurality of color patches, whereby each of the plurality of digital gamut points corresponds to an associated printed color patch using a predetermined printing calibration. [0010] In the above method, the predetermined illuminant is International Commission on Illumination (CIE) illuminant E. [0011] In the above method, the plurality of types of tissue includes palpebral conjunctiva. [0012] In the above method, the tissue of interest includes skin. [0013] In the above method, the tissue of interest includes teeth. [0014] In the above method, the tissue of interest includes tongue. [0015] In the above method, the tissue of interest includes eye. [0016] In the above method, the tissue of interest includes bulbar conjunctiva. [0017] In the above method, tissue of interest includes whole blood. [0018] In the above method, tissue of interest includes eye tears. [0019] In the above method, tissue of interest includes nailbed. [0020] In the above method, tissue of interest includes external eye. [0021] In the above method, tissue of interest includes stool. [0022] In the above method, the step of synthesizing a plurality of synthesized spectra is based on a plurality of parameter data points associated with each of the parameters of the plurality of parameters. PRF-70251-02 [0023] In the above method, one or more of the plurality of parameters are associated with whole blood and one or more of the parameters are associated with peripheral tissue. [0024] In the above method, the mathematical relationship is expressed as: % ^^'() ^^^^ ( ) ^ ^ ^ & *^'%^+^ , ^ ^^ ^^^ ^^^^^^^^^ (^)×"#$(^^#) % ^^^^ ( ) -. ^(^) = ^^ + (1 − ^) ^^ ^ ^ + ^ ^+^ , ^^ ^^^ ^^ ^ ,
Figure imgf000007_0001
λ represents wavelength, the plurality of parameters are ^^^, ^^/, ^^^, ^^0, ^/, ^^, ^0, ^1, and ^3, wherein: ^^^, ^^/, ^^^, and ^^0 represent tissue scattering contributions, ^/ represents optical pathlength, ^^ represents blood volume fraction, ^0 represents effective blood vessel diameter in peripheral tissue, ^1 represents blood hemoglobin (Hgb) content, ^3 represents blood oxygen saturation, ^4 represents a constant for wavelength normalization, 56 7896:(^) represents total absorption coefficient including oxygenated and deoxygenated Hgb, wherein: 56 7896:(^) = ^1;^3<=>?@^(^) + (1 − ^3)<=>?(^)A,
Figure imgf000007_0002
the mathematical relationship represents peripheral tissue and when b = 1, the mathematical relationship represents whole blood, <=>?@^(^) represents extinction coefficient of oxygenated Hgb, and <=>?(^) represents extinction coefficient of deoxygenated Hgb. [0025] In the above method, the tissue of interest includes whole blood and palpebral conjunctiva; ^^^ is represented by a range of about 0 to about 1 for b = 0; and not applicable for b = 1; ^^/ is represented by a range of about -1 to about 2 for b = 0; and not applicable for b = 1; ^^^ is represented by a range of about 0 to about 1 for b = 0; and not applicable for b = 1; ^^0 is represented by a range of about -1 to about 2 for b = 0; and not applicable for b = 1; ^/×^^ is represented by a range of about 0.02 to about 0.1 for b = 0; ^/ is about 0.1, and ^^ is not PRF-70251-02 applicable for b = 1; ^0 is represented by a range of about 5 to about 70 for b = 0; and not applicable for b = 1; ^1 is represented by a range of about 4 to about 20; and ^3 is represented by a range of about 0 to about 1. [0026] In the above method, ^^^, ^^/, ^^^, ^^0, ^/, ^^, ^0, ^1, and ^3 are related to peripheral tissue for when b = 0. [0027] In the above method, ^/, ^1, and ^3 are related to whole blood for when b = 1, where 56 7896:(^) represents total absorption coefficient including other light absorbing pigments and molecules in biological samples. [0028] In the above method, the predetermined color space is RGB. [0029] In the above method, the predetermined color space is CIE XYZ. [0030] In the above method, the predetermined color space is CIE RGB. [0031] In the above method, the predetermined color space is CIE YUV. [0032] In the above method, the predetermined color space is CIE UVW. [0033] In the above method, the predetermined color space is CIE LAB. [0034] In the above method, the predetermined color space is CIE LUV. [0035] In the above method, the predetermined color space is HSL. [0036] In the above method, the predetermined color space is HSV. [0037] In the above method, the predetermined color space is HCL. [0038] In the above method, the predetermined color space is LMS. [0039] Another method of generating a ground truth color chart for colorimetric bioassays is also disclosed. The method includes generating a digital bioassay-specific gamut using a predetermined color space under a predetermined illuminant for a bioassay-specific test strip having a plurality of reference color panels, identifying a plurality of digital gamut points within the digital bioassay-specific gamut based on a predetermined criterion, and printing a bioassay- specific gamut based on the digital bioassay-specific gamut thus establishing a ground truth color chart having a plurality of color patches, whereby each of the plurality of digital gamut points corresponds to an associated printed color patch using a predetermined printing calibration. [0040] In the above method, the predetermined illuminant is International Commission on Illumination (CIE) illuminant E. PRF-70251-02 [0041] In the above method, the bioassay-specific test strip is for urine. [0042] In the above method, the bioassay-specific test strip is for blood. [0043] In the above method, the bioassay-specific test strip is for eye tears. [0044] In the above method, the bioassay-specific test strip is for saliva. [0045] In the above method, the bioassay-specific test strip is for stool. [0046] In the above method, the bioassay-specific test strip is for body fluid. [0047] In the above method, the bioassay-specific test strip is for biological solutions. [0048] In the above method, the predetermined color space is RGB. [0049] In the above method, the predetermined color space is CIE XYZ. [0050] In the above method, the predetermined color space is CIE RGB. [0051] In the above method, the predetermined color space is CIE YUV. [0052] In the above method, the predetermined color space is CIE UVW. [0053] In the above method, the predetermined color space is CIE LAB. [0054] In the above method, the predetermined color space is CIE LUV. [0055] In the above method, the predetermined color space is HSL. [0056] In the above method, the predetermined color space is HSV. [0057] In the above method, the predetermined color space is HCL. [0058] In the above method, the predetermined color space is LMS. BRIEF DESCRIPTION OF FIGURES [0059] FIG.1A provides representative digital photos of biological tissue (e.g., palpebral conjunctiva) captured under five various white-light illumination conditions are provided including LEDs with color temperature of 3000 K, 4300 K, and 5800 K as well as fluorescent tube light. [0060] FIG.1B provides model-specific RGB spectral response functions which lead to device- dependent color mapping of several popular low- and high-end smartphones with ANDROID and iOS operating systems including APPLE iPHONE 12 PRO, APPLE iPHONE SE, SAMSUNG GALAXY S21, and SAMSUNG GALAXY A52. PRF-70251-02 [0061] FIGs.1C and 1D provide device-dependent RGB color values. [0062] FIGs.1E and 1F provides different types of white light sources which have distinct spectral profiles in otherwise grossly white-appearing light conditions. [0063] FIG.1G provides diverse spectral characteristics of light sources which fundamentally limit color management (e.g., white balancing), resulting in light condition-specific RGB color values. [0064] FIGs.1H and 1I provide degree of color compression (FIG.1H: schematic of file compressions) significantly influenced by the image file format (FIG.1I: DNG, JPEG, and MP4). [0065] FIG.2 is a flowchart that outlines the two approaches and their common convergence toward generating a tissue-specific ground truth color chart. [0066] FIG.3A is a hyperspectral image capture device captures a line-scan from an area of interest (e.g., the inner eyelid). [0067] FIG.3B is the resulting hyperspectral image in which this image is subdivided into three parts along a vertical (y-axis) while the horizontal axis (x-axis) is the associated wavelength in nm. [0068] FIG.3C provides the subdivisions in FIG.3B in the form of spectra. [0069] FIG.3D provides spectra shown in FIG.3C into an average spectrum. [0070] FIGs.4A and 4B provide 12,240 spectral datapoints generated from peripheral tissue (FIG.4A) and 10,000 spectral datapoints generated of whole blood (FIG.4B) in the visible range by varying parameters discussed below. [0071] FIG.4C provides converted synthesized spectra to a CIE XYZ tristimulus value resulting in generation of a digital tissue-specific gamut. [0072] FIG.4D provides division between the 12,240 and the 10,000 spectral datapoints of FIGs.4A and 4B based on the plurality of parameters discussed below. [0073] FIGs.5A and 5B provide number of points, e.g., 116, inside and outside of a digital Hgb gamut - these points represent 116 reference color patches including 100 CIE xy chromaticity values that are uniformly distributed inside the Hgb gamut as well as 12 primary colors and four PRF-70251-02 black and white colors to interpolate colorimetric outliers outside the Hgb gamut and to compute the spectral response functions of the image capture device, e.g., a smartphone camera. [0074] FIGs.5C and 5D provide printed tissue-specific gamut determined based on the digital tissue-specific gamut shown in FIGs.5A and 5B, whereby each of the plurality of digital gamut points corresponds to an associated printed gamut point thereby establishing an error signal corresponding to a plurality of CMYK (cyan, magenta, yellow, and key (black)) values used for printing the associated printed gamut points. [0075] FIG.5E is a color chart for each of the printed gamut points in FIGs.5C and 5D. [0076] FIG.6 provides a non-calibrated image of a bioassay-specific test strip along with a conventional color chart (e.g., Macbeth ColorChecker or X-Rite ColorChecker), wherein the color chart has m color patches, e.g., m = 24.
PRF-70251-02 DETAILED DESCRIPTION [0077] For the purposes of promoting an understanding of the principles in the present disclosure, reference will now be made to the embodiments illustrated in the drawings, and specific language will be used to describe the same. It will nevertheless be understood that no limitation of the scope of this disclosure is thereby intended. [0078] In the present disclosure, the term “about” can allow for a degree of variability in a value or range, for example, within 10%, within 5%, or within 1% of a stated value or of a stated limit of a range. [0079] In the present disclosure, the term “substantially” can allow for a degree of variability in a value or range, for example, within 90%, within 95%, or within 99% of a stated value or of a stated limit of a range. [0080] A novel method is disclosed herein that can be used to generate a tissue-specific ground truth color chart that can be used with biological tissue-specific images. Towards this end two approaches are discussed herein. These two approaches converge to generate a ground truth color chart that is specific to a tissue. Referring to FIG.2, a flowchart is provided that outlines the two approaches and their common convergence toward generating a tissue-specific ground truth color chart. Two different types of color gamut determination are shown in FIG.2. The first one is gamut determination based on spectral data, while the second is RGB (red-green-blue)-based. [0081] Identification of a color gamut is required to achieve accurate and precise ground truth color charts in diagnostic colorimetric applications in bioimaging and bioassays. Commonly used conventional color gamuts (e.g., sRGB) are too broad to offer accurate and precise color corrections. Depending on the availability of commercially available reference color panels for a biological sample or bioassay strip of interest, two different approaches are disclosed herein to determine the specific gamut. [0082] First, spectroscopic gamut determination (e.g., blood hemoglobin and peripheral tissue (e.g., inner eyelid)) is discussed. We can use parametric biological tissue spectral modeling if reference color panels for a biological sample of interest are unavailable. By generating spectral PRF-70251-02 profiles using biological tissue spectral modeling, we determine a specific color gamut. For example, a color gamut specific to blood hemoglobin (Hgb) and peripheral tissue perfusion can be determined. Physiologically relevant ranges of model parameters are varied to generate possible spectra, from which CIE xy chromaticity values are calculated. This allows for the determination of a specific unique and narrow triangular color gamut in the CIE xy chromaticity diagram. Instead of parametric biological tissue spectral modeling, we can also use Monte Carlo simulations and approximation of radiative transport (e.g., diffusion and Born) combined with specific optical properties or relevant biological ranges. This is based on the idea that spectral profiles can be used to classify the types of biological samples. [0083] The second type of gamut determination is based on RGB data. This type is generally seen in strip test (e.g., colorimetric strip tests (e.g., urine test strips)). We can use commercially available reference color panels to determine a color gamut of a biological sample for colorimetric diagnostics of interest. These bioassay reference color panels, such as dental shade guides, urine test strips, pH or peroxide strips, provide a narrow range of colors that can be used for gamut design. The color gamut can be determined by acquiring CIE xy chromaticity values of reference color panels using a white-light D65 LED light source. By converting RGB values to ground truth CIE XYZ and CIE xy chromaticity values, a unique and narrow triangular gamut can be defined based on the local cluster of reference color panels. Each of these gamut processing approaches are now defined in more details. When there are no commercially available reference color panels for a biological target of interest, parametric biological tissue spectral modeling can be used to augment homogeneous data for proper gamut determination. For example, we focus on blood Hgb and peripheral tissue perfusion where blood Hgb is a dominant pigment. First, in this approach a plurality of hyperspectral images from a plurality of subjects from an area of interest is received. In the experiment conducted associated with the present disclosure 153 subjects were examined generating 153 hyperspectral images. An example of such a hyperspectral image is shown in FIGs.3A–3C. As shown in FIG.3A, a hyperspectral image capture device captures a line-scan from an area of interest (e.g., the inner eyelid). The resulting hyperspectral image is shown in FIG.3B. This image is subdivided into three parts along a vertical (y-axis) while the horizontal axis (x-axis) is the associated PRF-70251-02 wavelength in nm. Each of these subdivisions is shown as a spectrum in FIG.3C relating intensity to wavelength. The spectra in FIG.3C are averaged into a spectrum which is shown in FIG.3D. Thus, for each of the 153 hyperspectral images, a spectrum is generated as shown in FIG.3D. Next, a mathematical relationship is established between intensity as a function of wavelength, wherein the mathematical relationship includes a plurality of parameters. The mathematical relationship is expressed as: % ^^'()*^' ^^^^ ( ) ^ ^ ^^^^ & %^+^ , ^ ^^ ^^^ ^^^^^^ (^)×"#$(^^#) % +^^^^ ( ) -. ^(^) = ^^ + (1 − ^) ^^^^ ^ ^^ + ^^^ ^ ^^ ^ ^ ^ , , wherein I represents
Figure imgf000014_0001
λ represents wavelength, the plurality of parameters are ^^^, ^^/, ^^^, ^^0, ^/, ^^, ^0, ^1, and ^3, wherein: ^^^, ^^/, ^^^, and ^^0 represent tissue scattering contributions, ^/ represents optical pathlength, ^^ represents blood volume fraction, ^0 represents effective blood vessel diameter in peripheral tissue, ^1 represents blood hemoglobin (Hgb) content, ^3 represents blood oxygen saturation, ^4 represents a constant for wavelength normalization, 56 7896:(^) represents total absorption coefficient including oxygenated and deoxygenated Hgb, wherein: 56 7896:(^) = ^1;^3<=>?@^(^) + (1 − ^3)<=>?(^)A, (2)
Figure imgf000014_0002
peripheral tissue and when b = 1, the mathematical relationship represents whole blood, <=>?@^ (^) represents extinction coefficient of oxygenated Hgb, and <=>?(^) represents extinction coefficient of deoxygenated Hgb. [0084] A set of possible spectral profiles of peripheral tissue (^ = 0) and whole blood (^ = 1) are synthesized using the generalized spectral equations of biological tissue, presented above (Equations 1 and 2). PRF-70251-02 [0085] Table 1 summarizes the physiologically relevant ranges of the model parameters ^^^, ^^/, ^^^, ^^0, ^/, ^^, ^0, ^1, and ^3, reflecting the optical properties of peripheral perfusion and blood Hgb. By varying these parameters at specific intervals (Equations 1 and 2), we generate 12,240 spectral data of peripheral tissue shown in FIG.4A and 10,000 spectral data of whole blood shown in FIG.4B in the visible range. As a result, CIE XYZ and CIE xy chromaticity values are calculated from a total of 22,240 synthesized blood-related spectra, as related to this non-limiting example, using Equations 3 and 4. The division between the 12,240 and the 10,000 spectral data based on the plurality of parameters are shown in FIG.4D. Table 1 – Physiologically relevant ranges of the model parameters in spectral modeling of peripheral perfusion and blood Hgb samples Relevant range
Figure imgf000015_0001
[0086] Using the specific set of spectral profiles, we determine the corresponding color gamut, we employ the CIE XYZ color space to analyze the physiologically relevant colorimetric range. Each synthesized spectrum C(^) can be mapped to the corresponding CIE XYZ tristimulus values using the CIE XYZ color matching functions. D = ^ ∑K HL^ G C I̅ , PRF-70251-02 M = ^ E ∑K HL^ G(^H)C(^H)NO(^H) , (3) ^ of 1 nm (S =
Figure imgf000016_0001
, I̅(^), NO(^), and Q̅(^) are the CIE XYZ color matching functions, G(^) is the illuminant spectrum, and T = ∑K HL^ G(^H)NO(^H) . In particular, G(^) = 1 as C(^) was computed under the assumption of CIE E (equal energy radiator).
Figure imgf000016_0002
[0087] Thus, each of the plurality of synthesized spectra is converted to a CIE XYZ tristimulus value thereby generating a digital tissue-specific gamut, as shown in FIG.4C in the triangular area identified as the Hgb gamut within the CIE xy chromaticity space. Thus, the CIE xy chromaticity diagram (FIG.4C) exhibits the chromaticity values from a total of 22,240 blood- related spectral data; forming a local cluster such that a unique and narrow triangular gamut can be defined with three primary points of the CIE xy chromaticity (FIG.4C): (I, N) = (0.30, 0.31), (0.47, 0.42), and (0.63, 0.33). This gamut is herein referred to as the digital Hgb gamut. To further factor out the brightness in the CIE XYZ values, the CIE xy chromaticity can be calculated: I = \ \$]$^, and (4)
Figure imgf000016_0003
perspective, the desired physical dimension should be the sizes of typical business cards or credit cards. We impose the number of reference colors to be greater than 100, although other numbers may be possible. [0089] A number of points, e.g., 116, inside and outside of the digital Hgb gamut are chosen as shown in FIGs.5A and 5B (these points represent 116 reference color patches including 100 CIE xy chromaticity values that are uniformly distributed inside the Hgb gamut as well as 12 primary colors and four black and white colors to interpolate colorimetric outliers outside the Hgb gamut and to compute the spectral response functions of the image capture device, e.g., a smartphone PRF-70251-02 camera). Next, a printed tissue-specific gamut is determined based on the digital tissue-specific gamut, whereby each of the plurality of digital gamut points corresponds to an associated printed gamut point thereby establishing a printing calibration corresponding to a plurality of CMYK (cyan, magenta, yellow, and key (black)) values used for printing the associated printed gamut points and by minimizing the error signal based on a regression technique known to a person having ordinary skill in the art. The resulting printed gamut is shown in FIGs.5C and 5D for the associated printed gamut points. Each of these printed gamut points then corresponds to a reference color patch in a color chart (shown in FIG.5E), thus the color chart which is the ground truth color chart for the biological area of interest also has 116 patches. [0090] For the gamut mapping process, we utilized a total of 729 colors derived from various combinations of CMYK color values. CMYK refers to the four fundamental ink pigments for color printing. These colors were generated based on the U.S. Web Coated (SWOP) v2, which served as the standard CMYK profile in the working space. Black (K), which mainly affects the luminance of colors, was set to 0, while the primary colors of cyan (C), magenta (M), and yellow (Y) were manipulated to consider a wide range of colors. Specifically, there were a comprehensive set of 729 possible digital inputs by combining the values of C, M, and Y, which encompass a range of [0%, 12.5%, 25%, 37.5%, 50%, 62.5%, 75%, 87.5%, 100%]. The 729 CMYK input values were printed using a professional photographic inkjet printer (imagePROGRAF PRO-1000, Canon). We also applied the International Color Consortium (ICC) profile and used the manufacturer-recommended genuine paper (Photo Paper Premium Fine Art Smooth, Canon). We measured the reflectance spectra of 729 printed outputs using a scientific laboratory spectrometer (VS140 VIS-NIR, Horiba Jobin Yvon Inc.). We calculated the CIE xy chromaticity values from the measured spectral data of printed colors. Consequently, the database of CMYK (digital input) and CIE xy chromaticity (printed output) for the 729 distinct colors were prepared for the gamut mapping. [0091] The one-to-one mapping between the digital CMYK input and printed output values, enabling optimal color selection for desired printouts were based on two main steps: 1) We identified the _th printed output values of the 729 colors such that the CIE xy chromaticity (`ac bdef9 = ;I 7 bcdef9, Nb cdef9A ) best matched that of the gth color patch PRF-70251-02 (`ai h j6d9 = ;Ih ij6d9, Nh ij6d9A7) by minimizing k`ac bdef9 − `ai h j6d9k, where ‖∙‖ denotes the Euclidean norm; and 2) Corresponding to the _th printed output
Figure imgf000018_0001
CMYK input values, which were used for printing the desired physical reference color. [0092] Physical charts were printed by a professional photographic inkjet printer, using the digital CMYK input values for the desired reference color patches. To further validate the printed color output values, we re-measured the reflectance spectra of all of the 116 color patches in the printed charts using a scientific laboratory spectrometer. CIE XYZ and CIE xy chromaticity values were calculated from the measured spectra using Equations 3 and 4. Consequently, we confirmed that the CIE xy chromaticity values were within the range of colors that can be produced by the Hgb gamut. In particular, the measured CIE XYZ values of the 116 color patches served as the ground truth. [0093] The second approach for receiving an RGB-based gamut is now described. When reference color panels are available for a specific diagnostic colorimetric application, these panels can be utilized for the determination of a relevant color gamut for a biological sample of interest. For example, dental shade guides consist of a comprehensive set of reference colors that mimic the natural shades of teeth, allowing for assessing colorimetric matches for tooth whitening procedure. Similarly, urine test strips incorporate a range of distinct colors that arise from different reagent tests, which enables health monitoring of vital organs such as kidney and liver, as well as measuring glucose levels. In addition, pH or peroxide strips exhibit unique colors corresponding to varying pH values and peroxide levels. Importantly, using these reference color panels, we can map out the homogeneous range of colorimetric characteristics of a target biological sample. Initially, a non-calibrated image of a bioassay-specific test strip is received along with a conventional color chart (e.g., Macbeth ColorChecker or X-Rite ColorChecker), wherein the color chart has m color patches, e.g., m = 24, as shown by the example provided in FIG.6. From the non-calibrated image, RGB information is acquired for the color chart and the test strip. Thus, an RGB matrix of 24×3 represents the color chart. This matrix is multiplied by a color-correction matrix of size 3×3, including 9 unknown parameters. The multiplication results in a calibrated matrix of 24×3 matrix which expresses a calibrated PRF-70251-02 color information of the color chart in the CIE XYZ space. The calibrated color values of the color chart are known apriori. The 9 parameters of the 3×3 color-correction matrix are thus determined via known regression techniques, e.g., simple linear regression, by employing least square techniques, also known to a person having ordinary skill in the art. Once the 3×3 color- correction matrix is known, that matrix is multiplied by the matrix representing the test strip in order to determine a calibrated color information of the test strip in the CIE XYZ space. Alternative approaches may be implemented for generating CIE XYZ tristimulus value based on converting an RGB-based matrix to a CIE XYZ matrix (m×3) and then multiplying by a second version of the color-correction matrix (3×3) to obtain a CIE XYZ matrix (m×3). Still in another alternative approach of generating a CIE XYZ tristimulus value is based on multiplying a first RGB-based matrix (m×3) by a third version of the color-correction matrix (3×3) to obtain a second RGB-based matrix (m×3) and then converting the second RGB-based matrix (m×3) to a CIE XYZ matrix (m×3). [0094] Thus, the exact color gamut of a specific biological sample is determined by acquiring CIE xy chromaticity values of reference color panels using the most commonly used Macbeth ColorChecker (or X-Rite ColorChecker) consisting of 24 color patches. Specifically, single-shot RGB photos are captured for the reference color panels juxtaposed with Macbeth ColorChecker, under a CIE standard illuminant LED light source with color temperature of 6500 K (also known as D65). Given that CIE XYZ coordinates of 24 color patches in Macbeth ColorChecker under D65 LED illumination are apriori accessible, these coordinates can be used to derive an RGB-to- CIE XYZ conversion matrix, as described above. By employing the derived conversion matrix, RGB values are transformed into corresponding CIE XYZ values for the reference color panels under D65 LED illumination. CIE xy chromaticity values of the reference color panels are calculated from the CIE XYZ values. It should be noted that these chromaticity values form a local cluster in the CIE xy chromaticity diagram as discussed with reference to FIG.4C. Consequently, we define a unique and narrow triangular gamut that is circumscribed about the cluster, having three primary points of CIE xy chromaticity, as discussed above with respect to FIG.4C. The remainder of the steps are similar to spectroscopic gamut determination to generate the ground truth color chart as described with respect to FIGs.5A–5E. PRF-70251-02 [0095] In both approaches, a ground truth color chart is provided containing a plurality of color patches along with ground truth color values of each of the color patches for various domains including RGB, CIE XYZ, CIE RGB, CIE LAB, CIE LUV, HSL, and HSV. [0096] Among CIE standard illuminants (also known as reference illuminants), CIE illuminant E stands out as a theoretical reference with a 100% uniform spectral power distribution across the entire wavelength range (equal energy radiator or spectrally uniform illumination). Although CIE illuminant E is considered to exist solely in theory within the color science community, in the field of tissue optics and spectroscopy, spectral normalization involving a reflectance standard is frequently used to factor out the spectral response of the illumination and system, which is essentially equivalent to using CIE illuminant E. Given the availability of reflectance standards with a reflectivity of > 99% over the entire visible range, spectral normalization is equivalent to using illuminant E. [0097] We obtained the spectral intensity n(^) reflected from a sample of interest under CIE illuminant E without using a physical light source of illuminant E as follows. The spectral intensity ^o (^) reflected from the sample under an arbitrary light illumination, measured by a scientific laboratory spectrometer, can be expressed as a function of the wavelength of light ^: [0098] ^o (^) = G(^) ∙ p(^) ∙ q(^) ∙ n(^), (5) where G(^) is the spectral profile of the illumination light source, p(^) is the spectral response of all optical components in the system, and q(^) is the spectral response function (also known as the spectral sensitivity) of the image sensor. Using a white diffuse (Lambertian) reflectance standard having a reflectivity of > 99% in the visible range (SRT-99-050, Labsphere), the spectral intensity ^drs (^) reflected from the white reflectance standard under the identical imaging setting as the sample can be obtained: ^drs (^) = G(^) ∙ p(^) ∙ q(^). (6) Then, n(^) is calculated by normalizing ^o (^) by ^drs (^): n = tu(^). (7)
Figure imgf000020_0001
illuminant E was straightforward, mimicking the scenario in which illuminant E was used. It should be noted that CIE illuminant E via spectral normalization allowed for the definition of the PRF-70251-02 absolute colors of a sample because the spectral intensity reflected from the sample is not affected by the physical illumination source and acquisition conditions. [0099] Those having ordinary skill in the art will recognize that numerous modifications can be made to the specific implementations described above. The implementations should not be limited to the particular limitations described. Other implementations may be possible.

Claims

PRF-70251-02 Claims: 1. A method of generating a ground truth color chart including color patches for biological imaging and colorimetric bioassays, comprising: using a mathematical relationship associated with a tissue of interest expressing a relationship between intensity as a function of wavelength, the received mathematical relationship having a plurality of parameters each with an established range; synthesizing a plurality of synthesized spectra based on the mathematical relationship; converting each of the plurality of synthesized spectra to a predetermined color space under a predetermined illuminant, thereby generating a digital tissue-specific gamut; identifying a plurality of digital gamut points within the digital tissue-specific gamut based on a predetermined criterion; and printing a tissue-specific gamut based on the digital tissue-specific gamut thus establishing a ground truth color chart having a plurality of color patches, whereby each of the plurality of digital gamut points corresponds to an associated printed color patch using a predetermined printing calibration. 2. The method of claim 1, wherein the predetermined illuminant is International Commission on Illumination (CIE) illuminant E. 3. The method of claim 2, wherein the plurality of types of tissue includes palpebral conjunctiva. 4. The method of claim 2, wherein the tissue of interest includes skin. 5. The method of claim 2, wherein the tissue of interest includes teeth. 6. The method of claim 2, wherein the tissue of interest includes tongue. 7. The method of claim 2, wherein the tissue of interest includes eye. 8. The method of claim 2, wherein the tissue of interest includes bulbar conjunctiva. 9. The method of claim 2, wherein tissue of interest includes whole blood. 10. The method of claim 2, wherein tissue of interest includes eye tears. 11. The method of claim 2, wherein tissue of interest includes nailbed. 12. The method of claim 2, wherein tissue of interest includes external eye. 13. The method of claim 2, wherein tissue of interest includes stool. PRF-70251-02 14. The method of claim 2, wherein the step of synthesizing a plurality of synthesized spectra is based on a plurality of parameter data points associated with each of the parameters of the plurality of parameters. 15. The method of claim 2, wherein one or more of the plurality of parameters are associated with whole blood and one or more of the parameters are associated with peripheral tissue. 16. The method of claim 2, wherein the mathematical relationship is expressed as: %&^^'()*^'%^+ ^ ^ ^^^ (,)^^ ^^^ ^^^ ^^^^^^^^^^ (^)×"#$(^^#) ^^^^ ( ) -. ^(^) = ^^ + (1 − ^) ^^^^ ^ ^^ + ^^^ ^ ^^ ^ %^+^ , , wherein
Figure imgf000023_0001
I represents spectral intensity, λ represents wavelength, the plurality of parameters are ^^^, ^^/, ^^^, ^^0, ^/, ^^, ^0, ^1, and ^3, wherein: ^^^, ^^/, ^^^, and ^^0 represent tissue scattering contributions, ^/ represents optical pathlength, ^^ represents blood volume fraction, ^0 represents effective blood vessel diameter in peripheral tissue, ^1 represents blood hemoglobin (Hgb) content, ^3 represents blood oxygen saturation, ^4 represents a constant for wavelength normalization, 56 7896:(^) represents total absorption coefficient including oxygenated and deoxygenated Hgb, wherein: 56 7896:(^) = ^1;^3<=>?@^(^) + (1 − ^3)<=>?(^)A, the mathematical relationship represents peripheral tissue and when b = 1, the mathematical relationship represents whole blood, <=>?@^ (^) represents extinction coefficient of oxygenated Hgb, and <=>?(^) represents extinction coefficient of deoxygenated Hgb. 17. The method of claim 15, wherein the tissue of interest includes whole blood and palpebral conjunctiva; ^^^ is represented by a range of about 0 to about 1 for b = 0; and not applicable for b = 1; ^^/ is represented by a range of about -1 to about 2 for b = 0; and not PRF-70251-02 applicable for b = 1; ^^^ is represented by a range of about 0 to about 1 for b = 0; and not applicable for b = 1; ^^0 is represented by a range of about -1 to about 2 for b = 0; and not applicable for b = 1; ^/×^^ is represented by a range of about 0.02 to about 0.1 for b = 0; ^/ is about 0.1, and ^^ is not applicable for b = 1; ^0 is represented by a range of about 5 to about 70 for b = 0; and not applicable for b = 1; ^1 is represented by a range of about 4 to about 20; and ^3 is represented by a range of about 0 to about 1. 18. The method of claim 15, wherein ^^^, ^^/, ^^^, ^^0, ^/, ^^, ^0, ^1, and ^3 are related to peripheral tissue for when b = 0. 19. The method of claim 15, wherein ^/, ^1, and ^3 are related to whole blood for when b = 1, where 56 7896:(^) represents total absorption coefficient including other light absorbing pigments and molecules in biological samples. 20. The method of claim 2, wherein the predetermined color space is RGB. 21. The method of claim 2, wherein the predetermined color space is CIE XYZ. 22. The method of claim 2, wherein the predetermined color space is CIE RGB. 23. The method of claim 2, wherein the predetermined color space is CIE YUV. 24. The method of claim 2, wherein the predetermined color space is CIE UVW. 25. The method of claim 2, wherein the predetermined color space is CIE LAB. 26. The method of claim 2, wherein the predetermined color space is CIE LUV. 27. The method of claim 2, wherein the predetermined color space is HSL. 28. The method of claim 2, wherein the predetermined color space is HSV. 29. The method of claim 2, wherein the predetermined color space is HCL. 30. The method of claim 2, wherein the predetermined color space is LMS. 31. A method of generating a ground truth color chart for colorimetric bioassays, comprising: generating a digital bioassay-specific gamut using a predetermined color space under a predetermined illuminant for a bioassay-specific test strip having a plurality of reference color panels; identifying a plurality of digital gamut points within the digital bioassay-specific gamut based on a predetermined criterion; and PRF-70251-02 printing a bioassay-specific gamut based on the digital bioassay-specific gamut thus establishing a ground truth color chart having a plurality of color patches, whereby each of the plurality of digital gamut points corresponds to an associated printed color patch using a predetermined printing calibration. 32. The method of claim 30, wherein the predetermined illuminant is International Commission on Illumination (CIE) illuminant E. 33. The method of claim 32, wherein the bioassay-specific test strip is for urine. 34. The method of claim 32, wherein the bioassay-specific test strip is for blood. 35. The method of claim 32, wherein the bioassay-specific test strip is for eye tears. 36. The method of claim 32, wherein the bioassay-specific test strip is for saliva. 37. The method of claim 32, wherein the bioassay-specific test strip is for stool. 38. The method of claim 32, wherein the bioassay-specific test strip is for body fluid. 39. The method of claim 32, wherein the bioassay-specific test strip is for biological solutions. 40. The method of claim 32, wherein the predetermined color space is RGB. 41. The method of claim 32, wherein the predetermined color space is CIE XYZ. 42. The method of claim 32, wherein the predetermined color space is CIE RGB. 43. The method of claim 32, wherein the predetermined color space is CIE YUV. 44. The method of claim 32, wherein the predetermined color space is CIE UVW. 45. The method of claim 32, wherein the predetermined color space is CIE LAB. 46. The method of claim 32, wherein the predetermined color space is CIE LUV. 47. The method of claim 32, wherein the predetermined color space is HSL. 48. The method of claim 32, wherein the predetermined color space is HSV. 49. The method of claim 32, wherein the predetermined color space is HCL. 50. The method of claim 32, wherein the predetermined color space is LMS.
PCT/US2024/025608 2023-06-30 2024-04-20 Method for developing tissue-specific color chart Ceased WO2025006041A1 (en)

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
US202363524318P 2023-06-30 2023-06-30
US202363524352P 2023-06-30 2023-06-30
US63/524,318 2023-06-30
US63/524,352 2023-06-30

Publications (1)

Publication Number Publication Date
WO2025006041A1 true WO2025006041A1 (en) 2025-01-02

Family

ID=93939690

Family Applications (2)

Application Number Title Priority Date Filing Date
PCT/US2024/025608 Ceased WO2025006041A1 (en) 2023-06-30 2024-04-20 Method for developing tissue-specific color chart
PCT/US2024/025609 Ceased WO2025006042A2 (en) 2023-06-30 2024-04-20 Method for color correction based on ground truth color chart

Family Applications After (1)

Application Number Title Priority Date Filing Date
PCT/US2024/025609 Ceased WO2025006042A2 (en) 2023-06-30 2024-04-20 Method for color correction based on ground truth color chart

Country Status (1)

Country Link
WO (2) WO2025006041A1 (en)

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2016136698A1 (en) * 2015-02-27 2016-09-01 Hoya株式会社 Image processing device
US20190310203A1 (en) * 2012-08-08 2019-10-10 Scanadu Incorporated Quantifying color changes of chemical test pads induced by specific concentrations of biological analytes under different lighting conditions
US20200214571A1 (en) * 2013-12-31 2020-07-09 Memorial Sloan Kettering Cancer Center Systems, methods, and apparatus for multichannel imaging of fluorescent sources in real-time
US20230016631A1 (en) * 2019-12-09 2023-01-19 Visu, Inc. Methods for color-blindness remediation through image color correction

Family Cites Families (18)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
IN202211072421A (en) * 2022-12-30
EP2464125B1 (en) * 2004-12-17 2013-07-31 Nikon Corporation Image processing device
US8506901B2 (en) * 2010-11-03 2013-08-13 Teco Diagnostics All-in-one specimen cup with optically readable results
WO2013126602A1 (en) * 2012-02-21 2013-08-29 Massachusetts Eye & Ear Infirmary Inflammatory eye disorders
JP6396890B2 (en) * 2013-04-08 2018-09-26 パナソニック インテレクチュアル プロパティ コーポレーション オブ アメリカPanasonic Intellectual Property Corporation of America Image processing apparatus, image processing method, and program capable of virtually reproducing state where makeup coating material is applied
DE102013114394A1 (en) * 2013-12-18 2015-06-18 Huf Hülsbeck & Fürst Gmbh & Co. Kg Method for authenticating a driver in a motor vehicle
US10397585B2 (en) * 2015-06-08 2019-08-27 Qualcomm Incorporated Processing high dynamic range and wide color gamut video data for video coding
JP6320440B2 (en) * 2015-08-04 2018-05-09 ドルビー ラボラトリーズ ライセンシング コーポレイション Signal reconstruction for high dynamic range signals
US9959604B2 (en) * 2016-06-13 2018-05-01 Gopro, Inc. Dynamic global tone mapping with integrated 3D color look-up table
CN107066933B (en) * 2017-01-25 2020-06-05 武汉极目智能技术有限公司 Road sign identification method and system
CN110447041B (en) * 2017-05-20 2023-05-30 渊慧科技有限公司 Noise neural network layer
WO2019043695A1 (en) * 2017-08-31 2019-03-07 Twine Solutions Ltd. Color detection algorithm
JP6947021B2 (en) * 2017-12-27 2021-10-13 株式会社リコー Image processing method, image processing device and image processing system
US10835349B2 (en) * 2018-07-20 2020-11-17 Align Technology, Inc. Parametric blurring of colors for teeth in generated images
AU2020218573A1 (en) * 2019-02-04 2021-08-05 Farmers Edge Inc. Shadow and cloud masking for remote sensing images in agriculture applications using multilayer perceptron
US11298017B2 (en) * 2019-06-27 2022-04-12 Bao Tran Medical analysis system
US11517196B2 (en) * 2019-09-12 2022-12-06 Yuan Ze University Evaluation device for tear secretion
US20240268679A1 (en) * 2021-06-29 2024-08-15 Universita' Degli Studi Di Bari Aldo Moro Non-invasive device for quickly estimating anaemia

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20190310203A1 (en) * 2012-08-08 2019-10-10 Scanadu Incorporated Quantifying color changes of chemical test pads induced by specific concentrations of biological analytes under different lighting conditions
US20200214571A1 (en) * 2013-12-31 2020-07-09 Memorial Sloan Kettering Cancer Center Systems, methods, and apparatus for multichannel imaging of fluorescent sources in real-time
WO2016136698A1 (en) * 2015-02-27 2016-09-01 Hoya株式会社 Image processing device
US20230016631A1 (en) * 2019-12-09 2023-01-19 Visu, Inc. Methods for color-blindness remediation through image color correction

Also Published As

Publication number Publication date
WO2025006042A3 (en) 2025-01-30
WO2025006042A2 (en) 2025-01-02

Similar Documents

Publication Publication Date Title
Hardeberg Acquisition and reproduction of color images: colorimetric and multispectral approaches
JP2006500877A (en) Digital image color correction method
EP3481041A1 (en) Color conversion system, color conversion device, and color conversion method
US8203756B2 (en) Method for characterizing the color response of an imaging device
Pascale RGB coordinates of the Macbeth ColorChecker
EP3993382B1 (en) Colour calibration of an imaging device
US8401289B2 (en) Method for matching colors between two systems
US8355573B2 (en) Method for matching colors by using human observer color matching functions
US8274718B2 (en) Method for creating color conversion definition for image output devices and image processing apparatus implementing the method
US7940393B2 (en) Method and system for approximating the spectrum of a plurality of color samples
Hung Color theory and its application to digital still cameras
Pointer et al. Practical camera characterization for colour measurement
Fairchild Seeing, adapting to, and reproducing the appearance of nature
EP3182691A1 (en) Method of encoding raw color coordinates provided by a camera representing colors of a scene having two different illuminations
Berns Image quality degradation caused by color transformations in multispectral imaging—A practical review
Nyström Colorimetric and multispectral image acquisition
JP5097927B2 (en) Color conversion matrix calculation method
Párraga et al. Accurate mapping of natural scenes radiance to cone activation space: a new image dataset
Day The Effects of Multi-channel Visible Spectrum Imaging on Perceived Spatial Image Quality and Color Reproduction Accuracy
Gindi Color characterization and modeling of a scanner
Chou et al. Evaluation of Color Performance of Video Cameras for Poultry House Monitoring Applications
Allen Color Measurement and Calibration in Medical Photography
Vander Haeghen Development of a dermatological workstation with calibrated acquisition and management of color images for the follow-up of patients with an increased risk of skin cancer
Park Tissue Optics-Informed Hyperspectral Learning for Mobile Health
WO2025006042A2 (en) Method for color correction based on ground truth color chart

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 24832626

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE