US20230258501A1 - Color chart - Google Patents

Color chart Download PDF

Info

Publication number
US20230258501A1
US20230258501A1 US18/010,596 US202118010596A US2023258501A1 US 20230258501 A1 US20230258501 A1 US 20230258501A1 US 202118010596 A US202118010596 A US 202118010596A US 2023258501 A1 US2023258501 A1 US 2023258501A1
Authority
US
United States
Prior art keywords
color
image
patch
color chart
chart
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
US18/010,596
Other languages
English (en)
Inventor
Masato Takahashi
Yasuhiro Morihara
Norimichi Tsumura
Ryo Takahashi
Keiko Ogawa
Isseki Kin
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
DIC Corp
Original Assignee
DIC Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by DIC Corp filed Critical DIC Corp
Assigned to DIC CORPORATION reassignment DIC CORPORATION ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: MORIHARA, YASUHIRO, OGAWA, KEIKO, TSUMURA, NORIMICHI, TAKAHASHI, RYO, TAKAHASHI, MASATO, KIN, Isseki
Publication of US20230258501A1 publication Critical patent/US20230258501A1/en
Pending legal-status Critical Current

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N1/00—Scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission; Details thereof
    • H04N1/46—Colour picture communication systems
    • H04N1/56—Processing of colour picture signals
    • H04N1/60—Colour correction or control
    • H04N1/603—Colour correction or control controlled by characteristics of the picture signal generator or the picture reproducer
    • H04N1/6033—Colour correction or control controlled by characteristics of the picture signal generator or the picture reproducer using test pattern analysis
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01J—MEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
    • G01J3/00—Spectrometry; Spectrophotometry; Monochromators; Measuring colours
    • G01J3/46—Measurement of colour; Colour measuring devices, e.g. colorimeters
    • G01J3/52—Measurement of colour; Colour measuring devices, e.g. colorimeters using colour charts
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01J—MEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
    • G01J3/00—Spectrometry; Spectrophotometry; Monochromators; Measuring colours
    • G01J3/46—Measurement of colour; Colour measuring devices, e.g. colorimeters
    • G01J3/462—Computing operations in or between colour spaces; Colour management systems
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01J—MEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
    • G01J3/00—Spectrometry; Spectrophotometry; Monochromators; Measuring colours
    • G01J3/46—Measurement of colour; Colour measuring devices, e.g. colorimeters
    • G01J3/463—Colour matching
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01J—MEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
    • G01J3/00—Spectrometry; Spectrophotometry; Monochromators; Measuring colours
    • G01J3/46—Measurement of colour; Colour measuring devices, e.g. colorimeters
    • G01J3/50—Measurement of colour; Colour measuring devices, e.g. colorimeters using electric radiation detectors
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N1/00—Scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission; Details thereof
    • H04N1/46—Colour picture communication systems
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N1/00—Scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission; Details thereof
    • H04N1/46—Colour picture communication systems
    • H04N1/56—Processing of colour picture signals
    • H04N1/60—Colour correction or control
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N1/00—Scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission; Details thereof
    • H04N1/46—Colour picture communication systems
    • H04N1/56—Processing of colour picture signals
    • H04N1/60—Colour correction or control
    • H04N1/6016—Conversion to subtractive colour signals
    • H04N1/6019—Conversion to subtractive colour signals using look-up tables
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01J—MEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
    • G01J3/00—Spectrometry; Spectrophotometry; Monochromators; Measuring colours
    • G01J3/46—Measurement of colour; Colour measuring devices, e.g. colorimeters
    • G01J2003/466—Coded colour; Recognition of predetermined colour; Determining proximity to predetermined colour
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01J—MEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
    • G01J3/00—Spectrometry; Spectrophotometry; Monochromators; Measuring colours
    • G01J3/46—Measurement of colour; Colour measuring devices, e.g. colorimeters
    • G01J2003/467—Colour computing
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01J—MEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
    • G01J3/00—Spectrometry; Spectrophotometry; Monochromators; Measuring colours
    • G01J3/02—Details
    • G01J3/0264—Electrical interface; User interface

Definitions

  • the present invention relates to a color chart.
  • a color chart is a plate-shaped object in which color samples are arranged, and is used for comparison and measurement of colors such as checking a color reproducibility of an image system.
  • the color chart may be used for color correction for a digital image captured by a digital camera or the like.
  • an object of the present invention is to provide a color chart in which the patch in the color chart can be easily and automatically recognized.
  • the present invention includes the following aspects.
  • a color chart including: a plurality of patches; and an automatic recognition marker configured to automatically recognize at least one of the plurality of patches.
  • the plurality of patches include at least three patches selected from the group consisting of the following first patch to seventh patch:
  • the plurality of patches include a plurality of achromatic color patches having different brightnesses.
  • the plurality of patches include a plurality of chromatic color patches whose colors are different from the first color to the seventh color.
  • an area is 40 cm 2 or more and 150 cm 2 or less.
  • an area of each of the plurality of patches is 0.25 cm 2 or more and 4 cm 2 or less.
  • a color chart can be provided in which a patch in the color chart can be easily and automatically recognized.
  • FIG. 1 is a schematic diagram of an example of a color chart.
  • FIG. 2 is a configuration diagram of an example of an image display system.
  • FIG. 3 is a functional configuration diagram of an example of a display device.
  • FIG. 4 is a flowchart of an example of an image display method.
  • FIG. 5 is a schematic diagram of an example in which an image of the color chart and a patient is captured simultaneously by an image capturing device.
  • FIG. 6 is a schematic diagram of an example in which a captured image is displayed on a display unit of the display device.
  • FIG. 7 is a schematic diagram of an example in which a doctor displays the captured image on the display unit of the display device to perform remote diagnosis and treatment.
  • the color chart according to the present invention includes at least a plurality of patches and an automatic recognition marker.
  • the plurality of patches include, for example, a plurality of achromatic color patches having different brightnesses.
  • the number of types of the achromatic color patches is, for example, five to seven. If the number of the types of the achromatic color patches is three or less, for example, when color correction for an image obtained by capturing an image of the color chart by a camera is executed using the achromatic color patches, the non-linearity of the camera cannot be sufficiently coped with, and the accuracy of the color correction may decrease.
  • the number of the types of the achromatic color patches is preferably five or more.
  • the plurality of patches include, for example, a plurality of chromatic color patches.
  • the plurality of patches include, for example, a plurality of chromatic color patches whose colors are different from a first color to a seventh color to be described later.
  • the number of types of these chromatic color patches is, for example, 15 to 20.
  • each patch in the color chart is not particularly limited, and is preferably not too small from a viewpoint of not interfering with color recognition. In this regard, 0.25 cm 2 or more is preferable. In addition, from a viewpoint that the color chart is not too large, 4 cm 2 or less is preferable.
  • each patch examples include a square.
  • the color chart includes an automatic recognition marker that automatically recognizes at least one of the plurality of patches.
  • the color chart includes the automatic recognition marker, so that it is possible to automatically execute an operation of recognizing each patch of the color chart in image data when the color correction to be described later is executed.
  • the shape and the size of the automatic recognition marker are not particularly limited, and are preferably, for example, similar to those of the patch.
  • the size of the automatic recognition marker is preferably 0.25 cm 2 or more and 4 cm 2 or less.
  • the automatic recognition marker generally has a pattern that each patch does not have.
  • the color chart includes two or more automatic recognition markers having different patterns.
  • the automatic recognition for each patch is executed in consideration of relative positional relation between the two or more automatic recognition markers, and thus the automatic recognition performance for each patch is improved.
  • the automatic recognition marker is not particularly limited as long as the automatic recognition marker is a marker that enables the automatic recognition, and information such as version information of the color chart, a link to a use method, and an expiration date may be added to the automatic recognition marker by a two-dimensional barcode or the like. Further, the color chart may fade depending on a storage condition. In that respect, it may be preferable to set an expiration date for the color chart.
  • the automatic recognition marker is detected from an image obtained by capturing an image of the color chart.
  • the automatic recognition marker can be detected using, for example, an image recognition device including general-purpose image recognition processing software. Specifically, pattern matching between an image of the automatic recognition marker stored in advance in the image recognition device and the image obtained by capturing an image of the color chart is executed using the image recognition device. Accordingly, the automatic recognition marker is detected from the image obtained by capturing an image of the color chart.
  • positional relation between the automatic recognition marker and each patch in the color chart is stored in advance in the image recognition device.
  • positional relation between each of the two automatic recognition markers and each patch is stored in advance in a storage unit of the image recognition device.
  • the image recognition device include a combination of a CPU and a memory.
  • each patch of the color chart in the captured image can be automatically recognized using the detected automatic recognition marker.
  • the size of the color chart is not particularly limited, and from a viewpoint that the color chart can be held by one hand and the color chart does not become an obstacle even when the color chart is held near a face, the area of the color chart is preferably 40 cm 2 or more and 150 cm 2 or less.
  • the color chart is generally a sheet-shaped color chart. Further, the shape of a main surface of the color chart is, for example, a rectangle.
  • a material of the color chart is not particularly limited as long as each patch can be printed.
  • the color chart may be made of plastic resin (for example, synthetic paper) or may be made of paper.
  • the color chart preferably includes a blank portion at a lower right portion (a lower left portion when viewed from the front) of the main surface. Most humans are right-handed. Therefore, when the blank portion of the color chart is held by a right hand, it is easy to naturally place the color chart on a right side of the face.
  • diagnosis and treatment such as observation of a color of a gum in the dentistry, observation of a color of the skin in the dermatology, observation of a color of a throat in the otorhinolaryngology, and examination (inspection) based on a skin color of the face, a tongue color, or the like, which is performed in Chinese medicine, diagnosis and treatment that emphasizes a color may be executed. In such diagnosis and treatment, inaccurate color recognition may affect the diagnosis and treatment.
  • the color chart according to the present invention preferably includes at least two patches, more preferably includes at least three patches, even more preferably includes at least five patches, and particularly preferably includes seven patches.
  • the patches are selected from the group consisting of the following first patch to seventh patch.
  • the color chart assists in accurately recognizing the color such as the skin color and the tongue color in the remote diagnosis and treatment, and therefore, the color chart is useful for the remote diagnosis and treatment using color information such as the skin color and the tongue color of a patient.
  • a combination of the first patch to the seventh patch is not particularly limited as long as the combination is a combination of two or more patches selected from the seven patches, and it is preferable to select three or more patches having different color tones such as purplish-red, pale red-purple, and deep yellow-red.
  • the color of the first patch corresponds to a color of tongue coating formed due to accumulation of moisture (excess water).
  • the color of the second patch corresponds to an inflammatory skin color.
  • the color of the third patch corresponds to a color of a tongue having blood stasis (poor microcirculation).
  • the color of the fourth patch corresponds to a color of a certain portion of healthy tongue coating.
  • the color of the sixth patch corresponds to a color of a healthy tongue.
  • the color of the seventh patch corresponds to a color of a tongue having heat.
  • FIG. 1 is a schematic diagram of an example of the color chart.
  • color chart in FIG. 1 is a gray scale, but an actual color chart includes a chromatic color patch.
  • the color chart in FIG. 1 is a rectangle having a length of about 90 mm and a width of about 55 mm.
  • Automatic recognition markers 11 a and 11 b of 10 mm square are disposed on an upper right portion (an upper left portion when viewed from the front) at an upper side and a lower left portion (a lower right portion when viewed from the front) at a lower side of a main surface of the color chart.
  • the two automatic recognition markers 11 a and 11 b have white patterns on black backgrounds.
  • the white pattern of the automatic recognition marker 11 a is different from the white pattern of the automatic recognition marker 11 b.
  • patches of 10 mm square are arranged without being spaced apart in 6 (A to F) rows and 5 (a to e) columns.
  • achromatic color patches are arranged in order of brightness.
  • L*a*b* values of the patches of the color chart shown in FIG. 1 are shown in Table 1-1.
  • outlines of colors of the patches of the color chart shown in FIG. 1 are shown in Table 1-2.
  • relation between the first patch to the seventh patch and the skin color and the tongue color is shown in Table 1-3.
  • the image display system includes at least the color chart, an image capturing device, and a display device, and further includes other devices as necessary.
  • the image display method according to the present invention includes at least an image capturing step and a display step, and further includes other steps as necessary.
  • FIG. 2 is a configuration diagram of an example of the image display system.
  • the image display system in FIG. 2 includes a color chart 1 , an image capturing device 2 , and a display device 3 .
  • the image capturing device is a device that simultaneously captures an image of the color chart and a subject to be image-captured and that acquires image data.
  • the image of the color chart and the subject to be image-captured is captured simultaneously, and the image data is acquired.
  • the image capturing step is executed by, for example, the image capturing device.
  • the subject to be image-captured is, for example, a patient who receives the remote diagnosis and treatment.
  • Examples of the image capturing device include a camera and an electronic device having a camera function.
  • Examples of the electronic device having a camera function include a mobile phone, a smartphone, a tablet terminal, a personal computer, a monitoring camera, and a camera system (for example, a camera system attached to an f-MRI) attached to a medical examination apparatus.
  • a camera in the personal computer serving as the image capturing device may be a built-in camera or an external camera.
  • Examples of an image capturing element provided in the image capturing device include a charge coupled device (CCD) and a complementary metal oxide semiconductor (CMOS).
  • CCD charge coupled device
  • CMOS complementary metal oxide semiconductor
  • the image capturing device includes a transmission unit that transmits the image data.
  • the transmission of the image data by the transmission unit may be executed by wireless communication, or may be executed by wired communication.
  • wireless transmission for example, wireless communication of any available type such as Wi-Fi, LTE, and 5G can be used.
  • the captured image may be a still image or a moving image.
  • the display device is a device that receives the image data and that displays the image data on a display unit as an image.
  • the display device includes at least a display unit, and further includes other units such as a color correction unit as necessary.
  • the image data is received, and the image data is displayed on the display unit as the image.
  • a color correction process may be also executed.
  • the display step is executed by, for example, the display device.
  • FIG. 3 illustrates a functional configuration diagram of an example of the display device.
  • the display device 3 in FIG. 3 includes a display unit 3 a and a color correction unit 3 b.
  • the display device includes, for example, a reception unit that receives the image data.
  • the image data is transmitted from the image capturing device and received by the display device.
  • the image data is generally transmitted and received through an Internet line.
  • a file format of the image data is not particularly limited, and may be any available format.
  • examples of the file format of the image data include JPG (JPEG), GIF, PNG, and BMP when the image data is the still image, and include AVI, QuickTime, Mpeg-1, Mpeg-2, WMV, FLV, and MPEG-4 when the image data is the moving image.
  • the image data can be transmitted and received using, for example, a communication service such as an E-mail and a social networking service.
  • a communication service such as an E-mail and a social networking service.
  • image data is the moving image
  • a web conference system such as Skype, Zoom, and Microsoft Teams may be used for the transmission and reception.
  • voice data may be transmitted and received.
  • a method for transmitting the image data from the image capturing device to the display device may include uploading of the image data from the image capturing device to a cloud server and downloading of the image data from the cloud server to the display device.
  • the uploading and the downloading are executed using a cloud. That is, the display device may receive the image data from the cloud server.
  • the method for transmitting the image data from the image capturing device to the display device may be executed by physical movement via an external memory.
  • the display device can receive the image data by storing the image data acquired by the image capturing device in an external memory such as a USB memory, physically moving the external memory by mail or the like, and then connecting the external memory to the display device.
  • the display device is not particularly limited, and examples thereof include output terminals of the mobile phone, the smartphone, the tablet terminal, the personal computer, and an electronic medical record system.
  • the display device is not particularly limited, and examples thereof include the mobile phone, the smartphone, the tablet terminal, and the personal computer.
  • the color correction unit is a unit that corrects a display color of the display unit and color information of the image data such that a color of at least one patch in a color chart in the image displayed on the display unit approaches or matches a color of at least one corresponding patch in a color chart measured under a light source at a place where the display unit is placed.
  • the display color of the display unit and the color information of the image data are corrected such that the color of at least one patch in the color chart in the image displayed on the display unit approaches or matches the color of at least one corresponding patch in the color chart measured under the light source at the place where the display unit is placed.
  • the color correction process is executed by, for example, the color correction unit.
  • the color correction unit is, for example, a CPU that executes a program for executing the color correction.
  • the degree to which the colors are brought close to each other by the color correction may be appropriately selected according to a purpose.
  • Such color correction may be executed using only one of the patches in the color chart, or may be executed using a plurality of patches.
  • the color correction unit includes, for example, a first correction unit and a second correction unit.
  • the first correction unit is a unit that corrects the display color of the display unit such that a corresponding display color of the display unit approaches or matches the color of at least one patch in the color chart measured under the light source at the place where the display unit is placed.
  • the second correction unit is a unit that corrects the color information of the image data such that a color of at least one corresponding patch in the color chart in the image data approaches or matches the color of at least one patch in the color chart measured under the light source at the place where the display unit is placed.
  • the color correction process includes, for example, a first correction process and a second correction process.
  • the display color of the display unit is corrected such that the corresponding display color of the display unit approaches or matches the color of at least one patch in the color chart measured under the light source at the place where the display unit is placed.
  • the color information of the image data is corrected such that the color of at least one corresponding patch in the color chart in the image data approaches or matches the color of at least one patch in the color chart measured under the light source at the place where the display unit is placed.
  • the first correction process is executed by, for example, the first correction unit.
  • the second correction process is executed by, for example, the second correction unit.
  • the color information for example, RGB values
  • the obtained image data differs due to a difference in image capturing environment, a difference in type of the image capturing device, or the like.
  • Examples of the difference in image capturing environment include a difference in type of a light source for lighting and a difference in brightness of the lighting in a case of image capturing in a room.
  • a difference in positional relation between the light source and the target to be image-captured also affects the color information in the obtained image data.
  • Examples of the difference in type of the image capturing device include a difference in type of the image capturing element and a difference in image processing engine.
  • the image processing engine is, for example, a system LSI that processes a raw image output from the image capturing element and that converts the raw image into an image suitable for the humans to observe.
  • the system LSI which is the image processing engine, is implemented by, for example, an embedded CPU, an embedded DSP, a dedicated arithmetic circuit that executes face detection and the like, a program memory, a data memory, and an image memory.
  • the color information of the patch in the color chart may differ for each obtained image data due to a difference in type of the smartphone serving as the image capturing device, a difference in type of an indoor lighting, or the like. Therefore, the colors of the patch in the color chart in the images may be different from each other also when the images are displayed on the same display unit. This difference may affect the remote diagnosis and treatment.
  • a color of the patch of the color chart recognized by a person when a color chart is observed depends on environment (for example, the light source) in which the color is observed. This is because spectral distribution of light illuminating the color chart depends on the light source. Therefore, when the light sources are different, the colors of the patch in the color chart recognized or measured when the color chart is observed are different. Therefore, even if the RGB value of the color of the patch in the color chart is accurately displayed on the display unit, the color of the patch in the color chart displayed on the display unit may be different from the color of the patch in the color chart recognized by the person under the light source at the place where the display unit is placed.
  • a purpose of the color correction is to match a color of a color chart (a color chart captured together with a patient) in an image displayed on a display unit (for example, a display of a PC) used by the doctor to a color (a color of a color chart recognized by the doctor under a certain light source) of a color chart at hand of the doctor, which is a correct value.
  • a display unit for example, a display of a PC
  • the color correction is executed in an order of color correction (the first correction process) of a display color of the display used by the doctor and color correction (the second correction process) of an image obtained by capturing an image of the patient.
  • the display color of the display unit is corrected such that the corresponding display color of the display unit approaches or matches the color of at least one patch in the color chart measured under the light source at the place where the display unit is placed.
  • the color of at least one patch in the color chart measured under the light source at the place where the display unit is placed is measured.
  • the display color of the display is corrected to approach or match the measured color.
  • XYZ values which are correct values, are measured and obtained by a colorimeter under the same lighting environment as lighting environment of the doctor.
  • a colorimeter for example, a Konica Minolta color luminance meter CS-100A is used.
  • Equation ( 1 ) Relation between luminances and input RGB levels is expressed by the following Equation ( 1 ).
  • Tristimulus values X′, Y′, and Z′ of the display color of the display can be decomposed into contributions of R, G, and B as indicated in the following Equation (2).
  • the tristimulus values corresponding to the emissions can be calculated based on luminances L and color coordinates x and y when the display is measured. Relation of X-Y and Y-Z for each emission can be expressed by a linear equation such as the following Equation (3).
  • a i , b i , c i , and d i are coefficients.
  • Equation (4) is obtained based on Equations (2) and (3).
  • Equation (5) luminances of the RGB at the time when certain tristimulus values X′Y′Z′ are desired to be displayed on the display.
  • the XYZ values of the patch in the color chart which are the correct values measured by the colorimeter under the same lighting environment as the lighting environment of the doctor, are entered into X′, Y′, and Z′ in Equation (5). Then, by applying the luminances obtained by Equation (5) to Equation (1), an RGB value (a reference RGB value) can be calculated. Then, the display color (the RGB value) of the display corresponding to the color (the RGB value) of the patch in the color chart is corrected to the calculated RGB value (the reference RGB value). Accordingly, the display color of the display used by the doctor can be corrected. That is, according to the above procedure, the display color of the display can be corrected to the correct value.
  • the color information of the image data is corrected such that the color of at least one corresponding patch in the color chart in the image data approaches or matches the color of at least one patch in the color chart measured under the light source at the place where the display unit is placed.
  • an RGB value of at least one patch in a color chart in image data of an image obtained by capturing an image of the color chart and the patient is corrected to the corresponding reference RGB value calculated in the first process correction.
  • each patch portion in the color chart is extracted from the captured image using the automatic recognition marker, and an average value of RGB values of pixels in the patch is obtained for each patch.
  • a model is created by multiple regression based on a difference between an averaged number (an RGB value) and the corresponding reference RGB value. Based on the model, all pixels of the image data are converted, and a color of a face, a tongue, or the like of an image-captured person is corrected.
  • the correction is executed by examining correlation between an RGB value of a patch in a color chart in image data of the image obtained by capturing an image of the patient and the corresponding reference RGB value.
  • gamma correction of the image data is executed using achromatic colors in the patches in the color chart of the captured image. Then, the RGB value of the image data is corrected using all chromatic colors in the patches in the color chart.
  • the gamma correction will be described in detail. First, in the first correction process, based on luminances at the time when achromatic color parts in the patches in the color chart are measured by the colorimeter, the gamma correction is executed on RGB values of the achromatic color parts in the captured image. Similarly, the gamma correction is also executed for a gray scale part of the reference RGB value.
  • R c is an R value of the captured image
  • Y is a luminance at the time when the achromatic color in the patch in the color chart is measured by the colorimeter.
  • Normalization is executed with a luminance value of white such that black is 0 and white is 1 among the achromatic colors of the color chart. Accordingly, conversion is executed such that the brightness of the achromatic color is in a range of 0 to 1.
  • the gamma correction is executed for any RGB value. Specifically, an RGB value obtained after the gamma correction is calculated by multiplying each of the RGB values by an inverse function in Equation (6).
  • Equation (7) a model is constructed by the multiple regression for the color of the patch for which the gamma correction has been executed.
  • An R value is as illustrated in Equation (7).
  • R′ c aR r +bG r +cB r +d (7)
  • R′ c is an R value of the corrected image
  • R r , G r , and B r are RGB values before correction.
  • Each parameter (a, b, c, d) is obtained by the multiple regression using the corresponding patch.
  • FIG. 4 is a flowchart of an example of the image display method.
  • an image of the color chart 1 and a subject 21 to be image-captured is captured simultaneously using a smartphone that is the image capturing device 2 (S 11 ).
  • image data obtained by the image capturing is transmitted from the image capturing device 2 to the display device 3 (S 12 ).
  • the image data transmitted from the image capturing device 2 is received by the display device 3 (S 13 ).
  • the image data is transmitted and received by, for example, being attached to an e-mail.
  • a display color of the display unit 3 a is corrected (S 14 ). Specifically, the display color of the display unit is corrected such that the corresponding display color of the display unit approaches or matches the color of at least one patch in the color chart measured under the light source at the place where the display unit is placed. The color correction is executed by the color correction unit 3 b.
  • the image data is corrected (S 15 ). Specifically, the color information of the image data is corrected such that the color of at least one corresponding patch in the color chart in the image data approaches or matches the color of at least one patch in the color chart measured under the light source at the place where the display unit is placed (S 15 ).
  • the color correction is executed by the color correction unit 3 b. When the color correction is executed, each patch in the color chart in the image is automatically recognized using the automatic recognition marker.
  • the corrected image data is displayed as an image on the display unit 3 a (the display) of the PC that is the display device 3 (S 16 ).
  • step S 14 does not need to be executed after the step S 13 , and the step S 14 and other steps may be executed in any order.
  • a doctor 4 who is a diagnostician, observes a skin color of a face and a tongue color of the patient that are displayed on the display unit 3 a while holding the same color chart 1 as the color chart 1 held by the patient who is the subject 21 to be image-captured, and performs diagnosis and treatment.
  • the color correction is executed, and therefore, as compared with a case in which the color correction is not executed, the skin color of the face of the patient in the image is close to a skin color of the face of the patient at the time when it is assumed that face-to-face diagnosis and treatment is performed. Therefore, when inspecting the skin color and the tongue color of the patient, the doctor can perform the remote diagnosis and treatment in a state close to a state in which the face-to-face diagnosis and treatment is performed.
  • the color chart according to the present invention can also be used in a case in which the color correction as described above is not executed. That is, the color chart according to the present invention can also be used in a case in which the remote diagnosis and treatment is performed using the ability (the ability to compare colors and execute the color correction in the brain) of human chromatic adaptation. In this case, for example, the remote diagnosis and treatment may be performed as follows.
  • the doctor While holding the color chart at hand, the doctor causes the personal computer to display an image (an image obtained by simultaneously capturing an image of the color chart and the patient) sent from the patient, and observes the skin color of the face of the patient while viewing the image to perform diagnosis and treatment.
  • the doctor compares the color of the color chart at hand with the color of the color chart in the image displayed on the personal computer, and observes the skin color of the face of the patient while reflecting, in the brain, a difference between the colors in the color of the patient in the image.
  • the image was displayed according to the flowchart illustrated in FIG. 4 .
  • the program for executing the color correction was created by Python.
  • the skin color of the face of the patient in the image displayed on the display unit was the same as the skin color of the face at the time when it was assumed that the face-to-face diagnosis and treatment was performed.
  • a doctor of Chinese medicine evaluated the image displayed on the display unit. In an evaluation result, an opinion was obtained that color correction within a reliable range was executed in the diagnosis and treatment.

Landscapes

  • Physics & Mathematics (AREA)
  • Spectroscopy & Molecular Physics (AREA)
  • General Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Mathematical Physics (AREA)
  • Theoretical Computer Science (AREA)
  • Spectrometry And Color Measurement (AREA)
  • Color Image Communication Systems (AREA)
  • Image Processing (AREA)
US18/010,596 2020-06-17 2021-06-15 Color chart Pending US20230258501A1 (en)

Applications Claiming Priority (5)

Application Number Priority Date Filing Date Title
JP2020-104762 2020-06-17
JP2020104762 2020-06-17
JP2021039110A JP6981561B1 (ja) 2020-06-17 2021-03-11 カラーチャート
JP2021-039110 2021-03-11
PCT/JP2021/022641 WO2021256458A1 (ja) 2020-06-17 2021-06-15 カラーチャート

Publications (1)

Publication Number Publication Date
US20230258501A1 true US20230258501A1 (en) 2023-08-17

Family

ID=79190961

Family Applications (1)

Application Number Title Priority Date Filing Date
US18/010,596 Pending US20230258501A1 (en) 2020-06-17 2021-06-15 Color chart

Country Status (7)

Country Link
US (1) US20230258501A1 (ja)
EP (1) EP4170304A4 (ja)
JP (1) JP6981561B1 (ja)
KR (1) KR20230025380A (ja)
CN (1) CN115516284A (ja)
CA (1) CA3182622A1 (ja)
WO (1) WO2021256458A1 (ja)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP7334004B1 (ja) * 2022-02-10 2023-08-28 弘子 内藤 デジタルカラー診断システム及びデジタルカラー診断方法

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2001260407A (ja) * 2000-03-22 2001-09-25 Konica Corp 画像処理装置校正用カラーチャート、校正用色彩データ作成方法および校正用色彩データ処理方法ならびに画像処理装置
US7006246B1 (en) * 1999-09-17 2006-02-28 Canon Kabushiki Kaisha Image processing method, apparatus, recording medium and chart therefor

Family Cites Families (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH0646448A (ja) 1992-07-21 1994-02-18 Sony Corp 画像処理方法および装置
WO2004044639A1 (ja) * 2002-10-18 2004-05-27 Hamamatsu Photonics K.K. スライドガラス、カバーガラス及び病理診断システム
US20080068625A1 (en) * 2006-09-15 2008-03-20 Eastman Kodak Company Image control system and method incorporating a graininess correction
US7856118B2 (en) * 2007-07-20 2010-12-21 The Procter & Gamble Company Methods for recommending a personal care product and tools therefor
GB201000835D0 (en) * 2010-01-19 2010-03-03 Akzo Nobel Coatings Int Bv Method and system for determining colour from an image
US8915435B2 (en) * 2013-01-25 2014-12-23 Hewlett-Packard Development Company, L.P. Characterization of color charts
US20140232923A1 (en) * 2013-02-20 2014-08-21 Hewlett-Packard Development Company, Llp Device independent color differences
WO2015005152A1 (ja) * 2013-07-09 2015-01-15 Ｄｉｃグラフィックス株式会社 色見本生成システム、色見本生成方法及びそのプログラム
US9824441B2 (en) * 2014-04-15 2017-11-21 Gauss Surgical, Inc. Method for estimating a quantity of a blood component in a fluid canister
JP6455764B2 (ja) * 2014-05-30 2019-01-23 パナソニックＩｐマネジメント株式会社 色補正パラメータ算出方法、色補正パラメータ算出装置および画像出力システム
US10267683B2 (en) * 2014-11-14 2019-04-23 Konica Minolta, Inc. Colorimetry device and colorimetry method having a patch quantity comparison processing unit and a second position correction processing unit
US10502627B2 (en) * 2015-04-06 2019-12-10 Konica Minolta, Inc. Color measuring device and color measuring method
EP3121571A1 (en) * 2015-07-22 2017-01-25 Archroma IP GmbH Color sample device for providing color information, method for its production and data processing apparatus for reading the color information

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7006246B1 (en) * 1999-09-17 2006-02-28 Canon Kabushiki Kaisha Image processing method, apparatus, recording medium and chart therefor
JP2001260407A (ja) * 2000-03-22 2001-09-25 Konica Corp 画像処理装置校正用カラーチャート、校正用色彩データ作成方法および校正用色彩データ処理方法ならびに画像処理装置

Also Published As

Publication number Publication date
WO2021256458A1 (ja) 2021-12-23
JP6981561B1 (ja) 2021-12-15
EP4170304A4 (en) 2024-07-10
CN115516284A (zh) 2022-12-23
CA3182622A1 (en) 2021-12-23
KR20230025380A (ko) 2023-02-21
EP4170304A1 (en) 2023-04-26
JP2022000623A (ja) 2022-01-04

Similar Documents

Publication Publication Date Title
Dimauro et al. A new method and a non-invasive device to estimate anemia based on digital images of the conjunctiva
US8319857B2 (en) Apparatus and method for correcting digital color photographs
WO2016136698A1 (ja) 画像処理装置
US20040151379A1 (en) Method of digital image analysis for isolating a region of interest within a tongue image and health monitoring method and apparatus using the tongue image
EP3100672A1 (en) Organ image capturing device
US20100041968A1 (en) Image capture in combination with vital signs bedside monitor
US20230239419A1 (en) Image display system and image display method
KR20140130879A (ko) 소변 검사 방법 및 관련 장치
WO2012038474A1 (en) Determining the colour of teeth
US20230258501A1 (en) Color chart
US20170238843A1 (en) Degree-of-health outputting device, degree-of-health outputting system, and program
KR20180072021A (ko) 퍼스널 컬러 진단 시스템 및 퍼스널 컬러 진단 방법
CN102419861A (zh) 基于均匀色空间拓扑剖分的彩色图像校正方法
TW201501070A (zh) 黃疸自動分析檢測方法及電腦程式產品
US12022048B2 (en) Display unit color-correction method
KR101341065B1 (ko) 3파장 영상을 이용한 설진 영상 처리 방법
KR102399939B1 (ko) 검출 방법 및 검출 패드
KR102226943B1 (ko) 검출 방법 및 검출 패드
KR20140135921A (ko) 소변 검사용 소변 스트랩
US20160242678A1 (en) Organ image photographing apparatus
KR20180061629A (ko) 영상을 이용한 피부 상태 평가 방법 및 영상을 이용한 피부 상태 평가 장치
CN215778014U (zh) 一种舌象颜色校正色卡
TW202321672A (zh) 色度量測方法及裝置

Legal Events

Date Code Title Description
AS Assignment

Owner name: DIC CORPORATION, JAPAN

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:TAKAHASHI, MASATO;MORIHARA, YASUHIRO;TSUMURA, NORIMICHI;AND OTHERS;SIGNING DATES FROM 20221130 TO 20221208;REEL/FRAME:062432/0168

STPP Information on status: patent application and granting procedure in general

Free format text: DOCKETED NEW CASE - READY FOR EXAMINATION

STPP Information on status: patent application and granting procedure in general

Free format text: NON FINAL ACTION MAILED

STPP Information on status: patent application and granting procedure in general

Free format text: RESPONSE TO NON-FINAL OFFICE ACTION ENTERED AND FORWARDED TO EXAMINER

STPP Information on status: patent application and granting procedure in general

Free format text: NOTICE OF ALLOWANCE MAILED -- APPLICATION RECEIVED IN OFFICE OF PUBLICATIONS

STPP Information on status: patent application and granting procedure in general

Free format text: PUBLICATIONS -- ISSUE FEE PAYMENT VERIFIED

STPP Information on status: patent application and granting procedure in general

Free format text: AWAITING TC RESP., ISSUE FEE NOT PAID

STPP Information on status: patent application and granting procedure in general

Free format text: NOTICE OF ALLOWANCE MAILED -- APPLICATION RECEIVED IN OFFICE OF PUBLICATIONS

STPP Information on status: patent application and granting procedure in general

Free format text: PUBLICATIONS -- ISSUE FEE PAYMENT VERIFIED