WO2008108761A1 - True color communication - Google Patents
True color communication Download PDFInfo
- Publication number
- WO2008108761A1 WO2008108761A1 PCT/US2007/005759 US2007005759W WO2008108761A1 WO 2008108761 A1 WO2008108761 A1 WO 2008108761A1 US 2007005759 W US2007005759 W US 2007005759W WO 2008108761 A1 WO2008108761 A1 WO 2008108761A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- color
- reference color
- image
- image capture
- present
- Prior art date
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N1/00—Scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission; Details thereof
- H04N1/46—Colour picture communication systems
- H04N1/56—Processing of colour picture signals
- H04N1/60—Colour correction or control
- H04N1/6083—Colour correction or control controlled by factors external to the apparatus
- H04N1/6086—Colour correction or control controlled by factors external to the apparatus by scene illuminant, i.e. conditions at the time of picture capture, e.g. flash, optical filter used, evening, cloud, daylight, artificial lighting, white point measurement, colour temperature
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N1/00—Scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission; Details thereof
- H04N1/46—Colour picture communication systems
- H04N1/56—Processing of colour picture signals
- H04N1/60—Colour correction or control
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N1/00—Scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission; Details thereof
- H04N1/46—Colour picture communication systems
- H04N1/56—Processing of colour picture signals
Definitions
- Embodiments of the present invention are related to accurately capturing and conveying the color of a subject.
- processing parameters of the image capture and image display devices are pre-set by the manufacturers.
- the manufacturers adjust these parameters so that the created image looks "good” so that the user will be satisfied with the result.
- This is referred to as the "photofinishing or preferred reproduction model” as opposed to the “colorimetric reproduction model” which seeks to convey the correct colors of a subject.
- many digital cameras perform an operation called “white balancing” that adjusts the imaging parameters so that the overall average color of an image is, for example, that of a half- brightness gray image (50% gray). This assumes that the view imaged is in fact 50% gray, which is rarely true.
- white balancing is an arbitrary adjustment that works qualitatively to produce a viewable image, but not quantitatively to produce a correctly depicted image.
- the darkest and lightest depicted values (e.g., black and white levels) in an image are usually clipped by an analysis of the distribution of brightness levels observed.
- the clipping is done to ensure good use of the available signal range.
- a pre-specified percentage of, for example, dark and light values are clipped and mapped to the same value (e.g., to zero or a maximum value). Values in between are then scaled through the available range. However, this scaling may distort the true color spectra in order to make the resulting image more appealing.
- These adjustments are usually pre-defined by the manufacturer and applied uniformly to all of the acquired images.
- the processing parameters of the digital camera do not address rendering the "true" color of the items in the view, since this cannot be determined without other information.
- the ambient lighting conditions present when an image is captured can distort the overall coloration of an image. For example, if a picture is taken indoors, the light radiated by lighting fixtures may be weighted in a particular range of the color spectrum. For example, fluorescent lighting emits light with a slightly bluish tint. Thus, a picture taken in the presence of fluorescent lighting will be distorted by the ambient light and will depict the subject with more blue tones than may actually be present.
- a controlled environment may be provided in which the image processing parameters of the image capture equipment is carefully calibrated and monitored. These controlled environments also rely upon carefully calibrated and controlled lighting so that any distortions generated by the ambient lighting and image processing equipment are either known, or minimized.
- Embodiments of the present invention recite a system and method for conveying the true color of a subject.
- the present invention comprises an • image capture device, an imaged reference color set comprising at least one reference color, and a control reference color set comprising at least one control color corresponding to the at least one reference color.
- the present invention further comprises a color correction component for accessing the control reference color set and the imaged reference color set and for generating a color correction function which eliminates a discrepancy between the at least one reference color and the at least one control color.
- FIGURE 1 is a flowchart of a method for conveying the true color of a subject in accordance with embodiments of the present invention.
- FIGURES 2A 1 2B, and 2C shows exemplary image capture systems used in accordance with embodiments of the present invention.
- FIGURE 3 shows an exemplary color reference set used in embodiments of the present invention.
- FIGURE 4 is a block diagram of a color correction component in accordance with embodiments of the present invention.
- FIGURE 5 is a block diagram of an exemplary computer system upon which embodiments of the present invention may be implemented.
- FIG. 1 is a flowchart of a method 100 for conveying the true color of a subject in accordance with embodiments of the present invention.
- an imaged reference color set comprising at least one reference color is accessed.
- an image is captured which comprises a set of reference colors.
- the imaged reference color set may be the only object in the captured image, or may also be in a captured image of a subject.
- the subject may be any person, place, or thing whose image can be captured.
- the quality and spectral characteristics of light falling on a given subject affect the subject's appearance to a camera and thus on the image generated by the camera.
- the camera itself through physical characteristics of its design and fabrication of its sensor, and also through internal processing characteristics of the camera, introduces further alteration in the perceived coloration of the subject. These effects combine to make coloration metrics of the imaged subject highly dubious.
- embodiments of the present invention may facilitate determining a transformation from the observed color space of the captured image to a reference or "true" color space that is independent of the ambient lighting conditions and image processing capabilities of the camera which captures the image.
- a control reference color set comprising at least one control color corresponding to the at least one reference color is accessed.
- the true color space is represented by a control reference color set comprising a color or colors that correspond with the color or colors of the imaged reference color set.
- the control reference color set may comprise a logical reference color set in which the spectral reflectance and color signal values of reference color set in the captured image are accessed, rather than an actual physical entity.
- a color correction function is generated which eliminates a discrepancy between the at least one reference color and the corresponding control color.
- a transformation, or "color correction function” which accounts for the discrepancy between the characteristics of the imaged reference color set and the control reference color set. This color correction function directly compensates for the combined effect of the ambient lighting in the room and the color transformation of the acquiring camera.
- embodiments of the present invention detect the imaged reference color set within the image and measure the observed characteristics of the imaged reference color set. Embodiments of the present invention then determine a color correction function that brings color descriptions of the imaged reference color set closer to the color values of control reference color set. This color correction function can then be applied to the captured image, or subsequently captured images so that the colors in the images more accurately convey the true colors of a subject.
- embodiments of the present invention can infer the combined effects of the ambient lighting conditions at the location at which the image is captured as well as device characteristics and the image processing capabilities of the image capture system. These combined effects are then substantially eliminated from the image such that a more accurate representation of the color of the subject can be conveyed.
- the color correction function may be generated and applied by the image capture device itself, by a device displaying an image, as a service by a third party, or any combination thereof.
- Figure 2A shows an exemplary image capture system 200 used in conjunction with embodiments of the present invention.
- system 200 comprises an image capture device 201 , an imaged reference color set 202, a control reference color set 203, and a color correction component 204.
- imaged reference color set 202 further comprises at least one reference color 202a and a unique identification 202b.
- control reference color set 203 further comprises at least one control color 203a that corresponds with the at least one reference color 202a as well as a corresponding identification 203b that corresponds with unique identification 202b.
- color correction component 204 is for accessing imaged reference color set 202 and control reference color set 203. More specifically, color correction component 204 compares reference color 202a with control color 203a to determine how the colors of imaged reference color set 202 have been transformed due to the ambient lighting conditions and the image processing parameters of image capture device 201. Color correction component 204 then generates a color correction function (e.g., 210) which eliminates the discrepancy between reference color 202a and control color 203a, if any exists.
- a color correction function e.g., 210
- system 200 further comprises an applicator 205 which is coupled with color correction component 204.
- applicator 205 applies the color correction function 210 generated by color correction component 204 to an image (e.g., 206) to create a modified image 207.
- image e.g., 206
- applicator 205 applies the color correction function 210 generated by color correction component 204 to an image (e.g., 206) to create a modified image 207.
- the term "eliminated” means that the difference between a reference color in imaged reference color set 202 (e.g., in modified image 207) and control reference color set 203 is either outside the detection parameters of system 200 or within an accepted variation value.
- imaged reference color set 202 may be captured in the same image 206 as subject 211.
- imaged reference color set 202 may be captured in a separate image than the image 206 in which subject 211 is captured. This may be advantageous in situations in which it may not be desired to show imaged reference color set 202 in the same image as subject 211.
- the photographer may not want imaged reference color set 202 to be seen in a portrait of subject 211.
- the photographer may capture a first image of imaged reference color set 202 which is used in determining color correction function 210. Subsequently captured images of subject 211 are then processed using the color correction function 210 previously generated by color correction component 204.
- system 200 further comprises a data storage device 208 for storing color correction function 210 and one or more images (e.g., image 206, modified image 207, etc.). It is noted that in embodiments of the present invention, the ambient lighting conditions and image processing capabilities which capture the separate images should be substantially the same in order to derive an accurate color correction function 210.
- color correction component 204, applicator 205, and data storage device 208 may be implemented as a discrete color correction system, or as a network of communicatively coupled components.
- functions of color correction component 204, • applicator 205, and data storage device 208 may be performed as a service by a third party service provider, or the provider of network 209.
- color correction component 204, applicator 205, and data storage device 208 may be implemented as components of image capture device 201.
- applicator 205 is disposed upon image capture device 201 which is communicatively coupled with color correction component 204 and data storage device 208.
- image capture device 201 receives color correction function 210 via network 209 and applies it to image 207 to create modified image 207.
- color correction component 204, applicator 205, and control reference color set 203 may be implemented as a removable component (e.g., of image capture device 201) using removable media such as a smart card or other removable data storage device.
- image capture device 201 does not require a controlled infrastructure when capturing image 206.
- image capture device 201 may be a subject's personal computer system, digital camera, or a cellular telephone capable of generating photographs (e.g., referred to herein as a "picture phone").
- calibrated equipment e.g., calibrated cameras and calibrated lighting
- embodiments of the present invention may utilize the subject's personal equipment to capture image 206.
- image 206 there is no requirement for image 206 to be captured in an environment in which the ambient lighting conditions are known or controlled as long as the lighting conditions are sufficient for color correction component 204 to process the image.
- image 206 may even be captured in a variety of environments including, for example, outdoors, or in the home of subject 211.
- Embodiments of the present invention are advantageous in that they do not require a controlled infrastructure because color correction component 204 utilizes the received image of imaged reference color set 202 to infer the ambient lighting conditions and image processing parameters of image capture device 201.
- color correction component 204 may compare color descriptions of colors comprising imaged reference color set 202 with color descriptions of corresponding colors from control reference color set 208.
- embodiments of the present invention do not rely upon calibrated cameras or calibrated lighting when capturing an image of subject 211. By performing this analysis, color correction component 204 can infer the combined effects of the ambient lighting conditions of the location at which subject 211 is located and the image processing capabilities of image capture device 201.
- Color correction component 204 can then determine what adjustments are necessary so that the received spectral reflectance and color signal values of imaged reference color set 202 correspond with the known spectral reflectance and color signal values of the control reference color set 203. Color correction component 204 can thus compensate for distortions of the image induced by ambient lighting conditions and the image processing parameters of image capture device 201 when capturing the image and, based on this analysis, infer the correct colors for depicting subject 211. While the present invention recites that a controlled infrastructure is not required, embodiments of the present invention may be used in conjunction with a controlled infrastructure as well.
- image capture device 201 may comprise personal property of subject 211 such as a printer, scanner, picture phone, a digital camera, a personal digital assistant (PDA), a personal computer system, a digital video recorder, or a similar device capable of capturing an image.
- PDA personal digital assistant
- embodiments of the present invention may also be used in proprietary systems in which a manufacturer provides a kiosk or other automated system for providing product consultation.
- network 209 comprises a dial-up Internet connection, a public switched telephone network (PSTN), a high-speed network connection (e.g., cable Internet, or high-speed computer network), or the like.
- PSTN public switched telephone network
- image capture device 201 may utilize a cellular telephone connection, a satellite telephone connection, a radio connection, an infra-red communication connection, or other type of wireless communication.
- accurate presentation of the true colors to an observer is as important as capturing the true colors of subject 211.
- embodiments of the present invention may be used to adjust a display so that the colors shown by the display are as desired. In other words, eliminating chromatic distortion created by a display device is also important in conveying the true color of a subject.
- the data accessed by the display may be described as "raw” data that has not yet been processed as described above with reference to Figure 2A.
- the data accessed by the display may be described as "processed” data that has been processed as described above with reference to Figure 2A.
- color correction component 204 may also examine imaged reference color set 202 for a geometric pattern to determine if the lens of image capture device 201 is introducing geometric flaws into image 206. If a geometric flaw is detected in image 206, colorcorrection function may also comprise a transform function for correcting this flaw in modified image 207.
- FIG. 2B shows another exemplary image capture system used in accordance with embodiments of the present invention.
- the data accessed by the display device can be described as "processed" data that has been processed as described above with reference to Figure 2A to represent "true" color.
- a display device 220 generates a display 221.
- display 221 may comprise a printed display, a projected display, a digitally generated display, or the like.
- imaged reference color set 202 is shown in display 221 and a physical control reference color set 222 is disposed proximate thereto.
- imaged reference color set 202 may comprise reference color 202a and unique identification 202b as described above with reference to Figure 2A.
- physical control reference color set 222 may further comprise a physical reference color 222a and corresponding identification 222b. It is noted that the spectral reflectance and color signal values of physical reference color 222a may correspond with the spectral reflectance and color signal values of control reference color set 203 as described above with reference to Figure 2A.
- the ambient lighting conditions and image processing parameters of image capture device 201 may be determined first prior to processing the imaged reference color set 202 shown in display 221.
- color correction component 204 compares physical reference color 222a with control color 203a to determine how the colors of imaged reference color set 202 have been transformed due to the ambient lighting conditions and the image processing parameters of image capture device 201.
- Color correction component 204 can then determine what adjustments are necessary so that the received spectral reflectance and color signal values of physical control reference color set 222 correspond with the known spectral reflectance and color signal values of the control reference color set 203.
- Color correction component 204 then generates color correction function 210 which compensates for distortions of the image induced by the ambient lighting conditions or the image processing parameters of image capture device 201 when capturing the image of physical control reference color set 222.
- imaged reference color set 202 and physical control reference color set 222 are then simultaneously imaged by image capture device 201.
- image 202 is a "true" color depiction of a provided control reference color set 203'
- captured image 206 is conveyed to color correction component 204 where a color correction function is generated based upon a comparison of imaged reference color set 202 and control reference color set 203'.
- color correction component 204 when a discrepancy between imaged reference color set 202 and control reference color set 203' is detected by color correction component 204, a second color correction function 225 is generated which eliminates the discrepancy between imaged reference color set 202 and control reference color set 203'.
- color correction component 204, or applicator 205 may comprise a color adjustment generator for . controlling at least one color control of display 221.
- applicator 205 may generate an adjustment 223 in response to second color correction function 225 which causes a change in one of the color controls of display 221 which eliminates any discrepancy between the reference color(s) of imaged reference color set 202 and control reference color set 203'.
- embodiments of the present invention determine a first transform function (e.g., color correction function 210) between physical control reference color set 222 and its correct photometric appearance for viewing.
- a second transform function (e.g., second color correction function 225) between control reference color set 203' and imaged reference color set 202 is determined.
- the mapping from the display to the correct viewing in an image can be determined from an appropriate combination of these two transforms.
- Color correction function 210 accounts for the combined effects of illumination and image capture parameters on the observed colors of physical control reference color set 222.
- Second color correction function 225 accounts for the combined effects of illumination, display parameters of display device 220, and image capture parameters.
- an inverse product process of color correction function 210 with second color correction function 225 can be made to determine the effects of the display parameters of display device 220.
- the output of display device 220 can then be controlled by system 200 such that the ambient lighting conditions at display device 220 as well the display processing parameters of display device 220 do not affect the representation of colors in display 221.
- the image displayed by display device 220 is now independent of the ambient lighting conditions and the image processing capabilities of the camera which captures the image and the true colors of a subject can be accurately conveyed by system 200.
- control reference color set 203' as applied to the displayed image 202 need not differ from the reference set 203 as applied to physical control reference color set 222.
- color correction component 204, applicator 205, and data storage device 208 may be implemented as a discrete color correction system, or as a network of communicatively coupled components. In embodiments of the present invention, functions of color correction component 204, applicator 205, and data storage device 208 may be performed as a service by a third party service provider, or the provider of network 209.
- color correction component 204, applicator 205, and data storage device 208 may be implemented as components of image capture device 201 or display device 220. It is noted that this process may occur once as a calibration step of display device 220, as an iterative or feedback cycle for constantly adjusting the color control of display device 220, or as an adjustment to the accessed color representation of image 202 such that the resulting display of 202 in 221 is within acceptable tolerance of the "true" control reference color set 203'.
- the data (e.g., modified image 207) accessed by display device 220 can be described as "synthesized" data that has been generated to conform with the control color reference set 203 to match the "true" color of physical control reference color set 202.
- modified image 207 and imaged reference color set 202 are simultaneously imaged by image capture device 201.
- this image 206 is conveyed to color correction component 204 where a color correction function is generated based upon a comparison of the two reference color sets visible in modified image" 207 —the displayed image 207 and reference color set 202.
- color correction component 204 may comprise a color adjustment generator for controlling at least one color control of display 221.
- applicator 205 may generate an adjustment 223 in response to second color correction function 225 which causes a change in one of the color controls of display 221 which eliminates any discrepancy between the reference color(s) of modified image 207 and reference color set 202.
- modified image 207 should represent the 'true" color values of control reference color set 202, any discrepancy between them is indicative of distortions in the colors shown in display 221.
- modified image 207 when shown in display 221 , may be used as a reference color set for determining color correction 225.
- a transform function e.g., color correction function 225
- Any discrepancies between these color values will indicate the distortions in color representation due to characteristics of the display device 220.
- the output of display device 220 can then be controlled by system 200 such that the display processing parameters of display device 220 do not present deviation from the colors of reference color set 202 in the representation of colors in display 221.
- the image displayed by display device 220 is now consistent with the desired "true" color set 202. How truly consistent the display is will depend upon the gamut of the display device, in other words, its ability to accurately render the desired colors.
- color correction component 204, applicator 205, and data storage device 208 may be implemented as a discrete color correction system, or as a network of communicatively coupled components.
- functions of color correction component 204, applicator 205, and data storage device 208 may be performed as a service by a third party service provider, or the provider of network 209.
- color correction component 204, applicator 205, and data storage device 208 may be implemented as components of image capture device 201 or display device 220.
- this process may occur once as a calibration step of display device 220, as an iterative or feedback cycle for constantly adjusting the color control of display device 220, or as an adjustment to the accessed color representation of image 207 such that the resulting display of 207 in 221 is within acceptable tolerance of the "true" color set 202.
- feedback from the analysis of image 206 may be used to adjust internal sensor and actuator settings.
- image capture device 201 to optimize its register settings (e.g., gain, exposure, brightness, black and dark level, saturation, contrast, etc.) so that the resulting capture of images best represents the true color values.
- the controls of display device 220 can be adjusted to optimize its output of display 221 , or the colors presented could be transformed to yield their best display given the system's effects.
- Figure 3 shows an exemplary imaged reference color set 202 used in embodiments of the present invention. It is noted that while the following discussion recites regions of imaged reference color set 202 comprising a color or colors, for the sake of clarity, these colors have been omitted from Figure 3. In embodiments of the present invention, imaged reference color set 202 is designed for robust automatic detection by color correction component 204.
- imaged reference color set 202 comprises a plurality of color patches (e.g., 301 -324) which are arrayed in 3 rows of 8 color patches each.
- Color patches 301-324 comprise the reference color(s) 202a described above with reference to Figures 2A, 2B, and 2C.
- color patches 301-324 are set against a black background 330 which is bounded by a white border 340 and a black border 350.
- color correction component 204 uses a detection algorithm to identify a pattern consistent to that produced by bounding black background 330 with white border 340.
- Black border 350 is used to facilitate identifying white border 340.
- imaged reference color set 202 may comprise a checkerboard pattern, stripes, or background in which the colors represented by color patches 301-324 are embedded into wall paper, wall hangings, rugs, etc.
- imaged reference color set 202 may comprise continuous color variations over a desired color range, such as a spectrum or rainbow of colors. Sampling of colors from a continuous range may comprise sampling the entire range of colors, or sampling discreet regions of the continuous range.
- Figure 3 shows a rectangular array, color patches 301-324 may be disposed in a circular pattern, a triangular pattern, a square pattern, etc. as well.
- color patches 301 -308 comprise primary and secondary colors for general scene tone balancing and two shades of gray plus black and white for white balancing.
- Color patches 309-324 comprise sixteen color patches representative of a selected range of colors.
- color patches 309-324 comprise a range of human skin colors.
- the color descriptions of control reference color set 203 are known to color correction component 204 and are used as the reference or "true," color space, independent of lighting and image capture device characteristics, to which imaged reference color set 202 is compared.
- the spectral reflectances of each color patch (e.g., 301-324) is measured and then approximated as a 3-component standard red, green, blue (sRGB) encoded digital value.
- sRGB standard red, green, blue
- These encoded signal values are then compared with the corresponding 3-component signal values of the control colors (e.g., 203a) of control reference color set 203.
- imaged reference color set 202 comprises a unique identification 202b.
- unique identification 202b may comprise any symbol, letter, word, pattern, number, barcode, radio frequency identification (RFID) tag, etc. that is recognizable to image capture device 201.
- RFID radio frequency identification
- embodiments of the present invention facilitate identifying the control reference color set 203 whose color characteristics correspond with the color patches 301-324. This is advantageous remotely accessing (e.g., by image capture device 201) the control reference color data that corresponds with imaged reference color set 202.
- image capture device 201 or display device 220, comprises a color correction component 204
- the control reference color set 203 that corresponds with imaged reference color set 202 can be identified, using corresponding identification 203b, and downloaded.
- a carrier or service provider can quickly identify the color characteristics that correspond with a particular imaged reference color set 202.
- FIG 4 is a block diagram of a color correction system 400 for providing true color correction in accordance with embodiments of the present invention.
- color correction component 204 comprises a first accessor 401 for accessing an imaged reference color set and a second accessor 402 for accessing a control reference color set 203. It is appreciated that in embodiments of the present invention, a single accessor may be operable for accessing both color correction component 204 and control reference color set 203.
- color correction system 400 further comprises a function generating component 403 coupled with first accessor 401 and second accessor 402 for generating a color correction function (e.g., 210).
- first accessor 401 , second accessor 402, input 404, output 405, and function generating component 403 may perform the functionality of color correction component 204 described above with reference to Figures 2A, 2B, and 2C.
- system 400 further comprises applicator 205 for applying color correction function 210 to an image and a data storage device 208 for storing data. It is noted that in embodiments of the present invention, applicator 205 may output modified color values of the pixels of image 206 rather than a modified image as described above.
- system 400 further comprises a color adjustment generator 406 for generating an adjustment to at least one color control of a display device, and a display output 407 that is coupled with color adjustment generator 406 and a display device (e.g.. 220 of Figures 2B and 2C).
- a color adjustment generator 406 for generating an adjustment to at least one color control of a display device
- a display output 407 that is coupled with color adjustment generator 406 and a display device (e.g.. 220 of Figures 2B and 2C).
- color correction component 204 performs an automatic detection of a target pattern (e.g., imaged reference color set 202).
- a monochrome (e.g., a luminance only) version of the color image is filtered using, for example, a Laplacian filter. This determines the locus of maximal brightness change in the image (e.g., between the color patches 301-324 and background 330, or between white border 340 and black border 350). The locus of zero-crossing positions observed in the Laplacian output are then connected, where possible, into a set of closed contours. .
- Each of the closed contours is then approximated by a sequence of linear segments, which may be determined through a successive bisection operation based on deviation of the contour from a straight line.
- "Rectangle candidates" are accepted for those contours whose segmentation (as above) results in four major pieces whose relationships are consistent with the projection of a planar rectangle (i.e., opposing sides are consistent with being parallel and adjacent sides are consistent with being orthogonal)
- a contour "rectangle candidate” is located whose contrast is indicative of a darker exterior (e.g., black border 350) and lighter interior (e.g., white border 340).
- a contour "rectangle candidate” is located inside the above contour whose contrast is indicative of a lighter exterior (e.g., white border 340) and a darker interior (e.g., black background 330).
- the above contour e.g., the edge of black background 330
- a set of "rectangle candidate" contours e.g., color patches 301-324
- contrasts are indicative of lighter interiors set inside a darker exterior.
- each of color patches 301- 324 are lighter than the black background 330 in which they are positioned.
- a determination is made of the transformation that maps the outer two "rectangle candidate" contours (e.g., black border 350 and white border 340) to true rectangles of correct aspect and relationship based upon the known values of these contours from the reference target description.
- the interior contours e.g., of color patches 301-324
- the interior contours are also of the correct aspect ratio and at consistent locations when transformed by the above transformation (based upon the known values of the contours of the color patches). It is noted that some of the color patches may have contrast values that inhibit their detection in a given image 202. However, in embodiments of the present invention, if a sufficient number of interior color patches are detected (e.g., a suitable measure of "sufficiency" might be 90%), then the reference target is accepted as being detected. In embodiments of the present invention, the color values inside the above-detected and validated color patches are sampled and used as the sample values for establishing the true-color transformation performed by color correction component 204.
- orientation of imaged reference color set 202 may be determined by assessing the arrangement of the color patches 301-324 themselves.
- distinctive markings e.g., a geometric pattern, or a geometric pattern of color patches 301-324
- color correction component 204 may also validate the imaged reference color set 202 upon detection to ensure the fidelity of color patches 301 -324 in imaged reference color set 202. For example, if color patches 301 -324 fade, or become discolored due to staining, the results of sampling the color patches by color correction component 204 may become skewed. As a result, an incorrect estimation of the color correction function 210 by color correction component 204 may result. Thus, in embodiments of the present invention, color correction component 204 may validate the age or version of imaged reference color set 202. In another embodiment, unique identification 202b may be used to determine when imaged reference color set 202 was created and thus determine whether it is still valid.
- one or more of the inks used to create imaged reference color set 202 may be selected to fade after a given amount of time. As a result, portions of imaged reference color set 202 may become unrecognizable to color correction component 204 which prevents further estimation of the color correction function from imaged reference color set 202. In another embodiment, fading of one or more of the inks may cause a message to be displayed which tells a user that imaged reference color set 202 has expired and that a new version will be needed.
- color correction component 204 upon determining that the imaged reference color set 202 is a valid copy, estimates the color transformation, also referred to as a "transform function", between the color space of imaged reference color set 202 and the control reference color set 203 to determine color correction function 210.
- a least-squares estimation is used to derive a color correction function Fin the form of 3 x 4 matrix, that maps measured patch mean colors M (e.g., from one or more of color patches 301-324) from imaged reference color set 204 to corresponding control color values R in control reference color set 203.
- the measured patch mean color values may be processed through an inverse-gamma function to remove the effects of device non-linear contrast adjustment.
- the matrix results in a transform function F a 3 x 3 color transformation matrix plus an additive per-color-component offset.
- patch mean colors with at least one saturated component are excluded, and the sRGB color component function is inverted for both M and R.
- the measured patch mean color values may be processed through an inverse-gamma function to remove the effects of device non-linear contrast adjustment.
- a 3 x 4 matrix may be used to determine the color correction function
- embodiments of the present invention are not limited to linear algebra to determine this function.
- the color correction function 210 can take any functional form.
- all of the color patches from imaged reference color set 202 may be measured and used to determine the color correction function 210).
- the color patches may be selectively sampled. For example, in one embodiment, only the color patches (e.g., 301-308) of the primary, secondary, and ' monochrome colors (e.g., blue, green, red, cyan, magenta, yellow, and gray shades) are used to determine color correction function 210.
- Embodiments of the present invention may also sample white tones from white border 340 and black tones from background 330 or black border 350.
- all of the color patches e.g., color patches 309-324) as well as black, white, and gray tones are sampled in order to determine color correction function 210.
- only the color patches e.g., color patches 309-324) are sampled to determine color correction function 210.
- sampling all of the imaged color patches from the imaged reference color set 202 may result in a color correction function 210 that is best suited for correcting the colors of the overall image, but is not necessarily best suited for correcting the imaged color of subject 211.
- dense sampling of the color region of interest e.g., the red tones of the car
- color correction component 204 determines a color correction function 210 which substantially eliminates discrepancies between the imaged reference color set 202 and the control reference color set 203. If we denote color correction function 210, in any functional form, as F, then this can be expressed by the equation:
- color correction function 210 attempts to accurately convey the colors of image 206 by compensating for the effects of the ambient lighting conditions and of image capture device 201. It is noted that color correction 210 may only be approximate. For example, the color correction function F may not map each acquired image color from imaged reference color set 202 to its exact corresponding reference color in control reference color set 203. Furthermore, it is appreciated that F may lack the degree of precision necessary to cause an exact match to a reference color in control reference color set 203 when applied to the corresponding color in imaged reference color set 202.
- the phrase "substantially eliminates” means that, after F has been applied to the color value 412 of the identified skin pixels of image 206 (e.g., or color descriptions thereof), the difference between the color of subject 211 and the corrected color of subject 211 represented by modified image 207 is not readily discemable, or is within an acceptance parameter.
- FIG. 5 is a block diagram of an exemplary computer system 500 upon which embodiments of the present invention may be implemented.
- portions of the present invention are comprised of computer-readable and computer-executable instructions that reside, for example, in computer system 500 which is used as a part of a general purpose computer network (not shown).
- computer system 500 of Figure 5 is exemplary only and that the present invention can operate within a number of different computer systems including general-purpose computer systems, embedded computer systems, laptop computer systems, hand-held computer systems, networked computer systems, and stand-alone computer systems.
- computer system 500 includes an address/data bus
- computer system 500 may also include a data storage device 505 (e.g., a magnetic, optical, floppy, or tape drive or the like) for storing vast amounts of data.
- data storage device 505 e.g., a magnetic, optical, floppy, or tape drive or the like
- the software program for performing skin color estimation of the present invention can be stored either in volatile memory 503, data storage device 505, or in an external storage device (not shown).
- Computer system 500 Devices which are optionally coupled to computer system 500 include a display device 506 for displaying information to a computer user, an alpha-numeric input device 507 (e.g., a keyboard), and a cursor control device 508 (e.g., mouse, trackball, light pen, etc.) for inputting data, selections, updates, etc.
- Computer system 500 can also include a mechanism for emitting an audible signal (not shown).
- optional display device 506 of Figure 5 may be a liquid crystal device, cathode ray tube, or other display device suitable for creating graphic images and alpha-numeric characters recognizable to a user.
- Optional cursor control device 508 allows the computer user to dynamically signal the two dimensional movement of a visible symbol (cursor) on a display screen of display device 506.
- cursor control device 508 are known in the art including a trackball, mouse, touch pad, joystick, or special keys on alpha-numeric input 507 capable of signaling movement of a given direction or manner displacement.
- a cursor can be directed and activated via input from alpha-numeric input 507 using special keys and key sequence commands.
- the cursor may be directed and activated via input from a number of specially adapted cursor directing devices.
- computer system 500 can include an input/output (I/O) signal unit
- computer system 500 may be coupled in a network, such as a client/server environment, whereby a number of clients (e.g., personal computers, workstations, portable computers, minicomputers, terminals, etc.) are used to run processes for performing desired tasks.
- computer system 500 can be coupled in a system for estimating skin color from a single captured image.
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Facsimile Image Signal Circuits (AREA)
- Image Processing (AREA)
- Color Image Communication Systems (AREA)
- Color Television Image Signal Generators (AREA)
- Processing Of Color Television Signals (AREA)
Abstract
Description
Claims
Priority Applications (5)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2009552648A JP2010521098A (en) | 2007-03-08 | 2007-03-08 | True color communication |
KR1020097021027A KR101099844B1 (en) | 2007-03-08 | 2007-03-08 | True color communication |
PCT/US2007/005759 WO2008108761A1 (en) | 2007-03-08 | 2007-03-08 | True color communication |
CN200780052908A CN101669356A (en) | 2007-03-08 | 2007-03-08 | True color communication |
EP07752455A EP2127357A1 (en) | 2007-03-08 | 2007-03-08 | True color communication |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
PCT/US2007/005759 WO2008108761A1 (en) | 2007-03-08 | 2007-03-08 | True color communication |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2008108761A1 true WO2008108761A1 (en) | 2008-09-12 |
Family
ID=38514973
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/US2007/005759 WO2008108761A1 (en) | 2007-03-08 | 2007-03-08 | True color communication |
Country Status (5)
Country | Link |
---|---|
EP (1) | EP2127357A1 (en) |
JP (1) | JP2010521098A (en) |
KR (1) | KR101099844B1 (en) |
CN (1) | CN101669356A (en) |
WO (1) | WO2008108761A1 (en) |
Families Citing this family (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
KR20180075506A (en) * | 2015-10-27 | 2018-07-04 | 소니 주식회사 | Information processing apparatus, information processing method, and program |
WO2023074477A1 (en) * | 2021-11-01 | 2023-05-04 | ソニーグループ株式会社 | Information processing device and information processing method |
WO2023074897A1 (en) * | 2021-11-01 | 2023-05-04 | ソニーグループ株式会社 | Information processing device, program, and information processing system |
WO2023095742A1 (en) * | 2021-11-29 | 2023-06-01 | ソニーグループ株式会社 | Information processing device and information processing method |
Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US6038339A (en) * | 1997-11-14 | 2000-03-14 | Hewlett-Packard Company | White point determination using correlation matrix memory |
US20020141639A1 (en) * | 2001-04-03 | 2002-10-03 | John Steinberg | Method and apparatus for automated image correction for digital image acquisition |
US20020150290A1 (en) * | 2001-04-13 | 2002-10-17 | Robins Mark N. | Method and apparatus for color comparison in a digital camera |
Family Cites Families (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JPH05103336A (en) * | 1991-10-11 | 1993-04-23 | Olympus Optical Co Ltd | Color video signal processing device and color correcting method for color video signal |
JP3912813B2 (en) * | 1996-02-23 | 2007-05-09 | 株式会社東芝 | Color image processing system |
JP3729252B2 (en) * | 2001-03-26 | 2005-12-21 | セイコーエプソン株式会社 | Image processing system, program, and information storage medium |
JP2003134526A (en) * | 2001-10-19 | 2003-05-09 | Univ Waseda | Apparatus and method for color reproduction |
JP2004032399A (en) * | 2002-06-26 | 2004-01-29 | Olympus Corp | Picture color reproduction system, picture color reproduction program, and method for reproducing picture color |
JP2006019956A (en) * | 2004-06-30 | 2006-01-19 | Fuji Xerox Co Ltd | Device and method for color processing |
JP4115987B2 (en) * | 2004-11-26 | 2008-07-09 | 京セラミタ株式会社 | Image reading device |
JP4540492B2 (en) * | 2005-01-28 | 2010-09-08 | Hoya株式会社 | Color conversion matrix calculation method and image signal processing apparatus |
-
2007
- 2007-03-08 KR KR1020097021027A patent/KR101099844B1/en active IP Right Grant
- 2007-03-08 EP EP07752455A patent/EP2127357A1/en not_active Ceased
- 2007-03-08 WO PCT/US2007/005759 patent/WO2008108761A1/en active Application Filing
- 2007-03-08 CN CN200780052908A patent/CN101669356A/en active Pending
- 2007-03-08 JP JP2009552648A patent/JP2010521098A/en active Pending
Patent Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US6038339A (en) * | 1997-11-14 | 2000-03-14 | Hewlett-Packard Company | White point determination using correlation matrix memory |
US20020141639A1 (en) * | 2001-04-03 | 2002-10-03 | John Steinberg | Method and apparatus for automated image correction for digital image acquisition |
US20020150290A1 (en) * | 2001-04-13 | 2002-10-17 | Robins Mark N. | Method and apparatus for color comparison in a digital camera |
Non-Patent Citations (3)
Title |
---|
DATABASE COMPENDEX [online] ENGINEERING INFORMATION, INC., NEW YORK, NY, US; HARVILLE MICHAEL ET AL: "Consistent image-based measurement and classification of skin color", XP002452466, Database accession no. E20064210175471 * |
PROC. INT. CONF. IMAGE PROCESS. ICIP; PROCEEDINGS - INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, ICIP; IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING 2005, ICIP 2005 2005, vol. 2, 2005, pages 374 - 377 * |
See also references of EP2127357A1 * |
Also Published As
Publication number | Publication date |
---|---|
KR20100005069A (en) | 2010-01-13 |
EP2127357A1 (en) | 2009-12-02 |
JP2010521098A (en) | 2010-06-17 |
CN101669356A (en) | 2010-03-10 |
KR101099844B1 (en) | 2011-12-27 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US7522767B2 (en) | True color communication | |
WO2018016572A1 (en) | Display correction apparatus, program, and display correction system | |
JP5270346B2 (en) | Multimedia color management system | |
US7072507B2 (en) | Image processing apparatus and method | |
US8896706B2 (en) | Colour calibration method for an image capture device | |
US20030142374A1 (en) | Digital camera for image device calibration | |
US7599553B2 (en) | Image processing apparatus and method that perform color matching using detected uniformity | |
JP2009524841A (en) | Correction of super-resolution display | |
US7639401B2 (en) | Camera-based method for calibrating color displays | |
JP2001189875A (en) | Configuration of profile to compensate nonlinearity of image acquisition | |
EP1467555A2 (en) | Producing a balanced digital color image having minimal color errors | |
US20090116082A1 (en) | Image conversion apparatus, image conversion program storage medium, and image display system | |
Madi et al. | Color constancy for visual compensation of projector displayed image | |
WO2008108761A1 (en) | True color communication | |
US7639260B2 (en) | Camera-based system for calibrating color displays | |
US9024962B2 (en) | Method for adjusting the settings of a reproduction color device | |
JP2007081683A (en) | Image processing device and method therefor | |
JPH11232451A (en) | Adapting method of color representation to image observed in environments of different relative luminance levels | |
Lee et al. | Colour matching for soft proofing using a camera | |
Bala et al. | A camera-based method for calibrating projection color displays | |
Bala et al. | Efficient and simple methods for display tone‐response characterization | |
Allen | Color Measurement and Calibration in Medical Photography | |
Murphy | A review of standards defining testing procedures for characterizing the color and spatial quality of digital cameras used to image cultural heritage | |
Zhang | Appearance-based image splitting for HDR display systems | |
WO2000054213A1 (en) | System for color balancing animations and the like |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
WWE | Wipo information: entry into national phase |
Ref document number: 200780052908.5 Country of ref document: CN |
|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 07752455 Country of ref document: EP Kind code of ref document: A1 |
|
WWE | Wipo information: entry into national phase |
Ref document number: 2009552648 Country of ref document: JP Ref document number: 5248/CHENP/2009 Country of ref document: IN |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
WWE | Wipo information: entry into national phase |
Ref document number: 2007752455 Country of ref document: EP |
|
ENP | Entry into the national phase |
Ref document number: 20097021027 Country of ref document: KR Kind code of ref document: A |